Jul 13 15:24:05.118208 ip-10-0-140-255 systemd[1]: Starting Kubernetes Kubelet...
Jul 13 15:24:05.553219 ip-10-0-140-255 kubenswrapper[2564]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 13 15:24:05.553219 ip-10-0-140-255 kubenswrapper[2564]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jul 13 15:24:05.553219 ip-10-0-140-255 kubenswrapper[2564]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 13 15:24:05.553219 ip-10-0-140-255 kubenswrapper[2564]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jul 13 15:24:05.553219 ip-10-0-140-255 kubenswrapper[2564]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 13 15:24:05.555192 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:05.555095    2564 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jul 13 15:24:05.559453 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:24:05.559435    2564 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 13 15:24:05.559453 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:24:05.559452    2564 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 13 15:24:05.559453 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:24:05.559456    2564 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 13 15:24:05.559587 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:24:05.559460    2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 13 15:24:05.559587 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:24:05.559463    2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 13 15:24:05.559587 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:24:05.559467    2564 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 13 15:24:05.559587 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:24:05.559470    2564 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 13 15:24:05.559587 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:24:05.559473    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 13 15:24:05.559587 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:24:05.559476    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 13 15:24:05.559587 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:24:05.559479    2564 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 13 15:24:05.559587 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:24:05.559482    2564 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 13 15:24:05.559587 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:24:05.559485    2564 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 13 15:24:05.559587 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:24:05.559488    2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 13 15:24:05.559587 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:24:05.559491    2564 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 13 15:24:05.559587 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:24:05.559494    2564 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 13 15:24:05.559587 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:24:05.559497    2564 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 13 15:24:05.559587 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:24:05.559499    2564 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 13 15:24:05.559587 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:24:05.559502    2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 13 15:24:05.559587 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:24:05.559505    2564 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 13 15:24:05.559587 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:24:05.559507    2564 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 13 15:24:05.559587 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:24:05.559517    2564 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 13 15:24:05.559587 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:24:05.559520    2564 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 13 15:24:05.559587 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:24:05.559523    2564 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 13 15:24:05.560072 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:24:05.559526    2564 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 13 15:24:05.560072 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:24:05.559529    2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 13 15:24:05.560072 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:24:05.559531    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 13 15:24:05.560072 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:24:05.559534    2564 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 13 15:24:05.560072 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:24:05.559536    2564 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 13 15:24:05.560072 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:24:05.559539    2564 feature_gate.go:328] unrecognized feature gate: Example2
Jul 13 15:24:05.560072 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:24:05.559541    2564 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 13 15:24:05.560072 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:24:05.559544    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 13 15:24:05.560072 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:24:05.559547    2564 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 13 15:24:05.560072 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:24:05.559554    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 13 15:24:05.560072 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:24:05.559556    2564 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 13 15:24:05.560072 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:24:05.559559    2564 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 13 15:24:05.560072 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:24:05.559562    2564 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 13 15:24:05.560072 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:24:05.559565    2564 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 13 15:24:05.560072 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:24:05.559568    2564 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 13 15:24:05.560072 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:24:05.559570    2564 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 13 15:24:05.560072 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:24:05.559574    2564 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 13 15:24:05.560072 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:24:05.559578    2564 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 13 15:24:05.560072 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:24:05.559581    2564 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 13 15:24:05.560529 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:24:05.559584    2564 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 13 15:24:05.560529 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:24:05.559587    2564 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 13 15:24:05.560529 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:24:05.559590    2564 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 13 15:24:05.560529 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:24:05.559593    2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 13 15:24:05.560529 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:24:05.559596    2564 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 13 15:24:05.560529 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:24:05.559599    2564 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 13 15:24:05.560529 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:24:05.559603    2564 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 13 15:24:05.560529 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:24:05.559606    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 13 15:24:05.560529 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:24:05.559608    2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 13 15:24:05.560529 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:24:05.559612    2564 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 13 15:24:05.560529 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:24:05.559615    2564 feature_gate.go:328] unrecognized feature gate: Example
Jul 13 15:24:05.560529 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:24:05.559618    2564 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 13 15:24:05.560529 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:24:05.559621    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 13 15:24:05.560529 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:24:05.559623    2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 13 15:24:05.560529 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:24:05.559626    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 13 15:24:05.560529 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:24:05.559629    2564 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 13 15:24:05.560529 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:24:05.559632    2564 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 13 15:24:05.560529 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:24:05.559634    2564 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 13 15:24:05.560529 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:24:05.559637    2564 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 13 15:24:05.560529 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:24:05.559639    2564 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 13 15:24:05.561018 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:24:05.559642    2564 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 13 15:24:05.561018 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:24:05.559645    2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 13 15:24:05.561018 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:24:05.559648    2564 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 13 15:24:05.561018 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:24:05.559650    2564 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 13 15:24:05.561018 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:24:05.559653    2564 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 13 15:24:05.561018 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:24:05.559655    2564 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 13 15:24:05.561018 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:24:05.559659    2564 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 13 15:24:05.561018 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:24:05.559662    2564 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 13 15:24:05.561018 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:24:05.559664    2564 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 13 15:24:05.561018 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:24:05.559667    2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 13 15:24:05.561018 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:24:05.559670    2564 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 13 15:24:05.561018 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:24:05.559673    2564 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 13 15:24:05.561018 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:24:05.559675    2564 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 13 15:24:05.561018 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:24:05.559678    2564 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 13 15:24:05.561018 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:24:05.559680    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 13 15:24:05.561018 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:24:05.559683    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 13 15:24:05.561018 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:24:05.559685    2564 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 13 15:24:05.561018 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:24:05.559688    2564 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 13 15:24:05.561018 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:24:05.559691    2564 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 13 15:24:05.561018 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:24:05.559695    2564 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 13 15:24:05.561499 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:24:05.559698    2564 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 13 15:24:05.561499 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:24:05.559701    2564 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 13 15:24:05.561499 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:24:05.559704    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 13 15:24:05.561499 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:24:05.559706    2564 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 13 15:24:05.561499 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:24:05.559710    2564 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 13 15:24:05.561499 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:24:05.559713    2564 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 13 15:24:05.561499 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:24:05.559717    2564 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 13 15:24:05.561499 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:24:05.559721    2564 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 13 15:24:05.561499 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:24:05.559724    2564 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 13 15:24:05.561499 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:24:05.559727    2564 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 13 15:24:05.561499 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:24:05.559729    2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 13 15:24:05.561499 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:24:05.559732    2564 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 13 15:24:05.561499 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:24:05.559735    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 13 15:24:05.561499 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:24:05.559737    2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 13 15:24:05.561499 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:24:05.559740    2564 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 13 15:24:05.561499 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:24:05.559742    2564 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 13 15:24:05.561499 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:24:05.559745    2564 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 13 15:24:05.561499 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:24:05.560476    2564 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 13 15:24:05.561499 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:24:05.560483    2564 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 13 15:24:05.561976 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:24:05.560487    2564 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 13 15:24:05.561976 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:24:05.560490    2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 13 15:24:05.561976 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:24:05.560493    2564 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 13 15:24:05.561976 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:24:05.560496    2564 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 13 15:24:05.561976 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:24:05.560499    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 13 15:24:05.561976 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:24:05.560502    2564 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 13 15:24:05.561976 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:24:05.560505    2564 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 13 15:24:05.561976 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:24:05.560507    2564 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 13 15:24:05.561976 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:24:05.560510    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 13 15:24:05.561976 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:24:05.560512    2564 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 13 15:24:05.561976 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:24:05.560515    2564 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 13 15:24:05.561976 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:24:05.560517    2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 13 15:24:05.561976 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:24:05.560520    2564 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 13 15:24:05.561976 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:24:05.560523    2564 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 13 15:24:05.561976 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:24:05.560525    2564 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 13 15:24:05.561976 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:24:05.560530    2564 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 13 15:24:05.561976 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:24:05.560534    2564 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 13 15:24:05.561976 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:24:05.560538    2564 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 13 15:24:05.561976 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:24:05.560542    2564 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 13 15:24:05.562466 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:24:05.560546    2564 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 13 15:24:05.562466 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:24:05.560549    2564 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 13 15:24:05.562466 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:24:05.560551    2564 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 13 15:24:05.562466 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:24:05.560554    2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 13 15:24:05.562466 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:24:05.560556    2564 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 13 15:24:05.562466 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:24:05.560559    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 13 15:24:05.562466 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:24:05.560562    2564 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 13 15:24:05.562466 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:24:05.560565    2564 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 13 15:24:05.562466 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:24:05.560567    2564 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 13 15:24:05.562466 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:24:05.560570    2564 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 13 15:24:05.562466 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:24:05.560573    2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 13 15:24:05.562466 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:24:05.560576    2564 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 13 15:24:05.562466 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:24:05.560578    2564 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 13 15:24:05.562466 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:24:05.560581    2564 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 13 15:24:05.562466 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:24:05.560583    2564 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 13 15:24:05.562466 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:24:05.560586    2564 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 13 15:24:05.562466 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:24:05.560589    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 13 15:24:05.562466 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:24:05.560594    2564 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 13 15:24:05.562466 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:24:05.560597    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 13 15:24:05.562938 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:24:05.560600    2564 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 13 15:24:05.562938 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:24:05.560603    2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 13 15:24:05.562938 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:24:05.560606    2564 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 13 15:24:05.562938 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:24:05.560609    2564 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 13 15:24:05.562938 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:24:05.560613    2564 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 13 15:24:05.562938 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:24:05.560616    2564 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 13 15:24:05.562938 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:24:05.560618    2564 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 13 15:24:05.562938 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:24:05.560620    2564 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 13 15:24:05.562938 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:24:05.560623    2564 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 13 15:24:05.562938 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:24:05.560625    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 13 15:24:05.562938 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:24:05.560628    2564 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 13 15:24:05.562938 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:24:05.560630    2564 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 13 15:24:05.562938 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:24:05.560633    2564 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 13 15:24:05.562938 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:24:05.560635    2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 13 15:24:05.562938 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:24:05.560638    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 13 15:24:05.562938 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:24:05.560640    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 13 15:24:05.562938 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:24:05.560643    2564 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 13 15:24:05.562938 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:24:05.560646    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 13 15:24:05.562938 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:24:05.560649    2564 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 13 15:24:05.562938 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:24:05.560651    2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 13 15:24:05.563425 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:24:05.560654    2564 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 13 15:24:05.563425 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:24:05.560657    2564 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 13 15:24:05.563425 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:24:05.560659    2564 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 13 15:24:05.563425 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:24:05.560662    2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 13 15:24:05.563425 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:24:05.560665    2564 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 13 15:24:05.563425 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:24:05.560668    2564 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 13 15:24:05.563425 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:24:05.560672    2564 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 13 15:24:05.563425 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:24:05.560674    2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 13 15:24:05.563425 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:24:05.560677    2564 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 13 15:24:05.563425 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:24:05.560679    2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 13 15:24:05.563425 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:24:05.560682    2564 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 13 15:24:05.563425 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:24:05.560685    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 13 15:24:05.563425 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:24:05.560688    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 13 15:24:05.563425 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:24:05.560691    2564 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 13 15:24:05.563425 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:24:05.560693    2564 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 13 15:24:05.563425 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:24:05.560696    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 13 15:24:05.563425 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:24:05.560699    2564 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 13 15:24:05.563425 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:24:05.560701    2564 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 13 15:24:05.563425 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:24:05.560704    2564 feature_gate.go:328] unrecognized feature gate: Example
Jul 13 15:24:05.563425 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:24:05.560707    2564 feature_gate.go:328] unrecognized feature gate: Example2
Jul 13 15:24:05.563909 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:24:05.560709    2564 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 13 15:24:05.563909 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:24:05.560712    2564 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 13 15:24:05.563909 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:24:05.560714    2564 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 13 15:24:05.563909 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:24:05.560717    2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 13 15:24:05.563909 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:24:05.560719    2564 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 13 15:24:05.563909 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:24:05.560722    2564 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 13 15:24:05.563909 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:24:05.560724    2564 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 13 15:24:05.563909 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:24:05.560727    2564 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 13 15:24:05.563909 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:24:05.560729    2564 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 13 15:24:05.563909 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:24:05.560732    2564 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 13 15:24:05.563909 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:24:05.560735    2564 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 13 15:24:05.563909 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:24:05.560737    2564 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 13 15:24:05.563909 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:24:05.560740    2564 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 13 15:24:05.563909 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:24:05.560742    2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 13 15:24:05.563909 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:24:05.560745    2564 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 13 15:24:05.563909 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:24:05.560748    2564 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 13 15:24:05.563909 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:24:05.560751    2564 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 13 15:24:05.563909 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:24:05.560753    2564 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 13 15:24:05.563909 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:24:05.560756    2564 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 13 15:24:05.563909 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:24:05.561144    2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 13 15:24:05.564399 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:24:05.561149    2564 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 13 15:24:05.564399 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:24:05.561152    2564 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 13 15:24:05.564399 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:24:05.561155    2564 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 13 15:24:05.564399 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:24:05.561158    2564 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 13 15:24:05.564399 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:24:05.561161    2564 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 13 15:24:05.564399 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:24:05.561164    2564 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 13 15:24:05.564399 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:24:05.561166    2564 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 13 15:24:05.564399 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:24:05.561170    2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 13 15:24:05.564399 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:24:05.561172    2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 13 15:24:05.564399 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:24:05.561177    2564 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 13 15:24:05.564399 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:24:05.561180    2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 13 15:24:05.564399 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:24:05.561184    2564 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 13 15:24:05.564399 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:24:05.561187    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 13 15:24:05.564399 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:24:05.561190    2564 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 13 15:24:05.564399 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:24:05.561193    2564 feature_gate.go:328] unrecognized feature gate: Example
Jul 13 15:24:05.564399 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:24:05.561196    2564 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 13 15:24:05.564399 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:24:05.561199    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 13 15:24:05.564399 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:24:05.561205    2564 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 13 15:24:05.564399 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:24:05.561208    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 13 15:24:05.564845 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:24:05.561210    2564 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 13 15:24:05.564845 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:24:05.561213    2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 13 15:24:05.564845 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:24:05.561216    2564 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 13 15:24:05.564845 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:24:05.561219    2564 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 13 15:24:05.564845 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:24:05.561221    2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 13 15:24:05.564845 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:24:05.561224    2564 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 13 15:24:05.564845 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:24:05.561227    2564 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 13 15:24:05.564845 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:24:05.561229    2564 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 13 15:24:05.564845 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:24:05.561232    2564 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 13 15:24:05.564845 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:24:05.561235    2564 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 13 15:24:05.564845 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:24:05.561237    2564 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 13 15:24:05.564845 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:24:05.561240    2564 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 13 15:24:05.564845 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:24:05.561244    2564 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 13 15:24:05.564845 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:24:05.561248    2564 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 13 15:24:05.564845 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:24:05.561251    2564 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 13 15:24:05.564845 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:24:05.561253    2564 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 13 15:24:05.564845 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:24:05.561257    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 13 15:24:05.564845 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:24:05.561260    2564 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 13 15:24:05.564845 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:24:05.561263    2564 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 13 15:24:05.565309 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:24:05.561267    2564 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 13 15:24:05.565309 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:24:05.561271    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 13 15:24:05.565309 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:24:05.561273    2564 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 13 15:24:05.565309 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:24:05.561276    2564 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 13 15:24:05.565309 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:24:05.561279    2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 13 15:24:05.565309 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:24:05.561282    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 13 15:24:05.565309 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:24:05.561285    2564 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 13 15:24:05.565309 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:24:05.561288    2564 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 13 15:24:05.565309 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:24:05.561290    2564 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 13 15:24:05.565309 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:24:05.561293    2564 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 13 15:24:05.565309 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:24:05.561296    2564 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 13 15:24:05.565309 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:24:05.561302    2564 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 13 15:24:05.565309 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:24:05.561304    2564 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 13 15:24:05.565309 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:24:05.561307    2564 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 13 15:24:05.565309 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:24:05.561310    2564 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 13 15:24:05.565309 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:24:05.561312    2564 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 13 15:24:05.565309 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:24:05.561317    2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 13 15:24:05.565309 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:24:05.561319    2564 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 13 15:24:05.565309 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:24:05.561322    2564 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 13 15:24:05.565781 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:24:05.561325    2564 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 13 15:24:05.565781 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:24:05.561327    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 13 15:24:05.565781 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:24:05.561330    2564 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 13 15:24:05.565781 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:24:05.561332    2564 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 13 15:24:05.565781 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:24:05.561335    2564 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 13 15:24:05.565781 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:24:05.561337    2564 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 13 15:24:05.565781 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:24:05.561340    2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 13 15:24:05.565781 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:24:05.561343    2564 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 13 15:24:05.565781 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:24:05.561345    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 13 15:24:05.565781 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:24:05.561348    2564 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 13 15:24:05.565781 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:24:05.561351    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 13 15:24:05.565781 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:24:05.561353    2564 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 13 15:24:05.565781 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:24:05.561356    2564 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 13 15:24:05.565781 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:24:05.561359    2564 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 13 15:24:05.565781 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:24:05.561362    2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 13 15:24:05.565781 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:24:05.561365    2564 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 13 15:24:05.565781 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:24:05.561367    2564 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 13 15:24:05.565781 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:24:05.561370    2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 13 15:24:05.565781 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:24:05.561372    2564 feature_gate.go:328] unrecognized feature gate: Example2
Jul 13 15:24:05.565781 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:24:05.561375    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 13 15:24:05.566275 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:24:05.561377    2564 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 13 15:24:05.566275 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:24:05.561380    2564 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 13 15:24:05.566275 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:24:05.561382    2564 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 13 15:24:05.566275 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:24:05.561385    2564 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 13 15:24:05.566275 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:24:05.561389    2564 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 13 15:24:05.566275 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:24:05.561391    2564 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 13 15:24:05.566275 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:24:05.561394    2564 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 13 15:24:05.566275 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:24:05.561397    2564 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 13 15:24:05.566275 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:24:05.561399    2564 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 13 15:24:05.566275 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:24:05.561403    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 13 15:24:05.566275 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:24:05.561406    2564 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 13 15:24:05.566275 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:24:05.561408    2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 13 15:24:05.566275 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:24:05.561411    2564 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 13 15:24:05.566275 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:24:05.561414    2564 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 13 15:24:05.566275 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:24:05.561416    2564 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 13 15:24:05.566275 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:24:05.561419    2564 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 13 15:24:05.566275 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:24:05.561421    2564 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 13 15:24:05.566275 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:24:05.561424    2564 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 13 15:24:05.566275 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:24:05.561426    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 13 15:24:05.566275 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:24:05.561429    2564 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 13 15:24:05.566749 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:24:05.561431    2564 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 13 15:24:05.566749 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:05.561509    2564 flags.go:64] FLAG: --address="0.0.0.0"
Jul 13 15:24:05.566749 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:05.561516    2564 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jul 13 15:24:05.566749 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:05.561523    2564 flags.go:64] FLAG: --anonymous-auth="true"
Jul 13 15:24:05.566749 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:05.561528    2564 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jul 13 15:24:05.566749 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:05.561533    2564 flags.go:64] FLAG: --authentication-token-webhook="false"
Jul 13 15:24:05.566749 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:05.561537    2564 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jul 13 15:24:05.566749 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:05.561541    2564 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jul 13 15:24:05.566749 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:05.561546    2564 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jul 13 15:24:05.566749 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:05.561549    2564 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jul 13 15:24:05.566749 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:05.561552    2564 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jul 13 15:24:05.566749 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:05.561555    2564 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jul 13 15:24:05.566749 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:05.561558    2564 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jul 13 15:24:05.566749 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:05.561562    2564 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jul 13 15:24:05.566749 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:05.561565    2564 flags.go:64] FLAG: --cgroup-root=""
Jul 13 15:24:05.566749 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:05.561568    2564 flags.go:64] FLAG: --cgroups-per-qos="true"
Jul 13 15:24:05.566749 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:05.561572    2564 flags.go:64] FLAG: --client-ca-file=""
Jul 13 15:24:05.566749 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:05.561575    2564 flags.go:64] FLAG: --cloud-provider="external"
Jul 13 15:24:05.566749 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:05.561578    2564 flags.go:64] FLAG: --cluster-dns="[]"
Jul 13 15:24:05.566749 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:05.561582    2564 flags.go:64] FLAG: --cluster-domain=""
Jul 13 15:24:05.566749 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:05.561585    2564 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jul 13 15:24:05.566749 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:05.561589    2564 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jul 13 15:24:05.566749 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:05.561592    2564 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jul 13 15:24:05.566749 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:05.561595    2564 flags.go:64] FLAG: --container-log-max-files="5"
Jul 13 15:24:05.567363 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:05.561599    2564 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jul 13 15:24:05.567363 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:05.561603    2564 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jul 13 15:24:05.567363 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:05.561606    2564 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jul 13 15:24:05.567363 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:05.561610    2564 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jul 13 15:24:05.567363 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:05.561613    2564 flags.go:64] FLAG: --contention-profiling="false"
Jul 13 15:24:05.567363 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:05.561616    2564 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jul 13 15:24:05.567363 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:05.561619    2564 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jul 13 15:24:05.567363 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:05.561622    2564 flags.go:64] FLAG: --cpu-manager-policy="none"
Jul 13 15:24:05.567363 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:05.561625    2564 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jul 13 15:24:05.567363 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:05.561629    2564 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jul 13 15:24:05.567363 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:05.561632    2564 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jul 13 15:24:05.567363 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:05.561635    2564 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jul 13 15:24:05.567363 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:05.561638    2564 flags.go:64] FLAG: --enable-load-reader="false"
Jul 13 15:24:05.567363 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:05.561641    2564 flags.go:64] FLAG: --enable-server="true"
Jul 13 15:24:05.567363 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:05.561645    2564 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jul 13 15:24:05.567363 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:05.561649    2564 flags.go:64] FLAG: --event-burst="100"
Jul 13 15:24:05.567363 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:05.561652    2564 flags.go:64] FLAG: --event-qps="50"
Jul 13 15:24:05.567363 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:05.561655    2564 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jul 13 15:24:05.567363 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:05.561658    2564 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jul 13 15:24:05.567363 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:05.561661    2564 flags.go:64] FLAG: --eviction-hard=""
Jul 13 15:24:05.567363 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:05.561665    2564 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jul 13 15:24:05.567363 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:05.561668    2564 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jul 13 15:24:05.567363 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:05.561671    2564 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jul 13 15:24:05.567363 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:05.561674    2564 flags.go:64] FLAG: --eviction-soft=""
Jul 13 15:24:05.567363 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:05.561677    2564 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jul 13 15:24:05.568072 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:05.561680    2564 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jul 13 15:24:05.568072 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:05.561683    2564 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jul 13 15:24:05.568072 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:05.561686    2564 flags.go:64] FLAG: --experimental-mounter-path=""
Jul 13 15:24:05.568072 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:05.561689    2564 flags.go:64] FLAG: --fail-cgroupv1="false"
Jul 13 15:24:05.568072 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:05.561693    2564 flags.go:64] FLAG: --fail-swap-on="true"
Jul 13 15:24:05.568072 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:05.561696    2564 flags.go:64] FLAG: --feature-gates=""
Jul 13 15:24:05.568072 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:05.561700    2564 flags.go:64] FLAG: --file-check-frequency="20s"
Jul 13 15:24:05.568072 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:05.561703    2564 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jul 13 15:24:05.568072 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:05.561706    2564 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jul 13 15:24:05.568072 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:05.561709    2564 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jul 13 15:24:05.568072 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:05.561712    2564 flags.go:64] FLAG: --healthz-port="10248"
Jul 13 15:24:05.568072 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:05.561715    2564 flags.go:64] FLAG: --help="false"
Jul 13 15:24:05.568072 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:05.561718    2564 flags.go:64] FLAG: --hostname-override="ip-10-0-140-255.ec2.internal"
Jul 13 15:24:05.568072 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:05.561721    2564 flags.go:64] FLAG: --housekeeping-interval="10s"
Jul 13 15:24:05.568072 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:05.561724    2564 flags.go:64] FLAG: --http-check-frequency="20s"
Jul 13 15:24:05.568072 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:05.561728    2564 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jul 13 15:24:05.568072 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:05.561731    2564 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jul 13 15:24:05.568072 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:05.561735    2564 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jul 13 15:24:05.568072 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:05.561738    2564 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jul 13 15:24:05.568072 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:05.561741    2564 flags.go:64] FLAG: --image-service-endpoint=""
Jul 13 15:24:05.568072 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:05.561744    2564 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jul 13 15:24:05.568072 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:05.561747    2564 flags.go:64] FLAG: --kube-api-burst="100"
Jul 13 15:24:05.568072 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:05.561750    2564 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jul 13 15:24:05.569112 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:05.561753    2564 flags.go:64] FLAG: --kube-api-qps="50"
Jul 13 15:24:05.569112 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:05.561756    2564 flags.go:64] FLAG: --kube-reserved=""
Jul 13 15:24:05.569112 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:05.561759    2564 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jul 13 15:24:05.569112 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:05.561762    2564 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jul 13 15:24:05.569112 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:05.561765    2564 flags.go:64] FLAG: --kubelet-cgroups=""
Jul 13 15:24:05.569112 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:05.561768    2564 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jul 13 15:24:05.569112 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:05.561771    2564 flags.go:64] FLAG: --lock-file=""
Jul 13 15:24:05.569112 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:05.561774    2564 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jul 13 15:24:05.569112 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:05.561777    2564 flags.go:64] FLAG: --log-flush-frequency="5s"
Jul 13 15:24:05.569112 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:05.561780    2564 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jul 13 15:24:05.569112 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:05.561786    2564 flags.go:64] FLAG: --log-json-split-stream="false"
Jul 13 15:24:05.569112 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:05.561789    2564 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jul 13 15:24:05.569112 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:05.561792    2564 flags.go:64] FLAG: --log-text-split-stream="false"
Jul 13 15:24:05.569112 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:05.561795    2564 flags.go:64] FLAG: --logging-format="text"
Jul 13 15:24:05.569112 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:05.561797    2564 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jul 13 15:24:05.569112 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:05.561801    2564 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jul 13 15:24:05.569112 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:05.561803    2564 flags.go:64] FLAG: --manifest-url=""
Jul 13 15:24:05.569112 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:05.561806    2564 flags.go:64] FLAG: --manifest-url-header=""
Jul 13 15:24:05.569112 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:05.561811    2564 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jul 13 15:24:05.569112 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:05.561814    2564 flags.go:64] FLAG: --max-open-files="1000000"
Jul 13 15:24:05.569112 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:05.561818    2564 flags.go:64] FLAG: --max-pods="110"
Jul 13 15:24:05.569112 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:05.561821    2564 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jul 13 15:24:05.569112 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:05.561824    2564 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jul 13 15:24:05.569112 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:05.561827    2564 flags.go:64] FLAG: --memory-manager-policy="None"
Jul 13 15:24:05.569112 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:05.561830    2564 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jul 13 15:24:05.570161 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:05.561832    2564 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jul 13 15:24:05.570161 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:05.561835    2564 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jul 13 15:24:05.570161 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:05.561838    2564 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jul 13 15:24:05.570161 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:05.561846    2564 flags.go:64] FLAG: --node-status-max-images="50"
Jul 13 15:24:05.570161 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:05.561849    2564 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jul 13 15:24:05.570161 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:05.561852    2564 flags.go:64] FLAG: --oom-score-adj="-999"
Jul 13 15:24:05.570161 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:05.561855    2564 flags.go:64] FLAG: --pod-cidr=""
Jul 13 15:24:05.570161 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:05.561858    2564 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b04c0b1f73af4d021dd8f0b51bfeb302c24482c093de5f2c43654ab56c506926"
Jul 13 15:24:05.570161 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:05.561864    2564 flags.go:64] FLAG: --pod-manifest-path=""
Jul 13 15:24:05.570161 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:05.561867    2564 flags.go:64] FLAG: --pod-max-pids="-1"
Jul 13 15:24:05.570161 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:05.561870    2564 flags.go:64] FLAG: --pods-per-core="0"
Jul 13 15:24:05.570161 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:05.561873    2564 flags.go:64] FLAG: --port="10250"
Jul 13 15:24:05.570161 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:05.561876    2564 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jul 13 15:24:05.570161 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:05.561879    2564 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0d7299d5e06aa3b26"
Jul 13 15:24:05.570161 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:05.561882    2564 flags.go:64] FLAG: --qos-reserved=""
Jul 13 15:24:05.570161 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:05.561885    2564 flags.go:64] FLAG: --read-only-port="10255"
Jul 13 15:24:05.570161 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:05.561902    2564 flags.go:64] FLAG: --register-node="true"
Jul 13 15:24:05.570161 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:05.561906    2564 flags.go:64] FLAG: --register-with-taints=""
Jul 13 15:24:05.570161 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:05.561909    2564 flags.go:64] FLAG: --registry-burst="10"
Jul 13 15:24:05.570161 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:05.561912    2564 flags.go:64] FLAG: --registry-qps="5"
Jul 13 15:24:05.570161 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:05.561915    2564 flags.go:64] FLAG: --reserved-cpus=""
Jul 13 15:24:05.570161 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:05.561918    2564 flags.go:64] FLAG: --reserved-memory=""
Jul 13 15:24:05.570161 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:05.561922    2564 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jul 13 15:24:05.570161 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:05.561925    2564 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jul 13 15:24:05.570161 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:05.561928    2564 flags.go:64] FLAG: --rotate-certificates="false"
Jul 13 15:24:05.570764 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:05.561931    2564 flags.go:64] FLAG: --rotate-server-certificates="false"
Jul 13 15:24:05.570764 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:05.561934    2564 flags.go:64] FLAG: --runonce="false"
Jul 13 15:24:05.570764 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:05.561937    2564 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jul 13 15:24:05.570764 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:05.561940    2564 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jul 13 15:24:05.570764 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:05.561943    2564 flags.go:64] FLAG: --seccomp-default="false"
Jul 13 15:24:05.570764 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:05.561946    2564 flags.go:64] FLAG: --serialize-image-pulls="true"
Jul 13 15:24:05.570764 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:05.561949    2564 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jul 13 15:24:05.570764 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:05.561953    2564 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jul 13 15:24:05.570764 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:05.561956    2564 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jul 13 15:24:05.570764 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:05.561959    2564 flags.go:64] FLAG: --storage-driver-password="root"
Jul 13 15:24:05.570764 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:05.561962    2564 flags.go:64] FLAG: --storage-driver-secure="false"
Jul 13 15:24:05.570764 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:05.561965    2564 flags.go:64] FLAG: --storage-driver-table="stats"
Jul 13 15:24:05.570764 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:05.561968    2564 flags.go:64] FLAG: --storage-driver-user="root"
Jul 13 15:24:05.570764 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:05.561972    2564 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jul 13 15:24:05.570764 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:05.561975    2564 flags.go:64] FLAG: --sync-frequency="1m0s"
Jul 13 15:24:05.570764 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:05.561979    2564 flags.go:64] FLAG: --system-cgroups=""
Jul 13 15:24:05.570764 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:05.561982    2564 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jul 13 15:24:05.570764 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:05.561988    2564 flags.go:64] FLAG: --system-reserved-cgroup=""
Jul 13 15:24:05.570764 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:05.561991    2564 flags.go:64] FLAG: --tls-cert-file=""
Jul 13 15:24:05.570764 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:05.561994    2564 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jul 13 15:24:05.570764 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:05.561998    2564 flags.go:64] FLAG: --tls-min-version=""
Jul 13 15:24:05.570764 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:05.562001    2564 flags.go:64] FLAG: --tls-private-key-file=""
Jul 13 15:24:05.570764 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:05.562003    2564 flags.go:64] FLAG: --topology-manager-policy="none"
Jul 13 15:24:05.570764 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:05.562008    2564 flags.go:64] FLAG: --topology-manager-policy-options=""
Jul 13 15:24:05.570764 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:05.562011    2564 flags.go:64] FLAG: --topology-manager-scope="container"
Jul 13 15:24:05.571679 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:05.562014    2564 flags.go:64] FLAG: --v="2"
Jul 13 15:24:05.571679 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:05.562018    2564 flags.go:64] FLAG: --version="false"
Jul 13 15:24:05.571679 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:05.562022    2564 flags.go:64] FLAG: --vmodule=""
Jul 13 15:24:05.571679 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:05.562031    2564 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jul 13 15:24:05.571679 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:05.562034    2564 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jul 13 15:24:05.571679 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:24:05.562148    2564 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 13 15:24:05.571679 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:24:05.562153    2564 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 13 15:24:05.571679 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:24:05.562156    2564 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 13 15:24:05.571679 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:24:05.562159    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 13 15:24:05.571679 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:24:05.562162    2564 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 13 15:24:05.571679 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:24:05.562165    2564 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 13 15:24:05.571679 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:24:05.562168    2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 13 15:24:05.571679 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:24:05.562171    2564 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 13 15:24:05.571679 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:24:05.562173    2564 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 13 15:24:05.571679 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:24:05.562176    2564 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 13 15:24:05.571679 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:24:05.562179    2564 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 13 15:24:05.571679 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:24:05.562181    2564 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 13 15:24:05.571679 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:24:05.562184    2564 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 13 15:24:05.571679 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:24:05.562186    2564 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 13 15:24:05.571679 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:24:05.562191    2564 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 13 15:24:05.571679 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:24:05.562196    2564 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 13 15:24:05.572611 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:24:05.562200    2564 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 13 15:24:05.572611 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:24:05.562202    2564 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 13 15:24:05.572611 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:24:05.562206    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 13 15:24:05.572611 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:24:05.562208    2564 feature_gate.go:328] unrecognized feature gate: Example
Jul 13 15:24:05.572611 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:24:05.562211    2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 13 15:24:05.572611 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:24:05.562214    2564 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 13 15:24:05.572611 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:24:05.562216    2564 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 13 15:24:05.572611 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:24:05.562219    2564 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 13 15:24:05.572611 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:24:05.562222    2564 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 13 15:24:05.572611 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:24:05.562227    2564 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 13 15:24:05.572611 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:24:05.562230    2564 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 13 15:24:05.572611 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:24:05.562233    2564 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 13 15:24:05.572611 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:24:05.562235    2564 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 13 15:24:05.572611 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:24:05.562238    2564 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 13 15:24:05.572611 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:24:05.562241    2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 13 15:24:05.572611 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:24:05.562243    2564 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 13 15:24:05.572611 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:24:05.562246    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 13 15:24:05.572611 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:24:05.562249    2564 feature_gate.go:328] unrecognized feature gate: Example2
Jul 13 15:24:05.572611 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:24:05.562252    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 13 15:24:05.572611 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:24:05.562254    2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 13 15:24:05.573418 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:24:05.562257    2564 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 13 15:24:05.573418 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:24:05.562260    2564 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 13 15:24:05.573418 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:24:05.562262    2564 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 13 15:24:05.573418 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:24:05.562265    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 13 15:24:05.573418 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:24:05.562267    2564 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 13 15:24:05.573418 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:24:05.562270    2564 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 13 15:24:05.573418 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:24:05.562273    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 13 15:24:05.573418 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:24:05.562275    2564 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 13 15:24:05.573418 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:24:05.562278    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 13 15:24:05.573418 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:24:05.562280    2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 13 15:24:05.573418 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:24:05.562283    2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 13 15:24:05.573418 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:24:05.562287    2564 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 13 15:24:05.573418 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:24:05.562289    2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 13 15:24:05.573418 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:24:05.562292    2564 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 13 15:24:05.573418 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:24:05.562294    2564 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 13 15:24:05.573418 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:24:05.562298    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 13 15:24:05.573418 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:24:05.562300    2564 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 13 15:24:05.573418 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:24:05.562303    2564 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 13 15:24:05.573418 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:24:05.562305    2564 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 13 15:24:05.573418 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:24:05.562308    2564 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 13 15:24:05.574021 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:24:05.562310    2564 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 13 15:24:05.574021 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:24:05.562314    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 13 15:24:05.574021 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:24:05.562316    2564 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 13 15:24:05.574021 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:24:05.562319    2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 13 15:24:05.574021 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:24:05.562321    2564 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 13 15:24:05.574021 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:24:05.562324    2564 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 13 15:24:05.574021 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:24:05.562326    2564 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 13 15:24:05.574021 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:24:05.562329    2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 13 15:24:05.574021 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:24:05.562332    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 13 15:24:05.574021 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:24:05.562334    2564 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 13 15:24:05.574021 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:24:05.562337    2564 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 13 15:24:05.574021 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:24:05.562340    2564 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 13 15:24:05.574021 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:24:05.562342    2564 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 13 15:24:05.574021 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:24:05.562345    2564 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 13 15:24:05.574021 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:24:05.562349    2564 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 13 15:24:05.574021 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:24:05.562352    2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 13 15:24:05.574021 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:24:05.562354    2564 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 13 15:24:05.574021 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:24:05.562357    2564 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 13 15:24:05.574021 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:24:05.562360    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 13 15:24:05.574021 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:24:05.562363    2564 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 13 15:24:05.574703 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:24:05.562366    2564 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 13 15:24:05.574703 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:24:05.562369    2564 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 13 15:24:05.574703 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:24:05.562372    2564 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 13 15:24:05.574703 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:24:05.562376    2564 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 13 15:24:05.574703 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:24:05.562378    2564 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 13 15:24:05.574703 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:24:05.562381    2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 13 15:24:05.574703 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:24:05.562383    2564 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 13 15:24:05.574703 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:24:05.562386    2564 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 13 15:24:05.574703 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:24:05.562389    2564 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 13 15:24:05.574703 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:24:05.562391    2564 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 13 15:24:05.574703 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:24:05.562394    2564 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 13 15:24:05.574703 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:24:05.562397    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 13 15:24:05.574703 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:24:05.562399    2564 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 13 15:24:05.574703 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:24:05.562403    2564 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 13 15:24:05.574703 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:24:05.562406    2564 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 13 15:24:05.574703 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:24:05.562408    2564 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 13 15:24:05.574703 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:24:05.562411    2564 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 13 15:24:05.574703 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:24:05.562413    2564 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 13 15:24:05.574703 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:24:05.562416    2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 13 15:24:05.575506 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:24:05.562418    2564 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 13 15:24:05.575506 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:24:05.562421    2564 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 13 15:24:05.575506 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:24:05.562423    2564 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 13 15:24:05.575506 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:24:05.562426    2564 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 13 15:24:05.575506 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:05.562431    2564 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 13 15:24:05.575506 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:05.570092    2564 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Jul 13 15:24:05.575506 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:05.570111    2564 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jul 13 15:24:05.575506 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:05.571007    2564 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jul 13 15:24:05.575506 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:05.571021    2564 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jul 13 15:24:05.575506 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:24:05.571142    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 13 15:24:05.575506 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:24:05.571151    2564 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 13 15:24:05.575506 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:24:05.571156    2564 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 13 15:24:05.575506 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:24:05.571161    2564 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 13 15:24:05.575506 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:24:05.571166    2564 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 13 15:24:05.575506 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:24:05.571171    2564 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 13 15:24:05.576014 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:24:05.571176    2564 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 13 15:24:05.576014 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:24:05.571181    2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 13 15:24:05.576014 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:24:05.571185    2564 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 13 15:24:05.576014 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:24:05.571189    2564 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 13 15:24:05.576014 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:24:05.571194    2564 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 13 15:24:05.576014 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:24:05.571198    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 13 15:24:05.576014 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:24:05.571203    2564 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 13 15:24:05.576014 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:24:05.571207    2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 13 15:24:05.576014 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:24:05.571212    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 13 15:24:05.576014 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:24:05.571216    2564 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 13 15:24:05.576014 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:24:05.571221    2564 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 13 15:24:05.576014 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:24:05.571225    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 13 15:24:05.576014 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:24:05.571229    2564 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 13 15:24:05.576014 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:24:05.571233    2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 13 15:24:05.576014 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:24:05.571237    2564 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 13 15:24:05.576014 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:24:05.571242    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 13 15:24:05.576014 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:24:05.571246    2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 13 15:24:05.576014 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:24:05.571251    2564 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 13 15:24:05.576014 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:24:05.571255    2564 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 13 15:24:05.576014 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:24:05.571260    2564 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 13 15:24:05.576637 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:24:05.571264    2564 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 13 15:24:05.576637 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:24:05.571268    2564 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 13 15:24:05.576637 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:24:05.571276    2564 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 13 15:24:05.576637 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:24:05.571283    2564 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 13 15:24:05.576637 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:24:05.571289    2564 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 13 15:24:05.576637 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:24:05.571294    2564 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 13 15:24:05.576637 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:24:05.571300    2564 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 13 15:24:05.576637 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:24:05.571304    2564 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 13 15:24:05.576637 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:24:05.571308    2564 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 13 15:24:05.576637 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:24:05.571313    2564 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 13 15:24:05.576637 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:24:05.571318    2564 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 13 15:24:05.576637 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:24:05.571322    2564 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 13 15:24:05.576637 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:24:05.571327    2564 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 13 15:24:05.576637 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:24:05.571332    2564 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 13 15:24:05.576637 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:24:05.571337    2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 13 15:24:05.576637 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:24:05.571341    2564 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 13 15:24:05.576637 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:24:05.571345    2564 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 13 15:24:05.576637 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:24:05.571350    2564 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 13 15:24:05.576637 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:24:05.571354    2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 13 15:24:05.577127 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:24:05.571358    2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 13 15:24:05.577127 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:24:05.571362    2564 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 13 15:24:05.577127 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:24:05.571367    2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 13 15:24:05.577127 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:24:05.571371    2564 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 13 15:24:05.577127 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:24:05.571375    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 13 15:24:05.577127 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:24:05.571380    2564 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 13 15:24:05.577127 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:24:05.571384    2564 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 13 15:24:05.577127 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:24:05.571388    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 13 15:24:05.577127 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:24:05.571393    2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 13 15:24:05.577127 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:24:05.571398    2564 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 13 15:24:05.577127 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:24:05.571402    2564 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 13 15:24:05.577127 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:24:05.571406    2564 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 13 15:24:05.577127 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:24:05.571410    2564 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 13 15:24:05.577127 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:24:05.571414    2564 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 13 15:24:05.577127 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:24:05.571421    2564 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 13 15:24:05.577127 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:24:05.571427    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 13 15:24:05.577127 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:24:05.571432    2564 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 13 15:24:05.577127 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:24:05.571438    2564 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 13 15:24:05.577127 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:24:05.571443    2564 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 13 15:24:05.577631 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:24:05.571448    2564 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 13 15:24:05.577631 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:24:05.571452    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 13 15:24:05.577631 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:24:05.571457    2564 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 13 15:24:05.577631 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:24:05.571462    2564 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 13 15:24:05.577631 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:24:05.571466    2564 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 13 15:24:05.577631 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:24:05.571471    2564 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 13 15:24:05.577631 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:24:05.571476    2564 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 13 15:24:05.577631 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:24:05.571480    2564 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 13 15:24:05.577631 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:24:05.571484    2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 13 15:24:05.577631 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:24:05.571488    2564 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 13 15:24:05.577631 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:24:05.571493    2564 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 13 15:24:05.577631 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:24:05.571497    2564 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 13 15:24:05.577631 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:24:05.571501    2564 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 13 15:24:05.577631 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:24:05.571507    2564 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 13 15:24:05.577631 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:24:05.571514    2564 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 13 15:24:05.577631 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:24:05.571518    2564 feature_gate.go:328] unrecognized feature gate: Example2
Jul 13 15:24:05.577631 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:24:05.571522    2564 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 13 15:24:05.577631 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:24:05.571526    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 13 15:24:05.577631 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:24:05.571531    2564 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 13 15:24:05.577631 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:24:05.571536    2564 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 13 15:24:05.578201 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:24:05.571540    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 13 15:24:05.578201 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:24:05.571544    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 13 15:24:05.578201 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:24:05.571549    2564 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 13 15:24:05.578201 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:24:05.571553    2564 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 13 15:24:05.578201 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:24:05.571557    2564 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 13 15:24:05.578201 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:24:05.571561    2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 13 15:24:05.578201 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:24:05.571565    2564 feature_gate.go:328] unrecognized feature gate: Example
Jul 13 15:24:05.578201 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:24:05.571570    2564 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 13 15:24:05.578201 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:24:05.571574    2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 13 15:24:05.578201 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:24:05.571579    2564 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 13 15:24:05.578201 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:24:05.571583    2564 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 13 15:24:05.578201 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:24:05.571588    2564 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 13 15:24:05.578201 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:24:05.571593    2564 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 13 15:24:05.578201 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:24:05.571597    2564 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 13 15:24:05.578201 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:24:05.571623    2564 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 13 15:24:05.578626 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:05.571632    2564 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 13 15:24:05.578626 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:24:05.571829    2564 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 13 15:24:05.578626 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:24:05.571839    2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 13 15:24:05.578626 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:24:05.571844    2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 13 15:24:05.578626 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:24:05.571849    2564 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 13 15:24:05.578626 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:24:05.571853    2564 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 13 15:24:05.578626 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:24:05.571857    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 13 15:24:05.578626 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:24:05.571862    2564 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 13 15:24:05.578626 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:24:05.571866    2564 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 13 15:24:05.578626 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:24:05.571870    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 13 15:24:05.578626 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:24:05.571874    2564 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 13 15:24:05.578626 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:24:05.571879    2564 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 13 15:24:05.578626 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:24:05.571883    2564 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 13 15:24:05.578626 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:24:05.571904    2564 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 13 15:24:05.578626 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:24:05.571909    2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 13 15:24:05.579024 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:24:05.571913    2564 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 13 15:24:05.579024 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:24:05.571917    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 13 15:24:05.579024 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:24:05.571922    2564 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 13 15:24:05.579024 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:24:05.571926    2564 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 13 15:24:05.579024 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:24:05.571930    2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 13 15:24:05.579024 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:24:05.571934    2564 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 13 15:24:05.579024 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:24:05.571938    2564 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 13 15:24:05.579024 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:24:05.571943    2564 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 13 15:24:05.579024 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:24:05.571947    2564 feature_gate.go:328] unrecognized feature gate: Example2
Jul 13 15:24:05.579024 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:24:05.571951    2564 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 13 15:24:05.579024 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:24:05.571956    2564 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 13 15:24:05.579024 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:24:05.571960    2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 13 15:24:05.579024 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:24:05.571965    2564 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 13 15:24:05.579024 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:24:05.571968    2564 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 13 15:24:05.579024 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:24:05.571974    2564 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 13 15:24:05.579024 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:24:05.571978    2564 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 13 15:24:05.579024 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:24:05.571985    2564 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 13 15:24:05.579024 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:24:05.571991    2564 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 13 15:24:05.579024 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:24:05.571995    2564 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 13 15:24:05.579024 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:24:05.572000    2564 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 13 15:24:05.579561 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:24:05.572004    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 13 15:24:05.579561 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:24:05.572009    2564 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 13 15:24:05.579561 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:24:05.572013    2564 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 13 15:24:05.579561 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:24:05.572017    2564 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 13 15:24:05.579561 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:24:05.572022    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 13 15:24:05.579561 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:24:05.572027    2564 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 13 15:24:05.579561 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:24:05.572034    2564 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 13 15:24:05.579561 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:24:05.572041    2564 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 13 15:24:05.579561 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:24:05.572046    2564 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 13 15:24:05.579561 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:24:05.572051    2564 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 13 15:24:05.579561 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:24:05.572055    2564 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 13 15:24:05.579561 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:24:05.572060    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 13 15:24:05.579561 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:24:05.572064    2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 13 15:24:05.579561 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:24:05.572069    2564 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 13 15:24:05.579561 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:24:05.572073    2564 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 13 15:24:05.579561 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:24:05.572078    2564 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 13 15:24:05.579561 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:24:05.572082    2564 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 13 15:24:05.579561 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:24:05.572086    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 13 15:24:05.579561 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:24:05.572090    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 13 15:24:05.580065 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:24:05.572095    2564 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 13 15:24:05.580065 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:24:05.572099    2564 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 13 15:24:05.580065 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:24:05.572109    2564 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 13 15:24:05.580065 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:24:05.572113    2564 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 13 15:24:05.580065 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:24:05.572118    2564 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 13 15:24:05.580065 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:24:05.572122    2564 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 13 15:24:05.580065 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:24:05.572126    2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 13 15:24:05.580065 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:24:05.572132    2564 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 13 15:24:05.580065 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:24:05.572139    2564 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 13 15:24:05.580065 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:24:05.572144    2564 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 13 15:24:05.580065 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:24:05.572148    2564 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 13 15:24:05.580065 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:24:05.572153    2564 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 13 15:24:05.580065 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:24:05.572157    2564 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 13 15:24:05.580065 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:24:05.572162    2564 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 13 15:24:05.580065 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:24:05.572167    2564 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 13 15:24:05.580065 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:24:05.572171    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 13 15:24:05.580065 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:24:05.572175    2564 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 13 15:24:05.580065 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:24:05.572180    2564 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 13 15:24:05.580065 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:24:05.572184    2564 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 13 15:24:05.580065 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:24:05.572188    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 13 15:24:05.580553 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:24:05.572193    2564 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 13 15:24:05.580553 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:24:05.572197    2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 13 15:24:05.580553 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:24:05.572201    2564 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 13 15:24:05.580553 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:24:05.572205    2564 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 13 15:24:05.580553 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:24:05.572209    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 13 15:24:05.580553 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:24:05.572214    2564 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 13 15:24:05.580553 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:24:05.572218    2564 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 13 15:24:05.580553 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:24:05.572223    2564 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 13 15:24:05.580553 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:24:05.572227    2564 feature_gate.go:328] unrecognized feature gate: Example
Jul 13 15:24:05.580553 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:24:05.572232    2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 13 15:24:05.580553 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:24:05.572236    2564 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 13 15:24:05.580553 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:24:05.572240    2564 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 13 15:24:05.580553 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:24:05.572244    2564 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 13 15:24:05.580553 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:24:05.572248    2564 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 13 15:24:05.580553 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:24:05.572252    2564 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 13 15:24:05.580553 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:24:05.572256    2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 13 15:24:05.580553 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:24:05.572261    2564 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 13 15:24:05.580553 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:24:05.572265    2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 13 15:24:05.580553 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:24:05.572269    2564 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 13 15:24:05.580553 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:24:05.572273    2564 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 13 15:24:05.581591 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:24:05.572277    2564 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 13 15:24:05.581591 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:24:05.572281    2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 13 15:24:05.581591 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:24:05.572286    2564 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 13 15:24:05.581591 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:24:05.572290    2564 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 13 15:24:05.581591 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:24:05.572294    2564 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 13 15:24:05.581591 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:24:05.572298    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 13 15:24:05.581591 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:05.572306    2564 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 13 15:24:05.581591 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:05.573474    2564 server.go:962] "Client rotation is on, will bootstrap in background"
Jul 13 15:24:05.581591 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:05.576285    2564 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jul 13 15:24:05.581591 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:05.578307    2564 server.go:1019] "Starting client certificate rotation"
Jul 13 15:24:05.581591 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:05.578411    2564 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 13 15:24:05.581591 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:05.578451    2564 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 13 15:24:05.581591 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:05.581206    2564 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 13 15:24:05.582785 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:05.582767    2564 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 13 15:24:05.594147 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:05.594127    2564 log.go:25] "Validated CRI v1 runtime API"
Jul 13 15:24:05.596124 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:05.596099    2564 log.go:25] "Validated CRI v1 image API"
Jul 13 15:24:05.596905 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:05.596874    2564 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jul 13 15:24:05.600193 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:05.600169    2564 fs.go:135] Filesystem UUIDs: map[1492a1b3-b18d-4eaf-bb38-07262e51bc21:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 8309c208-0c7e-4f41-b3a5-2cd12050b0ae:/dev/nvme0n1p4]
Jul 13 15:24:05.600278 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:05.600190    2564 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jul 13 15:24:05.605511 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:05.605381    2564 manager.go:216] Machine: {Timestamp:2026-07-13 15:24:05.604797538 +0000 UTC m=+0.364008543 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3099122 MemoryCapacity:33164496896 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec25e7226181f3dcf9806d3e6ea155cd SystemUUID:ec25e722-6181-f3dc-f980-6d3e6ea155cd BootID:6dbca212-689c-4b6d-bb77-279e3167f2f3 Filesystems:[{Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:03:70:ce:cc:89 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:03:70:ce:cc:89 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:5e:3c:53:71:2c:da Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164496896 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jul 13 15:24:05.605511 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:05.605507    2564 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jul 13 15:24:05.605615 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:05.605598    2564 manager.go:232] Version: {KernelVersion:5.14.0-570.126.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260702-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jul 13 15:24:05.606666 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:05.606639    2564 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jul 13 15:24:05.606816 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:05.606667    2564 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-140-255.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jul 13 15:24:05.607930 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:05.607915    2564 topology_manager.go:138] "Creating topology manager with none policy"
Jul 13 15:24:05.607968 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:05.607935    2564 container_manager_linux.go:309] "Creating device plugin manager"
Jul 13 15:24:05.607968 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:05.607943    2564 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 13 15:24:05.608990 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:05.608975    2564 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 13 15:24:05.609964 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:05.609952    2564 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jul 13 15:24:05.611625 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:05.611607    2564 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 13 15:24:05.613410 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:05.613394    2564 state_mem.go:36] "Initialized new in-memory state store"
Jul 13 15:24:05.613551 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:05.613541    2564 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jul 13 15:24:05.613592 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:05.613574    2564 kubelet.go:486] "Attempting to sync node with API server"
Jul 13 15:24:05.613592 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:05.613586    2564 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jul 13 15:24:05.613649 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:05.613605    2564 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jul 13 15:24:05.613649 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:05.613618    2564 kubelet.go:398] "Adding apiserver pod source"
Jul 13 15:24:05.613649 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:05.613629    2564 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jul 13 15:24:05.614101 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:05.614087    2564 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 13 15:24:05.614154 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:05.614112    2564 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 13 15:24:05.616117 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:05.616045    2564 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1"
Jul 13 15:24:05.618292 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:05.617868    2564 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jul 13 15:24:05.618292 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:05.617935    2564 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jul 13 15:24:05.618292 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:05.618217    2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jul 13 15:24:05.618292 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:05.618234    2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jul 13 15:24:05.618292 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:05.618243    2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jul 13 15:24:05.618292 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:05.618252    2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jul 13 15:24:05.618292 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:05.618263    2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jul 13 15:24:05.618292 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:05.618277    2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jul 13 15:24:05.618629 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:05.618612    2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jul 13 15:24:05.618677 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:05.618633    2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jul 13 15:24:05.618677 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:05.618652    2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jul 13 15:24:05.618677 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:05.618672    2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jul 13 15:24:05.618793 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:05.618686    2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jul 13 15:24:05.618793 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:05.618735    2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jul 13 15:24:05.619484 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:05.619467    2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jul 13 15:24:05.619735 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:05.619724    2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jul 13 15:24:05.623310 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:05.623293    2564 server.go:1268] "Started kubelet"
Jul 13 15:24:05.623436 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:05.623385    2564 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jul 13 15:24:05.623504 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:05.623461    2564 server_v1.go:49] "podresources" method="list" useActivePods=true
Jul 13 15:24:05.623774 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:05.623748    2564 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jul 13 15:24:05.624213 ip-10-0-140-255 systemd[1]: Started Kubernetes Kubelet.
Jul 13 15:24:05.625154 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:05.625145    2564 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jul 13 15:24:05.626442 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:05.626423    2564 server.go:310] "Adding debug handlers to kubelet server"
Jul 13 15:24:05.626540 ip-10-0-140-255 kubenswrapper[2564]: E0713 15:24:05.626517    2564 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 13 15:24:05.626602 ip-10-0-140-255 kubenswrapper[2564]: E0713 15:24:05.626580    2564 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-140-255.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 13 15:24:05.626602 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:05.626597    2564 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-140-255.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 13 15:24:05.629743 ip-10-0-140-255 kubenswrapper[2564]: E0713 15:24:05.629725    2564 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jul 13 15:24:05.630011 ip-10-0-140-255 kubenswrapper[2564]: E0713 15:24:05.628715    2564 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-140-255.ec2.internal.18c1e2c0eb36e9d2  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-140-255.ec2.internal,UID:ip-10-0-140-255.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-140-255.ec2.internal,},FirstTimestamp:2026-07-13 15:24:05.623269842 +0000 UTC m=+0.382480847,LastTimestamp:2026-07-13 15:24:05.623269842 +0000 UTC m=+0.382480847,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-140-255.ec2.internal,}"
Jul 13 15:24:05.631253 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:05.631240    2564 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jul 13 15:24:05.631325 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:05.631311    2564 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jul 13 15:24:05.631378 ip-10-0-140-255 kubenswrapper[2564]: E0713 15:24:05.631346    2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-255.ec2.internal\" not found"
Jul 13 15:24:05.632081 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:05.632065    2564 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jul 13 15:24:05.632081 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:05.632067    2564 volume_manager.go:311] "The desired_state_of_world populator starts"
Jul 13 15:24:05.632244 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:05.632101    2564 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jul 13 15:24:05.632244 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:05.632216    2564 reconstruct.go:97] "Volume reconstruction finished"
Jul 13 15:24:05.632244 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:05.632227    2564 reconciler.go:29] "Reconciler: start to sync state"
Jul 13 15:24:05.632244 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:05.632241    2564 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jul 13 15:24:05.632394 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:05.632254    2564 factory.go:55] Registering systemd factory
Jul 13 15:24:05.632394 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:05.632262    2564 factory.go:223] Registration of the systemd container factory successfully
Jul 13 15:24:05.632475 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:05.632460    2564 factory.go:153] Registering CRI-O factory
Jul 13 15:24:05.632505 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:05.632475    2564 factory.go:223] Registration of the crio container factory successfully
Jul 13 15:24:05.632505 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:05.632495    2564 factory.go:103] Registering Raw factory
Jul 13 15:24:05.632505 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:05.632505    2564 manager.go:1196] Started watching for new ooms in manager
Jul 13 15:24:05.634018 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:05.633994    2564 manager.go:349] Starting recovery of all containers
Jul 13 15:24:05.641513 ip-10-0-140-255 kubenswrapper[2564]: E0713 15:24:05.641277    2564 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Jul 13 15:24:05.641659 ip-10-0-140-255 kubenswrapper[2564]: E0713 15:24:05.641328    2564 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-140-255.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Jul 13 15:24:05.643339 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:05.643312    2564 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-w57x2"
Jul 13 15:24:05.644546 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:05.644527    2564 manager.go:354] Recovery completed
Jul 13 15:24:05.646665 ip-10-0-140-255 kubenswrapper[2564]: E0713 15:24:05.646618    2564 watcher.go:152] Failed to watch directory "/sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service": inotify_add_watch /sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service: no such file or directory
Jul 13 15:24:05.651305 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:05.651286    2564 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-w57x2"
Jul 13 15:24:05.657152 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:05.657112    2564 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 13 15:24:05.659157 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:05.659142    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-255.ec2.internal" event="NodeHasSufficientMemory"
Jul 13 15:24:05.659223 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:05.659169    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-255.ec2.internal" event="NodeHasNoDiskPressure"
Jul 13 15:24:05.659223 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:05.659179    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-255.ec2.internal" event="NodeHasSufficientPID"
Jul 13 15:24:05.659848 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:05.659831    2564 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jul 13 15:24:05.659848 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:05.659845    2564 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jul 13 15:24:05.660040 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:05.659863    2564 state_mem.go:36] "Initialized new in-memory state store"
Jul 13 15:24:05.660040 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:05.659862    2564 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 13 15:24:05.660573 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:05.660556    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-255.ec2.internal" event="NodeHasSufficientMemory"
Jul 13 15:24:05.660636 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:05.660586    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-255.ec2.internal" event="NodeHasNoDiskPressure"
Jul 13 15:24:05.660636 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:05.660598    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-255.ec2.internal" event="NodeHasSufficientPID"
Jul 13 15:24:05.669363 ip-10-0-140-255 kubenswrapper[2564]: E0713 15:24:05.669273    2564 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-140-255.ec2.internal.18c1e2c0ed5a7ce4  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-140-255.ec2.internal,UID:ip-10-0-140-255.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-140-255.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-140-255.ec2.internal,},FirstTimestamp:2026-07-13 15:24:05.659155684 +0000 UTC m=+0.418366687,LastTimestamp:2026-07-13 15:24:05.659155684 +0000 UTC m=+0.418366687,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-140-255.ec2.internal,}"
Jul 13 15:24:05.679959 ip-10-0-140-255 kubenswrapper[2564]: E0713 15:24:05.679859    2564 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-140-255.ec2.internal.18c1e2c0ed5ac309  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-140-255.ec2.internal,UID:ip-10-0-140-255.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-140-255.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-140-255.ec2.internal,},FirstTimestamp:2026-07-13 15:24:05.659173641 +0000 UTC m=+0.418384644,LastTimestamp:2026-07-13 15:24:05.659173641 +0000 UTC m=+0.418384644,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-140-255.ec2.internal,}"
Jul 13 15:24:05.687964 ip-10-0-140-255 kubenswrapper[2564]: E0713 15:24:05.687865    2564 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-140-255.ec2.internal.18c1e2c0ed5ae858  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-140-255.ec2.internal,UID:ip-10-0-140-255.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-140-255.ec2.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-140-255.ec2.internal,},FirstTimestamp:2026-07-13 15:24:05.659183192 +0000 UTC m=+0.418394196,LastTimestamp:2026-07-13 15:24:05.659183192 +0000 UTC m=+0.418394196,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-140-255.ec2.internal,}"
Jul 13 15:24:05.699155 ip-10-0-140-255 kubenswrapper[2564]: E0713 15:24:05.699083    2564 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-140-255.ec2.internal.18c1e2c0ed5a7ce4\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-140-255.ec2.internal.18c1e2c0ed5a7ce4  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-140-255.ec2.internal,UID:ip-10-0-140-255.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-140-255.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-140-255.ec2.internal,},FirstTimestamp:2026-07-13 15:24:05.659155684 +0000 UTC m=+0.418366687,LastTimestamp:2026-07-13 15:24:05.660571245 +0000 UTC m=+0.419782250,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-140-255.ec2.internal,}"
Jul 13 15:24:05.706793 ip-10-0-140-255 kubenswrapper[2564]: E0713 15:24:05.706725    2564 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-140-255.ec2.internal.18c1e2c0ed5ac309\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-140-255.ec2.internal.18c1e2c0ed5ac309  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-140-255.ec2.internal,UID:ip-10-0-140-255.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-140-255.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-140-255.ec2.internal,},FirstTimestamp:2026-07-13 15:24:05.659173641 +0000 UTC m=+0.418384644,LastTimestamp:2026-07-13 15:24:05.66059174 +0000 UTC m=+0.419802746,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-140-255.ec2.internal,}"
Jul 13 15:24:05.717983 ip-10-0-140-255 kubenswrapper[2564]: E0713 15:24:05.717914    2564 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-140-255.ec2.internal.18c1e2c0ed5ae858\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-140-255.ec2.internal.18c1e2c0ed5ae858  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-140-255.ec2.internal,UID:ip-10-0-140-255.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-140-255.ec2.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-140-255.ec2.internal,},FirstTimestamp:2026-07-13 15:24:05.659183192 +0000 UTC m=+0.418394196,LastTimestamp:2026-07-13 15:24:05.660602633 +0000 UTC m=+0.419813638,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-140-255.ec2.internal,}"
Jul 13 15:24:05.732098 ip-10-0-140-255 kubenswrapper[2564]: E0713 15:24:05.732066    2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-255.ec2.internal\" not found"
Jul 13 15:24:05.802720 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:05.802689    2564 policy_none.go:49] "None policy: Start"
Jul 13 15:24:05.802826 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:05.802730    2564 memory_manager.go:187] "Starting memorymanager" policy="None"
Jul 13 15:24:05.802826 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:05.802749    2564 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jul 13 15:24:05.804200 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:05.804185    2564 policy_none.go:47] "Start"
Jul 13 15:24:05.830493 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:05.830477    2564 manager.go:337] "Starting Device Plugin manager"
Jul 13 15:24:05.830583 ip-10-0-140-255 kubenswrapper[2564]: E0713 15:24:05.830511    2564 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jul 13 15:24:05.830583 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:05.830521    2564 server.go:87] "Starting device plugin registration server"
Jul 13 15:24:05.830820 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:05.830807    2564 eviction_manager.go:189] "Eviction manager: starting control loop"
Jul 13 15:24:05.830854 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:05.830823    2564 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jul 13 15:24:05.830931 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:05.830917    2564 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jul 13 15:24:05.831001 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:05.830989    2564 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jul 13 15:24:05.831001 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:05.831000    2564 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jul 13 15:24:05.831623 ip-10-0-140-255 kubenswrapper[2564]: E0713 15:24:05.831604    2564 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jul 13 15:24:05.831700 ip-10-0-140-255 kubenswrapper[2564]: E0713 15:24:05.831659    2564 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-140-255.ec2.internal\" not found"
Jul 13 15:24:05.849369 ip-10-0-140-255 kubenswrapper[2564]: E0713 15:24:05.849338    2564 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-140-255.ec2.internal\" not found" node="ip-10-0-140-255.ec2.internal"
Jul 13 15:24:05.931425 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:05.931353    2564 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 13 15:24:05.932558 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:05.932536    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-255.ec2.internal" event="NodeHasSufficientMemory"
Jul 13 15:24:05.932649 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:05.932572    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-255.ec2.internal" event="NodeHasNoDiskPressure"
Jul 13 15:24:05.932649 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:05.932587    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-255.ec2.internal" event="NodeHasSufficientPID"
Jul 13 15:24:05.932649 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:05.932612    2564 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-140-255.ec2.internal"
Jul 13 15:24:05.933281 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:05.933261    2564 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jul 13 15:24:05.934517 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:05.934495    2564 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jul 13 15:24:05.934618 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:05.934530    2564 status_manager.go:244] "Starting to sync pod status with apiserver"
Jul 13 15:24:05.934618 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:05.934551    2564 kubelet.go:2448] "Starting kubelet main sync loop"
Jul 13 15:24:05.934618 ip-10-0-140-255 kubenswrapper[2564]: E0713 15:24:05.934584    2564 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jul 13 15:24:05.936605 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:05.936586    2564 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 13 15:24:05.941410 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:05.941395    2564 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-140-255.ec2.internal"
Jul 13 15:24:05.941488 ip-10-0-140-255 kubenswrapper[2564]: E0713 15:24:05.941417    2564 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-140-255.ec2.internal\": node \"ip-10-0-140-255.ec2.internal\" not found"
Jul 13 15:24:05.988356 ip-10-0-140-255 kubenswrapper[2564]: E0713 15:24:05.988323    2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-255.ec2.internal\" not found"
Jul 13 15:24:06.035705 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:06.035655    2564 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-255.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-140-255.ec2.internal"]
Jul 13 15:24:06.035849 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:06.035751    2564 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 13 15:24:06.036780 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:06.036761    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-255.ec2.internal" event="NodeHasSufficientMemory"
Jul 13 15:24:06.036917 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:06.036793    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-255.ec2.internal" event="NodeHasNoDiskPressure"
Jul 13 15:24:06.036917 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:06.036803    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-255.ec2.internal" event="NodeHasSufficientPID"
Jul 13 15:24:06.038152 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:06.038138    2564 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 13 15:24:06.038261 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:06.038245    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-255.ec2.internal"
Jul 13 15:24:06.038314 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:06.038283    2564 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 13 15:24:06.038827 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:06.038812    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-255.ec2.internal" event="NodeHasSufficientMemory"
Jul 13 15:24:06.038922 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:06.038845    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-255.ec2.internal" event="NodeHasNoDiskPressure"
Jul 13 15:24:06.038922 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:06.038858    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-255.ec2.internal" event="NodeHasSufficientPID"
Jul 13 15:24:06.038922 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:06.038812    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-255.ec2.internal" event="NodeHasSufficientMemory"
Jul 13 15:24:06.039069 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:06.038929    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-255.ec2.internal" event="NodeHasNoDiskPressure"
Jul 13 15:24:06.039069 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:06.038946    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-255.ec2.internal" event="NodeHasSufficientPID"
Jul 13 15:24:06.040778 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:06.040758    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-255.ec2.internal"
Jul 13 15:24:06.040863 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:06.040797    2564 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 13 15:24:06.041638 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:06.041623    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-255.ec2.internal" event="NodeHasSufficientMemory"
Jul 13 15:24:06.041720 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:06.041647    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-255.ec2.internal" event="NodeHasNoDiskPressure"
Jul 13 15:24:06.041720 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:06.041659    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-255.ec2.internal" event="NodeHasSufficientPID"
Jul 13 15:24:06.064753 ip-10-0-140-255 kubenswrapper[2564]: E0713 15:24:06.064729    2564 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-140-255.ec2.internal\" not found" node="ip-10-0-140-255.ec2.internal"
Jul 13 15:24:06.069420 ip-10-0-140-255 kubenswrapper[2564]: E0713 15:24:06.069406    2564 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-140-255.ec2.internal\" not found" node="ip-10-0-140-255.ec2.internal"
Jul 13 15:24:06.088441 ip-10-0-140-255 kubenswrapper[2564]: E0713 15:24:06.088417    2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-255.ec2.internal\" not found"
Jul 13 15:24:06.134278 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:06.134244    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/cee06081bb6408d4c7824c898f1b18f4-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-140-255.ec2.internal\" (UID: \"cee06081bb6408d4c7824c898f1b18f4\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-255.ec2.internal"
Jul 13 15:24:06.134278 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:06.134279    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/cee06081bb6408d4c7824c898f1b18f4-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-140-255.ec2.internal\" (UID: \"cee06081bb6408d4c7824c898f1b18f4\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-255.ec2.internal"
Jul 13 15:24:06.134421 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:06.134295    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/92665f5a3cb50772f6b086b04422f9c8-config\") pod \"kube-apiserver-proxy-ip-10-0-140-255.ec2.internal\" (UID: \"92665f5a3cb50772f6b086b04422f9c8\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-140-255.ec2.internal"
Jul 13 15:24:06.188749 ip-10-0-140-255 kubenswrapper[2564]: E0713 15:24:06.188686    2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-255.ec2.internal\" not found"
Jul 13 15:24:06.235185 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:06.235161    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/cee06081bb6408d4c7824c898f1b18f4-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-140-255.ec2.internal\" (UID: \"cee06081bb6408d4c7824c898f1b18f4\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-255.ec2.internal"
Jul 13 15:24:06.235185 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:06.235120    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/cee06081bb6408d4c7824c898f1b18f4-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-140-255.ec2.internal\" (UID: \"cee06081bb6408d4c7824c898f1b18f4\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-255.ec2.internal"
Jul 13 15:24:06.235290 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:06.235220    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/cee06081bb6408d4c7824c898f1b18f4-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-140-255.ec2.internal\" (UID: \"cee06081bb6408d4c7824c898f1b18f4\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-255.ec2.internal"
Jul 13 15:24:06.235290 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:06.235241    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/92665f5a3cb50772f6b086b04422f9c8-config\") pod \"kube-apiserver-proxy-ip-10-0-140-255.ec2.internal\" (UID: \"92665f5a3cb50772f6b086b04422f9c8\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-140-255.ec2.internal"
Jul 13 15:24:06.235290 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:06.235265    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/92665f5a3cb50772f6b086b04422f9c8-config\") pod \"kube-apiserver-proxy-ip-10-0-140-255.ec2.internal\" (UID: \"92665f5a3cb50772f6b086b04422f9c8\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-140-255.ec2.internal"
Jul 13 15:24:06.235393 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:06.235291    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/cee06081bb6408d4c7824c898f1b18f4-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-140-255.ec2.internal\" (UID: \"cee06081bb6408d4c7824c898f1b18f4\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-255.ec2.internal"
Jul 13 15:24:06.289297 ip-10-0-140-255 kubenswrapper[2564]: E0713 15:24:06.289267    2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-255.ec2.internal\" not found"
Jul 13 15:24:06.366810 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:06.366775    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-255.ec2.internal"
Jul 13 15:24:06.372970 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:06.372950    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-255.ec2.internal"
Jul 13 15:24:06.389903 ip-10-0-140-255 kubenswrapper[2564]: E0713 15:24:06.389866    2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-255.ec2.internal\" not found"
Jul 13 15:24:06.490539 ip-10-0-140-255 kubenswrapper[2564]: E0713 15:24:06.490437    2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-255.ec2.internal\" not found"
Jul 13 15:24:06.576977 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:06.576952    2564 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jul 13 15:24:06.577591 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:06.577098    2564 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 13 15:24:06.591279 ip-10-0-140-255 kubenswrapper[2564]: E0713 15:24:06.591248    2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-255.ec2.internal\" not found"
Jul 13 15:24:06.678976 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:06.678950    2564 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 13 15:24:06.680041 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:06.680024    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-255.ec2.internal" event="NodeHasSufficientMemory"
Jul 13 15:24:06.680118 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:06.680055    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-255.ec2.internal" event="NodeHasNoDiskPressure"
Jul 13 15:24:06.680118 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:06.680065    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-255.ec2.internal" event="NodeHasSufficientPID"
Jul 13 15:24:06.691777 ip-10-0-140-255 kubenswrapper[2564]: E0713 15:24:06.691755    2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-255.ec2.internal\" not found"
Jul 13 15:24:06.792057 ip-10-0-140-255 kubenswrapper[2564]: E0713 15:24:06.791978    2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-255.ec2.internal\" not found"
Jul 13 15:24:06.806169 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:06.806120    2564 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-12 15:19:06 +0000 UTC" deadline="2028-02-04 12:38:48.884879256 +0000 UTC"
Jul 13 15:24:06.806169 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:06.806163    2564 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13701h14m42.078719229s"
Jul 13 15:24:06.892687 ip-10-0-140-255 kubenswrapper[2564]: E0713 15:24:06.892660    2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-255.ec2.internal\" not found"
Jul 13 15:24:06.909998 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:06.909974    2564 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 13 15:24:06.932225 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:06.932195    2564 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-255.ec2.internal"
Jul 13 15:24:06.949045 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:06.949024    2564 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 13 15:24:06.950881 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:06.950860    2564 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-255.ec2.internal"
Jul 13 15:24:08.140333 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:08.140316    2564 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 13 15:24:08.150144 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:08.150119    2564 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 13 15:24:08.172906 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:24:08.172858    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcee06081bb6408d4c7824c898f1b18f4.slice/crio-6e0d7712bbdce161d82a96f02511b3c789ed31748785469676c4ebacb584a4ad WatchSource:0}: Error finding container 6e0d7712bbdce161d82a96f02511b3c789ed31748785469676c4ebacb584a4ad: Status 404 returned error can't find the container with id 6e0d7712bbdce161d82a96f02511b3c789ed31748785469676c4ebacb584a4ad
Jul 13 15:24:08.173128 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:24:08.173102    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod92665f5a3cb50772f6b086b04422f9c8.slice/crio-40379c54a0492b5aee65eac7771a55b8cac55d2effe854d99dcc625bda890159 WatchSource:0}: Error finding container 40379c54a0492b5aee65eac7771a55b8cac55d2effe854d99dcc625bda890159: Status 404 returned error can't find the container with id 40379c54a0492b5aee65eac7771a55b8cac55d2effe854d99dcc625bda890159
Jul 13 15:24:08.178429 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:08.178414    2564 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 13 15:24:08.315091 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:08.315012    2564 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 13 15:24:08.628892 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:08.628793    2564 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 13 15:24:08.795268 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:08.795234    2564 apiserver.go:52] "Watching apiserver"
Jul 13 15:24:08.803248 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:08.803211    2564 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 13 15:24:08.803784 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:08.803758    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-node-tuning-operator/tuned-7bd8f","openshift-image-registry/node-ca-zq68g","openshift-multus/multus-additional-cni-plugins-t8ljw","openshift-multus/multus-q24vk","openshift-network-diagnostics/network-check-target-7qzb8","kube-system/global-pull-secret-syncer-75h9t","kube-system/konnectivity-agent-v8r47","kube-system/kube-apiserver-proxy-ip-10-0-140-255.ec2.internal","openshift-dns/node-resolver-vmz75","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-255.ec2.internal","openshift-multus/network-metrics-daemon-8whd7","openshift-network-operator/iptables-alerter-nbxfp","openshift-ovn-kubernetes/ovnkube-node-9dq6z","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7v5qg"]
Jul 13 15:24:08.805769 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:08.805739    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-v8r47"
Jul 13 15:24:08.808231 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:08.808188    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-9dq6z"
Jul 13 15:24:08.808733 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:08.808712    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-9mdmd\""
Jul 13 15:24:08.808857 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:08.808838    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 13 15:24:08.809146 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:08.809124    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 13 15:24:08.810029 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:08.810007    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-t8ljw"
Jul 13 15:24:08.810861 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:08.810840    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 13 15:24:08.810960 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:08.810898    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 13 15:24:08.811020 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:08.810843    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 13 15:24:08.811524 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:08.811375    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-64glw\""
Jul 13 15:24:08.811524 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:08.811410    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 13 15:24:08.811649 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:08.811625    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 13 15:24:08.811700 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:08.811692    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-q24vk"
Jul 13 15:24:08.812792 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:08.812641    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 13 15:24:08.812913 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:08.812887    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 13 15:24:08.813191 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:08.813171    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 13 15:24:08.813563 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:08.813527    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-d69xj\""
Jul 13 15:24:08.813789 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:08.813774    2564 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jul 13 15:24:08.815102 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:08.814634    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 13 15:24:08.815102 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:08.814801    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7qzb8"
Jul 13 15:24:08.815102 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:08.814821    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-xt9r9\""
Jul 13 15:24:08.815102 ip-10-0-140-255 kubenswrapper[2564]: E0713 15:24:08.814902    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7qzb8" podUID="38555aab-29b1-4bdf-b689-069e8fe6712c"
Jul 13 15:24:08.815102 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:08.815005    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 13 15:24:08.815645 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:08.815203    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 13 15:24:08.815792 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:08.815774    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-75h9t"
Jul 13 15:24:08.815899 ip-10-0-140-255 kubenswrapper[2564]: E0713 15:24:08.815834    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-75h9t" podUID="84c5054b-6b5c-4b21-992a-cbd68bf1b4f2"
Jul 13 15:24:08.816577 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:08.816464    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 13 15:24:08.816577 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:08.816526    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-vmz75"
Jul 13 15:24:08.820442 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:08.820306    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 13 15:24:08.821275 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:08.821256    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-km94k\""
Jul 13 15:24:08.821578 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:08.821389    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 13 15:24:08.821578 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:08.821531    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-7bd8f"
Jul 13 15:24:08.822736 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:08.822564    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/697aa34e-8473-49a1-a7dd-8be4f23ea1b3-tmp-dir\") pod \"node-resolver-vmz75\" (UID: \"697aa34e-8473-49a1-a7dd-8be4f23ea1b3\") " pod="openshift-dns/node-resolver-vmz75"
Jul 13 15:24:08.822736 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:08.822597    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/258b7ae3-adf5-437a-8f8e-71bdd1cc665b-var-lib-openvswitch\") pod \"ovnkube-node-9dq6z\" (UID: \"258b7ae3-adf5-437a-8f8e-71bdd1cc665b\") " pod="openshift-ovn-kubernetes/ovnkube-node-9dq6z"
Jul 13 15:24:08.822736 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:08.822623    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/258b7ae3-adf5-437a-8f8e-71bdd1cc665b-host-run-ovn-kubernetes\") pod \"ovnkube-node-9dq6z\" (UID: \"258b7ae3-adf5-437a-8f8e-71bdd1cc665b\") " pod="openshift-ovn-kubernetes/ovnkube-node-9dq6z"
Jul 13 15:24:08.822736 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:08.822647    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/258b7ae3-adf5-437a-8f8e-71bdd1cc665b-host-cni-bin\") pod \"ovnkube-node-9dq6z\" (UID: \"258b7ae3-adf5-437a-8f8e-71bdd1cc665b\") " pod="openshift-ovn-kubernetes/ovnkube-node-9dq6z"
Jul 13 15:24:08.822736 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:08.822669    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ca6016f5-c1af-4395-bdf0-e642bf637019-multus-cni-dir\") pod \"multus-q24vk\" (UID: \"ca6016f5-c1af-4395-bdf0-e642bf637019\") " pod="openshift-multus/multus-q24vk"
Jul 13 15:24:08.822736 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:08.822691    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/ca6016f5-c1af-4395-bdf0-e642bf637019-host-run-multus-certs\") pod \"multus-q24vk\" (UID: \"ca6016f5-c1af-4395-bdf0-e642bf637019\") " pod="openshift-multus/multus-q24vk"
Jul 13 15:24:08.822736 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:08.822732    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/258b7ae3-adf5-437a-8f8e-71bdd1cc665b-systemd-units\") pod \"ovnkube-node-9dq6z\" (UID: \"258b7ae3-adf5-437a-8f8e-71bdd1cc665b\") " pod="openshift-ovn-kubernetes/ovnkube-node-9dq6z"
Jul 13 15:24:08.823156 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:08.822786    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6tpjc\" (UniqueName: \"kubernetes.io/projected/258b7ae3-adf5-437a-8f8e-71bdd1cc665b-kube-api-access-6tpjc\") pod \"ovnkube-node-9dq6z\" (UID: \"258b7ae3-adf5-437a-8f8e-71bdd1cc665b\") " pod="openshift-ovn-kubernetes/ovnkube-node-9dq6z"
Jul 13 15:24:08.823156 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:08.822815    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/ca6016f5-c1af-4395-bdf0-e642bf637019-os-release\") pod \"multus-q24vk\" (UID: \"ca6016f5-c1af-4395-bdf0-e642bf637019\") " pod="openshift-multus/multus-q24vk"
Jul 13 15:24:08.823156 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:08.822851    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/ca6016f5-c1af-4395-bdf0-e642bf637019-cni-binary-copy\") pod \"multus-q24vk\" (UID: \"ca6016f5-c1af-4395-bdf0-e642bf637019\") " pod="openshift-multus/multus-q24vk"
Jul 13 15:24:08.823156 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:08.822909    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ca6016f5-c1af-4395-bdf0-e642bf637019-etc-kubernetes\") pod \"multus-q24vk\" (UID: \"ca6016f5-c1af-4395-bdf0-e642bf637019\") " pod="openshift-multus/multus-q24vk"
Jul 13 15:24:08.823156 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:08.822946    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/a0cd4788-5dd7-402b-9364-7588dcd91951-os-release\") pod \"multus-additional-cni-plugins-t8ljw\" (UID: \"a0cd4788-5dd7-402b-9364-7588dcd91951\") " pod="openshift-multus/multus-additional-cni-plugins-t8ljw"
Jul 13 15:24:08.823156 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:08.822977    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/a0cd4788-5dd7-402b-9364-7588dcd91951-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-t8ljw\" (UID: \"a0cd4788-5dd7-402b-9364-7588dcd91951\") " pod="openshift-multus/multus-additional-cni-plugins-t8ljw"
Jul 13 15:24:08.823156 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:08.823036    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/84c5054b-6b5c-4b21-992a-cbd68bf1b4f2-kubelet-config\") pod \"global-pull-secret-syncer-75h9t\" (UID: \"84c5054b-6b5c-4b21-992a-cbd68bf1b4f2\") " pod="kube-system/global-pull-secret-syncer-75h9t"
Jul 13 15:24:08.823156 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:08.823070    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/258b7ae3-adf5-437a-8f8e-71bdd1cc665b-ovnkube-script-lib\") pod \"ovnkube-node-9dq6z\" (UID: \"258b7ae3-adf5-437a-8f8e-71bdd1cc665b\") " pod="openshift-ovn-kubernetes/ovnkube-node-9dq6z"
Jul 13 15:24:08.823156 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:08.823095    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fmjhp\" (UniqueName: \"kubernetes.io/projected/697aa34e-8473-49a1-a7dd-8be4f23ea1b3-kube-api-access-fmjhp\") pod \"node-resolver-vmz75\" (UID: \"697aa34e-8473-49a1-a7dd-8be4f23ea1b3\") " pod="openshift-dns/node-resolver-vmz75"
Jul 13 15:24:08.823156 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:08.823146    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/258b7ae3-adf5-437a-8f8e-71bdd1cc665b-host-slash\") pod \"ovnkube-node-9dq6z\" (UID: \"258b7ae3-adf5-437a-8f8e-71bdd1cc665b\") " pod="openshift-ovn-kubernetes/ovnkube-node-9dq6z"
Jul 13 15:24:08.823607 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:08.823170    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ca6016f5-c1af-4395-bdf0-e642bf637019-host-var-lib-cni-bin\") pod \"multus-q24vk\" (UID: \"ca6016f5-c1af-4395-bdf0-e642bf637019\") " pod="openshift-multus/multus-q24vk"
Jul 13 15:24:08.823607 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:08.823194    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ca6016f5-c1af-4395-bdf0-e642bf637019-host-var-lib-kubelet\") pod \"multus-q24vk\" (UID: \"ca6016f5-c1af-4395-bdf0-e642bf637019\") " pod="openshift-multus/multus-q24vk"
Jul 13 15:24:08.823607 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:08.823235    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/84c5054b-6b5c-4b21-992a-cbd68bf1b4f2-original-pull-secret\") pod \"global-pull-secret-syncer-75h9t\" (UID: \"84c5054b-6b5c-4b21-992a-cbd68bf1b4f2\") " pod="kube-system/global-pull-secret-syncer-75h9t"
Jul 13 15:24:08.823607 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:08.823297    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-zq68g"
Jul 13 15:24:08.823607 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:08.823311    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/ca6016f5-c1af-4395-bdf0-e642bf637019-host-run-k8s-cni-cncf-io\") pod \"multus-q24vk\" (UID: \"ca6016f5-c1af-4395-bdf0-e642bf637019\") " pod="openshift-multus/multus-q24vk"
Jul 13 15:24:08.823607 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:08.823358    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/ca6016f5-c1af-4395-bdf0-e642bf637019-multus-conf-dir\") pod \"multus-q24vk\" (UID: \"ca6016f5-c1af-4395-bdf0-e642bf637019\") " pod="openshift-multus/multus-q24vk"
Jul 13 15:24:08.823607 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:08.823392    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d9flx\" (UniqueName: \"kubernetes.io/projected/38555aab-29b1-4bdf-b689-069e8fe6712c-kube-api-access-d9flx\") pod \"network-check-target-7qzb8\" (UID: \"38555aab-29b1-4bdf-b689-069e8fe6712c\") " pod="openshift-network-diagnostics/network-check-target-7qzb8"
Jul 13 15:24:08.823607 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:08.823432    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/ca6016f5-c1af-4395-bdf0-e642bf637019-hostroot\") pod \"multus-q24vk\" (UID: \"ca6016f5-c1af-4395-bdf0-e642bf637019\") " pod="openshift-multus/multus-q24vk"
Jul 13 15:24:08.823607 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:08.823461    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/a0cd4788-5dd7-402b-9364-7588dcd91951-tuning-conf-dir\") pod \"multus-additional-cni-plugins-t8ljw\" (UID: \"a0cd4788-5dd7-402b-9364-7588dcd91951\") " pod="openshift-multus/multus-additional-cni-plugins-t8ljw"
Jul 13 15:24:08.823607 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:08.823485    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/258b7ae3-adf5-437a-8f8e-71bdd1cc665b-run-systemd\") pod \"ovnkube-node-9dq6z\" (UID: \"258b7ae3-adf5-437a-8f8e-71bdd1cc665b\") " pod="openshift-ovn-kubernetes/ovnkube-node-9dq6z"
Jul 13 15:24:08.823607 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:08.823528    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/258b7ae3-adf5-437a-8f8e-71bdd1cc665b-log-socket\") pod \"ovnkube-node-9dq6z\" (UID: \"258b7ae3-adf5-437a-8f8e-71bdd1cc665b\") " pod="openshift-ovn-kubernetes/ovnkube-node-9dq6z"
Jul 13 15:24:08.823607 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:08.823565    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sfz9t\" (UniqueName: \"kubernetes.io/projected/ca6016f5-c1af-4395-bdf0-e642bf637019-kube-api-access-sfz9t\") pod \"multus-q24vk\" (UID: \"ca6016f5-c1af-4395-bdf0-e642bf637019\") " pod="openshift-multus/multus-q24vk"
Jul 13 15:24:08.823607 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:08.823608    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/a0cd4788-5dd7-402b-9364-7588dcd91951-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-t8ljw\" (UID: \"a0cd4788-5dd7-402b-9364-7588dcd91951\") " pod="openshift-multus/multus-additional-cni-plugins-t8ljw"
Jul 13 15:24:08.824286 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:08.823634    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-chw8w\" (UniqueName: \"kubernetes.io/projected/a0cd4788-5dd7-402b-9364-7588dcd91951-kube-api-access-chw8w\") pod \"multus-additional-cni-plugins-t8ljw\" (UID: \"a0cd4788-5dd7-402b-9364-7588dcd91951\") " pod="openshift-multus/multus-additional-cni-plugins-t8ljw"
Jul 13 15:24:08.824286 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:08.823674    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/258b7ae3-adf5-437a-8f8e-71bdd1cc665b-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-9dq6z\" (UID: \"258b7ae3-adf5-437a-8f8e-71bdd1cc665b\") " pod="openshift-ovn-kubernetes/ovnkube-node-9dq6z"
Jul 13 15:24:08.824286 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:08.823703    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/a0cd4788-5dd7-402b-9364-7588dcd91951-cnibin\") pod \"multus-additional-cni-plugins-t8ljw\" (UID: \"a0cd4788-5dd7-402b-9364-7588dcd91951\") " pod="openshift-multus/multus-additional-cni-plugins-t8ljw"
Jul 13 15:24:08.824286 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:08.823726    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/84c5054b-6b5c-4b21-992a-cbd68bf1b4f2-dbus\") pod \"global-pull-secret-syncer-75h9t\" (UID: \"84c5054b-6b5c-4b21-992a-cbd68bf1b4f2\") " pod="kube-system/global-pull-secret-syncer-75h9t"
Jul 13 15:24:08.824286 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:08.823743    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 13 15:24:08.824286 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:08.823777    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/ca6016f5-c1af-4395-bdf0-e642bf637019-multus-socket-dir-parent\") pod \"multus-q24vk\" (UID: \"ca6016f5-c1af-4395-bdf0-e642bf637019\") " pod="openshift-multus/multus-q24vk"
Jul 13 15:24:08.824286 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:08.823806    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a0cd4788-5dd7-402b-9364-7588dcd91951-system-cni-dir\") pod \"multus-additional-cni-plugins-t8ljw\" (UID: \"a0cd4788-5dd7-402b-9364-7588dcd91951\") " pod="openshift-multus/multus-additional-cni-plugins-t8ljw"
Jul 13 15:24:08.824286 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:08.823842    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/258b7ae3-adf5-437a-8f8e-71bdd1cc665b-etc-openvswitch\") pod \"ovnkube-node-9dq6z\" (UID: \"258b7ae3-adf5-437a-8f8e-71bdd1cc665b\") " pod="openshift-ovn-kubernetes/ovnkube-node-9dq6z"
Jul 13 15:24:08.824286 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:08.823888    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/258b7ae3-adf5-437a-8f8e-71bdd1cc665b-node-log\") pod \"ovnkube-node-9dq6z\" (UID: \"258b7ae3-adf5-437a-8f8e-71bdd1cc665b\") " pod="openshift-ovn-kubernetes/ovnkube-node-9dq6z"
Jul 13 15:24:08.824286 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:08.823914    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/ca6016f5-c1af-4395-bdf0-e642bf637019-host-var-lib-cni-multus\") pod \"multus-q24vk\" (UID: \"ca6016f5-c1af-4395-bdf0-e642bf637019\") " pod="openshift-multus/multus-q24vk"
Jul 13 15:24:08.824286 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:08.823939    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/ca6016f5-c1af-4395-bdf0-e642bf637019-multus-daemon-config\") pod \"multus-q24vk\" (UID: \"ca6016f5-c1af-4395-bdf0-e642bf637019\") " pod="openshift-multus/multus-q24vk"
Jul 13 15:24:08.824286 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:08.823963    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/a0cd4788-5dd7-402b-9364-7588dcd91951-cni-binary-copy\") pod \"multus-additional-cni-plugins-t8ljw\" (UID: \"a0cd4788-5dd7-402b-9364-7588dcd91951\") " pod="openshift-multus/multus-additional-cni-plugins-t8ljw"
Jul 13 15:24:08.824286 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:08.823987    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/258b7ae3-adf5-437a-8f8e-71bdd1cc665b-ovnkube-config\") pod \"ovnkube-node-9dq6z\" (UID: \"258b7ae3-adf5-437a-8f8e-71bdd1cc665b\") " pod="openshift-ovn-kubernetes/ovnkube-node-9dq6z"
Jul 13 15:24:08.824286 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:08.824009    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/258b7ae3-adf5-437a-8f8e-71bdd1cc665b-host-kubelet\") pod \"ovnkube-node-9dq6z\" (UID: \"258b7ae3-adf5-437a-8f8e-71bdd1cc665b\") " pod="openshift-ovn-kubernetes/ovnkube-node-9dq6z"
Jul 13 15:24:08.824286 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:08.824032    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/258b7ae3-adf5-437a-8f8e-71bdd1cc665b-host-run-netns\") pod \"ovnkube-node-9dq6z\" (UID: \"258b7ae3-adf5-437a-8f8e-71bdd1cc665b\") " pod="openshift-ovn-kubernetes/ovnkube-node-9dq6z"
Jul 13 15:24:08.824286 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:08.824055    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/258b7ae3-adf5-437a-8f8e-71bdd1cc665b-run-openvswitch\") pod \"ovnkube-node-9dq6z\" (UID: \"258b7ae3-adf5-437a-8f8e-71bdd1cc665b\") " pod="openshift-ovn-kubernetes/ovnkube-node-9dq6z"
Jul 13 15:24:08.824286 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:08.824079    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/258b7ae3-adf5-437a-8f8e-71bdd1cc665b-host-cni-netd\") pod \"ovnkube-node-9dq6z\" (UID: \"258b7ae3-adf5-437a-8f8e-71bdd1cc665b\") " pod="openshift-ovn-kubernetes/ovnkube-node-9dq6z"
Jul 13 15:24:08.825091 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:08.824109    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ca6016f5-c1af-4395-bdf0-e642bf637019-host-run-netns\") pod \"multus-q24vk\" (UID: \"ca6016f5-c1af-4395-bdf0-e642bf637019\") " pod="openshift-multus/multus-q24vk"
Jul 13 15:24:08.825091 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:08.824134    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/258b7ae3-adf5-437a-8f8e-71bdd1cc665b-ovn-node-metrics-cert\") pod \"ovnkube-node-9dq6z\" (UID: \"258b7ae3-adf5-437a-8f8e-71bdd1cc665b\") " pod="openshift-ovn-kubernetes/ovnkube-node-9dq6z"
Jul 13 15:24:08.825091 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:08.824158    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/7687fe5c-b22f-40ba-af3e-b74095ec910c-konnectivity-ca\") pod \"konnectivity-agent-v8r47\" (UID: \"7687fe5c-b22f-40ba-af3e-b74095ec910c\") " pod="kube-system/konnectivity-agent-v8r47"
Jul 13 15:24:08.825091 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:08.824181    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 13 15:24:08.825091 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:08.824181    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/258b7ae3-adf5-437a-8f8e-71bdd1cc665b-run-ovn\") pod \"ovnkube-node-9dq6z\" (UID: \"258b7ae3-adf5-437a-8f8e-71bdd1cc665b\") " pod="openshift-ovn-kubernetes/ovnkube-node-9dq6z"
Jul 13 15:24:08.825091 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:08.824222    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ca6016f5-c1af-4395-bdf0-e642bf637019-system-cni-dir\") pod \"multus-q24vk\" (UID: \"ca6016f5-c1af-4395-bdf0-e642bf637019\") " pod="openshift-multus/multus-q24vk"
Jul 13 15:24:08.825091 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:08.824242    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-mn9k5\""
Jul 13 15:24:08.825091 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:08.824245    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/ca6016f5-c1af-4395-bdf0-e642bf637019-cnibin\") pod \"multus-q24vk\" (UID: \"ca6016f5-c1af-4395-bdf0-e642bf637019\") " pod="openshift-multus/multus-q24vk"
Jul 13 15:24:08.825091 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:08.824271    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/258b7ae3-adf5-437a-8f8e-71bdd1cc665b-env-overrides\") pod \"ovnkube-node-9dq6z\" (UID: \"258b7ae3-adf5-437a-8f8e-71bdd1cc665b\") " pod="openshift-ovn-kubernetes/ovnkube-node-9dq6z"
Jul 13 15:24:08.825091 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:08.824293    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/7687fe5c-b22f-40ba-af3e-b74095ec910c-agent-certs\") pod \"konnectivity-agent-v8r47\" (UID: \"7687fe5c-b22f-40ba-af3e-b74095ec910c\") " pod="kube-system/konnectivity-agent-v8r47"
Jul 13 15:24:08.825091 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:08.824341    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/697aa34e-8473-49a1-a7dd-8be4f23ea1b3-hosts-file\") pod \"node-resolver-vmz75\" (UID: \"697aa34e-8473-49a1-a7dd-8be4f23ea1b3\") " pod="openshift-dns/node-resolver-vmz75"
Jul 13 15:24:08.825091 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:08.824586    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7v5qg"
Jul 13 15:24:08.826464 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:08.826250    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 13 15:24:08.826998 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:08.826642    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8whd7"
Jul 13 15:24:08.826998 ip-10-0-140-255 kubenswrapper[2564]: E0713 15:24:08.826704    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8whd7" podUID="9c040000-a5ce-49b2-b7a8-6faedac4708f"
Jul 13 15:24:08.827591 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:08.827443    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 13 15:24:08.827591 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:08.827578    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-lkpzc\""
Jul 13 15:24:08.827826 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:08.827804    2564 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 13 15:24:08.828935 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:08.828749    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-nbxfp"
Jul 13 15:24:08.829736 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:08.829430    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 13 15:24:08.829736 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:08.829565    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 13 15:24:08.829736 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:08.829619    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 13 15:24:08.829736 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:08.829647    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jul 13 15:24:08.830008 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:08.829796    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-bbsfr\""
Jul 13 15:24:08.831323 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:08.831298    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 13 15:24:08.831615 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:08.831596    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 13 15:24:08.831848 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:08.831823    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-pd4m2\""
Jul 13 15:24:08.832073 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:08.832056    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 13 15:24:08.855242 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:08.855218    2564 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-cdc89"
Jul 13 15:24:08.867536 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:08.866573    2564 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-cdc89"
Jul 13 15:24:08.913137 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:08.913045    2564 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jul 13 15:24:08.925469 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:08.925434    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/ca6016f5-c1af-4395-bdf0-e642bf637019-multus-daemon-config\") pod \"multus-q24vk\" (UID: \"ca6016f5-c1af-4395-bdf0-e642bf637019\") " pod="openshift-multus/multus-q24vk"
Jul 13 15:24:08.925629 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:08.925486    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/a0cd4788-5dd7-402b-9364-7588dcd91951-cni-binary-copy\") pod \"multus-additional-cni-plugins-t8ljw\" (UID: \"a0cd4788-5dd7-402b-9364-7588dcd91951\") " pod="openshift-multus/multus-additional-cni-plugins-t8ljw"
Jul 13 15:24:08.925629 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:08.925521    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c9f5cad4-bd45-453d-912b-d73122b0562e-etc-kubernetes\") pod \"tuned-7bd8f\" (UID: \"c9f5cad4-bd45-453d-912b-d73122b0562e\") " pod="openshift-cluster-node-tuning-operator/tuned-7bd8f"
Jul 13 15:24:08.925629 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:08.925553    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c9f5cad4-bd45-453d-912b-d73122b0562e-var-lib-kubelet\") pod \"tuned-7bd8f\" (UID: \"c9f5cad4-bd45-453d-912b-d73122b0562e\") " pod="openshift-cluster-node-tuning-operator/tuned-7bd8f"
Jul 13 15:24:08.925629 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:08.925583    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/0f6cac01-3a2e-4b4d-bd6b-b07daa4fc725-etc-selinux\") pod \"aws-ebs-csi-driver-node-7v5qg\" (UID: \"0f6cac01-3a2e-4b4d-bd6b-b07daa4fc725\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7v5qg"
Jul 13 15:24:08.925629 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:08.925610    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/258b7ae3-adf5-437a-8f8e-71bdd1cc665b-ovnkube-config\") pod \"ovnkube-node-9dq6z\" (UID: \"258b7ae3-adf5-437a-8f8e-71bdd1cc665b\") " pod="openshift-ovn-kubernetes/ovnkube-node-9dq6z"
Jul 13 15:24:08.925887 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:08.925639    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/258b7ae3-adf5-437a-8f8e-71bdd1cc665b-host-kubelet\") pod \"ovnkube-node-9dq6z\" (UID: \"258b7ae3-adf5-437a-8f8e-71bdd1cc665b\") " pod="openshift-ovn-kubernetes/ovnkube-node-9dq6z"
Jul 13 15:24:08.925887 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:08.925667    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/258b7ae3-adf5-437a-8f8e-71bdd1cc665b-host-run-netns\") pod \"ovnkube-node-9dq6z\" (UID: \"258b7ae3-adf5-437a-8f8e-71bdd1cc665b\") " pod="openshift-ovn-kubernetes/ovnkube-node-9dq6z"
Jul 13 15:24:08.925887 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:08.925696    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/258b7ae3-adf5-437a-8f8e-71bdd1cc665b-run-openvswitch\") pod \"ovnkube-node-9dq6z\" (UID: \"258b7ae3-adf5-437a-8f8e-71bdd1cc665b\") " pod="openshift-ovn-kubernetes/ovnkube-node-9dq6z"
Jul 13 15:24:08.925887 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:08.925727    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/258b7ae3-adf5-437a-8f8e-71bdd1cc665b-host-cni-netd\") pod \"ovnkube-node-9dq6z\" (UID: \"258b7ae3-adf5-437a-8f8e-71bdd1cc665b\") " pod="openshift-ovn-kubernetes/ovnkube-node-9dq6z"
Jul 13 15:24:08.925887 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:08.925753    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ca6016f5-c1af-4395-bdf0-e642bf637019-host-run-netns\") pod \"multus-q24vk\" (UID: \"ca6016f5-c1af-4395-bdf0-e642bf637019\") " pod="openshift-multus/multus-q24vk"
Jul 13 15:24:08.925887 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:08.925782    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/c9f5cad4-bd45-453d-912b-d73122b0562e-etc-sysconfig\") pod \"tuned-7bd8f\" (UID: \"c9f5cad4-bd45-453d-912b-d73122b0562e\") " pod="openshift-cluster-node-tuning-operator/tuned-7bd8f"
Jul 13 15:24:08.925887 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:08.925818    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/c9f5cad4-bd45-453d-912b-d73122b0562e-etc-systemd\") pod \"tuned-7bd8f\" (UID: \"c9f5cad4-bd45-453d-912b-d73122b0562e\") " pod="openshift-cluster-node-tuning-operator/tuned-7bd8f"
Jul 13 15:24:08.925887 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:08.925849    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/258b7ae3-adf5-437a-8f8e-71bdd1cc665b-ovn-node-metrics-cert\") pod \"ovnkube-node-9dq6z\" (UID: \"258b7ae3-adf5-437a-8f8e-71bdd1cc665b\") " pod="openshift-ovn-kubernetes/ovnkube-node-9dq6z"
Jul 13 15:24:08.926234 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:08.925893    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/c9f5cad4-bd45-453d-912b-d73122b0562e-etc-tuned\") pod \"tuned-7bd8f\" (UID: \"c9f5cad4-bd45-453d-912b-d73122b0562e\") " pod="openshift-cluster-node-tuning-operator/tuned-7bd8f"
Jul 13 15:24:08.926234 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:08.925925    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mlhhm\" (UniqueName: \"kubernetes.io/projected/c9f5cad4-bd45-453d-912b-d73122b0562e-kube-api-access-mlhhm\") pod \"tuned-7bd8f\" (UID: \"c9f5cad4-bd45-453d-912b-d73122b0562e\") " pod="openshift-cluster-node-tuning-operator/tuned-7bd8f"
Jul 13 15:24:08.926234 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:08.925954    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dlzpx\" (UniqueName: \"kubernetes.io/projected/7897ab94-b445-4dd1-9475-4a316db407a2-kube-api-access-dlzpx\") pod \"node-ca-zq68g\" (UID: \"7897ab94-b445-4dd1-9475-4a316db407a2\") " pod="openshift-image-registry/node-ca-zq68g"
Jul 13 15:24:08.926234 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:08.925988    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x4ls8\" (UniqueName: \"kubernetes.io/projected/9c040000-a5ce-49b2-b7a8-6faedac4708f-kube-api-access-x4ls8\") pod \"network-metrics-daemon-8whd7\" (UID: \"9c040000-a5ce-49b2-b7a8-6faedac4708f\") " pod="openshift-multus/network-metrics-daemon-8whd7"
Jul 13 15:24:08.926234 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:08.926028    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/7687fe5c-b22f-40ba-af3e-b74095ec910c-konnectivity-ca\") pod \"konnectivity-agent-v8r47\" (UID: \"7687fe5c-b22f-40ba-af3e-b74095ec910c\") " pod="kube-system/konnectivity-agent-v8r47"
Jul 13 15:24:08.926234 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:08.926057    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/c9f5cad4-bd45-453d-912b-d73122b0562e-etc-sysctl-d\") pod \"tuned-7bd8f\" (UID: \"c9f5cad4-bd45-453d-912b-d73122b0562e\") " pod="openshift-cluster-node-tuning-operator/tuned-7bd8f"
Jul 13 15:24:08.926234 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:08.926080    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/c9f5cad4-bd45-453d-912b-d73122b0562e-run\") pod \"tuned-7bd8f\" (UID: \"c9f5cad4-bd45-453d-912b-d73122b0562e\") " pod="openshift-cluster-node-tuning-operator/tuned-7bd8f"
Jul 13 15:24:08.926234 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:08.926109    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/0f6cac01-3a2e-4b4d-bd6b-b07daa4fc725-kubelet-dir\") pod \"aws-ebs-csi-driver-node-7v5qg\" (UID: \"0f6cac01-3a2e-4b4d-bd6b-b07daa4fc725\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7v5qg"
Jul 13 15:24:08.926234 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:08.926137    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/258b7ae3-adf5-437a-8f8e-71bdd1cc665b-run-ovn\") pod \"ovnkube-node-9dq6z\" (UID: \"258b7ae3-adf5-437a-8f8e-71bdd1cc665b\") " pod="openshift-ovn-kubernetes/ovnkube-node-9dq6z"
Jul 13 15:24:08.926234 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:08.926165    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ca6016f5-c1af-4395-bdf0-e642bf637019-system-cni-dir\") pod \"multus-q24vk\" (UID: \"ca6016f5-c1af-4395-bdf0-e642bf637019\") " pod="openshift-multus/multus-q24vk"
Jul 13 15:24:08.926234 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:08.926193    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/ca6016f5-c1af-4395-bdf0-e642bf637019-cnibin\") pod \"multus-q24vk\" (UID: \"ca6016f5-c1af-4395-bdf0-e642bf637019\") " pod="openshift-multus/multus-q24vk"
Jul 13 15:24:08.926234 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:08.926216    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-blssv\" (UniqueName: \"kubernetes.io/projected/a5193ce3-be31-44a5-a677-c50746b73b3f-kube-api-access-blssv\") pod \"iptables-alerter-nbxfp\" (UID: \"a5193ce3-be31-44a5-a677-c50746b73b3f\") " pod="openshift-network-operator/iptables-alerter-nbxfp"
Jul 13 15:24:08.926734 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:08.926243    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/258b7ae3-adf5-437a-8f8e-71bdd1cc665b-env-overrides\") pod \"ovnkube-node-9dq6z\" (UID: \"258b7ae3-adf5-437a-8f8e-71bdd1cc665b\") " pod="openshift-ovn-kubernetes/ovnkube-node-9dq6z"
Jul 13 15:24:08.926734 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:08.926271    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/7687fe5c-b22f-40ba-af3e-b74095ec910c-agent-certs\") pod \"konnectivity-agent-v8r47\" (UID: \"7687fe5c-b22f-40ba-af3e-b74095ec910c\") " pod="kube-system/konnectivity-agent-v8r47"
Jul 13 15:24:08.926734 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:08.926297    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/c9f5cad4-bd45-453d-912b-d73122b0562e-host\") pod \"tuned-7bd8f\" (UID: \"c9f5cad4-bd45-453d-912b-d73122b0562e\") " pod="openshift-cluster-node-tuning-operator/tuned-7bd8f"
Jul 13 15:24:08.926734 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:08.926322    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/7897ab94-b445-4dd1-9475-4a316db407a2-host\") pod \"node-ca-zq68g\" (UID: \"7897ab94-b445-4dd1-9475-4a316db407a2\") " pod="openshift-image-registry/node-ca-zq68g"
Jul 13 15:24:08.926734 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:08.926345    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/0f6cac01-3a2e-4b4d-bd6b-b07daa4fc725-device-dir\") pod \"aws-ebs-csi-driver-node-7v5qg\" (UID: \"0f6cac01-3a2e-4b4d-bd6b-b07daa4fc725\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7v5qg"
Jul 13 15:24:08.926734 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:08.926383    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/697aa34e-8473-49a1-a7dd-8be4f23ea1b3-hosts-file\") pod \"node-resolver-vmz75\" (UID: \"697aa34e-8473-49a1-a7dd-8be4f23ea1b3\") " pod="openshift-dns/node-resolver-vmz75"
Jul 13 15:24:08.926734 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:08.926415    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/697aa34e-8473-49a1-a7dd-8be4f23ea1b3-tmp-dir\") pod \"node-resolver-vmz75\" (UID: \"697aa34e-8473-49a1-a7dd-8be4f23ea1b3\") " pod="openshift-dns/node-resolver-vmz75"
Jul 13 15:24:08.926734 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:08.926444    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/258b7ae3-adf5-437a-8f8e-71bdd1cc665b-var-lib-openvswitch\") pod \"ovnkube-node-9dq6z\" (UID: \"258b7ae3-adf5-437a-8f8e-71bdd1cc665b\") " pod="openshift-ovn-kubernetes/ovnkube-node-9dq6z"
Jul 13 15:24:08.926734 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:08.926478    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/258b7ae3-adf5-437a-8f8e-71bdd1cc665b-host-run-ovn-kubernetes\") pod \"ovnkube-node-9dq6z\" (UID: \"258b7ae3-adf5-437a-8f8e-71bdd1cc665b\") " pod="openshift-ovn-kubernetes/ovnkube-node-9dq6z"
Jul 13 15:24:08.926734 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:08.926507    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/258b7ae3-adf5-437a-8f8e-71bdd1cc665b-host-cni-bin\") pod \"ovnkube-node-9dq6z\" (UID: \"258b7ae3-adf5-437a-8f8e-71bdd1cc665b\") " pod="openshift-ovn-kubernetes/ovnkube-node-9dq6z"
Jul 13 15:24:08.926734 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:08.926531    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ca6016f5-c1af-4395-bdf0-e642bf637019-multus-cni-dir\") pod \"multus-q24vk\" (UID: \"ca6016f5-c1af-4395-bdf0-e642bf637019\") " pod="openshift-multus/multus-q24vk"
Jul 13 15:24:08.926734 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:08.926561    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/ca6016f5-c1af-4395-bdf0-e642bf637019-host-run-multus-certs\") pod \"multus-q24vk\" (UID: \"ca6016f5-c1af-4395-bdf0-e642bf637019\") " pod="openshift-multus/multus-q24vk"
Jul 13 15:24:08.926734 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:08.926622    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/258b7ae3-adf5-437a-8f8e-71bdd1cc665b-systemd-units\") pod \"ovnkube-node-9dq6z\" (UID: \"258b7ae3-adf5-437a-8f8e-71bdd1cc665b\") " pod="openshift-ovn-kubernetes/ovnkube-node-9dq6z"
Jul 13 15:24:08.926734 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:08.926651    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6tpjc\" (UniqueName: \"kubernetes.io/projected/258b7ae3-adf5-437a-8f8e-71bdd1cc665b-kube-api-access-6tpjc\") pod \"ovnkube-node-9dq6z\" (UID: \"258b7ae3-adf5-437a-8f8e-71bdd1cc665b\") " pod="openshift-ovn-kubernetes/ovnkube-node-9dq6z"
Jul 13 15:24:08.926734 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:08.926678    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/ca6016f5-c1af-4395-bdf0-e642bf637019-os-release\") pod \"multus-q24vk\" (UID: \"ca6016f5-c1af-4395-bdf0-e642bf637019\") " pod="openshift-multus/multus-q24vk"
Jul 13 15:24:08.926734 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:08.926703    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/ca6016f5-c1af-4395-bdf0-e642bf637019-cni-binary-copy\") pod \"multus-q24vk\" (UID: \"ca6016f5-c1af-4395-bdf0-e642bf637019\") " pod="openshift-multus/multus-q24vk"
Jul 13 15:24:08.926734 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:08.926733    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ca6016f5-c1af-4395-bdf0-e642bf637019-etc-kubernetes\") pod \"multus-q24vk\" (UID: \"ca6016f5-c1af-4395-bdf0-e642bf637019\") " pod="openshift-multus/multus-q24vk"
Jul 13 15:24:08.927447 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:08.926760    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/a0cd4788-5dd7-402b-9364-7588dcd91951-os-release\") pod \"multus-additional-cni-plugins-t8ljw\" (UID: \"a0cd4788-5dd7-402b-9364-7588dcd91951\") " pod="openshift-multus/multus-additional-cni-plugins-t8ljw"
Jul 13 15:24:08.927447 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:08.926789    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/a0cd4788-5dd7-402b-9364-7588dcd91951-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-t8ljw\" (UID: \"a0cd4788-5dd7-402b-9364-7588dcd91951\") " pod="openshift-multus/multus-additional-cni-plugins-t8ljw"
Jul 13 15:24:08.927447 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:08.926817    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/84c5054b-6b5c-4b21-992a-cbd68bf1b4f2-kubelet-config\") pod \"global-pull-secret-syncer-75h9t\" (UID: \"84c5054b-6b5c-4b21-992a-cbd68bf1b4f2\") " pod="kube-system/global-pull-secret-syncer-75h9t"
Jul 13 15:24:08.927447 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:08.926884    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/258b7ae3-adf5-437a-8f8e-71bdd1cc665b-ovnkube-script-lib\") pod \"ovnkube-node-9dq6z\" (UID: \"258b7ae3-adf5-437a-8f8e-71bdd1cc665b\") " pod="openshift-ovn-kubernetes/ovnkube-node-9dq6z"
Jul 13 15:24:08.927447 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:08.926916    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c9f5cad4-bd45-453d-912b-d73122b0562e-tmp\") pod \"tuned-7bd8f\" (UID: \"c9f5cad4-bd45-453d-912b-d73122b0562e\") " pod="openshift-cluster-node-tuning-operator/tuned-7bd8f"
Jul 13 15:24:08.927447 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:08.926945    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a5193ce3-be31-44a5-a677-c50746b73b3f-host-slash\") pod \"iptables-alerter-nbxfp\" (UID: \"a5193ce3-be31-44a5-a677-c50746b73b3f\") " pod="openshift-network-operator/iptables-alerter-nbxfp"
Jul 13 15:24:08.927447 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:08.926976    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fmjhp\" (UniqueName: \"kubernetes.io/projected/697aa34e-8473-49a1-a7dd-8be4f23ea1b3-kube-api-access-fmjhp\") pod \"node-resolver-vmz75\" (UID: \"697aa34e-8473-49a1-a7dd-8be4f23ea1b3\") " pod="openshift-dns/node-resolver-vmz75"
Jul 13 15:24:08.927447 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:08.927002    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/258b7ae3-adf5-437a-8f8e-71bdd1cc665b-host-slash\") pod \"ovnkube-node-9dq6z\" (UID: \"258b7ae3-adf5-437a-8f8e-71bdd1cc665b\") " pod="openshift-ovn-kubernetes/ovnkube-node-9dq6z"
Jul 13 15:24:08.927447 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:08.927033    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ca6016f5-c1af-4395-bdf0-e642bf637019-host-var-lib-cni-bin\") pod \"multus-q24vk\" (UID: \"ca6016f5-c1af-4395-bdf0-e642bf637019\") " pod="openshift-multus/multus-q24vk"
Jul 13 15:24:08.927447 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:08.927063    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ca6016f5-c1af-4395-bdf0-e642bf637019-host-var-lib-kubelet\") pod \"multus-q24vk\" (UID: \"ca6016f5-c1af-4395-bdf0-e642bf637019\") " pod="openshift-multus/multus-q24vk"
Jul 13 15:24:08.927447 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:08.927095    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/84c5054b-6b5c-4b21-992a-cbd68bf1b4f2-original-pull-secret\") pod \"global-pull-secret-syncer-75h9t\" (UID: \"84c5054b-6b5c-4b21-992a-cbd68bf1b4f2\") " pod="kube-system/global-pull-secret-syncer-75h9t"
Jul 13 15:24:08.927447 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:08.927124    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/c9f5cad4-bd45-453d-912b-d73122b0562e-etc-modprobe-d\") pod \"tuned-7bd8f\" (UID: \"c9f5cad4-bd45-453d-912b-d73122b0562e\") " pod="openshift-cluster-node-tuning-operator/tuned-7bd8f"
Jul 13 15:24:08.927447 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:08.927147    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/0f6cac01-3a2e-4b4d-bd6b-b07daa4fc725-registration-dir\") pod \"aws-ebs-csi-driver-node-7v5qg\" (UID: \"0f6cac01-3a2e-4b4d-bd6b-b07daa4fc725\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7v5qg"
Jul 13 15:24:08.927447 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:08.927176    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/0f6cac01-3a2e-4b4d-bd6b-b07daa4fc725-sys-fs\") pod \"aws-ebs-csi-driver-node-7v5qg\" (UID: \"0f6cac01-3a2e-4b4d-bd6b-b07daa4fc725\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7v5qg"
Jul 13 15:24:08.927447 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:08.927204    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/ca6016f5-c1af-4395-bdf0-e642bf637019-host-run-k8s-cni-cncf-io\") pod \"multus-q24vk\" (UID: \"ca6016f5-c1af-4395-bdf0-e642bf637019\") " pod="openshift-multus/multus-q24vk"
Jul 13 15:24:08.927447 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:08.927233    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/ca6016f5-c1af-4395-bdf0-e642bf637019-multus-conf-dir\") pod \"multus-q24vk\" (UID: \"ca6016f5-c1af-4395-bdf0-e642bf637019\") " pod="openshift-multus/multus-q24vk"
Jul 13 15:24:08.927447 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:08.927262    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d9flx\" (UniqueName: \"kubernetes.io/projected/38555aab-29b1-4bdf-b689-069e8fe6712c-kube-api-access-d9flx\") pod \"network-check-target-7qzb8\" (UID: \"38555aab-29b1-4bdf-b689-069e8fe6712c\") " pod="openshift-network-diagnostics/network-check-target-7qzb8"
Jul 13 15:24:08.928211 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:08.927287    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/c9f5cad4-bd45-453d-912b-d73122b0562e-lib-modules\") pod \"tuned-7bd8f\" (UID: \"c9f5cad4-bd45-453d-912b-d73122b0562e\") " pod="openshift-cluster-node-tuning-operator/tuned-7bd8f"
Jul 13 15:24:08.928211 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:08.927317    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9c040000-a5ce-49b2-b7a8-6faedac4708f-metrics-certs\") pod \"network-metrics-daemon-8whd7\" (UID: \"9c040000-a5ce-49b2-b7a8-6faedac4708f\") " pod="openshift-multus/network-metrics-daemon-8whd7"
Jul 13 15:24:08.928211 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:08.927347    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/ca6016f5-c1af-4395-bdf0-e642bf637019-hostroot\") pod \"multus-q24vk\" (UID: \"ca6016f5-c1af-4395-bdf0-e642bf637019\") " pod="openshift-multus/multus-q24vk"
Jul 13 15:24:08.928211 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:08.927384    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/a0cd4788-5dd7-402b-9364-7588dcd91951-tuning-conf-dir\") pod \"multus-additional-cni-plugins-t8ljw\" (UID: \"a0cd4788-5dd7-402b-9364-7588dcd91951\") " pod="openshift-multus/multus-additional-cni-plugins-t8ljw"
Jul 13 15:24:08.928211 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:08.927410    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zrntz\" (UniqueName: \"kubernetes.io/projected/0f6cac01-3a2e-4b4d-bd6b-b07daa4fc725-kube-api-access-zrntz\") pod \"aws-ebs-csi-driver-node-7v5qg\" (UID: \"0f6cac01-3a2e-4b4d-bd6b-b07daa4fc725\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7v5qg"
Jul 13 15:24:08.928211 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:08.927444    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/258b7ae3-adf5-437a-8f8e-71bdd1cc665b-run-systemd\") pod \"ovnkube-node-9dq6z\" (UID: \"258b7ae3-adf5-437a-8f8e-71bdd1cc665b\") " pod="openshift-ovn-kubernetes/ovnkube-node-9dq6z"
Jul 13 15:24:08.928211 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:08.927473    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/258b7ae3-adf5-437a-8f8e-71bdd1cc665b-log-socket\") pod \"ovnkube-node-9dq6z\" (UID: \"258b7ae3-adf5-437a-8f8e-71bdd1cc665b\") " pod="openshift-ovn-kubernetes/ovnkube-node-9dq6z"
Jul 13 15:24:08.928211 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:08.927507    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sfz9t\" (UniqueName: \"kubernetes.io/projected/ca6016f5-c1af-4395-bdf0-e642bf637019-kube-api-access-sfz9t\") pod \"multus-q24vk\" (UID: \"ca6016f5-c1af-4395-bdf0-e642bf637019\") " pod="openshift-multus/multus-q24vk"
Jul 13 15:24:08.928211 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:08.927548    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/a0cd4788-5dd7-402b-9364-7588dcd91951-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-t8ljw\" (UID: \"a0cd4788-5dd7-402b-9364-7588dcd91951\") " pod="openshift-multus/multus-additional-cni-plugins-t8ljw"
Jul 13 15:24:08.928211 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:08.927581    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-chw8w\" (UniqueName: \"kubernetes.io/projected/a0cd4788-5dd7-402b-9364-7588dcd91951-kube-api-access-chw8w\") pod \"multus-additional-cni-plugins-t8ljw\" (UID: \"a0cd4788-5dd7-402b-9364-7588dcd91951\") " pod="openshift-multus/multus-additional-cni-plugins-t8ljw"
Jul 13 15:24:08.928211 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:08.927613    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/258b7ae3-adf5-437a-8f8e-71bdd1cc665b-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-9dq6z\" (UID: \"258b7ae3-adf5-437a-8f8e-71bdd1cc665b\") " pod="openshift-ovn-kubernetes/ovnkube-node-9dq6z"
Jul 13 15:24:08.928211 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:08.927646    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/a0cd4788-5dd7-402b-9364-7588dcd91951-cnibin\") pod \"multus-additional-cni-plugins-t8ljw\" (UID: \"a0cd4788-5dd7-402b-9364-7588dcd91951\") " pod="openshift-multus/multus-additional-cni-plugins-t8ljw"
Jul 13 15:24:08.928211 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:08.927677    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/84c5054b-6b5c-4b21-992a-cbd68bf1b4f2-dbus\") pod \"global-pull-secret-syncer-75h9t\" (UID: \"84c5054b-6b5c-4b21-992a-cbd68bf1b4f2\") " pod="kube-system/global-pull-secret-syncer-75h9t"
Jul 13 15:24:08.928211 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:08.927703    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/a5193ce3-be31-44a5-a677-c50746b73b3f-iptables-alerter-script\") pod \"iptables-alerter-nbxfp\" (UID: \"a5193ce3-be31-44a5-a677-c50746b73b3f\") " pod="openshift-network-operator/iptables-alerter-nbxfp"
Jul 13 15:24:08.928211 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:08.927736    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/ca6016f5-c1af-4395-bdf0-e642bf637019-multus-socket-dir-parent\") pod \"multus-q24vk\" (UID: \"ca6016f5-c1af-4395-bdf0-e642bf637019\") " pod="openshift-multus/multus-q24vk"
Jul 13 15:24:08.928211 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:08.927768    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a0cd4788-5dd7-402b-9364-7588dcd91951-system-cni-dir\") pod \"multus-additional-cni-plugins-t8ljw\" (UID: \"a0cd4788-5dd7-402b-9364-7588dcd91951\") " pod="openshift-multus/multus-additional-cni-plugins-t8ljw"
Jul 13 15:24:08.928911 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:08.927798    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/c9f5cad4-bd45-453d-912b-d73122b0562e-etc-sysctl-conf\") pod \"tuned-7bd8f\" (UID: \"c9f5cad4-bd45-453d-912b-d73122b0562e\") " pod="openshift-cluster-node-tuning-operator/tuned-7bd8f"
Jul 13 15:24:08.928911 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:08.927823    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/7897ab94-b445-4dd1-9475-4a316db407a2-serviceca\") pod \"node-ca-zq68g\" (UID: \"7897ab94-b445-4dd1-9475-4a316db407a2\") " pod="openshift-image-registry/node-ca-zq68g"
Jul 13 15:24:08.928911 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:08.927851    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/0f6cac01-3a2e-4b4d-bd6b-b07daa4fc725-socket-dir\") pod \"aws-ebs-csi-driver-node-7v5qg\" (UID: \"0f6cac01-3a2e-4b4d-bd6b-b07daa4fc725\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7v5qg"
Jul 13 15:24:08.928911 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:08.927901    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/258b7ae3-adf5-437a-8f8e-71bdd1cc665b-etc-openvswitch\") pod \"ovnkube-node-9dq6z\" (UID: \"258b7ae3-adf5-437a-8f8e-71bdd1cc665b\") " pod="openshift-ovn-kubernetes/ovnkube-node-9dq6z"
Jul 13 15:24:08.928911 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:08.927935    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/258b7ae3-adf5-437a-8f8e-71bdd1cc665b-node-log\") pod \"ovnkube-node-9dq6z\" (UID: \"258b7ae3-adf5-437a-8f8e-71bdd1cc665b\") " pod="openshift-ovn-kubernetes/ovnkube-node-9dq6z"
Jul 13 15:24:08.928911 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:08.927964    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c9f5cad4-bd45-453d-912b-d73122b0562e-sys\") pod \"tuned-7bd8f\" (UID: \"c9f5cad4-bd45-453d-912b-d73122b0562e\") " pod="openshift-cluster-node-tuning-operator/tuned-7bd8f"
Jul 13 15:24:08.928911 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:08.927991    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/ca6016f5-c1af-4395-bdf0-e642bf637019-host-var-lib-cni-multus\") pod \"multus-q24vk\" (UID: \"ca6016f5-c1af-4395-bdf0-e642bf637019\") " pod="openshift-multus/multus-q24vk"
Jul 13 15:24:08.928911 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:08.928118    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/ca6016f5-c1af-4395-bdf0-e642bf637019-host-var-lib-cni-multus\") pod \"multus-q24vk\" (UID: \"ca6016f5-c1af-4395-bdf0-e642bf637019\") " pod="openshift-multus/multus-q24vk"
Jul 13 15:24:08.929400 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:08.929377    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/ca6016f5-c1af-4395-bdf0-e642bf637019-multus-daemon-config\") pod \"multus-q24vk\" (UID: \"ca6016f5-c1af-4395-bdf0-e642bf637019\") " pod="openshift-multus/multus-q24vk"
Jul 13 15:24:08.929904 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:08.929882    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/a0cd4788-5dd7-402b-9364-7588dcd91951-cni-binary-copy\") pod \"multus-additional-cni-plugins-t8ljw\" (UID: \"a0cd4788-5dd7-402b-9364-7588dcd91951\") " pod="openshift-multus/multus-additional-cni-plugins-t8ljw"
Jul 13 15:24:08.930581 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:08.930560    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/258b7ae3-adf5-437a-8f8e-71bdd1cc665b-ovnkube-config\") pod \"ovnkube-node-9dq6z\" (UID: \"258b7ae3-adf5-437a-8f8e-71bdd1cc665b\") " pod="openshift-ovn-kubernetes/ovnkube-node-9dq6z"
Jul 13 15:24:08.930676 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:08.930663    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/258b7ae3-adf5-437a-8f8e-71bdd1cc665b-host-kubelet\") pod \"ovnkube-node-9dq6z\" (UID: \"258b7ae3-adf5-437a-8f8e-71bdd1cc665b\") " pod="openshift-ovn-kubernetes/ovnkube-node-9dq6z"
Jul 13 15:24:08.930740 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:08.930725    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/258b7ae3-adf5-437a-8f8e-71bdd1cc665b-host-run-netns\") pod \"ovnkube-node-9dq6z\" (UID: \"258b7ae3-adf5-437a-8f8e-71bdd1cc665b\") " pod="openshift-ovn-kubernetes/ovnkube-node-9dq6z"
Jul 13 15:24:08.930794 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:08.930773    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/258b7ae3-adf5-437a-8f8e-71bdd1cc665b-run-openvswitch\") pod \"ovnkube-node-9dq6z\" (UID: \"258b7ae3-adf5-437a-8f8e-71bdd1cc665b\") " pod="openshift-ovn-kubernetes/ovnkube-node-9dq6z"
Jul 13 15:24:08.932289 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:08.930821    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/258b7ae3-adf5-437a-8f8e-71bdd1cc665b-host-cni-netd\") pod \"ovnkube-node-9dq6z\" (UID: \"258b7ae3-adf5-437a-8f8e-71bdd1cc665b\") " pod="openshift-ovn-kubernetes/ovnkube-node-9dq6z"
Jul 13 15:24:08.932289 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:08.930945    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ca6016f5-c1af-4395-bdf0-e642bf637019-host-run-netns\") pod \"multus-q24vk\" (UID: \"ca6016f5-c1af-4395-bdf0-e642bf637019\") " pod="openshift-multus/multus-q24vk"
Jul 13 15:24:08.932289 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:08.931436    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/258b7ae3-adf5-437a-8f8e-71bdd1cc665b-run-ovn\") pod \"ovnkube-node-9dq6z\" (UID: \"258b7ae3-adf5-437a-8f8e-71bdd1cc665b\") " pod="openshift-ovn-kubernetes/ovnkube-node-9dq6z"
Jul 13 15:24:08.932289 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:08.931470    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ca6016f5-c1af-4395-bdf0-e642bf637019-system-cni-dir\") pod \"multus-q24vk\" (UID: \"ca6016f5-c1af-4395-bdf0-e642bf637019\") " pod="openshift-multus/multus-q24vk"
Jul 13 15:24:08.932289 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:08.931543    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/ca6016f5-c1af-4395-bdf0-e642bf637019-cnibin\") pod \"multus-q24vk\" (UID: \"ca6016f5-c1af-4395-bdf0-e642bf637019\") " pod="openshift-multus/multus-q24vk"
Jul 13 15:24:08.932289 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:08.932093    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/7687fe5c-b22f-40ba-af3e-b74095ec910c-konnectivity-ca\") pod \"konnectivity-agent-v8r47\" (UID: \"7687fe5c-b22f-40ba-af3e-b74095ec910c\") " pod="kube-system/konnectivity-agent-v8r47"
Jul 13 15:24:08.932289 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:08.932199    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/697aa34e-8473-49a1-a7dd-8be4f23ea1b3-tmp-dir\") pod \"node-resolver-vmz75\" (UID: \"697aa34e-8473-49a1-a7dd-8be4f23ea1b3\") " pod="openshift-dns/node-resolver-vmz75"
Jul 13 15:24:08.932289 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:08.932218    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ca6016f5-c1af-4395-bdf0-e642bf637019-etc-kubernetes\") pod \"multus-q24vk\" (UID: \"ca6016f5-c1af-4395-bdf0-e642bf637019\") " pod="openshift-multus/multus-q24vk"
Jul 13 15:24:08.932289 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:08.932243    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/258b7ae3-adf5-437a-8f8e-71bdd1cc665b-host-slash\") pod \"ovnkube-node-9dq6z\" (UID: \"258b7ae3-adf5-437a-8f8e-71bdd1cc665b\") " pod="openshift-ovn-kubernetes/ovnkube-node-9dq6z"
Jul 13 15:24:08.932877 ip-10-0-140-255 kubenswrapper[2564]: E0713 15:24:08.932356    2564 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 13 15:24:08.932877 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:08.932540    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ca6016f5-c1af-4395-bdf0-e642bf637019-host-var-lib-kubelet\") pod \"multus-q24vk\" (UID: \"ca6016f5-c1af-4395-bdf0-e642bf637019\") " pod="openshift-multus/multus-q24vk"
Jul 13 15:24:08.932877 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:08.932632    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/ca6016f5-c1af-4395-bdf0-e642bf637019-os-release\") pod \"multus-q24vk\" (UID: \"ca6016f5-c1af-4395-bdf0-e642bf637019\") " pod="openshift-multus/multus-q24vk"
Jul 13 15:24:08.932877 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:08.932636    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/258b7ae3-adf5-437a-8f8e-71bdd1cc665b-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-9dq6z\" (UID: \"258b7ae3-adf5-437a-8f8e-71bdd1cc665b\") " pod="openshift-ovn-kubernetes/ovnkube-node-9dq6z"
Jul 13 15:24:08.932877 ip-10-0-140-255 kubenswrapper[2564]: E0713 15:24:08.932666    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/84c5054b-6b5c-4b21-992a-cbd68bf1b4f2-original-pull-secret podName:84c5054b-6b5c-4b21-992a-cbd68bf1b4f2 nodeName:}" failed. No retries permitted until 2026-07-13 15:24:09.432621851 +0000 UTC m=+3.011857011 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/84c5054b-6b5c-4b21-992a-cbd68bf1b4f2-original-pull-secret") pod "global-pull-secret-syncer-75h9t" (UID: "84c5054b-6b5c-4b21-992a-cbd68bf1b4f2") : object "kube-system"/"original-pull-secret" not registered
Jul 13 15:24:08.932877 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:08.932686    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/258b7ae3-adf5-437a-8f8e-71bdd1cc665b-systemd-units\") pod \"ovnkube-node-9dq6z\" (UID: \"258b7ae3-adf5-437a-8f8e-71bdd1cc665b\") " pod="openshift-ovn-kubernetes/ovnkube-node-9dq6z"
Jul 13 15:24:08.932877 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:08.932701    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/84c5054b-6b5c-4b21-992a-cbd68bf1b4f2-kubelet-config\") pod \"global-pull-secret-syncer-75h9t\" (UID: \"84c5054b-6b5c-4b21-992a-cbd68bf1b4f2\") " pod="kube-system/global-pull-secret-syncer-75h9t"
Jul 13 15:24:08.932877 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:08.932712    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/a0cd4788-5dd7-402b-9364-7588dcd91951-cnibin\") pod \"multus-additional-cni-plugins-t8ljw\" (UID: \"a0cd4788-5dd7-402b-9364-7588dcd91951\") " pod="openshift-multus/multus-additional-cni-plugins-t8ljw"
Jul 13 15:24:08.932877 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:08.932770    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/258b7ae3-adf5-437a-8f8e-71bdd1cc665b-host-cni-bin\") pod \"ovnkube-node-9dq6z\" (UID: \"258b7ae3-adf5-437a-8f8e-71bdd1cc665b\") " pod="openshift-ovn-kubernetes/ovnkube-node-9dq6z"
Jul 13 15:24:08.932877 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:08.932776    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/258b7ae3-adf5-437a-8f8e-71bdd1cc665b-etc-openvswitch\") pod \"ovnkube-node-9dq6z\" (UID: \"258b7ae3-adf5-437a-8f8e-71bdd1cc665b\") " pod="openshift-ovn-kubernetes/ovnkube-node-9dq6z"
Jul 13 15:24:08.932877 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:08.932846    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/ca6016f5-c1af-4395-bdf0-e642bf637019-host-run-multus-certs\") pod \"multus-q24vk\" (UID: \"ca6016f5-c1af-4395-bdf0-e642bf637019\") " pod="openshift-multus/multus-q24vk"
Jul 13 15:24:08.932877 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:08.932847    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/258b7ae3-adf5-437a-8f8e-71bdd1cc665b-node-log\") pod \"ovnkube-node-9dq6z\" (UID: \"258b7ae3-adf5-437a-8f8e-71bdd1cc665b\") " pod="openshift-ovn-kubernetes/ovnkube-node-9dq6z"
Jul 13 15:24:08.933462 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:08.932925    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/ca6016f5-c1af-4395-bdf0-e642bf637019-hostroot\") pod \"multus-q24vk\" (UID: \"ca6016f5-c1af-4395-bdf0-e642bf637019\") " pod="openshift-multus/multus-q24vk"
Jul 13 15:24:08.933462 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:08.933012    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/ca6016f5-c1af-4395-bdf0-e642bf637019-multus-conf-dir\") pod \"multus-q24vk\" (UID: \"ca6016f5-c1af-4395-bdf0-e642bf637019\") " pod="openshift-multus/multus-q24vk"
Jul 13 15:24:08.933462 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:08.933021    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/697aa34e-8473-49a1-a7dd-8be4f23ea1b3-hosts-file\") pod \"node-resolver-vmz75\" (UID: \"697aa34e-8473-49a1-a7dd-8be4f23ea1b3\") " pod="openshift-dns/node-resolver-vmz75"
Jul 13 15:24:08.933462 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:08.933090    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/ca6016f5-c1af-4395-bdf0-e642bf637019-multus-socket-dir-parent\") pod \"multus-q24vk\" (UID: \"ca6016f5-c1af-4395-bdf0-e642bf637019\") " pod="openshift-multus/multus-q24vk"
Jul 13 15:24:08.933462 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:08.933150    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ca6016f5-c1af-4395-bdf0-e642bf637019-multus-cni-dir\") pod \"multus-q24vk\" (UID: \"ca6016f5-c1af-4395-bdf0-e642bf637019\") " pod="openshift-multus/multus-q24vk"
Jul 13 15:24:08.933462 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:08.933158    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/258b7ae3-adf5-437a-8f8e-71bdd1cc665b-var-lib-openvswitch\") pod \"ovnkube-node-9dq6z\" (UID: \"258b7ae3-adf5-437a-8f8e-71bdd1cc665b\") " pod="openshift-ovn-kubernetes/ovnkube-node-9dq6z"
Jul 13 15:24:08.933462 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:08.933169    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/a0cd4788-5dd7-402b-9364-7588dcd91951-tuning-conf-dir\") pod \"multus-additional-cni-plugins-t8ljw\" (UID: \"a0cd4788-5dd7-402b-9364-7588dcd91951\") " pod="openshift-multus/multus-additional-cni-plugins-t8ljw"
Jul 13 15:24:08.933462 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:08.933192    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/258b7ae3-adf5-437a-8f8e-71bdd1cc665b-log-socket\") pod \"ovnkube-node-9dq6z\" (UID: \"258b7ae3-adf5-437a-8f8e-71bdd1cc665b\") " pod="openshift-ovn-kubernetes/ovnkube-node-9dq6z"
Jul 13 15:24:08.933462 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:08.933218    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/258b7ae3-adf5-437a-8f8e-71bdd1cc665b-host-run-ovn-kubernetes\") pod \"ovnkube-node-9dq6z\" (UID: \"258b7ae3-adf5-437a-8f8e-71bdd1cc665b\") " pod="openshift-ovn-kubernetes/ovnkube-node-9dq6z"
Jul 13 15:24:08.933462 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:08.933266    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/a0cd4788-5dd7-402b-9364-7588dcd91951-os-release\") pod \"multus-additional-cni-plugins-t8ljw\" (UID: \"a0cd4788-5dd7-402b-9364-7588dcd91951\") " pod="openshift-multus/multus-additional-cni-plugins-t8ljw"
Jul 13 15:24:08.934043 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:08.933652    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/258b7ae3-adf5-437a-8f8e-71bdd1cc665b-ovnkube-script-lib\") pod \"ovnkube-node-9dq6z\" (UID: \"258b7ae3-adf5-437a-8f8e-71bdd1cc665b\") " pod="openshift-ovn-kubernetes/ovnkube-node-9dq6z"
Jul 13 15:24:08.934043 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:08.933717    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/258b7ae3-adf5-437a-8f8e-71bdd1cc665b-run-systemd\") pod \"ovnkube-node-9dq6z\" (UID: \"258b7ae3-adf5-437a-8f8e-71bdd1cc665b\") " pod="openshift-ovn-kubernetes/ovnkube-node-9dq6z"
Jul 13 15:24:08.934043 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:08.933730    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/a0cd4788-5dd7-402b-9364-7588dcd91951-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-t8ljw\" (UID: \"a0cd4788-5dd7-402b-9364-7588dcd91951\") " pod="openshift-multus/multus-additional-cni-plugins-t8ljw"
Jul 13 15:24:08.934043 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:08.933820    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/a0cd4788-5dd7-402b-9364-7588dcd91951-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-t8ljw\" (UID: \"a0cd4788-5dd7-402b-9364-7588dcd91951\") " pod="openshift-multus/multus-additional-cni-plugins-t8ljw"
Jul 13 15:24:08.934043 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:08.933901    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a0cd4788-5dd7-402b-9364-7588dcd91951-system-cni-dir\") pod \"multus-additional-cni-plugins-t8ljw\" (UID: \"a0cd4788-5dd7-402b-9364-7588dcd91951\") " pod="openshift-multus/multus-additional-cni-plugins-t8ljw"
Jul 13 15:24:08.934043 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:08.933908    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/ca6016f5-c1af-4395-bdf0-e642bf637019-host-run-k8s-cni-cncf-io\") pod \"multus-q24vk\" (UID: \"ca6016f5-c1af-4395-bdf0-e642bf637019\") " pod="openshift-multus/multus-q24vk"
Jul 13 15:24:08.934877 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:08.934070    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/ca6016f5-c1af-4395-bdf0-e642bf637019-cni-binary-copy\") pod \"multus-q24vk\" (UID: \"ca6016f5-c1af-4395-bdf0-e642bf637019\") " pod="openshift-multus/multus-q24vk"
Jul 13 15:24:08.934877 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:08.934149    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/258b7ae3-adf5-437a-8f8e-71bdd1cc665b-env-overrides\") pod \"ovnkube-node-9dq6z\" (UID: \"258b7ae3-adf5-437a-8f8e-71bdd1cc665b\") " pod="openshift-ovn-kubernetes/ovnkube-node-9dq6z"
Jul 13 15:24:08.934877 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:08.934221    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/84c5054b-6b5c-4b21-992a-cbd68bf1b4f2-dbus\") pod \"global-pull-secret-syncer-75h9t\" (UID: \"84c5054b-6b5c-4b21-992a-cbd68bf1b4f2\") " pod="kube-system/global-pull-secret-syncer-75h9t"
Jul 13 15:24:08.934877 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:08.934283    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ca6016f5-c1af-4395-bdf0-e642bf637019-host-var-lib-cni-bin\") pod \"multus-q24vk\" (UID: \"ca6016f5-c1af-4395-bdf0-e642bf637019\") " pod="openshift-multus/multus-q24vk"
Jul 13 15:24:08.934877 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:08.934576    2564 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jul 13 15:24:08.939186 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:08.939134    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/7687fe5c-b22f-40ba-af3e-b74095ec910c-agent-certs\") pod \"konnectivity-agent-v8r47\" (UID: \"7687fe5c-b22f-40ba-af3e-b74095ec910c\") " pod="kube-system/konnectivity-agent-v8r47"
Jul 13 15:24:08.939282 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:08.939261    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/258b7ae3-adf5-437a-8f8e-71bdd1cc665b-ovn-node-metrics-cert\") pod \"ovnkube-node-9dq6z\" (UID: \"258b7ae3-adf5-437a-8f8e-71bdd1cc665b\") " pod="openshift-ovn-kubernetes/ovnkube-node-9dq6z"
Jul 13 15:24:08.946077 ip-10-0-140-255 kubenswrapper[2564]: E0713 15:24:08.946055    2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 13 15:24:08.946180 ip-10-0-140-255 kubenswrapper[2564]: E0713 15:24:08.946084    2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 13 15:24:08.946180 ip-10-0-140-255 kubenswrapper[2564]: E0713 15:24:08.946098    2564 projected.go:196] Error preparing data for projected volume kube-api-access-d9flx for pod openshift-network-diagnostics/network-check-target-7qzb8: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 13 15:24:08.946180 ip-10-0-140-255 kubenswrapper[2564]: E0713 15:24:08.946160    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/38555aab-29b1-4bdf-b689-069e8fe6712c-kube-api-access-d9flx podName:38555aab-29b1-4bdf-b689-069e8fe6712c nodeName:}" failed. No retries permitted until 2026-07-13 15:24:09.446141666 +0000 UTC m=+3.025376845 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-d9flx" (UniqueName: "kubernetes.io/projected/38555aab-29b1-4bdf-b689-069e8fe6712c-kube-api-access-d9flx") pod "network-check-target-7qzb8" (UID: "38555aab-29b1-4bdf-b689-069e8fe6712c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 13 15:24:08.947515 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:08.947491    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sfz9t\" (UniqueName: \"kubernetes.io/projected/ca6016f5-c1af-4395-bdf0-e642bf637019-kube-api-access-sfz9t\") pod \"multus-q24vk\" (UID: \"ca6016f5-c1af-4395-bdf0-e642bf637019\") " pod="openshift-multus/multus-q24vk"
Jul 13 15:24:08.948172 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:08.948151    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-chw8w\" (UniqueName: \"kubernetes.io/projected/a0cd4788-5dd7-402b-9364-7588dcd91951-kube-api-access-chw8w\") pod \"multus-additional-cni-plugins-t8ljw\" (UID: \"a0cd4788-5dd7-402b-9364-7588dcd91951\") " pod="openshift-multus/multus-additional-cni-plugins-t8ljw"
Jul 13 15:24:08.949283 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:08.949260    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6tpjc\" (UniqueName: \"kubernetes.io/projected/258b7ae3-adf5-437a-8f8e-71bdd1cc665b-kube-api-access-6tpjc\") pod \"ovnkube-node-9dq6z\" (UID: \"258b7ae3-adf5-437a-8f8e-71bdd1cc665b\") " pod="openshift-ovn-kubernetes/ovnkube-node-9dq6z"
Jul 13 15:24:08.949736 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:08.949714    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fmjhp\" (UniqueName: \"kubernetes.io/projected/697aa34e-8473-49a1-a7dd-8be4f23ea1b3-kube-api-access-fmjhp\") pod \"node-resolver-vmz75\" (UID: \"697aa34e-8473-49a1-a7dd-8be4f23ea1b3\") " pod="openshift-dns/node-resolver-vmz75"
Jul 13 15:24:09.029289 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:09.029248    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c9f5cad4-bd45-453d-912b-d73122b0562e-sys\") pod \"tuned-7bd8f\" (UID: \"c9f5cad4-bd45-453d-912b-d73122b0562e\") " pod="openshift-cluster-node-tuning-operator/tuned-7bd8f"
Jul 13 15:24:09.029447 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:09.029316    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c9f5cad4-bd45-453d-912b-d73122b0562e-etc-kubernetes\") pod \"tuned-7bd8f\" (UID: \"c9f5cad4-bd45-453d-912b-d73122b0562e\") " pod="openshift-cluster-node-tuning-operator/tuned-7bd8f"
Jul 13 15:24:09.029447 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:09.029343    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c9f5cad4-bd45-453d-912b-d73122b0562e-var-lib-kubelet\") pod \"tuned-7bd8f\" (UID: \"c9f5cad4-bd45-453d-912b-d73122b0562e\") " pod="openshift-cluster-node-tuning-operator/tuned-7bd8f"
Jul 13 15:24:09.029447 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:09.029367    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/0f6cac01-3a2e-4b4d-bd6b-b07daa4fc725-etc-selinux\") pod \"aws-ebs-csi-driver-node-7v5qg\" (UID: \"0f6cac01-3a2e-4b4d-bd6b-b07daa4fc725\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7v5qg"
Jul 13 15:24:09.029447 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:09.029387    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c9f5cad4-bd45-453d-912b-d73122b0562e-sys\") pod \"tuned-7bd8f\" (UID: \"c9f5cad4-bd45-453d-912b-d73122b0562e\") " pod="openshift-cluster-node-tuning-operator/tuned-7bd8f"
Jul 13 15:24:09.029447 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:09.029394    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/c9f5cad4-bd45-453d-912b-d73122b0562e-etc-sysconfig\") pod \"tuned-7bd8f\" (UID: \"c9f5cad4-bd45-453d-912b-d73122b0562e\") " pod="openshift-cluster-node-tuning-operator/tuned-7bd8f"
Jul 13 15:24:09.029447 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:09.029435    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/c9f5cad4-bd45-453d-912b-d73122b0562e-etc-sysconfig\") pod \"tuned-7bd8f\" (UID: \"c9f5cad4-bd45-453d-912b-d73122b0562e\") " pod="openshift-cluster-node-tuning-operator/tuned-7bd8f"
Jul 13 15:24:09.029723 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:09.029435    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c9f5cad4-bd45-453d-912b-d73122b0562e-etc-kubernetes\") pod \"tuned-7bd8f\" (UID: \"c9f5cad4-bd45-453d-912b-d73122b0562e\") " pod="openshift-cluster-node-tuning-operator/tuned-7bd8f"
Jul 13 15:24:09.029723 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:09.029453    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/c9f5cad4-bd45-453d-912b-d73122b0562e-etc-systemd\") pod \"tuned-7bd8f\" (UID: \"c9f5cad4-bd45-453d-912b-d73122b0562e\") " pod="openshift-cluster-node-tuning-operator/tuned-7bd8f"
Jul 13 15:24:09.029723 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:09.029478    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c9f5cad4-bd45-453d-912b-d73122b0562e-var-lib-kubelet\") pod \"tuned-7bd8f\" (UID: \"c9f5cad4-bd45-453d-912b-d73122b0562e\") " pod="openshift-cluster-node-tuning-operator/tuned-7bd8f"
Jul 13 15:24:09.029723 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:09.029481    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/c9f5cad4-bd45-453d-912b-d73122b0562e-etc-tuned\") pod \"tuned-7bd8f\" (UID: \"c9f5cad4-bd45-453d-912b-d73122b0562e\") " pod="openshift-cluster-node-tuning-operator/tuned-7bd8f"
Jul 13 15:24:09.029723 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:09.029515    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mlhhm\" (UniqueName: \"kubernetes.io/projected/c9f5cad4-bd45-453d-912b-d73122b0562e-kube-api-access-mlhhm\") pod \"tuned-7bd8f\" (UID: \"c9f5cad4-bd45-453d-912b-d73122b0562e\") " pod="openshift-cluster-node-tuning-operator/tuned-7bd8f"
Jul 13 15:24:09.029723 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:09.029538    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dlzpx\" (UniqueName: \"kubernetes.io/projected/7897ab94-b445-4dd1-9475-4a316db407a2-kube-api-access-dlzpx\") pod \"node-ca-zq68g\" (UID: \"7897ab94-b445-4dd1-9475-4a316db407a2\") " pod="openshift-image-registry/node-ca-zq68g"
Jul 13 15:24:09.029723 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:09.029556    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/0f6cac01-3a2e-4b4d-bd6b-b07daa4fc725-etc-selinux\") pod \"aws-ebs-csi-driver-node-7v5qg\" (UID: \"0f6cac01-3a2e-4b4d-bd6b-b07daa4fc725\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7v5qg"
Jul 13 15:24:09.029723 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:09.029566    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x4ls8\" (UniqueName: \"kubernetes.io/projected/9c040000-a5ce-49b2-b7a8-6faedac4708f-kube-api-access-x4ls8\") pod \"network-metrics-daemon-8whd7\" (UID: \"9c040000-a5ce-49b2-b7a8-6faedac4708f\") " pod="openshift-multus/network-metrics-daemon-8whd7"
Jul 13 15:24:09.029723 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:09.029616    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/c9f5cad4-bd45-453d-912b-d73122b0562e-etc-systemd\") pod \"tuned-7bd8f\" (UID: \"c9f5cad4-bd45-453d-912b-d73122b0562e\") " pod="openshift-cluster-node-tuning-operator/tuned-7bd8f"
Jul 13 15:24:09.030275 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:09.029857    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/c9f5cad4-bd45-453d-912b-d73122b0562e-etc-sysctl-d\") pod \"tuned-7bd8f\" (UID: \"c9f5cad4-bd45-453d-912b-d73122b0562e\") " pod="openshift-cluster-node-tuning-operator/tuned-7bd8f"
Jul 13 15:24:09.030275 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:09.029904    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/c9f5cad4-bd45-453d-912b-d73122b0562e-run\") pod \"tuned-7bd8f\" (UID: \"c9f5cad4-bd45-453d-912b-d73122b0562e\") " pod="openshift-cluster-node-tuning-operator/tuned-7bd8f"
Jul 13 15:24:09.030275 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:09.029930    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/0f6cac01-3a2e-4b4d-bd6b-b07daa4fc725-kubelet-dir\") pod \"aws-ebs-csi-driver-node-7v5qg\" (UID: \"0f6cac01-3a2e-4b4d-bd6b-b07daa4fc725\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7v5qg"
Jul 13 15:24:09.030275 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:09.029960    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-blssv\" (UniqueName: \"kubernetes.io/projected/a5193ce3-be31-44a5-a677-c50746b73b3f-kube-api-access-blssv\") pod \"iptables-alerter-nbxfp\" (UID: \"a5193ce3-be31-44a5-a677-c50746b73b3f\") " pod="openshift-network-operator/iptables-alerter-nbxfp"
Jul 13 15:24:09.030275 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:09.029978    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/c9f5cad4-bd45-453d-912b-d73122b0562e-run\") pod \"tuned-7bd8f\" (UID: \"c9f5cad4-bd45-453d-912b-d73122b0562e\") " pod="openshift-cluster-node-tuning-operator/tuned-7bd8f"
Jul 13 15:24:09.030275 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:09.030002    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/c9f5cad4-bd45-453d-912b-d73122b0562e-etc-sysctl-d\") pod \"tuned-7bd8f\" (UID: \"c9f5cad4-bd45-453d-912b-d73122b0562e\") " pod="openshift-cluster-node-tuning-operator/tuned-7bd8f"
Jul 13 15:24:09.030275 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:09.030062    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/0f6cac01-3a2e-4b4d-bd6b-b07daa4fc725-kubelet-dir\") pod \"aws-ebs-csi-driver-node-7v5qg\" (UID: \"0f6cac01-3a2e-4b4d-bd6b-b07daa4fc725\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7v5qg"
Jul 13 15:24:09.030275 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:09.030072    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/c9f5cad4-bd45-453d-912b-d73122b0562e-host\") pod \"tuned-7bd8f\" (UID: \"c9f5cad4-bd45-453d-912b-d73122b0562e\") " pod="openshift-cluster-node-tuning-operator/tuned-7bd8f"
Jul 13 15:24:09.030275 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:09.029985    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/c9f5cad4-bd45-453d-912b-d73122b0562e-host\") pod \"tuned-7bd8f\" (UID: \"c9f5cad4-bd45-453d-912b-d73122b0562e\") " pod="openshift-cluster-node-tuning-operator/tuned-7bd8f"
Jul 13 15:24:09.030275 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:09.030106    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/7897ab94-b445-4dd1-9475-4a316db407a2-host\") pod \"node-ca-zq68g\" (UID: \"7897ab94-b445-4dd1-9475-4a316db407a2\") " pod="openshift-image-registry/node-ca-zq68g"
Jul 13 15:24:09.030275 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:09.030130    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/0f6cac01-3a2e-4b4d-bd6b-b07daa4fc725-device-dir\") pod \"aws-ebs-csi-driver-node-7v5qg\" (UID: \"0f6cac01-3a2e-4b4d-bd6b-b07daa4fc725\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7v5qg"
Jul 13 15:24:09.030275 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:09.030168    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c9f5cad4-bd45-453d-912b-d73122b0562e-tmp\") pod \"tuned-7bd8f\" (UID: \"c9f5cad4-bd45-453d-912b-d73122b0562e\") " pod="openshift-cluster-node-tuning-operator/tuned-7bd8f"
Jul 13 15:24:09.030275 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:09.030191    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a5193ce3-be31-44a5-a677-c50746b73b3f-host-slash\") pod \"iptables-alerter-nbxfp\" (UID: \"a5193ce3-be31-44a5-a677-c50746b73b3f\") " pod="openshift-network-operator/iptables-alerter-nbxfp"
Jul 13 15:24:09.030275 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:09.030230    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/c9f5cad4-bd45-453d-912b-d73122b0562e-etc-modprobe-d\") pod \"tuned-7bd8f\" (UID: \"c9f5cad4-bd45-453d-912b-d73122b0562e\") " pod="openshift-cluster-node-tuning-operator/tuned-7bd8f"
Jul 13 15:24:09.030275 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:09.030252    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/0f6cac01-3a2e-4b4d-bd6b-b07daa4fc725-registration-dir\") pod \"aws-ebs-csi-driver-node-7v5qg\" (UID: \"0f6cac01-3a2e-4b4d-bd6b-b07daa4fc725\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7v5qg"
Jul 13 15:24:09.030275 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:09.030276    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/0f6cac01-3a2e-4b4d-bd6b-b07daa4fc725-sys-fs\") pod \"aws-ebs-csi-driver-node-7v5qg\" (UID: \"0f6cac01-3a2e-4b4d-bd6b-b07daa4fc725\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7v5qg"
Jul 13 15:24:09.031137 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:09.030313    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/c9f5cad4-bd45-453d-912b-d73122b0562e-lib-modules\") pod \"tuned-7bd8f\" (UID: \"c9f5cad4-bd45-453d-912b-d73122b0562e\") " pod="openshift-cluster-node-tuning-operator/tuned-7bd8f"
Jul 13 15:24:09.031137 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:09.030337    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9c040000-a5ce-49b2-b7a8-6faedac4708f-metrics-certs\") pod \"network-metrics-daemon-8whd7\" (UID: \"9c040000-a5ce-49b2-b7a8-6faedac4708f\") " pod="openshift-multus/network-metrics-daemon-8whd7"
Jul 13 15:24:09.031137 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:09.030361    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zrntz\" (UniqueName: \"kubernetes.io/projected/0f6cac01-3a2e-4b4d-bd6b-b07daa4fc725-kube-api-access-zrntz\") pod \"aws-ebs-csi-driver-node-7v5qg\" (UID: \"0f6cac01-3a2e-4b4d-bd6b-b07daa4fc725\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7v5qg"
Jul 13 15:24:09.031137 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:09.030396    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/a5193ce3-be31-44a5-a677-c50746b73b3f-iptables-alerter-script\") pod \"iptables-alerter-nbxfp\" (UID: \"a5193ce3-be31-44a5-a677-c50746b73b3f\") " pod="openshift-network-operator/iptables-alerter-nbxfp"
Jul 13 15:24:09.031137 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:09.030422    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/c9f5cad4-bd45-453d-912b-d73122b0562e-etc-sysctl-conf\") pod \"tuned-7bd8f\" (UID: \"c9f5cad4-bd45-453d-912b-d73122b0562e\") " pod="openshift-cluster-node-tuning-operator/tuned-7bd8f"
Jul 13 15:24:09.031137 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:09.030447    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/7897ab94-b445-4dd1-9475-4a316db407a2-serviceca\") pod \"node-ca-zq68g\" (UID: \"7897ab94-b445-4dd1-9475-4a316db407a2\") " pod="openshift-image-registry/node-ca-zq68g"
Jul 13 15:24:09.031137 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:09.030472    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/0f6cac01-3a2e-4b4d-bd6b-b07daa4fc725-socket-dir\") pod \"aws-ebs-csi-driver-node-7v5qg\" (UID: \"0f6cac01-3a2e-4b4d-bd6b-b07daa4fc725\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7v5qg"
Jul 13 15:24:09.031137 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:09.030626    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/0f6cac01-3a2e-4b4d-bd6b-b07daa4fc725-socket-dir\") pod \"aws-ebs-csi-driver-node-7v5qg\" (UID: \"0f6cac01-3a2e-4b4d-bd6b-b07daa4fc725\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7v5qg"
Jul 13 15:24:09.031137 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:09.030656    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/c9f5cad4-bd45-453d-912b-d73122b0562e-lib-modules\") pod \"tuned-7bd8f\" (UID: \"c9f5cad4-bd45-453d-912b-d73122b0562e\") " pod="openshift-cluster-node-tuning-operator/tuned-7bd8f"
Jul 13 15:24:09.031137 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:09.030704    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a5193ce3-be31-44a5-a677-c50746b73b3f-host-slash\") pod \"iptables-alerter-nbxfp\" (UID: \"a5193ce3-be31-44a5-a677-c50746b73b3f\") " pod="openshift-network-operator/iptables-alerter-nbxfp"
Jul 13 15:24:09.031137 ip-10-0-140-255 kubenswrapper[2564]: E0713 15:24:09.030708    2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 13 15:24:09.031137 ip-10-0-140-255 kubenswrapper[2564]: E0713 15:24:09.030763    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9c040000-a5ce-49b2-b7a8-6faedac4708f-metrics-certs podName:9c040000-a5ce-49b2-b7a8-6faedac4708f nodeName:}" failed. No retries permitted until 2026-07-13 15:24:09.53074452 +0000 UTC m=+3.109979681 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9c040000-a5ce-49b2-b7a8-6faedac4708f-metrics-certs") pod "network-metrics-daemon-8whd7" (UID: "9c040000-a5ce-49b2-b7a8-6faedac4708f") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 13 15:24:09.031137 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:09.030837    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/c9f5cad4-bd45-453d-912b-d73122b0562e-etc-modprobe-d\") pod \"tuned-7bd8f\" (UID: \"c9f5cad4-bd45-453d-912b-d73122b0562e\") " pod="openshift-cluster-node-tuning-operator/tuned-7bd8f"
Jul 13 15:24:09.031137 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:09.030903    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/0f6cac01-3a2e-4b4d-bd6b-b07daa4fc725-registration-dir\") pod \"aws-ebs-csi-driver-node-7v5qg\" (UID: \"0f6cac01-3a2e-4b4d-bd6b-b07daa4fc725\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7v5qg"
Jul 13 15:24:09.031792 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:09.031344    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/c9f5cad4-bd45-453d-912b-d73122b0562e-etc-sysctl-conf\") pod \"tuned-7bd8f\" (UID: \"c9f5cad4-bd45-453d-912b-d73122b0562e\") " pod="openshift-cluster-node-tuning-operator/tuned-7bd8f"
Jul 13 15:24:09.031792 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:09.031397    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/7897ab94-b445-4dd1-9475-4a316db407a2-host\") pod \"node-ca-zq68g\" (UID: \"7897ab94-b445-4dd1-9475-4a316db407a2\") " pod="openshift-image-registry/node-ca-zq68g"
Jul 13 15:24:09.031792 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:09.031430    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/a5193ce3-be31-44a5-a677-c50746b73b3f-iptables-alerter-script\") pod \"iptables-alerter-nbxfp\" (UID: \"a5193ce3-be31-44a5-a677-c50746b73b3f\") " pod="openshift-network-operator/iptables-alerter-nbxfp"
Jul 13 15:24:09.031792 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:09.031439    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/0f6cac01-3a2e-4b4d-bd6b-b07daa4fc725-device-dir\") pod \"aws-ebs-csi-driver-node-7v5qg\" (UID: \"0f6cac01-3a2e-4b4d-bd6b-b07daa4fc725\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7v5qg"
Jul 13 15:24:09.031792 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:09.031447    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/7897ab94-b445-4dd1-9475-4a316db407a2-serviceca\") pod \"node-ca-zq68g\" (UID: \"7897ab94-b445-4dd1-9475-4a316db407a2\") " pod="openshift-image-registry/node-ca-zq68g"
Jul 13 15:24:09.031792 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:09.031507    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/0f6cac01-3a2e-4b4d-bd6b-b07daa4fc725-sys-fs\") pod \"aws-ebs-csi-driver-node-7v5qg\" (UID: \"0f6cac01-3a2e-4b4d-bd6b-b07daa4fc725\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7v5qg"
Jul 13 15:24:09.032078 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:09.032005    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/c9f5cad4-bd45-453d-912b-d73122b0562e-etc-tuned\") pod \"tuned-7bd8f\" (UID: \"c9f5cad4-bd45-453d-912b-d73122b0562e\") " pod="openshift-cluster-node-tuning-operator/tuned-7bd8f"
Jul 13 15:24:09.033623 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:09.033600    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c9f5cad4-bd45-453d-912b-d73122b0562e-tmp\") pod \"tuned-7bd8f\" (UID: \"c9f5cad4-bd45-453d-912b-d73122b0562e\") " pod="openshift-cluster-node-tuning-operator/tuned-7bd8f"
Jul 13 15:24:09.050642 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:09.050574    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dlzpx\" (UniqueName: \"kubernetes.io/projected/7897ab94-b445-4dd1-9475-4a316db407a2-kube-api-access-dlzpx\") pod \"node-ca-zq68g\" (UID: \"7897ab94-b445-4dd1-9475-4a316db407a2\") " pod="openshift-image-registry/node-ca-zq68g"
Jul 13 15:24:09.051325 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:09.051269    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x4ls8\" (UniqueName: \"kubernetes.io/projected/9c040000-a5ce-49b2-b7a8-6faedac4708f-kube-api-access-x4ls8\") pod \"network-metrics-daemon-8whd7\" (UID: \"9c040000-a5ce-49b2-b7a8-6faedac4708f\") " pod="openshift-multus/network-metrics-daemon-8whd7"
Jul 13 15:24:09.057687 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:09.057652    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zrntz\" (UniqueName: \"kubernetes.io/projected/0f6cac01-3a2e-4b4d-bd6b-b07daa4fc725-kube-api-access-zrntz\") pod \"aws-ebs-csi-driver-node-7v5qg\" (UID: \"0f6cac01-3a2e-4b4d-bd6b-b07daa4fc725\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7v5qg"
Jul 13 15:24:09.058021 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:09.057978    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-blssv\" (UniqueName: \"kubernetes.io/projected/a5193ce3-be31-44a5-a677-c50746b73b3f-kube-api-access-blssv\") pod \"iptables-alerter-nbxfp\" (UID: \"a5193ce3-be31-44a5-a677-c50746b73b3f\") " pod="openshift-network-operator/iptables-alerter-nbxfp"
Jul 13 15:24:09.058525 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:09.058480    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mlhhm\" (UniqueName: \"kubernetes.io/projected/c9f5cad4-bd45-453d-912b-d73122b0562e-kube-api-access-mlhhm\") pod \"tuned-7bd8f\" (UID: \"c9f5cad4-bd45-453d-912b-d73122b0562e\") " pod="openshift-cluster-node-tuning-operator/tuned-7bd8f"
Jul 13 15:24:09.121626 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:09.121568    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-255.ec2.internal" event={"ID":"92665f5a3cb50772f6b086b04422f9c8","Type":"ContainerStarted","Data":"40379c54a0492b5aee65eac7771a55b8cac55d2effe854d99dcc625bda890159"}
Jul 13 15:24:09.121799 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:09.121737    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-v8r47"
Jul 13 15:24:09.124398 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:09.124099    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-255.ec2.internal" event={"ID":"cee06081bb6408d4c7824c898f1b18f4","Type":"ContainerStarted","Data":"6e0d7712bbdce161d82a96f02511b3c789ed31748785469676c4ebacb584a4ad"}
Jul 13 15:24:09.131543 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:24:09.131481    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7687fe5c_b22f_40ba_af3e_b74095ec910c.slice/crio-5afbede2597a494ce5ea3d7beb95667848f250fc4f1c0d3bbeadb659edd591d9 WatchSource:0}: Error finding container 5afbede2597a494ce5ea3d7beb95667848f250fc4f1c0d3bbeadb659edd591d9: Status 404 returned error can't find the container with id 5afbede2597a494ce5ea3d7beb95667848f250fc4f1c0d3bbeadb659edd591d9
Jul 13 15:24:09.133154 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:09.132986    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-9dq6z"
Jul 13 15:24:09.142576 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:24:09.142552    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod258b7ae3_adf5_437a_8f8e_71bdd1cc665b.slice/crio-7f2102c714d568a0ff2a607df5c8c6e15554ac99848e3da30ac6e090e37aaeed WatchSource:0}: Error finding container 7f2102c714d568a0ff2a607df5c8c6e15554ac99848e3da30ac6e090e37aaeed: Status 404 returned error can't find the container with id 7f2102c714d568a0ff2a607df5c8c6e15554ac99848e3da30ac6e090e37aaeed
Jul 13 15:24:09.144420 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:09.144399    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-t8ljw"
Jul 13 15:24:09.150479 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:09.150457    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-q24vk"
Jul 13 15:24:09.153654 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:24:09.153625    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda0cd4788_5dd7_402b_9364_7588dcd91951.slice/crio-63ac16f17c928c5ab9edbd85909a1ccdbad78c78a88309aaf01b3b0f1f4b7d63 WatchSource:0}: Error finding container 63ac16f17c928c5ab9edbd85909a1ccdbad78c78a88309aaf01b3b0f1f4b7d63: Status 404 returned error can't find the container with id 63ac16f17c928c5ab9edbd85909a1ccdbad78c78a88309aaf01b3b0f1f4b7d63
Jul 13 15:24:09.158512 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:09.158492    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-vmz75"
Jul 13 15:24:09.158806 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:24:09.158747    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podca6016f5_c1af_4395_bdf0_e642bf637019.slice/crio-16d8488ca2e3646f96c0dfb54c6e4a447c292bd34bd939273aaed8cf90ae61e3 WatchSource:0}: Error finding container 16d8488ca2e3646f96c0dfb54c6e4a447c292bd34bd939273aaed8cf90ae61e3: Status 404 returned error can't find the container with id 16d8488ca2e3646f96c0dfb54c6e4a447c292bd34bd939273aaed8cf90ae61e3
Jul 13 15:24:09.166766 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:09.166743    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-7bd8f"
Jul 13 15:24:09.175088 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:09.175070    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-zq68g"
Jul 13 15:24:09.183193 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:09.183093    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7v5qg"
Jul 13 15:24:09.191031 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:09.191004    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-nbxfp"
Jul 13 15:24:09.432899 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:09.432780    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/84c5054b-6b5c-4b21-992a-cbd68bf1b4f2-original-pull-secret\") pod \"global-pull-secret-syncer-75h9t\" (UID: \"84c5054b-6b5c-4b21-992a-cbd68bf1b4f2\") " pod="kube-system/global-pull-secret-syncer-75h9t"
Jul 13 15:24:09.433071 ip-10-0-140-255 kubenswrapper[2564]: E0713 15:24:09.432927    2564 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 13 15:24:09.433071 ip-10-0-140-255 kubenswrapper[2564]: E0713 15:24:09.432998    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/84c5054b-6b5c-4b21-992a-cbd68bf1b4f2-original-pull-secret podName:84c5054b-6b5c-4b21-992a-cbd68bf1b4f2 nodeName:}" failed. No retries permitted until 2026-07-13 15:24:10.432980265 +0000 UTC m=+4.012215424 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/84c5054b-6b5c-4b21-992a-cbd68bf1b4f2-original-pull-secret") pod "global-pull-secret-syncer-75h9t" (UID: "84c5054b-6b5c-4b21-992a-cbd68bf1b4f2") : object "kube-system"/"original-pull-secret" not registered
Jul 13 15:24:09.533562 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:09.533533    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d9flx\" (UniqueName: \"kubernetes.io/projected/38555aab-29b1-4bdf-b689-069e8fe6712c-kube-api-access-d9flx\") pod \"network-check-target-7qzb8\" (UID: \"38555aab-29b1-4bdf-b689-069e8fe6712c\") " pod="openshift-network-diagnostics/network-check-target-7qzb8"
Jul 13 15:24:09.533719 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:09.533566    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9c040000-a5ce-49b2-b7a8-6faedac4708f-metrics-certs\") pod \"network-metrics-daemon-8whd7\" (UID: \"9c040000-a5ce-49b2-b7a8-6faedac4708f\") " pod="openshift-multus/network-metrics-daemon-8whd7"
Jul 13 15:24:09.533719 ip-10-0-140-255 kubenswrapper[2564]: E0713 15:24:09.533696    2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 13 15:24:09.533719 ip-10-0-140-255 kubenswrapper[2564]: E0713 15:24:09.533713    2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 13 15:24:09.533906 ip-10-0-140-255 kubenswrapper[2564]: E0713 15:24:09.533735    2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 13 15:24:09.533906 ip-10-0-140-255 kubenswrapper[2564]: E0713 15:24:09.533748    2564 projected.go:196] Error preparing data for projected volume kube-api-access-d9flx for pod openshift-network-diagnostics/network-check-target-7qzb8: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 13 15:24:09.533906 ip-10-0-140-255 kubenswrapper[2564]: E0713 15:24:09.533752    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9c040000-a5ce-49b2-b7a8-6faedac4708f-metrics-certs podName:9c040000-a5ce-49b2-b7a8-6faedac4708f nodeName:}" failed. No retries permitted until 2026-07-13 15:24:10.533735312 +0000 UTC m=+4.112970468 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9c040000-a5ce-49b2-b7a8-6faedac4708f-metrics-certs") pod "network-metrics-daemon-8whd7" (UID: "9c040000-a5ce-49b2-b7a8-6faedac4708f") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 13 15:24:09.533906 ip-10-0-140-255 kubenswrapper[2564]: E0713 15:24:09.533791    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/38555aab-29b1-4bdf-b689-069e8fe6712c-kube-api-access-d9flx podName:38555aab-29b1-4bdf-b689-069e8fe6712c nodeName:}" failed. No retries permitted until 2026-07-13 15:24:10.53377567 +0000 UTC m=+4.113010825 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-d9flx" (UniqueName: "kubernetes.io/projected/38555aab-29b1-4bdf-b689-069e8fe6712c-kube-api-access-d9flx") pod "network-check-target-7qzb8" (UID: "38555aab-29b1-4bdf-b689-069e8fe6712c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 13 15:24:09.870005 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:09.869763    2564 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-12 15:19:08 +0000 UTC" deadline="2028-01-12 14:40:58.383883327 +0000 UTC"
Jul 13 15:24:09.870362 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:09.870026    2564 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13151h16m48.513880845s"
Jul 13 15:24:10.116198 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:10.115358    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8whd7"
Jul 13 15:24:10.116198 ip-10-0-140-255 kubenswrapper[2564]: E0713 15:24:10.115514    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8whd7" podUID="9c040000-a5ce-49b2-b7a8-6faedac4708f"
Jul 13 15:24:10.116198 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:10.115971    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7qzb8"
Jul 13 15:24:10.116198 ip-10-0-140-255 kubenswrapper[2564]: E0713 15:24:10.116098    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7qzb8" podUID="38555aab-29b1-4bdf-b689-069e8fe6712c"
Jul 13 15:24:10.127352 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:10.127316    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-q24vk" event={"ID":"ca6016f5-c1af-4395-bdf0-e642bf637019","Type":"ContainerStarted","Data":"16d8488ca2e3646f96c0dfb54c6e4a447c292bd34bd939273aaed8cf90ae61e3"}
Jul 13 15:24:10.128995 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:10.128957    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-t8ljw" event={"ID":"a0cd4788-5dd7-402b-9364-7588dcd91951","Type":"ContainerStarted","Data":"63ac16f17c928c5ab9edbd85909a1ccdbad78c78a88309aaf01b3b0f1f4b7d63"}
Jul 13 15:24:10.130990 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:10.130811    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9dq6z" event={"ID":"258b7ae3-adf5-437a-8f8e-71bdd1cc665b","Type":"ContainerStarted","Data":"7f2102c714d568a0ff2a607df5c8c6e15554ac99848e3da30ac6e090e37aaeed"}
Jul 13 15:24:10.133632 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:10.133576    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-v8r47" event={"ID":"7687fe5c-b22f-40ba-af3e-b74095ec910c","Type":"ContainerStarted","Data":"5afbede2597a494ce5ea3d7beb95667848f250fc4f1c0d3bbeadb659edd591d9"}
Jul 13 15:24:10.268236 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:24:10.268206    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod697aa34e_8473_49a1_a7dd_8be4f23ea1b3.slice/crio-01d5817dbc56da94818293d2a49864b070969f99e2e3a26583641e719effa1e4 WatchSource:0}: Error finding container 01d5817dbc56da94818293d2a49864b070969f99e2e3a26583641e719effa1e4: Status 404 returned error can't find the container with id 01d5817dbc56da94818293d2a49864b070969f99e2e3a26583641e719effa1e4
Jul 13 15:24:10.273162 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:24:10.273136    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7897ab94_b445_4dd1_9475_4a316db407a2.slice/crio-9426908c6cdcd9f4dbd09ec57b6898f571d91d90d276e557eb6ccc61966421e6 WatchSource:0}: Error finding container 9426908c6cdcd9f4dbd09ec57b6898f571d91d90d276e557eb6ccc61966421e6: Status 404 returned error can't find the container with id 9426908c6cdcd9f4dbd09ec57b6898f571d91d90d276e557eb6ccc61966421e6
Jul 13 15:24:10.274527 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:24:10.274502    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0f6cac01_3a2e_4b4d_bd6b_b07daa4fc725.slice/crio-be3e84cf7657ddec22d87d3c00396bd6b2ab68e3a240df88b1c306ba05d75a58 WatchSource:0}: Error finding container be3e84cf7657ddec22d87d3c00396bd6b2ab68e3a240df88b1c306ba05d75a58: Status 404 returned error can't find the container with id be3e84cf7657ddec22d87d3c00396bd6b2ab68e3a240df88b1c306ba05d75a58
Jul 13 15:24:10.275766 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:24:10.275741    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc9f5cad4_bd45_453d_912b_d73122b0562e.slice/crio-94926cfad091cb435ee7a6d2fb53cb7fe899d561cb47874f300aa07f8da4279d WatchSource:0}: Error finding container 94926cfad091cb435ee7a6d2fb53cb7fe899d561cb47874f300aa07f8da4279d: Status 404 returned error can't find the container with id 94926cfad091cb435ee7a6d2fb53cb7fe899d561cb47874f300aa07f8da4279d
Jul 13 15:24:10.278277 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:24:10.278031    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda5193ce3_be31_44a5_a677_c50746b73b3f.slice/crio-63119ea6bcada9f069462128d1baa483bac031208fd5d9ad7a4dbcfe4024bee5 WatchSource:0}: Error finding container 63119ea6bcada9f069462128d1baa483bac031208fd5d9ad7a4dbcfe4024bee5: Status 404 returned error can't find the container with id 63119ea6bcada9f069462128d1baa483bac031208fd5d9ad7a4dbcfe4024bee5
Jul 13 15:24:10.441520 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:10.441489    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/84c5054b-6b5c-4b21-992a-cbd68bf1b4f2-original-pull-secret\") pod \"global-pull-secret-syncer-75h9t\" (UID: \"84c5054b-6b5c-4b21-992a-cbd68bf1b4f2\") " pod="kube-system/global-pull-secret-syncer-75h9t"
Jul 13 15:24:10.441692 ip-10-0-140-255 kubenswrapper[2564]: E0713 15:24:10.441660    2564 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 13 15:24:10.441766 ip-10-0-140-255 kubenswrapper[2564]: E0713 15:24:10.441740    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/84c5054b-6b5c-4b21-992a-cbd68bf1b4f2-original-pull-secret podName:84c5054b-6b5c-4b21-992a-cbd68bf1b4f2 nodeName:}" failed. No retries permitted until 2026-07-13 15:24:12.441720487 +0000 UTC m=+6.020955646 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/84c5054b-6b5c-4b21-992a-cbd68bf1b4f2-original-pull-secret") pod "global-pull-secret-syncer-75h9t" (UID: "84c5054b-6b5c-4b21-992a-cbd68bf1b4f2") : object "kube-system"/"original-pull-secret" not registered
Jul 13 15:24:10.542819 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:10.542774    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d9flx\" (UniqueName: \"kubernetes.io/projected/38555aab-29b1-4bdf-b689-069e8fe6712c-kube-api-access-d9flx\") pod \"network-check-target-7qzb8\" (UID: \"38555aab-29b1-4bdf-b689-069e8fe6712c\") " pod="openshift-network-diagnostics/network-check-target-7qzb8"
Jul 13 15:24:10.542996 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:10.542825    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9c040000-a5ce-49b2-b7a8-6faedac4708f-metrics-certs\") pod \"network-metrics-daemon-8whd7\" (UID: \"9c040000-a5ce-49b2-b7a8-6faedac4708f\") " pod="openshift-multus/network-metrics-daemon-8whd7"
Jul 13 15:24:10.542996 ip-10-0-140-255 kubenswrapper[2564]: E0713 15:24:10.542977    2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 13 15:24:10.543110 ip-10-0-140-255 kubenswrapper[2564]: E0713 15:24:10.543044    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9c040000-a5ce-49b2-b7a8-6faedac4708f-metrics-certs podName:9c040000-a5ce-49b2-b7a8-6faedac4708f nodeName:}" failed. No retries permitted until 2026-07-13 15:24:12.543023485 +0000 UTC m=+6.122258648 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9c040000-a5ce-49b2-b7a8-6faedac4708f-metrics-certs") pod "network-metrics-daemon-8whd7" (UID: "9c040000-a5ce-49b2-b7a8-6faedac4708f") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 13 15:24:10.543473 ip-10-0-140-255 kubenswrapper[2564]: E0713 15:24:10.543453    2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 13 15:24:10.543547 ip-10-0-140-255 kubenswrapper[2564]: E0713 15:24:10.543483    2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 13 15:24:10.543547 ip-10-0-140-255 kubenswrapper[2564]: E0713 15:24:10.543497    2564 projected.go:196] Error preparing data for projected volume kube-api-access-d9flx for pod openshift-network-diagnostics/network-check-target-7qzb8: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 13 15:24:10.543547 ip-10-0-140-255 kubenswrapper[2564]: E0713 15:24:10.543545    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/38555aab-29b1-4bdf-b689-069e8fe6712c-kube-api-access-d9flx podName:38555aab-29b1-4bdf-b689-069e8fe6712c nodeName:}" failed. No retries permitted until 2026-07-13 15:24:12.543529662 +0000 UTC m=+6.122764821 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-d9flx" (UniqueName: "kubernetes.io/projected/38555aab-29b1-4bdf-b689-069e8fe6712c-kube-api-access-d9flx") pod "network-check-target-7qzb8" (UID: "38555aab-29b1-4bdf-b689-069e8fe6712c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 13 15:24:10.870690 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:10.870624    2564 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-12 15:19:08 +0000 UTC" deadline="2028-02-08 08:34:04.407590205 +0000 UTC"
Jul 13 15:24:10.870690 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:10.870688    2564 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13793h9m53.536906586s"
Jul 13 15:24:11.117780 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:11.117704    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-75h9t"
Jul 13 15:24:11.118012 ip-10-0-140-255 kubenswrapper[2564]: E0713 15:24:11.117827    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-75h9t" podUID="84c5054b-6b5c-4b21-992a-cbd68bf1b4f2"
Jul 13 15:24:11.141550 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:11.141509    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-255.ec2.internal" event={"ID":"92665f5a3cb50772f6b086b04422f9c8","Type":"ContainerStarted","Data":"97e3302d06043b6b45eb7cca0bd258cf91d0e9adfcc517676916eccd87ae6892"}
Jul 13 15:24:11.147239 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:11.147159    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-zq68g" event={"ID":"7897ab94-b445-4dd1-9475-4a316db407a2","Type":"ContainerStarted","Data":"9426908c6cdcd9f4dbd09ec57b6898f571d91d90d276e557eb6ccc61966421e6"}
Jul 13 15:24:11.153476 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:11.153441    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-vmz75" event={"ID":"697aa34e-8473-49a1-a7dd-8be4f23ea1b3","Type":"ContainerStarted","Data":"01d5817dbc56da94818293d2a49864b070969f99e2e3a26583641e719effa1e4"}
Jul 13 15:24:11.158411 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:11.157815    2564 generic.go:356] "Generic (PLEG): container finished" podID="cee06081bb6408d4c7824c898f1b18f4" containerID="93692f5bee6d6118a14764b0a7f556572708e27e5fb84ede5685457e882e01db" exitCode=0
Jul 13 15:24:11.158411 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:11.157928    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-255.ec2.internal" event={"ID":"cee06081bb6408d4c7824c898f1b18f4","Type":"ContainerDied","Data":"93692f5bee6d6118a14764b0a7f556572708e27e5fb84ede5685457e882e01db"}
Jul 13 15:24:11.164803 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:11.164729    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-nbxfp" event={"ID":"a5193ce3-be31-44a5-a677-c50746b73b3f","Type":"ContainerStarted","Data":"63119ea6bcada9f069462128d1baa483bac031208fd5d9ad7a4dbcfe4024bee5"}
Jul 13 15:24:11.172607 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:11.172577    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-7bd8f" event={"ID":"c9f5cad4-bd45-453d-912b-d73122b0562e","Type":"ContainerStarted","Data":"94926cfad091cb435ee7a6d2fb53cb7fe899d561cb47874f300aa07f8da4279d"}
Jul 13 15:24:11.175312 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:11.175284    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7v5qg" event={"ID":"0f6cac01-3a2e-4b4d-bd6b-b07daa4fc725","Type":"ContainerStarted","Data":"be3e84cf7657ddec22d87d3c00396bd6b2ab68e3a240df88b1c306ba05d75a58"}
Jul 13 15:24:11.183083 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:11.183015    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-255.ec2.internal" podStartSLOduration=3.182996032 podStartE2EDuration="3.182996032s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-13 15:24:08 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 15:24:11.163483231 +0000 UTC m=+4.742718428" watchObservedRunningTime="2026-07-13 15:24:11.182996032 +0000 UTC m=+4.762231213"
Jul 13 15:24:12.115092 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:12.115049    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7qzb8"
Jul 13 15:24:12.115474 ip-10-0-140-255 kubenswrapper[2564]: E0713 15:24:12.115189    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7qzb8" podUID="38555aab-29b1-4bdf-b689-069e8fe6712c"
Jul 13 15:24:12.115602 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:12.115581    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8whd7"
Jul 13 15:24:12.115716 ip-10-0-140-255 kubenswrapper[2564]: E0713 15:24:12.115696    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8whd7" podUID="9c040000-a5ce-49b2-b7a8-6faedac4708f"
Jul 13 15:24:12.456746 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:12.456614    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/84c5054b-6b5c-4b21-992a-cbd68bf1b4f2-original-pull-secret\") pod \"global-pull-secret-syncer-75h9t\" (UID: \"84c5054b-6b5c-4b21-992a-cbd68bf1b4f2\") " pod="kube-system/global-pull-secret-syncer-75h9t"
Jul 13 15:24:12.456944 ip-10-0-140-255 kubenswrapper[2564]: E0713 15:24:12.456784    2564 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 13 15:24:12.456944 ip-10-0-140-255 kubenswrapper[2564]: E0713 15:24:12.456860    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/84c5054b-6b5c-4b21-992a-cbd68bf1b4f2-original-pull-secret podName:84c5054b-6b5c-4b21-992a-cbd68bf1b4f2 nodeName:}" failed. No retries permitted until 2026-07-13 15:24:16.456840571 +0000 UTC m=+10.036075734 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/84c5054b-6b5c-4b21-992a-cbd68bf1b4f2-original-pull-secret") pod "global-pull-secret-syncer-75h9t" (UID: "84c5054b-6b5c-4b21-992a-cbd68bf1b4f2") : object "kube-system"/"original-pull-secret" not registered
Jul 13 15:24:12.557565 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:12.557523    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d9flx\" (UniqueName: \"kubernetes.io/projected/38555aab-29b1-4bdf-b689-069e8fe6712c-kube-api-access-d9flx\") pod \"network-check-target-7qzb8\" (UID: \"38555aab-29b1-4bdf-b689-069e8fe6712c\") " pod="openshift-network-diagnostics/network-check-target-7qzb8"
Jul 13 15:24:12.557734 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:12.557576    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9c040000-a5ce-49b2-b7a8-6faedac4708f-metrics-certs\") pod \"network-metrics-daemon-8whd7\" (UID: \"9c040000-a5ce-49b2-b7a8-6faedac4708f\") " pod="openshift-multus/network-metrics-daemon-8whd7"
Jul 13 15:24:12.557734 ip-10-0-140-255 kubenswrapper[2564]: E0713 15:24:12.557714    2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 13 15:24:12.557851 ip-10-0-140-255 kubenswrapper[2564]: E0713 15:24:12.557785    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9c040000-a5ce-49b2-b7a8-6faedac4708f-metrics-certs podName:9c040000-a5ce-49b2-b7a8-6faedac4708f nodeName:}" failed. No retries permitted until 2026-07-13 15:24:16.557756154 +0000 UTC m=+10.136991317 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9c040000-a5ce-49b2-b7a8-6faedac4708f-metrics-certs") pod "network-metrics-daemon-8whd7" (UID: "9c040000-a5ce-49b2-b7a8-6faedac4708f") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 13 15:24:12.558219 ip-10-0-140-255 kubenswrapper[2564]: E0713 15:24:12.558202    2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 13 15:24:12.558301 ip-10-0-140-255 kubenswrapper[2564]: E0713 15:24:12.558226    2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 13 15:24:12.558301 ip-10-0-140-255 kubenswrapper[2564]: E0713 15:24:12.558239    2564 projected.go:196] Error preparing data for projected volume kube-api-access-d9flx for pod openshift-network-diagnostics/network-check-target-7qzb8: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 13 15:24:12.558301 ip-10-0-140-255 kubenswrapper[2564]: E0713 15:24:12.558284    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/38555aab-29b1-4bdf-b689-069e8fe6712c-kube-api-access-d9flx podName:38555aab-29b1-4bdf-b689-069e8fe6712c nodeName:}" failed. No retries permitted until 2026-07-13 15:24:16.558268078 +0000 UTC m=+10.137503237 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-d9flx" (UniqueName: "kubernetes.io/projected/38555aab-29b1-4bdf-b689-069e8fe6712c-kube-api-access-d9flx") pod "network-check-target-7qzb8" (UID: "38555aab-29b1-4bdf-b689-069e8fe6712c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 13 15:24:13.115897 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:13.115297    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-75h9t"
Jul 13 15:24:13.115897 ip-10-0-140-255 kubenswrapper[2564]: E0713 15:24:13.115422    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-75h9t" podUID="84c5054b-6b5c-4b21-992a-cbd68bf1b4f2"
Jul 13 15:24:14.115446 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:14.114981    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7qzb8"
Jul 13 15:24:14.115446 ip-10-0-140-255 kubenswrapper[2564]: E0713 15:24:14.115101    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7qzb8" podUID="38555aab-29b1-4bdf-b689-069e8fe6712c"
Jul 13 15:24:14.115887 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:14.115770    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8whd7"
Jul 13 15:24:14.116029 ip-10-0-140-255 kubenswrapper[2564]: E0713 15:24:14.115995    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8whd7" podUID="9c040000-a5ce-49b2-b7a8-6faedac4708f"
Jul 13 15:24:15.117477 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:15.117442    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-75h9t"
Jul 13 15:24:15.117918 ip-10-0-140-255 kubenswrapper[2564]: E0713 15:24:15.117558    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-75h9t" podUID="84c5054b-6b5c-4b21-992a-cbd68bf1b4f2"
Jul 13 15:24:16.116279 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:16.115610    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7qzb8"
Jul 13 15:24:16.116279 ip-10-0-140-255 kubenswrapper[2564]: E0713 15:24:16.115738    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7qzb8" podUID="38555aab-29b1-4bdf-b689-069e8fe6712c"
Jul 13 15:24:16.116279 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:16.116140    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8whd7"
Jul 13 15:24:16.116279 ip-10-0-140-255 kubenswrapper[2564]: E0713 15:24:16.116231    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8whd7" podUID="9c040000-a5ce-49b2-b7a8-6faedac4708f"
Jul 13 15:24:16.501114 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:16.501075    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/84c5054b-6b5c-4b21-992a-cbd68bf1b4f2-original-pull-secret\") pod \"global-pull-secret-syncer-75h9t\" (UID: \"84c5054b-6b5c-4b21-992a-cbd68bf1b4f2\") " pod="kube-system/global-pull-secret-syncer-75h9t"
Jul 13 15:24:16.501584 ip-10-0-140-255 kubenswrapper[2564]: E0713 15:24:16.501241    2564 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 13 15:24:16.501584 ip-10-0-140-255 kubenswrapper[2564]: E0713 15:24:16.501315    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/84c5054b-6b5c-4b21-992a-cbd68bf1b4f2-original-pull-secret podName:84c5054b-6b5c-4b21-992a-cbd68bf1b4f2 nodeName:}" failed. No retries permitted until 2026-07-13 15:24:24.501291154 +0000 UTC m=+18.080526314 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/84c5054b-6b5c-4b21-992a-cbd68bf1b4f2-original-pull-secret") pod "global-pull-secret-syncer-75h9t" (UID: "84c5054b-6b5c-4b21-992a-cbd68bf1b4f2") : object "kube-system"/"original-pull-secret" not registered
Jul 13 15:24:16.601679 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:16.601645    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d9flx\" (UniqueName: \"kubernetes.io/projected/38555aab-29b1-4bdf-b689-069e8fe6712c-kube-api-access-d9flx\") pod \"network-check-target-7qzb8\" (UID: \"38555aab-29b1-4bdf-b689-069e8fe6712c\") " pod="openshift-network-diagnostics/network-check-target-7qzb8"
Jul 13 15:24:16.601679 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:16.601688    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9c040000-a5ce-49b2-b7a8-6faedac4708f-metrics-certs\") pod \"network-metrics-daemon-8whd7\" (UID: \"9c040000-a5ce-49b2-b7a8-6faedac4708f\") " pod="openshift-multus/network-metrics-daemon-8whd7"
Jul 13 15:24:16.601961 ip-10-0-140-255 kubenswrapper[2564]: E0713 15:24:16.601832    2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 13 15:24:16.602016 ip-10-0-140-255 kubenswrapper[2564]: E0713 15:24:16.601986    2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 13 15:24:16.602016 ip-10-0-140-255 kubenswrapper[2564]: E0713 15:24:16.602003    2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 13 15:24:16.602016 ip-10-0-140-255 kubenswrapper[2564]: E0713 15:24:16.602017    2564 projected.go:196] Error preparing data for projected volume kube-api-access-d9flx for pod openshift-network-diagnostics/network-check-target-7qzb8: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 13 15:24:16.602139 ip-10-0-140-255 kubenswrapper[2564]: E0713 15:24:16.602068    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/38555aab-29b1-4bdf-b689-069e8fe6712c-kube-api-access-d9flx podName:38555aab-29b1-4bdf-b689-069e8fe6712c nodeName:}" failed. No retries permitted until 2026-07-13 15:24:24.602047763 +0000 UTC m=+18.181282939 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-d9flx" (UniqueName: "kubernetes.io/projected/38555aab-29b1-4bdf-b689-069e8fe6712c-kube-api-access-d9flx") pod "network-check-target-7qzb8" (UID: "38555aab-29b1-4bdf-b689-069e8fe6712c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 13 15:24:16.602478 ip-10-0-140-255 kubenswrapper[2564]: E0713 15:24:16.602460    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9c040000-a5ce-49b2-b7a8-6faedac4708f-metrics-certs podName:9c040000-a5ce-49b2-b7a8-6faedac4708f nodeName:}" failed. No retries permitted until 2026-07-13 15:24:24.602430034 +0000 UTC m=+18.181665194 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9c040000-a5ce-49b2-b7a8-6faedac4708f-metrics-certs") pod "network-metrics-daemon-8whd7" (UID: "9c040000-a5ce-49b2-b7a8-6faedac4708f") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 13 15:24:17.116822 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:17.116381    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-75h9t"
Jul 13 15:24:17.116822 ip-10-0-140-255 kubenswrapper[2564]: E0713 15:24:17.116496    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-75h9t" podUID="84c5054b-6b5c-4b21-992a-cbd68bf1b4f2"
Jul 13 15:24:18.115505 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:18.115467    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8whd7"
Jul 13 15:24:18.115958 ip-10-0-140-255 kubenswrapper[2564]: E0713 15:24:18.115687    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8whd7" podUID="9c040000-a5ce-49b2-b7a8-6faedac4708f"
Jul 13 15:24:18.115958 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:18.115820    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7qzb8"
Jul 13 15:24:18.116088 ip-10-0-140-255 kubenswrapper[2564]: E0713 15:24:18.115956    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7qzb8" podUID="38555aab-29b1-4bdf-b689-069e8fe6712c"
Jul 13 15:24:19.115494 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:19.115462    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-75h9t"
Jul 13 15:24:19.115687 ip-10-0-140-255 kubenswrapper[2564]: E0713 15:24:19.115591    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-75h9t" podUID="84c5054b-6b5c-4b21-992a-cbd68bf1b4f2"
Jul 13 15:24:20.115437 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:20.115390    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7qzb8"
Jul 13 15:24:20.115606 ip-10-0-140-255 kubenswrapper[2564]: E0713 15:24:20.115526    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7qzb8" podUID="38555aab-29b1-4bdf-b689-069e8fe6712c"
Jul 13 15:24:20.115606 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:20.115583    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8whd7"
Jul 13 15:24:20.116041 ip-10-0-140-255 kubenswrapper[2564]: E0713 15:24:20.115706    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8whd7" podUID="9c040000-a5ce-49b2-b7a8-6faedac4708f"
Jul 13 15:24:21.115604 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:21.115570    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-75h9t"
Jul 13 15:24:21.115776 ip-10-0-140-255 kubenswrapper[2564]: E0713 15:24:21.115709    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-75h9t" podUID="84c5054b-6b5c-4b21-992a-cbd68bf1b4f2"
Jul 13 15:24:22.115591 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:22.115550    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7qzb8"
Jul 13 15:24:22.115778 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:22.115551    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8whd7"
Jul 13 15:24:22.115778 ip-10-0-140-255 kubenswrapper[2564]: E0713 15:24:22.115675    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7qzb8" podUID="38555aab-29b1-4bdf-b689-069e8fe6712c"
Jul 13 15:24:22.116192 ip-10-0-140-255 kubenswrapper[2564]: E0713 15:24:22.115782    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8whd7" podUID="9c040000-a5ce-49b2-b7a8-6faedac4708f"
Jul 13 15:24:23.115168 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:23.115128    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-75h9t"
Jul 13 15:24:23.115369 ip-10-0-140-255 kubenswrapper[2564]: E0713 15:24:23.115284    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-75h9t" podUID="84c5054b-6b5c-4b21-992a-cbd68bf1b4f2"
Jul 13 15:24:24.114885 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:24.114845    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7qzb8"
Jul 13 15:24:24.115374 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:24.114852    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8whd7"
Jul 13 15:24:24.115374 ip-10-0-140-255 kubenswrapper[2564]: E0713 15:24:24.114985    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7qzb8" podUID="38555aab-29b1-4bdf-b689-069e8fe6712c"
Jul 13 15:24:24.115374 ip-10-0-140-255 kubenswrapper[2564]: E0713 15:24:24.115067    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8whd7" podUID="9c040000-a5ce-49b2-b7a8-6faedac4708f"
Jul 13 15:24:24.561551 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:24.561447    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/84c5054b-6b5c-4b21-992a-cbd68bf1b4f2-original-pull-secret\") pod \"global-pull-secret-syncer-75h9t\" (UID: \"84c5054b-6b5c-4b21-992a-cbd68bf1b4f2\") " pod="kube-system/global-pull-secret-syncer-75h9t"
Jul 13 15:24:24.561719 ip-10-0-140-255 kubenswrapper[2564]: E0713 15:24:24.561574    2564 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 13 15:24:24.561719 ip-10-0-140-255 kubenswrapper[2564]: E0713 15:24:24.561652    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/84c5054b-6b5c-4b21-992a-cbd68bf1b4f2-original-pull-secret podName:84c5054b-6b5c-4b21-992a-cbd68bf1b4f2 nodeName:}" failed. No retries permitted until 2026-07-13 15:24:40.561635965 +0000 UTC m=+34.140871124 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/84c5054b-6b5c-4b21-992a-cbd68bf1b4f2-original-pull-secret") pod "global-pull-secret-syncer-75h9t" (UID: "84c5054b-6b5c-4b21-992a-cbd68bf1b4f2") : object "kube-system"/"original-pull-secret" not registered
Jul 13 15:24:24.662033 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:24.661991    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d9flx\" (UniqueName: \"kubernetes.io/projected/38555aab-29b1-4bdf-b689-069e8fe6712c-kube-api-access-d9flx\") pod \"network-check-target-7qzb8\" (UID: \"38555aab-29b1-4bdf-b689-069e8fe6712c\") " pod="openshift-network-diagnostics/network-check-target-7qzb8"
Jul 13 15:24:24.662278 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:24.662044    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9c040000-a5ce-49b2-b7a8-6faedac4708f-metrics-certs\") pod \"network-metrics-daemon-8whd7\" (UID: \"9c040000-a5ce-49b2-b7a8-6faedac4708f\") " pod="openshift-multus/network-metrics-daemon-8whd7"
Jul 13 15:24:24.662278 ip-10-0-140-255 kubenswrapper[2564]: E0713 15:24:24.662169    2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 13 15:24:24.662278 ip-10-0-140-255 kubenswrapper[2564]: E0713 15:24:24.662179    2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 13 15:24:24.662278 ip-10-0-140-255 kubenswrapper[2564]: E0713 15:24:24.662206    2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 13 15:24:24.662278 ip-10-0-140-255 kubenswrapper[2564]: E0713 15:24:24.662219    2564 projected.go:196] Error preparing data for projected volume kube-api-access-d9flx for pod openshift-network-diagnostics/network-check-target-7qzb8: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 13 15:24:24.662278 ip-10-0-140-255 kubenswrapper[2564]: E0713 15:24:24.662242    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9c040000-a5ce-49b2-b7a8-6faedac4708f-metrics-certs podName:9c040000-a5ce-49b2-b7a8-6faedac4708f nodeName:}" failed. No retries permitted until 2026-07-13 15:24:40.662220151 +0000 UTC m=+34.241455329 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9c040000-a5ce-49b2-b7a8-6faedac4708f-metrics-certs") pod "network-metrics-daemon-8whd7" (UID: "9c040000-a5ce-49b2-b7a8-6faedac4708f") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 13 15:24:24.662278 ip-10-0-140-255 kubenswrapper[2564]: E0713 15:24:24.662269    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/38555aab-29b1-4bdf-b689-069e8fe6712c-kube-api-access-d9flx podName:38555aab-29b1-4bdf-b689-069e8fe6712c nodeName:}" failed. No retries permitted until 2026-07-13 15:24:40.662253381 +0000 UTC m=+34.241488539 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-d9flx" (UniqueName: "kubernetes.io/projected/38555aab-29b1-4bdf-b689-069e8fe6712c-kube-api-access-d9flx") pod "network-check-target-7qzb8" (UID: "38555aab-29b1-4bdf-b689-069e8fe6712c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 13 15:24:25.115004 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:25.114968    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-75h9t"
Jul 13 15:24:25.115406 ip-10-0-140-255 kubenswrapper[2564]: E0713 15:24:25.115096    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-75h9t" podUID="84c5054b-6b5c-4b21-992a-cbd68bf1b4f2"
Jul 13 15:24:26.115079 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:26.115034    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7qzb8"
Jul 13 15:24:26.115079 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:26.115060    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8whd7"
Jul 13 15:24:26.115604 ip-10-0-140-255 kubenswrapper[2564]: E0713 15:24:26.115169    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7qzb8" podUID="38555aab-29b1-4bdf-b689-069e8fe6712c"
Jul 13 15:24:26.115604 ip-10-0-140-255 kubenswrapper[2564]: E0713 15:24:26.115271    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8whd7" podUID="9c040000-a5ce-49b2-b7a8-6faedac4708f"
Jul 13 15:24:27.115764 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:27.115728    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-75h9t"
Jul 13 15:24:27.116217 ip-10-0-140-255 kubenswrapper[2564]: E0713 15:24:27.115854    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-75h9t" podUID="84c5054b-6b5c-4b21-992a-cbd68bf1b4f2"
Jul 13 15:24:28.115071 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:28.114815    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7qzb8"
Jul 13 15:24:28.115170 ip-10-0-140-255 kubenswrapper[2564]: E0713 15:24:28.115146    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7qzb8" podUID="38555aab-29b1-4bdf-b689-069e8fe6712c"
Jul 13 15:24:28.115318 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:28.115002    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8whd7"
Jul 13 15:24:28.115417 ip-10-0-140-255 kubenswrapper[2564]: E0713 15:24:28.115390    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8whd7" podUID="9c040000-a5ce-49b2-b7a8-6faedac4708f"
Jul 13 15:24:28.210472 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:28.210398    2564 generic.go:356] "Generic (PLEG): container finished" podID="a0cd4788-5dd7-402b-9364-7588dcd91951" containerID="616df55616a2a98081982b4844e65b6fa7c152782f790f7b21616ff7ddbc7ebc" exitCode=0
Jul 13 15:24:28.211297 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:28.210483    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-t8ljw" event={"ID":"a0cd4788-5dd7-402b-9364-7588dcd91951","Type":"ContainerDied","Data":"616df55616a2a98081982b4844e65b6fa7c152782f790f7b21616ff7ddbc7ebc"}
Jul 13 15:24:28.212214 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:28.212190    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-v8r47" event={"ID":"7687fe5c-b22f-40ba-af3e-b74095ec910c","Type":"ContainerStarted","Data":"dc8e2c1abd9fc1541639ee88fec9df14d345d94a4e1c1a1025705063fc18aa44"}
Jul 13 15:24:28.214384 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:28.214363    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-zq68g" event={"ID":"7897ab94-b445-4dd1-9475-4a316db407a2","Type":"ContainerStarted","Data":"7bdb1fedb4bdca178901cb260696f4beb03a2c34b1aec35d9b2f5ef86798c85c"}
Jul 13 15:24:28.215707 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:28.215689    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-vmz75" event={"ID":"697aa34e-8473-49a1-a7dd-8be4f23ea1b3","Type":"ContainerStarted","Data":"76e09c94041a0927201fd8a5d5df93fa0ee63bf6c5c99f3bc3a6e3c61d2c55d8"}
Jul 13 15:24:28.217765 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:28.217743    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-255.ec2.internal" event={"ID":"cee06081bb6408d4c7824c898f1b18f4","Type":"ContainerStarted","Data":"a8a7514d6114810eddef2a208656fce5a7b953feb466703f51d761dbdcf459db"}
Jul 13 15:24:28.219298 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:28.219275    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-q24vk" event={"ID":"ca6016f5-c1af-4395-bdf0-e642bf637019","Type":"ContainerStarted","Data":"bf82a7a07c84e84c97af33552d998315050f9b70e1011ec7c3bff09d218208b4"}
Jul 13 15:24:28.220837 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:28.220817    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9dq6z" event={"ID":"258b7ae3-adf5-437a-8f8e-71bdd1cc665b","Type":"ContainerStarted","Data":"d28551792a57dae18aa64df2587f5f6f9dccd560aabe6431d6bb47ea898006e0"}
Jul 13 15:24:28.222213 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:28.222192    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-7bd8f" event={"ID":"c9f5cad4-bd45-453d-912b-d73122b0562e","Type":"ContainerStarted","Data":"84ed0194c57080463b946c211c42ee4e1aaf89374acaa668068263eb507c3fe6"}
Jul 13 15:24:28.223784 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:28.223742    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7v5qg" event={"ID":"0f6cac01-3a2e-4b4d-bd6b-b07daa4fc725","Type":"ContainerStarted","Data":"eb2baff0abbed20e0688fd8f51c3a6a2afccb16d2bbe9c2a7c077133aa93ebb4"}
Jul 13 15:24:28.275689 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:28.275617    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-zq68g" podStartSLOduration=3.644041159 podStartE2EDuration="21.275598244s" totalImagesPullingTime="17.631557085s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-13 15:24:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 15:24:28.275590796 +0000 UTC m=+21.854825975" watchObservedRunningTime="2026-07-13 15:24:28.275598244 +0000 UTC m=+21.854833423"
Jul 13 15:24:28.293855 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:28.293805    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-v8r47" podStartSLOduration=8.106389302 podStartE2EDuration="21.293788362s" totalImagesPullingTime="13.18739906s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 15:24:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 15:24:28.293527521 +0000 UTC m=+21.872762699" watchObservedRunningTime="2026-07-13 15:24:28.293788362 +0000 UTC m=+21.873023572"
Jul 13 15:24:28.314907 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:28.314710    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-q24vk" podStartSLOduration=2.465566848 podStartE2EDuration="21.314690297s" totalImagesPullingTime="18.849123449s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-13 15:24:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 15:24:28.314236527 +0000 UTC m=+21.893471720" watchObservedRunningTime="2026-07-13 15:24:28.314690297 +0000 UTC m=+21.893925475"
Jul 13 15:24:28.336551 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:28.336504    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-vmz75" podStartSLOduration=9.285881072 podStartE2EDuration="21.336486774s" totalImagesPullingTime="12.050605702s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-13 15:24:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 15:24:28.335823837 +0000 UTC m=+21.915059016" watchObservedRunningTime="2026-07-13 15:24:28.336486774 +0000 UTC m=+21.915721948"
Jul 13 15:24:28.355036 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:28.354996    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-7bd8f" podStartSLOduration=3.723101953 podStartE2EDuration="21.354980241s" totalImagesPullingTime="17.631878288s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-13 15:24:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 15:24:28.354532609 +0000 UTC m=+21.933767788" watchObservedRunningTime="2026-07-13 15:24:28.354980241 +0000 UTC m=+21.934215418"
Jul 13 15:24:28.373796 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:28.373753    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-255.ec2.internal" podStartSLOduration=20.373737419 podStartE2EDuration="20.373737419s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-13 15:24:08 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 15:24:28.373597802 +0000 UTC m=+21.952833012" watchObservedRunningTime="2026-07-13 15:24:28.373737419 +0000 UTC m=+21.952972597"
Jul 13 15:24:29.115296 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:29.115262    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-75h9t"
Jul 13 15:24:29.115510 ip-10-0-140-255 kubenswrapper[2564]: E0713 15:24:29.115402    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-75h9t" podUID="84c5054b-6b5c-4b21-992a-cbd68bf1b4f2"
Jul 13 15:24:29.229978 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:29.229904    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9dq6z_258b7ae3-adf5-437a-8f8e-71bdd1cc665b/ovn-acl-logging/0.log"
Jul 13 15:24:29.230444 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:29.230257    2564 generic.go:356] "Generic (PLEG): container finished" podID="258b7ae3-adf5-437a-8f8e-71bdd1cc665b" containerID="885d7019d2ff2551462c9cb4a9b887f933ae582ef4474d9f76ca8120e701293a" exitCode=1
Jul 13 15:24:29.230444 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:29.230393    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9dq6z" event={"ID":"258b7ae3-adf5-437a-8f8e-71bdd1cc665b","Type":"ContainerStarted","Data":"95dd909420facf344d110315c0a1953a7bf0c684ff8d1a6506e0c005d2165ae9"}
Jul 13 15:24:29.230533 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:29.230462    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9dq6z" event={"ID":"258b7ae3-adf5-437a-8f8e-71bdd1cc665b","Type":"ContainerStarted","Data":"21623faeab927be50c1db66f20037234817e2e85f700fd3748adde7c0106302c"}
Jul 13 15:24:29.230533 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:29.230499    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9dq6z" event={"ID":"258b7ae3-adf5-437a-8f8e-71bdd1cc665b","Type":"ContainerStarted","Data":"90bd3e15f5e0de00e02f2a7a65d2d36d65d8c39bea22ac6c169fb68b472e2c8c"}
Jul 13 15:24:29.230604 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:29.230534    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9dq6z" event={"ID":"258b7ae3-adf5-437a-8f8e-71bdd1cc665b","Type":"ContainerStarted","Data":"b7eba98180ed0df5a68d1d8c0e9f351468a58b5f6eea82470b5c651ced1f8e1b"}
Jul 13 15:24:29.230604 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:29.230585    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9dq6z" event={"ID":"258b7ae3-adf5-437a-8f8e-71bdd1cc665b","Type":"ContainerDied","Data":"885d7019d2ff2551462c9cb4a9b887f933ae582ef4474d9f76ca8120e701293a"}
Jul 13 15:24:29.496373 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:29.496332    2564 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jul 13 15:24:30.024838 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:30.024693    2564 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-13T15:24:29.496352815Z","UUID":"57bcffdf-6971-454d-b3f4-e463b1047caf","Handler":null,"Name":"","Endpoint":""}
Jul 13 15:24:30.026629 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:30.026595    2564 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jul 13 15:24:30.026629 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:30.026637    2564 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jul 13 15:24:30.115752 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:30.115719    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7qzb8"
Jul 13 15:24:30.115952 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:30.115719    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8whd7"
Jul 13 15:24:30.115952 ip-10-0-140-255 kubenswrapper[2564]: E0713 15:24:30.115846    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7qzb8" podUID="38555aab-29b1-4bdf-b689-069e8fe6712c"
Jul 13 15:24:30.115952 ip-10-0-140-255 kubenswrapper[2564]: E0713 15:24:30.115933    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8whd7" podUID="9c040000-a5ce-49b2-b7a8-6faedac4708f"
Jul 13 15:24:30.235337 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:30.235071    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-nbxfp" event={"ID":"a5193ce3-be31-44a5-a677-c50746b73b3f","Type":"ContainerStarted","Data":"b78ce4127fd7574079fcfe139d453ab968fee359a0e6d7794b6b3b8a48720a6a"}
Jul 13 15:24:30.238373 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:30.238320    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7v5qg" event={"ID":"0f6cac01-3a2e-4b4d-bd6b-b07daa4fc725","Type":"ContainerStarted","Data":"7f4ab787d55548104ae7161b36652d0efe52a4f854d7408e40dab0cd75d7f3c7"}
Jul 13 15:24:30.865005 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:30.864738    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-v8r47"
Jul 13 15:24:30.865450 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:30.865424    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-v8r47"
Jul 13 15:24:30.885218 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:30.885171    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-nbxfp" podStartSLOduration=6.257858069 podStartE2EDuration="23.885151494s" totalImagesPullingTime="17.627293425s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-13 15:24:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 15:24:30.253539621 +0000 UTC m=+23.832774831" watchObservedRunningTime="2026-07-13 15:24:30.885151494 +0000 UTC m=+24.464386673"
Jul 13 15:24:31.114911 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:31.114825    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-75h9t"
Jul 13 15:24:31.115069 ip-10-0-140-255 kubenswrapper[2564]: E0713 15:24:31.114965    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-75h9t" podUID="84c5054b-6b5c-4b21-992a-cbd68bf1b4f2"
Jul 13 15:24:31.243553 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:31.243454    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7v5qg" event={"ID":"0f6cac01-3a2e-4b4d-bd6b-b07daa4fc725","Type":"ContainerStarted","Data":"d6a02e3d4ba8d4e13a086a4796efeff055f5d561de98c6c3a93640d31555a4b7"}
Jul 13 15:24:31.243553 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:31.243550    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-v8r47"
Jul 13 15:24:31.244334 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:31.244311    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-v8r47"
Jul 13 15:24:31.269376 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:31.269320    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7v5qg" podStartSLOduration=4.287056433 podStartE2EDuration="24.269305141s" totalImagesPullingTime="19.982248708s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-13 15:24:07 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 15:24:31.268951788 +0000 UTC m=+24.848186987" watchObservedRunningTime="2026-07-13 15:24:31.269305141 +0000 UTC m=+24.848540319"
Jul 13 15:24:32.114744 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:32.114713    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8whd7"
Jul 13 15:24:32.114950 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:32.114726    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7qzb8"
Jul 13 15:24:32.114950 ip-10-0-140-255 kubenswrapper[2564]: E0713 15:24:32.114847    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8whd7" podUID="9c040000-a5ce-49b2-b7a8-6faedac4708f"
Jul 13 15:24:32.114950 ip-10-0-140-255 kubenswrapper[2564]: E0713 15:24:32.114914    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7qzb8" podUID="38555aab-29b1-4bdf-b689-069e8fe6712c"
Jul 13 15:24:33.114802 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:33.114761    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-75h9t"
Jul 13 15:24:33.115441 ip-10-0-140-255 kubenswrapper[2564]: E0713 15:24:33.114899    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-75h9t" podUID="84c5054b-6b5c-4b21-992a-cbd68bf1b4f2"
Jul 13 15:24:33.250629 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:33.250603    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9dq6z_258b7ae3-adf5-437a-8f8e-71bdd1cc665b/ovn-acl-logging/0.log"
Jul 13 15:24:33.250986 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:33.250963    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9dq6z" event={"ID":"258b7ae3-adf5-437a-8f8e-71bdd1cc665b","Type":"ContainerStarted","Data":"ee0e24a33b912872c3f9346c4729b89b95c9d71644ad4e5487bce72446314d34"}
Jul 13 15:24:33.252500 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:33.252479    2564 generic.go:356] "Generic (PLEG): container finished" podID="a0cd4788-5dd7-402b-9364-7588dcd91951" containerID="28a86b7bec6e9120ffaa7107c9585e8e12b714362140e8c0cc139c1e915314f2" exitCode=0
Jul 13 15:24:33.252592 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:33.252560    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-t8ljw" event={"ID":"a0cd4788-5dd7-402b-9364-7588dcd91951","Type":"ContainerDied","Data":"28a86b7bec6e9120ffaa7107c9585e8e12b714362140e8c0cc139c1e915314f2"}
Jul 13 15:24:34.115166 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:34.115137    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8whd7"
Jul 13 15:24:34.115653 ip-10-0-140-255 kubenswrapper[2564]: E0713 15:24:34.115248    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8whd7" podUID="9c040000-a5ce-49b2-b7a8-6faedac4708f"
Jul 13 15:24:34.115653 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:34.115305    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7qzb8"
Jul 13 15:24:34.115653 ip-10-0-140-255 kubenswrapper[2564]: E0713 15:24:34.115407    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7qzb8" podUID="38555aab-29b1-4bdf-b689-069e8fe6712c"
Jul 13 15:24:35.116043 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:35.115754    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-75h9t"
Jul 13 15:24:35.116458 ip-10-0-140-255 kubenswrapper[2564]: E0713 15:24:35.116166    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-75h9t" podUID="84c5054b-6b5c-4b21-992a-cbd68bf1b4f2"
Jul 13 15:24:35.259242 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:35.259198    2564 generic.go:356] "Generic (PLEG): container finished" podID="a0cd4788-5dd7-402b-9364-7588dcd91951" containerID="46f3af666fa5a4e5bd4b70661c4e4764e320c07a32b0a4db1ecd7913fab777b6" exitCode=0
Jul 13 15:24:35.259397 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:35.259284    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-t8ljw" event={"ID":"a0cd4788-5dd7-402b-9364-7588dcd91951","Type":"ContainerDied","Data":"46f3af666fa5a4e5bd4b70661c4e4764e320c07a32b0a4db1ecd7913fab777b6"}
Jul 13 15:24:35.262787 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:35.262770    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9dq6z_258b7ae3-adf5-437a-8f8e-71bdd1cc665b/ovn-acl-logging/0.log"
Jul 13 15:24:35.263133 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:35.263112    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9dq6z" event={"ID":"258b7ae3-adf5-437a-8f8e-71bdd1cc665b","Type":"ContainerStarted","Data":"45edd907b6cd1be5dc6874705b8278d21abec376e3b6c0f5a0173f6da667ff4a"}
Jul 13 15:24:35.263414 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:35.263395    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-9dq6z"
Jul 13 15:24:35.263499 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:35.263465    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-9dq6z"
Jul 13 15:24:35.263558 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:35.263511    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-9dq6z"
Jul 13 15:24:35.263595 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:35.263565    2564 scope.go:117] "RemoveContainer" containerID="885d7019d2ff2551462c9cb4a9b887f933ae582ef4474d9f76ca8120e701293a"
Jul 13 15:24:35.280425 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:35.280402    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-9dq6z"
Jul 13 15:24:35.280528 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:35.280515    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-9dq6z"
Jul 13 15:24:36.114928 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:36.114885    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7qzb8"
Jul 13 15:24:36.115115 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:36.114934    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8whd7"
Jul 13 15:24:36.115115 ip-10-0-140-255 kubenswrapper[2564]: E0713 15:24:36.115013    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7qzb8" podUID="38555aab-29b1-4bdf-b689-069e8fe6712c"
Jul 13 15:24:36.115215 ip-10-0-140-255 kubenswrapper[2564]: E0713 15:24:36.115118    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8whd7" podUID="9c040000-a5ce-49b2-b7a8-6faedac4708f"
Jul 13 15:24:36.268970 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:36.268894    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9dq6z_258b7ae3-adf5-437a-8f8e-71bdd1cc665b/ovn-acl-logging/0.log"
Jul 13 15:24:36.269370 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:36.269287    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9dq6z" event={"ID":"258b7ae3-adf5-437a-8f8e-71bdd1cc665b","Type":"ContainerStarted","Data":"1d45be4d74d3b85e2515d5654dc2a1923924dca08a8a2edfa1c4a38c3cf877d9"}
Jul 13 15:24:36.271647 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:36.271623    2564 generic.go:356] "Generic (PLEG): container finished" podID="a0cd4788-5dd7-402b-9364-7588dcd91951" containerID="6375a53ea42087b0dbe07110c6c2c443a8e2d68adacda71b1aefb92cc6c50880" exitCode=0
Jul 13 15:24:36.271745 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:36.271666    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-t8ljw" event={"ID":"a0cd4788-5dd7-402b-9364-7588dcd91951","Type":"ContainerDied","Data":"6375a53ea42087b0dbe07110c6c2c443a8e2d68adacda71b1aefb92cc6c50880"}
Jul 13 15:24:36.324054 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:36.324002    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-9dq6z" podStartSLOduration=10.500744172 podStartE2EDuration="29.323986297s" totalImagesPullingTime="18.823242125s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-13 15:24:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 15:24:36.32375002 +0000 UTC m=+29.902985199" watchObservedRunningTime="2026-07-13 15:24:36.323986297 +0000 UTC m=+29.903221474"
Jul 13 15:24:37.116142 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:37.116109    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-75h9t"
Jul 13 15:24:37.116310 ip-10-0-140-255 kubenswrapper[2564]: E0713 15:24:37.116222    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-75h9t" podUID="84c5054b-6b5c-4b21-992a-cbd68bf1b4f2"
Jul 13 15:24:38.115823 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:38.115788    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7qzb8"
Jul 13 15:24:38.115823 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:38.115819    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8whd7"
Jul 13 15:24:38.116340 ip-10-0-140-255 kubenswrapper[2564]: E0713 15:24:38.115959    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7qzb8" podUID="38555aab-29b1-4bdf-b689-069e8fe6712c"
Jul 13 15:24:38.116340 ip-10-0-140-255 kubenswrapper[2564]: E0713 15:24:38.116091    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8whd7" podUID="9c040000-a5ce-49b2-b7a8-6faedac4708f"
Jul 13 15:24:39.115744 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:39.115707    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-75h9t"
Jul 13 15:24:39.115910 ip-10-0-140-255 kubenswrapper[2564]: E0713 15:24:39.115841    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-75h9t" podUID="84c5054b-6b5c-4b21-992a-cbd68bf1b4f2"
Jul 13 15:24:40.114979 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:40.114939    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7qzb8"
Jul 13 15:24:40.115207 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:40.114939    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8whd7"
Jul 13 15:24:40.115207 ip-10-0-140-255 kubenswrapper[2564]: E0713 15:24:40.115129    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7qzb8" podUID="38555aab-29b1-4bdf-b689-069e8fe6712c"
Jul 13 15:24:40.115305 ip-10-0-140-255 kubenswrapper[2564]: E0713 15:24:40.115240    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8whd7" podUID="9c040000-a5ce-49b2-b7a8-6faedac4708f"
Jul 13 15:24:40.582433 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:40.582408    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/84c5054b-6b5c-4b21-992a-cbd68bf1b4f2-original-pull-secret\") pod \"global-pull-secret-syncer-75h9t\" (UID: \"84c5054b-6b5c-4b21-992a-cbd68bf1b4f2\") " pod="kube-system/global-pull-secret-syncer-75h9t"
Jul 13 15:24:40.582758 ip-10-0-140-255 kubenswrapper[2564]: E0713 15:24:40.582524    2564 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 13 15:24:40.582758 ip-10-0-140-255 kubenswrapper[2564]: E0713 15:24:40.582568    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/84c5054b-6b5c-4b21-992a-cbd68bf1b4f2-original-pull-secret podName:84c5054b-6b5c-4b21-992a-cbd68bf1b4f2 nodeName:}" failed. No retries permitted until 2026-07-13 15:25:12.582555253 +0000 UTC m=+66.161790410 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/84c5054b-6b5c-4b21-992a-cbd68bf1b4f2-original-pull-secret") pod "global-pull-secret-syncer-75h9t" (UID: "84c5054b-6b5c-4b21-992a-cbd68bf1b4f2") : object "kube-system"/"original-pull-secret" not registered
Jul 13 15:24:40.683378 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:40.683194    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d9flx\" (UniqueName: \"kubernetes.io/projected/38555aab-29b1-4bdf-b689-069e8fe6712c-kube-api-access-d9flx\") pod \"network-check-target-7qzb8\" (UID: \"38555aab-29b1-4bdf-b689-069e8fe6712c\") " pod="openshift-network-diagnostics/network-check-target-7qzb8"
Jul 13 15:24:40.683529 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:40.683386    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9c040000-a5ce-49b2-b7a8-6faedac4708f-metrics-certs\") pod \"network-metrics-daemon-8whd7\" (UID: \"9c040000-a5ce-49b2-b7a8-6faedac4708f\") " pod="openshift-multus/network-metrics-daemon-8whd7"
Jul 13 15:24:40.683529 ip-10-0-140-255 kubenswrapper[2564]: E0713 15:24:40.683360    2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 13 15:24:40.683529 ip-10-0-140-255 kubenswrapper[2564]: E0713 15:24:40.683454    2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 13 15:24:40.683529 ip-10-0-140-255 kubenswrapper[2564]: E0713 15:24:40.683464    2564 projected.go:196] Error preparing data for projected volume kube-api-access-d9flx for pod openshift-network-diagnostics/network-check-target-7qzb8: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 13 15:24:40.683529 ip-10-0-140-255 kubenswrapper[2564]: E0713 15:24:40.683478    2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 13 15:24:40.683529 ip-10-0-140-255 kubenswrapper[2564]: E0713 15:24:40.683511    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/38555aab-29b1-4bdf-b689-069e8fe6712c-kube-api-access-d9flx podName:38555aab-29b1-4bdf-b689-069e8fe6712c nodeName:}" failed. No retries permitted until 2026-07-13 15:25:12.683497751 +0000 UTC m=+66.262732908 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-d9flx" (UniqueName: "kubernetes.io/projected/38555aab-29b1-4bdf-b689-069e8fe6712c-kube-api-access-d9flx") pod "network-check-target-7qzb8" (UID: "38555aab-29b1-4bdf-b689-069e8fe6712c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 13 15:24:40.683529 ip-10-0-140-255 kubenswrapper[2564]: E0713 15:24:40.683524    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9c040000-a5ce-49b2-b7a8-6faedac4708f-metrics-certs podName:9c040000-a5ce-49b2-b7a8-6faedac4708f nodeName:}" failed. No retries permitted until 2026-07-13 15:25:12.683518375 +0000 UTC m=+66.262753531 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9c040000-a5ce-49b2-b7a8-6faedac4708f-metrics-certs") pod "network-metrics-daemon-8whd7" (UID: "9c040000-a5ce-49b2-b7a8-6faedac4708f") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 13 15:24:41.114697 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:41.114662    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-75h9t"
Jul 13 15:24:41.114906 ip-10-0-140-255 kubenswrapper[2564]: E0713 15:24:41.114765    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-75h9t" podUID="84c5054b-6b5c-4b21-992a-cbd68bf1b4f2"
Jul 13 15:24:41.286502 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:41.286467    2564 generic.go:356] "Generic (PLEG): container finished" podID="a0cd4788-5dd7-402b-9364-7588dcd91951" containerID="6f841a04d4c8308f9348488290c55339e97d8559cefdad1f67193913fcf2096a" exitCode=0
Jul 13 15:24:41.286666 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:41.286544    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-t8ljw" event={"ID":"a0cd4788-5dd7-402b-9364-7588dcd91951","Type":"ContainerDied","Data":"6f841a04d4c8308f9348488290c55339e97d8559cefdad1f67193913fcf2096a"}
Jul 13 15:24:42.115507 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:42.115476    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7qzb8"
Jul 13 15:24:42.115904 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:42.115476    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8whd7"
Jul 13 15:24:42.115904 ip-10-0-140-255 kubenswrapper[2564]: E0713 15:24:42.115576    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7qzb8" podUID="38555aab-29b1-4bdf-b689-069e8fe6712c"
Jul 13 15:24:42.115904 ip-10-0-140-255 kubenswrapper[2564]: E0713 15:24:42.115653    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8whd7" podUID="9c040000-a5ce-49b2-b7a8-6faedac4708f"
Jul 13 15:24:42.292134 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:42.292099    2564 generic.go:356] "Generic (PLEG): container finished" podID="a0cd4788-5dd7-402b-9364-7588dcd91951" containerID="bde684e9fdc8aae42b118abfa728dd0d840f305e2956e623af5b9f3392f5bed3" exitCode=0
Jul 13 15:24:42.292283 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:42.292163    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-t8ljw" event={"ID":"a0cd4788-5dd7-402b-9364-7588dcd91951","Type":"ContainerDied","Data":"bde684e9fdc8aae42b118abfa728dd0d840f305e2956e623af5b9f3392f5bed3"}
Jul 13 15:24:43.115501 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:43.115465    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-75h9t"
Jul 13 15:24:43.115712 ip-10-0-140-255 kubenswrapper[2564]: E0713 15:24:43.115598    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-75h9t" podUID="84c5054b-6b5c-4b21-992a-cbd68bf1b4f2"
Jul 13 15:24:43.297590 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:43.297559    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-t8ljw" event={"ID":"a0cd4788-5dd7-402b-9364-7588dcd91951","Type":"ContainerStarted","Data":"6a461ece0e169872ddb1bca5247da187ab7089e3e6addb9b0a6e8ec20e037a31"}
Jul 13 15:24:43.331507 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:43.331453    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-t8ljw" podStartSLOduration=12.047506493 podStartE2EDuration="36.331437818s" totalImagesPullingTime="24.283931325s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-13 15:24:07 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 15:24:43.329619621 +0000 UTC m=+36.908854799" watchObservedRunningTime="2026-07-13 15:24:43.331437818 +0000 UTC m=+36.910672996"
Jul 13 15:24:44.113359 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:44.113326    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-7qzb8"]
Jul 13 15:24:44.113551 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:44.113459    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7qzb8"
Jul 13 15:24:44.113619 ip-10-0-140-255 kubenswrapper[2564]: E0713 15:24:44.113553    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7qzb8" podUID="38555aab-29b1-4bdf-b689-069e8fe6712c"
Jul 13 15:24:44.114162 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:44.114129    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-75h9t"]
Jul 13 15:24:44.114427 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:44.114411    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-75h9t"
Jul 13 15:24:44.114541 ip-10-0-140-255 kubenswrapper[2564]: E0713 15:24:44.114515    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-75h9t" podUID="84c5054b-6b5c-4b21-992a-cbd68bf1b4f2"
Jul 13 15:24:44.114670 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:44.114649    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8whd7"
Jul 13 15:24:44.114765 ip-10-0-140-255 kubenswrapper[2564]: E0713 15:24:44.114748    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8whd7" podUID="9c040000-a5ce-49b2-b7a8-6faedac4708f"
Jul 13 15:24:44.114940 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:44.114919    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-8whd7"]
Jul 13 15:24:44.300051 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:44.300018    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8whd7"
Jul 13 15:24:44.300720 ip-10-0-140-255 kubenswrapper[2564]: E0713 15:24:44.300386    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8whd7" podUID="9c040000-a5ce-49b2-b7a8-6faedac4708f"
Jul 13 15:24:46.115403 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:46.115361    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8whd7"
Jul 13 15:24:46.115787 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:46.115363    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-75h9t"
Jul 13 15:24:46.115787 ip-10-0-140-255 kubenswrapper[2564]: E0713 15:24:46.115485    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8whd7" podUID="9c040000-a5ce-49b2-b7a8-6faedac4708f"
Jul 13 15:24:46.115787 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:46.115362    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7qzb8"
Jul 13 15:24:46.115787 ip-10-0-140-255 kubenswrapper[2564]: E0713 15:24:46.115554    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-75h9t" podUID="84c5054b-6b5c-4b21-992a-cbd68bf1b4f2"
Jul 13 15:24:46.115787 ip-10-0-140-255 kubenswrapper[2564]: E0713 15:24:46.115625    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7qzb8" podUID="38555aab-29b1-4bdf-b689-069e8fe6712c"
Jul 13 15:24:47.684940 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:47.684745    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-255.ec2.internal" event="NodeReady"
Jul 13 15:24:47.685299 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:47.685060    2564 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jul 13 15:24:47.726441 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:47.726345    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-56fb9f5477-z82hh"]
Jul 13 15:24:47.743770 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:47.743740    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-56fb9f5477-z82hh"]
Jul 13 15:24:47.743915 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:47.743826    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-56fb9f5477-z82hh"
Jul 13 15:24:47.748019 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:47.747999    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Jul 13 15:24:47.749171 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:47.749151    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Jul 13 15:24:47.749412 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:47.749391    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Jul 13 15:24:47.749536 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:47.749509    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-4pjzc\""
Jul 13 15:24:47.750503 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:47.750484    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-j9pwk"]
Jul 13 15:24:47.758745 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:47.758724    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Jul 13 15:24:47.775888 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:47.775847    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-xml8d"]
Jul 13 15:24:47.776049 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:47.775967    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-j9pwk"
Jul 13 15:24:47.778575 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:47.778557    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 13 15:24:47.778727 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:47.778688    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 13 15:24:47.778727 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:47.778691    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-74ppt\""
Jul 13 15:24:47.778991 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:47.778977    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 13 15:24:47.779065 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:47.779015    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 13 15:24:47.799858 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:47.799834    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-j9pwk"]
Jul 13 15:24:47.799981 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:47.799893    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-xml8d"]
Jul 13 15:24:47.799981 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:47.799965    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-xml8d"
Jul 13 15:24:47.805474 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:47.805454    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-dhlhs\""
Jul 13 15:24:47.805592 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:47.805454    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 13 15:24:47.805592 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:47.805462    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 13 15:24:47.835248 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:47.835221    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/da805e4c-bc0d-461a-a749-f3493be924b8-registry-tls\") pod \"image-registry-56fb9f5477-z82hh\" (UID: \"da805e4c-bc0d-461a-a749-f3493be924b8\") " pod="openshift-image-registry/image-registry-56fb9f5477-z82hh"
Jul 13 15:24:47.835385 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:47.835252    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/da805e4c-bc0d-461a-a749-f3493be924b8-trusted-ca\") pod \"image-registry-56fb9f5477-z82hh\" (UID: \"da805e4c-bc0d-461a-a749-f3493be924b8\") " pod="openshift-image-registry/image-registry-56fb9f5477-z82hh"
Jul 13 15:24:47.835385 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:47.835271    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/da805e4c-bc0d-461a-a749-f3493be924b8-bound-sa-token\") pod \"image-registry-56fb9f5477-z82hh\" (UID: \"da805e4c-bc0d-461a-a749-f3493be924b8\") " pod="openshift-image-registry/image-registry-56fb9f5477-z82hh"
Jul 13 15:24:47.835385 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:47.835304    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/da805e4c-bc0d-461a-a749-f3493be924b8-image-registry-private-configuration\") pod \"image-registry-56fb9f5477-z82hh\" (UID: \"da805e4c-bc0d-461a-a749-f3493be924b8\") " pod="openshift-image-registry/image-registry-56fb9f5477-z82hh"
Jul 13 15:24:47.835385 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:47.835323    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/da805e4c-bc0d-461a-a749-f3493be924b8-ca-trust-extracted\") pod \"image-registry-56fb9f5477-z82hh\" (UID: \"da805e4c-bc0d-461a-a749-f3493be924b8\") " pod="openshift-image-registry/image-registry-56fb9f5477-z82hh"
Jul 13 15:24:47.835385 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:47.835376    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g6lb5\" (UniqueName: \"kubernetes.io/projected/da805e4c-bc0d-461a-a749-f3493be924b8-kube-api-access-g6lb5\") pod \"image-registry-56fb9f5477-z82hh\" (UID: \"da805e4c-bc0d-461a-a749-f3493be924b8\") " pod="openshift-image-registry/image-registry-56fb9f5477-z82hh"
Jul 13 15:24:47.835611 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:47.835424    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/da805e4c-bc0d-461a-a749-f3493be924b8-installation-pull-secrets\") pod \"image-registry-56fb9f5477-z82hh\" (UID: \"da805e4c-bc0d-461a-a749-f3493be924b8\") " pod="openshift-image-registry/image-registry-56fb9f5477-z82hh"
Jul 13 15:24:47.835611 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:47.835459    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/da805e4c-bc0d-461a-a749-f3493be924b8-registry-certificates\") pod \"image-registry-56fb9f5477-z82hh\" (UID: \"da805e4c-bc0d-461a-a749-f3493be924b8\") " pod="openshift-image-registry/image-registry-56fb9f5477-z82hh"
Jul 13 15:24:47.846791 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:47.846768    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-sc4kw"]
Jul 13 15:24:47.864443 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:47.864417    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-sc4kw"]
Jul 13 15:24:47.864553 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:47.864503    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-sc4kw"
Jul 13 15:24:47.867397 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:47.867372    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 13 15:24:47.867524 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:47.867380    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-n8x6l\""
Jul 13 15:24:47.867524 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:47.867409    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 13 15:24:47.867524 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:47.867377    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 13 15:24:47.936149 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:47.936107    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/da805e4c-bc0d-461a-a749-f3493be924b8-registry-certificates\") pod \"image-registry-56fb9f5477-z82hh\" (UID: \"da805e4c-bc0d-461a-a749-f3493be924b8\") " pod="openshift-image-registry/image-registry-56fb9f5477-z82hh"
Jul 13 15:24:47.936342 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:47.936155    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wrw9p\" (UniqueName: \"kubernetes.io/projected/2b3d1ed0-50ff-416a-8589-ef4124fdee16-kube-api-access-wrw9p\") pod \"insights-runtime-extractor-j9pwk\" (UID: \"2b3d1ed0-50ff-416a-8589-ef4124fdee16\") " pod="openshift-insights/insights-runtime-extractor-j9pwk"
Jul 13 15:24:47.936342 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:47.936196    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/2b3d1ed0-50ff-416a-8589-ef4124fdee16-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-j9pwk\" (UID: \"2b3d1ed0-50ff-416a-8589-ef4124fdee16\") " pod="openshift-insights/insights-runtime-extractor-j9pwk"
Jul 13 15:24:47.936342 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:47.936255    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/da805e4c-bc0d-461a-a749-f3493be924b8-registry-tls\") pod \"image-registry-56fb9f5477-z82hh\" (UID: \"da805e4c-bc0d-461a-a749-f3493be924b8\") " pod="openshift-image-registry/image-registry-56fb9f5477-z82hh"
Jul 13 15:24:47.936342 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:47.936279    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/da805e4c-bc0d-461a-a749-f3493be924b8-trusted-ca\") pod \"image-registry-56fb9f5477-z82hh\" (UID: \"da805e4c-bc0d-461a-a749-f3493be924b8\") " pod="openshift-image-registry/image-registry-56fb9f5477-z82hh"
Jul 13 15:24:47.936342 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:47.936302    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/da805e4c-bc0d-461a-a749-f3493be924b8-bound-sa-token\") pod \"image-registry-56fb9f5477-z82hh\" (UID: \"da805e4c-bc0d-461a-a749-f3493be924b8\") " pod="openshift-image-registry/image-registry-56fb9f5477-z82hh"
Jul 13 15:24:47.936342 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:47.936324    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/2b3d1ed0-50ff-416a-8589-ef4124fdee16-data-volume\") pod \"insights-runtime-extractor-j9pwk\" (UID: \"2b3d1ed0-50ff-416a-8589-ef4124fdee16\") " pod="openshift-insights/insights-runtime-extractor-j9pwk"
Jul 13 15:24:47.936624 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:47.936354    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/da805e4c-bc0d-461a-a749-f3493be924b8-image-registry-private-configuration\") pod \"image-registry-56fb9f5477-z82hh\" (UID: \"da805e4c-bc0d-461a-a749-f3493be924b8\") " pod="openshift-image-registry/image-registry-56fb9f5477-z82hh"
Jul 13 15:24:47.936624 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:47.936378    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/da805e4c-bc0d-461a-a749-f3493be924b8-ca-trust-extracted\") pod \"image-registry-56fb9f5477-z82hh\" (UID: \"da805e4c-bc0d-461a-a749-f3493be924b8\") " pod="openshift-image-registry/image-registry-56fb9f5477-z82hh"
Jul 13 15:24:47.936624 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:47.936478    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/79a02cca-4b4d-4550-8a21-f20f13e159af-metrics-tls\") pod \"dns-default-xml8d\" (UID: \"79a02cca-4b4d-4550-8a21-f20f13e159af\") " pod="openshift-dns/dns-default-xml8d"
Jul 13 15:24:47.936624 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:47.936527    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p848s\" (UniqueName: \"kubernetes.io/projected/79a02cca-4b4d-4550-8a21-f20f13e159af-kube-api-access-p848s\") pod \"dns-default-xml8d\" (UID: \"79a02cca-4b4d-4550-8a21-f20f13e159af\") " pod="openshift-dns/dns-default-xml8d"
Jul 13 15:24:47.936624 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:47.936572    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g6lb5\" (UniqueName: \"kubernetes.io/projected/da805e4c-bc0d-461a-a749-f3493be924b8-kube-api-access-g6lb5\") pod \"image-registry-56fb9f5477-z82hh\" (UID: \"da805e4c-bc0d-461a-a749-f3493be924b8\") " pod="openshift-image-registry/image-registry-56fb9f5477-z82hh"
Jul 13 15:24:47.936624 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:47.936597    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/2b3d1ed0-50ff-416a-8589-ef4124fdee16-crio-socket\") pod \"insights-runtime-extractor-j9pwk\" (UID: \"2b3d1ed0-50ff-416a-8589-ef4124fdee16\") " pod="openshift-insights/insights-runtime-extractor-j9pwk"
Jul 13 15:24:47.936928 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:47.936627    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/2b3d1ed0-50ff-416a-8589-ef4124fdee16-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-j9pwk\" (UID: \"2b3d1ed0-50ff-416a-8589-ef4124fdee16\") " pod="openshift-insights/insights-runtime-extractor-j9pwk"
Jul 13 15:24:47.936928 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:47.936669    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/79a02cca-4b4d-4550-8a21-f20f13e159af-config-volume\") pod \"dns-default-xml8d\" (UID: \"79a02cca-4b4d-4550-8a21-f20f13e159af\") " pod="openshift-dns/dns-default-xml8d"
Jul 13 15:24:47.936928 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:47.936699    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/da805e4c-bc0d-461a-a749-f3493be924b8-installation-pull-secrets\") pod \"image-registry-56fb9f5477-z82hh\" (UID: \"da805e4c-bc0d-461a-a749-f3493be924b8\") " pod="openshift-image-registry/image-registry-56fb9f5477-z82hh"
Jul 13 15:24:47.936928 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:47.936724    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/79a02cca-4b4d-4550-8a21-f20f13e159af-tmp-dir\") pod \"dns-default-xml8d\" (UID: \"79a02cca-4b4d-4550-8a21-f20f13e159af\") " pod="openshift-dns/dns-default-xml8d"
Jul 13 15:24:47.937229 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:47.937206    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/da805e4c-bc0d-461a-a749-f3493be924b8-ca-trust-extracted\") pod \"image-registry-56fb9f5477-z82hh\" (UID: \"da805e4c-bc0d-461a-a749-f3493be924b8\") " pod="openshift-image-registry/image-registry-56fb9f5477-z82hh"
Jul 13 15:24:47.937292 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:47.937259    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/da805e4c-bc0d-461a-a749-f3493be924b8-trusted-ca\") pod \"image-registry-56fb9f5477-z82hh\" (UID: \"da805e4c-bc0d-461a-a749-f3493be924b8\") " pod="openshift-image-registry/image-registry-56fb9f5477-z82hh"
Jul 13 15:24:47.940583 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:47.940551    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/da805e4c-bc0d-461a-a749-f3493be924b8-image-registry-private-configuration\") pod \"image-registry-56fb9f5477-z82hh\" (UID: \"da805e4c-bc0d-461a-a749-f3493be924b8\") " pod="openshift-image-registry/image-registry-56fb9f5477-z82hh"
Jul 13 15:24:47.940583 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:47.940567    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/da805e4c-bc0d-461a-a749-f3493be924b8-installation-pull-secrets\") pod \"image-registry-56fb9f5477-z82hh\" (UID: \"da805e4c-bc0d-461a-a749-f3493be924b8\") " pod="openshift-image-registry/image-registry-56fb9f5477-z82hh"
Jul 13 15:24:47.940731 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:47.940630    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/da805e4c-bc0d-461a-a749-f3493be924b8-registry-tls\") pod \"image-registry-56fb9f5477-z82hh\" (UID: \"da805e4c-bc0d-461a-a749-f3493be924b8\") " pod="openshift-image-registry/image-registry-56fb9f5477-z82hh"
Jul 13 15:24:47.945204 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:47.945181    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/da805e4c-bc0d-461a-a749-f3493be924b8-bound-sa-token\") pod \"image-registry-56fb9f5477-z82hh\" (UID: \"da805e4c-bc0d-461a-a749-f3493be924b8\") " pod="openshift-image-registry/image-registry-56fb9f5477-z82hh"
Jul 13 15:24:47.945420 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:47.945402    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g6lb5\" (UniqueName: \"kubernetes.io/projected/da805e4c-bc0d-461a-a749-f3493be924b8-kube-api-access-g6lb5\") pod \"image-registry-56fb9f5477-z82hh\" (UID: \"da805e4c-bc0d-461a-a749-f3493be924b8\") " pod="openshift-image-registry/image-registry-56fb9f5477-z82hh"
Jul 13 15:24:47.950798 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:47.950776    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/da805e4c-bc0d-461a-a749-f3493be924b8-registry-certificates\") pod \"image-registry-56fb9f5477-z82hh\" (UID: \"da805e4c-bc0d-461a-a749-f3493be924b8\") " pod="openshift-image-registry/image-registry-56fb9f5477-z82hh"
Jul 13 15:24:48.037168 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:48.037070    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/2b3d1ed0-50ff-416a-8589-ef4124fdee16-data-volume\") pod \"insights-runtime-extractor-j9pwk\" (UID: \"2b3d1ed0-50ff-416a-8589-ef4124fdee16\") " pod="openshift-insights/insights-runtime-extractor-j9pwk"
Jul 13 15:24:48.037168 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:48.037113    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/79a02cca-4b4d-4550-8a21-f20f13e159af-metrics-tls\") pod \"dns-default-xml8d\" (UID: \"79a02cca-4b4d-4550-8a21-f20f13e159af\") " pod="openshift-dns/dns-default-xml8d"
Jul 13 15:24:48.037168 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:48.037138    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p848s\" (UniqueName: \"kubernetes.io/projected/79a02cca-4b4d-4550-8a21-f20f13e159af-kube-api-access-p848s\") pod \"dns-default-xml8d\" (UID: \"79a02cca-4b4d-4550-8a21-f20f13e159af\") " pod="openshift-dns/dns-default-xml8d"
Jul 13 15:24:48.037168 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:48.037164    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6747n\" (UniqueName: \"kubernetes.io/projected/e33696de-d117-4fb9-a514-ad79951752f3-kube-api-access-6747n\") pod \"ingress-canary-sc4kw\" (UID: \"e33696de-d117-4fb9-a514-ad79951752f3\") " pod="openshift-ingress-canary/ingress-canary-sc4kw"
Jul 13 15:24:48.037497 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:48.037275    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e33696de-d117-4fb9-a514-ad79951752f3-cert\") pod \"ingress-canary-sc4kw\" (UID: \"e33696de-d117-4fb9-a514-ad79951752f3\") " pod="openshift-ingress-canary/ingress-canary-sc4kw"
Jul 13 15:24:48.037497 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:48.037316    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/2b3d1ed0-50ff-416a-8589-ef4124fdee16-crio-socket\") pod \"insights-runtime-extractor-j9pwk\" (UID: \"2b3d1ed0-50ff-416a-8589-ef4124fdee16\") " pod="openshift-insights/insights-runtime-extractor-j9pwk"
Jul 13 15:24:48.037497 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:48.037337    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/2b3d1ed0-50ff-416a-8589-ef4124fdee16-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-j9pwk\" (UID: \"2b3d1ed0-50ff-416a-8589-ef4124fdee16\") " pod="openshift-insights/insights-runtime-extractor-j9pwk"
Jul 13 15:24:48.037497 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:48.037364    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/79a02cca-4b4d-4550-8a21-f20f13e159af-config-volume\") pod \"dns-default-xml8d\" (UID: \"79a02cca-4b4d-4550-8a21-f20f13e159af\") " pod="openshift-dns/dns-default-xml8d"
Jul 13 15:24:48.037497 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:48.037384    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/79a02cca-4b4d-4550-8a21-f20f13e159af-tmp-dir\") pod \"dns-default-xml8d\" (UID: \"79a02cca-4b4d-4550-8a21-f20f13e159af\") " pod="openshift-dns/dns-default-xml8d"
Jul 13 15:24:48.037497 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:48.037406    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wrw9p\" (UniqueName: \"kubernetes.io/projected/2b3d1ed0-50ff-416a-8589-ef4124fdee16-kube-api-access-wrw9p\") pod \"insights-runtime-extractor-j9pwk\" (UID: \"2b3d1ed0-50ff-416a-8589-ef4124fdee16\") " pod="openshift-insights/insights-runtime-extractor-j9pwk"
Jul 13 15:24:48.037497 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:48.037438    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/2b3d1ed0-50ff-416a-8589-ef4124fdee16-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-j9pwk\" (UID: \"2b3d1ed0-50ff-416a-8589-ef4124fdee16\") " pod="openshift-insights/insights-runtime-extractor-j9pwk"
Jul 13 15:24:48.037497 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:48.037447    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/2b3d1ed0-50ff-416a-8589-ef4124fdee16-data-volume\") pod \"insights-runtime-extractor-j9pwk\" (UID: \"2b3d1ed0-50ff-416a-8589-ef4124fdee16\") " pod="openshift-insights/insights-runtime-extractor-j9pwk"
Jul 13 15:24:48.037839 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:48.037503    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/2b3d1ed0-50ff-416a-8589-ef4124fdee16-crio-socket\") pod \"insights-runtime-extractor-j9pwk\" (UID: \"2b3d1ed0-50ff-416a-8589-ef4124fdee16\") " pod="openshift-insights/insights-runtime-extractor-j9pwk"
Jul 13 15:24:48.037839 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:48.037820    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/79a02cca-4b4d-4550-8a21-f20f13e159af-tmp-dir\") pod \"dns-default-xml8d\" (UID: \"79a02cca-4b4d-4550-8a21-f20f13e159af\") " pod="openshift-dns/dns-default-xml8d"
Jul 13 15:24:48.037949 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:48.037936    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/2b3d1ed0-50ff-416a-8589-ef4124fdee16-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-j9pwk\" (UID: \"2b3d1ed0-50ff-416a-8589-ef4124fdee16\") " pod="openshift-insights/insights-runtime-extractor-j9pwk"
Jul 13 15:24:48.038019 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:48.037994    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/79a02cca-4b4d-4550-8a21-f20f13e159af-config-volume\") pod \"dns-default-xml8d\" (UID: \"79a02cca-4b4d-4550-8a21-f20f13e159af\") " pod="openshift-dns/dns-default-xml8d"
Jul 13 15:24:48.039511 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:48.039490    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/79a02cca-4b4d-4550-8a21-f20f13e159af-metrics-tls\") pod \"dns-default-xml8d\" (UID: \"79a02cca-4b4d-4550-8a21-f20f13e159af\") " pod="openshift-dns/dns-default-xml8d"
Jul 13 15:24:48.039692 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:48.039675    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/2b3d1ed0-50ff-416a-8589-ef4124fdee16-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-j9pwk\" (UID: \"2b3d1ed0-50ff-416a-8589-ef4124fdee16\") " pod="openshift-insights/insights-runtime-extractor-j9pwk"
Jul 13 15:24:48.048829 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:48.048803    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p848s\" (UniqueName: \"kubernetes.io/projected/79a02cca-4b4d-4550-8a21-f20f13e159af-kube-api-access-p848s\") pod \"dns-default-xml8d\" (UID: \"79a02cca-4b4d-4550-8a21-f20f13e159af\") " pod="openshift-dns/dns-default-xml8d"
Jul 13 15:24:48.049042 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:48.049025    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wrw9p\" (UniqueName: \"kubernetes.io/projected/2b3d1ed0-50ff-416a-8589-ef4124fdee16-kube-api-access-wrw9p\") pod \"insights-runtime-extractor-j9pwk\" (UID: \"2b3d1ed0-50ff-416a-8589-ef4124fdee16\") " pod="openshift-insights/insights-runtime-extractor-j9pwk"
Jul 13 15:24:48.053914 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:48.053894    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-56fb9f5477-z82hh"
Jul 13 15:24:48.083934 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:48.083908    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-j9pwk"
Jul 13 15:24:48.109128 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:48.109096    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-xml8d"
Jul 13 15:24:48.115251 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:48.115224    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-75h9t"
Jul 13 15:24:48.115251 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:48.115251    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7qzb8"
Jul 13 15:24:48.115251 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:48.115258    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8whd7"
Jul 13 15:24:48.118140 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:48.118123    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 13 15:24:48.118374 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:48.118360    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 13 15:24:48.118374 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:48.118371    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 13 15:24:48.118533 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:48.118403    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-489nl\""
Jul 13 15:24:48.118533 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:48.118425    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 13 15:24:48.118533 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:48.118405    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-hbtnc\""
Jul 13 15:24:48.138069 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:48.138047    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6747n\" (UniqueName: \"kubernetes.io/projected/e33696de-d117-4fb9-a514-ad79951752f3-kube-api-access-6747n\") pod \"ingress-canary-sc4kw\" (UID: \"e33696de-d117-4fb9-a514-ad79951752f3\") " pod="openshift-ingress-canary/ingress-canary-sc4kw"
Jul 13 15:24:48.138156 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:48.138076    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e33696de-d117-4fb9-a514-ad79951752f3-cert\") pod \"ingress-canary-sc4kw\" (UID: \"e33696de-d117-4fb9-a514-ad79951752f3\") " pod="openshift-ingress-canary/ingress-canary-sc4kw"
Jul 13 15:24:48.140716 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:48.140692    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e33696de-d117-4fb9-a514-ad79951752f3-cert\") pod \"ingress-canary-sc4kw\" (UID: \"e33696de-d117-4fb9-a514-ad79951752f3\") " pod="openshift-ingress-canary/ingress-canary-sc4kw"
Jul 13 15:24:48.147783 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:48.147758    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6747n\" (UniqueName: \"kubernetes.io/projected/e33696de-d117-4fb9-a514-ad79951752f3-kube-api-access-6747n\") pod \"ingress-canary-sc4kw\" (UID: \"e33696de-d117-4fb9-a514-ad79951752f3\") " pod="openshift-ingress-canary/ingress-canary-sc4kw"
Jul 13 15:24:48.173360 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:48.173099    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-sc4kw"
Jul 13 15:24:48.297987 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:48.297908    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-j9pwk"]
Jul 13 15:24:48.301033 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:24:48.301006    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2b3d1ed0_50ff_416a_8589_ef4124fdee16.slice/crio-be0ad0e06d3221940b87fcf11107218031f622bf3557a09d32319da4c86d430d WatchSource:0}: Error finding container be0ad0e06d3221940b87fcf11107218031f622bf3557a09d32319da4c86d430d: Status 404 returned error can't find the container with id be0ad0e06d3221940b87fcf11107218031f622bf3557a09d32319da4c86d430d
Jul 13 15:24:48.304482 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:48.304460    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-56fb9f5477-z82hh"]
Jul 13 15:24:48.308501 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:24:48.308477    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podda805e4c_bc0d_461a_a749_f3493be924b8.slice/crio-72c64d1f69c66b10b3984b2f3550d518945163f1bcb90ed1b2e8396005b80615 WatchSource:0}: Error finding container 72c64d1f69c66b10b3984b2f3550d518945163f1bcb90ed1b2e8396005b80615: Status 404 returned error can't find the container with id 72c64d1f69c66b10b3984b2f3550d518945163f1bcb90ed1b2e8396005b80615
Jul 13 15:24:48.310698 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:48.310664    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-j9pwk" event={"ID":"2b3d1ed0-50ff-416a-8589-ef4124fdee16","Type":"ContainerStarted","Data":"be0ad0e06d3221940b87fcf11107218031f622bf3557a09d32319da4c86d430d"}
Jul 13 15:24:48.327655 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:48.327632    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-xml8d"]
Jul 13 15:24:48.330427 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:24:48.330403    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod79a02cca_4b4d_4550_8a21_f20f13e159af.slice/crio-db3acea88bf73cf8a9daf844935c1a5460346c1bea0601100f5be8cb72021dcd WatchSource:0}: Error finding container db3acea88bf73cf8a9daf844935c1a5460346c1bea0601100f5be8cb72021dcd: Status 404 returned error can't find the container with id db3acea88bf73cf8a9daf844935c1a5460346c1bea0601100f5be8cb72021dcd
Jul 13 15:24:48.351994 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:48.351968    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-sc4kw"]
Jul 13 15:24:48.354996 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:24:48.354931    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode33696de_d117_4fb9_a514_ad79951752f3.slice/crio-d1148a362aa55dd429c864db47cc6f9a2fe47c690e249687078cdd76063d27f3 WatchSource:0}: Error finding container d1148a362aa55dd429c864db47cc6f9a2fe47c690e249687078cdd76063d27f3: Status 404 returned error can't find the container with id d1148a362aa55dd429c864db47cc6f9a2fe47c690e249687078cdd76063d27f3
Jul 13 15:24:49.314488 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:49.314283    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-xml8d" event={"ID":"79a02cca-4b4d-4550-8a21-f20f13e159af","Type":"ContainerStarted","Data":"db3acea88bf73cf8a9daf844935c1a5460346c1bea0601100f5be8cb72021dcd"}
Jul 13 15:24:49.315683 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:49.315650    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-56fb9f5477-z82hh" event={"ID":"da805e4c-bc0d-461a-a749-f3493be924b8","Type":"ContainerStarted","Data":"bb83f6ed402911de2530f816c43f631bd97442aa0112d94902356ce500c1cdfa"}
Jul 13 15:24:49.315812 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:49.315701    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-56fb9f5477-z82hh" event={"ID":"da805e4c-bc0d-461a-a749-f3493be924b8","Type":"ContainerStarted","Data":"72c64d1f69c66b10b3984b2f3550d518945163f1bcb90ed1b2e8396005b80615"}
Jul 13 15:24:49.315812 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:49.315724    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-56fb9f5477-z82hh"
Jul 13 15:24:49.316730 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:49.316706    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-sc4kw" event={"ID":"e33696de-d117-4fb9-a514-ad79951752f3","Type":"ContainerStarted","Data":"d1148a362aa55dd429c864db47cc6f9a2fe47c690e249687078cdd76063d27f3"}
Jul 13 15:24:49.343744 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:49.343686    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-56fb9f5477-z82hh" podStartSLOduration=7.34367151 podStartE2EDuration="7.34367151s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 15:24:42 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 15:24:49.342319756 +0000 UTC m=+42.921554944" watchObservedRunningTime="2026-07-13 15:24:49.34367151 +0000 UTC m=+42.922906688"
Jul 13 15:24:54.163835 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:54.163795    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-v6bcf"]
Jul 13 15:24:54.183653 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:54.183616    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-v6bcf"]
Jul 13 15:24:54.183779 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:54.183737    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-v6bcf"
Jul 13 15:24:54.186497 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:54.186472    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-bdxb8\""
Jul 13 15:24:54.186627 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:54.186503    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\""
Jul 13 15:24:54.285361 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:54.285321    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/120cd9ec-defa-4943-9679-79cc335cc915-tls-certificates\") pod \"prometheus-operator-admission-webhook-77d98bc786-v6bcf\" (UID: \"120cd9ec-defa-4943-9679-79cc335cc915\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-v6bcf"
Jul 13 15:24:54.386224 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:54.386191    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/120cd9ec-defa-4943-9679-79cc335cc915-tls-certificates\") pod \"prometheus-operator-admission-webhook-77d98bc786-v6bcf\" (UID: \"120cd9ec-defa-4943-9679-79cc335cc915\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-v6bcf"
Jul 13 15:24:54.390428 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:54.390403    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/120cd9ec-defa-4943-9679-79cc335cc915-tls-certificates\") pod \"prometheus-operator-admission-webhook-77d98bc786-v6bcf\" (UID: \"120cd9ec-defa-4943-9679-79cc335cc915\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-v6bcf"
Jul 13 15:24:54.493582 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:54.493486    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-v6bcf"
Jul 13 15:24:54.822786 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:54.822463    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-v6bcf"]
Jul 13 15:24:54.826862 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:24:54.826832    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod120cd9ec_defa_4943_9679_79cc335cc915.slice/crio-37c77d85d1ef60dcff6bd7a3ed9317e62c3b6950d00e47cfa1440700fbd2a7d4 WatchSource:0}: Error finding container 37c77d85d1ef60dcff6bd7a3ed9317e62c3b6950d00e47cfa1440700fbd2a7d4: Status 404 returned error can't find the container with id 37c77d85d1ef60dcff6bd7a3ed9317e62c3b6950d00e47cfa1440700fbd2a7d4
Jul 13 15:24:55.333912 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:55.333808    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-v6bcf" event={"ID":"120cd9ec-defa-4943-9679-79cc335cc915","Type":"ContainerStarted","Data":"37c77d85d1ef60dcff6bd7a3ed9317e62c3b6950d00e47cfa1440700fbd2a7d4"}
Jul 13 15:24:55.335277 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:55.335254    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-sc4kw" event={"ID":"e33696de-d117-4fb9-a514-ad79951752f3","Type":"ContainerStarted","Data":"249bb6c1dca3de9a2aec2c17d87ddc608a1f46930c3f5efc67c8dfc054ba1371"}
Jul 13 15:24:55.336729 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:55.336701    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-j9pwk" event={"ID":"2b3d1ed0-50ff-416a-8589-ef4124fdee16","Type":"ContainerStarted","Data":"32922e1802aa24d5a6545fdc42325f1de0971f8d939c26c0b4519b6db5947055"}
Jul 13 15:24:55.338217 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:55.338199    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-xml8d" event={"ID":"79a02cca-4b4d-4550-8a21-f20f13e159af","Type":"ContainerStarted","Data":"0f89610e61a1ee972ca0ea8e40c2e261abd37834fd77a62b228cd9068644ec02"}
Jul 13 15:24:55.338278 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:55.338234    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-xml8d" event={"ID":"79a02cca-4b4d-4550-8a21-f20f13e159af","Type":"ContainerStarted","Data":"6ae9dbfcbc74ba77b9a75140f3930dc108a7acb4879f15979a58a60238a2de13"}
Jul 13 15:24:55.338351 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:55.338340    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-xml8d"
Jul 13 15:24:55.362454 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:55.362404    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-sc4kw" podStartSLOduration=2.024327769 podStartE2EDuration="8.362388834s" totalImagesPullingTime="6.338061065s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 15:24:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 15:24:55.361144538 +0000 UTC m=+48.940379723" watchObservedRunningTime="2026-07-13 15:24:55.362388834 +0000 UTC m=+48.941623989"
Jul 13 15:24:55.381846 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:55.381795    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-xml8d" podStartSLOduration=2.027364582 podStartE2EDuration="8.381777029s" totalImagesPullingTime="6.354412447s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 15:24:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 15:24:55.381425384 +0000 UTC m=+48.960660594" watchObservedRunningTime="2026-07-13 15:24:55.381777029 +0000 UTC m=+48.961012207"
Jul 13 15:24:57.346944 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:57.346700    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-v6bcf" event={"ID":"120cd9ec-defa-4943-9679-79cc335cc915","Type":"ContainerStarted","Data":"4d49b029e82e6f2e7eec60bd72948a4837b72845d24f39dee7b07b0a215a3125"}
Jul 13 15:24:57.347537 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:57.346979    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-v6bcf"
Jul 13 15:24:57.348481 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:57.348456    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-j9pwk" event={"ID":"2b3d1ed0-50ff-416a-8589-ef4124fdee16","Type":"ContainerStarted","Data":"3d6606c9707b71f4a5b660e6636c102f7dbca3674f81ab0daf1afeac6f7524f5"}
Jul 13 15:24:57.351945 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:57.351923    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-v6bcf"
Jul 13 15:24:57.364964 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:24:57.364912    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-v6bcf" podStartSLOduration=1.827803485 podStartE2EDuration="3.364893233s" totalImagesPullingTime="1.537089748s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 15:24:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 15:24:57.363678253 +0000 UTC m=+50.942913451" watchObservedRunningTime="2026-07-13 15:24:57.364893233 +0000 UTC m=+50.944128402"
Jul 13 15:25:00.359970 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:25:00.359928    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-j9pwk" event={"ID":"2b3d1ed0-50ff-416a-8589-ef4124fdee16","Type":"ContainerStarted","Data":"ac0211673ee9401500c83a00e806b56fdb75ac5b9c0593edd9fde8de5a858dab"}
Jul 13 15:25:00.383515 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:25:00.383465    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-j9pwk" podStartSLOduration=2.528978431 podStartE2EDuration="13.383446986s" totalImagesPullingTime="10.854468555s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-13 15:24:47 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 15:25:00.382951976 +0000 UTC m=+53.962187178" watchObservedRunningTime="2026-07-13 15:25:00.383446986 +0000 UTC m=+53.962682401"
Jul 13 15:25:03.635752 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:25:03.635717    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-59248"]
Jul 13 15:25:03.647067 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:25:03.647040    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-785778ff74-9nmfd"]
Jul 13 15:25:03.647217 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:25:03.647170    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-59248"
Jul 13 15:25:03.650200 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:25:03.650175    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 13 15:25:03.650348 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:25:03.650175    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 13 15:25:03.650348 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:25:03.650341    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-hjgnp\""
Jul 13 15:25:03.650457 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:25:03.650418    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 13 15:25:03.650457 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:25:03.650424    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 13 15:25:03.650654 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:25:03.650640    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 13 15:25:03.650754 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:25:03.650737    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 13 15:25:03.654056 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:25:03.654033    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-785778ff74-9nmfd"
Jul 13 15:25:03.656152 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:25:03.656119    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\""
Jul 13 15:25:03.656535 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:25:03.656516    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\""
Jul 13 15:25:03.656633 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:25:03.656588    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\""
Jul 13 15:25:03.657539 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:25:03.657517    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-785778ff74-9nmfd"]
Jul 13 15:25:03.659846 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:25:03.659821    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6b7nj\" (UniqueName: \"kubernetes.io/projected/36c089c7-2008-444f-bb90-c398b04bd569-kube-api-access-6b7nj\") pod \"kube-state-metrics-785778ff74-9nmfd\" (UID: \"36c089c7-2008-444f-bb90-c398b04bd569\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-9nmfd"
Jul 13 15:25:03.659956 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:25:03.659856    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/269be8b3-99be-405a-bbcc-f0c8c65d7a01-node-exporter-accelerators-collector-config\") pod \"node-exporter-59248\" (UID: \"269be8b3-99be-405a-bbcc-f0c8c65d7a01\") " pod="openshift-monitoring/node-exporter-59248"
Jul 13 15:25:03.659956 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:25:03.659928    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/269be8b3-99be-405a-bbcc-f0c8c65d7a01-metrics-client-ca\") pod \"node-exporter-59248\" (UID: \"269be8b3-99be-405a-bbcc-f0c8c65d7a01\") " pod="openshift-monitoring/node-exporter-59248"
Jul 13 15:25:03.660052 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:25:03.659954    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/269be8b3-99be-405a-bbcc-f0c8c65d7a01-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-59248\" (UID: \"269be8b3-99be-405a-bbcc-f0c8c65d7a01\") " pod="openshift-monitoring/node-exporter-59248"
Jul 13 15:25:03.660052 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:25:03.660001    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/36c089c7-2008-444f-bb90-c398b04bd569-kube-state-metrics-tls\") pod \"kube-state-metrics-785778ff74-9nmfd\" (UID: \"36c089c7-2008-444f-bb90-c398b04bd569\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-9nmfd"
Jul 13 15:25:03.660052 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:25:03.660022    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/36c089c7-2008-444f-bb90-c398b04bd569-metrics-client-ca\") pod \"kube-state-metrics-785778ff74-9nmfd\" (UID: \"36c089c7-2008-444f-bb90-c398b04bd569\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-9nmfd"
Jul 13 15:25:03.660198 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:25:03.660056    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/269be8b3-99be-405a-bbcc-f0c8c65d7a01-node-exporter-tls\") pod \"node-exporter-59248\" (UID: \"269be8b3-99be-405a-bbcc-f0c8c65d7a01\") " pod="openshift-monitoring/node-exporter-59248"
Jul 13 15:25:03.660198 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:25:03.660084    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/269be8b3-99be-405a-bbcc-f0c8c65d7a01-root\") pod \"node-exporter-59248\" (UID: \"269be8b3-99be-405a-bbcc-f0c8c65d7a01\") " pod="openshift-monitoring/node-exporter-59248"
Jul 13 15:25:03.660198 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:25:03.660118    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/36c089c7-2008-444f-bb90-c398b04bd569-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-785778ff74-9nmfd\" (UID: \"36c089c7-2008-444f-bb90-c398b04bd569\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-9nmfd"
Jul 13 15:25:03.660198 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:25:03.660167    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/36c089c7-2008-444f-bb90-c398b04bd569-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-785778ff74-9nmfd\" (UID: \"36c089c7-2008-444f-bb90-c398b04bd569\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-9nmfd"
Jul 13 15:25:03.660372 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:25:03.660203    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/36c089c7-2008-444f-bb90-c398b04bd569-volume-directive-shadow\") pod \"kube-state-metrics-785778ff74-9nmfd\" (UID: \"36c089c7-2008-444f-bb90-c398b04bd569\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-9nmfd"
Jul 13 15:25:03.660372 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:25:03.660227    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/269be8b3-99be-405a-bbcc-f0c8c65d7a01-sys\") pod \"node-exporter-59248\" (UID: \"269be8b3-99be-405a-bbcc-f0c8c65d7a01\") " pod="openshift-monitoring/node-exporter-59248"
Jul 13 15:25:03.660372 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:25:03.660247    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/269be8b3-99be-405a-bbcc-f0c8c65d7a01-node-exporter-textfile\") pod \"node-exporter-59248\" (UID: \"269be8b3-99be-405a-bbcc-f0c8c65d7a01\") " pod="openshift-monitoring/node-exporter-59248"
Jul 13 15:25:03.660372 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:25:03.660269    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6ws9z\" (UniqueName: \"kubernetes.io/projected/269be8b3-99be-405a-bbcc-f0c8c65d7a01-kube-api-access-6ws9z\") pod \"node-exporter-59248\" (UID: \"269be8b3-99be-405a-bbcc-f0c8c65d7a01\") " pod="openshift-monitoring/node-exporter-59248"
Jul 13 15:25:03.660372 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:25:03.660347    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/269be8b3-99be-405a-bbcc-f0c8c65d7a01-node-exporter-wtmp\") pod \"node-exporter-59248\" (UID: \"269be8b3-99be-405a-bbcc-f0c8c65d7a01\") " pod="openshift-monitoring/node-exporter-59248"
Jul 13 15:25:03.663567 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:25:03.663550    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-7ctff\""
Jul 13 15:25:03.761604 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:25:03.761564    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/269be8b3-99be-405a-bbcc-f0c8c65d7a01-node-exporter-wtmp\") pod \"node-exporter-59248\" (UID: \"269be8b3-99be-405a-bbcc-f0c8c65d7a01\") " pod="openshift-monitoring/node-exporter-59248"
Jul 13 15:25:03.761787 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:25:03.761616    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6b7nj\" (UniqueName: \"kubernetes.io/projected/36c089c7-2008-444f-bb90-c398b04bd569-kube-api-access-6b7nj\") pod \"kube-state-metrics-785778ff74-9nmfd\" (UID: \"36c089c7-2008-444f-bb90-c398b04bd569\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-9nmfd"
Jul 13 15:25:03.761787 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:25:03.761731    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/269be8b3-99be-405a-bbcc-f0c8c65d7a01-node-exporter-accelerators-collector-config\") pod \"node-exporter-59248\" (UID: \"269be8b3-99be-405a-bbcc-f0c8c65d7a01\") " pod="openshift-monitoring/node-exporter-59248"
Jul 13 15:25:03.761949 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:25:03.761798    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/269be8b3-99be-405a-bbcc-f0c8c65d7a01-metrics-client-ca\") pod \"node-exporter-59248\" (UID: \"269be8b3-99be-405a-bbcc-f0c8c65d7a01\") " pod="openshift-monitoring/node-exporter-59248"
Jul 13 15:25:03.761949 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:25:03.761739    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/269be8b3-99be-405a-bbcc-f0c8c65d7a01-node-exporter-wtmp\") pod \"node-exporter-59248\" (UID: \"269be8b3-99be-405a-bbcc-f0c8c65d7a01\") " pod="openshift-monitoring/node-exporter-59248"
Jul 13 15:25:03.761949 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:25:03.761851    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/269be8b3-99be-405a-bbcc-f0c8c65d7a01-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-59248\" (UID: \"269be8b3-99be-405a-bbcc-f0c8c65d7a01\") " pod="openshift-monitoring/node-exporter-59248"
Jul 13 15:25:03.761949 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:25:03.761909    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/36c089c7-2008-444f-bb90-c398b04bd569-kube-state-metrics-tls\") pod \"kube-state-metrics-785778ff74-9nmfd\" (UID: \"36c089c7-2008-444f-bb90-c398b04bd569\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-9nmfd"
Jul 13 15:25:03.761949 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:25:03.761935    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/36c089c7-2008-444f-bb90-c398b04bd569-metrics-client-ca\") pod \"kube-state-metrics-785778ff74-9nmfd\" (UID: \"36c089c7-2008-444f-bb90-c398b04bd569\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-9nmfd"
Jul 13 15:25:03.762260 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:25:03.761984    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/269be8b3-99be-405a-bbcc-f0c8c65d7a01-node-exporter-tls\") pod \"node-exporter-59248\" (UID: \"269be8b3-99be-405a-bbcc-f0c8c65d7a01\") " pod="openshift-monitoring/node-exporter-59248"
Jul 13 15:25:03.762260 ip-10-0-140-255 kubenswrapper[2564]: E0713 15:25:03.762006    2564 secret.go:189] Couldn't get secret openshift-monitoring/kube-state-metrics-tls: secret "kube-state-metrics-tls" not found
Jul 13 15:25:03.762260 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:25:03.762014    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/269be8b3-99be-405a-bbcc-f0c8c65d7a01-root\") pod \"node-exporter-59248\" (UID: \"269be8b3-99be-405a-bbcc-f0c8c65d7a01\") " pod="openshift-monitoring/node-exporter-59248"
Jul 13 15:25:03.762260 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:25:03.762041    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/36c089c7-2008-444f-bb90-c398b04bd569-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-785778ff74-9nmfd\" (UID: \"36c089c7-2008-444f-bb90-c398b04bd569\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-9nmfd"
Jul 13 15:25:03.762260 ip-10-0-140-255 kubenswrapper[2564]: E0713 15:25:03.762081    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/36c089c7-2008-444f-bb90-c398b04bd569-kube-state-metrics-tls podName:36c089c7-2008-444f-bb90-c398b04bd569 nodeName:}" failed. No retries permitted until 2026-07-13 15:25:04.262060032 +0000 UTC m=+57.841295192 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-state-metrics-tls" (UniqueName: "kubernetes.io/secret/36c089c7-2008-444f-bb90-c398b04bd569-kube-state-metrics-tls") pod "kube-state-metrics-785778ff74-9nmfd" (UID: "36c089c7-2008-444f-bb90-c398b04bd569") : secret "kube-state-metrics-tls" not found
Jul 13 15:25:03.762260 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:25:03.762122    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/36c089c7-2008-444f-bb90-c398b04bd569-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-785778ff74-9nmfd\" (UID: \"36c089c7-2008-444f-bb90-c398b04bd569\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-9nmfd"
Jul 13 15:25:03.762260 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:25:03.762155    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/36c089c7-2008-444f-bb90-c398b04bd569-volume-directive-shadow\") pod \"kube-state-metrics-785778ff74-9nmfd\" (UID: \"36c089c7-2008-444f-bb90-c398b04bd569\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-9nmfd"
Jul 13 15:25:03.762260 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:25:03.762180    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/269be8b3-99be-405a-bbcc-f0c8c65d7a01-sys\") pod \"node-exporter-59248\" (UID: \"269be8b3-99be-405a-bbcc-f0c8c65d7a01\") " pod="openshift-monitoring/node-exporter-59248"
Jul 13 15:25:03.762260 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:25:03.762215    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/269be8b3-99be-405a-bbcc-f0c8c65d7a01-node-exporter-textfile\") pod \"node-exporter-59248\" (UID: \"269be8b3-99be-405a-bbcc-f0c8c65d7a01\") " pod="openshift-monitoring/node-exporter-59248"
Jul 13 15:25:03.762260 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:25:03.762240    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6ws9z\" (UniqueName: \"kubernetes.io/projected/269be8b3-99be-405a-bbcc-f0c8c65d7a01-kube-api-access-6ws9z\") pod \"node-exporter-59248\" (UID: \"269be8b3-99be-405a-bbcc-f0c8c65d7a01\") " pod="openshift-monitoring/node-exporter-59248"
Jul 13 15:25:03.762760 ip-10-0-140-255 kubenswrapper[2564]: E0713 15:25:03.762475    2564 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found
Jul 13 15:25:03.762760 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:25:03.762523    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/269be8b3-99be-405a-bbcc-f0c8c65d7a01-node-exporter-accelerators-collector-config\") pod \"node-exporter-59248\" (UID: \"269be8b3-99be-405a-bbcc-f0c8c65d7a01\") " pod="openshift-monitoring/node-exporter-59248"
Jul 13 15:25:03.762760 ip-10-0-140-255 kubenswrapper[2564]: E0713 15:25:03.762541    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/269be8b3-99be-405a-bbcc-f0c8c65d7a01-node-exporter-tls podName:269be8b3-99be-405a-bbcc-f0c8c65d7a01 nodeName:}" failed. No retries permitted until 2026-07-13 15:25:04.262523211 +0000 UTC m=+57.841758371 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/269be8b3-99be-405a-bbcc-f0c8c65d7a01-node-exporter-tls") pod "node-exporter-59248" (UID: "269be8b3-99be-405a-bbcc-f0c8c65d7a01") : secret "node-exporter-tls" not found
Jul 13 15:25:03.762760 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:25:03.762566    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/269be8b3-99be-405a-bbcc-f0c8c65d7a01-sys\") pod \"node-exporter-59248\" (UID: \"269be8b3-99be-405a-bbcc-f0c8c65d7a01\") " pod="openshift-monitoring/node-exporter-59248"
Jul 13 15:25:03.762760 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:25:03.762123    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/269be8b3-99be-405a-bbcc-f0c8c65d7a01-root\") pod \"node-exporter-59248\" (UID: \"269be8b3-99be-405a-bbcc-f0c8c65d7a01\") " pod="openshift-monitoring/node-exporter-59248"
Jul 13 15:25:03.762760 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:25:03.762617    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/36c089c7-2008-444f-bb90-c398b04bd569-volume-directive-shadow\") pod \"kube-state-metrics-785778ff74-9nmfd\" (UID: \"36c089c7-2008-444f-bb90-c398b04bd569\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-9nmfd"
Jul 13 15:25:03.763037 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:25:03.762783    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/269be8b3-99be-405a-bbcc-f0c8c65d7a01-metrics-client-ca\") pod \"node-exporter-59248\" (UID: \"269be8b3-99be-405a-bbcc-f0c8c65d7a01\") " pod="openshift-monitoring/node-exporter-59248"
Jul 13 15:25:03.763037 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:25:03.762796    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/36c089c7-2008-444f-bb90-c398b04bd569-metrics-client-ca\") pod \"kube-state-metrics-785778ff74-9nmfd\" (UID: \"36c089c7-2008-444f-bb90-c398b04bd569\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-9nmfd"
Jul 13 15:25:03.763037 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:25:03.762783    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/269be8b3-99be-405a-bbcc-f0c8c65d7a01-node-exporter-textfile\") pod \"node-exporter-59248\" (UID: \"269be8b3-99be-405a-bbcc-f0c8c65d7a01\") " pod="openshift-monitoring/node-exporter-59248"
Jul 13 15:25:03.763127 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:25:03.763074    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/36c089c7-2008-444f-bb90-c398b04bd569-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-785778ff74-9nmfd\" (UID: \"36c089c7-2008-444f-bb90-c398b04bd569\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-9nmfd"
Jul 13 15:25:03.766132 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:25:03.766103    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/269be8b3-99be-405a-bbcc-f0c8c65d7a01-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-59248\" (UID: \"269be8b3-99be-405a-bbcc-f0c8c65d7a01\") " pod="openshift-monitoring/node-exporter-59248"
Jul 13 15:25:03.766267 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:25:03.766148    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/36c089c7-2008-444f-bb90-c398b04bd569-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-785778ff74-9nmfd\" (UID: \"36c089c7-2008-444f-bb90-c398b04bd569\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-9nmfd"
Jul 13 15:25:03.771080 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:25:03.771058    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6b7nj\" (UniqueName: \"kubernetes.io/projected/36c089c7-2008-444f-bb90-c398b04bd569-kube-api-access-6b7nj\") pod \"kube-state-metrics-785778ff74-9nmfd\" (UID: \"36c089c7-2008-444f-bb90-c398b04bd569\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-9nmfd"
Jul 13 15:25:03.771325 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:25:03.771307    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6ws9z\" (UniqueName: \"kubernetes.io/projected/269be8b3-99be-405a-bbcc-f0c8c65d7a01-kube-api-access-6ws9z\") pod \"node-exporter-59248\" (UID: \"269be8b3-99be-405a-bbcc-f0c8c65d7a01\") " pod="openshift-monitoring/node-exporter-59248"
Jul 13 15:25:04.266569 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:25:04.266530    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/269be8b3-99be-405a-bbcc-f0c8c65d7a01-node-exporter-tls\") pod \"node-exporter-59248\" (UID: \"269be8b3-99be-405a-bbcc-f0c8c65d7a01\") " pod="openshift-monitoring/node-exporter-59248"
Jul 13 15:25:04.266742 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:25:04.266619    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/36c089c7-2008-444f-bb90-c398b04bd569-kube-state-metrics-tls\") pod \"kube-state-metrics-785778ff74-9nmfd\" (UID: \"36c089c7-2008-444f-bb90-c398b04bd569\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-9nmfd"
Jul 13 15:25:04.269031 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:25:04.269000    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/269be8b3-99be-405a-bbcc-f0c8c65d7a01-node-exporter-tls\") pod \"node-exporter-59248\" (UID: \"269be8b3-99be-405a-bbcc-f0c8c65d7a01\") " pod="openshift-monitoring/node-exporter-59248"
Jul 13 15:25:04.269150 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:25:04.269135    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/36c089c7-2008-444f-bb90-c398b04bd569-kube-state-metrics-tls\") pod \"kube-state-metrics-785778ff74-9nmfd\" (UID: \"36c089c7-2008-444f-bb90-c398b04bd569\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-9nmfd"
Jul 13 15:25:04.558939 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:25:04.558821    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-59248"
Jul 13 15:25:04.565146 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:25:04.565111    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-785778ff74-9nmfd"
Jul 13 15:25:04.596359 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:25:04.596330    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod269be8b3_99be_405a_bbcc_f0c8c65d7a01.slice/crio-e458d8002f74c7d1f0fa296c0cea6ca1d273cb94858041700c43ca7733e6e9f0 WatchSource:0}: Error finding container e458d8002f74c7d1f0fa296c0cea6ca1d273cb94858041700c43ca7733e6e9f0: Status 404 returned error can't find the container with id e458d8002f74c7d1f0fa296c0cea6ca1d273cb94858041700c43ca7733e6e9f0
Jul 13 15:25:04.753895 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:25:04.753852    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-785778ff74-9nmfd"]
Jul 13 15:25:04.757051 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:25:04.757026    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod36c089c7_2008_444f_bb90_c398b04bd569.slice/crio-240bf7d7d84da11568b4bc84e70951d72e4dd42b9a232dce62a14a5aad4e093b WatchSource:0}: Error finding container 240bf7d7d84da11568b4bc84e70951d72e4dd42b9a232dce62a14a5aad4e093b: Status 404 returned error can't find the container with id 240bf7d7d84da11568b4bc84e70951d72e4dd42b9a232dce62a14a5aad4e093b
Jul 13 15:25:04.923807 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:25:04.923774    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 13 15:25:04.928932 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:25:04.928895    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 13 15:25:04.939279 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:25:04.939254    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
Jul 13 15:25:04.939622 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:25:04.939609    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
Jul 13 15:25:04.939675 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:25:04.939659    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
Jul 13 15:25:04.939859 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:25:04.939844    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
Jul 13 15:25:04.939933 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:25:04.939916    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
Jul 13 15:25:04.940010 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:25:04.939995    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
Jul 13 15:25:04.940133 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:25:04.940117    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
Jul 13 15:25:04.940252 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:25:04.940236    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
Jul 13 15:25:04.940797 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:25:04.940783    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
Jul 13 15:25:04.941263 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:25:04.941249    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-vktnm\""
Jul 13 15:25:04.955284 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:25:04.955252    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 13 15:25:04.971902 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:25:04.971848    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ca3d6543-c2c9-4225-a3c9-5045b863c183-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"ca3d6543-c2c9-4225-a3c9-5045b863c183\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 13 15:25:04.972073 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:25:04.971935    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/ca3d6543-c2c9-4225-a3c9-5045b863c183-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"ca3d6543-c2c9-4225-a3c9-5045b863c183\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 13 15:25:04.972073 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:25:04.971958    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ca3d6543-c2c9-4225-a3c9-5045b863c183-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"ca3d6543-c2c9-4225-a3c9-5045b863c183\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 13 15:25:04.972073 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:25:04.971984    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/ca3d6543-c2c9-4225-a3c9-5045b863c183-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"ca3d6543-c2c9-4225-a3c9-5045b863c183\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 13 15:25:04.972073 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:25:04.972011    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-92gg7\" (UniqueName: \"kubernetes.io/projected/ca3d6543-c2c9-4225-a3c9-5045b863c183-kube-api-access-92gg7\") pod \"alertmanager-main-0\" (UID: \"ca3d6543-c2c9-4225-a3c9-5045b863c183\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 13 15:25:04.972073 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:25:04.972031    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/ca3d6543-c2c9-4225-a3c9-5045b863c183-web-config\") pod \"alertmanager-main-0\" (UID: \"ca3d6543-c2c9-4225-a3c9-5045b863c183\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 13 15:25:04.972237 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:25:04.972079    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ca3d6543-c2c9-4225-a3c9-5045b863c183-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"ca3d6543-c2c9-4225-a3c9-5045b863c183\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 13 15:25:04.972237 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:25:04.972164    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/ca3d6543-c2c9-4225-a3c9-5045b863c183-config-out\") pod \"alertmanager-main-0\" (UID: \"ca3d6543-c2c9-4225-a3c9-5045b863c183\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 13 15:25:04.972237 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:25:04.972212    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/ca3d6543-c2c9-4225-a3c9-5045b863c183-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"ca3d6543-c2c9-4225-a3c9-5045b863c183\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 13 15:25:04.972237 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:25:04.972232    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/ca3d6543-c2c9-4225-a3c9-5045b863c183-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"ca3d6543-c2c9-4225-a3c9-5045b863c183\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 13 15:25:04.972350 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:25:04.972310    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/ca3d6543-c2c9-4225-a3c9-5045b863c183-tls-assets\") pod \"alertmanager-main-0\" (UID: \"ca3d6543-c2c9-4225-a3c9-5045b863c183\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 13 15:25:04.972350 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:25:04.972326    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ca3d6543-c2c9-4225-a3c9-5045b863c183-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"ca3d6543-c2c9-4225-a3c9-5045b863c183\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 13 15:25:04.972350 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:25:04.972344    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/ca3d6543-c2c9-4225-a3c9-5045b863c183-config-volume\") pod \"alertmanager-main-0\" (UID: \"ca3d6543-c2c9-4225-a3c9-5045b863c183\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 13 15:25:05.073471 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:25:05.073438    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/ca3d6543-c2c9-4225-a3c9-5045b863c183-tls-assets\") pod \"alertmanager-main-0\" (UID: \"ca3d6543-c2c9-4225-a3c9-5045b863c183\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 13 15:25:05.073471 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:25:05.073476    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ca3d6543-c2c9-4225-a3c9-5045b863c183-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"ca3d6543-c2c9-4225-a3c9-5045b863c183\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 13 15:25:05.073716 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:25:05.073500    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/ca3d6543-c2c9-4225-a3c9-5045b863c183-config-volume\") pod \"alertmanager-main-0\" (UID: \"ca3d6543-c2c9-4225-a3c9-5045b863c183\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 13 15:25:05.073716 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:25:05.073527    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ca3d6543-c2c9-4225-a3c9-5045b863c183-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"ca3d6543-c2c9-4225-a3c9-5045b863c183\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 13 15:25:05.073716 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:25:05.073563    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/ca3d6543-c2c9-4225-a3c9-5045b863c183-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"ca3d6543-c2c9-4225-a3c9-5045b863c183\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 13 15:25:05.073716 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:25:05.073586    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ca3d6543-c2c9-4225-a3c9-5045b863c183-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"ca3d6543-c2c9-4225-a3c9-5045b863c183\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 13 15:25:05.073716 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:25:05.073609    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/ca3d6543-c2c9-4225-a3c9-5045b863c183-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"ca3d6543-c2c9-4225-a3c9-5045b863c183\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 13 15:25:05.073716 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:25:05.073645    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-92gg7\" (UniqueName: \"kubernetes.io/projected/ca3d6543-c2c9-4225-a3c9-5045b863c183-kube-api-access-92gg7\") pod \"alertmanager-main-0\" (UID: \"ca3d6543-c2c9-4225-a3c9-5045b863c183\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 13 15:25:05.073716 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:25:05.073668    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/ca3d6543-c2c9-4225-a3c9-5045b863c183-web-config\") pod \"alertmanager-main-0\" (UID: \"ca3d6543-c2c9-4225-a3c9-5045b863c183\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 13 15:25:05.073716 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:25:05.073706    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ca3d6543-c2c9-4225-a3c9-5045b863c183-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"ca3d6543-c2c9-4225-a3c9-5045b863c183\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 13 15:25:05.074112 ip-10-0-140-255 kubenswrapper[2564]: E0713 15:25:05.073763    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/ca3d6543-c2c9-4225-a3c9-5045b863c183-alertmanager-trusted-ca-bundle podName:ca3d6543-c2c9-4225-a3c9-5045b863c183 nodeName:}" failed. No retries permitted until 2026-07-13 15:25:05.573741662 +0000 UTC m=+59.152976817 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "alertmanager-trusted-ca-bundle" (UniqueName: "kubernetes.io/configmap/ca3d6543-c2c9-4225-a3c9-5045b863c183-alertmanager-trusted-ca-bundle") pod "alertmanager-main-0" (UID: "ca3d6543-c2c9-4225-a3c9-5045b863c183") : configmap references non-existent config key: ca-bundle.crt
Jul 13 15:25:05.074112 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:25:05.073824    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/ca3d6543-c2c9-4225-a3c9-5045b863c183-config-out\") pod \"alertmanager-main-0\" (UID: \"ca3d6543-c2c9-4225-a3c9-5045b863c183\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 13 15:25:05.074112 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:25:05.073923    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/ca3d6543-c2c9-4225-a3c9-5045b863c183-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"ca3d6543-c2c9-4225-a3c9-5045b863c183\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 13 15:25:05.074112 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:25:05.073952    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/ca3d6543-c2c9-4225-a3c9-5045b863c183-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"ca3d6543-c2c9-4225-a3c9-5045b863c183\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 13 15:25:05.074631 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:25:05.074597    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ca3d6543-c2c9-4225-a3c9-5045b863c183-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"ca3d6543-c2c9-4225-a3c9-5045b863c183\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 13 15:25:05.074758 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:25:05.074602    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/ca3d6543-c2c9-4225-a3c9-5045b863c183-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"ca3d6543-c2c9-4225-a3c9-5045b863c183\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 13 15:25:05.076757 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:25:05.076710    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/ca3d6543-c2c9-4225-a3c9-5045b863c183-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"ca3d6543-c2c9-4225-a3c9-5045b863c183\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 13 15:25:05.077232 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:25:05.077204    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/ca3d6543-c2c9-4225-a3c9-5045b863c183-config-out\") pod \"alertmanager-main-0\" (UID: \"ca3d6543-c2c9-4225-a3c9-5045b863c183\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 13 15:25:05.077331 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:25:05.077247    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/ca3d6543-c2c9-4225-a3c9-5045b863c183-config-volume\") pod \"alertmanager-main-0\" (UID: \"ca3d6543-c2c9-4225-a3c9-5045b863c183\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 13 15:25:05.077331 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:25:05.077269    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/ca3d6543-c2c9-4225-a3c9-5045b863c183-tls-assets\") pod \"alertmanager-main-0\" (UID: \"ca3d6543-c2c9-4225-a3c9-5045b863c183\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 13 15:25:05.077445 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:25:05.077336    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ca3d6543-c2c9-4225-a3c9-5045b863c183-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"ca3d6543-c2c9-4225-a3c9-5045b863c183\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 13 15:25:05.077445 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:25:05.077396    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/ca3d6543-c2c9-4225-a3c9-5045b863c183-web-config\") pod \"alertmanager-main-0\" (UID: \"ca3d6543-c2c9-4225-a3c9-5045b863c183\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 13 15:25:05.077546 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:25:05.077521    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ca3d6543-c2c9-4225-a3c9-5045b863c183-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"ca3d6543-c2c9-4225-a3c9-5045b863c183\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 13 15:25:05.077777 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:25:05.077759    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/ca3d6543-c2c9-4225-a3c9-5045b863c183-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"ca3d6543-c2c9-4225-a3c9-5045b863c183\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 13 15:25:05.078815 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:25:05.078795    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/ca3d6543-c2c9-4225-a3c9-5045b863c183-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"ca3d6543-c2c9-4225-a3c9-5045b863c183\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 13 15:25:05.095471 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:25:05.095443    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-92gg7\" (UniqueName: \"kubernetes.io/projected/ca3d6543-c2c9-4225-a3c9-5045b863c183-kube-api-access-92gg7\") pod \"alertmanager-main-0\" (UID: \"ca3d6543-c2c9-4225-a3c9-5045b863c183\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 13 15:25:05.345551 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:25:05.344929    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-xml8d"
Jul 13 15:25:05.379069 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:25:05.379031    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-785778ff74-9nmfd" event={"ID":"36c089c7-2008-444f-bb90-c398b04bd569","Type":"ContainerStarted","Data":"240bf7d7d84da11568b4bc84e70951d72e4dd42b9a232dce62a14a5aad4e093b"}
Jul 13 15:25:05.380380 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:25:05.380348    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-59248" event={"ID":"269be8b3-99be-405a-bbcc-f0c8c65d7a01","Type":"ContainerStarted","Data":"e458d8002f74c7d1f0fa296c0cea6ca1d273cb94858041700c43ca7733e6e9f0"}
Jul 13 15:25:05.579010 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:25:05.578955    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ca3d6543-c2c9-4225-a3c9-5045b863c183-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"ca3d6543-c2c9-4225-a3c9-5045b863c183\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 13 15:25:05.579907 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:25:05.579885    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ca3d6543-c2c9-4225-a3c9-5045b863c183-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"ca3d6543-c2c9-4225-a3c9-5045b863c183\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 13 15:25:05.838363 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:25:05.838323    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 13 15:25:06.244364 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:25:06.244336    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 13 15:25:06.249905 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:25:06.249196    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podca3d6543_c2c9_4225_a3c9_5045b863c183.slice/crio-6c6ce697f5224b83f2e6b4721c179f3fd82656544b43569fe3e5b4da07509852 WatchSource:0}: Error finding container 6c6ce697f5224b83f2e6b4721c179f3fd82656544b43569fe3e5b4da07509852: Status 404 returned error can't find the container with id 6c6ce697f5224b83f2e6b4721c179f3fd82656544b43569fe3e5b4da07509852
Jul 13 15:25:06.387009 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:25:06.386973    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-785778ff74-9nmfd" event={"ID":"36c089c7-2008-444f-bb90-c398b04bd569","Type":"ContainerStarted","Data":"809e2cf85fcc28a3d659060ec2f241152a6f0a1a449cc30b0f11b2efbdedb53c"}
Jul 13 15:25:06.387192 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:25:06.387045    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-785778ff74-9nmfd" event={"ID":"36c089c7-2008-444f-bb90-c398b04bd569","Type":"ContainerStarted","Data":"67b018a485183935de2609048f2231f59c92d032acd235463d1520842fbbff90"}
Jul 13 15:25:06.387192 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:25:06.387079    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-785778ff74-9nmfd" event={"ID":"36c089c7-2008-444f-bb90-c398b04bd569","Type":"ContainerStarted","Data":"eca536411d70df6554fed1bda6ae3ae6251994143c53f7cfcb710e58542f889e"}
Jul 13 15:25:06.388761 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:25:06.388734    2564 generic.go:356] "Generic (PLEG): container finished" podID="269be8b3-99be-405a-bbcc-f0c8c65d7a01" containerID="af1a1d0cab7b3e2f97641deb562f9cb23cca28e27b37693e431d9b4b046c82f2" exitCode=0
Jul 13 15:25:06.388923 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:25:06.388805    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-59248" event={"ID":"269be8b3-99be-405a-bbcc-f0c8c65d7a01","Type":"ContainerDied","Data":"af1a1d0cab7b3e2f97641deb562f9cb23cca28e27b37693e431d9b4b046c82f2"}
Jul 13 15:25:06.390034 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:25:06.390013    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ca3d6543-c2c9-4225-a3c9-5045b863c183","Type":"ContainerStarted","Data":"6c6ce697f5224b83f2e6b4721c179f3fd82656544b43569fe3e5b4da07509852"}
Jul 13 15:25:06.418889 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:25:06.418817    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-785778ff74-9nmfd" podStartSLOduration=2.073898514 podStartE2EDuration="3.418799984s" totalImagesPullingTime="1.34490147s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 15:25:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 15:25:06.418076655 +0000 UTC m=+59.997311862" watchObservedRunningTime="2026-07-13 15:25:06.418799984 +0000 UTC m=+59.998035162"
Jul 13 15:25:07.285587 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:25:07.285551    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-9dq6z"
Jul 13 15:25:07.395135 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:25:07.395101    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-59248" event={"ID":"269be8b3-99be-405a-bbcc-f0c8c65d7a01","Type":"ContainerStarted","Data":"285fc6e28a1ee56314b060f8b95f67e64313ccd8f02f76397b690372260ec20d"}
Jul 13 15:25:07.395271 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:25:07.395162    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-59248" event={"ID":"269be8b3-99be-405a-bbcc-f0c8c65d7a01","Type":"ContainerStarted","Data":"4b80cf2769711ee1cb4d7c62f17aab29d400eed95183d55e98c2cb4e8f36aa62"}
Jul 13 15:25:07.396560 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:25:07.396536    2564 generic.go:356] "Generic (PLEG): container finished" podID="ca3d6543-c2c9-4225-a3c9-5045b863c183" containerID="c73d268bb888bb8696989ca65648d788d3cccfb0b927352a4eef481d62d65a2e" exitCode=0
Jul 13 15:25:07.396662 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:25:07.396613    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ca3d6543-c2c9-4225-a3c9-5045b863c183","Type":"ContainerDied","Data":"c73d268bb888bb8696989ca65648d788d3cccfb0b927352a4eef481d62d65a2e"}
Jul 13 15:25:07.440862 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:25:07.438375    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-59248" podStartSLOduration=2.868316105 podStartE2EDuration="4.438349032s" totalImagesPullingTime="1.478291057s" totalInitContainerRuntime="91.74187ms" isStatefulPod=true podCreationTimestamp="2026-07-13 15:25:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 15:25:07.436723506 +0000 UTC m=+61.015958684" watchObservedRunningTime="2026-07-13 15:25:07.438349032 +0000 UTC m=+61.017584212"
Jul 13 15:25:08.060027 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:25:08.059977    2564 patch_prober.go:28] interesting pod/image-registry-56fb9f5477-z82hh container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Jul 13 15:25:08.060220 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:25:08.060050    2564 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-56fb9f5477-z82hh" podUID="da805e4c-bc0d-461a-a749-f3493be924b8" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 13 15:25:08.371665 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:25:08.371576    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-5f68df7f58-c7nm7"]
Jul 13 15:25:08.373823 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:25:08.373802    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-c7nm7"
Jul 13 15:25:08.376557 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:25:08.376533    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\""
Jul 13 15:25:08.377033 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:25:08.377017    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-8mh9v\""
Jul 13 15:25:08.384583 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:25:08.384550    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-5f68df7f58-c7nm7"]
Jul 13 15:25:08.405602 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:25:08.405569    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/13ed4799-2ed4-44a9-93a5-89dacfe15702-monitoring-plugin-cert\") pod \"monitoring-plugin-5f68df7f58-c7nm7\" (UID: \"13ed4799-2ed4-44a9-93a5-89dacfe15702\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-c7nm7"
Jul 13 15:25:08.405793 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:25:08.405620    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qkg6z\" (UniqueName: \"kubernetes.io/projected/13ed4799-2ed4-44a9-93a5-89dacfe15702-kube-api-access-qkg6z\") pod \"monitoring-plugin-5f68df7f58-c7nm7\" (UID: \"13ed4799-2ed4-44a9-93a5-89dacfe15702\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-c7nm7"
Jul 13 15:25:08.506810 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:25:08.506773    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/13ed4799-2ed4-44a9-93a5-89dacfe15702-monitoring-plugin-cert\") pod \"monitoring-plugin-5f68df7f58-c7nm7\" (UID: \"13ed4799-2ed4-44a9-93a5-89dacfe15702\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-c7nm7"
Jul 13 15:25:08.507021 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:25:08.506831    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qkg6z\" (UniqueName: \"kubernetes.io/projected/13ed4799-2ed4-44a9-93a5-89dacfe15702-kube-api-access-qkg6z\") pod \"monitoring-plugin-5f68df7f58-c7nm7\" (UID: \"13ed4799-2ed4-44a9-93a5-89dacfe15702\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-c7nm7"
Jul 13 15:25:08.507021 ip-10-0-140-255 kubenswrapper[2564]: E0713 15:25:08.506945    2564 secret.go:189] Couldn't get secret openshift-monitoring/monitoring-plugin-cert: secret "monitoring-plugin-cert" not found
Jul 13 15:25:08.507021 ip-10-0-140-255 kubenswrapper[2564]: E0713 15:25:08.507013    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/13ed4799-2ed4-44a9-93a5-89dacfe15702-monitoring-plugin-cert podName:13ed4799-2ed4-44a9-93a5-89dacfe15702 nodeName:}" failed. No retries permitted until 2026-07-13 15:25:09.006992109 +0000 UTC m=+62.586227270 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "monitoring-plugin-cert" (UniqueName: "kubernetes.io/secret/13ed4799-2ed4-44a9-93a5-89dacfe15702-monitoring-plugin-cert") pod "monitoring-plugin-5f68df7f58-c7nm7" (UID: "13ed4799-2ed4-44a9-93a5-89dacfe15702") : secret "monitoring-plugin-cert" not found
Jul 13 15:25:08.518460 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:25:08.518426    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qkg6z\" (UniqueName: \"kubernetes.io/projected/13ed4799-2ed4-44a9-93a5-89dacfe15702-kube-api-access-qkg6z\") pod \"monitoring-plugin-5f68df7f58-c7nm7\" (UID: \"13ed4799-2ed4-44a9-93a5-89dacfe15702\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-c7nm7"
Jul 13 15:25:08.849376 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:25:08.849341    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-68fbd76bb6-d8pmc"]
Jul 13 15:25:08.852736 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:25:08.852706    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-68fbd76bb6-d8pmc"
Jul 13 15:25:08.856256 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:25:08.856232    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\""
Jul 13 15:25:08.856573 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:25:08.856553    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\""
Jul 13 15:25:08.856819 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:25:08.856793    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\""
Jul 13 15:25:08.856922 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:25:08.856882    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-hnh54\""
Jul 13 15:25:08.856998 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:25:08.856936    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\""
Jul 13 15:25:08.857058 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:25:08.857025    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\""
Jul 13 15:25:08.863912 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:25:08.863850    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\""
Jul 13 15:25:08.866930 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:25:08.866898    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-68fbd76bb6-d8pmc"]
Jul 13 15:25:08.911315 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:25:08.911264    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6fkgw\" (UniqueName: \"kubernetes.io/projected/997a6543-33f9-4f8c-a8e8-9f625137038f-kube-api-access-6fkgw\") pod \"telemeter-client-68fbd76bb6-d8pmc\" (UID: \"997a6543-33f9-4f8c-a8e8-9f625137038f\") " pod="openshift-monitoring/telemeter-client-68fbd76bb6-d8pmc"
Jul 13 15:25:08.911507 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:25:08.911325    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/997a6543-33f9-4f8c-a8e8-9f625137038f-serving-certs-ca-bundle\") pod \"telemeter-client-68fbd76bb6-d8pmc\" (UID: \"997a6543-33f9-4f8c-a8e8-9f625137038f\") " pod="openshift-monitoring/telemeter-client-68fbd76bb6-d8pmc"
Jul 13 15:25:08.911507 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:25:08.911419    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/997a6543-33f9-4f8c-a8e8-9f625137038f-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-68fbd76bb6-d8pmc\" (UID: \"997a6543-33f9-4f8c-a8e8-9f625137038f\") " pod="openshift-monitoring/telemeter-client-68fbd76bb6-d8pmc"
Jul 13 15:25:08.911604 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:25:08.911530    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/997a6543-33f9-4f8c-a8e8-9f625137038f-telemeter-client-tls\") pod \"telemeter-client-68fbd76bb6-d8pmc\" (UID: \"997a6543-33f9-4f8c-a8e8-9f625137038f\") " pod="openshift-monitoring/telemeter-client-68fbd76bb6-d8pmc"
Jul 13 15:25:08.911604 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:25:08.911569    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/997a6543-33f9-4f8c-a8e8-9f625137038f-federate-client-tls\") pod \"telemeter-client-68fbd76bb6-d8pmc\" (UID: \"997a6543-33f9-4f8c-a8e8-9f625137038f\") " pod="openshift-monitoring/telemeter-client-68fbd76bb6-d8pmc"
Jul 13 15:25:08.911688 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:25:08.911607    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/997a6543-33f9-4f8c-a8e8-9f625137038f-metrics-client-ca\") pod \"telemeter-client-68fbd76bb6-d8pmc\" (UID: \"997a6543-33f9-4f8c-a8e8-9f625137038f\") " pod="openshift-monitoring/telemeter-client-68fbd76bb6-d8pmc"
Jul 13 15:25:08.911688 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:25:08.911667    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/997a6543-33f9-4f8c-a8e8-9f625137038f-telemeter-trusted-ca-bundle\") pod \"telemeter-client-68fbd76bb6-d8pmc\" (UID: \"997a6543-33f9-4f8c-a8e8-9f625137038f\") " pod="openshift-monitoring/telemeter-client-68fbd76bb6-d8pmc"
Jul 13 15:25:08.911779 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:25:08.911721    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/997a6543-33f9-4f8c-a8e8-9f625137038f-secret-telemeter-client\") pod \"telemeter-client-68fbd76bb6-d8pmc\" (UID: \"997a6543-33f9-4f8c-a8e8-9f625137038f\") " pod="openshift-monitoring/telemeter-client-68fbd76bb6-d8pmc"
Jul 13 15:25:09.012404 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:25:09.012361    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/997a6543-33f9-4f8c-a8e8-9f625137038f-metrics-client-ca\") pod \"telemeter-client-68fbd76bb6-d8pmc\" (UID: \"997a6543-33f9-4f8c-a8e8-9f625137038f\") " pod="openshift-monitoring/telemeter-client-68fbd76bb6-d8pmc"
Jul 13 15:25:09.012574 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:25:09.012496    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/997a6543-33f9-4f8c-a8e8-9f625137038f-telemeter-trusted-ca-bundle\") pod \"telemeter-client-68fbd76bb6-d8pmc\" (UID: \"997a6543-33f9-4f8c-a8e8-9f625137038f\") " pod="openshift-monitoring/telemeter-client-68fbd76bb6-d8pmc"
Jul 13 15:25:09.012574 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:25:09.012538    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/13ed4799-2ed4-44a9-93a5-89dacfe15702-monitoring-plugin-cert\") pod \"monitoring-plugin-5f68df7f58-c7nm7\" (UID: \"13ed4799-2ed4-44a9-93a5-89dacfe15702\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-c7nm7"
Jul 13 15:25:09.012710 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:25:09.012605    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/997a6543-33f9-4f8c-a8e8-9f625137038f-secret-telemeter-client\") pod \"telemeter-client-68fbd76bb6-d8pmc\" (UID: \"997a6543-33f9-4f8c-a8e8-9f625137038f\") " pod="openshift-monitoring/telemeter-client-68fbd76bb6-d8pmc"
Jul 13 15:25:09.012710 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:25:09.012652    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6fkgw\" (UniqueName: \"kubernetes.io/projected/997a6543-33f9-4f8c-a8e8-9f625137038f-kube-api-access-6fkgw\") pod \"telemeter-client-68fbd76bb6-d8pmc\" (UID: \"997a6543-33f9-4f8c-a8e8-9f625137038f\") " pod="openshift-monitoring/telemeter-client-68fbd76bb6-d8pmc"
Jul 13 15:25:09.012710 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:25:09.012681    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/997a6543-33f9-4f8c-a8e8-9f625137038f-serving-certs-ca-bundle\") pod \"telemeter-client-68fbd76bb6-d8pmc\" (UID: \"997a6543-33f9-4f8c-a8e8-9f625137038f\") " pod="openshift-monitoring/telemeter-client-68fbd76bb6-d8pmc"
Jul 13 15:25:09.012851 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:25:09.012712    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/997a6543-33f9-4f8c-a8e8-9f625137038f-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-68fbd76bb6-d8pmc\" (UID: \"997a6543-33f9-4f8c-a8e8-9f625137038f\") " pod="openshift-monitoring/telemeter-client-68fbd76bb6-d8pmc"
Jul 13 15:25:09.012851 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:25:09.012764    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/997a6543-33f9-4f8c-a8e8-9f625137038f-telemeter-client-tls\") pod \"telemeter-client-68fbd76bb6-d8pmc\" (UID: \"997a6543-33f9-4f8c-a8e8-9f625137038f\") " pod="openshift-monitoring/telemeter-client-68fbd76bb6-d8pmc"
Jul 13 15:25:09.012851 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:25:09.012806    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/997a6543-33f9-4f8c-a8e8-9f625137038f-federate-client-tls\") pod \"telemeter-client-68fbd76bb6-d8pmc\" (UID: \"997a6543-33f9-4f8c-a8e8-9f625137038f\") " pod="openshift-monitoring/telemeter-client-68fbd76bb6-d8pmc"
Jul 13 15:25:09.013825 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:25:09.013770    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/997a6543-33f9-4f8c-a8e8-9f625137038f-telemeter-trusted-ca-bundle\") pod \"telemeter-client-68fbd76bb6-d8pmc\" (UID: \"997a6543-33f9-4f8c-a8e8-9f625137038f\") " pod="openshift-monitoring/telemeter-client-68fbd76bb6-d8pmc"
Jul 13 15:25:09.013825 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:25:09.013809    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/997a6543-33f9-4f8c-a8e8-9f625137038f-serving-certs-ca-bundle\") pod \"telemeter-client-68fbd76bb6-d8pmc\" (UID: \"997a6543-33f9-4f8c-a8e8-9f625137038f\") " pod="openshift-monitoring/telemeter-client-68fbd76bb6-d8pmc"
Jul 13 15:25:09.014447 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:25:09.014426    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/997a6543-33f9-4f8c-a8e8-9f625137038f-metrics-client-ca\") pod \"telemeter-client-68fbd76bb6-d8pmc\" (UID: \"997a6543-33f9-4f8c-a8e8-9f625137038f\") " pod="openshift-monitoring/telemeter-client-68fbd76bb6-d8pmc"
Jul 13 15:25:09.015814 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:25:09.015783    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/997a6543-33f9-4f8c-a8e8-9f625137038f-secret-telemeter-client\") pod \"telemeter-client-68fbd76bb6-d8pmc\" (UID: \"997a6543-33f9-4f8c-a8e8-9f625137038f\") " pod="openshift-monitoring/telemeter-client-68fbd76bb6-d8pmc"
Jul 13 15:25:09.016112 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:25:09.016047    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/997a6543-33f9-4f8c-a8e8-9f625137038f-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-68fbd76bb6-d8pmc\" (UID: \"997a6543-33f9-4f8c-a8e8-9f625137038f\") " pod="openshift-monitoring/telemeter-client-68fbd76bb6-d8pmc"
Jul 13 15:25:09.016112 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:25:09.016075    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/997a6543-33f9-4f8c-a8e8-9f625137038f-telemeter-client-tls\") pod \"telemeter-client-68fbd76bb6-d8pmc\" (UID: \"997a6543-33f9-4f8c-a8e8-9f625137038f\") " pod="openshift-monitoring/telemeter-client-68fbd76bb6-d8pmc"
Jul 13 15:25:09.016472 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:25:09.016448    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/997a6543-33f9-4f8c-a8e8-9f625137038f-federate-client-tls\") pod \"telemeter-client-68fbd76bb6-d8pmc\" (UID: \"997a6543-33f9-4f8c-a8e8-9f625137038f\") " pod="openshift-monitoring/telemeter-client-68fbd76bb6-d8pmc"
Jul 13 15:25:09.016547 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:25:09.016488    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/13ed4799-2ed4-44a9-93a5-89dacfe15702-monitoring-plugin-cert\") pod \"monitoring-plugin-5f68df7f58-c7nm7\" (UID: \"13ed4799-2ed4-44a9-93a5-89dacfe15702\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-c7nm7"
Jul 13 15:25:09.022327 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:25:09.022303    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6fkgw\" (UniqueName: \"kubernetes.io/projected/997a6543-33f9-4f8c-a8e8-9f625137038f-kube-api-access-6fkgw\") pod \"telemeter-client-68fbd76bb6-d8pmc\" (UID: \"997a6543-33f9-4f8c-a8e8-9f625137038f\") " pod="openshift-monitoring/telemeter-client-68fbd76bb6-d8pmc"
Jul 13 15:25:09.164815 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:25:09.164795    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-68fbd76bb6-d8pmc"
Jul 13 15:25:09.283300 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:25:09.283065    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-c7nm7"
Jul 13 15:25:09.336954 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:25:09.336900    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-68fbd76bb6-d8pmc"]
Jul 13 15:25:09.340431 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:25:09.340405    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod997a6543_33f9_4f8c_a8e8_9f625137038f.slice/crio-19069ff7c05fa66091ad5e4fbefeaa4a2613f8ddb5eb77d3aaab81694598cc04 WatchSource:0}: Error finding container 19069ff7c05fa66091ad5e4fbefeaa4a2613f8ddb5eb77d3aaab81694598cc04: Status 404 returned error can't find the container with id 19069ff7c05fa66091ad5e4fbefeaa4a2613f8ddb5eb77d3aaab81694598cc04
Jul 13 15:25:09.407326 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:25:09.407279    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ca3d6543-c2c9-4225-a3c9-5045b863c183","Type":"ContainerStarted","Data":"76aaf49caf8f5ff584f1d6691ee89db3f478b670690895b4c167520a1837f773"}
Jul 13 15:25:09.407693 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:25:09.407370    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ca3d6543-c2c9-4225-a3c9-5045b863c183","Type":"ContainerStarted","Data":"04fcdb54ded9e2a852acc1aecabf8cb6182234940b37388ac554c0eda0ad5195"}
Jul 13 15:25:09.407693 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:25:09.407411    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ca3d6543-c2c9-4225-a3c9-5045b863c183","Type":"ContainerStarted","Data":"fa797379cfc0d78fc0e3b1a5fd919cc9dc8d5b06aceb2b51db3d2b2fb70ebeaa"}
Jul 13 15:25:09.407693 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:25:09.407451    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ca3d6543-c2c9-4225-a3c9-5045b863c183","Type":"ContainerStarted","Data":"bf6657065cf582d5d815415fc7fd22e42a26a89aa9b95b0eb6dabc478c946a0e"}
Jul 13 15:25:09.407693 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:25:09.407483    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ca3d6543-c2c9-4225-a3c9-5045b863c183","Type":"ContainerStarted","Data":"331faf227a152ad724de7e5ec8bbf7c7a89194a4dfa51e04bcf0d2dcde452046"}
Jul 13 15:25:09.408547 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:25:09.408509    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-68fbd76bb6-d8pmc" event={"ID":"997a6543-33f9-4f8c-a8e8-9f625137038f","Type":"ContainerStarted","Data":"19069ff7c05fa66091ad5e4fbefeaa4a2613f8ddb5eb77d3aaab81694598cc04"}
Jul 13 15:25:09.440470 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:25:09.440438    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-5f68df7f58-c7nm7"]
Jul 13 15:25:09.444349 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:25:09.444325    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod13ed4799_2ed4_44a9_93a5_89dacfe15702.slice/crio-d73754a80988693b0e18cfb9a63870143d8a2492bd685a79727fd6790276fdfe WatchSource:0}: Error finding container d73754a80988693b0e18cfb9a63870143d8a2492bd685a79727fd6790276fdfe: Status 404 returned error can't find the container with id d73754a80988693b0e18cfb9a63870143d8a2492bd685a79727fd6790276fdfe
Jul 13 15:25:09.722620 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:25:09.722540    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-79bd5f85c7-9brqt"]
Jul 13 15:25:09.725263 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:25:09.725244    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-79bd5f85c7-9brqt"
Jul 13 15:25:09.727801 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:25:09.727760    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Jul 13 15:25:09.727801 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:25:09.727761    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Jul 13 15:25:09.727801 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:25:09.727790    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Jul 13 15:25:09.728104 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:25:09.727848    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Jul 13 15:25:09.728104 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:25:09.727984    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Jul 13 15:25:09.728631 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:25:09.728609    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Jul 13 15:25:09.728727 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:25:09.728612    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-mgdfp\""
Jul 13 15:25:09.728727 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:25:09.728686    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Jul 13 15:25:09.733518 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:25:09.733492    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Jul 13 15:25:09.738454 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:25:09.738427    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-79bd5f85c7-9brqt"]
Jul 13 15:25:09.821293 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:25:09.821255    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4868d58a-76b3-4dfb-84aa-b984553701b2-console-serving-cert\") pod \"console-79bd5f85c7-9brqt\" (UID: \"4868d58a-76b3-4dfb-84aa-b984553701b2\") " pod="openshift-console/console-79bd5f85c7-9brqt"
Jul 13 15:25:09.821293 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:25:09.821294    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4868d58a-76b3-4dfb-84aa-b984553701b2-trusted-ca-bundle\") pod \"console-79bd5f85c7-9brqt\" (UID: \"4868d58a-76b3-4dfb-84aa-b984553701b2\") " pod="openshift-console/console-79bd5f85c7-9brqt"
Jul 13 15:25:09.821515 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:25:09.821314    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4qhn6\" (UniqueName: \"kubernetes.io/projected/4868d58a-76b3-4dfb-84aa-b984553701b2-kube-api-access-4qhn6\") pod \"console-79bd5f85c7-9brqt\" (UID: \"4868d58a-76b3-4dfb-84aa-b984553701b2\") " pod="openshift-console/console-79bd5f85c7-9brqt"
Jul 13 15:25:09.821515 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:25:09.821480    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4868d58a-76b3-4dfb-84aa-b984553701b2-oauth-serving-cert\") pod \"console-79bd5f85c7-9brqt\" (UID: \"4868d58a-76b3-4dfb-84aa-b984553701b2\") " pod="openshift-console/console-79bd5f85c7-9brqt"
Jul 13 15:25:09.821627 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:25:09.821527    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4868d58a-76b3-4dfb-84aa-b984553701b2-console-oauth-config\") pod \"console-79bd5f85c7-9brqt\" (UID: \"4868d58a-76b3-4dfb-84aa-b984553701b2\") " pod="openshift-console/console-79bd5f85c7-9brqt"
Jul 13 15:25:09.821627 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:25:09.821565    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4868d58a-76b3-4dfb-84aa-b984553701b2-console-config\") pod \"console-79bd5f85c7-9brqt\" (UID: \"4868d58a-76b3-4dfb-84aa-b984553701b2\") " pod="openshift-console/console-79bd5f85c7-9brqt"
Jul 13 15:25:09.821627 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:25:09.821609    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4868d58a-76b3-4dfb-84aa-b984553701b2-service-ca\") pod \"console-79bd5f85c7-9brqt\" (UID: \"4868d58a-76b3-4dfb-84aa-b984553701b2\") " pod="openshift-console/console-79bd5f85c7-9brqt"
Jul 13 15:25:09.922435 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:25:09.922391    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4868d58a-76b3-4dfb-84aa-b984553701b2-console-serving-cert\") pod \"console-79bd5f85c7-9brqt\" (UID: \"4868d58a-76b3-4dfb-84aa-b984553701b2\") " pod="openshift-console/console-79bd5f85c7-9brqt"
Jul 13 15:25:09.922435 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:25:09.922435    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4868d58a-76b3-4dfb-84aa-b984553701b2-trusted-ca-bundle\") pod \"console-79bd5f85c7-9brqt\" (UID: \"4868d58a-76b3-4dfb-84aa-b984553701b2\") " pod="openshift-console/console-79bd5f85c7-9brqt"
Jul 13 15:25:09.922698 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:25:09.922454    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4qhn6\" (UniqueName: \"kubernetes.io/projected/4868d58a-76b3-4dfb-84aa-b984553701b2-kube-api-access-4qhn6\") pod \"console-79bd5f85c7-9brqt\" (UID: \"4868d58a-76b3-4dfb-84aa-b984553701b2\") " pod="openshift-console/console-79bd5f85c7-9brqt"
Jul 13 15:25:09.922698 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:25:09.922503    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4868d58a-76b3-4dfb-84aa-b984553701b2-oauth-serving-cert\") pod \"console-79bd5f85c7-9brqt\" (UID: \"4868d58a-76b3-4dfb-84aa-b984553701b2\") " pod="openshift-console/console-79bd5f85c7-9brqt"
Jul 13 15:25:09.922698 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:25:09.922627    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4868d58a-76b3-4dfb-84aa-b984553701b2-console-oauth-config\") pod \"console-79bd5f85c7-9brqt\" (UID: \"4868d58a-76b3-4dfb-84aa-b984553701b2\") " pod="openshift-console/console-79bd5f85c7-9brqt"
Jul 13 15:25:09.922698 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:25:09.922662    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4868d58a-76b3-4dfb-84aa-b984553701b2-console-config\") pod \"console-79bd5f85c7-9brqt\" (UID: \"4868d58a-76b3-4dfb-84aa-b984553701b2\") " pod="openshift-console/console-79bd5f85c7-9brqt"
Jul 13 15:25:09.922698 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:25:09.922688    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4868d58a-76b3-4dfb-84aa-b984553701b2-service-ca\") pod \"console-79bd5f85c7-9brqt\" (UID: \"4868d58a-76b3-4dfb-84aa-b984553701b2\") " pod="openshift-console/console-79bd5f85c7-9brqt"
Jul 13 15:25:09.923312 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:25:09.923292    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4868d58a-76b3-4dfb-84aa-b984553701b2-oauth-serving-cert\") pod \"console-79bd5f85c7-9brqt\" (UID: \"4868d58a-76b3-4dfb-84aa-b984553701b2\") " pod="openshift-console/console-79bd5f85c7-9brqt"
Jul 13 15:25:09.923464 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:25:09.923442    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4868d58a-76b3-4dfb-84aa-b984553701b2-service-ca\") pod \"console-79bd5f85c7-9brqt\" (UID: \"4868d58a-76b3-4dfb-84aa-b984553701b2\") " pod="openshift-console/console-79bd5f85c7-9brqt"
Jul 13 15:25:09.923535 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:25:09.923466    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4868d58a-76b3-4dfb-84aa-b984553701b2-console-config\") pod \"console-79bd5f85c7-9brqt\" (UID: \"4868d58a-76b3-4dfb-84aa-b984553701b2\") " pod="openshift-console/console-79bd5f85c7-9brqt"
Jul 13 15:25:09.923535 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:25:09.923515    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4868d58a-76b3-4dfb-84aa-b984553701b2-trusted-ca-bundle\") pod \"console-79bd5f85c7-9brqt\" (UID: \"4868d58a-76b3-4dfb-84aa-b984553701b2\") " pod="openshift-console/console-79bd5f85c7-9brqt"
Jul 13 15:25:09.925125 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:25:09.925096    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4868d58a-76b3-4dfb-84aa-b984553701b2-console-serving-cert\") pod \"console-79bd5f85c7-9brqt\" (UID: \"4868d58a-76b3-4dfb-84aa-b984553701b2\") " pod="openshift-console/console-79bd5f85c7-9brqt"
Jul 13 15:25:09.925125 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:25:09.925110    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4868d58a-76b3-4dfb-84aa-b984553701b2-console-oauth-config\") pod \"console-79bd5f85c7-9brqt\" (UID: \"4868d58a-76b3-4dfb-84aa-b984553701b2\") " pod="openshift-console/console-79bd5f85c7-9brqt"
Jul 13 15:25:09.935290 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:25:09.935265    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4qhn6\" (UniqueName: \"kubernetes.io/projected/4868d58a-76b3-4dfb-84aa-b984553701b2-kube-api-access-4qhn6\") pod \"console-79bd5f85c7-9brqt\" (UID: \"4868d58a-76b3-4dfb-84aa-b984553701b2\") " pod="openshift-console/console-79bd5f85c7-9brqt"
Jul 13 15:25:10.035068 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:25:10.034984    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-79bd5f85c7-9brqt"
Jul 13 15:25:10.197544 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:25:10.197518    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-79bd5f85c7-9brqt"]
Jul 13 15:25:10.200306 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:25:10.200277    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4868d58a_76b3_4dfb_84aa_b984553701b2.slice/crio-f934d6e37a717d318564d84f1cc228fb32d2da9313a798d26ed4217d58cb4caa WatchSource:0}: Error finding container f934d6e37a717d318564d84f1cc228fb32d2da9313a798d26ed4217d58cb4caa: Status 404 returned error can't find the container with id f934d6e37a717d318564d84f1cc228fb32d2da9313a798d26ed4217d58cb4caa
Jul 13 15:25:10.327079 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:25:10.326345    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-56fb9f5477-z82hh"
Jul 13 15:25:10.417018 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:25:10.416519    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-c7nm7" event={"ID":"13ed4799-2ed4-44a9-93a5-89dacfe15702","Type":"ContainerStarted","Data":"d73754a80988693b0e18cfb9a63870143d8a2492bd685a79727fd6790276fdfe"}
Jul 13 15:25:10.418345 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:25:10.418273    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-79bd5f85c7-9brqt" event={"ID":"4868d58a-76b3-4dfb-84aa-b984553701b2","Type":"ContainerStarted","Data":"f934d6e37a717d318564d84f1cc228fb32d2da9313a798d26ed4217d58cb4caa"}
Jul 13 15:25:11.425996 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:25:11.425954    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ca3d6543-c2c9-4225-a3c9-5045b863c183","Type":"ContainerStarted","Data":"c5676721fde29e669bb5469d2847f8318ee4e9aa4243760afcfc153a49f285b9"}
Jul 13 15:25:12.648412 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:25:12.648375    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/84c5054b-6b5c-4b21-992a-cbd68bf1b4f2-original-pull-secret\") pod \"global-pull-secret-syncer-75h9t\" (UID: \"84c5054b-6b5c-4b21-992a-cbd68bf1b4f2\") " pod="kube-system/global-pull-secret-syncer-75h9t"
Jul 13 15:25:12.651768 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:25:12.651742    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 13 15:25:12.661842 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:25:12.661812    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/84c5054b-6b5c-4b21-992a-cbd68bf1b4f2-original-pull-secret\") pod \"global-pull-secret-syncer-75h9t\" (UID: \"84c5054b-6b5c-4b21-992a-cbd68bf1b4f2\") " pod="kube-system/global-pull-secret-syncer-75h9t"
Jul 13 15:25:12.726647 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:25:12.726613    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-75h9t"
Jul 13 15:25:12.749787 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:25:12.749752    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d9flx\" (UniqueName: \"kubernetes.io/projected/38555aab-29b1-4bdf-b689-069e8fe6712c-kube-api-access-d9flx\") pod \"network-check-target-7qzb8\" (UID: \"38555aab-29b1-4bdf-b689-069e8fe6712c\") " pod="openshift-network-diagnostics/network-check-target-7qzb8"
Jul 13 15:25:12.749954 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:25:12.749856    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9c040000-a5ce-49b2-b7a8-6faedac4708f-metrics-certs\") pod \"network-metrics-daemon-8whd7\" (UID: \"9c040000-a5ce-49b2-b7a8-6faedac4708f\") " pod="openshift-multus/network-metrics-daemon-8whd7"
Jul 13 15:25:12.752811 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:25:12.752780    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 13 15:25:12.752958 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:25:12.752814    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 13 15:25:12.763480 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:25:12.763455    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9c040000-a5ce-49b2-b7a8-6faedac4708f-metrics-certs\") pod \"network-metrics-daemon-8whd7\" (UID: \"9c040000-a5ce-49b2-b7a8-6faedac4708f\") " pod="openshift-multus/network-metrics-daemon-8whd7"
Jul 13 15:25:12.763610 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:25:12.763482    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 13 15:25:12.774433 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:25:12.774404    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d9flx\" (UniqueName: \"kubernetes.io/projected/38555aab-29b1-4bdf-b689-069e8fe6712c-kube-api-access-d9flx\") pod \"network-check-target-7qzb8\" (UID: \"38555aab-29b1-4bdf-b689-069e8fe6712c\") " pod="openshift-network-diagnostics/network-check-target-7qzb8"
Jul 13 15:25:13.036974 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:25:13.036889    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-489nl\""
Jul 13 15:25:13.045027 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:25:13.044996    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7qzb8"
Jul 13 15:25:13.045859 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:25:13.045834    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-hbtnc\""
Jul 13 15:25:13.051809 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:25:13.051782    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8whd7"
Jul 13 15:25:13.414154 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:25:13.412987    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=5.528281883 podStartE2EDuration="9.412963958s" totalImagesPullingTime="3.86751652s" totalInitContainerRuntime="17.165555ms" isStatefulPod=false podCreationTimestamp="2026-07-13 15:25:04 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 15:25:11.467621559 +0000 UTC m=+65.046856775" watchObservedRunningTime="2026-07-13 15:25:13.412963958 +0000 UTC m=+66.992199137"
Jul 13 15:25:13.415616 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:25:13.415563    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-8whd7"]
Jul 13 15:25:13.436677 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:25:13.436638    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-c7nm7" event={"ID":"13ed4799-2ed4-44a9-93a5-89dacfe15702","Type":"ContainerStarted","Data":"19999960a7a57cdb132927b79a5c867d0f3d3cc46b3e4cc23c4eee963557378e"}
Jul 13 15:25:13.439484 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:25:13.439394    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-79bd5f85c7-9brqt" event={"ID":"4868d58a-76b3-4dfb-84aa-b984553701b2","Type":"ContainerStarted","Data":"e3865d12e5bfe34e35ce3e576713697ec76839ead3719d9e864a2005dc06aec5"}
Jul 13 15:25:13.442299 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:25:13.442278    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-7qzb8"]
Jul 13 15:25:13.448770 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:25:13.448737    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-68fbd76bb6-d8pmc" event={"ID":"997a6543-33f9-4f8c-a8e8-9f625137038f","Type":"ContainerStarted","Data":"004cfe05dd8dcacfe5c87fd88e147cdc66d0983a3989017f7da51193b35442ce"}
Jul 13 15:25:13.450522 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:25:13.450496    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-8whd7" event={"ID":"9c040000-a5ce-49b2-b7a8-6faedac4708f","Type":"ContainerStarted","Data":"14cc7ba26c95a928fb161c8807269e90f09a87b19e0ccdcc18a4dcbf5cc385d1"}
Jul 13 15:25:13.459642 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:25:13.459602    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-c7nm7" podStartSLOduration=1.68299772 podStartE2EDuration="5.45958627s" totalImagesPullingTime="3.77658855s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 15:25:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 15:25:13.458160147 +0000 UTC m=+67.037395352" watchObservedRunningTime="2026-07-13 15:25:13.45958627 +0000 UTC m=+67.038821447"
Jul 13 15:25:13.480589 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:25:13.480534    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-79bd5f85c7-9brqt" podStartSLOduration=1.423845754 podStartE2EDuration="4.480515331s" totalImagesPullingTime="3.056669577s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 15:25:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 15:25:13.479913991 +0000 UTC m=+67.059149192" watchObservedRunningTime="2026-07-13 15:25:13.480515331 +0000 UTC m=+67.059750579"
Jul 13 15:25:13.645284 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:25:13.645245    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-75h9t"]
Jul 13 15:25:13.648628 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:25:13.648596    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod84c5054b_6b5c_4b21_992a_cbd68bf1b4f2.slice/crio-eef19110b41c81d9e670525b2fd83ce6410a0165b1c7b4af3a953c41d7bf211c WatchSource:0}: Error finding container eef19110b41c81d9e670525b2fd83ce6410a0165b1c7b4af3a953c41d7bf211c: Status 404 returned error can't find the container with id eef19110b41c81d9e670525b2fd83ce6410a0165b1c7b4af3a953c41d7bf211c
Jul 13 15:25:14.455635 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:25:14.455598    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-7qzb8" event={"ID":"38555aab-29b1-4bdf-b689-069e8fe6712c","Type":"ContainerStarted","Data":"9127ac0f1371903b75718f142bc70dfe2f3490a91fbd37a6d309c35c23bee767"}
Jul 13 15:25:14.458089 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:25:14.458060    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-68fbd76bb6-d8pmc" event={"ID":"997a6543-33f9-4f8c-a8e8-9f625137038f","Type":"ContainerStarted","Data":"55a5cee7e496083ee7dc48f7ecef7bd5ba9649921f71719c7e39a6a5f79b3ffb"}
Jul 13 15:25:14.458226 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:25:14.458116    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-68fbd76bb6-d8pmc" event={"ID":"997a6543-33f9-4f8c-a8e8-9f625137038f","Type":"ContainerStarted","Data":"2bb4adfb409bd6bac400ff471877a11ff6722a03a21f491433418c3612f6bf2c"}
Jul 13 15:25:14.459353 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:25:14.459323    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-75h9t" event={"ID":"84c5054b-6b5c-4b21-992a-cbd68bf1b4f2","Type":"ContainerStarted","Data":"eef19110b41c81d9e670525b2fd83ce6410a0165b1c7b4af3a953c41d7bf211c"}
Jul 13 15:25:14.460030 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:25:14.459739    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-c7nm7"
Jul 13 15:25:14.465728 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:25:14.465682    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-c7nm7"
Jul 13 15:25:14.492550 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:25:14.492497    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-68fbd76bb6-d8pmc" podStartSLOduration=2.612854429 podStartE2EDuration="6.49247801s" totalImagesPullingTime="3.879623581s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 15:25:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 15:25:14.49144027 +0000 UTC m=+68.070675466" watchObservedRunningTime="2026-07-13 15:25:14.49247801 +0000 UTC m=+68.071713187"
Jul 13 15:25:15.466083 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:25:15.466044    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-8whd7" event={"ID":"9c040000-a5ce-49b2-b7a8-6faedac4708f","Type":"ContainerStarted","Data":"c59c8e53de6263c3eafe910534bdeb1911a2c7ae62216af2fc55a7311d18657b"}
Jul 13 15:25:15.466548 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:25:15.466109    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-8whd7" event={"ID":"9c040000-a5ce-49b2-b7a8-6faedac4708f","Type":"ContainerStarted","Data":"fd803d71c87cdcfae6f020a38f9d49cb5a724d93fff972c3077bee8d0c28b017"}
Jul 13 15:25:15.486490 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:25:15.486430    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-8whd7" podStartSLOduration=67.521640293 podStartE2EDuration="1m8.486406974s" totalImagesPullingTime="964.766681ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 15:24:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 15:25:15.486088413 +0000 UTC m=+69.065323611" watchObservedRunningTime="2026-07-13 15:25:15.486406974 +0000 UTC m=+69.065642156"
Jul 13 15:25:17.478663 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:25:17.478621    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-7qzb8" event={"ID":"38555aab-29b1-4bdf-b689-069e8fe6712c","Type":"ContainerStarted","Data":"7a06ce276f12a8e7ab8cde65bf9af1752db8091f2ceb9f1d2563f3e797fc44cd"}
Jul 13 15:25:17.479171 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:25:17.478777    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-7qzb8"
Jul 13 15:25:17.498803 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:25:17.498739    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-7qzb8" podStartSLOduration=67.393630555 podStartE2EDuration="1m10.498716465s" totalImagesPullingTime="3.10508591s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 15:24:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 15:25:17.497694278 +0000 UTC m=+71.076929473" watchObservedRunningTime="2026-07-13 15:25:17.498716465 +0000 UTC m=+71.077951645"
Jul 13 15:25:18.484990 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:25:18.484946    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-75h9t" event={"ID":"84c5054b-6b5c-4b21-992a-cbd68bf1b4f2","Type":"ContainerStarted","Data":"6dc3f02995a58a55a988dc216167945d94bed0337f8ffac0b4107b96c6c79050"}
Jul 13 15:25:18.501327 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:25:18.501275    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-75h9t" podStartSLOduration=66.857352233 podStartE2EDuration="1m11.501258718s" totalImagesPullingTime="4.643906485s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-13 15:24:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 15:25:18.500893006 +0000 UTC m=+72.080128197" watchObservedRunningTime="2026-07-13 15:25:18.501258718 +0000 UTC m=+72.080493921"
Jul 13 15:25:19.057939 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:25:19.057905    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-79bd5f85c7-9brqt"]
Jul 13 15:25:20.036130 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:25:20.036098    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-79bd5f85c7-9brqt"
Jul 13 15:25:44.078380 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:25:44.078309    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-79bd5f85c7-9brqt" podUID="4868d58a-76b3-4dfb-84aa-b984553701b2" containerName="console" containerID="cri-o://e3865d12e5bfe34e35ce3e576713697ec76839ead3719d9e864a2005dc06aec5" gracePeriod=15
Jul 13 15:25:44.324620 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:25:44.324594    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-79bd5f85c7-9brqt"
Jul 13 15:25:44.402960 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:25:44.402931    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4868d58a-76b3-4dfb-84aa-b984553701b2-console-oauth-config\") pod \"4868d58a-76b3-4dfb-84aa-b984553701b2\" (UID: \"4868d58a-76b3-4dfb-84aa-b984553701b2\") "
Jul 13 15:25:44.403152 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:25:44.402969    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4qhn6\" (UniqueName: \"kubernetes.io/projected/4868d58a-76b3-4dfb-84aa-b984553701b2-kube-api-access-4qhn6\") pod \"4868d58a-76b3-4dfb-84aa-b984553701b2\" (UID: \"4868d58a-76b3-4dfb-84aa-b984553701b2\") "
Jul 13 15:25:44.403152 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:25:44.403002    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4868d58a-76b3-4dfb-84aa-b984553701b2-oauth-serving-cert\") pod \"4868d58a-76b3-4dfb-84aa-b984553701b2\" (UID: \"4868d58a-76b3-4dfb-84aa-b984553701b2\") "
Jul 13 15:25:44.403152 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:25:44.403032    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4868d58a-76b3-4dfb-84aa-b984553701b2-service-ca\") pod \"4868d58a-76b3-4dfb-84aa-b984553701b2\" (UID: \"4868d58a-76b3-4dfb-84aa-b984553701b2\") "
Jul 13 15:25:44.403152 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:25:44.403074    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4868d58a-76b3-4dfb-84aa-b984553701b2-console-config\") pod \"4868d58a-76b3-4dfb-84aa-b984553701b2\" (UID: \"4868d58a-76b3-4dfb-84aa-b984553701b2\") "
Jul 13 15:25:44.403152 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:25:44.403130    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4868d58a-76b3-4dfb-84aa-b984553701b2-trusted-ca-bundle\") pod \"4868d58a-76b3-4dfb-84aa-b984553701b2\" (UID: \"4868d58a-76b3-4dfb-84aa-b984553701b2\") "
Jul 13 15:25:44.403406 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:25:44.403175    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4868d58a-76b3-4dfb-84aa-b984553701b2-console-serving-cert\") pod \"4868d58a-76b3-4dfb-84aa-b984553701b2\" (UID: \"4868d58a-76b3-4dfb-84aa-b984553701b2\") "
Jul 13 15:25:44.403543 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:25:44.403502    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4868d58a-76b3-4dfb-84aa-b984553701b2-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "4868d58a-76b3-4dfb-84aa-b984553701b2" (UID: "4868d58a-76b3-4dfb-84aa-b984553701b2"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 13 15:25:44.403637 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:25:44.403601    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4868d58a-76b3-4dfb-84aa-b984553701b2-service-ca" (OuterVolumeSpecName: "service-ca") pod "4868d58a-76b3-4dfb-84aa-b984553701b2" (UID: "4868d58a-76b3-4dfb-84aa-b984553701b2"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 13 15:25:44.403759 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:25:44.403609    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4868d58a-76b3-4dfb-84aa-b984553701b2-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "4868d58a-76b3-4dfb-84aa-b984553701b2" (UID: "4868d58a-76b3-4dfb-84aa-b984553701b2"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 13 15:25:44.403759 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:25:44.403613    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4868d58a-76b3-4dfb-84aa-b984553701b2-console-config" (OuterVolumeSpecName: "console-config") pod "4868d58a-76b3-4dfb-84aa-b984553701b2" (UID: "4868d58a-76b3-4dfb-84aa-b984553701b2"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 13 15:25:44.405488 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:25:44.405462    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4868d58a-76b3-4dfb-84aa-b984553701b2-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "4868d58a-76b3-4dfb-84aa-b984553701b2" (UID: "4868d58a-76b3-4dfb-84aa-b984553701b2"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 13 15:25:44.405566 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:25:44.405461    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4868d58a-76b3-4dfb-84aa-b984553701b2-kube-api-access-4qhn6" (OuterVolumeSpecName: "kube-api-access-4qhn6") pod "4868d58a-76b3-4dfb-84aa-b984553701b2" (UID: "4868d58a-76b3-4dfb-84aa-b984553701b2"). InnerVolumeSpecName "kube-api-access-4qhn6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 13 15:25:44.405566 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:25:44.405507    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4868d58a-76b3-4dfb-84aa-b984553701b2-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "4868d58a-76b3-4dfb-84aa-b984553701b2" (UID: "4868d58a-76b3-4dfb-84aa-b984553701b2"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 13 15:25:44.504700 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:25:44.504666    2564 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4868d58a-76b3-4dfb-84aa-b984553701b2-trusted-ca-bundle\") on node \"ip-10-0-140-255.ec2.internal\" DevicePath \"\""
Jul 13 15:25:44.504700 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:25:44.504696    2564 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4868d58a-76b3-4dfb-84aa-b984553701b2-console-serving-cert\") on node \"ip-10-0-140-255.ec2.internal\" DevicePath \"\""
Jul 13 15:25:44.504700 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:25:44.504705    2564 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4868d58a-76b3-4dfb-84aa-b984553701b2-console-oauth-config\") on node \"ip-10-0-140-255.ec2.internal\" DevicePath \"\""
Jul 13 15:25:44.504700 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:25:44.504714    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4qhn6\" (UniqueName: \"kubernetes.io/projected/4868d58a-76b3-4dfb-84aa-b984553701b2-kube-api-access-4qhn6\") on node \"ip-10-0-140-255.ec2.internal\" DevicePath \"\""
Jul 13 15:25:44.504990 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:25:44.504724    2564 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4868d58a-76b3-4dfb-84aa-b984553701b2-oauth-serving-cert\") on node \"ip-10-0-140-255.ec2.internal\" DevicePath \"\""
Jul 13 15:25:44.504990 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:25:44.504732    2564 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4868d58a-76b3-4dfb-84aa-b984553701b2-service-ca\") on node \"ip-10-0-140-255.ec2.internal\" DevicePath \"\""
Jul 13 15:25:44.504990 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:25:44.504741    2564 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4868d58a-76b3-4dfb-84aa-b984553701b2-console-config\") on node \"ip-10-0-140-255.ec2.internal\" DevicePath \"\""
Jul 13 15:25:44.580250 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:25:44.580215    2564 generic.go:356] "Generic (PLEG): container finished" podID="4868d58a-76b3-4dfb-84aa-b984553701b2" containerID="e3865d12e5bfe34e35ce3e576713697ec76839ead3719d9e864a2005dc06aec5" exitCode=0
Jul 13 15:25:44.580413 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:25:44.580267    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-79bd5f85c7-9brqt"
Jul 13 15:25:44.580413 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:25:44.580305    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-79bd5f85c7-9brqt" event={"ID":"4868d58a-76b3-4dfb-84aa-b984553701b2","Type":"ContainerDied","Data":"e3865d12e5bfe34e35ce3e576713697ec76839ead3719d9e864a2005dc06aec5"}
Jul 13 15:25:44.580413 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:25:44.580380    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-79bd5f85c7-9brqt" event={"ID":"4868d58a-76b3-4dfb-84aa-b984553701b2","Type":"ContainerDied","Data":"f934d6e37a717d318564d84f1cc228fb32d2da9313a798d26ed4217d58cb4caa"}
Jul 13 15:25:44.580413 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:25:44.580402    2564 scope.go:117] "RemoveContainer" containerID="e3865d12e5bfe34e35ce3e576713697ec76839ead3719d9e864a2005dc06aec5"
Jul 13 15:25:44.589089 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:25:44.589069    2564 scope.go:117] "RemoveContainer" containerID="e3865d12e5bfe34e35ce3e576713697ec76839ead3719d9e864a2005dc06aec5"
Jul 13 15:25:44.589425 ip-10-0-140-255 kubenswrapper[2564]: E0713 15:25:44.589406    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e3865d12e5bfe34e35ce3e576713697ec76839ead3719d9e864a2005dc06aec5\": container with ID starting with e3865d12e5bfe34e35ce3e576713697ec76839ead3719d9e864a2005dc06aec5 not found: ID does not exist" containerID="e3865d12e5bfe34e35ce3e576713697ec76839ead3719d9e864a2005dc06aec5"
Jul 13 15:25:44.589478 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:25:44.589434    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e3865d12e5bfe34e35ce3e576713697ec76839ead3719d9e864a2005dc06aec5"} err="failed to get container status \"e3865d12e5bfe34e35ce3e576713697ec76839ead3719d9e864a2005dc06aec5\": rpc error: code = NotFound desc = could not find container \"e3865d12e5bfe34e35ce3e576713697ec76839ead3719d9e864a2005dc06aec5\": container with ID starting with e3865d12e5bfe34e35ce3e576713697ec76839ead3719d9e864a2005dc06aec5 not found: ID does not exist"
Jul 13 15:25:44.612992 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:25:44.612959    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-79bd5f85c7-9brqt"]
Jul 13 15:25:44.617842 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:25:44.617816    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-79bd5f85c7-9brqt"]
Jul 13 15:25:45.120679 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:25:45.120648    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4868d58a-76b3-4dfb-84aa-b984553701b2" path="/var/lib/kubelet/pods/4868d58a-76b3-4dfb-84aa-b984553701b2/volumes"
Jul 13 15:25:48.488163 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:25:48.488136    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-7qzb8"
Jul 13 15:26:24.278562 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:26:24.278528    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 13 15:26:24.279021 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:26:24.278837    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="ca3d6543-c2c9-4225-a3c9-5045b863c183" containerName="alertmanager" containerID="cri-o://331faf227a152ad724de7e5ec8bbf7c7a89194a4dfa51e04bcf0d2dcde452046" gracePeriod=120
Jul 13 15:26:24.279021 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:26:24.278931    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="ca3d6543-c2c9-4225-a3c9-5045b863c183" containerName="prom-label-proxy" containerID="cri-o://c5676721fde29e669bb5469d2847f8318ee4e9aa4243760afcfc153a49f285b9" gracePeriod=120
Jul 13 15:26:24.279021 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:26:24.278931    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="ca3d6543-c2c9-4225-a3c9-5045b863c183" containerName="kube-rbac-proxy-metric" containerID="cri-o://76aaf49caf8f5ff584f1d6691ee89db3f478b670690895b4c167520a1837f773" gracePeriod=120
Jul 13 15:26:24.279021 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:26:24.278977    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="ca3d6543-c2c9-4225-a3c9-5045b863c183" containerName="kube-rbac-proxy-web" containerID="cri-o://fa797379cfc0d78fc0e3b1a5fd919cc9dc8d5b06aceb2b51db3d2b2fb70ebeaa" gracePeriod=120
Jul 13 15:26:24.279236 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:26:24.279011    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="ca3d6543-c2c9-4225-a3c9-5045b863c183" containerName="config-reloader" containerID="cri-o://bf6657065cf582d5d815415fc7fd22e42a26a89aa9b95b0eb6dabc478c946a0e" gracePeriod=120
Jul 13 15:26:24.279236 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:26:24.278991    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="ca3d6543-c2c9-4225-a3c9-5045b863c183" containerName="kube-rbac-proxy" containerID="cri-o://04fcdb54ded9e2a852acc1aecabf8cb6182234940b37388ac554c0eda0ad5195" gracePeriod=120
Jul 13 15:26:24.726066 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:26:24.726031    2564 generic.go:356] "Generic (PLEG): container finished" podID="ca3d6543-c2c9-4225-a3c9-5045b863c183" containerID="c5676721fde29e669bb5469d2847f8318ee4e9aa4243760afcfc153a49f285b9" exitCode=0
Jul 13 15:26:24.726066 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:26:24.726056    2564 generic.go:356] "Generic (PLEG): container finished" podID="ca3d6543-c2c9-4225-a3c9-5045b863c183" containerID="04fcdb54ded9e2a852acc1aecabf8cb6182234940b37388ac554c0eda0ad5195" exitCode=0
Jul 13 15:26:24.726066 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:26:24.726063    2564 generic.go:356] "Generic (PLEG): container finished" podID="ca3d6543-c2c9-4225-a3c9-5045b863c183" containerID="bf6657065cf582d5d815415fc7fd22e42a26a89aa9b95b0eb6dabc478c946a0e" exitCode=0
Jul 13 15:26:24.726066 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:26:24.726069    2564 generic.go:356] "Generic (PLEG): container finished" podID="ca3d6543-c2c9-4225-a3c9-5045b863c183" containerID="331faf227a152ad724de7e5ec8bbf7c7a89194a4dfa51e04bcf0d2dcde452046" exitCode=0
Jul 13 15:26:24.726403 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:26:24.726104    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ca3d6543-c2c9-4225-a3c9-5045b863c183","Type":"ContainerDied","Data":"c5676721fde29e669bb5469d2847f8318ee4e9aa4243760afcfc153a49f285b9"}
Jul 13 15:26:24.726403 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:26:24.726173    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ca3d6543-c2c9-4225-a3c9-5045b863c183","Type":"ContainerDied","Data":"04fcdb54ded9e2a852acc1aecabf8cb6182234940b37388ac554c0eda0ad5195"}
Jul 13 15:26:24.726403 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:26:24.726201    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ca3d6543-c2c9-4225-a3c9-5045b863c183","Type":"ContainerDied","Data":"bf6657065cf582d5d815415fc7fd22e42a26a89aa9b95b0eb6dabc478c946a0e"}
Jul 13 15:26:24.726403 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:26:24.726226    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ca3d6543-c2c9-4225-a3c9-5045b863c183","Type":"ContainerDied","Data":"331faf227a152ad724de7e5ec8bbf7c7a89194a4dfa51e04bcf0d2dcde452046"}
Jul 13 15:26:25.527680 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:26:25.527657    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 13 15:26:25.606799 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:26:25.606765    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ca3d6543-c2c9-4225-a3c9-5045b863c183-metrics-client-ca\") pod \"ca3d6543-c2c9-4225-a3c9-5045b863c183\" (UID: \"ca3d6543-c2c9-4225-a3c9-5045b863c183\") "
Jul 13 15:26:25.606799 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:26:25.606803    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/ca3d6543-c2c9-4225-a3c9-5045b863c183-config-volume\") pod \"ca3d6543-c2c9-4225-a3c9-5045b863c183\" (UID: \"ca3d6543-c2c9-4225-a3c9-5045b863c183\") "
Jul 13 15:26:25.607099 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:26:25.606833    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/ca3d6543-c2c9-4225-a3c9-5045b863c183-secret-alertmanager-main-tls\") pod \"ca3d6543-c2c9-4225-a3c9-5045b863c183\" (UID: \"ca3d6543-c2c9-4225-a3c9-5045b863c183\") "
Jul 13 15:26:25.607099 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:26:25.606861    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/ca3d6543-c2c9-4225-a3c9-5045b863c183-alertmanager-main-db\") pod \"ca3d6543-c2c9-4225-a3c9-5045b863c183\" (UID: \"ca3d6543-c2c9-4225-a3c9-5045b863c183\") "
Jul 13 15:26:25.607099 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:26:25.606975    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/ca3d6543-c2c9-4225-a3c9-5045b863c183-cluster-tls-config\") pod \"ca3d6543-c2c9-4225-a3c9-5045b863c183\" (UID: \"ca3d6543-c2c9-4225-a3c9-5045b863c183\") "
Jul 13 15:26:25.607099 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:26:25.607022    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/ca3d6543-c2c9-4225-a3c9-5045b863c183-config-out\") pod \"ca3d6543-c2c9-4225-a3c9-5045b863c183\" (UID: \"ca3d6543-c2c9-4225-a3c9-5045b863c183\") "
Jul 13 15:26:25.607099 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:26:25.607094    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ca3d6543-c2c9-4225-a3c9-5045b863c183-secret-alertmanager-kube-rbac-proxy\") pod \"ca3d6543-c2c9-4225-a3c9-5045b863c183\" (UID: \"ca3d6543-c2c9-4225-a3c9-5045b863c183\") "
Jul 13 15:26:25.607358 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:26:25.607121    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ca3d6543-c2c9-4225-a3c9-5045b863c183-alertmanager-trusted-ca-bundle\") pod \"ca3d6543-c2c9-4225-a3c9-5045b863c183\" (UID: \"ca3d6543-c2c9-4225-a3c9-5045b863c183\") "
Jul 13 15:26:25.607358 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:26:25.607164    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-92gg7\" (UniqueName: \"kubernetes.io/projected/ca3d6543-c2c9-4225-a3c9-5045b863c183-kube-api-access-92gg7\") pod \"ca3d6543-c2c9-4225-a3c9-5045b863c183\" (UID: \"ca3d6543-c2c9-4225-a3c9-5045b863c183\") "
Jul 13 15:26:25.607358 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:26:25.607196    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/ca3d6543-c2c9-4225-a3c9-5045b863c183-secret-alertmanager-kube-rbac-proxy-metric\") pod \"ca3d6543-c2c9-4225-a3c9-5045b863c183\" (UID: \"ca3d6543-c2c9-4225-a3c9-5045b863c183\") "
Jul 13 15:26:25.607358 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:26:25.607236    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/ca3d6543-c2c9-4225-a3c9-5045b863c183-web-config\") pod \"ca3d6543-c2c9-4225-a3c9-5045b863c183\" (UID: \"ca3d6543-c2c9-4225-a3c9-5045b863c183\") "
Jul 13 15:26:25.607358 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:26:25.607259    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/ca3d6543-c2c9-4225-a3c9-5045b863c183-tls-assets\") pod \"ca3d6543-c2c9-4225-a3c9-5045b863c183\" (UID: \"ca3d6543-c2c9-4225-a3c9-5045b863c183\") "
Jul 13 15:26:25.607358 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:26:25.607263    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ca3d6543-c2c9-4225-a3c9-5045b863c183-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "ca3d6543-c2c9-4225-a3c9-5045b863c183" (UID: "ca3d6543-c2c9-4225-a3c9-5045b863c183"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 13 15:26:25.607358 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:26:25.607315    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ca3d6543-c2c9-4225-a3c9-5045b863c183-secret-alertmanager-kube-rbac-proxy-web\") pod \"ca3d6543-c2c9-4225-a3c9-5045b863c183\" (UID: \"ca3d6543-c2c9-4225-a3c9-5045b863c183\") "
Jul 13 15:26:25.607721 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:26:25.607538    2564 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ca3d6543-c2c9-4225-a3c9-5045b863c183-metrics-client-ca\") on node \"ip-10-0-140-255.ec2.internal\" DevicePath \"\""
Jul 13 15:26:25.608494 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:26:25.607803    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ca3d6543-c2c9-4225-a3c9-5045b863c183-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "ca3d6543-c2c9-4225-a3c9-5045b863c183" (UID: "ca3d6543-c2c9-4225-a3c9-5045b863c183"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 15:26:25.608494 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:26:25.608233    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ca3d6543-c2c9-4225-a3c9-5045b863c183-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "ca3d6543-c2c9-4225-a3c9-5045b863c183" (UID: "ca3d6543-c2c9-4225-a3c9-5045b863c183"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 13 15:26:25.610571 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:26:25.610541    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ca3d6543-c2c9-4225-a3c9-5045b863c183-config-volume" (OuterVolumeSpecName: "config-volume") pod "ca3d6543-c2c9-4225-a3c9-5045b863c183" (UID: "ca3d6543-c2c9-4225-a3c9-5045b863c183"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 13 15:26:25.611084 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:26:25.611048    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ca3d6543-c2c9-4225-a3c9-5045b863c183-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "ca3d6543-c2c9-4225-a3c9-5045b863c183" (UID: "ca3d6543-c2c9-4225-a3c9-5045b863c183"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 13 15:26:25.611324 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:26:25.611208    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ca3d6543-c2c9-4225-a3c9-5045b863c183-kube-api-access-92gg7" (OuterVolumeSpecName: "kube-api-access-92gg7") pod "ca3d6543-c2c9-4225-a3c9-5045b863c183" (UID: "ca3d6543-c2c9-4225-a3c9-5045b863c183"). InnerVolumeSpecName "kube-api-access-92gg7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 13 15:26:25.611853 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:26:25.611807    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ca3d6543-c2c9-4225-a3c9-5045b863c183-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "ca3d6543-c2c9-4225-a3c9-5045b863c183" (UID: "ca3d6543-c2c9-4225-a3c9-5045b863c183"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 13 15:26:25.611966 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:26:25.611855    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ca3d6543-c2c9-4225-a3c9-5045b863c183-config-out" (OuterVolumeSpecName: "config-out") pod "ca3d6543-c2c9-4225-a3c9-5045b863c183" (UID: "ca3d6543-c2c9-4225-a3c9-5045b863c183"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 15:26:25.612555 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:26:25.612526    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ca3d6543-c2c9-4225-a3c9-5045b863c183-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "ca3d6543-c2c9-4225-a3c9-5045b863c183" (UID: "ca3d6543-c2c9-4225-a3c9-5045b863c183"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 13 15:26:25.612654 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:26:25.612634    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ca3d6543-c2c9-4225-a3c9-5045b863c183-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "ca3d6543-c2c9-4225-a3c9-5045b863c183" (UID: "ca3d6543-c2c9-4225-a3c9-5045b863c183"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 13 15:26:25.612841 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:26:25.612815    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ca3d6543-c2c9-4225-a3c9-5045b863c183-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "ca3d6543-c2c9-4225-a3c9-5045b863c183" (UID: "ca3d6543-c2c9-4225-a3c9-5045b863c183"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 13 15:26:25.615289 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:26:25.615262    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ca3d6543-c2c9-4225-a3c9-5045b863c183-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "ca3d6543-c2c9-4225-a3c9-5045b863c183" (UID: "ca3d6543-c2c9-4225-a3c9-5045b863c183"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 13 15:26:25.622723 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:26:25.622698    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ca3d6543-c2c9-4225-a3c9-5045b863c183-web-config" (OuterVolumeSpecName: "web-config") pod "ca3d6543-c2c9-4225-a3c9-5045b863c183" (UID: "ca3d6543-c2c9-4225-a3c9-5045b863c183"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 13 15:26:25.708399 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:26:25.708343    2564 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/ca3d6543-c2c9-4225-a3c9-5045b863c183-web-config\") on node \"ip-10-0-140-255.ec2.internal\" DevicePath \"\""
Jul 13 15:26:25.708399 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:26:25.708390    2564 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/ca3d6543-c2c9-4225-a3c9-5045b863c183-tls-assets\") on node \"ip-10-0-140-255.ec2.internal\" DevicePath \"\""
Jul 13 15:26:25.708399 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:26:25.708405    2564 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ca3d6543-c2c9-4225-a3c9-5045b863c183-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-140-255.ec2.internal\" DevicePath \"\""
Jul 13 15:26:25.708650 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:26:25.708417    2564 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/ca3d6543-c2c9-4225-a3c9-5045b863c183-config-volume\") on node \"ip-10-0-140-255.ec2.internal\" DevicePath \"\""
Jul 13 15:26:25.708650 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:26:25.708434    2564 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/ca3d6543-c2c9-4225-a3c9-5045b863c183-secret-alertmanager-main-tls\") on node \"ip-10-0-140-255.ec2.internal\" DevicePath \"\""
Jul 13 15:26:25.708650 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:26:25.708445    2564 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/ca3d6543-c2c9-4225-a3c9-5045b863c183-alertmanager-main-db\") on node \"ip-10-0-140-255.ec2.internal\" DevicePath \"\""
Jul 13 15:26:25.708650 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:26:25.708456    2564 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/ca3d6543-c2c9-4225-a3c9-5045b863c183-cluster-tls-config\") on node \"ip-10-0-140-255.ec2.internal\" DevicePath \"\""
Jul 13 15:26:25.708650 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:26:25.708466    2564 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/ca3d6543-c2c9-4225-a3c9-5045b863c183-config-out\") on node \"ip-10-0-140-255.ec2.internal\" DevicePath \"\""
Jul 13 15:26:25.708650 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:26:25.708477    2564 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ca3d6543-c2c9-4225-a3c9-5045b863c183-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-140-255.ec2.internal\" DevicePath \"\""
Jul 13 15:26:25.708650 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:26:25.708489    2564 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ca3d6543-c2c9-4225-a3c9-5045b863c183-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-140-255.ec2.internal\" DevicePath \"\""
Jul 13 15:26:25.708650 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:26:25.708501    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-92gg7\" (UniqueName: \"kubernetes.io/projected/ca3d6543-c2c9-4225-a3c9-5045b863c183-kube-api-access-92gg7\") on node \"ip-10-0-140-255.ec2.internal\" DevicePath \"\""
Jul 13 15:26:25.708650 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:26:25.708514    2564 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/ca3d6543-c2c9-4225-a3c9-5045b863c183-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-140-255.ec2.internal\" DevicePath \"\""
Jul 13 15:26:25.732539 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:26:25.732504    2564 generic.go:356] "Generic (PLEG): container finished" podID="ca3d6543-c2c9-4225-a3c9-5045b863c183" containerID="76aaf49caf8f5ff584f1d6691ee89db3f478b670690895b4c167520a1837f773" exitCode=0
Jul 13 15:26:25.732539 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:26:25.732530    2564 generic.go:356] "Generic (PLEG): container finished" podID="ca3d6543-c2c9-4225-a3c9-5045b863c183" containerID="fa797379cfc0d78fc0e3b1a5fd919cc9dc8d5b06aceb2b51db3d2b2fb70ebeaa" exitCode=0
Jul 13 15:26:25.732770 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:26:25.732551    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ca3d6543-c2c9-4225-a3c9-5045b863c183","Type":"ContainerDied","Data":"76aaf49caf8f5ff584f1d6691ee89db3f478b670690895b4c167520a1837f773"}
Jul 13 15:26:25.732770 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:26:25.732597    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 13 15:26:25.732770 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:26:25.732609    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ca3d6543-c2c9-4225-a3c9-5045b863c183","Type":"ContainerDied","Data":"fa797379cfc0d78fc0e3b1a5fd919cc9dc8d5b06aceb2b51db3d2b2fb70ebeaa"}
Jul 13 15:26:25.732770 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:26:25.732636    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ca3d6543-c2c9-4225-a3c9-5045b863c183","Type":"ContainerDied","Data":"6c6ce697f5224b83f2e6b4721c179f3fd82656544b43569fe3e5b4da07509852"}
Jul 13 15:26:25.732770 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:26:25.732667    2564 scope.go:117] "RemoveContainer" containerID="c5676721fde29e669bb5469d2847f8318ee4e9aa4243760afcfc153a49f285b9"
Jul 13 15:26:25.739948 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:26:25.739927    2564 scope.go:117] "RemoveContainer" containerID="76aaf49caf8f5ff584f1d6691ee89db3f478b670690895b4c167520a1837f773"
Jul 13 15:26:25.747218 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:26:25.747195    2564 scope.go:117] "RemoveContainer" containerID="04fcdb54ded9e2a852acc1aecabf8cb6182234940b37388ac554c0eda0ad5195"
Jul 13 15:26:25.753805 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:26:25.753788    2564 scope.go:117] "RemoveContainer" containerID="fa797379cfc0d78fc0e3b1a5fd919cc9dc8d5b06aceb2b51db3d2b2fb70ebeaa"
Jul 13 15:26:25.760681 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:26:25.760659    2564 scope.go:117] "RemoveContainer" containerID="bf6657065cf582d5d815415fc7fd22e42a26a89aa9b95b0eb6dabc478c946a0e"
Jul 13 15:26:25.760940 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:26:25.760921    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 13 15:26:25.766605 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:26:25.766576    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 13 15:26:25.768260 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:26:25.768245    2564 scope.go:117] "RemoveContainer" containerID="331faf227a152ad724de7e5ec8bbf7c7a89194a4dfa51e04bcf0d2dcde452046"
Jul 13 15:26:25.774776 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:26:25.774760    2564 scope.go:117] "RemoveContainer" containerID="c73d268bb888bb8696989ca65648d788d3cccfb0b927352a4eef481d62d65a2e"
Jul 13 15:26:25.781161 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:26:25.781145    2564 scope.go:117] "RemoveContainer" containerID="c5676721fde29e669bb5469d2847f8318ee4e9aa4243760afcfc153a49f285b9"
Jul 13 15:26:25.781443 ip-10-0-140-255 kubenswrapper[2564]: E0713 15:26:25.781425    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c5676721fde29e669bb5469d2847f8318ee4e9aa4243760afcfc153a49f285b9\": container with ID starting with c5676721fde29e669bb5469d2847f8318ee4e9aa4243760afcfc153a49f285b9 not found: ID does not exist" containerID="c5676721fde29e669bb5469d2847f8318ee4e9aa4243760afcfc153a49f285b9"
Jul 13 15:26:25.781502 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:26:25.781451    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c5676721fde29e669bb5469d2847f8318ee4e9aa4243760afcfc153a49f285b9"} err="failed to get container status \"c5676721fde29e669bb5469d2847f8318ee4e9aa4243760afcfc153a49f285b9\": rpc error: code = NotFound desc = could not find container \"c5676721fde29e669bb5469d2847f8318ee4e9aa4243760afcfc153a49f285b9\": container with ID starting with c5676721fde29e669bb5469d2847f8318ee4e9aa4243760afcfc153a49f285b9 not found: ID does not exist"
Jul 13 15:26:25.781502 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:26:25.781470    2564 scope.go:117] "RemoveContainer" containerID="76aaf49caf8f5ff584f1d6691ee89db3f478b670690895b4c167520a1837f773"
Jul 13 15:26:25.781710 ip-10-0-140-255 kubenswrapper[2564]: E0713 15:26:25.781695    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"76aaf49caf8f5ff584f1d6691ee89db3f478b670690895b4c167520a1837f773\": container with ID starting with 76aaf49caf8f5ff584f1d6691ee89db3f478b670690895b4c167520a1837f773 not found: ID does not exist" containerID="76aaf49caf8f5ff584f1d6691ee89db3f478b670690895b4c167520a1837f773"
Jul 13 15:26:25.781760 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:26:25.781713    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"76aaf49caf8f5ff584f1d6691ee89db3f478b670690895b4c167520a1837f773"} err="failed to get container status \"76aaf49caf8f5ff584f1d6691ee89db3f478b670690895b4c167520a1837f773\": rpc error: code = NotFound desc = could not find container \"76aaf49caf8f5ff584f1d6691ee89db3f478b670690895b4c167520a1837f773\": container with ID starting with 76aaf49caf8f5ff584f1d6691ee89db3f478b670690895b4c167520a1837f773 not found: ID does not exist"
Jul 13 15:26:25.781760 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:26:25.781725    2564 scope.go:117] "RemoveContainer" containerID="04fcdb54ded9e2a852acc1aecabf8cb6182234940b37388ac554c0eda0ad5195"
Jul 13 15:26:25.781924 ip-10-0-140-255 kubenswrapper[2564]: E0713 15:26:25.781904    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"04fcdb54ded9e2a852acc1aecabf8cb6182234940b37388ac554c0eda0ad5195\": container with ID starting with 04fcdb54ded9e2a852acc1aecabf8cb6182234940b37388ac554c0eda0ad5195 not found: ID does not exist" containerID="04fcdb54ded9e2a852acc1aecabf8cb6182234940b37388ac554c0eda0ad5195"
Jul 13 15:26:25.782024 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:26:25.781925    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"04fcdb54ded9e2a852acc1aecabf8cb6182234940b37388ac554c0eda0ad5195"} err="failed to get container status \"04fcdb54ded9e2a852acc1aecabf8cb6182234940b37388ac554c0eda0ad5195\": rpc error: code = NotFound desc = could not find container \"04fcdb54ded9e2a852acc1aecabf8cb6182234940b37388ac554c0eda0ad5195\": container with ID starting with 04fcdb54ded9e2a852acc1aecabf8cb6182234940b37388ac554c0eda0ad5195 not found: ID does not exist"
Jul 13 15:26:25.782024 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:26:25.781939    2564 scope.go:117] "RemoveContainer" containerID="fa797379cfc0d78fc0e3b1a5fd919cc9dc8d5b06aceb2b51db3d2b2fb70ebeaa"
Jul 13 15:26:25.782189 ip-10-0-140-255 kubenswrapper[2564]: E0713 15:26:25.782172    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fa797379cfc0d78fc0e3b1a5fd919cc9dc8d5b06aceb2b51db3d2b2fb70ebeaa\": container with ID starting with fa797379cfc0d78fc0e3b1a5fd919cc9dc8d5b06aceb2b51db3d2b2fb70ebeaa not found: ID does not exist" containerID="fa797379cfc0d78fc0e3b1a5fd919cc9dc8d5b06aceb2b51db3d2b2fb70ebeaa"
Jul 13 15:26:25.782232 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:26:25.782192    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fa797379cfc0d78fc0e3b1a5fd919cc9dc8d5b06aceb2b51db3d2b2fb70ebeaa"} err="failed to get container status \"fa797379cfc0d78fc0e3b1a5fd919cc9dc8d5b06aceb2b51db3d2b2fb70ebeaa\": rpc error: code = NotFound desc = could not find container \"fa797379cfc0d78fc0e3b1a5fd919cc9dc8d5b06aceb2b51db3d2b2fb70ebeaa\": container with ID starting with fa797379cfc0d78fc0e3b1a5fd919cc9dc8d5b06aceb2b51db3d2b2fb70ebeaa not found: ID does not exist"
Jul 13 15:26:25.782232 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:26:25.782204    2564 scope.go:117] "RemoveContainer" containerID="bf6657065cf582d5d815415fc7fd22e42a26a89aa9b95b0eb6dabc478c946a0e"
Jul 13 15:26:25.782422 ip-10-0-140-255 kubenswrapper[2564]: E0713 15:26:25.782404    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bf6657065cf582d5d815415fc7fd22e42a26a89aa9b95b0eb6dabc478c946a0e\": container with ID starting with bf6657065cf582d5d815415fc7fd22e42a26a89aa9b95b0eb6dabc478c946a0e not found: ID does not exist" containerID="bf6657065cf582d5d815415fc7fd22e42a26a89aa9b95b0eb6dabc478c946a0e"
Jul 13 15:26:25.782483 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:26:25.782429    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bf6657065cf582d5d815415fc7fd22e42a26a89aa9b95b0eb6dabc478c946a0e"} err="failed to get container status \"bf6657065cf582d5d815415fc7fd22e42a26a89aa9b95b0eb6dabc478c946a0e\": rpc error: code = NotFound desc = could not find container \"bf6657065cf582d5d815415fc7fd22e42a26a89aa9b95b0eb6dabc478c946a0e\": container with ID starting with bf6657065cf582d5d815415fc7fd22e42a26a89aa9b95b0eb6dabc478c946a0e not found: ID does not exist"
Jul 13 15:26:25.782483 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:26:25.782451    2564 scope.go:117] "RemoveContainer" containerID="331faf227a152ad724de7e5ec8bbf7c7a89194a4dfa51e04bcf0d2dcde452046"
Jul 13 15:26:25.782660 ip-10-0-140-255 kubenswrapper[2564]: E0713 15:26:25.782644    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"331faf227a152ad724de7e5ec8bbf7c7a89194a4dfa51e04bcf0d2dcde452046\": container with ID starting with 331faf227a152ad724de7e5ec8bbf7c7a89194a4dfa51e04bcf0d2dcde452046 not found: ID does not exist" containerID="331faf227a152ad724de7e5ec8bbf7c7a89194a4dfa51e04bcf0d2dcde452046"
Jul 13 15:26:25.782771 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:26:25.782666    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"331faf227a152ad724de7e5ec8bbf7c7a89194a4dfa51e04bcf0d2dcde452046"} err="failed to get container status \"331faf227a152ad724de7e5ec8bbf7c7a89194a4dfa51e04bcf0d2dcde452046\": rpc error: code = NotFound desc = could not find container \"331faf227a152ad724de7e5ec8bbf7c7a89194a4dfa51e04bcf0d2dcde452046\": container with ID starting with 331faf227a152ad724de7e5ec8bbf7c7a89194a4dfa51e04bcf0d2dcde452046 not found: ID does not exist"
Jul 13 15:26:25.782771 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:26:25.782684    2564 scope.go:117] "RemoveContainer" containerID="c73d268bb888bb8696989ca65648d788d3cccfb0b927352a4eef481d62d65a2e"
Jul 13 15:26:25.782917 ip-10-0-140-255 kubenswrapper[2564]: E0713 15:26:25.782892    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c73d268bb888bb8696989ca65648d788d3cccfb0b927352a4eef481d62d65a2e\": container with ID starting with c73d268bb888bb8696989ca65648d788d3cccfb0b927352a4eef481d62d65a2e not found: ID does not exist" containerID="c73d268bb888bb8696989ca65648d788d3cccfb0b927352a4eef481d62d65a2e"
Jul 13 15:26:25.782981 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:26:25.782925    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c73d268bb888bb8696989ca65648d788d3cccfb0b927352a4eef481d62d65a2e"} err="failed to get container status \"c73d268bb888bb8696989ca65648d788d3cccfb0b927352a4eef481d62d65a2e\": rpc error: code = NotFound desc = could not find container \"c73d268bb888bb8696989ca65648d788d3cccfb0b927352a4eef481d62d65a2e\": container with ID starting with c73d268bb888bb8696989ca65648d788d3cccfb0b927352a4eef481d62d65a2e not found: ID does not exist"
Jul 13 15:26:25.782981 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:26:25.782944    2564 scope.go:117] "RemoveContainer" containerID="c5676721fde29e669bb5469d2847f8318ee4e9aa4243760afcfc153a49f285b9"
Jul 13 15:26:25.783181 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:26:25.783164    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c5676721fde29e669bb5469d2847f8318ee4e9aa4243760afcfc153a49f285b9"} err="failed to get container status \"c5676721fde29e669bb5469d2847f8318ee4e9aa4243760afcfc153a49f285b9\": rpc error: code = NotFound desc = could not find container \"c5676721fde29e669bb5469d2847f8318ee4e9aa4243760afcfc153a49f285b9\": container with ID starting with c5676721fde29e669bb5469d2847f8318ee4e9aa4243760afcfc153a49f285b9 not found: ID does not exist"
Jul 13 15:26:25.783229 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:26:25.783182    2564 scope.go:117] "RemoveContainer" containerID="76aaf49caf8f5ff584f1d6691ee89db3f478b670690895b4c167520a1837f773"
Jul 13 15:26:25.783412 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:26:25.783393    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"76aaf49caf8f5ff584f1d6691ee89db3f478b670690895b4c167520a1837f773"} err="failed to get container status \"76aaf49caf8f5ff584f1d6691ee89db3f478b670690895b4c167520a1837f773\": rpc error: code = NotFound desc = could not find container \"76aaf49caf8f5ff584f1d6691ee89db3f478b670690895b4c167520a1837f773\": container with ID starting with 76aaf49caf8f5ff584f1d6691ee89db3f478b670690895b4c167520a1837f773 not found: ID does not exist"
Jul 13 15:26:25.783472 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:26:25.783412    2564 scope.go:117] "RemoveContainer" containerID="04fcdb54ded9e2a852acc1aecabf8cb6182234940b37388ac554c0eda0ad5195"
Jul 13 15:26:25.783644 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:26:25.783623    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"04fcdb54ded9e2a852acc1aecabf8cb6182234940b37388ac554c0eda0ad5195"} err="failed to get container status \"04fcdb54ded9e2a852acc1aecabf8cb6182234940b37388ac554c0eda0ad5195\": rpc error: code = NotFound desc = could not find container \"04fcdb54ded9e2a852acc1aecabf8cb6182234940b37388ac554c0eda0ad5195\": container with ID starting with 04fcdb54ded9e2a852acc1aecabf8cb6182234940b37388ac554c0eda0ad5195 not found: ID does not exist"
Jul 13 15:26:25.783687 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:26:25.783646    2564 scope.go:117] "RemoveContainer" containerID="fa797379cfc0d78fc0e3b1a5fd919cc9dc8d5b06aceb2b51db3d2b2fb70ebeaa"
Jul 13 15:26:25.783853 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:26:25.783833    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fa797379cfc0d78fc0e3b1a5fd919cc9dc8d5b06aceb2b51db3d2b2fb70ebeaa"} err="failed to get container status \"fa797379cfc0d78fc0e3b1a5fd919cc9dc8d5b06aceb2b51db3d2b2fb70ebeaa\": rpc error: code = NotFound desc = could not find container \"fa797379cfc0d78fc0e3b1a5fd919cc9dc8d5b06aceb2b51db3d2b2fb70ebeaa\": container with ID starting with fa797379cfc0d78fc0e3b1a5fd919cc9dc8d5b06aceb2b51db3d2b2fb70ebeaa not found: ID does not exist"
Jul 13 15:26:25.783940 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:26:25.783855    2564 scope.go:117] "RemoveContainer" containerID="bf6657065cf582d5d815415fc7fd22e42a26a89aa9b95b0eb6dabc478c946a0e"
Jul 13 15:26:25.784095 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:26:25.784068    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bf6657065cf582d5d815415fc7fd22e42a26a89aa9b95b0eb6dabc478c946a0e"} err="failed to get container status \"bf6657065cf582d5d815415fc7fd22e42a26a89aa9b95b0eb6dabc478c946a0e\": rpc error: code = NotFound desc = could not find container \"bf6657065cf582d5d815415fc7fd22e42a26a89aa9b95b0eb6dabc478c946a0e\": container with ID starting with bf6657065cf582d5d815415fc7fd22e42a26a89aa9b95b0eb6dabc478c946a0e not found: ID does not exist"
Jul 13 15:26:25.784154 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:26:25.784098    2564 scope.go:117] "RemoveContainer" containerID="331faf227a152ad724de7e5ec8bbf7c7a89194a4dfa51e04bcf0d2dcde452046"
Jul 13 15:26:25.784336 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:26:25.784320    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"331faf227a152ad724de7e5ec8bbf7c7a89194a4dfa51e04bcf0d2dcde452046"} err="failed to get container status \"331faf227a152ad724de7e5ec8bbf7c7a89194a4dfa51e04bcf0d2dcde452046\": rpc error: code = NotFound desc = could not find container \"331faf227a152ad724de7e5ec8bbf7c7a89194a4dfa51e04bcf0d2dcde452046\": container with ID starting with 331faf227a152ad724de7e5ec8bbf7c7a89194a4dfa51e04bcf0d2dcde452046 not found: ID does not exist"
Jul 13 15:26:25.784382 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:26:25.784336    2564 scope.go:117] "RemoveContainer" containerID="c73d268bb888bb8696989ca65648d788d3cccfb0b927352a4eef481d62d65a2e"
Jul 13 15:26:25.784548 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:26:25.784526    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c73d268bb888bb8696989ca65648d788d3cccfb0b927352a4eef481d62d65a2e"} err="failed to get container status \"c73d268bb888bb8696989ca65648d788d3cccfb0b927352a4eef481d62d65a2e\": rpc error: code = NotFound desc = could not find container \"c73d268bb888bb8696989ca65648d788d3cccfb0b927352a4eef481d62d65a2e\": container with ID starting with c73d268bb888bb8696989ca65648d788d3cccfb0b927352a4eef481d62d65a2e not found: ID does not exist"
Jul 13 15:26:25.798914 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:26:25.798891    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 13 15:26:25.799134 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:26:25.799122    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ca3d6543-c2c9-4225-a3c9-5045b863c183" containerName="prom-label-proxy"
Jul 13 15:26:25.799174 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:26:25.799135    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="ca3d6543-c2c9-4225-a3c9-5045b863c183" containerName="prom-label-proxy"
Jul 13 15:26:25.799174 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:26:25.799149    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ca3d6543-c2c9-4225-a3c9-5045b863c183" containerName="init-config-reloader"
Jul 13 15:26:25.799174 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:26:25.799155    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="ca3d6543-c2c9-4225-a3c9-5045b863c183" containerName="init-config-reloader"
Jul 13 15:26:25.799174 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:26:25.799161    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ca3d6543-c2c9-4225-a3c9-5045b863c183" containerName="config-reloader"
Jul 13 15:26:25.799174 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:26:25.799167    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="ca3d6543-c2c9-4225-a3c9-5045b863c183" containerName="config-reloader"
Jul 13 15:26:25.799315 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:26:25.799176    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ca3d6543-c2c9-4225-a3c9-5045b863c183" containerName="kube-rbac-proxy-metric"
Jul 13 15:26:25.799315 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:26:25.799181    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="ca3d6543-c2c9-4225-a3c9-5045b863c183" containerName="kube-rbac-proxy-metric"
Jul 13 15:26:25.799315 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:26:25.799187    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4868d58a-76b3-4dfb-84aa-b984553701b2" containerName="console"
Jul 13 15:26:25.799315 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:26:25.799192    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="4868d58a-76b3-4dfb-84aa-b984553701b2" containerName="console"
Jul 13 15:26:25.799315 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:26:25.799199    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ca3d6543-c2c9-4225-a3c9-5045b863c183" containerName="kube-rbac-proxy"
Jul 13 15:26:25.799315 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:26:25.799204    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="ca3d6543-c2c9-4225-a3c9-5045b863c183" containerName="kube-rbac-proxy"
Jul 13 15:26:25.799315 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:26:25.799212    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ca3d6543-c2c9-4225-a3c9-5045b863c183" containerName="alertmanager"
Jul 13 15:26:25.799315 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:26:25.799217    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="ca3d6543-c2c9-4225-a3c9-5045b863c183" containerName="alertmanager"
Jul 13 15:26:25.799315 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:26:25.799224    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ca3d6543-c2c9-4225-a3c9-5045b863c183" containerName="kube-rbac-proxy-web"
Jul 13 15:26:25.799315 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:26:25.799229    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="ca3d6543-c2c9-4225-a3c9-5045b863c183" containerName="kube-rbac-proxy-web"
Jul 13 15:26:25.799315 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:26:25.799270    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="ca3d6543-c2c9-4225-a3c9-5045b863c183" containerName="alertmanager"
Jul 13 15:26:25.799315 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:26:25.799277    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="ca3d6543-c2c9-4225-a3c9-5045b863c183" containerName="kube-rbac-proxy"
Jul 13 15:26:25.799315 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:26:25.799283    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="4868d58a-76b3-4dfb-84aa-b984553701b2" containerName="console"
Jul 13 15:26:25.799315 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:26:25.799289    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="ca3d6543-c2c9-4225-a3c9-5045b863c183" containerName="kube-rbac-proxy-web"
Jul 13 15:26:25.799315 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:26:25.799295    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="ca3d6543-c2c9-4225-a3c9-5045b863c183" containerName="config-reloader"
Jul 13 15:26:25.799315 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:26:25.799299    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="ca3d6543-c2c9-4225-a3c9-5045b863c183" containerName="kube-rbac-proxy-metric"
Jul 13 15:26:25.799315 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:26:25.799304    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="ca3d6543-c2c9-4225-a3c9-5045b863c183" containerName="prom-label-proxy"
Jul 13 15:26:25.802609 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:26:25.802595    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 13 15:26:25.805629 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:26:25.805610    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
Jul 13 15:26:25.805916 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:26:25.805861    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
Jul 13 15:26:25.805916 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:26:25.805883    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
Jul 13 15:26:25.806064 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:26:25.805862    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
Jul 13 15:26:25.806064 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:26:25.805882    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
Jul 13 15:26:25.806202 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:26:25.806188    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
Jul 13 15:26:25.806297 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:26:25.806282    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
Jul 13 15:26:25.806532 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:26:25.806519    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-vktnm\""
Jul 13 15:26:25.806739 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:26:25.806722    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
Jul 13 15:26:25.814480 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:26:25.812515    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
Jul 13 15:26:25.823320 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:26:25.823300    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 13 15:26:25.909606 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:26:25.909565    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/10c75331-88b1-4742-b10b-bc974e245162-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"10c75331-88b1-4742-b10b-bc974e245162\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 13 15:26:25.909606 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:26:25.909612    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/10c75331-88b1-4742-b10b-bc974e245162-tls-assets\") pod \"alertmanager-main-0\" (UID: \"10c75331-88b1-4742-b10b-bc974e245162\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 13 15:26:25.909818 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:26:25.909632    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/10c75331-88b1-4742-b10b-bc974e245162-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"10c75331-88b1-4742-b10b-bc974e245162\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 13 15:26:25.909818 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:26:25.909667    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jjrg9\" (UniqueName: \"kubernetes.io/projected/10c75331-88b1-4742-b10b-bc974e245162-kube-api-access-jjrg9\") pod \"alertmanager-main-0\" (UID: \"10c75331-88b1-4742-b10b-bc974e245162\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 13 15:26:25.909818 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:26:25.909687    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/10c75331-88b1-4742-b10b-bc974e245162-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"10c75331-88b1-4742-b10b-bc974e245162\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 13 15:26:25.909818 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:26:25.909707    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/10c75331-88b1-4742-b10b-bc974e245162-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"10c75331-88b1-4742-b10b-bc974e245162\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 13 15:26:25.909818 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:26:25.909755    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/10c75331-88b1-4742-b10b-bc974e245162-config-volume\") pod \"alertmanager-main-0\" (UID: \"10c75331-88b1-4742-b10b-bc974e245162\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 13 15:26:25.909818 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:26:25.909791    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/10c75331-88b1-4742-b10b-bc974e245162-web-config\") pod \"alertmanager-main-0\" (UID: \"10c75331-88b1-4742-b10b-bc974e245162\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 13 15:26:25.909818 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:26:25.909815    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/10c75331-88b1-4742-b10b-bc974e245162-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"10c75331-88b1-4742-b10b-bc974e245162\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 13 15:26:25.910077 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:26:25.909831    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/10c75331-88b1-4742-b10b-bc974e245162-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"10c75331-88b1-4742-b10b-bc974e245162\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 13 15:26:25.910077 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:26:25.909856    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/10c75331-88b1-4742-b10b-bc974e245162-config-out\") pod \"alertmanager-main-0\" (UID: \"10c75331-88b1-4742-b10b-bc974e245162\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 13 15:26:25.910077 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:26:25.909898    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/10c75331-88b1-4742-b10b-bc974e245162-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"10c75331-88b1-4742-b10b-bc974e245162\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 13 15:26:25.910077 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:26:25.909919    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/10c75331-88b1-4742-b10b-bc974e245162-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"10c75331-88b1-4742-b10b-bc974e245162\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 13 15:26:26.010687 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:26:26.010650    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/10c75331-88b1-4742-b10b-bc974e245162-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"10c75331-88b1-4742-b10b-bc974e245162\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 13 15:26:26.010687 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:26:26.010691    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/10c75331-88b1-4742-b10b-bc974e245162-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"10c75331-88b1-4742-b10b-bc974e245162\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 13 15:26:26.010915 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:26:26.010715    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/10c75331-88b1-4742-b10b-bc974e245162-tls-assets\") pod \"alertmanager-main-0\" (UID: \"10c75331-88b1-4742-b10b-bc974e245162\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 13 15:26:26.010915 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:26:26.010734    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/10c75331-88b1-4742-b10b-bc974e245162-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"10c75331-88b1-4742-b10b-bc974e245162\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 13 15:26:26.010915 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:26:26.010888    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jjrg9\" (UniqueName: \"kubernetes.io/projected/10c75331-88b1-4742-b10b-bc974e245162-kube-api-access-jjrg9\") pod \"alertmanager-main-0\" (UID: \"10c75331-88b1-4742-b10b-bc974e245162\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 13 15:26:26.011077 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:26:26.010955    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/10c75331-88b1-4742-b10b-bc974e245162-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"10c75331-88b1-4742-b10b-bc974e245162\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 13 15:26:26.011077 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:26:26.010998    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/10c75331-88b1-4742-b10b-bc974e245162-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"10c75331-88b1-4742-b10b-bc974e245162\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 13 15:26:26.011077 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:26:26.011045    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/10c75331-88b1-4742-b10b-bc974e245162-config-volume\") pod \"alertmanager-main-0\" (UID: \"10c75331-88b1-4742-b10b-bc974e245162\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 13 15:26:26.011222 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:26:26.011075    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/10c75331-88b1-4742-b10b-bc974e245162-web-config\") pod \"alertmanager-main-0\" (UID: \"10c75331-88b1-4742-b10b-bc974e245162\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 13 15:26:26.011222 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:26:26.011112    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/10c75331-88b1-4742-b10b-bc974e245162-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"10c75331-88b1-4742-b10b-bc974e245162\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 13 15:26:26.011222 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:26:26.011136    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/10c75331-88b1-4742-b10b-bc974e245162-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"10c75331-88b1-4742-b10b-bc974e245162\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 13 15:26:26.011222 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:26:26.011155    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/10c75331-88b1-4742-b10b-bc974e245162-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"10c75331-88b1-4742-b10b-bc974e245162\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 13 15:26:26.011222 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:26:26.011175    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/10c75331-88b1-4742-b10b-bc974e245162-config-out\") pod \"alertmanager-main-0\" (UID: \"10c75331-88b1-4742-b10b-bc974e245162\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 13 15:26:26.011222 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:26:26.011216    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/10c75331-88b1-4742-b10b-bc974e245162-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"10c75331-88b1-4742-b10b-bc974e245162\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 13 15:26:26.012218 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:26:26.012185    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/10c75331-88b1-4742-b10b-bc974e245162-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"10c75331-88b1-4742-b10b-bc974e245162\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 13 15:26:26.013599 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:26:26.013569    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/10c75331-88b1-4742-b10b-bc974e245162-config-out\") pod \"alertmanager-main-0\" (UID: \"10c75331-88b1-4742-b10b-bc974e245162\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 13 15:26:26.013931 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:26:26.013842    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/10c75331-88b1-4742-b10b-bc974e245162-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"10c75331-88b1-4742-b10b-bc974e245162\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 13 15:26:26.013931 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:26:26.013859    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/10c75331-88b1-4742-b10b-bc974e245162-tls-assets\") pod \"alertmanager-main-0\" (UID: \"10c75331-88b1-4742-b10b-bc974e245162\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 13 15:26:26.013931 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:26:26.013842    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/10c75331-88b1-4742-b10b-bc974e245162-web-config\") pod \"alertmanager-main-0\" (UID: \"10c75331-88b1-4742-b10b-bc974e245162\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 13 15:26:26.014119 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:26:26.013997    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/10c75331-88b1-4742-b10b-bc974e245162-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"10c75331-88b1-4742-b10b-bc974e245162\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 13 15:26:26.014156 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:26:26.014109    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/10c75331-88b1-4742-b10b-bc974e245162-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"10c75331-88b1-4742-b10b-bc974e245162\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 13 15:26:26.014688 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:26:26.014665    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/10c75331-88b1-4742-b10b-bc974e245162-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"10c75331-88b1-4742-b10b-bc974e245162\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 13 15:26:26.014783 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:26:26.014761    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/10c75331-88b1-4742-b10b-bc974e245162-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"10c75331-88b1-4742-b10b-bc974e245162\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 13 15:26:26.014823 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:26:26.014797    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/10c75331-88b1-4742-b10b-bc974e245162-config-volume\") pod \"alertmanager-main-0\" (UID: \"10c75331-88b1-4742-b10b-bc974e245162\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 13 15:26:26.015716 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:26:26.015701    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/10c75331-88b1-4742-b10b-bc974e245162-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"10c75331-88b1-4742-b10b-bc974e245162\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 13 15:26:26.021237 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:26:26.021214    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jjrg9\" (UniqueName: \"kubernetes.io/projected/10c75331-88b1-4742-b10b-bc974e245162-kube-api-access-jjrg9\") pod \"alertmanager-main-0\" (UID: \"10c75331-88b1-4742-b10b-bc974e245162\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 13 15:26:26.113081 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:26:26.113029    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 13 15:26:26.254167 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:26:26.254144    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 13 15:26:26.255401 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:26:26.255377    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod10c75331_88b1_4742_b10b_bc974e245162.slice/crio-70ba07dfa945dbd483c9486ee8e0ba142122da50bfee1333f51f8064bfc90a64 WatchSource:0}: Error finding container 70ba07dfa945dbd483c9486ee8e0ba142122da50bfee1333f51f8064bfc90a64: Status 404 returned error can't find the container with id 70ba07dfa945dbd483c9486ee8e0ba142122da50bfee1333f51f8064bfc90a64
Jul 13 15:26:26.738104 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:26:26.738069    2564 generic.go:356] "Generic (PLEG): container finished" podID="10c75331-88b1-4742-b10b-bc974e245162" containerID="ca6120da65a9ef9839943a9af5d6d81564263ee724e107a1bcb842f10293bd1f" exitCode=0
Jul 13 15:26:26.738478 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:26:26.738136    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"10c75331-88b1-4742-b10b-bc974e245162","Type":"ContainerDied","Data":"ca6120da65a9ef9839943a9af5d6d81564263ee724e107a1bcb842f10293bd1f"}
Jul 13 15:26:26.738478 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:26:26.738191    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"10c75331-88b1-4742-b10b-bc974e245162","Type":"ContainerStarted","Data":"70ba07dfa945dbd483c9486ee8e0ba142122da50bfee1333f51f8064bfc90a64"}
Jul 13 15:26:27.120765 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:26:27.120729    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ca3d6543-c2c9-4225-a3c9-5045b863c183" path="/var/lib/kubelet/pods/ca3d6543-c2c9-4225-a3c9-5045b863c183/volumes"
Jul 13 15:26:27.749631 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:26:27.749596    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"10c75331-88b1-4742-b10b-bc974e245162","Type":"ContainerStarted","Data":"50949836b61b11cf994fcfb7636269bce25551509748d031b75a499b4554c68e"}
Jul 13 15:26:27.750003 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:26:27.749683    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"10c75331-88b1-4742-b10b-bc974e245162","Type":"ContainerStarted","Data":"8181f51f46e4bf4eac576c2493bc5b5133a400836c3762ff66eb26712509694d"}
Jul 13 15:26:27.750003 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:26:27.749717    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"10c75331-88b1-4742-b10b-bc974e245162","Type":"ContainerStarted","Data":"636d7ad9197bf815bad3b9a5614a575d622ab189b09db81848ec9848f200563e"}
Jul 13 15:26:27.750003 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:26:27.749741    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"10c75331-88b1-4742-b10b-bc974e245162","Type":"ContainerStarted","Data":"a93335ca52ff102a435d4e69dab24369468569a2361017c70d39d007cad524a3"}
Jul 13 15:26:27.750003 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:26:27.749762    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"10c75331-88b1-4742-b10b-bc974e245162","Type":"ContainerStarted","Data":"ae43706f74ef51aef45df3a0581e695743e88516745dcb9cc50b85ccb0c10a19"}
Jul 13 15:26:27.750003 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:26:27.749787    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"10c75331-88b1-4742-b10b-bc974e245162","Type":"ContainerStarted","Data":"a33cd3b7fed445eb5b5c23da594b930a6d15b513951e16e0557181f1144c2daf"}
Jul 13 15:26:27.783709 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:26:27.783659    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.768000718 podStartE2EDuration="2.783643462s" totalImagesPullingTime="0s" totalInitContainerRuntime="15.642744ms" isStatefulPod=false podCreationTimestamp="2026-07-13 15:26:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 15:26:27.782396775 +0000 UTC m=+141.361631956" watchObservedRunningTime="2026-07-13 15:26:27.783643462 +0000 UTC m=+141.362878668"
Jul 13 15:26:29.328664 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:26:29.328629    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-5cf68d78f7-l9sbr"]
Jul 13 15:26:29.331077 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:26:29.331060    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5cf68d78f7-l9sbr"
Jul 13 15:26:29.333636 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:26:29.333612    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Jul 13 15:26:29.333789 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:26:29.333638    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Jul 13 15:26:29.333789 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:26:29.333670    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-mgdfp\""
Jul 13 15:26:29.333789 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:26:29.333618    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Jul 13 15:26:29.334329 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:26:29.334312    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Jul 13 15:26:29.334450 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:26:29.334435    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Jul 13 15:26:29.334509 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:26:29.334449    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Jul 13 15:26:29.334690 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:26:29.334674    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Jul 13 15:26:29.340203 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:26:29.340183    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Jul 13 15:26:29.346352 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:26:29.346327    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5cf68d78f7-l9sbr"]
Jul 13 15:26:29.437113 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:26:29.437078    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v6mx4\" (UniqueName: \"kubernetes.io/projected/fb17c356-2f90-411a-8fc8-1b2116ad787f-kube-api-access-v6mx4\") pod \"console-5cf68d78f7-l9sbr\" (UID: \"fb17c356-2f90-411a-8fc8-1b2116ad787f\") " pod="openshift-console/console-5cf68d78f7-l9sbr"
Jul 13 15:26:29.437113 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:26:29.437113    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/fb17c356-2f90-411a-8fc8-1b2116ad787f-console-config\") pod \"console-5cf68d78f7-l9sbr\" (UID: \"fb17c356-2f90-411a-8fc8-1b2116ad787f\") " pod="openshift-console/console-5cf68d78f7-l9sbr"
Jul 13 15:26:29.437312 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:26:29.437138    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/fb17c356-2f90-411a-8fc8-1b2116ad787f-console-serving-cert\") pod \"console-5cf68d78f7-l9sbr\" (UID: \"fb17c356-2f90-411a-8fc8-1b2116ad787f\") " pod="openshift-console/console-5cf68d78f7-l9sbr"
Jul 13 15:26:29.437312 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:26:29.437220    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/fb17c356-2f90-411a-8fc8-1b2116ad787f-console-oauth-config\") pod \"console-5cf68d78f7-l9sbr\" (UID: \"fb17c356-2f90-411a-8fc8-1b2116ad787f\") " pod="openshift-console/console-5cf68d78f7-l9sbr"
Jul 13 15:26:29.437312 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:26:29.437253    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fb17c356-2f90-411a-8fc8-1b2116ad787f-trusted-ca-bundle\") pod \"console-5cf68d78f7-l9sbr\" (UID: \"fb17c356-2f90-411a-8fc8-1b2116ad787f\") " pod="openshift-console/console-5cf68d78f7-l9sbr"
Jul 13 15:26:29.437312 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:26:29.437282    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/fb17c356-2f90-411a-8fc8-1b2116ad787f-oauth-serving-cert\") pod \"console-5cf68d78f7-l9sbr\" (UID: \"fb17c356-2f90-411a-8fc8-1b2116ad787f\") " pod="openshift-console/console-5cf68d78f7-l9sbr"
Jul 13 15:26:29.437430 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:26:29.437323    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/fb17c356-2f90-411a-8fc8-1b2116ad787f-service-ca\") pod \"console-5cf68d78f7-l9sbr\" (UID: \"fb17c356-2f90-411a-8fc8-1b2116ad787f\") " pod="openshift-console/console-5cf68d78f7-l9sbr"
Jul 13 15:26:29.538704 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:26:29.538666    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/fb17c356-2f90-411a-8fc8-1b2116ad787f-console-oauth-config\") pod \"console-5cf68d78f7-l9sbr\" (UID: \"fb17c356-2f90-411a-8fc8-1b2116ad787f\") " pod="openshift-console/console-5cf68d78f7-l9sbr"
Jul 13 15:26:29.538704 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:26:29.538705    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fb17c356-2f90-411a-8fc8-1b2116ad787f-trusted-ca-bundle\") pod \"console-5cf68d78f7-l9sbr\" (UID: \"fb17c356-2f90-411a-8fc8-1b2116ad787f\") " pod="openshift-console/console-5cf68d78f7-l9sbr"
Jul 13 15:26:29.539008 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:26:29.538731    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/fb17c356-2f90-411a-8fc8-1b2116ad787f-oauth-serving-cert\") pod \"console-5cf68d78f7-l9sbr\" (UID: \"fb17c356-2f90-411a-8fc8-1b2116ad787f\") " pod="openshift-console/console-5cf68d78f7-l9sbr"
Jul 13 15:26:29.539008 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:26:29.538757    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/fb17c356-2f90-411a-8fc8-1b2116ad787f-service-ca\") pod \"console-5cf68d78f7-l9sbr\" (UID: \"fb17c356-2f90-411a-8fc8-1b2116ad787f\") " pod="openshift-console/console-5cf68d78f7-l9sbr"
Jul 13 15:26:29.539008 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:26:29.538790    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v6mx4\" (UniqueName: \"kubernetes.io/projected/fb17c356-2f90-411a-8fc8-1b2116ad787f-kube-api-access-v6mx4\") pod \"console-5cf68d78f7-l9sbr\" (UID: \"fb17c356-2f90-411a-8fc8-1b2116ad787f\") " pod="openshift-console/console-5cf68d78f7-l9sbr"
Jul 13 15:26:29.539008 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:26:29.538808    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/fb17c356-2f90-411a-8fc8-1b2116ad787f-console-config\") pod \"console-5cf68d78f7-l9sbr\" (UID: \"fb17c356-2f90-411a-8fc8-1b2116ad787f\") " pod="openshift-console/console-5cf68d78f7-l9sbr"
Jul 13 15:26:29.539008 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:26:29.538830    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/fb17c356-2f90-411a-8fc8-1b2116ad787f-console-serving-cert\") pod \"console-5cf68d78f7-l9sbr\" (UID: \"fb17c356-2f90-411a-8fc8-1b2116ad787f\") " pod="openshift-console/console-5cf68d78f7-l9sbr"
Jul 13 15:26:29.539663 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:26:29.539627    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/fb17c356-2f90-411a-8fc8-1b2116ad787f-service-ca\") pod \"console-5cf68d78f7-l9sbr\" (UID: \"fb17c356-2f90-411a-8fc8-1b2116ad787f\") " pod="openshift-console/console-5cf68d78f7-l9sbr"
Jul 13 15:26:29.539781 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:26:29.539635    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/fb17c356-2f90-411a-8fc8-1b2116ad787f-oauth-serving-cert\") pod \"console-5cf68d78f7-l9sbr\" (UID: \"fb17c356-2f90-411a-8fc8-1b2116ad787f\") " pod="openshift-console/console-5cf68d78f7-l9sbr"
Jul 13 15:26:29.539781 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:26:29.539764    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/fb17c356-2f90-411a-8fc8-1b2116ad787f-console-config\") pod \"console-5cf68d78f7-l9sbr\" (UID: \"fb17c356-2f90-411a-8fc8-1b2116ad787f\") " pod="openshift-console/console-5cf68d78f7-l9sbr"
Jul 13 15:26:29.539905 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:26:29.539857    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fb17c356-2f90-411a-8fc8-1b2116ad787f-trusted-ca-bundle\") pod \"console-5cf68d78f7-l9sbr\" (UID: \"fb17c356-2f90-411a-8fc8-1b2116ad787f\") " pod="openshift-console/console-5cf68d78f7-l9sbr"
Jul 13 15:26:29.541302 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:26:29.541283    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/fb17c356-2f90-411a-8fc8-1b2116ad787f-console-oauth-config\") pod \"console-5cf68d78f7-l9sbr\" (UID: \"fb17c356-2f90-411a-8fc8-1b2116ad787f\") " pod="openshift-console/console-5cf68d78f7-l9sbr"
Jul 13 15:26:29.541386 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:26:29.541371    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/fb17c356-2f90-411a-8fc8-1b2116ad787f-console-serving-cert\") pod \"console-5cf68d78f7-l9sbr\" (UID: \"fb17c356-2f90-411a-8fc8-1b2116ad787f\") " pod="openshift-console/console-5cf68d78f7-l9sbr"
Jul 13 15:26:29.548954 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:26:29.548927    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v6mx4\" (UniqueName: \"kubernetes.io/projected/fb17c356-2f90-411a-8fc8-1b2116ad787f-kube-api-access-v6mx4\") pod \"console-5cf68d78f7-l9sbr\" (UID: \"fb17c356-2f90-411a-8fc8-1b2116ad787f\") " pod="openshift-console/console-5cf68d78f7-l9sbr"
Jul 13 15:26:29.640266 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:26:29.640236    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5cf68d78f7-l9sbr"
Jul 13 15:26:29.774509 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:26:29.774484    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5cf68d78f7-l9sbr"]
Jul 13 15:26:29.776425 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:26:29.776394    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfb17c356_2f90_411a_8fc8_1b2116ad787f.slice/crio-2bd37c1fe47316eb433114662e5d07d082bf0296f09af39fdc0d651e13210ee0 WatchSource:0}: Error finding container 2bd37c1fe47316eb433114662e5d07d082bf0296f09af39fdc0d651e13210ee0: Status 404 returned error can't find the container with id 2bd37c1fe47316eb433114662e5d07d082bf0296f09af39fdc0d651e13210ee0
Jul 13 15:26:30.764201 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:26:30.764165    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5cf68d78f7-l9sbr" event={"ID":"fb17c356-2f90-411a-8fc8-1b2116ad787f","Type":"ContainerStarted","Data":"d6d88196ed853785bbbc622e8c740b2726ec7b3f0805ec6d8ada95be607bad5d"}
Jul 13 15:26:30.764541 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:26:30.764246    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5cf68d78f7-l9sbr" event={"ID":"fb17c356-2f90-411a-8fc8-1b2116ad787f","Type":"ContainerStarted","Data":"2bd37c1fe47316eb433114662e5d07d082bf0296f09af39fdc0d651e13210ee0"}
Jul 13 15:26:30.784233 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:26:30.784184    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-5cf68d78f7-l9sbr" podStartSLOduration=1.784169489 podStartE2EDuration="1.784169489s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 15:26:29 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 15:26:30.783842111 +0000 UTC m=+144.363077312" watchObservedRunningTime="2026-07-13 15:26:30.784169489 +0000 UTC m=+144.363404665"
Jul 13 15:26:39.641095 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:26:39.641058    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-5cf68d78f7-l9sbr"
Jul 13 15:26:39.641562 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:26:39.641126    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-5cf68d78f7-l9sbr"
Jul 13 15:26:39.645916 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:26:39.645891    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-5cf68d78f7-l9sbr"
Jul 13 15:26:39.802193 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:26:39.802166    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-5cf68d78f7-l9sbr"
Jul 13 15:27:24.394921 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:27:24.394860    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675407m8sj"]
Jul 13 15:27:24.398462 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:27:24.398442    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675407m8sj"
Jul 13 15:27:24.402090 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:27:24.402067    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Jul 13 15:27:24.402634 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:27:24.402618    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Jul 13 15:27:24.402725 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:27:24.402620    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-7cvtw\""
Jul 13 15:27:24.410977 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:27:24.410952    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675407m8sj"]
Jul 13 15:27:24.478577 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:27:24.478542    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/acc51147-22da-4b7d-8295-8f77067efe70-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675407m8sj\" (UID: \"acc51147-22da-4b7d-8295-8f77067efe70\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675407m8sj"
Jul 13 15:27:24.478774 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:27:24.478599    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zn2qz\" (UniqueName: \"kubernetes.io/projected/acc51147-22da-4b7d-8295-8f77067efe70-kube-api-access-zn2qz\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675407m8sj\" (UID: \"acc51147-22da-4b7d-8295-8f77067efe70\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675407m8sj"
Jul 13 15:27:24.478774 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:27:24.478658    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/acc51147-22da-4b7d-8295-8f77067efe70-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675407m8sj\" (UID: \"acc51147-22da-4b7d-8295-8f77067efe70\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675407m8sj"
Jul 13 15:27:24.579566 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:27:24.579523    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zn2qz\" (UniqueName: \"kubernetes.io/projected/acc51147-22da-4b7d-8295-8f77067efe70-kube-api-access-zn2qz\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675407m8sj\" (UID: \"acc51147-22da-4b7d-8295-8f77067efe70\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675407m8sj"
Jul 13 15:27:24.579566 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:27:24.579576    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/acc51147-22da-4b7d-8295-8f77067efe70-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675407m8sj\" (UID: \"acc51147-22da-4b7d-8295-8f77067efe70\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675407m8sj"
Jul 13 15:27:24.579830 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:27:24.579635    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/acc51147-22da-4b7d-8295-8f77067efe70-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675407m8sj\" (UID: \"acc51147-22da-4b7d-8295-8f77067efe70\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675407m8sj"
Jul 13 15:27:24.580075 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:27:24.580053    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/acc51147-22da-4b7d-8295-8f77067efe70-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675407m8sj\" (UID: \"acc51147-22da-4b7d-8295-8f77067efe70\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675407m8sj"
Jul 13 15:27:24.580075 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:27:24.580069    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/acc51147-22da-4b7d-8295-8f77067efe70-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675407m8sj\" (UID: \"acc51147-22da-4b7d-8295-8f77067efe70\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675407m8sj"
Jul 13 15:27:24.590580 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:27:24.590555    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zn2qz\" (UniqueName: \"kubernetes.io/projected/acc51147-22da-4b7d-8295-8f77067efe70-kube-api-access-zn2qz\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675407m8sj\" (UID: \"acc51147-22da-4b7d-8295-8f77067efe70\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675407m8sj"
Jul 13 15:27:24.707513 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:27:24.707427    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675407m8sj"
Jul 13 15:27:24.841025 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:27:24.840993    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675407m8sj"]
Jul 13 15:27:24.844173 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:27:24.844139    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podacc51147_22da_4b7d_8295_8f77067efe70.slice/crio-770edc9793947b6546bd463c99b2760fd28af16fd5659d1132393afed920b093 WatchSource:0}: Error finding container 770edc9793947b6546bd463c99b2760fd28af16fd5659d1132393afed920b093: Status 404 returned error can't find the container with id 770edc9793947b6546bd463c99b2760fd28af16fd5659d1132393afed920b093
Jul 13 15:27:24.957698 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:27:24.957607    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675407m8sj" event={"ID":"acc51147-22da-4b7d-8295-8f77067efe70","Type":"ContainerStarted","Data":"770edc9793947b6546bd463c99b2760fd28af16fd5659d1132393afed920b093"}
Jul 13 15:27:31.987054 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:27:31.987012    2564 generic.go:356] "Generic (PLEG): container finished" podID="acc51147-22da-4b7d-8295-8f77067efe70" containerID="0f05ca7c4e8084334caf5b4880c1335ab743d57deea2ea08b416e9ce5631fc19" exitCode=0
Jul 13 15:27:31.987448 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:27:31.987101    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675407m8sj" event={"ID":"acc51147-22da-4b7d-8295-8f77067efe70","Type":"ContainerDied","Data":"0f05ca7c4e8084334caf5b4880c1335ab743d57deea2ea08b416e9ce5631fc19"}
Jul 13 15:27:35.000761 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:27:35.000728    2564 generic.go:356] "Generic (PLEG): container finished" podID="acc51147-22da-4b7d-8295-8f77067efe70" containerID="1fb88d516f88aefd99b574d49d88c62a1c976bcb849b2734bd0d957cba325a95" exitCode=0
Jul 13 15:27:35.001181 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:27:35.000821    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675407m8sj" event={"ID":"acc51147-22da-4b7d-8295-8f77067efe70","Type":"ContainerDied","Data":"1fb88d516f88aefd99b574d49d88c62a1c976bcb849b2734bd0d957cba325a95"}
Jul 13 15:27:44.038485 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:27:44.038453    2564 generic.go:356] "Generic (PLEG): container finished" podID="acc51147-22da-4b7d-8295-8f77067efe70" containerID="184ddeb674f5148197b56694cc210cfea6fa21eec80e3fdefd0fddb16195ed75" exitCode=0
Jul 13 15:27:44.038836 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:27:44.038513    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675407m8sj" event={"ID":"acc51147-22da-4b7d-8295-8f77067efe70","Type":"ContainerDied","Data":"184ddeb674f5148197b56694cc210cfea6fa21eec80e3fdefd0fddb16195ed75"}
Jul 13 15:27:45.165297 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:27:45.165273    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675407m8sj"
Jul 13 15:27:45.266105 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:27:45.266080    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/acc51147-22da-4b7d-8295-8f77067efe70-util\") pod \"acc51147-22da-4b7d-8295-8f77067efe70\" (UID: \"acc51147-22da-4b7d-8295-8f77067efe70\") "
Jul 13 15:27:45.266296 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:27:45.266119    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/acc51147-22da-4b7d-8295-8f77067efe70-bundle\") pod \"acc51147-22da-4b7d-8295-8f77067efe70\" (UID: \"acc51147-22da-4b7d-8295-8f77067efe70\") "
Jul 13 15:27:45.266296 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:27:45.266161    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zn2qz\" (UniqueName: \"kubernetes.io/projected/acc51147-22da-4b7d-8295-8f77067efe70-kube-api-access-zn2qz\") pod \"acc51147-22da-4b7d-8295-8f77067efe70\" (UID: \"acc51147-22da-4b7d-8295-8f77067efe70\") "
Jul 13 15:27:45.266998 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:27:45.266970    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/acc51147-22da-4b7d-8295-8f77067efe70-bundle" (OuterVolumeSpecName: "bundle") pod "acc51147-22da-4b7d-8295-8f77067efe70" (UID: "acc51147-22da-4b7d-8295-8f77067efe70"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 15:27:45.269088 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:27:45.269059    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/acc51147-22da-4b7d-8295-8f77067efe70-kube-api-access-zn2qz" (OuterVolumeSpecName: "kube-api-access-zn2qz") pod "acc51147-22da-4b7d-8295-8f77067efe70" (UID: "acc51147-22da-4b7d-8295-8f77067efe70"). InnerVolumeSpecName "kube-api-access-zn2qz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 13 15:27:45.270515 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:27:45.270486    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/acc51147-22da-4b7d-8295-8f77067efe70-util" (OuterVolumeSpecName: "util") pod "acc51147-22da-4b7d-8295-8f77067efe70" (UID: "acc51147-22da-4b7d-8295-8f77067efe70"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 15:27:45.366810 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:27:45.366720    2564 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/acc51147-22da-4b7d-8295-8f77067efe70-util\") on node \"ip-10-0-140-255.ec2.internal\" DevicePath \"\""
Jul 13 15:27:45.366810 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:27:45.366750    2564 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/acc51147-22da-4b7d-8295-8f77067efe70-bundle\") on node \"ip-10-0-140-255.ec2.internal\" DevicePath \"\""
Jul 13 15:27:45.366810 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:27:45.366760    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zn2qz\" (UniqueName: \"kubernetes.io/projected/acc51147-22da-4b7d-8295-8f77067efe70-kube-api-access-zn2qz\") on node \"ip-10-0-140-255.ec2.internal\" DevicePath \"\""
Jul 13 15:27:46.050107 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:27:46.049633    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675407m8sj" event={"ID":"acc51147-22da-4b7d-8295-8f77067efe70","Type":"ContainerDied","Data":"770edc9793947b6546bd463c99b2760fd28af16fd5659d1132393afed920b093"}
Jul 13 15:27:46.050107 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:27:46.049731    2564 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="770edc9793947b6546bd463c99b2760fd28af16fd5659d1132393afed920b093"
Jul 13 15:27:46.050107 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:27:46.049839    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675407m8sj"
Jul 13 15:27:52.775247 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:27:52.775211    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-cbqxq"]
Jul 13 15:27:52.775675 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:27:52.775524    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="acc51147-22da-4b7d-8295-8f77067efe70" containerName="util"
Jul 13 15:27:52.775675 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:27:52.775536    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="acc51147-22da-4b7d-8295-8f77067efe70" containerName="util"
Jul 13 15:27:52.775675 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:27:52.775546    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="acc51147-22da-4b7d-8295-8f77067efe70" containerName="extract"
Jul 13 15:27:52.775675 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:27:52.775554    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="acc51147-22da-4b7d-8295-8f77067efe70" containerName="extract"
Jul 13 15:27:52.775675 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:27:52.775572    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="acc51147-22da-4b7d-8295-8f77067efe70" containerName="pull"
Jul 13 15:27:52.775675 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:27:52.775578    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="acc51147-22da-4b7d-8295-8f77067efe70" containerName="pull"
Jul 13 15:27:52.775675 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:27:52.775633    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="acc51147-22da-4b7d-8295-8f77067efe70" containerName="extract"
Jul 13 15:27:52.777570 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:27:52.777552    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-cbqxq"
Jul 13 15:27:52.780356 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:27:52.780333    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-j5kkf\""
Jul 13 15:27:52.780678 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:27:52.780660    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\""
Jul 13 15:27:52.780724 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:27:52.780713    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\""
Jul 13 15:27:52.790946 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:27:52.790923    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-cbqxq"]
Jul 13 15:27:52.926018 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:27:52.925968    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vnwks\" (UniqueName: \"kubernetes.io/projected/64b3f0f0-2f1d-4ab3-a529-836c6ecd0812-kube-api-access-vnwks\") pod \"cert-manager-operator-controller-manager-55c444bf86-cbqxq\" (UID: \"64b3f0f0-2f1d-4ab3-a529-836c6ecd0812\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-cbqxq"
Jul 13 15:27:52.926213 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:27:52.926040    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/64b3f0f0-2f1d-4ab3-a529-836c6ecd0812-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-cbqxq\" (UID: \"64b3f0f0-2f1d-4ab3-a529-836c6ecd0812\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-cbqxq"
Jul 13 15:27:53.026935 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:27:53.026840    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vnwks\" (UniqueName: \"kubernetes.io/projected/64b3f0f0-2f1d-4ab3-a529-836c6ecd0812-kube-api-access-vnwks\") pod \"cert-manager-operator-controller-manager-55c444bf86-cbqxq\" (UID: \"64b3f0f0-2f1d-4ab3-a529-836c6ecd0812\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-cbqxq"
Jul 13 15:27:53.026935 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:27:53.026903    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/64b3f0f0-2f1d-4ab3-a529-836c6ecd0812-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-cbqxq\" (UID: \"64b3f0f0-2f1d-4ab3-a529-836c6ecd0812\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-cbqxq"
Jul 13 15:27:53.027233 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:27:53.027213    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/64b3f0f0-2f1d-4ab3-a529-836c6ecd0812-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-cbqxq\" (UID: \"64b3f0f0-2f1d-4ab3-a529-836c6ecd0812\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-cbqxq"
Jul 13 15:27:53.037125 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:27:53.037100    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vnwks\" (UniqueName: \"kubernetes.io/projected/64b3f0f0-2f1d-4ab3-a529-836c6ecd0812-kube-api-access-vnwks\") pod \"cert-manager-operator-controller-manager-55c444bf86-cbqxq\" (UID: \"64b3f0f0-2f1d-4ab3-a529-836c6ecd0812\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-cbqxq"
Jul 13 15:27:53.086443 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:27:53.086409    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-cbqxq"
Jul 13 15:27:53.223141 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:27:53.223117    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-cbqxq"]
Jul 13 15:27:53.226146 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:27:53.226116    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod64b3f0f0_2f1d_4ab3_a529_836c6ecd0812.slice/crio-1ff3a95ca8d83e32811fc2c31f0e2b6679f3fb8a2deed4ae7d53246f3d812be8 WatchSource:0}: Error finding container 1ff3a95ca8d83e32811fc2c31f0e2b6679f3fb8a2deed4ae7d53246f3d812be8: Status 404 returned error can't find the container with id 1ff3a95ca8d83e32811fc2c31f0e2b6679f3fb8a2deed4ae7d53246f3d812be8
Jul 13 15:27:54.084180 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:27:54.084134    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-cbqxq" event={"ID":"64b3f0f0-2f1d-4ab3-a529-836c6ecd0812","Type":"ContainerStarted","Data":"1ff3a95ca8d83e32811fc2c31f0e2b6679f3fb8a2deed4ae7d53246f3d812be8"}
Jul 13 15:27:55.090287 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:27:55.090251    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-cbqxq" event={"ID":"64b3f0f0-2f1d-4ab3-a529-836c6ecd0812","Type":"ContainerStarted","Data":"bd4b40ebd505472a30c6242021abbaee3c7443c57b279591af9490bf2362a55e"}
Jul 13 15:27:55.119569 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:27:55.119516    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-cbqxq" podStartSLOduration=1.418417155 podStartE2EDuration="3.119499619s" totalImagesPullingTime="1.701082464s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 15:27:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 15:27:55.117214947 +0000 UTC m=+228.696450158" watchObservedRunningTime="2026-07-13 15:27:55.119499619 +0000 UTC m=+228.698734797"
Jul 13 15:27:56.468351 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:27:56.468314    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ffg488"]
Jul 13 15:27:56.470636 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:27:56.470619    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ffg488"
Jul 13 15:27:56.473412 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:27:56.473386    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Jul 13 15:27:56.474384 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:27:56.474347    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Jul 13 15:27:56.474454 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:27:56.474347    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-7cvtw\""
Jul 13 15:27:56.482904 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:27:56.482861    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ffg488"]
Jul 13 15:27:56.556537 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:27:56.556502    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9286f073-6989-43a6-a325-ef0dde31344e-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ffg488\" (UID: \"9286f073-6989-43a6-a325-ef0dde31344e\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ffg488"
Jul 13 15:27:56.556734 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:27:56.556571    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nl5rs\" (UniqueName: \"kubernetes.io/projected/9286f073-6989-43a6-a325-ef0dde31344e-kube-api-access-nl5rs\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ffg488\" (UID: \"9286f073-6989-43a6-a325-ef0dde31344e\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ffg488"
Jul 13 15:27:56.556734 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:27:56.556606    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9286f073-6989-43a6-a325-ef0dde31344e-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ffg488\" (UID: \"9286f073-6989-43a6-a325-ef0dde31344e\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ffg488"
Jul 13 15:27:56.657910 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:27:56.657852    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nl5rs\" (UniqueName: \"kubernetes.io/projected/9286f073-6989-43a6-a325-ef0dde31344e-kube-api-access-nl5rs\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ffg488\" (UID: \"9286f073-6989-43a6-a325-ef0dde31344e\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ffg488"
Jul 13 15:27:56.657910 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:27:56.657916    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9286f073-6989-43a6-a325-ef0dde31344e-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ffg488\" (UID: \"9286f073-6989-43a6-a325-ef0dde31344e\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ffg488"
Jul 13 15:27:56.658417 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:27:56.658392    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9286f073-6989-43a6-a325-ef0dde31344e-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ffg488\" (UID: \"9286f073-6989-43a6-a325-ef0dde31344e\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ffg488"
Jul 13 15:27:56.658531 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:27:56.658516    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9286f073-6989-43a6-a325-ef0dde31344e-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ffg488\" (UID: \"9286f073-6989-43a6-a325-ef0dde31344e\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ffg488"
Jul 13 15:27:56.658757 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:27:56.658739    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9286f073-6989-43a6-a325-ef0dde31344e-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ffg488\" (UID: \"9286f073-6989-43a6-a325-ef0dde31344e\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ffg488"
Jul 13 15:27:56.668086 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:27:56.668062    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nl5rs\" (UniqueName: \"kubernetes.io/projected/9286f073-6989-43a6-a325-ef0dde31344e-kube-api-access-nl5rs\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ffg488\" (UID: \"9286f073-6989-43a6-a325-ef0dde31344e\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ffg488"
Jul 13 15:27:56.779788 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:27:56.779698    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ffg488"
Jul 13 15:27:56.909217 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:27:56.909188    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ffg488"]
Jul 13 15:27:56.911697 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:27:56.911669    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9286f073_6989_43a6_a325_ef0dde31344e.slice/crio-dd4fda65e1ee96bafe347b8fb0f597633995faec1b568309e43c2d0f8de84384 WatchSource:0}: Error finding container dd4fda65e1ee96bafe347b8fb0f597633995faec1b568309e43c2d0f8de84384: Status 404 returned error can't find the container with id dd4fda65e1ee96bafe347b8fb0f597633995faec1b568309e43c2d0f8de84384
Jul 13 15:27:57.099928 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:27:57.099815    2564 generic.go:356] "Generic (PLEG): container finished" podID="9286f073-6989-43a6-a325-ef0dde31344e" containerID="b80012793406e14f96c0d1f86167ad87964d8786eb698b920a468b90caee5458" exitCode=0
Jul 13 15:27:57.100075 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:27:57.099915    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ffg488" event={"ID":"9286f073-6989-43a6-a325-ef0dde31344e","Type":"ContainerDied","Data":"b80012793406e14f96c0d1f86167ad87964d8786eb698b920a468b90caee5458"}
Jul 13 15:27:57.100075 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:27:57.099972    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ffg488" event={"ID":"9286f073-6989-43a6-a325-ef0dde31344e","Type":"ContainerStarted","Data":"dd4fda65e1ee96bafe347b8fb0f597633995faec1b568309e43c2d0f8de84384"}
Jul 13 15:27:58.429352 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:27:58.429317    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-kvbv2"]
Jul 13 15:27:58.431857 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:27:58.431834    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-kvbv2"
Jul 13 15:27:58.436299 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:27:58.436277    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
Jul 13 15:27:58.437114 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:27:58.437097    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
Jul 13 15:27:58.437217 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:27:58.437097    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-wpl6c\""
Jul 13 15:27:58.445523 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:27:58.445501    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-kvbv2"]
Jul 13 15:27:58.576844 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:27:58.576808    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hkpks\" (UniqueName: \"kubernetes.io/projected/aa87b953-68a6-4ede-b57e-10b8968cd405-kube-api-access-hkpks\") pod \"cert-manager-cainjector-559cdd8c87-kvbv2\" (UID: \"aa87b953-68a6-4ede-b57e-10b8968cd405\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-kvbv2"
Jul 13 15:27:58.577040 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:27:58.576852    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/aa87b953-68a6-4ede-b57e-10b8968cd405-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-kvbv2\" (UID: \"aa87b953-68a6-4ede-b57e-10b8968cd405\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-kvbv2"
Jul 13 15:27:58.678198 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:27:58.678162    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hkpks\" (UniqueName: \"kubernetes.io/projected/aa87b953-68a6-4ede-b57e-10b8968cd405-kube-api-access-hkpks\") pod \"cert-manager-cainjector-559cdd8c87-kvbv2\" (UID: \"aa87b953-68a6-4ede-b57e-10b8968cd405\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-kvbv2"
Jul 13 15:27:58.678385 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:27:58.678211    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/aa87b953-68a6-4ede-b57e-10b8968cd405-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-kvbv2\" (UID: \"aa87b953-68a6-4ede-b57e-10b8968cd405\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-kvbv2"
Jul 13 15:27:58.690230 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:27:58.690155    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/aa87b953-68a6-4ede-b57e-10b8968cd405-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-kvbv2\" (UID: \"aa87b953-68a6-4ede-b57e-10b8968cd405\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-kvbv2"
Jul 13 15:27:58.690422 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:27:58.690398    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hkpks\" (UniqueName: \"kubernetes.io/projected/aa87b953-68a6-4ede-b57e-10b8968cd405-kube-api-access-hkpks\") pod \"cert-manager-cainjector-559cdd8c87-kvbv2\" (UID: \"aa87b953-68a6-4ede-b57e-10b8968cd405\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-kvbv2"
Jul 13 15:27:58.756084 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:27:58.756047    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-kvbv2"
Jul 13 15:27:59.337831 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:27:59.337801    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-kvbv2"]
Jul 13 15:27:59.341401 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:27:59.341371    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podaa87b953_68a6_4ede_b57e_10b8968cd405.slice/crio-4176b1adad59d201a3f2475b1e9d9ca4e038324b684866ac795ce0cc05070d7a WatchSource:0}: Error finding container 4176b1adad59d201a3f2475b1e9d9ca4e038324b684866ac795ce0cc05070d7a: Status 404 returned error can't find the container with id 4176b1adad59d201a3f2475b1e9d9ca4e038324b684866ac795ce0cc05070d7a
Jul 13 15:28:00.115524 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:28:00.115427    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-kvbv2" event={"ID":"aa87b953-68a6-4ede-b57e-10b8968cd405","Type":"ContainerStarted","Data":"4176b1adad59d201a3f2475b1e9d9ca4e038324b684866ac795ce0cc05070d7a"}
Jul 13 15:28:00.117282 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:28:00.117255    2564 generic.go:356] "Generic (PLEG): container finished" podID="9286f073-6989-43a6-a325-ef0dde31344e" containerID="5ba2d14291591f0bb22a42775c58d6e4d394a236a69e7d54c8cd3710d75dddc4" exitCode=0
Jul 13 15:28:00.117380 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:28:00.117343    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ffg488" event={"ID":"9286f073-6989-43a6-a325-ef0dde31344e","Type":"ContainerDied","Data":"5ba2d14291591f0bb22a42775c58d6e4d394a236a69e7d54c8cd3710d75dddc4"}
Jul 13 15:28:01.122770 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:28:01.122731    2564 generic.go:356] "Generic (PLEG): container finished" podID="9286f073-6989-43a6-a325-ef0dde31344e" containerID="33462cd39792b55baa5ba2156351ceb9d2e2eae4e37c1135dd7678b9c47faf7f" exitCode=0
Jul 13 15:28:01.123163 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:28:01.122810    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ffg488" event={"ID":"9286f073-6989-43a6-a325-ef0dde31344e","Type":"ContainerDied","Data":"33462cd39792b55baa5ba2156351ceb9d2e2eae4e37c1135dd7678b9c47faf7f"}
Jul 13 15:28:02.256451 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:28:02.256423    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ffg488"
Jul 13 15:28:02.309996 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:28:02.309954    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nl5rs\" (UniqueName: \"kubernetes.io/projected/9286f073-6989-43a6-a325-ef0dde31344e-kube-api-access-nl5rs\") pod \"9286f073-6989-43a6-a325-ef0dde31344e\" (UID: \"9286f073-6989-43a6-a325-ef0dde31344e\") "
Jul 13 15:28:02.310208 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:28:02.310010    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9286f073-6989-43a6-a325-ef0dde31344e-util\") pod \"9286f073-6989-43a6-a325-ef0dde31344e\" (UID: \"9286f073-6989-43a6-a325-ef0dde31344e\") "
Jul 13 15:28:02.310208 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:28:02.310036    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9286f073-6989-43a6-a325-ef0dde31344e-bundle\") pod \"9286f073-6989-43a6-a325-ef0dde31344e\" (UID: \"9286f073-6989-43a6-a325-ef0dde31344e\") "
Jul 13 15:28:02.310474 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:28:02.310449    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9286f073-6989-43a6-a325-ef0dde31344e-bundle" (OuterVolumeSpecName: "bundle") pod "9286f073-6989-43a6-a325-ef0dde31344e" (UID: "9286f073-6989-43a6-a325-ef0dde31344e"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 15:28:02.312044 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:28:02.312017    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9286f073-6989-43a6-a325-ef0dde31344e-kube-api-access-nl5rs" (OuterVolumeSpecName: "kube-api-access-nl5rs") pod "9286f073-6989-43a6-a325-ef0dde31344e" (UID: "9286f073-6989-43a6-a325-ef0dde31344e"). InnerVolumeSpecName "kube-api-access-nl5rs". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 13 15:28:02.410849 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:28:02.410806    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nl5rs\" (UniqueName: \"kubernetes.io/projected/9286f073-6989-43a6-a325-ef0dde31344e-kube-api-access-nl5rs\") on node \"ip-10-0-140-255.ec2.internal\" DevicePath \"\""
Jul 13 15:28:02.410849 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:28:02.410837    2564 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9286f073-6989-43a6-a325-ef0dde31344e-bundle\") on node \"ip-10-0-140-255.ec2.internal\" DevicePath \"\""
Jul 13 15:28:02.412711 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:28:02.412673    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9286f073-6989-43a6-a325-ef0dde31344e-util" (OuterVolumeSpecName: "util") pod "9286f073-6989-43a6-a325-ef0dde31344e" (UID: "9286f073-6989-43a6-a325-ef0dde31344e"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 15:28:02.512067 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:28:02.512029    2564 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9286f073-6989-43a6-a325-ef0dde31344e-util\") on node \"ip-10-0-140-255.ec2.internal\" DevicePath \"\""
Jul 13 15:28:02.628627 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:28:02.628590    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-xl8ps"]
Jul 13 15:28:02.629081 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:28:02.629052    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9286f073-6989-43a6-a325-ef0dde31344e" containerName="util"
Jul 13 15:28:02.629081 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:28:02.629075    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="9286f073-6989-43a6-a325-ef0dde31344e" containerName="util"
Jul 13 15:28:02.629258 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:28:02.629106    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9286f073-6989-43a6-a325-ef0dde31344e" containerName="pull"
Jul 13 15:28:02.629258 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:28:02.629113    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="9286f073-6989-43a6-a325-ef0dde31344e" containerName="pull"
Jul 13 15:28:02.629258 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:28:02.629128    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9286f073-6989-43a6-a325-ef0dde31344e" containerName="extract"
Jul 13 15:28:02.629258 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:28:02.629136    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="9286f073-6989-43a6-a325-ef0dde31344e" containerName="extract"
Jul 13 15:28:02.629258 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:28:02.629212    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="9286f073-6989-43a6-a325-ef0dde31344e" containerName="extract"
Jul 13 15:28:02.659006 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:28:02.658942    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-xl8ps"]
Jul 13 15:28:02.659170 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:28:02.659050    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-xl8ps"
Jul 13 15:28:02.661963 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:28:02.661892    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-dk7mr\""
Jul 13 15:28:02.713936 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:28:02.713895    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jl8qt\" (UniqueName: \"kubernetes.io/projected/1dbd08c8-a06a-4747-9325-abefc7d7ab3b-kube-api-access-jl8qt\") pod \"cert-manager-webhook-6486ffd997-xl8ps\" (UID: \"1dbd08c8-a06a-4747-9325-abefc7d7ab3b\") " pod="cert-manager/cert-manager-webhook-6486ffd997-xl8ps"
Jul 13 15:28:02.714101 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:28:02.713956    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/1dbd08c8-a06a-4747-9325-abefc7d7ab3b-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-xl8ps\" (UID: \"1dbd08c8-a06a-4747-9325-abefc7d7ab3b\") " pod="cert-manager/cert-manager-webhook-6486ffd997-xl8ps"
Jul 13 15:28:02.814591 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:28:02.814552    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jl8qt\" (UniqueName: \"kubernetes.io/projected/1dbd08c8-a06a-4747-9325-abefc7d7ab3b-kube-api-access-jl8qt\") pod \"cert-manager-webhook-6486ffd997-xl8ps\" (UID: \"1dbd08c8-a06a-4747-9325-abefc7d7ab3b\") " pod="cert-manager/cert-manager-webhook-6486ffd997-xl8ps"
Jul 13 15:28:02.814781 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:28:02.814605    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/1dbd08c8-a06a-4747-9325-abefc7d7ab3b-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-xl8ps\" (UID: \"1dbd08c8-a06a-4747-9325-abefc7d7ab3b\") " pod="cert-manager/cert-manager-webhook-6486ffd997-xl8ps"
Jul 13 15:28:02.823708 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:28:02.823667    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/1dbd08c8-a06a-4747-9325-abefc7d7ab3b-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-xl8ps\" (UID: \"1dbd08c8-a06a-4747-9325-abefc7d7ab3b\") " pod="cert-manager/cert-manager-webhook-6486ffd997-xl8ps"
Jul 13 15:28:02.823851 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:28:02.823735    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jl8qt\" (UniqueName: \"kubernetes.io/projected/1dbd08c8-a06a-4747-9325-abefc7d7ab3b-kube-api-access-jl8qt\") pod \"cert-manager-webhook-6486ffd997-xl8ps\" (UID: \"1dbd08c8-a06a-4747-9325-abefc7d7ab3b\") " pod="cert-manager/cert-manager-webhook-6486ffd997-xl8ps"
Jul 13 15:28:02.968620 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:28:02.968524    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-xl8ps"
Jul 13 15:28:03.133599 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:28:03.133463    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-xl8ps"]
Jul 13 15:28:03.134342 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:28:03.134322    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ffg488"
Jul 13 15:28:03.134419 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:28:03.134335    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ffg488" event={"ID":"9286f073-6989-43a6-a325-ef0dde31344e","Type":"ContainerDied","Data":"dd4fda65e1ee96bafe347b8fb0f597633995faec1b568309e43c2d0f8de84384"}
Jul 13 15:28:03.134419 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:28:03.134385    2564 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="dd4fda65e1ee96bafe347b8fb0f597633995faec1b568309e43c2d0f8de84384"
Jul 13 15:28:03.136144 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:28:03.136102    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod1dbd08c8_a06a_4747_9325_abefc7d7ab3b.slice/crio-58c0239176b2007bd15eda9981f6b8204bac24b78a62286909b36845953e7b92 WatchSource:0}: Error finding container 58c0239176b2007bd15eda9981f6b8204bac24b78a62286909b36845953e7b92: Status 404 returned error can't find the container with id 58c0239176b2007bd15eda9981f6b8204bac24b78a62286909b36845953e7b92
Jul 13 15:28:04.140575 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:28:04.140538    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-xl8ps" event={"ID":"1dbd08c8-a06a-4747-9325-abefc7d7ab3b","Type":"ContainerStarted","Data":"58c0239176b2007bd15eda9981f6b8204bac24b78a62286909b36845953e7b92"}
Jul 13 15:28:07.154129 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:28:07.154097    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-xl8ps" event={"ID":"1dbd08c8-a06a-4747-9325-abefc7d7ab3b","Type":"ContainerStarted","Data":"a6ebf8ff6d2cab90e7520c959813281c4c709d7347a312dd59ab94387bbe8777"}
Jul 13 15:28:07.154487 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:28:07.154158    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-6486ffd997-xl8ps"
Jul 13 15:28:07.189692 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:28:07.189467    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-6486ffd997-xl8ps" podStartSLOduration=1.925705405 podStartE2EDuration="5.189444478s" totalImagesPullingTime="3.263739073s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 15:28:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 15:28:07.188932669 +0000 UTC m=+240.768167849" watchObservedRunningTime="2026-07-13 15:28:07.189444478 +0000 UTC m=+240.768679654"
Jul 13 15:28:12.176595 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:28:12.176557    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-kvbv2" event={"ID":"aa87b953-68a6-4ede-b57e-10b8968cd405","Type":"ContainerStarted","Data":"e5a7e842032873558c3f8786a89b646d35e3a16fd0e0205cb945048de5f9387d"}
Jul 13 15:28:12.197246 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:28:12.197195    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-559cdd8c87-kvbv2" podStartSLOduration=1.84343846 podStartE2EDuration="14.197180718s" totalImagesPullingTime="12.353742258s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 15:27:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 15:28:12.196669283 +0000 UTC m=+245.775904461" watchObservedRunningTime="2026-07-13 15:28:12.197180718 +0000 UTC m=+245.776415896"
Jul 13 15:28:13.161093 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:28:13.161056    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-6486ffd997-xl8ps"
Jul 13 15:28:14.895369 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:28:14.895330    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afgkrkz"]
Jul 13 15:28:14.897922 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:28:14.897892    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afgkrkz"
Jul 13 15:28:14.900310 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:28:14.900284    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-7cvtw\""
Jul 13 15:28:14.900436 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:28:14.900284    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Jul 13 15:28:14.901275 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:28:14.901254    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Jul 13 15:28:14.907102 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:28:14.907078    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afgkrkz"]
Jul 13 15:28:15.019031 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:28:15.019000    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8671e860-425b-466d-9608-153cb6d6ec00-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afgkrkz\" (UID: \"8671e860-425b-466d-9608-153cb6d6ec00\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afgkrkz"
Jul 13 15:28:15.019203 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:28:15.019056    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dzns2\" (UniqueName: \"kubernetes.io/projected/8671e860-425b-466d-9608-153cb6d6ec00-kube-api-access-dzns2\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afgkrkz\" (UID: \"8671e860-425b-466d-9608-153cb6d6ec00\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afgkrkz"
Jul 13 15:28:15.019203 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:28:15.019115    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8671e860-425b-466d-9608-153cb6d6ec00-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afgkrkz\" (UID: \"8671e860-425b-466d-9608-153cb6d6ec00\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afgkrkz"
Jul 13 15:28:15.125018 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:28:15.120995    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8671e860-425b-466d-9608-153cb6d6ec00-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afgkrkz\" (UID: \"8671e860-425b-466d-9608-153cb6d6ec00\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afgkrkz"
Jul 13 15:28:15.125018 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:28:15.121102    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dzns2\" (UniqueName: \"kubernetes.io/projected/8671e860-425b-466d-9608-153cb6d6ec00-kube-api-access-dzns2\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afgkrkz\" (UID: \"8671e860-425b-466d-9608-153cb6d6ec00\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afgkrkz"
Jul 13 15:28:15.125018 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:28:15.121172    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8671e860-425b-466d-9608-153cb6d6ec00-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afgkrkz\" (UID: \"8671e860-425b-466d-9608-153cb6d6ec00\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afgkrkz"
Jul 13 15:28:15.125018 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:28:15.122016    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8671e860-425b-466d-9608-153cb6d6ec00-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afgkrkz\" (UID: \"8671e860-425b-466d-9608-153cb6d6ec00\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afgkrkz"
Jul 13 15:28:15.125018 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:28:15.122289    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8671e860-425b-466d-9608-153cb6d6ec00-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afgkrkz\" (UID: \"8671e860-425b-466d-9608-153cb6d6ec00\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afgkrkz"
Jul 13 15:28:15.132202 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:28:15.132171    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dzns2\" (UniqueName: \"kubernetes.io/projected/8671e860-425b-466d-9608-153cb6d6ec00-kube-api-access-dzns2\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afgkrkz\" (UID: \"8671e860-425b-466d-9608-153cb6d6ec00\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afgkrkz"
Jul 13 15:28:15.207824 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:28:15.207730    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afgkrkz"
Jul 13 15:28:15.338557 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:28:15.338528    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afgkrkz"]
Jul 13 15:28:15.340691 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:28:15.340653    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8671e860_425b_466d_9608_153cb6d6ec00.slice/crio-5060231adc5caf0af5212d9cc9fac7b80c0e38079fa588752b6dd5045855037d WatchSource:0}: Error finding container 5060231adc5caf0af5212d9cc9fac7b80c0e38079fa588752b6dd5045855037d: Status 404 returned error can't find the container with id 5060231adc5caf0af5212d9cc9fac7b80c0e38079fa588752b6dd5045855037d
Jul 13 15:28:16.200303 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:28:16.200266    2564 generic.go:356] "Generic (PLEG): container finished" podID="8671e860-425b-466d-9608-153cb6d6ec00" containerID="38384c85418862c55e4f7b6c1ec787c59ac2f819553f913cc939fc61fe99d89f" exitCode=0
Jul 13 15:28:16.200763 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:28:16.200352    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afgkrkz" event={"ID":"8671e860-425b-466d-9608-153cb6d6ec00","Type":"ContainerDied","Data":"38384c85418862c55e4f7b6c1ec787c59ac2f819553f913cc939fc61fe99d89f"}
Jul 13 15:28:16.200763 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:28:16.200444    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afgkrkz" event={"ID":"8671e860-425b-466d-9608-153cb6d6ec00","Type":"ContainerStarted","Data":"5060231adc5caf0af5212d9cc9fac7b80c0e38079fa588752b6dd5045855037d"}
Jul 13 15:28:17.206216 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:28:17.206179    2564 generic.go:356] "Generic (PLEG): container finished" podID="8671e860-425b-466d-9608-153cb6d6ec00" containerID="93a0c4e27e1f8002864e0e4cb317dfc1b008251dfdc2173e4d8a51174d7a7325" exitCode=0
Jul 13 15:28:17.206604 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:28:17.206259    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afgkrkz" event={"ID":"8671e860-425b-466d-9608-153cb6d6ec00","Type":"ContainerDied","Data":"93a0c4e27e1f8002864e0e4cb317dfc1b008251dfdc2173e4d8a51174d7a7325"}
Jul 13 15:28:18.212277 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:28:18.212237    2564 generic.go:356] "Generic (PLEG): container finished" podID="8671e860-425b-466d-9608-153cb6d6ec00" containerID="534865dd47e93727d2d72fd7be772a156465dd8fde4e597ae92f71fbb4e7684d" exitCode=0
Jul 13 15:28:18.212618 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:28:18.212320    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afgkrkz" event={"ID":"8671e860-425b-466d-9608-153cb6d6ec00","Type":"ContainerDied","Data":"534865dd47e93727d2d72fd7be772a156465dd8fde4e597ae92f71fbb4e7684d"}
Jul 13 15:28:19.355817 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:28:19.355785    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afgkrkz"
Jul 13 15:28:19.456542 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:28:19.456509    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8671e860-425b-466d-9608-153cb6d6ec00-util\") pod \"8671e860-425b-466d-9608-153cb6d6ec00\" (UID: \"8671e860-425b-466d-9608-153cb6d6ec00\") "
Jul 13 15:28:19.456705 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:28:19.456557    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dzns2\" (UniqueName: \"kubernetes.io/projected/8671e860-425b-466d-9608-153cb6d6ec00-kube-api-access-dzns2\") pod \"8671e860-425b-466d-9608-153cb6d6ec00\" (UID: \"8671e860-425b-466d-9608-153cb6d6ec00\") "
Jul 13 15:28:19.456705 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:28:19.456618    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8671e860-425b-466d-9608-153cb6d6ec00-bundle\") pod \"8671e860-425b-466d-9608-153cb6d6ec00\" (UID: \"8671e860-425b-466d-9608-153cb6d6ec00\") "
Jul 13 15:28:19.457368 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:28:19.457338    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8671e860-425b-466d-9608-153cb6d6ec00-bundle" (OuterVolumeSpecName: "bundle") pod "8671e860-425b-466d-9608-153cb6d6ec00" (UID: "8671e860-425b-466d-9608-153cb6d6ec00"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 15:28:19.458692 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:28:19.458668    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8671e860-425b-466d-9608-153cb6d6ec00-kube-api-access-dzns2" (OuterVolumeSpecName: "kube-api-access-dzns2") pod "8671e860-425b-466d-9608-153cb6d6ec00" (UID: "8671e860-425b-466d-9608-153cb6d6ec00"). InnerVolumeSpecName "kube-api-access-dzns2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 13 15:28:19.462517 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:28:19.462481    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8671e860-425b-466d-9608-153cb6d6ec00-util" (OuterVolumeSpecName: "util") pod "8671e860-425b-466d-9608-153cb6d6ec00" (UID: "8671e860-425b-466d-9608-153cb6d6ec00"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 15:28:19.557332 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:28:19.557246    2564 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8671e860-425b-466d-9608-153cb6d6ec00-util\") on node \"ip-10-0-140-255.ec2.internal\" DevicePath \"\""
Jul 13 15:28:19.557332 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:28:19.557274    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dzns2\" (UniqueName: \"kubernetes.io/projected/8671e860-425b-466d-9608-153cb6d6ec00-kube-api-access-dzns2\") on node \"ip-10-0-140-255.ec2.internal\" DevicePath \"\""
Jul 13 15:28:19.557332 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:28:19.557285    2564 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8671e860-425b-466d-9608-153cb6d6ec00-bundle\") on node \"ip-10-0-140-255.ec2.internal\" DevicePath \"\""
Jul 13 15:28:20.222723 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:28:20.222694    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afgkrkz"
Jul 13 15:28:20.222905 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:28:20.222692    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afgkrkz" event={"ID":"8671e860-425b-466d-9608-153cb6d6ec00","Type":"ContainerDied","Data":"5060231adc5caf0af5212d9cc9fac7b80c0e38079fa588752b6dd5045855037d"}
Jul 13 15:28:20.222905 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:28:20.222816    2564 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="5060231adc5caf0af5212d9cc9fac7b80c0e38079fa588752b6dd5045855037d"
Jul 13 15:28:32.810433 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:28:32.810352    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7695c54b44-ftgf9"]
Jul 13 15:28:32.810887 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:28:32.810639    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8671e860-425b-466d-9608-153cb6d6ec00" containerName="extract"
Jul 13 15:28:32.810887 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:28:32.810650    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="8671e860-425b-466d-9608-153cb6d6ec00" containerName="extract"
Jul 13 15:28:32.810887 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:28:32.810667    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8671e860-425b-466d-9608-153cb6d6ec00" containerName="util"
Jul 13 15:28:32.810887 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:28:32.810673    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="8671e860-425b-466d-9608-153cb6d6ec00" containerName="util"
Jul 13 15:28:32.810887 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:28:32.810685    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8671e860-425b-466d-9608-153cb6d6ec00" containerName="pull"
Jul 13 15:28:32.810887 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:28:32.810691    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="8671e860-425b-466d-9608-153cb6d6ec00" containerName="pull"
Jul 13 15:28:32.810887 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:28:32.810740    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="8671e860-425b-466d-9608-153cb6d6ec00" containerName="extract"
Jul 13 15:28:32.818003 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:28:32.817978    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-7695c54b44-ftgf9"
Jul 13 15:28:32.821910 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:28:32.821882    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Jul 13 15:28:32.822123 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:28:32.822111    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Jul 13 15:28:32.822368 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:28:32.822349    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Jul 13 15:28:32.822475 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:28:32.822461    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Jul 13 15:28:32.823465 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:28:32.823450    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-rbd9j\""
Jul 13 15:28:32.840568 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:28:32.840543    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7695c54b44-ftgf9"]
Jul 13 15:28:32.869101 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:28:32.869071    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/805b0797-42e8-46a5-b519-328b7411896e-manifests\") pod \"opendatahub-operator-controller-manager-7695c54b44-ftgf9\" (UID: \"805b0797-42e8-46a5-b519-328b7411896e\") " pod="opendatahub/opendatahub-operator-controller-manager-7695c54b44-ftgf9"
Jul 13 15:28:32.869258 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:28:32.869119    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/805b0797-42e8-46a5-b519-328b7411896e-webhook-cert\") pod \"opendatahub-operator-controller-manager-7695c54b44-ftgf9\" (UID: \"805b0797-42e8-46a5-b519-328b7411896e\") " pod="opendatahub/opendatahub-operator-controller-manager-7695c54b44-ftgf9"
Jul 13 15:28:32.869258 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:28:32.869189    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/805b0797-42e8-46a5-b519-328b7411896e-tmp\") pod \"opendatahub-operator-controller-manager-7695c54b44-ftgf9\" (UID: \"805b0797-42e8-46a5-b519-328b7411896e\") " pod="opendatahub/opendatahub-operator-controller-manager-7695c54b44-ftgf9"
Jul 13 15:28:32.869258 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:28:32.869230    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-95dnt\" (UniqueName: \"kubernetes.io/projected/805b0797-42e8-46a5-b519-328b7411896e-kube-api-access-95dnt\") pod \"opendatahub-operator-controller-manager-7695c54b44-ftgf9\" (UID: \"805b0797-42e8-46a5-b519-328b7411896e\") " pod="opendatahub/opendatahub-operator-controller-manager-7695c54b44-ftgf9"
Jul 13 15:28:32.869368 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:28:32.869262    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/805b0797-42e8-46a5-b519-328b7411896e-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7695c54b44-ftgf9\" (UID: \"805b0797-42e8-46a5-b519-328b7411896e\") " pod="opendatahub/opendatahub-operator-controller-manager-7695c54b44-ftgf9"
Jul 13 15:28:32.970373 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:28:32.970338    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/805b0797-42e8-46a5-b519-328b7411896e-webhook-cert\") pod \"opendatahub-operator-controller-manager-7695c54b44-ftgf9\" (UID: \"805b0797-42e8-46a5-b519-328b7411896e\") " pod="opendatahub/opendatahub-operator-controller-manager-7695c54b44-ftgf9"
Jul 13 15:28:32.970541 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:28:32.970383    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/805b0797-42e8-46a5-b519-328b7411896e-tmp\") pod \"opendatahub-operator-controller-manager-7695c54b44-ftgf9\" (UID: \"805b0797-42e8-46a5-b519-328b7411896e\") " pod="opendatahub/opendatahub-operator-controller-manager-7695c54b44-ftgf9"
Jul 13 15:28:32.970541 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:28:32.970402    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-95dnt\" (UniqueName: \"kubernetes.io/projected/805b0797-42e8-46a5-b519-328b7411896e-kube-api-access-95dnt\") pod \"opendatahub-operator-controller-manager-7695c54b44-ftgf9\" (UID: \"805b0797-42e8-46a5-b519-328b7411896e\") " pod="opendatahub/opendatahub-operator-controller-manager-7695c54b44-ftgf9"
Jul 13 15:28:32.970541 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:28:32.970433    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/805b0797-42e8-46a5-b519-328b7411896e-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7695c54b44-ftgf9\" (UID: \"805b0797-42e8-46a5-b519-328b7411896e\") " pod="opendatahub/opendatahub-operator-controller-manager-7695c54b44-ftgf9"
Jul 13 15:28:32.970541 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:28:32.970484    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/805b0797-42e8-46a5-b519-328b7411896e-manifests\") pod \"opendatahub-operator-controller-manager-7695c54b44-ftgf9\" (UID: \"805b0797-42e8-46a5-b519-328b7411896e\") " pod="opendatahub/opendatahub-operator-controller-manager-7695c54b44-ftgf9"
Jul 13 15:28:32.970928 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:28:32.970908    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/805b0797-42e8-46a5-b519-328b7411896e-manifests\") pod \"opendatahub-operator-controller-manager-7695c54b44-ftgf9\" (UID: \"805b0797-42e8-46a5-b519-328b7411896e\") " pod="opendatahub/opendatahub-operator-controller-manager-7695c54b44-ftgf9"
Jul 13 15:28:32.972800 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:28:32.972776    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/805b0797-42e8-46a5-b519-328b7411896e-tmp\") pod \"opendatahub-operator-controller-manager-7695c54b44-ftgf9\" (UID: \"805b0797-42e8-46a5-b519-328b7411896e\") " pod="opendatahub/opendatahub-operator-controller-manager-7695c54b44-ftgf9"
Jul 13 15:28:32.972941 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:28:32.972925    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/805b0797-42e8-46a5-b519-328b7411896e-webhook-cert\") pod \"opendatahub-operator-controller-manager-7695c54b44-ftgf9\" (UID: \"805b0797-42e8-46a5-b519-328b7411896e\") " pod="opendatahub/opendatahub-operator-controller-manager-7695c54b44-ftgf9"
Jul 13 15:28:32.973110 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:28:32.973089    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/805b0797-42e8-46a5-b519-328b7411896e-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7695c54b44-ftgf9\" (UID: \"805b0797-42e8-46a5-b519-328b7411896e\") " pod="opendatahub/opendatahub-operator-controller-manager-7695c54b44-ftgf9"
Jul 13 15:28:32.993344 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:28:32.993310    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-95dnt\" (UniqueName: \"kubernetes.io/projected/805b0797-42e8-46a5-b519-328b7411896e-kube-api-access-95dnt\") pod \"opendatahub-operator-controller-manager-7695c54b44-ftgf9\" (UID: \"805b0797-42e8-46a5-b519-328b7411896e\") " pod="opendatahub/opendatahub-operator-controller-manager-7695c54b44-ftgf9"
Jul 13 15:28:33.129060 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:28:33.129036    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-7695c54b44-ftgf9"
Jul 13 15:28:33.284985 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:28:33.284955    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7695c54b44-ftgf9"]
Jul 13 15:28:33.287018 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:28:33.286991    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod805b0797_42e8_46a5_b519_328b7411896e.slice/crio-0f98c0e158e980ec1483cb9473ce2ee0cee926a8e6e49062df11fa93db574a69 WatchSource:0}: Error finding container 0f98c0e158e980ec1483cb9473ce2ee0cee926a8e6e49062df11fa93db574a69: Status 404 returned error can't find the container with id 0f98c0e158e980ec1483cb9473ce2ee0cee926a8e6e49062df11fa93db574a69
Jul 13 15:28:34.288659 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:28:34.288622    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7695c54b44-ftgf9" event={"ID":"805b0797-42e8-46a5-b519-328b7411896e","Type":"ContainerStarted","Data":"0f98c0e158e980ec1483cb9473ce2ee0cee926a8e6e49062df11fa93db574a69"}
Jul 13 15:28:38.310243 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:28:38.310205    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7695c54b44-ftgf9" event={"ID":"805b0797-42e8-46a5-b519-328b7411896e","Type":"ContainerStarted","Data":"5fc05cc5998346886f131e1425beca3818ae50917dcf6bc3fa882f1c8a308750"}
Jul 13 15:28:39.318040 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:28:39.318001    2564 generic.go:356] "Generic (PLEG): container finished" podID="805b0797-42e8-46a5-b519-328b7411896e" containerID="5fc05cc5998346886f131e1425beca3818ae50917dcf6bc3fa882f1c8a308750" exitCode=0
Jul 13 15:28:39.318607 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:28:39.318102    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7695c54b44-ftgf9" event={"ID":"805b0797-42e8-46a5-b519-328b7411896e","Type":"ContainerDied","Data":"5fc05cc5998346886f131e1425beca3818ae50917dcf6bc3fa882f1c8a308750"}
Jul 13 15:28:40.325390 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:28:40.325355    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7695c54b44-ftgf9" event={"ID":"805b0797-42e8-46a5-b519-328b7411896e","Type":"ContainerStarted","Data":"343551c5ba9907bff89e0a3f6a60fb48b78214b8b68418ffd4dcb4ed3ed70d31"}
Jul 13 15:28:40.325789 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:28:40.325480    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-7695c54b44-ftgf9"
Jul 13 15:28:40.352539 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:28:40.352489    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-7695c54b44-ftgf9" podStartSLOduration=2.776527846 podStartE2EDuration="8.352472744s" totalImagesPullingTime="4.551155387s" totalInitContainerRuntime="1.024789511s" isStatefulPod=false podCreationTimestamp="2026-07-13 15:28:32 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 15:28:40.350622227 +0000 UTC m=+273.929857419" watchObservedRunningTime="2026-07-13 15:28:40.352472744 +0000 UTC m=+273.931707915"
Jul 13 15:28:51.333207 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:28:51.333173    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-7695c54b44-ftgf9"
Jul 13 15:28:53.468151 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:28:53.468108    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-6f57b96f59-q68cf"]
Jul 13 15:28:53.477454 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:28:53.477426    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-6f57b96f59-q68cf"
Jul 13 15:28:53.480277 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:28:53.480255    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
Jul 13 15:28:53.480422 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:28:53.480256    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Jul 13 15:28:53.481222 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:28:53.481189    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-hdtjj\""
Jul 13 15:28:53.481222 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:28:53.481205    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jul 13 15:28:53.481423 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:28:53.481229    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jul 13 15:28:53.489300 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:28:53.489279    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-6f57b96f59-q68cf"]
Jul 13 15:28:53.652987 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:28:53.652951    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3440af5d-72f3-48bf-bf40-d85097bac921-tls-certs\") pod \"kube-auth-proxy-6f57b96f59-q68cf\" (UID: \"3440af5d-72f3-48bf-bf40-d85097bac921\") " pod="openshift-ingress/kube-auth-proxy-6f57b96f59-q68cf"
Jul 13 15:28:53.653198 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:28:53.653061    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7jkjs\" (UniqueName: \"kubernetes.io/projected/3440af5d-72f3-48bf-bf40-d85097bac921-kube-api-access-7jkjs\") pod \"kube-auth-proxy-6f57b96f59-q68cf\" (UID: \"3440af5d-72f3-48bf-bf40-d85097bac921\") " pod="openshift-ingress/kube-auth-proxy-6f57b96f59-q68cf"
Jul 13 15:28:53.653198 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:28:53.653115    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3440af5d-72f3-48bf-bf40-d85097bac921-tmp\") pod \"kube-auth-proxy-6f57b96f59-q68cf\" (UID: \"3440af5d-72f3-48bf-bf40-d85097bac921\") " pod="openshift-ingress/kube-auth-proxy-6f57b96f59-q68cf"
Jul 13 15:28:53.703229 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:28:53.703194    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-dqc4z"]
Jul 13 15:28:53.706694 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:28:53.706677    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-dqc4z"
Jul 13 15:28:53.710885 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:28:53.710836    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\""
Jul 13 15:28:53.711382 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:28:53.711360    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-ww4g2\""
Jul 13 15:28:53.723346 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:28:53.723274    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-dqc4z"]
Jul 13 15:28:53.753972 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:28:53.753941    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7jkjs\" (UniqueName: \"kubernetes.io/projected/3440af5d-72f3-48bf-bf40-d85097bac921-kube-api-access-7jkjs\") pod \"kube-auth-proxy-6f57b96f59-q68cf\" (UID: \"3440af5d-72f3-48bf-bf40-d85097bac921\") " pod="openshift-ingress/kube-auth-proxy-6f57b96f59-q68cf"
Jul 13 15:28:53.754131 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:28:53.753991    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3440af5d-72f3-48bf-bf40-d85097bac921-tmp\") pod \"kube-auth-proxy-6f57b96f59-q68cf\" (UID: \"3440af5d-72f3-48bf-bf40-d85097bac921\") " pod="openshift-ingress/kube-auth-proxy-6f57b96f59-q68cf"
Jul 13 15:28:53.754131 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:28:53.754026    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3440af5d-72f3-48bf-bf40-d85097bac921-tls-certs\") pod \"kube-auth-proxy-6f57b96f59-q68cf\" (UID: \"3440af5d-72f3-48bf-bf40-d85097bac921\") " pod="openshift-ingress/kube-auth-proxy-6f57b96f59-q68cf"
Jul 13 15:28:53.756289 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:28:53.756257    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3440af5d-72f3-48bf-bf40-d85097bac921-tmp\") pod \"kube-auth-proxy-6f57b96f59-q68cf\" (UID: \"3440af5d-72f3-48bf-bf40-d85097bac921\") " pod="openshift-ingress/kube-auth-proxy-6f57b96f59-q68cf"
Jul 13 15:28:53.756453 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:28:53.756435    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3440af5d-72f3-48bf-bf40-d85097bac921-tls-certs\") pod \"kube-auth-proxy-6f57b96f59-q68cf\" (UID: \"3440af5d-72f3-48bf-bf40-d85097bac921\") " pod="openshift-ingress/kube-auth-proxy-6f57b96f59-q68cf"
Jul 13 15:28:53.772673 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:28:53.772642    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7jkjs\" (UniqueName: \"kubernetes.io/projected/3440af5d-72f3-48bf-bf40-d85097bac921-kube-api-access-7jkjs\") pod \"kube-auth-proxy-6f57b96f59-q68cf\" (UID: \"3440af5d-72f3-48bf-bf40-d85097bac921\") " pod="openshift-ingress/kube-auth-proxy-6f57b96f59-q68cf"
Jul 13 15:28:53.787505 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:28:53.787476    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-6f57b96f59-q68cf"
Jul 13 15:28:53.854466 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:28:53.854430    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h2jd9\" (UniqueName: \"kubernetes.io/projected/83fb3625-eb75-4872-8a24-703f2b5455dd-kube-api-access-h2jd9\") pod \"odh-model-controller-7998c67dc4-dqc4z\" (UID: \"83fb3625-eb75-4872-8a24-703f2b5455dd\") " pod="opendatahub/odh-model-controller-7998c67dc4-dqc4z"
Jul 13 15:28:53.854618 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:28:53.854560    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/83fb3625-eb75-4872-8a24-703f2b5455dd-cert\") pod \"odh-model-controller-7998c67dc4-dqc4z\" (UID: \"83fb3625-eb75-4872-8a24-703f2b5455dd\") " pod="opendatahub/odh-model-controller-7998c67dc4-dqc4z"
Jul 13 15:28:53.935392 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:28:53.935364    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-6f57b96f59-q68cf"]
Jul 13 15:28:53.937106 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:28:53.937080    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3440af5d_72f3_48bf_bf40_d85097bac921.slice/crio-4717fce072e1b7b75ca93d259b96b1c67b9d678a3e14d9e0da8917ffc225ac6e WatchSource:0}: Error finding container 4717fce072e1b7b75ca93d259b96b1c67b9d678a3e14d9e0da8917ffc225ac6e: Status 404 returned error can't find the container with id 4717fce072e1b7b75ca93d259b96b1c67b9d678a3e14d9e0da8917ffc225ac6e
Jul 13 15:28:53.955771 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:28:53.955744    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h2jd9\" (UniqueName: \"kubernetes.io/projected/83fb3625-eb75-4872-8a24-703f2b5455dd-kube-api-access-h2jd9\") pod \"odh-model-controller-7998c67dc4-dqc4z\" (UID: \"83fb3625-eb75-4872-8a24-703f2b5455dd\") " pod="opendatahub/odh-model-controller-7998c67dc4-dqc4z"
Jul 13 15:28:53.955923 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:28:53.955797    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/83fb3625-eb75-4872-8a24-703f2b5455dd-cert\") pod \"odh-model-controller-7998c67dc4-dqc4z\" (UID: \"83fb3625-eb75-4872-8a24-703f2b5455dd\") " pod="opendatahub/odh-model-controller-7998c67dc4-dqc4z"
Jul 13 15:28:53.958196 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:28:53.958178    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/83fb3625-eb75-4872-8a24-703f2b5455dd-cert\") pod \"odh-model-controller-7998c67dc4-dqc4z\" (UID: \"83fb3625-eb75-4872-8a24-703f2b5455dd\") " pod="opendatahub/odh-model-controller-7998c67dc4-dqc4z"
Jul 13 15:28:53.966814 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:28:53.966785    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h2jd9\" (UniqueName: \"kubernetes.io/projected/83fb3625-eb75-4872-8a24-703f2b5455dd-kube-api-access-h2jd9\") pod \"odh-model-controller-7998c67dc4-dqc4z\" (UID: \"83fb3625-eb75-4872-8a24-703f2b5455dd\") " pod="opendatahub/odh-model-controller-7998c67dc4-dqc4z"
Jul 13 15:28:54.018738 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:28:54.018647    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-dqc4z"
Jul 13 15:28:54.157488 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:28:54.157464    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-dqc4z"]
Jul 13 15:28:54.159779 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:28:54.159744    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod83fb3625_eb75_4872_8a24_703f2b5455dd.slice/crio-3faecbbb32ed8b1e6bf17cc00eb95ac3c93c6a5a03d0bdf0b0c9860c2ad65b60 WatchSource:0}: Error finding container 3faecbbb32ed8b1e6bf17cc00eb95ac3c93c6a5a03d0bdf0b0c9860c2ad65b60: Status 404 returned error can't find the container with id 3faecbbb32ed8b1e6bf17cc00eb95ac3c93c6a5a03d0bdf0b0c9860c2ad65b60
Jul 13 15:28:54.391207 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:28:54.391165    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-dqc4z" event={"ID":"83fb3625-eb75-4872-8a24-703f2b5455dd","Type":"ContainerStarted","Data":"3faecbbb32ed8b1e6bf17cc00eb95ac3c93c6a5a03d0bdf0b0c9860c2ad65b60"}
Jul 13 15:28:54.392854 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:28:54.392828    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-6f57b96f59-q68cf" event={"ID":"3440af5d-72f3-48bf-bf40-d85097bac921","Type":"ContainerStarted","Data":"4717fce072e1b7b75ca93d259b96b1c67b9d678a3e14d9e0da8917ffc225ac6e"}
Jul 13 15:28:54.425275 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:28:54.425241    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-jxf6r"]
Jul 13 15:28:54.429644 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:28:54.429625    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-jxf6r"
Jul 13 15:28:54.433429 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:28:54.433402    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\""
Jul 13 15:28:54.442717 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:28:54.442687    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-jxf6r"]
Jul 13 15:28:54.559982 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:28:54.559944    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wwbxr\" (UniqueName: \"kubernetes.io/projected/23916f62-f418-4c34-a70e-5c0de1d648ff-kube-api-access-wwbxr\") pod \"model-serving-api-54d89bd5fc-jxf6r\" (UID: \"23916f62-f418-4c34-a70e-5c0de1d648ff\") " pod="opendatahub/model-serving-api-54d89bd5fc-jxf6r"
Jul 13 15:28:54.560368 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:28:54.560059    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/23916f62-f418-4c34-a70e-5c0de1d648ff-tls-certs\") pod \"model-serving-api-54d89bd5fc-jxf6r\" (UID: \"23916f62-f418-4c34-a70e-5c0de1d648ff\") " pod="opendatahub/model-serving-api-54d89bd5fc-jxf6r"
Jul 13 15:28:54.660587 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:28:54.660503    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/23916f62-f418-4c34-a70e-5c0de1d648ff-tls-certs\") pod \"model-serving-api-54d89bd5fc-jxf6r\" (UID: \"23916f62-f418-4c34-a70e-5c0de1d648ff\") " pod="opendatahub/model-serving-api-54d89bd5fc-jxf6r"
Jul 13 15:28:54.660728 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:28:54.660588    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wwbxr\" (UniqueName: \"kubernetes.io/projected/23916f62-f418-4c34-a70e-5c0de1d648ff-kube-api-access-wwbxr\") pod \"model-serving-api-54d89bd5fc-jxf6r\" (UID: \"23916f62-f418-4c34-a70e-5c0de1d648ff\") " pod="opendatahub/model-serving-api-54d89bd5fc-jxf6r"
Jul 13 15:28:54.660728 ip-10-0-140-255 kubenswrapper[2564]: E0713 15:28:54.660658    2564 secret.go:189] Couldn't get secret opendatahub/model-serving-api-tls: secret "model-serving-api-tls" not found
Jul 13 15:28:54.660728 ip-10-0-140-255 kubenswrapper[2564]: E0713 15:28:54.660727    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/23916f62-f418-4c34-a70e-5c0de1d648ff-tls-certs podName:23916f62-f418-4c34-a70e-5c0de1d648ff nodeName:}" failed. No retries permitted until 2026-07-13 15:28:55.160705357 +0000 UTC m=+288.739940525 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/23916f62-f418-4c34-a70e-5c0de1d648ff-tls-certs") pod "model-serving-api-54d89bd5fc-jxf6r" (UID: "23916f62-f418-4c34-a70e-5c0de1d648ff") : secret "model-serving-api-tls" not found
Jul 13 15:28:54.681892 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:28:54.681843    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wwbxr\" (UniqueName: \"kubernetes.io/projected/23916f62-f418-4c34-a70e-5c0de1d648ff-kube-api-access-wwbxr\") pod \"model-serving-api-54d89bd5fc-jxf6r\" (UID: \"23916f62-f418-4c34-a70e-5c0de1d648ff\") " pod="opendatahub/model-serving-api-54d89bd5fc-jxf6r"
Jul 13 15:28:54.987159 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:28:54.987069    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-4z8rn"]
Jul 13 15:28:54.990712 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:28:54.990687    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-4z8rn"
Jul 13 15:28:54.994425 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:28:54.994400    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\""
Jul 13 15:28:54.995027 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:28:54.995006    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Jul 13 15:28:54.995639 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:28:54.995317    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-rh762\""
Jul 13 15:28:54.995639 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:28:54.995474    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\""
Jul 13 15:28:54.995639 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:28:54.995531    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\""
Jul 13 15:28:55.007326 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:28:55.007298    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-4z8rn"]
Jul 13 15:28:55.165533 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:28:55.165123    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/143605e2-e057-44c4-82d9-147d4fee79d4-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-4z8rn\" (UID: \"143605e2-e057-44c4-82d9-147d4fee79d4\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-4z8rn"
Jul 13 15:28:55.165533 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:28:55.165186    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/23916f62-f418-4c34-a70e-5c0de1d648ff-tls-certs\") pod \"model-serving-api-54d89bd5fc-jxf6r\" (UID: \"23916f62-f418-4c34-a70e-5c0de1d648ff\") " pod="opendatahub/model-serving-api-54d89bd5fc-jxf6r"
Jul 13 15:28:55.165533 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:28:55.165220    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/143605e2-e057-44c4-82d9-147d4fee79d4-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-4z8rn\" (UID: \"143605e2-e057-44c4-82d9-147d4fee79d4\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-4z8rn"
Jul 13 15:28:55.165533 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:28:55.165277    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/143605e2-e057-44c4-82d9-147d4fee79d4-cacerts\") pod \"istiod-openshift-gateway-7574459656-4z8rn\" (UID: \"143605e2-e057-44c4-82d9-147d4fee79d4\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-4z8rn"
Jul 13 15:28:55.165533 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:28:55.165296    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/143605e2-e057-44c4-82d9-147d4fee79d4-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-4z8rn\" (UID: \"143605e2-e057-44c4-82d9-147d4fee79d4\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-4z8rn"
Jul 13 15:28:55.165533 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:28:55.165339    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/143605e2-e057-44c4-82d9-147d4fee79d4-local-certs\") pod \"istiod-openshift-gateway-7574459656-4z8rn\" (UID: \"143605e2-e057-44c4-82d9-147d4fee79d4\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-4z8rn"
Jul 13 15:28:55.165533 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:28:55.165469    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sm6l8\" (UniqueName: \"kubernetes.io/projected/143605e2-e057-44c4-82d9-147d4fee79d4-kube-api-access-sm6l8\") pod \"istiod-openshift-gateway-7574459656-4z8rn\" (UID: \"143605e2-e057-44c4-82d9-147d4fee79d4\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-4z8rn"
Jul 13 15:28:55.165533 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:28:55.165537    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/143605e2-e057-44c4-82d9-147d4fee79d4-istio-token\") pod \"istiod-openshift-gateway-7574459656-4z8rn\" (UID: \"143605e2-e057-44c4-82d9-147d4fee79d4\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-4z8rn"
Jul 13 15:28:55.168124 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:28:55.168099    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/23916f62-f418-4c34-a70e-5c0de1d648ff-tls-certs\") pod \"model-serving-api-54d89bd5fc-jxf6r\" (UID: \"23916f62-f418-4c34-a70e-5c0de1d648ff\") " pod="opendatahub/model-serving-api-54d89bd5fc-jxf6r"
Jul 13 15:28:55.267093 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:28:55.267005    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sm6l8\" (UniqueName: \"kubernetes.io/projected/143605e2-e057-44c4-82d9-147d4fee79d4-kube-api-access-sm6l8\") pod \"istiod-openshift-gateway-7574459656-4z8rn\" (UID: \"143605e2-e057-44c4-82d9-147d4fee79d4\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-4z8rn"
Jul 13 15:28:55.267093 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:28:55.267073    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/143605e2-e057-44c4-82d9-147d4fee79d4-istio-token\") pod \"istiod-openshift-gateway-7574459656-4z8rn\" (UID: \"143605e2-e057-44c4-82d9-147d4fee79d4\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-4z8rn"
Jul 13 15:28:55.267323 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:28:55.267122    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/143605e2-e057-44c4-82d9-147d4fee79d4-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-4z8rn\" (UID: \"143605e2-e057-44c4-82d9-147d4fee79d4\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-4z8rn"
Jul 13 15:28:55.267323 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:28:55.267168    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/143605e2-e057-44c4-82d9-147d4fee79d4-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-4z8rn\" (UID: \"143605e2-e057-44c4-82d9-147d4fee79d4\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-4z8rn"
Jul 13 15:28:55.267323 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:28:55.267232    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/143605e2-e057-44c4-82d9-147d4fee79d4-cacerts\") pod \"istiod-openshift-gateway-7574459656-4z8rn\" (UID: \"143605e2-e057-44c4-82d9-147d4fee79d4\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-4z8rn"
Jul 13 15:28:55.267323 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:28:55.267258    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/143605e2-e057-44c4-82d9-147d4fee79d4-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-4z8rn\" (UID: \"143605e2-e057-44c4-82d9-147d4fee79d4\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-4z8rn"
Jul 13 15:28:55.267323 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:28:55.267292    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/143605e2-e057-44c4-82d9-147d4fee79d4-local-certs\") pod \"istiod-openshift-gateway-7574459656-4z8rn\" (UID: \"143605e2-e057-44c4-82d9-147d4fee79d4\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-4z8rn"
Jul 13 15:28:55.268467 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:28:55.268300    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/143605e2-e057-44c4-82d9-147d4fee79d4-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-4z8rn\" (UID: \"143605e2-e057-44c4-82d9-147d4fee79d4\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-4z8rn"
Jul 13 15:28:55.270211 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:28:55.270131    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/143605e2-e057-44c4-82d9-147d4fee79d4-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-4z8rn\" (UID: \"143605e2-e057-44c4-82d9-147d4fee79d4\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-4z8rn"
Jul 13 15:28:55.270342 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:28:55.270234    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/143605e2-e057-44c4-82d9-147d4fee79d4-cacerts\") pod \"istiod-openshift-gateway-7574459656-4z8rn\" (UID: \"143605e2-e057-44c4-82d9-147d4fee79d4\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-4z8rn"
Jul 13 15:28:55.270933 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:28:55.270910    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/143605e2-e057-44c4-82d9-147d4fee79d4-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-4z8rn\" (UID: \"143605e2-e057-44c4-82d9-147d4fee79d4\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-4z8rn"
Jul 13 15:28:55.271735 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:28:55.271712    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/143605e2-e057-44c4-82d9-147d4fee79d4-local-certs\") pod \"istiod-openshift-gateway-7574459656-4z8rn\" (UID: \"143605e2-e057-44c4-82d9-147d4fee79d4\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-4z8rn"
Jul 13 15:28:55.276623 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:28:55.276598    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sm6l8\" (UniqueName: \"kubernetes.io/projected/143605e2-e057-44c4-82d9-147d4fee79d4-kube-api-access-sm6l8\") pod \"istiod-openshift-gateway-7574459656-4z8rn\" (UID: \"143605e2-e057-44c4-82d9-147d4fee79d4\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-4z8rn"
Jul 13 15:28:55.276837 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:28:55.276818    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/143605e2-e057-44c4-82d9-147d4fee79d4-istio-token\") pod \"istiod-openshift-gateway-7574459656-4z8rn\" (UID: \"143605e2-e057-44c4-82d9-147d4fee79d4\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-4z8rn"
Jul 13 15:28:55.305595 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:28:55.305560    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-4z8rn"
Jul 13 15:28:55.341813 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:28:55.341778    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-jxf6r"
Jul 13 15:28:55.480891 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:28:55.480738    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-4z8rn"]
Jul 13 15:28:55.484303 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:28:55.484267    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod143605e2_e057_44c4_82d9_147d4fee79d4.slice/crio-b5f7c1fe3a8ad9db198d40b4279325d6c60d26bf9d349e0d69f52152c33d8790 WatchSource:0}: Error finding container b5f7c1fe3a8ad9db198d40b4279325d6c60d26bf9d349e0d69f52152c33d8790: Status 404 returned error can't find the container with id b5f7c1fe3a8ad9db198d40b4279325d6c60d26bf9d349e0d69f52152c33d8790
Jul 13 15:28:55.529016 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:28:55.528997    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-jxf6r"]
Jul 13 15:28:55.531109 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:28:55.531079    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod23916f62_f418_4c34_a70e_5c0de1d648ff.slice/crio-bacedb324ee58d2f5ca997b4f05aeb25c78bbea1a6c441da3e3f7942cc7ea9d6 WatchSource:0}: Error finding container bacedb324ee58d2f5ca997b4f05aeb25c78bbea1a6c441da3e3f7942cc7ea9d6: Status 404 returned error can't find the container with id bacedb324ee58d2f5ca997b4f05aeb25c78bbea1a6c441da3e3f7942cc7ea9d6
Jul 13 15:28:56.412707 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:28:56.412666    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-jxf6r" event={"ID":"23916f62-f418-4c34-a70e-5c0de1d648ff","Type":"ContainerStarted","Data":"bacedb324ee58d2f5ca997b4f05aeb25c78bbea1a6c441da3e3f7942cc7ea9d6"}
Jul 13 15:28:56.414330 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:28:56.414298    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-4z8rn" event={"ID":"143605e2-e057-44c4-82d9-147d4fee79d4","Type":"ContainerStarted","Data":"b5f7c1fe3a8ad9db198d40b4279325d6c60d26bf9d349e0d69f52152c33d8790"}
Jul 13 15:28:59.813902 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:28:59.813837    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 13 15:28:59.814285 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:28:59.813956    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 13 15:29:00.443021 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:29:00.442976    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-dqc4z" event={"ID":"83fb3625-eb75-4872-8a24-703f2b5455dd","Type":"ContainerStarted","Data":"20c7ce474ab462e4174fe36c083d707469ac34c077f67d7d5e244abde20a3d7c"}
Jul 13 15:29:00.443823 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:29:00.443799    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-7998c67dc4-dqc4z"
Jul 13 15:29:00.445565 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:29:00.445537    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-6f57b96f59-q68cf" event={"ID":"3440af5d-72f3-48bf-bf40-d85097bac921","Type":"ContainerStarted","Data":"25f977324624e7ec802e6bf20a823389e32d97be9e62c67d8e529fbc2e8d233a"}
Jul 13 15:29:00.447599 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:29:00.447574    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-jxf6r" event={"ID":"23916f62-f418-4c34-a70e-5c0de1d648ff","Type":"ContainerStarted","Data":"7d3df088e58447ef510f0a45899ade565e130786ba33a6aa905f73d2e4e0718f"}
Jul 13 15:29:00.448075 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:29:00.448054    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-54d89bd5fc-jxf6r"
Jul 13 15:29:00.451055 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:29:00.451029    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-4z8rn" event={"ID":"143605e2-e057-44c4-82d9-147d4fee79d4","Type":"ContainerStarted","Data":"615e233d253dc5696ecb2b09bcbf7b0daa890a06032bef6e7176eed3bf397bd5"}
Jul 13 15:29:00.451225 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:29:00.451211    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-7574459656-4z8rn"
Jul 13 15:29:00.453511 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:29:00.453197    2564 patch_prober.go:28] interesting pod/istiod-openshift-gateway-7574459656-4z8rn container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 13 15:29:00.453511 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:29:00.453257    2564 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-7574459656-4z8rn" podUID="143605e2-e057-44c4-82d9-147d4fee79d4" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 13 15:29:00.507755 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:29:00.507698    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/odh-model-controller-7998c67dc4-dqc4z" podStartSLOduration=1.862317734 podStartE2EDuration="7.507681465s" totalImagesPullingTime="5.645363731s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 15:28:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 15:29:00.4998278 +0000 UTC m=+294.079062978" watchObservedRunningTime="2026-07-13 15:29:00.507681465 +0000 UTC m=+294.086916634"
Jul 13 15:29:00.544634 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:29:00.544582    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-6f57b96f59-q68cf" podStartSLOduration=1.6729801659999999 podStartE2EDuration="7.544564314s" totalImagesPullingTime="5.871584148s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 15:28:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 15:29:00.542657792 +0000 UTC m=+294.121892995" watchObservedRunningTime="2026-07-13 15:29:00.544564314 +0000 UTC m=+294.123799492"
Jul 13 15:29:00.585381 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:29:00.585316    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-7574459656-4z8rn" podStartSLOduration=2.258316152 podStartE2EDuration="6.585295942s" totalImagesPullingTime="4.32697979s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 15:28:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 15:29:00.583936324 +0000 UTC m=+294.163171523" watchObservedRunningTime="2026-07-13 15:29:00.585295942 +0000 UTC m=+294.164531121"
Jul 13 15:29:00.622700 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:29:00.622646    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/model-serving-api-54d89bd5fc-jxf6r" podStartSLOduration=2.3418703929999998 podStartE2EDuration="6.622626851s" totalImagesPullingTime="4.280756458s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 15:28:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 15:29:00.620765774 +0000 UTC m=+294.200001034" watchObservedRunningTime="2026-07-13 15:29:00.622626851 +0000 UTC m=+294.201862030"
Jul 13 15:29:01.456568 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:29:01.456536    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-7574459656-4z8rn"
Jul 13 15:29:02.188335 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:29:02.188279    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-7b567978d6-sp4hs"]
Jul 13 15:29:02.191906 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:29:02.191885    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-7b567978d6-sp4hs"
Jul 13 15:29:02.196033 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:29:02.196011    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\""
Jul 13 15:29:02.196300 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:29:02.196283    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-xl4w8\""
Jul 13 15:29:02.196789 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:29:02.196777    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Jul 13 15:29:02.197080 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:29:02.197064    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\""
Jul 13 15:29:02.197206 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:29:02.197135    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\""
Jul 13 15:29:02.198901 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:29:02.198810    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Jul 13 15:29:02.202538 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:29:02.202513    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-7b567978d6-sp4hs"]
Jul 13 15:29:02.233989 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:29:02.233953    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/5240d9b4-ff9e-495b-a184-2e5753c828cd-manager-config\") pod \"lws-controller-manager-7b567978d6-sp4hs\" (UID: \"5240d9b4-ff9e-495b-a184-2e5753c828cd\") " pod="openshift-lws-operator/lws-controller-manager-7b567978d6-sp4hs"
Jul 13 15:29:02.234203 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:29:02.233999    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fn7l2\" (UniqueName: \"kubernetes.io/projected/5240d9b4-ff9e-495b-a184-2e5753c828cd-kube-api-access-fn7l2\") pod \"lws-controller-manager-7b567978d6-sp4hs\" (UID: \"5240d9b4-ff9e-495b-a184-2e5753c828cd\") " pod="openshift-lws-operator/lws-controller-manager-7b567978d6-sp4hs"
Jul 13 15:29:02.234203 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:29:02.234122    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5240d9b4-ff9e-495b-a184-2e5753c828cd-cert\") pod \"lws-controller-manager-7b567978d6-sp4hs\" (UID: \"5240d9b4-ff9e-495b-a184-2e5753c828cd\") " pod="openshift-lws-operator/lws-controller-manager-7b567978d6-sp4hs"
Jul 13 15:29:02.234203 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:29:02.234167    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/5240d9b4-ff9e-495b-a184-2e5753c828cd-metrics-cert\") pod \"lws-controller-manager-7b567978d6-sp4hs\" (UID: \"5240d9b4-ff9e-495b-a184-2e5753c828cd\") " pod="openshift-lws-operator/lws-controller-manager-7b567978d6-sp4hs"
Jul 13 15:29:02.334769 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:29:02.334731    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/5240d9b4-ff9e-495b-a184-2e5753c828cd-metrics-cert\") pod \"lws-controller-manager-7b567978d6-sp4hs\" (UID: \"5240d9b4-ff9e-495b-a184-2e5753c828cd\") " pod="openshift-lws-operator/lws-controller-manager-7b567978d6-sp4hs"
Jul 13 15:29:02.335010 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:29:02.334789    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/5240d9b4-ff9e-495b-a184-2e5753c828cd-manager-config\") pod \"lws-controller-manager-7b567978d6-sp4hs\" (UID: \"5240d9b4-ff9e-495b-a184-2e5753c828cd\") " pod="openshift-lws-operator/lws-controller-manager-7b567978d6-sp4hs"
Jul 13 15:29:02.335010 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:29:02.334818    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fn7l2\" (UniqueName: \"kubernetes.io/projected/5240d9b4-ff9e-495b-a184-2e5753c828cd-kube-api-access-fn7l2\") pod \"lws-controller-manager-7b567978d6-sp4hs\" (UID: \"5240d9b4-ff9e-495b-a184-2e5753c828cd\") " pod="openshift-lws-operator/lws-controller-manager-7b567978d6-sp4hs"
Jul 13 15:29:02.335010 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:29:02.334897    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5240d9b4-ff9e-495b-a184-2e5753c828cd-cert\") pod \"lws-controller-manager-7b567978d6-sp4hs\" (UID: \"5240d9b4-ff9e-495b-a184-2e5753c828cd\") " pod="openshift-lws-operator/lws-controller-manager-7b567978d6-sp4hs"
Jul 13 15:29:02.335550 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:29:02.335525    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/5240d9b4-ff9e-495b-a184-2e5753c828cd-manager-config\") pod \"lws-controller-manager-7b567978d6-sp4hs\" (UID: \"5240d9b4-ff9e-495b-a184-2e5753c828cd\") " pod="openshift-lws-operator/lws-controller-manager-7b567978d6-sp4hs"
Jul 13 15:29:02.337345 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:29:02.337324    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/5240d9b4-ff9e-495b-a184-2e5753c828cd-metrics-cert\") pod \"lws-controller-manager-7b567978d6-sp4hs\" (UID: \"5240d9b4-ff9e-495b-a184-2e5753c828cd\") " pod="openshift-lws-operator/lws-controller-manager-7b567978d6-sp4hs"
Jul 13 15:29:02.337454 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:29:02.337342    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5240d9b4-ff9e-495b-a184-2e5753c828cd-cert\") pod \"lws-controller-manager-7b567978d6-sp4hs\" (UID: \"5240d9b4-ff9e-495b-a184-2e5753c828cd\") " pod="openshift-lws-operator/lws-controller-manager-7b567978d6-sp4hs"
Jul 13 15:29:02.345791 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:29:02.345766    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fn7l2\" (UniqueName: \"kubernetes.io/projected/5240d9b4-ff9e-495b-a184-2e5753c828cd-kube-api-access-fn7l2\") pod \"lws-controller-manager-7b567978d6-sp4hs\" (UID: \"5240d9b4-ff9e-495b-a184-2e5753c828cd\") " pod="openshift-lws-operator/lws-controller-manager-7b567978d6-sp4hs"
Jul 13 15:29:02.502473 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:29:02.502385    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-7b567978d6-sp4hs"
Jul 13 15:29:02.655140 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:29:02.655114    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-7b567978d6-sp4hs"]
Jul 13 15:29:02.657525 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:29:02.657492    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5240d9b4_ff9e_495b_a184_2e5753c828cd.slice/crio-490171ba5cc0c2c23f40fc8b0131f88c2033f4224c208b6243149fc9d262268d WatchSource:0}: Error finding container 490171ba5cc0c2c23f40fc8b0131f88c2033f4224c208b6243149fc9d262268d: Status 404 returned error can't find the container with id 490171ba5cc0c2c23f40fc8b0131f88c2033f4224c208b6243149fc9d262268d
Jul 13 15:29:03.467400 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:29:03.467357    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-7b567978d6-sp4hs" event={"ID":"5240d9b4-ff9e-495b-a184-2e5753c828cd","Type":"ContainerStarted","Data":"490171ba5cc0c2c23f40fc8b0131f88c2033f4224c208b6243149fc9d262268d"}
Jul 13 15:29:04.473850 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:29:04.473823    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-7b567978d6-sp4hs" event={"ID":"5240d9b4-ff9e-495b-a184-2e5753c828cd","Type":"ContainerStarted","Data":"0f05d01507f3e29c15dacf538d74d2cf6b083e83296ac040594ac30484bdfbb1"}
Jul 13 15:29:04.474220 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:29:04.473927    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-7b567978d6-sp4hs"
Jul 13 15:29:04.517665 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:29:04.517583    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-7b567978d6-sp4hs" podStartSLOduration=0.778997138 podStartE2EDuration="2.517563785s" totalImagesPullingTime="1.738566647s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 15:29:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 15:29:04.515136188 +0000 UTC m=+298.094371367" watchObservedRunningTime="2026-07-13 15:29:04.517563785 +0000 UTC m=+298.096798956"
Jul 13 15:29:06.503734 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:29:06.503700    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-4z8rn"]
Jul 13 15:29:06.504211 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:29:06.503935    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/istiod-openshift-gateway-7574459656-4z8rn" podUID="143605e2-e057-44c4-82d9-147d4fee79d4" containerName="discovery" containerID="cri-o://615e233d253dc5696ecb2b09bcbf7b0daa890a06032bef6e7176eed3bf397bd5" gracePeriod=30
Jul 13 15:29:06.757075 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:29:06.757009    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-4z8rn"
Jul 13 15:29:06.858517 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:29:06.858484    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9dq6z_258b7ae3-adf5-437a-8f8e-71bdd1cc665b/ovn-acl-logging/0.log"
Jul 13 15:29:06.860197 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:29:06.860170    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9dq6z_258b7ae3-adf5-437a-8f8e-71bdd1cc665b/ovn-acl-logging/0.log"
Jul 13 15:29:06.861842 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:29:06.861823    2564 kubelet.go:1648] "Image garbage collection succeeded"
Jul 13 15:29:06.877159 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:29:06.877134    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/143605e2-e057-44c4-82d9-147d4fee79d4-cacerts\") pod \"143605e2-e057-44c4-82d9-147d4fee79d4\" (UID: \"143605e2-e057-44c4-82d9-147d4fee79d4\") "
Jul 13 15:29:06.877277 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:29:06.877168    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/143605e2-e057-44c4-82d9-147d4fee79d4-istio-token\") pod \"143605e2-e057-44c4-82d9-147d4fee79d4\" (UID: \"143605e2-e057-44c4-82d9-147d4fee79d4\") "
Jul 13 15:29:06.877277 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:29:06.877229    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/143605e2-e057-44c4-82d9-147d4fee79d4-istio-csr-dns-cert\") pod \"143605e2-e057-44c4-82d9-147d4fee79d4\" (UID: \"143605e2-e057-44c4-82d9-147d4fee79d4\") "
Jul 13 15:29:06.877368 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:29:06.877327    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sm6l8\" (UniqueName: \"kubernetes.io/projected/143605e2-e057-44c4-82d9-147d4fee79d4-kube-api-access-sm6l8\") pod \"143605e2-e057-44c4-82d9-147d4fee79d4\" (UID: \"143605e2-e057-44c4-82d9-147d4fee79d4\") "
Jul 13 15:29:06.877408 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:29:06.877393    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/143605e2-e057-44c4-82d9-147d4fee79d4-istio-csr-ca-configmap\") pod \"143605e2-e057-44c4-82d9-147d4fee79d4\" (UID: \"143605e2-e057-44c4-82d9-147d4fee79d4\") "
Jul 13 15:29:06.877447 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:29:06.877433    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/143605e2-e057-44c4-82d9-147d4fee79d4-istio-kubeconfig\") pod \"143605e2-e057-44c4-82d9-147d4fee79d4\" (UID: \"143605e2-e057-44c4-82d9-147d4fee79d4\") "
Jul 13 15:29:06.877527 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:29:06.877508    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/143605e2-e057-44c4-82d9-147d4fee79d4-local-certs\") pod \"143605e2-e057-44c4-82d9-147d4fee79d4\" (UID: \"143605e2-e057-44c4-82d9-147d4fee79d4\") "
Jul 13 15:29:06.877833 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:29:06.877777    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/143605e2-e057-44c4-82d9-147d4fee79d4-istio-csr-ca-configmap" (OuterVolumeSpecName: "istio-csr-ca-configmap") pod "143605e2-e057-44c4-82d9-147d4fee79d4" (UID: "143605e2-e057-44c4-82d9-147d4fee79d4"). InnerVolumeSpecName "istio-csr-ca-configmap". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 13 15:29:06.879600 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:29:06.879575    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/143605e2-e057-44c4-82d9-147d4fee79d4-cacerts" (OuterVolumeSpecName: "cacerts") pod "143605e2-e057-44c4-82d9-147d4fee79d4" (UID: "143605e2-e057-44c4-82d9-147d4fee79d4"). InnerVolumeSpecName "cacerts". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 13 15:29:06.879855 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:29:06.879818    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/143605e2-e057-44c4-82d9-147d4fee79d4-istio-token" (OuterVolumeSpecName: "istio-token") pod "143605e2-e057-44c4-82d9-147d4fee79d4" (UID: "143605e2-e057-44c4-82d9-147d4fee79d4"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 13 15:29:06.879970 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:29:06.879854    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/143605e2-e057-44c4-82d9-147d4fee79d4-istio-kubeconfig" (OuterVolumeSpecName: "istio-kubeconfig") pod "143605e2-e057-44c4-82d9-147d4fee79d4" (UID: "143605e2-e057-44c4-82d9-147d4fee79d4"). InnerVolumeSpecName "istio-kubeconfig". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 13 15:29:06.879970 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:29:06.879923    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/143605e2-e057-44c4-82d9-147d4fee79d4-istio-csr-dns-cert" (OuterVolumeSpecName: "istio-csr-dns-cert") pod "143605e2-e057-44c4-82d9-147d4fee79d4" (UID: "143605e2-e057-44c4-82d9-147d4fee79d4"). InnerVolumeSpecName "istio-csr-dns-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 13 15:29:06.879970 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:29:06.879933    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/143605e2-e057-44c4-82d9-147d4fee79d4-kube-api-access-sm6l8" (OuterVolumeSpecName: "kube-api-access-sm6l8") pod "143605e2-e057-44c4-82d9-147d4fee79d4" (UID: "143605e2-e057-44c4-82d9-147d4fee79d4"). InnerVolumeSpecName "kube-api-access-sm6l8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 13 15:29:06.879970 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:29:06.879955    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/143605e2-e057-44c4-82d9-147d4fee79d4-local-certs" (OuterVolumeSpecName: "local-certs") pod "143605e2-e057-44c4-82d9-147d4fee79d4" (UID: "143605e2-e057-44c4-82d9-147d4fee79d4"). InnerVolumeSpecName "local-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 15:29:06.978210 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:29:06.978174    2564 reconciler_common.go:299] "Volume detached for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/143605e2-e057-44c4-82d9-147d4fee79d4-cacerts\") on node \"ip-10-0-140-255.ec2.internal\" DevicePath \"\""
Jul 13 15:29:06.978210 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:29:06.978206    2564 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/143605e2-e057-44c4-82d9-147d4fee79d4-istio-token\") on node \"ip-10-0-140-255.ec2.internal\" DevicePath \"\""
Jul 13 15:29:06.978210 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:29:06.978216    2564 reconciler_common.go:299] "Volume detached for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/143605e2-e057-44c4-82d9-147d4fee79d4-istio-csr-dns-cert\") on node \"ip-10-0-140-255.ec2.internal\" DevicePath \"\""
Jul 13 15:29:06.978447 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:29:06.978225    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sm6l8\" (UniqueName: \"kubernetes.io/projected/143605e2-e057-44c4-82d9-147d4fee79d4-kube-api-access-sm6l8\") on node \"ip-10-0-140-255.ec2.internal\" DevicePath \"\""
Jul 13 15:29:06.978447 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:29:06.978234    2564 reconciler_common.go:299] "Volume detached for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/143605e2-e057-44c4-82d9-147d4fee79d4-istio-csr-ca-configmap\") on node \"ip-10-0-140-255.ec2.internal\" DevicePath \"\""
Jul 13 15:29:06.978447 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:29:06.978242    2564 reconciler_common.go:299] "Volume detached for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/143605e2-e057-44c4-82d9-147d4fee79d4-istio-kubeconfig\") on node \"ip-10-0-140-255.ec2.internal\" DevicePath \"\""
Jul 13 15:29:06.978447 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:29:06.978250    2564 reconciler_common.go:299] "Volume detached for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/143605e2-e057-44c4-82d9-147d4fee79d4-local-certs\") on node \"ip-10-0-140-255.ec2.internal\" DevicePath \"\""
Jul 13 15:29:07.488558 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:29:07.488469    2564 generic.go:356] "Generic (PLEG): container finished" podID="143605e2-e057-44c4-82d9-147d4fee79d4" containerID="615e233d253dc5696ecb2b09bcbf7b0daa890a06032bef6e7176eed3bf397bd5" exitCode=0
Jul 13 15:29:07.488558 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:29:07.488529    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-4z8rn"
Jul 13 15:29:07.488558 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:29:07.488551    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-4z8rn" event={"ID":"143605e2-e057-44c4-82d9-147d4fee79d4","Type":"ContainerDied","Data":"615e233d253dc5696ecb2b09bcbf7b0daa890a06032bef6e7176eed3bf397bd5"}
Jul 13 15:29:07.488814 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:29:07.488602    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-4z8rn" event={"ID":"143605e2-e057-44c4-82d9-147d4fee79d4","Type":"ContainerDied","Data":"b5f7c1fe3a8ad9db198d40b4279325d6c60d26bf9d349e0d69f52152c33d8790"}
Jul 13 15:29:07.488814 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:29:07.488625    2564 scope.go:117] "RemoveContainer" containerID="615e233d253dc5696ecb2b09bcbf7b0daa890a06032bef6e7176eed3bf397bd5"
Jul 13 15:29:07.496965 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:29:07.496944    2564 scope.go:117] "RemoveContainer" containerID="615e233d253dc5696ecb2b09bcbf7b0daa890a06032bef6e7176eed3bf397bd5"
Jul 13 15:29:07.497258 ip-10-0-140-255 kubenswrapper[2564]: E0713 15:29:07.497241    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"615e233d253dc5696ecb2b09bcbf7b0daa890a06032bef6e7176eed3bf397bd5\": container with ID starting with 615e233d253dc5696ecb2b09bcbf7b0daa890a06032bef6e7176eed3bf397bd5 not found: ID does not exist" containerID="615e233d253dc5696ecb2b09bcbf7b0daa890a06032bef6e7176eed3bf397bd5"
Jul 13 15:29:07.497315 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:29:07.497268    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"615e233d253dc5696ecb2b09bcbf7b0daa890a06032bef6e7176eed3bf397bd5"} err="failed to get container status \"615e233d253dc5696ecb2b09bcbf7b0daa890a06032bef6e7176eed3bf397bd5\": rpc error: code = NotFound desc = could not find container \"615e233d253dc5696ecb2b09bcbf7b0daa890a06032bef6e7176eed3bf397bd5\": container with ID starting with 615e233d253dc5696ecb2b09bcbf7b0daa890a06032bef6e7176eed3bf397bd5 not found: ID does not exist"
Jul 13 15:29:07.519138 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:29:07.519104    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-4z8rn"]
Jul 13 15:29:07.527975 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:29:07.527943    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-4z8rn"]
Jul 13 15:29:09.121251 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:29:09.121215    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="143605e2-e057-44c4-82d9-147d4fee79d4" path="/var/lib/kubelet/pods/143605e2-e057-44c4-82d9-147d4fee79d4/volumes"
Jul 13 15:29:12.462921 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:29:12.462891    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-7998c67dc4-dqc4z"
Jul 13 15:29:12.464825 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:29:12.464805    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-54d89bd5fc-jxf6r"
Jul 13 15:29:15.480525 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:29:15.480499    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-7b567978d6-sp4hs"
Jul 13 15:30:10.148383 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:30:10.148349    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0lp4tx"]
Jul 13 15:30:10.148921 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:30:10.148771    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="143605e2-e057-44c4-82d9-147d4fee79d4" containerName="discovery"
Jul 13 15:30:10.148921 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:30:10.148790    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="143605e2-e057-44c4-82d9-147d4fee79d4" containerName="discovery"
Jul 13 15:30:10.149578 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:30:10.149560    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="143605e2-e057-44c4-82d9-147d4fee79d4" containerName="discovery"
Jul 13 15:30:10.152411 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:30:10.152388    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0lp4tx"
Jul 13 15:30:10.156159 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:30:10.156140    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-4qjbx\""
Jul 13 15:30:10.156402 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:30:10.156375    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 13 15:30:10.157027 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:30:10.157013    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 13 15:30:10.164800 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:30:10.164776    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0lp4tx"]
Jul 13 15:30:10.216815 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:30:10.216777    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fx28x\" (UniqueName: \"kubernetes.io/projected/7f3a77c5-69ba-408f-9094-8141f494ba9b-kube-api-access-fx28x\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0lp4tx\" (UID: \"7f3a77c5-69ba-408f-9094-8141f494ba9b\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0lp4tx"
Jul 13 15:30:10.216815 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:30:10.216816    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7f3a77c5-69ba-408f-9094-8141f494ba9b-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0lp4tx\" (UID: \"7f3a77c5-69ba-408f-9094-8141f494ba9b\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0lp4tx"
Jul 13 15:30:10.217061 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:30:10.216853    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7f3a77c5-69ba-408f-9094-8141f494ba9b-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0lp4tx\" (UID: \"7f3a77c5-69ba-408f-9094-8141f494ba9b\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0lp4tx"
Jul 13 15:30:10.318299 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:30:10.318249    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7f3a77c5-69ba-408f-9094-8141f494ba9b-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0lp4tx\" (UID: \"7f3a77c5-69ba-408f-9094-8141f494ba9b\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0lp4tx"
Jul 13 15:30:10.318444 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:30:10.318373    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fx28x\" (UniqueName: \"kubernetes.io/projected/7f3a77c5-69ba-408f-9094-8141f494ba9b-kube-api-access-fx28x\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0lp4tx\" (UID: \"7f3a77c5-69ba-408f-9094-8141f494ba9b\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0lp4tx"
Jul 13 15:30:10.318444 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:30:10.318413    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7f3a77c5-69ba-408f-9094-8141f494ba9b-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0lp4tx\" (UID: \"7f3a77c5-69ba-408f-9094-8141f494ba9b\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0lp4tx"
Jul 13 15:30:10.318736 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:30:10.318717    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7f3a77c5-69ba-408f-9094-8141f494ba9b-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0lp4tx\" (UID: \"7f3a77c5-69ba-408f-9094-8141f494ba9b\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0lp4tx"
Jul 13 15:30:10.318782 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:30:10.318727    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7f3a77c5-69ba-408f-9094-8141f494ba9b-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0lp4tx\" (UID: \"7f3a77c5-69ba-408f-9094-8141f494ba9b\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0lp4tx"
Jul 13 15:30:10.333597 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:30:10.333562    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fx28x\" (UniqueName: \"kubernetes.io/projected/7f3a77c5-69ba-408f-9094-8141f494ba9b-kube-api-access-fx28x\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0lp4tx\" (UID: \"7f3a77c5-69ba-408f-9094-8141f494ba9b\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0lp4tx"
Jul 13 15:30:10.461030 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:30:10.460952    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0lp4tx"
Jul 13 15:30:10.596130 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:30:10.596107    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0lp4tx"]
Jul 13 15:30:10.598058 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:30:10.598031    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7f3a77c5_69ba_408f_9094_8141f494ba9b.slice/crio-f4d1f8b716826baf55facc4ba5224b429741d55593a793c6ddc15ec910a26b67 WatchSource:0}: Error finding container f4d1f8b716826baf55facc4ba5224b429741d55593a793c6ddc15ec910a26b67: Status 404 returned error can't find the container with id f4d1f8b716826baf55facc4ba5224b429741d55593a793c6ddc15ec910a26b67
Jul 13 15:30:10.733623 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:30:10.733531    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12fr6s"]
Jul 13 15:30:10.736204 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:30:10.736176    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12fr6s"
Jul 13 15:30:10.748903 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:30:10.748848    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12fr6s"]
Jul 13 15:30:10.780145 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:30:10.780114    2564 generic.go:356] "Generic (PLEG): container finished" podID="7f3a77c5-69ba-408f-9094-8141f494ba9b" containerID="e01cac81af43997011657b388114b161877ded6402effb80e68da916b3246c94" exitCode=0
Jul 13 15:30:10.780395 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:30:10.780182    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0lp4tx" event={"ID":"7f3a77c5-69ba-408f-9094-8141f494ba9b","Type":"ContainerDied","Data":"e01cac81af43997011657b388114b161877ded6402effb80e68da916b3246c94"}
Jul 13 15:30:10.780395 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:30:10.780228    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0lp4tx" event={"ID":"7f3a77c5-69ba-408f-9094-8141f494ba9b","Type":"ContainerStarted","Data":"f4d1f8b716826baf55facc4ba5224b429741d55593a793c6ddc15ec910a26b67"}
Jul 13 15:30:10.780672 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:30:10.780657    2564 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 13 15:30:10.821978 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:30:10.821940    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j4vkb\" (UniqueName: \"kubernetes.io/projected/c7b0aa49-e174-4a4d-ba47-0f56e757cc28-kube-api-access-j4vkb\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12fr6s\" (UID: \"c7b0aa49-e174-4a4d-ba47-0f56e757cc28\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12fr6s"
Jul 13 15:30:10.822170 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:30:10.822003    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c7b0aa49-e174-4a4d-ba47-0f56e757cc28-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12fr6s\" (UID: \"c7b0aa49-e174-4a4d-ba47-0f56e757cc28\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12fr6s"
Jul 13 15:30:10.822170 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:30:10.822041    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c7b0aa49-e174-4a4d-ba47-0f56e757cc28-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12fr6s\" (UID: \"c7b0aa49-e174-4a4d-ba47-0f56e757cc28\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12fr6s"
Jul 13 15:30:10.923113 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:30:10.923080    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j4vkb\" (UniqueName: \"kubernetes.io/projected/c7b0aa49-e174-4a4d-ba47-0f56e757cc28-kube-api-access-j4vkb\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12fr6s\" (UID: \"c7b0aa49-e174-4a4d-ba47-0f56e757cc28\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12fr6s"
Jul 13 15:30:10.923309 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:30:10.923129    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c7b0aa49-e174-4a4d-ba47-0f56e757cc28-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12fr6s\" (UID: \"c7b0aa49-e174-4a4d-ba47-0f56e757cc28\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12fr6s"
Jul 13 15:30:10.923309 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:30:10.923163    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c7b0aa49-e174-4a4d-ba47-0f56e757cc28-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12fr6s\" (UID: \"c7b0aa49-e174-4a4d-ba47-0f56e757cc28\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12fr6s"
Jul 13 15:30:10.923587 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:30:10.923563    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c7b0aa49-e174-4a4d-ba47-0f56e757cc28-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12fr6s\" (UID: \"c7b0aa49-e174-4a4d-ba47-0f56e757cc28\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12fr6s"
Jul 13 15:30:10.923657 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:30:10.923619    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c7b0aa49-e174-4a4d-ba47-0f56e757cc28-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12fr6s\" (UID: \"c7b0aa49-e174-4a4d-ba47-0f56e757cc28\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12fr6s"
Jul 13 15:30:10.932551 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:30:10.932524    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j4vkb\" (UniqueName: \"kubernetes.io/projected/c7b0aa49-e174-4a4d-ba47-0f56e757cc28-kube-api-access-j4vkb\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12fr6s\" (UID: \"c7b0aa49-e174-4a4d-ba47-0f56e757cc28\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12fr6s"
Jul 13 15:30:11.061599 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:30:11.061512    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12fr6s"
Jul 13 15:30:11.126074 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:30:11.126045    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73czf72"]
Jul 13 15:30:11.128790 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:30:11.128765    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73czf72"
Jul 13 15:30:11.138908 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:30:11.138882    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73czf72"]
Jul 13 15:30:11.205894 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:30:11.205849    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12fr6s"]
Jul 13 15:30:11.207938 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:30:11.207915    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc7b0aa49_e174_4a4d_ba47_0f56e757cc28.slice/crio-d97515f3ef1e0fb1cd0e2ec75b811f432ab7a7889a664f7677798705bf5c55cf WatchSource:0}: Error finding container d97515f3ef1e0fb1cd0e2ec75b811f432ab7a7889a664f7677798705bf5c55cf: Status 404 returned error can't find the container with id d97515f3ef1e0fb1cd0e2ec75b811f432ab7a7889a664f7677798705bf5c55cf
Jul 13 15:30:11.224943 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:30:11.224917    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/759670f8-b077-456c-b4bf-e65e8ceca720-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73czf72\" (UID: \"759670f8-b077-456c-b4bf-e65e8ceca720\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73czf72"
Jul 13 15:30:11.225172 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:30:11.225144    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8mmlv\" (UniqueName: \"kubernetes.io/projected/759670f8-b077-456c-b4bf-e65e8ceca720-kube-api-access-8mmlv\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73czf72\" (UID: \"759670f8-b077-456c-b4bf-e65e8ceca720\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73czf72"
Jul 13 15:30:11.225252 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:30:11.225233    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/759670f8-b077-456c-b4bf-e65e8ceca720-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73czf72\" (UID: \"759670f8-b077-456c-b4bf-e65e8ceca720\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73czf72"
Jul 13 15:30:11.326295 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:30:11.326261    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/759670f8-b077-456c-b4bf-e65e8ceca720-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73czf72\" (UID: \"759670f8-b077-456c-b4bf-e65e8ceca720\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73czf72"
Jul 13 15:30:11.326449 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:30:11.326315    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/759670f8-b077-456c-b4bf-e65e8ceca720-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73czf72\" (UID: \"759670f8-b077-456c-b4bf-e65e8ceca720\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73czf72"
Jul 13 15:30:11.326449 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:30:11.326358    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8mmlv\" (UniqueName: \"kubernetes.io/projected/759670f8-b077-456c-b4bf-e65e8ceca720-kube-api-access-8mmlv\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73czf72\" (UID: \"759670f8-b077-456c-b4bf-e65e8ceca720\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73czf72"
Jul 13 15:30:11.326620 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:30:11.326602    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/759670f8-b077-456c-b4bf-e65e8ceca720-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73czf72\" (UID: \"759670f8-b077-456c-b4bf-e65e8ceca720\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73czf72"
Jul 13 15:30:11.326664 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:30:11.326632    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/759670f8-b077-456c-b4bf-e65e8ceca720-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73czf72\" (UID: \"759670f8-b077-456c-b4bf-e65e8ceca720\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73czf72"
Jul 13 15:30:11.337811 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:30:11.337775    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8mmlv\" (UniqueName: \"kubernetes.io/projected/759670f8-b077-456c-b4bf-e65e8ceca720-kube-api-access-8mmlv\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73czf72\" (UID: \"759670f8-b077-456c-b4bf-e65e8ceca720\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73czf72"
Jul 13 15:30:11.438908 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:30:11.438885    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73czf72"
Jul 13 15:30:11.529975 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:30:11.528271    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759vslrv"]
Jul 13 15:30:11.531751 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:30:11.531666    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759vslrv"
Jul 13 15:30:11.542007 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:30:11.541958    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759vslrv"]
Jul 13 15:30:11.587726 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:30:11.587700    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73czf72"]
Jul 13 15:30:11.619858 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:30:11.619825    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod759670f8_b077_456c_b4bf_e65e8ceca720.slice/crio-7947b7ab46f918d65abf655366fea1b9f08a9ee10fbf25d36868958e6966e52b WatchSource:0}: Error finding container 7947b7ab46f918d65abf655366fea1b9f08a9ee10fbf25d36868958e6966e52b: Status 404 returned error can't find the container with id 7947b7ab46f918d65abf655366fea1b9f08a9ee10fbf25d36868958e6966e52b
Jul 13 15:30:11.628030 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:30:11.628007    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gzzxj\" (UniqueName: \"kubernetes.io/projected/a29f56cc-5a85-4bb7-a894-2241247faf6a-kube-api-access-gzzxj\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759vslrv\" (UID: \"a29f56cc-5a85-4bb7-a894-2241247faf6a\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759vslrv"
Jul 13 15:30:11.628118 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:30:11.628044    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a29f56cc-5a85-4bb7-a894-2241247faf6a-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759vslrv\" (UID: \"a29f56cc-5a85-4bb7-a894-2241247faf6a\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759vslrv"
Jul 13 15:30:11.628118 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:30:11.628070    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a29f56cc-5a85-4bb7-a894-2241247faf6a-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759vslrv\" (UID: \"a29f56cc-5a85-4bb7-a894-2241247faf6a\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759vslrv"
Jul 13 15:30:11.728735 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:30:11.728704    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gzzxj\" (UniqueName: \"kubernetes.io/projected/a29f56cc-5a85-4bb7-a894-2241247faf6a-kube-api-access-gzzxj\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759vslrv\" (UID: \"a29f56cc-5a85-4bb7-a894-2241247faf6a\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759vslrv"
Jul 13 15:30:11.728916 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:30:11.728745    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a29f56cc-5a85-4bb7-a894-2241247faf6a-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759vslrv\" (UID: \"a29f56cc-5a85-4bb7-a894-2241247faf6a\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759vslrv"
Jul 13 15:30:11.728916 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:30:11.728848    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a29f56cc-5a85-4bb7-a894-2241247faf6a-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759vslrv\" (UID: \"a29f56cc-5a85-4bb7-a894-2241247faf6a\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759vslrv"
Jul 13 15:30:11.729210 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:30:11.729189    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a29f56cc-5a85-4bb7-a894-2241247faf6a-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759vslrv\" (UID: \"a29f56cc-5a85-4bb7-a894-2241247faf6a\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759vslrv"
Jul 13 15:30:11.729210 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:30:11.729200    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a29f56cc-5a85-4bb7-a894-2241247faf6a-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759vslrv\" (UID: \"a29f56cc-5a85-4bb7-a894-2241247faf6a\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759vslrv"
Jul 13 15:30:11.741337 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:30:11.741312    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gzzxj\" (UniqueName: \"kubernetes.io/projected/a29f56cc-5a85-4bb7-a894-2241247faf6a-kube-api-access-gzzxj\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759vslrv\" (UID: \"a29f56cc-5a85-4bb7-a894-2241247faf6a\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759vslrv"
Jul 13 15:30:11.786495 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:30:11.786461    2564 generic.go:356] "Generic (PLEG): container finished" podID="7f3a77c5-69ba-408f-9094-8141f494ba9b" containerID="adfdd3e64153711be368a5309f57aabff178d3a1ceab3bf6ed413ca5579b2bb4" exitCode=0
Jul 13 15:30:11.786678 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:30:11.786549    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0lp4tx" event={"ID":"7f3a77c5-69ba-408f-9094-8141f494ba9b","Type":"ContainerDied","Data":"adfdd3e64153711be368a5309f57aabff178d3a1ceab3bf6ed413ca5579b2bb4"}
Jul 13 15:30:11.788200 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:30:11.788077    2564 generic.go:356] "Generic (PLEG): container finished" podID="759670f8-b077-456c-b4bf-e65e8ceca720" containerID="6e3d886f399fbc70f6836918552074069ac5a6608f80f09cfb0b6a813c5cd217" exitCode=0
Jul 13 15:30:11.788200 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:30:11.788113    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73czf72" event={"ID":"759670f8-b077-456c-b4bf-e65e8ceca720","Type":"ContainerDied","Data":"6e3d886f399fbc70f6836918552074069ac5a6608f80f09cfb0b6a813c5cd217"}
Jul 13 15:30:11.788200 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:30:11.788156    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73czf72" event={"ID":"759670f8-b077-456c-b4bf-e65e8ceca720","Type":"ContainerStarted","Data":"7947b7ab46f918d65abf655366fea1b9f08a9ee10fbf25d36868958e6966e52b"}
Jul 13 15:30:11.789615 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:30:11.789596    2564 generic.go:356] "Generic (PLEG): container finished" podID="c7b0aa49-e174-4a4d-ba47-0f56e757cc28" containerID="beeffb056dc9b3563642f64a4e821d78678bc024e6f78379ad8f46d871a21c00" exitCode=0
Jul 13 15:30:11.789698 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:30:11.789632    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12fr6s" event={"ID":"c7b0aa49-e174-4a4d-ba47-0f56e757cc28","Type":"ContainerDied","Data":"beeffb056dc9b3563642f64a4e821d78678bc024e6f78379ad8f46d871a21c00"}
Jul 13 15:30:11.789698 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:30:11.789657    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12fr6s" event={"ID":"c7b0aa49-e174-4a4d-ba47-0f56e757cc28","Type":"ContainerStarted","Data":"d97515f3ef1e0fb1cd0e2ec75b811f432ab7a7889a664f7677798705bf5c55cf"}
Jul 13 15:30:11.844819 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:30:11.844739    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759vslrv"
Jul 13 15:30:11.995282 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:30:11.995256    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759vslrv"]
Jul 13 15:30:11.997025 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:30:11.997000    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda29f56cc_5a85_4bb7_a894_2241247faf6a.slice/crio-457d9f96b69e861ac6465387b4fcc596402004da259c6fceb51dc8b15facbd3d WatchSource:0}: Error finding container 457d9f96b69e861ac6465387b4fcc596402004da259c6fceb51dc8b15facbd3d: Status 404 returned error can't find the container with id 457d9f96b69e861ac6465387b4fcc596402004da259c6fceb51dc8b15facbd3d
Jul 13 15:30:12.798507 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:30:12.798467    2564 generic.go:356] "Generic (PLEG): container finished" podID="7f3a77c5-69ba-408f-9094-8141f494ba9b" containerID="3f887144fad9583675bf970c72f55fd3fc793e0aa93af8072569e83d1e33a7e2" exitCode=0
Jul 13 15:30:12.799032 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:30:12.798546    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0lp4tx" event={"ID":"7f3a77c5-69ba-408f-9094-8141f494ba9b","Type":"ContainerDied","Data":"3f887144fad9583675bf970c72f55fd3fc793e0aa93af8072569e83d1e33a7e2"}
Jul 13 15:30:12.800528 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:30:12.800494    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12fr6s" event={"ID":"c7b0aa49-e174-4a4d-ba47-0f56e757cc28","Type":"ContainerStarted","Data":"16f1cea2cd6252fb911d54b411d6569d030636528eb4472e608fee0921b7e552"}
Jul 13 15:30:12.802087 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:30:12.802055    2564 generic.go:356] "Generic (PLEG): container finished" podID="a29f56cc-5a85-4bb7-a894-2241247faf6a" containerID="358d03d3c8850a2aba347057c302e25b366768bf67c046a389c20cbe7bccb85e" exitCode=0
Jul 13 15:30:12.802203 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:30:12.802120    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759vslrv" event={"ID":"a29f56cc-5a85-4bb7-a894-2241247faf6a","Type":"ContainerDied","Data":"358d03d3c8850a2aba347057c302e25b366768bf67c046a389c20cbe7bccb85e"}
Jul 13 15:30:12.802203 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:30:12.802170    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759vslrv" event={"ID":"a29f56cc-5a85-4bb7-a894-2241247faf6a","Type":"ContainerStarted","Data":"457d9f96b69e861ac6465387b4fcc596402004da259c6fceb51dc8b15facbd3d"}
Jul 13 15:30:13.808950 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:30:13.808920    2564 generic.go:356] "Generic (PLEG): container finished" podID="759670f8-b077-456c-b4bf-e65e8ceca720" containerID="9d9521509d870b626a93816734a7a02d479914c024a6614db2e50b93c4dba542" exitCode=0
Jul 13 15:30:13.809361 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:30:13.809000    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73czf72" event={"ID":"759670f8-b077-456c-b4bf-e65e8ceca720","Type":"ContainerDied","Data":"9d9521509d870b626a93816734a7a02d479914c024a6614db2e50b93c4dba542"}
Jul 13 15:30:13.811047 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:30:13.811024    2564 generic.go:356] "Generic (PLEG): container finished" podID="c7b0aa49-e174-4a4d-ba47-0f56e757cc28" containerID="16f1cea2cd6252fb911d54b411d6569d030636528eb4472e608fee0921b7e552" exitCode=0
Jul 13 15:30:13.811135 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:30:13.811106    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12fr6s" event={"ID":"c7b0aa49-e174-4a4d-ba47-0f56e757cc28","Type":"ContainerDied","Data":"16f1cea2cd6252fb911d54b411d6569d030636528eb4472e608fee0921b7e552"}
Jul 13 15:30:13.812955 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:30:13.812931    2564 generic.go:356] "Generic (PLEG): container finished" podID="a29f56cc-5a85-4bb7-a894-2241247faf6a" containerID="6d3e0ffe84d1e9ea2f2422df8fc63b32f6afad19a87323808e4b1bae984f2e77" exitCode=0
Jul 13 15:30:13.813060 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:30:13.813029    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759vslrv" event={"ID":"a29f56cc-5a85-4bb7-a894-2241247faf6a","Type":"ContainerDied","Data":"6d3e0ffe84d1e9ea2f2422df8fc63b32f6afad19a87323808e4b1bae984f2e77"}
Jul 13 15:30:13.951726 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:30:13.951699    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0lp4tx"
Jul 13 15:30:14.048028 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:30:14.047998    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7f3a77c5-69ba-408f-9094-8141f494ba9b-bundle\") pod \"7f3a77c5-69ba-408f-9094-8141f494ba9b\" (UID: \"7f3a77c5-69ba-408f-9094-8141f494ba9b\") "
Jul 13 15:30:14.048174 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:30:14.048044    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fx28x\" (UniqueName: \"kubernetes.io/projected/7f3a77c5-69ba-408f-9094-8141f494ba9b-kube-api-access-fx28x\") pod \"7f3a77c5-69ba-408f-9094-8141f494ba9b\" (UID: \"7f3a77c5-69ba-408f-9094-8141f494ba9b\") "
Jul 13 15:30:14.048174 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:30:14.048062    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7f3a77c5-69ba-408f-9094-8141f494ba9b-util\") pod \"7f3a77c5-69ba-408f-9094-8141f494ba9b\" (UID: \"7f3a77c5-69ba-408f-9094-8141f494ba9b\") "
Jul 13 15:30:14.048599 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:30:14.048572    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7f3a77c5-69ba-408f-9094-8141f494ba9b-bundle" (OuterVolumeSpecName: "bundle") pod "7f3a77c5-69ba-408f-9094-8141f494ba9b" (UID: "7f3a77c5-69ba-408f-9094-8141f494ba9b"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 15:30:14.050187 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:30:14.050163    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7f3a77c5-69ba-408f-9094-8141f494ba9b-kube-api-access-fx28x" (OuterVolumeSpecName: "kube-api-access-fx28x") pod "7f3a77c5-69ba-408f-9094-8141f494ba9b" (UID: "7f3a77c5-69ba-408f-9094-8141f494ba9b"). InnerVolumeSpecName "kube-api-access-fx28x". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 13 15:30:14.053294 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:30:14.053272    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7f3a77c5-69ba-408f-9094-8141f494ba9b-util" (OuterVolumeSpecName: "util") pod "7f3a77c5-69ba-408f-9094-8141f494ba9b" (UID: "7f3a77c5-69ba-408f-9094-8141f494ba9b"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 15:30:14.149648 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:30:14.149606    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fx28x\" (UniqueName: \"kubernetes.io/projected/7f3a77c5-69ba-408f-9094-8141f494ba9b-kube-api-access-fx28x\") on node \"ip-10-0-140-255.ec2.internal\" DevicePath \"\""
Jul 13 15:30:14.149648 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:30:14.149640    2564 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7f3a77c5-69ba-408f-9094-8141f494ba9b-util\") on node \"ip-10-0-140-255.ec2.internal\" DevicePath \"\""
Jul 13 15:30:14.149648 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:30:14.149652    2564 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7f3a77c5-69ba-408f-9094-8141f494ba9b-bundle\") on node \"ip-10-0-140-255.ec2.internal\" DevicePath \"\""
Jul 13 15:30:14.819766 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:30:14.819730    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0lp4tx" event={"ID":"7f3a77c5-69ba-408f-9094-8141f494ba9b","Type":"ContainerDied","Data":"f4d1f8b716826baf55facc4ba5224b429741d55593a793c6ddc15ec910a26b67"}
Jul 13 15:30:14.820244 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:30:14.819780    2564 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="f4d1f8b716826baf55facc4ba5224b429741d55593a793c6ddc15ec910a26b67"
Jul 13 15:30:14.820244 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:30:14.819740    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0lp4tx"
Jul 13 15:30:14.821911 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:30:14.821885    2564 generic.go:356] "Generic (PLEG): container finished" podID="759670f8-b077-456c-b4bf-e65e8ceca720" containerID="4cd984e13407d525c3daed5abf6b0fdf58a1171334ac8517eca8a10afc9b3bfe" exitCode=0
Jul 13 15:30:14.822045 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:30:14.821953    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73czf72" event={"ID":"759670f8-b077-456c-b4bf-e65e8ceca720","Type":"ContainerDied","Data":"4cd984e13407d525c3daed5abf6b0fdf58a1171334ac8517eca8a10afc9b3bfe"}
Jul 13 15:30:14.824063 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:30:14.824037    2564 generic.go:356] "Generic (PLEG): container finished" podID="c7b0aa49-e174-4a4d-ba47-0f56e757cc28" containerID="66fb2ce4f19b97c9cdcfd0d0e3dc1d63ac59120780c4f5cdd834c36c4e9349e4" exitCode=0
Jul 13 15:30:14.824171 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:30:14.824117    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12fr6s" event={"ID":"c7b0aa49-e174-4a4d-ba47-0f56e757cc28","Type":"ContainerDied","Data":"66fb2ce4f19b97c9cdcfd0d0e3dc1d63ac59120780c4f5cdd834c36c4e9349e4"}
Jul 13 15:30:14.826131 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:30:14.826107    2564 generic.go:356] "Generic (PLEG): container finished" podID="a29f56cc-5a85-4bb7-a894-2241247faf6a" containerID="2139fa3c6758d758cb80ee7786d1b58fb2f33ce5f30a1d99e9ff17bda717c405" exitCode=0
Jul 13 15:30:14.826226 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:30:14.826151    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759vslrv" event={"ID":"a29f56cc-5a85-4bb7-a894-2241247faf6a","Type":"ContainerDied","Data":"2139fa3c6758d758cb80ee7786d1b58fb2f33ce5f30a1d99e9ff17bda717c405"}
Jul 13 15:30:15.999941 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:30:15.999916    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759vslrv"
Jul 13 15:30:16.002747 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:30:16.002722    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73czf72"
Jul 13 15:30:16.028806 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:30:16.028780    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12fr6s"
Jul 13 15:30:16.064177 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:30:16.064140    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/759670f8-b077-456c-b4bf-e65e8ceca720-util\") pod \"759670f8-b077-456c-b4bf-e65e8ceca720\" (UID: \"759670f8-b077-456c-b4bf-e65e8ceca720\") "
Jul 13 15:30:16.064177 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:30:16.064182    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gzzxj\" (UniqueName: \"kubernetes.io/projected/a29f56cc-5a85-4bb7-a894-2241247faf6a-kube-api-access-gzzxj\") pod \"a29f56cc-5a85-4bb7-a894-2241247faf6a\" (UID: \"a29f56cc-5a85-4bb7-a894-2241247faf6a\") "
Jul 13 15:30:16.064406 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:30:16.064218    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/759670f8-b077-456c-b4bf-e65e8ceca720-bundle\") pod \"759670f8-b077-456c-b4bf-e65e8ceca720\" (UID: \"759670f8-b077-456c-b4bf-e65e8ceca720\") "
Jul 13 15:30:16.064406 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:30:16.064247    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a29f56cc-5a85-4bb7-a894-2241247faf6a-util\") pod \"a29f56cc-5a85-4bb7-a894-2241247faf6a\" (UID: \"a29f56cc-5a85-4bb7-a894-2241247faf6a\") "
Jul 13 15:30:16.064406 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:30:16.064319    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a29f56cc-5a85-4bb7-a894-2241247faf6a-bundle\") pod \"a29f56cc-5a85-4bb7-a894-2241247faf6a\" (UID: \"a29f56cc-5a85-4bb7-a894-2241247faf6a\") "
Jul 13 15:30:16.064406 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:30:16.064346    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8mmlv\" (UniqueName: \"kubernetes.io/projected/759670f8-b077-456c-b4bf-e65e8ceca720-kube-api-access-8mmlv\") pod \"759670f8-b077-456c-b4bf-e65e8ceca720\" (UID: \"759670f8-b077-456c-b4bf-e65e8ceca720\") "
Jul 13 15:30:16.064847 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:30:16.064809    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a29f56cc-5a85-4bb7-a894-2241247faf6a-bundle" (OuterVolumeSpecName: "bundle") pod "a29f56cc-5a85-4bb7-a894-2241247faf6a" (UID: "a29f56cc-5a85-4bb7-a894-2241247faf6a"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 15:30:16.065044 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:30:16.064990    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/759670f8-b077-456c-b4bf-e65e8ceca720-bundle" (OuterVolumeSpecName: "bundle") pod "759670f8-b077-456c-b4bf-e65e8ceca720" (UID: "759670f8-b077-456c-b4bf-e65e8ceca720"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 15:30:16.066612 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:30:16.066572    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/759670f8-b077-456c-b4bf-e65e8ceca720-kube-api-access-8mmlv" (OuterVolumeSpecName: "kube-api-access-8mmlv") pod "759670f8-b077-456c-b4bf-e65e8ceca720" (UID: "759670f8-b077-456c-b4bf-e65e8ceca720"). InnerVolumeSpecName "kube-api-access-8mmlv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 13 15:30:16.066738 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:30:16.066669    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a29f56cc-5a85-4bb7-a894-2241247faf6a-kube-api-access-gzzxj" (OuterVolumeSpecName: "kube-api-access-gzzxj") pod "a29f56cc-5a85-4bb7-a894-2241247faf6a" (UID: "a29f56cc-5a85-4bb7-a894-2241247faf6a"). InnerVolumeSpecName "kube-api-access-gzzxj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 13 15:30:16.070222 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:30:16.070200    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/759670f8-b077-456c-b4bf-e65e8ceca720-util" (OuterVolumeSpecName: "util") pod "759670f8-b077-456c-b4bf-e65e8ceca720" (UID: "759670f8-b077-456c-b4bf-e65e8ceca720"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 15:30:16.070480 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:30:16.070459    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a29f56cc-5a85-4bb7-a894-2241247faf6a-util" (OuterVolumeSpecName: "util") pod "a29f56cc-5a85-4bb7-a894-2241247faf6a" (UID: "a29f56cc-5a85-4bb7-a894-2241247faf6a"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 15:30:16.165133 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:30:16.165101    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c7b0aa49-e174-4a4d-ba47-0f56e757cc28-util\") pod \"c7b0aa49-e174-4a4d-ba47-0f56e757cc28\" (UID: \"c7b0aa49-e174-4a4d-ba47-0f56e757cc28\") "
Jul 13 15:30:16.165305 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:30:16.165202    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-j4vkb\" (UniqueName: \"kubernetes.io/projected/c7b0aa49-e174-4a4d-ba47-0f56e757cc28-kube-api-access-j4vkb\") pod \"c7b0aa49-e174-4a4d-ba47-0f56e757cc28\" (UID: \"c7b0aa49-e174-4a4d-ba47-0f56e757cc28\") "
Jul 13 15:30:16.165305 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:30:16.165224    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c7b0aa49-e174-4a4d-ba47-0f56e757cc28-bundle\") pod \"c7b0aa49-e174-4a4d-ba47-0f56e757cc28\" (UID: \"c7b0aa49-e174-4a4d-ba47-0f56e757cc28\") "
Jul 13 15:30:16.165437 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:30:16.165421    2564 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/759670f8-b077-456c-b4bf-e65e8ceca720-util\") on node \"ip-10-0-140-255.ec2.internal\" DevicePath \"\""
Jul 13 15:30:16.165477 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:30:16.165444    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gzzxj\" (UniqueName: \"kubernetes.io/projected/a29f56cc-5a85-4bb7-a894-2241247faf6a-kube-api-access-gzzxj\") on node \"ip-10-0-140-255.ec2.internal\" DevicePath \"\""
Jul 13 15:30:16.165477 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:30:16.165459    2564 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/759670f8-b077-456c-b4bf-e65e8ceca720-bundle\") on node \"ip-10-0-140-255.ec2.internal\" DevicePath \"\""
Jul 13 15:30:16.165477 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:30:16.165472    2564 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a29f56cc-5a85-4bb7-a894-2241247faf6a-util\") on node \"ip-10-0-140-255.ec2.internal\" DevicePath \"\""
Jul 13 15:30:16.165578 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:30:16.165485    2564 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a29f56cc-5a85-4bb7-a894-2241247faf6a-bundle\") on node \"ip-10-0-140-255.ec2.internal\" DevicePath \"\""
Jul 13 15:30:16.165578 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:30:16.165496    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8mmlv\" (UniqueName: \"kubernetes.io/projected/759670f8-b077-456c-b4bf-e65e8ceca720-kube-api-access-8mmlv\") on node \"ip-10-0-140-255.ec2.internal\" DevicePath \"\""
Jul 13 15:30:16.165747 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:30:16.165721    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c7b0aa49-e174-4a4d-ba47-0f56e757cc28-bundle" (OuterVolumeSpecName: "bundle") pod "c7b0aa49-e174-4a4d-ba47-0f56e757cc28" (UID: "c7b0aa49-e174-4a4d-ba47-0f56e757cc28"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 15:30:16.167314 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:30:16.167289    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c7b0aa49-e174-4a4d-ba47-0f56e757cc28-kube-api-access-j4vkb" (OuterVolumeSpecName: "kube-api-access-j4vkb") pod "c7b0aa49-e174-4a4d-ba47-0f56e757cc28" (UID: "c7b0aa49-e174-4a4d-ba47-0f56e757cc28"). InnerVolumeSpecName "kube-api-access-j4vkb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 13 15:30:16.170346 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:30:16.170325    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c7b0aa49-e174-4a4d-ba47-0f56e757cc28-util" (OuterVolumeSpecName: "util") pod "c7b0aa49-e174-4a4d-ba47-0f56e757cc28" (UID: "c7b0aa49-e174-4a4d-ba47-0f56e757cc28"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 15:30:16.266255 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:30:16.266218    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-j4vkb\" (UniqueName: \"kubernetes.io/projected/c7b0aa49-e174-4a4d-ba47-0f56e757cc28-kube-api-access-j4vkb\") on node \"ip-10-0-140-255.ec2.internal\" DevicePath \"\""
Jul 13 15:30:16.266255 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:30:16.266248    2564 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c7b0aa49-e174-4a4d-ba47-0f56e757cc28-bundle\") on node \"ip-10-0-140-255.ec2.internal\" DevicePath \"\""
Jul 13 15:30:16.266255 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:30:16.266258    2564 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c7b0aa49-e174-4a4d-ba47-0f56e757cc28-util\") on node \"ip-10-0-140-255.ec2.internal\" DevicePath \"\""
Jul 13 15:30:16.839516 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:30:16.839488    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73czf72"
Jul 13 15:30:16.839693 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:30:16.839482    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73czf72" event={"ID":"759670f8-b077-456c-b4bf-e65e8ceca720","Type":"ContainerDied","Data":"7947b7ab46f918d65abf655366fea1b9f08a9ee10fbf25d36868958e6966e52b"}
Jul 13 15:30:16.839693 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:30:16.839606    2564 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="7947b7ab46f918d65abf655366fea1b9f08a9ee10fbf25d36868958e6966e52b"
Jul 13 15:30:16.841375 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:30:16.841354    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12fr6s"
Jul 13 15:30:16.841493 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:30:16.841348    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12fr6s" event={"ID":"c7b0aa49-e174-4a4d-ba47-0f56e757cc28","Type":"ContainerDied","Data":"d97515f3ef1e0fb1cd0e2ec75b811f432ab7a7889a664f7677798705bf5c55cf"}
Jul 13 15:30:16.841493 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:30:16.841457    2564 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="d97515f3ef1e0fb1cd0e2ec75b811f432ab7a7889a664f7677798705bf5c55cf"
Jul 13 15:30:16.843416 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:30:16.843397    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759vslrv"
Jul 13 15:30:16.843494 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:30:16.843412    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759vslrv" event={"ID":"a29f56cc-5a85-4bb7-a894-2241247faf6a","Type":"ContainerDied","Data":"457d9f96b69e861ac6465387b4fcc596402004da259c6fceb51dc8b15facbd3d"}
Jul 13 15:30:16.843494 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:30:16.843447    2564 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="457d9f96b69e861ac6465387b4fcc596402004da259c6fceb51dc8b15facbd3d"
Jul 13 15:30:37.256632 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:30:37.256598    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-qj6f8"]
Jul 13 15:30:37.257161 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:30:37.256916    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c7b0aa49-e174-4a4d-ba47-0f56e757cc28" containerName="pull"
Jul 13 15:30:37.257161 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:30:37.256927    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="c7b0aa49-e174-4a4d-ba47-0f56e757cc28" containerName="pull"
Jul 13 15:30:37.257161 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:30:37.256938    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a29f56cc-5a85-4bb7-a894-2241247faf6a" containerName="pull"
Jul 13 15:30:37.257161 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:30:37.256943    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="a29f56cc-5a85-4bb7-a894-2241247faf6a" containerName="pull"
Jul 13 15:30:37.257161 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:30:37.256951    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7f3a77c5-69ba-408f-9094-8141f494ba9b" containerName="util"
Jul 13 15:30:37.257161 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:30:37.256957    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="7f3a77c5-69ba-408f-9094-8141f494ba9b" containerName="util"
Jul 13 15:30:37.257161 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:30:37.256962    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="759670f8-b077-456c-b4bf-e65e8ceca720" containerName="util"
Jul 13 15:30:37.257161 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:30:37.256968    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="759670f8-b077-456c-b4bf-e65e8ceca720" containerName="util"
Jul 13 15:30:37.257161 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:30:37.256974    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a29f56cc-5a85-4bb7-a894-2241247faf6a" containerName="util"
Jul 13 15:30:37.257161 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:30:37.256979    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="a29f56cc-5a85-4bb7-a894-2241247faf6a" containerName="util"
Jul 13 15:30:37.257161 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:30:37.256985    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="759670f8-b077-456c-b4bf-e65e8ceca720" containerName="pull"
Jul 13 15:30:37.257161 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:30:37.256990    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="759670f8-b077-456c-b4bf-e65e8ceca720" containerName="pull"
Jul 13 15:30:37.257161 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:30:37.256999    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="759670f8-b077-456c-b4bf-e65e8ceca720" containerName="extract"
Jul 13 15:30:37.257161 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:30:37.257004    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="759670f8-b077-456c-b4bf-e65e8ceca720" containerName="extract"
Jul 13 15:30:37.257161 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:30:37.257011    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7f3a77c5-69ba-408f-9094-8141f494ba9b" containerName="pull"
Jul 13 15:30:37.257161 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:30:37.257015    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="7f3a77c5-69ba-408f-9094-8141f494ba9b" containerName="pull"
Jul 13 15:30:37.257161 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:30:37.257023    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7f3a77c5-69ba-408f-9094-8141f494ba9b" containerName="extract"
Jul 13 15:30:37.257161 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:30:37.257028    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="7f3a77c5-69ba-408f-9094-8141f494ba9b" containerName="extract"
Jul 13 15:30:37.257161 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:30:37.257033    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c7b0aa49-e174-4a4d-ba47-0f56e757cc28" containerName="extract"
Jul 13 15:30:37.257161 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:30:37.257039    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="c7b0aa49-e174-4a4d-ba47-0f56e757cc28" containerName="extract"
Jul 13 15:30:37.257161 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:30:37.257049    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c7b0aa49-e174-4a4d-ba47-0f56e757cc28" containerName="util"
Jul 13 15:30:37.257161 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:30:37.257054    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="c7b0aa49-e174-4a4d-ba47-0f56e757cc28" containerName="util"
Jul 13 15:30:37.257161 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:30:37.257061    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a29f56cc-5a85-4bb7-a894-2241247faf6a" containerName="extract"
Jul 13 15:30:37.257161 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:30:37.257066    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="a29f56cc-5a85-4bb7-a894-2241247faf6a" containerName="extract"
Jul 13 15:30:37.257161 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:30:37.257138    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="7f3a77c5-69ba-408f-9094-8141f494ba9b" containerName="extract"
Jul 13 15:30:37.257161 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:30:37.257147    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="759670f8-b077-456c-b4bf-e65e8ceca720" containerName="extract"
Jul 13 15:30:37.257161 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:30:37.257154    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="a29f56cc-5a85-4bb7-a894-2241247faf6a" containerName="extract"
Jul 13 15:30:37.257161 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:30:37.257161    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="c7b0aa49-e174-4a4d-ba47-0f56e757cc28" containerName="extract"
Jul 13 15:30:37.259818 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:30:37.259801    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-qj6f8"
Jul 13 15:30:37.263607 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:30:37.263582    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-ddk2g\""
Jul 13 15:30:37.263726 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:30:37.263590    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 13 15:30:37.264510 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:30:37.264489    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\""
Jul 13 15:30:37.264614 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:30:37.264545    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 13 15:30:37.273180 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:30:37.273155    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-qj6f8"]
Jul 13 15:30:37.352854 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:30:37.352824    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p2h9s\" (UniqueName: \"kubernetes.io/projected/a2812859-d0c6-4564-84f0-5dbd80a45dd1-kube-api-access-p2h9s\") pod \"dns-operator-controller-manager-864dd78c4c-qj6f8\" (UID: \"a2812859-d0c6-4564-84f0-5dbd80a45dd1\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-qj6f8"
Jul 13 15:30:37.453603 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:30:37.453571    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p2h9s\" (UniqueName: \"kubernetes.io/projected/a2812859-d0c6-4564-84f0-5dbd80a45dd1-kube-api-access-p2h9s\") pod \"dns-operator-controller-manager-864dd78c4c-qj6f8\" (UID: \"a2812859-d0c6-4564-84f0-5dbd80a45dd1\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-qj6f8"
Jul 13 15:30:37.462496 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:30:37.462472    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p2h9s\" (UniqueName: \"kubernetes.io/projected/a2812859-d0c6-4564-84f0-5dbd80a45dd1-kube-api-access-p2h9s\") pod \"dns-operator-controller-manager-864dd78c4c-qj6f8\" (UID: \"a2812859-d0c6-4564-84f0-5dbd80a45dd1\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-qj6f8"
Jul 13 15:30:37.569305 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:30:37.569203    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-qj6f8"
Jul 13 15:30:37.701339 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:30:37.701314    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-qj6f8"]
Jul 13 15:30:37.703692 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:30:37.703667    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda2812859_d0c6_4564_84f0_5dbd80a45dd1.slice/crio-c6276de8b7fb7af1afff1ce88ce4edcbde4765f4925f4d1f62a1c88751b5e542 WatchSource:0}: Error finding container c6276de8b7fb7af1afff1ce88ce4edcbde4765f4925f4d1f62a1c88751b5e542: Status 404 returned error can't find the container with id c6276de8b7fb7af1afff1ce88ce4edcbde4765f4925f4d1f62a1c88751b5e542
Jul 13 15:30:37.951017 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:30:37.950980    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-qj6f8" event={"ID":"a2812859-d0c6-4564-84f0-5dbd80a45dd1","Type":"ContainerStarted","Data":"c6276de8b7fb7af1afff1ce88ce4edcbde4765f4925f4d1f62a1c88751b5e542"}
Jul 13 15:30:39.874487 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:30:39.874455    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5cf68d78f7-l9sbr"]
Jul 13 15:30:40.967290 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:30:40.967258    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-qj6f8" event={"ID":"a2812859-d0c6-4564-84f0-5dbd80a45dd1","Type":"ContainerStarted","Data":"b3cd4a1c003d6d9a732c8150ad0a061ef056a0da25f45559ecd0054452bc83f0"}
Jul 13 15:30:40.967736 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:30:40.967314    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-qj6f8"
Jul 13 15:30:40.987802 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:30:40.987750    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-qj6f8" podStartSLOduration=1.112816814 podStartE2EDuration="3.987735177s" totalImagesPullingTime="2.874918363s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 15:30:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 15:30:40.985596529 +0000 UTC m=+394.564831732" watchObservedRunningTime="2026-07-13 15:30:40.987735177 +0000 UTC m=+394.566970356"
Jul 13 15:30:41.883597 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:30:41.883565    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-m4kqm"]
Jul 13 15:30:41.887063 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:30:41.887043    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-m4kqm"
Jul 13 15:30:41.890048 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:30:41.890017    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"plugin-serving-cert\""
Jul 13 15:30:41.890200 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:30:41.890148    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-4qjbx\""
Jul 13 15:30:41.890260 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:30:41.890207    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kuadrant-console-nginx-conf\""
Jul 13 15:30:41.898597 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:30:41.898568    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-m4kqm"]
Jul 13 15:30:41.993436 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:30:41.993394    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fqq6b\" (UniqueName: \"kubernetes.io/projected/9b58983c-3823-4319-9664-96111d5494bc-kube-api-access-fqq6b\") pod \"kuadrant-console-plugin-66b5774985-m4kqm\" (UID: \"9b58983c-3823-4319-9664-96111d5494bc\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-m4kqm"
Jul 13 15:30:41.993436 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:30:41.993433    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/9b58983c-3823-4319-9664-96111d5494bc-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-m4kqm\" (UID: \"9b58983c-3823-4319-9664-96111d5494bc\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-m4kqm"
Jul 13 15:30:41.993924 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:30:41.993459    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/9b58983c-3823-4319-9664-96111d5494bc-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-m4kqm\" (UID: \"9b58983c-3823-4319-9664-96111d5494bc\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-m4kqm"
Jul 13 15:30:42.094003 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:30:42.093971    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fqq6b\" (UniqueName: \"kubernetes.io/projected/9b58983c-3823-4319-9664-96111d5494bc-kube-api-access-fqq6b\") pod \"kuadrant-console-plugin-66b5774985-m4kqm\" (UID: \"9b58983c-3823-4319-9664-96111d5494bc\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-m4kqm"
Jul 13 15:30:42.094003 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:30:42.094006    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/9b58983c-3823-4319-9664-96111d5494bc-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-m4kqm\" (UID: \"9b58983c-3823-4319-9664-96111d5494bc\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-m4kqm"
Jul 13 15:30:42.094223 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:30:42.094028    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/9b58983c-3823-4319-9664-96111d5494bc-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-m4kqm\" (UID: \"9b58983c-3823-4319-9664-96111d5494bc\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-m4kqm"
Jul 13 15:30:42.094608 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:30:42.094581    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/9b58983c-3823-4319-9664-96111d5494bc-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-m4kqm\" (UID: \"9b58983c-3823-4319-9664-96111d5494bc\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-m4kqm"
Jul 13 15:30:42.096479 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:30:42.096449    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/9b58983c-3823-4319-9664-96111d5494bc-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-m4kqm\" (UID: \"9b58983c-3823-4319-9664-96111d5494bc\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-m4kqm"
Jul 13 15:30:42.104581 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:30:42.104556    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fqq6b\" (UniqueName: \"kubernetes.io/projected/9b58983c-3823-4319-9664-96111d5494bc-kube-api-access-fqq6b\") pod \"kuadrant-console-plugin-66b5774985-m4kqm\" (UID: \"9b58983c-3823-4319-9664-96111d5494bc\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-m4kqm"
Jul 13 15:30:42.196996 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:30:42.196902    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-m4kqm"
Jul 13 15:30:42.344093 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:30:42.344067    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-m4kqm"]
Jul 13 15:30:42.345007 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:30:42.344976    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod9b58983c_3823_4319_9664_96111d5494bc.slice/crio-e61cd9c0de73a0e9c40cef1d55fda5a4cc5271eb52adb864071c25a4aed2216d WatchSource:0}: Error finding container e61cd9c0de73a0e9c40cef1d55fda5a4cc5271eb52adb864071c25a4aed2216d: Status 404 returned error can't find the container with id e61cd9c0de73a0e9c40cef1d55fda5a4cc5271eb52adb864071c25a4aed2216d
Jul 13 15:30:42.977500 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:30:42.977467    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-m4kqm" event={"ID":"9b58983c-3823-4319-9664-96111d5494bc","Type":"ContainerStarted","Data":"e61cd9c0de73a0e9c40cef1d55fda5a4cc5271eb52adb864071c25a4aed2216d"}
Jul 13 15:30:51.974457 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:30:51.974418    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-qj6f8"
Jul 13 15:31:04.980752 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:31:04.980703    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-5cf68d78f7-l9sbr" podUID="fb17c356-2f90-411a-8fc8-1b2116ad787f" containerName="console" containerID="cri-o://d6d88196ed853785bbbc622e8c740b2726ec7b3f0805ec6d8ada95be607bad5d" gracePeriod=15
Jul 13 15:31:07.315921 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:31:07.315889    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5cf68d78f7-l9sbr"
Jul 13 15:31:07.440855 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:31:07.440775    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/fb17c356-2f90-411a-8fc8-1b2116ad787f-console-oauth-config\") pod \"fb17c356-2f90-411a-8fc8-1b2116ad787f\" (UID: \"fb17c356-2f90-411a-8fc8-1b2116ad787f\") "
Jul 13 15:31:07.440855 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:31:07.440837    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fb17c356-2f90-411a-8fc8-1b2116ad787f-trusted-ca-bundle\") pod \"fb17c356-2f90-411a-8fc8-1b2116ad787f\" (UID: \"fb17c356-2f90-411a-8fc8-1b2116ad787f\") "
Jul 13 15:31:07.440855 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:31:07.440881    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/fb17c356-2f90-411a-8fc8-1b2116ad787f-service-ca\") pod \"fb17c356-2f90-411a-8fc8-1b2116ad787f\" (UID: \"fb17c356-2f90-411a-8fc8-1b2116ad787f\") "
Jul 13 15:31:07.441176 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:31:07.440917    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/fb17c356-2f90-411a-8fc8-1b2116ad787f-console-config\") pod \"fb17c356-2f90-411a-8fc8-1b2116ad787f\" (UID: \"fb17c356-2f90-411a-8fc8-1b2116ad787f\") "
Jul 13 15:31:07.441176 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:31:07.440947    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/fb17c356-2f90-411a-8fc8-1b2116ad787f-console-serving-cert\") pod \"fb17c356-2f90-411a-8fc8-1b2116ad787f\" (UID: \"fb17c356-2f90-411a-8fc8-1b2116ad787f\") "
Jul 13 15:31:07.441176 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:31:07.440996    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-v6mx4\" (UniqueName: \"kubernetes.io/projected/fb17c356-2f90-411a-8fc8-1b2116ad787f-kube-api-access-v6mx4\") pod \"fb17c356-2f90-411a-8fc8-1b2116ad787f\" (UID: \"fb17c356-2f90-411a-8fc8-1b2116ad787f\") "
Jul 13 15:31:07.441176 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:31:07.441105    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/fb17c356-2f90-411a-8fc8-1b2116ad787f-oauth-serving-cert\") pod \"fb17c356-2f90-411a-8fc8-1b2116ad787f\" (UID: \"fb17c356-2f90-411a-8fc8-1b2116ad787f\") "
Jul 13 15:31:07.441396 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:31:07.441275    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fb17c356-2f90-411a-8fc8-1b2116ad787f-service-ca" (OuterVolumeSpecName: "service-ca") pod "fb17c356-2f90-411a-8fc8-1b2116ad787f" (UID: "fb17c356-2f90-411a-8fc8-1b2116ad787f"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 13 15:31:07.441396 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:31:07.441308    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fb17c356-2f90-411a-8fc8-1b2116ad787f-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "fb17c356-2f90-411a-8fc8-1b2116ad787f" (UID: "fb17c356-2f90-411a-8fc8-1b2116ad787f"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 13 15:31:07.441495 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:31:07.441450    2564 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/fb17c356-2f90-411a-8fc8-1b2116ad787f-service-ca\") on node \"ip-10-0-140-255.ec2.internal\" DevicePath \"\""
Jul 13 15:31:07.441550 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:31:07.441497    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fb17c356-2f90-411a-8fc8-1b2116ad787f-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "fb17c356-2f90-411a-8fc8-1b2116ad787f" (UID: "fb17c356-2f90-411a-8fc8-1b2116ad787f"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 13 15:31:07.441618 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:31:07.441597    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fb17c356-2f90-411a-8fc8-1b2116ad787f-console-config" (OuterVolumeSpecName: "console-config") pod "fb17c356-2f90-411a-8fc8-1b2116ad787f" (UID: "fb17c356-2f90-411a-8fc8-1b2116ad787f"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 13 15:31:07.443118 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:31:07.443095    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fb17c356-2f90-411a-8fc8-1b2116ad787f-kube-api-access-v6mx4" (OuterVolumeSpecName: "kube-api-access-v6mx4") pod "fb17c356-2f90-411a-8fc8-1b2116ad787f" (UID: "fb17c356-2f90-411a-8fc8-1b2116ad787f"). InnerVolumeSpecName "kube-api-access-v6mx4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 13 15:31:07.443235 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:31:07.443160    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fb17c356-2f90-411a-8fc8-1b2116ad787f-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "fb17c356-2f90-411a-8fc8-1b2116ad787f" (UID: "fb17c356-2f90-411a-8fc8-1b2116ad787f"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 13 15:31:07.443235 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:31:07.443183    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fb17c356-2f90-411a-8fc8-1b2116ad787f-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "fb17c356-2f90-411a-8fc8-1b2116ad787f" (UID: "fb17c356-2f90-411a-8fc8-1b2116ad787f"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 13 15:31:07.542208 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:31:07.542178    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-v6mx4\" (UniqueName: \"kubernetes.io/projected/fb17c356-2f90-411a-8fc8-1b2116ad787f-kube-api-access-v6mx4\") on node \"ip-10-0-140-255.ec2.internal\" DevicePath \"\""
Jul 13 15:31:07.542208 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:31:07.542204    2564 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/fb17c356-2f90-411a-8fc8-1b2116ad787f-oauth-serving-cert\") on node \"ip-10-0-140-255.ec2.internal\" DevicePath \"\""
Jul 13 15:31:07.542208 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:31:07.542213    2564 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/fb17c356-2f90-411a-8fc8-1b2116ad787f-console-oauth-config\") on node \"ip-10-0-140-255.ec2.internal\" DevicePath \"\""
Jul 13 15:31:07.542502 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:31:07.542222    2564 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fb17c356-2f90-411a-8fc8-1b2116ad787f-trusted-ca-bundle\") on node \"ip-10-0-140-255.ec2.internal\" DevicePath \"\""
Jul 13 15:31:07.542502 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:31:07.542233    2564 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/fb17c356-2f90-411a-8fc8-1b2116ad787f-console-config\") on node \"ip-10-0-140-255.ec2.internal\" DevicePath \"\""
Jul 13 15:31:07.542502 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:31:07.542241    2564 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/fb17c356-2f90-411a-8fc8-1b2116ad787f-console-serving-cert\") on node \"ip-10-0-140-255.ec2.internal\" DevicePath \"\""
Jul 13 15:31:08.117744 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:31:08.117714    2564 generic.go:356] "Generic (PLEG): container finished" podID="fb17c356-2f90-411a-8fc8-1b2116ad787f" containerID="d6d88196ed853785bbbc622e8c740b2726ec7b3f0805ec6d8ada95be607bad5d" exitCode=0
Jul 13 15:31:08.117954 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:31:08.117757    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5cf68d78f7-l9sbr"
Jul 13 15:31:08.117954 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:31:08.117800    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5cf68d78f7-l9sbr" event={"ID":"fb17c356-2f90-411a-8fc8-1b2116ad787f","Type":"ContainerDied","Data":"d6d88196ed853785bbbc622e8c740b2726ec7b3f0805ec6d8ada95be607bad5d"}
Jul 13 15:31:08.117954 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:31:08.117841    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5cf68d78f7-l9sbr" event={"ID":"fb17c356-2f90-411a-8fc8-1b2116ad787f","Type":"ContainerDied","Data":"2bd37c1fe47316eb433114662e5d07d082bf0296f09af39fdc0d651e13210ee0"}
Jul 13 15:31:08.117954 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:31:08.117860    2564 scope.go:117] "RemoveContainer" containerID="d6d88196ed853785bbbc622e8c740b2726ec7b3f0805ec6d8ada95be607bad5d"
Jul 13 15:31:08.119415 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:31:08.119390    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-m4kqm" event={"ID":"9b58983c-3823-4319-9664-96111d5494bc","Type":"ContainerStarted","Data":"42fd7c8d74c12a1a543f11665a07d6479c66c11edb074e480a40b4ef0fab5774"}
Jul 13 15:31:08.126990 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:31:08.126970    2564 scope.go:117] "RemoveContainer" containerID="d6d88196ed853785bbbc622e8c740b2726ec7b3f0805ec6d8ada95be607bad5d"
Jul 13 15:31:08.127235 ip-10-0-140-255 kubenswrapper[2564]: E0713 15:31:08.127214    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d6d88196ed853785bbbc622e8c740b2726ec7b3f0805ec6d8ada95be607bad5d\": container with ID starting with d6d88196ed853785bbbc622e8c740b2726ec7b3f0805ec6d8ada95be607bad5d not found: ID does not exist" containerID="d6d88196ed853785bbbc622e8c740b2726ec7b3f0805ec6d8ada95be607bad5d"
Jul 13 15:31:08.127286 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:31:08.127244    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d6d88196ed853785bbbc622e8c740b2726ec7b3f0805ec6d8ada95be607bad5d"} err="failed to get container status \"d6d88196ed853785bbbc622e8c740b2726ec7b3f0805ec6d8ada95be607bad5d\": rpc error: code = NotFound desc = could not find container \"d6d88196ed853785bbbc622e8c740b2726ec7b3f0805ec6d8ada95be607bad5d\": container with ID starting with d6d88196ed853785bbbc622e8c740b2726ec7b3f0805ec6d8ada95be607bad5d not found: ID does not exist"
Jul 13 15:31:08.140261 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:31:08.140213    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-m4kqm" podStartSLOduration=1.939095606 podStartE2EDuration="27.140199466s" totalImagesPullingTime="25.20110386s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 15:30:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 15:31:08.138044067 +0000 UTC m=+421.717279247" watchObservedRunningTime="2026-07-13 15:31:08.140199466 +0000 UTC m=+421.719434644"
Jul 13 15:31:08.154189 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:31:08.154161    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5cf68d78f7-l9sbr"]
Jul 13 15:31:08.163348 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:31:08.163321    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-5cf68d78f7-l9sbr"]
Jul 13 15:31:09.120657 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:31:09.120618    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fb17c356-2f90-411a-8fc8-1b2116ad787f" path="/var/lib/kubelet/pods/fb17c356-2f90-411a-8fc8-1b2116ad787f/volumes"
Jul 13 15:31:37.761018 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:31:37.760933    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vhzkf"]
Jul 13 15:31:37.761480 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:31:37.761408    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fb17c356-2f90-411a-8fc8-1b2116ad787f" containerName="console"
Jul 13 15:31:37.761480 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:31:37.761426    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="fb17c356-2f90-411a-8fc8-1b2116ad787f" containerName="console"
Jul 13 15:31:37.761593 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:31:37.761530    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="fb17c356-2f90-411a-8fc8-1b2116ad787f" containerName="console"
Jul 13 15:31:37.782443 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:31:37.782413    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vhzkf"]
Jul 13 15:31:37.782587 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:31:37.782533    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-vhzkf"
Jul 13 15:31:37.785130 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:31:37.785098    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
Jul 13 15:31:37.789688 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:31:37.789669    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vhzkf"]
Jul 13 15:31:37.881624 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:31:37.881589    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t6xpg\" (UniqueName: \"kubernetes.io/projected/c5b486ab-64ea-44d9-86a0-cb7d18d49dcf-kube-api-access-t6xpg\") pod \"limitador-limitador-54d6d988d5-vhzkf\" (UID: \"c5b486ab-64ea-44d9-86a0-cb7d18d49dcf\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-vhzkf"
Jul 13 15:31:37.881794 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:31:37.881640    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/c5b486ab-64ea-44d9-86a0-cb7d18d49dcf-config-file\") pod \"limitador-limitador-54d6d988d5-vhzkf\" (UID: \"c5b486ab-64ea-44d9-86a0-cb7d18d49dcf\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-vhzkf"
Jul 13 15:31:37.982033 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:31:37.982002    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t6xpg\" (UniqueName: \"kubernetes.io/projected/c5b486ab-64ea-44d9-86a0-cb7d18d49dcf-kube-api-access-t6xpg\") pod \"limitador-limitador-54d6d988d5-vhzkf\" (UID: \"c5b486ab-64ea-44d9-86a0-cb7d18d49dcf\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-vhzkf"
Jul 13 15:31:37.982249 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:31:37.982058    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/c5b486ab-64ea-44d9-86a0-cb7d18d49dcf-config-file\") pod \"limitador-limitador-54d6d988d5-vhzkf\" (UID: \"c5b486ab-64ea-44d9-86a0-cb7d18d49dcf\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-vhzkf"
Jul 13 15:31:37.982617 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:31:37.982598    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/c5b486ab-64ea-44d9-86a0-cb7d18d49dcf-config-file\") pod \"limitador-limitador-54d6d988d5-vhzkf\" (UID: \"c5b486ab-64ea-44d9-86a0-cb7d18d49dcf\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-vhzkf"
Jul 13 15:31:37.990752 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:31:37.990720    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t6xpg\" (UniqueName: \"kubernetes.io/projected/c5b486ab-64ea-44d9-86a0-cb7d18d49dcf-kube-api-access-t6xpg\") pod \"limitador-limitador-54d6d988d5-vhzkf\" (UID: \"c5b486ab-64ea-44d9-86a0-cb7d18d49dcf\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-vhzkf"
Jul 13 15:31:38.093524 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:31:38.093447    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-vhzkf"
Jul 13 15:31:38.231908 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:31:38.231862    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vhzkf"]
Jul 13 15:31:38.233929 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:31:38.233895    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc5b486ab_64ea_44d9_86a0_cb7d18d49dcf.slice/crio-269039add3ca2698ce4a881924896853eaaea5e9cd6c80dff39b688760643881 WatchSource:0}: Error finding container 269039add3ca2698ce4a881924896853eaaea5e9cd6c80dff39b688760643881: Status 404 returned error can't find the container with id 269039add3ca2698ce4a881924896853eaaea5e9cd6c80dff39b688760643881
Jul 13 15:31:38.266709 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:31:38.266676    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-vhzkf" event={"ID":"c5b486ab-64ea-44d9-86a0-cb7d18d49dcf","Type":"ContainerStarted","Data":"269039add3ca2698ce4a881924896853eaaea5e9cd6c80dff39b688760643881"}
Jul 13 15:31:38.496058 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:31:38.496026    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-75d556bd77-zjhhn"]
Jul 13 15:31:38.498956 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:31:38.498939    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-zjhhn"
Jul 13 15:31:38.501408 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:31:38.501389    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-drvmg\""
Jul 13 15:31:38.509504 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:31:38.509479    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-zjhhn"]
Jul 13 15:31:38.587119 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:31:38.587087    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m7l2s\" (UniqueName: \"kubernetes.io/projected/52334a9c-eea2-420f-8f6f-0228e3b279fc-kube-api-access-m7l2s\") pod \"authorino-75d556bd77-zjhhn\" (UID: \"52334a9c-eea2-420f-8f6f-0228e3b279fc\") " pod="kuadrant-system/authorino-75d556bd77-zjhhn"
Jul 13 15:31:38.688214 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:31:38.688161    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m7l2s\" (UniqueName: \"kubernetes.io/projected/52334a9c-eea2-420f-8f6f-0228e3b279fc-kube-api-access-m7l2s\") pod \"authorino-75d556bd77-zjhhn\" (UID: \"52334a9c-eea2-420f-8f6f-0228e3b279fc\") " pod="kuadrant-system/authorino-75d556bd77-zjhhn"
Jul 13 15:31:38.697102 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:31:38.697072    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m7l2s\" (UniqueName: \"kubernetes.io/projected/52334a9c-eea2-420f-8f6f-0228e3b279fc-kube-api-access-m7l2s\") pod \"authorino-75d556bd77-zjhhn\" (UID: \"52334a9c-eea2-420f-8f6f-0228e3b279fc\") " pod="kuadrant-system/authorino-75d556bd77-zjhhn"
Jul 13 15:31:38.808810 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:31:38.808730    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-zjhhn"
Jul 13 15:31:38.986715 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:31:38.986678    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-zjhhn"]
Jul 13 15:31:38.990428 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:31:38.990399    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod52334a9c_eea2_420f_8f6f_0228e3b279fc.slice/crio-d06d8b16b460e343540bc0aaf267be52a6e20172ec0d3b2f47ced22d0dc3af26 WatchSource:0}: Error finding container d06d8b16b460e343540bc0aaf267be52a6e20172ec0d3b2f47ced22d0dc3af26: Status 404 returned error can't find the container with id d06d8b16b460e343540bc0aaf267be52a6e20172ec0d3b2f47ced22d0dc3af26
Jul 13 15:31:39.275529 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:31:39.275493    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-zjhhn" event={"ID":"52334a9c-eea2-420f-8f6f-0228e3b279fc","Type":"ContainerStarted","Data":"d06d8b16b460e343540bc0aaf267be52a6e20172ec0d3b2f47ced22d0dc3af26"}
Jul 13 15:31:41.290330 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:31:41.290244    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-vhzkf" event={"ID":"c5b486ab-64ea-44d9-86a0-cb7d18d49dcf","Type":"ContainerStarted","Data":"58753e54f1ab9b38d4b62eb61cf574c923ab136f10e563b09d96bc738f72d064"}
Jul 13 15:31:41.290330 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:31:41.290325    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-vhzkf"
Jul 13 15:31:41.310700 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:31:41.310630    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-54d6d988d5-vhzkf" podStartSLOduration=1.631301017 podStartE2EDuration="4.310610014s" totalImagesPullingTime="2.679308997s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 15:31:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 15:31:41.306945451 +0000 UTC m=+454.886180649" watchObservedRunningTime="2026-07-13 15:31:41.310610014 +0000 UTC m=+454.889845195"
Jul 13 15:31:43.304515 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:31:43.304475    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-zjhhn" event={"ID":"52334a9c-eea2-420f-8f6f-0228e3b279fc","Type":"ContainerStarted","Data":"d35bbdb491c14de0a3f38b903199d4f20d13126b82e72137d4472c2d74dc1eb0"}
Jul 13 15:31:43.320488 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:31:43.320432    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-75d556bd77-zjhhn" podStartSLOduration=1.228918964 podStartE2EDuration="5.320414144s" totalImagesPullingTime="4.09149518s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 15:31:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 15:31:43.319144933 +0000 UTC m=+456.898380115" watchObservedRunningTime="2026-07-13 15:31:43.320414144 +0000 UTC m=+456.899649322"
Jul 13 15:31:52.299659 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:31:52.299629    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-vhzkf"
Jul 13 15:32:11.496813 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:32:11.496778    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-749d4c5b47-ztsw9"]
Jul 13 15:32:11.500194 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:32:11.500175    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-749d4c5b47-ztsw9"
Jul 13 15:32:11.507147 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:32:11.507117    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-749d4c5b47-ztsw9"]
Jul 13 15:32:11.569376 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:32:11.569333    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5jvvb\" (UniqueName: \"kubernetes.io/projected/97f1fc5e-757c-4d59-8f4c-e5634daf6713-kube-api-access-5jvvb\") pod \"authorino-749d4c5b47-ztsw9\" (UID: \"97f1fc5e-757c-4d59-8f4c-e5634daf6713\") " pod="kuadrant-system/authorino-749d4c5b47-ztsw9"
Jul 13 15:32:11.589346 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:32:11.589305    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-749d4c5b47-ztsw9"]
Jul 13 15:32:11.589592 ip-10-0-140-255 kubenswrapper[2564]: E0713 15:32:11.589573    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-5jvvb], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/authorino-749d4c5b47-ztsw9" podUID="97f1fc5e-757c-4d59-8f4c-e5634daf6713"
Jul 13 15:32:11.670093 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:32:11.670049    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5jvvb\" (UniqueName: \"kubernetes.io/projected/97f1fc5e-757c-4d59-8f4c-e5634daf6713-kube-api-access-5jvvb\") pod \"authorino-749d4c5b47-ztsw9\" (UID: \"97f1fc5e-757c-4d59-8f4c-e5634daf6713\") " pod="kuadrant-system/authorino-749d4c5b47-ztsw9"
Jul 13 15:32:11.680367 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:32:11.680337    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5jvvb\" (UniqueName: \"kubernetes.io/projected/97f1fc5e-757c-4d59-8f4c-e5634daf6713-kube-api-access-5jvvb\") pod \"authorino-749d4c5b47-ztsw9\" (UID: \"97f1fc5e-757c-4d59-8f4c-e5634daf6713\") " pod="kuadrant-system/authorino-749d4c5b47-ztsw9"
Jul 13 15:32:12.447032 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:32:12.447002    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-749d4c5b47-ztsw9"
Jul 13 15:32:12.454198 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:32:12.454171    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-749d4c5b47-ztsw9"
Jul 13 15:32:12.577558 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:32:12.577511    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5jvvb\" (UniqueName: \"kubernetes.io/projected/97f1fc5e-757c-4d59-8f4c-e5634daf6713-kube-api-access-5jvvb\") pod \"97f1fc5e-757c-4d59-8f4c-e5634daf6713\" (UID: \"97f1fc5e-757c-4d59-8f4c-e5634daf6713\") "
Jul 13 15:32:12.579566 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:32:12.579543    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/97f1fc5e-757c-4d59-8f4c-e5634daf6713-kube-api-access-5jvvb" (OuterVolumeSpecName: "kube-api-access-5jvvb") pod "97f1fc5e-757c-4d59-8f4c-e5634daf6713" (UID: "97f1fc5e-757c-4d59-8f4c-e5634daf6713"). InnerVolumeSpecName "kube-api-access-5jvvb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 13 15:32:12.679195 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:32:12.679160    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5jvvb\" (UniqueName: \"kubernetes.io/projected/97f1fc5e-757c-4d59-8f4c-e5634daf6713-kube-api-access-5jvvb\") on node \"ip-10-0-140-255.ec2.internal\" DevicePath \"\""
Jul 13 15:32:12.775544 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:32:12.775442    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-zjhhn"]
Jul 13 15:32:12.775750 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:32:12.775700    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-75d556bd77-zjhhn" podUID="52334a9c-eea2-420f-8f6f-0228e3b279fc" containerName="authorino" containerID="cri-o://d35bbdb491c14de0a3f38b903199d4f20d13126b82e72137d4472c2d74dc1eb0" gracePeriod=30
Jul 13 15:32:13.028932 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:32:13.028845    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-zjhhn"
Jul 13 15:32:13.183922 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:32:13.183856    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-m7l2s\" (UniqueName: \"kubernetes.io/projected/52334a9c-eea2-420f-8f6f-0228e3b279fc-kube-api-access-m7l2s\") pod \"52334a9c-eea2-420f-8f6f-0228e3b279fc\" (UID: \"52334a9c-eea2-420f-8f6f-0228e3b279fc\") "
Jul 13 15:32:13.185931 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:32:13.185903    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/52334a9c-eea2-420f-8f6f-0228e3b279fc-kube-api-access-m7l2s" (OuterVolumeSpecName: "kube-api-access-m7l2s") pod "52334a9c-eea2-420f-8f6f-0228e3b279fc" (UID: "52334a9c-eea2-420f-8f6f-0228e3b279fc"). InnerVolumeSpecName "kube-api-access-m7l2s". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 13 15:32:13.284898 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:32:13.284779    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-m7l2s\" (UniqueName: \"kubernetes.io/projected/52334a9c-eea2-420f-8f6f-0228e3b279fc-kube-api-access-m7l2s\") on node \"ip-10-0-140-255.ec2.internal\" DevicePath \"\""
Jul 13 15:32:13.453211 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:32:13.453174    2564 generic.go:356] "Generic (PLEG): container finished" podID="52334a9c-eea2-420f-8f6f-0228e3b279fc" containerID="d35bbdb491c14de0a3f38b903199d4f20d13126b82e72137d4472c2d74dc1eb0" exitCode=0
Jul 13 15:32:13.453211 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:32:13.453214    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-zjhhn"
Jul 13 15:32:13.453457 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:32:13.453259    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-zjhhn" event={"ID":"52334a9c-eea2-420f-8f6f-0228e3b279fc","Type":"ContainerDied","Data":"d35bbdb491c14de0a3f38b903199d4f20d13126b82e72137d4472c2d74dc1eb0"}
Jul 13 15:32:13.453457 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:32:13.453305    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-zjhhn" event={"ID":"52334a9c-eea2-420f-8f6f-0228e3b279fc","Type":"ContainerDied","Data":"d06d8b16b460e343540bc0aaf267be52a6e20172ec0d3b2f47ced22d0dc3af26"}
Jul 13 15:32:13.453457 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:32:13.453324    2564 scope.go:117] "RemoveContainer" containerID="d35bbdb491c14de0a3f38b903199d4f20d13126b82e72137d4472c2d74dc1eb0"
Jul 13 15:32:13.453457 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:32:13.453368    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-749d4c5b47-ztsw9"
Jul 13 15:32:13.462791 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:32:13.462768    2564 scope.go:117] "RemoveContainer" containerID="d35bbdb491c14de0a3f38b903199d4f20d13126b82e72137d4472c2d74dc1eb0"
Jul 13 15:32:13.463127 ip-10-0-140-255 kubenswrapper[2564]: E0713 15:32:13.463108    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d35bbdb491c14de0a3f38b903199d4f20d13126b82e72137d4472c2d74dc1eb0\": container with ID starting with d35bbdb491c14de0a3f38b903199d4f20d13126b82e72137d4472c2d74dc1eb0 not found: ID does not exist" containerID="d35bbdb491c14de0a3f38b903199d4f20d13126b82e72137d4472c2d74dc1eb0"
Jul 13 15:32:13.463187 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:32:13.463137    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d35bbdb491c14de0a3f38b903199d4f20d13126b82e72137d4472c2d74dc1eb0"} err="failed to get container status \"d35bbdb491c14de0a3f38b903199d4f20d13126b82e72137d4472c2d74dc1eb0\": rpc error: code = NotFound desc = could not find container \"d35bbdb491c14de0a3f38b903199d4f20d13126b82e72137d4472c2d74dc1eb0\": container with ID starting with d35bbdb491c14de0a3f38b903199d4f20d13126b82e72137d4472c2d74dc1eb0 not found: ID does not exist"
Jul 13 15:32:13.485369 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:32:13.485335    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-zjhhn"]
Jul 13 15:32:13.506330 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:32:13.506302    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-75d556bd77-zjhhn"]
Jul 13 15:32:13.542527 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:32:13.542450    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-749d4c5b47-ztsw9"]
Jul 13 15:32:13.550960 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:32:13.550927    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-749d4c5b47-ztsw9"]
Jul 13 15:32:15.120969 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:32:15.120936    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="52334a9c-eea2-420f-8f6f-0228e3b279fc" path="/var/lib/kubelet/pods/52334a9c-eea2-420f-8f6f-0228e3b279fc/volumes"
Jul 13 15:32:15.121334 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:32:15.121271    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="97f1fc5e-757c-4d59-8f4c-e5634daf6713" path="/var/lib/kubelet/pods/97f1fc5e-757c-4d59-8f4c-e5634daf6713/volumes"
Jul 13 15:32:54.094543 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:32:54.094486    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vhzkf"]
Jul 13 15:33:23.438974 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:33:23.438935    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vhzkf"]
Jul 13 15:33:40.452718 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:33:40.452683    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vhzkf"]
Jul 13 15:34:00.047915 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:34:00.047852    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-ktz5c"]
Jul 13 15:34:00.048414 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:34:00.048371    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="52334a9c-eea2-420f-8f6f-0228e3b279fc" containerName="authorino"
Jul 13 15:34:00.048414 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:34:00.048386    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="52334a9c-eea2-420f-8f6f-0228e3b279fc" containerName="authorino"
Jul 13 15:34:00.048529 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:34:00.048458    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="52334a9c-eea2-420f-8f6f-0228e3b279fc" containerName="authorino"
Jul 13 15:34:00.050282 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:34:00.050264    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-ktz5c"
Jul 13 15:34:00.053245 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:34:00.053223    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Jul 13 15:34:00.054299 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:34:00.054275    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\""
Jul 13 15:34:00.054420 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:34:00.054304    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Jul 13 15:34:00.054420 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:34:00.054309    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-tl4pf\""
Jul 13 15:34:00.063730 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:34:00.063706    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-ktz5c"]
Jul 13 15:34:00.236656 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:34:00.236613    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7phk2\" (UniqueName: \"kubernetes.io/projected/716d9d72-0646-46dd-964c-2d0d0278d23e-kube-api-access-7phk2\") pod \"e2e-trlp-test-simulated-kserve-598466548d-ktz5c\" (UID: \"716d9d72-0646-46dd-964c-2d0d0278d23e\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-ktz5c"
Jul 13 15:34:00.236656 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:34:00.236659    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/716d9d72-0646-46dd-964c-2d0d0278d23e-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-ktz5c\" (UID: \"716d9d72-0646-46dd-964c-2d0d0278d23e\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-ktz5c"
Jul 13 15:34:00.236933 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:34:00.236705    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/716d9d72-0646-46dd-964c-2d0d0278d23e-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-ktz5c\" (UID: \"716d9d72-0646-46dd-964c-2d0d0278d23e\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-ktz5c"
Jul 13 15:34:00.236933 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:34:00.236739    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/716d9d72-0646-46dd-964c-2d0d0278d23e-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-ktz5c\" (UID: \"716d9d72-0646-46dd-964c-2d0d0278d23e\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-ktz5c"
Jul 13 15:34:00.236933 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:34:00.236763    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/716d9d72-0646-46dd-964c-2d0d0278d23e-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-ktz5c\" (UID: \"716d9d72-0646-46dd-964c-2d0d0278d23e\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-ktz5c"
Jul 13 15:34:00.236933 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:34:00.236818    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/716d9d72-0646-46dd-964c-2d0d0278d23e-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-ktz5c\" (UID: \"716d9d72-0646-46dd-964c-2d0d0278d23e\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-ktz5c"
Jul 13 15:34:00.338181 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:34:00.338081    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/716d9d72-0646-46dd-964c-2d0d0278d23e-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-ktz5c\" (UID: \"716d9d72-0646-46dd-964c-2d0d0278d23e\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-ktz5c"
Jul 13 15:34:00.338181 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:34:00.338162    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7phk2\" (UniqueName: \"kubernetes.io/projected/716d9d72-0646-46dd-964c-2d0d0278d23e-kube-api-access-7phk2\") pod \"e2e-trlp-test-simulated-kserve-598466548d-ktz5c\" (UID: \"716d9d72-0646-46dd-964c-2d0d0278d23e\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-ktz5c"
Jul 13 15:34:00.338181 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:34:00.338182    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/716d9d72-0646-46dd-964c-2d0d0278d23e-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-ktz5c\" (UID: \"716d9d72-0646-46dd-964c-2d0d0278d23e\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-ktz5c"
Jul 13 15:34:00.338442 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:34:00.338204    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/716d9d72-0646-46dd-964c-2d0d0278d23e-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-ktz5c\" (UID: \"716d9d72-0646-46dd-964c-2d0d0278d23e\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-ktz5c"
Jul 13 15:34:00.338442 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:34:00.338225    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/716d9d72-0646-46dd-964c-2d0d0278d23e-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-ktz5c\" (UID: \"716d9d72-0646-46dd-964c-2d0d0278d23e\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-ktz5c"
Jul 13 15:34:00.338442 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:34:00.338239    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/716d9d72-0646-46dd-964c-2d0d0278d23e-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-ktz5c\" (UID: \"716d9d72-0646-46dd-964c-2d0d0278d23e\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-ktz5c"
Jul 13 15:34:00.338593 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:34:00.338574    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/716d9d72-0646-46dd-964c-2d0d0278d23e-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-ktz5c\" (UID: \"716d9d72-0646-46dd-964c-2d0d0278d23e\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-ktz5c"
Jul 13 15:34:00.338633 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:34:00.338571    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/716d9d72-0646-46dd-964c-2d0d0278d23e-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-ktz5c\" (UID: \"716d9d72-0646-46dd-964c-2d0d0278d23e\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-ktz5c"
Jul 13 15:34:00.338685 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:34:00.338669    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/716d9d72-0646-46dd-964c-2d0d0278d23e-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-ktz5c\" (UID: \"716d9d72-0646-46dd-964c-2d0d0278d23e\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-ktz5c"
Jul 13 15:34:00.340475 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:34:00.340455    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/716d9d72-0646-46dd-964c-2d0d0278d23e-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-ktz5c\" (UID: \"716d9d72-0646-46dd-964c-2d0d0278d23e\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-ktz5c"
Jul 13 15:34:00.340776 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:34:00.340761    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/716d9d72-0646-46dd-964c-2d0d0278d23e-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-ktz5c\" (UID: \"716d9d72-0646-46dd-964c-2d0d0278d23e\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-ktz5c"
Jul 13 15:34:00.347225 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:34:00.347206    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7phk2\" (UniqueName: \"kubernetes.io/projected/716d9d72-0646-46dd-964c-2d0d0278d23e-kube-api-access-7phk2\") pod \"e2e-trlp-test-simulated-kserve-598466548d-ktz5c\" (UID: \"716d9d72-0646-46dd-964c-2d0d0278d23e\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-ktz5c"
Jul 13 15:34:00.361289 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:34:00.361262    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-ktz5c"
Jul 13 15:34:00.495830 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:34:00.495805    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-ktz5c"]
Jul 13 15:34:00.497645 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:34:00.497610    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod716d9d72_0646_46dd_964c_2d0d0278d23e.slice/crio-f90486ae0d919e270dafd6d0f534a867afd00d75ffcf4cc3c1244c58109710fc WatchSource:0}: Error finding container f90486ae0d919e270dafd6d0f534a867afd00d75ffcf4cc3c1244c58109710fc: Status 404 returned error can't find the container with id f90486ae0d919e270dafd6d0f534a867afd00d75ffcf4cc3c1244c58109710fc
Jul 13 15:34:00.992826 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:34:00.992784    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-ktz5c" event={"ID":"716d9d72-0646-46dd-964c-2d0d0278d23e","Type":"ContainerStarted","Data":"f90486ae0d919e270dafd6d0f534a867afd00d75ffcf4cc3c1244c58109710fc"}
Jul 13 15:34:01.138715 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:34:01.138677    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vhzkf"]
Jul 13 15:34:01.998914 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:34:01.998875    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-ktz5c" event={"ID":"716d9d72-0646-46dd-964c-2d0d0278d23e","Type":"ContainerStarted","Data":"28b3e9f7ef6a4eab8d7d0a6730a679806b488a162c3d0c56fc358cb3515b84fb"}
Jul 13 15:34:02.020723 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:34:02.020669    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-ktz5c" podStartSLOduration=1.007617765 podStartE2EDuration="2.02065085s" totalImagesPullingTime="1.013033085s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 15:34:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 15:34:02.01949383 +0000 UTC m=+595.598729028" watchObservedRunningTime="2026-07-13 15:34:02.02065085 +0000 UTC m=+595.599886027"
Jul 13 15:34:06.893958 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:34:06.893922    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9dq6z_258b7ae3-adf5-437a-8f8e-71bdd1cc665b/ovn-acl-logging/0.log"
Jul 13 15:34:06.894437 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:34:06.894073    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9dq6z_258b7ae3-adf5-437a-8f8e-71bdd1cc665b/ovn-acl-logging/0.log"
Jul 13 15:34:10.362071 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:34:10.362030    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-ktz5c"
Jul 13 15:34:10.363462 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:34:10.362088    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-ktz5c"
Jul 13 15:34:10.374587 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:34:10.374560    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-ktz5c"
Jul 13 15:34:11.057398 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:34:11.057370    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-ktz5c"
Jul 13 15:34:15.539588 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:34:15.539548    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vhzkf"]
Jul 13 15:34:24.327579 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:34:24.327538    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vhzkf"]
Jul 13 15:34:49.434037 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:34:49.434001    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-9wkqm"]
Jul 13 15:34:49.437212 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:34:49.437194    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-9wkqm"
Jul 13 15:34:49.439825 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:34:49.439800    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"premium-simulated-simulated-premium-kserve-self-signed-certs\""
Jul 13 15:34:49.456004 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:34:49.455969    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-9wkqm"]
Jul 13 15:34:49.574739 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:34:49.574706    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4bcede8b-bab1-4646-8bcf-e80787192fdb-home\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-9wkqm\" (UID: \"4bcede8b-bab1-4646-8bcf-e80787192fdb\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-9wkqm"
Jul 13 15:34:49.574739 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:34:49.574745    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4bcede8b-bab1-4646-8bcf-e80787192fdb-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-9wkqm\" (UID: \"4bcede8b-bab1-4646-8bcf-e80787192fdb\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-9wkqm"
Jul 13 15:34:49.574979 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:34:49.574773    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4bcede8b-bab1-4646-8bcf-e80787192fdb-dshm\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-9wkqm\" (UID: \"4bcede8b-bab1-4646-8bcf-e80787192fdb\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-9wkqm"
Jul 13 15:34:49.574979 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:34:49.574807    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4bcede8b-bab1-4646-8bcf-e80787192fdb-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-9wkqm\" (UID: \"4bcede8b-bab1-4646-8bcf-e80787192fdb\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-9wkqm"
Jul 13 15:34:49.574979 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:34:49.574838    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r549m\" (UniqueName: \"kubernetes.io/projected/4bcede8b-bab1-4646-8bcf-e80787192fdb-kube-api-access-r549m\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-9wkqm\" (UID: \"4bcede8b-bab1-4646-8bcf-e80787192fdb\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-9wkqm"
Jul 13 15:34:49.574979 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:34:49.574900    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4bcede8b-bab1-4646-8bcf-e80787192fdb-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-9wkqm\" (UID: \"4bcede8b-bab1-4646-8bcf-e80787192fdb\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-9wkqm"
Jul 13 15:34:49.675687 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:34:49.675651    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4bcede8b-bab1-4646-8bcf-e80787192fdb-home\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-9wkqm\" (UID: \"4bcede8b-bab1-4646-8bcf-e80787192fdb\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-9wkqm"
Jul 13 15:34:49.675687 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:34:49.675689    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4bcede8b-bab1-4646-8bcf-e80787192fdb-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-9wkqm\" (UID: \"4bcede8b-bab1-4646-8bcf-e80787192fdb\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-9wkqm"
Jul 13 15:34:49.675938 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:34:49.675716    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4bcede8b-bab1-4646-8bcf-e80787192fdb-dshm\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-9wkqm\" (UID: \"4bcede8b-bab1-4646-8bcf-e80787192fdb\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-9wkqm"
Jul 13 15:34:49.675938 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:34:49.675740    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4bcede8b-bab1-4646-8bcf-e80787192fdb-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-9wkqm\" (UID: \"4bcede8b-bab1-4646-8bcf-e80787192fdb\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-9wkqm"
Jul 13 15:34:49.675938 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:34:49.675760    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r549m\" (UniqueName: \"kubernetes.io/projected/4bcede8b-bab1-4646-8bcf-e80787192fdb-kube-api-access-r549m\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-9wkqm\" (UID: \"4bcede8b-bab1-4646-8bcf-e80787192fdb\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-9wkqm"
Jul 13 15:34:49.675938 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:34:49.675806    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4bcede8b-bab1-4646-8bcf-e80787192fdb-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-9wkqm\" (UID: \"4bcede8b-bab1-4646-8bcf-e80787192fdb\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-9wkqm"
Jul 13 15:34:49.676159 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:34:49.676134    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4bcede8b-bab1-4646-8bcf-e80787192fdb-home\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-9wkqm\" (UID: \"4bcede8b-bab1-4646-8bcf-e80787192fdb\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-9wkqm"
Jul 13 15:34:49.676229 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:34:49.676173    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4bcede8b-bab1-4646-8bcf-e80787192fdb-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-9wkqm\" (UID: \"4bcede8b-bab1-4646-8bcf-e80787192fdb\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-9wkqm"
Jul 13 15:34:49.676229 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:34:49.676212    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4bcede8b-bab1-4646-8bcf-e80787192fdb-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-9wkqm\" (UID: \"4bcede8b-bab1-4646-8bcf-e80787192fdb\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-9wkqm"
Jul 13 15:34:49.678109 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:34:49.678081    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4bcede8b-bab1-4646-8bcf-e80787192fdb-dshm\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-9wkqm\" (UID: \"4bcede8b-bab1-4646-8bcf-e80787192fdb\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-9wkqm"
Jul 13 15:34:49.678315 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:34:49.678299    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4bcede8b-bab1-4646-8bcf-e80787192fdb-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-9wkqm\" (UID: \"4bcede8b-bab1-4646-8bcf-e80787192fdb\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-9wkqm"
Jul 13 15:34:49.684286 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:34:49.684227    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r549m\" (UniqueName: \"kubernetes.io/projected/4bcede8b-bab1-4646-8bcf-e80787192fdb-kube-api-access-r549m\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-9wkqm\" (UID: \"4bcede8b-bab1-4646-8bcf-e80787192fdb\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-9wkqm"
Jul 13 15:34:49.747863 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:34:49.747832    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-9wkqm"
Jul 13 15:34:49.881473 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:34:49.881446    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-9wkqm"]
Jul 13 15:34:49.883398 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:34:49.883365    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod4bcede8b_bab1_4646_8bcf_e80787192fdb.slice/crio-6d05730959d701c02bd926f925f2abf223ec3d61035ad781856080e225208666 WatchSource:0}: Error finding container 6d05730959d701c02bd926f925f2abf223ec3d61035ad781856080e225208666: Status 404 returned error can't find the container with id 6d05730959d701c02bd926f925f2abf223ec3d61035ad781856080e225208666
Jul 13 15:34:50.243643 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:34:50.243605    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-9wkqm" event={"ID":"4bcede8b-bab1-4646-8bcf-e80787192fdb","Type":"ContainerStarted","Data":"9b0645f4459ce13584a3946343809d9b00a98eee85c436c6e330dd1989913926"}
Jul 13 15:34:50.243807 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:34:50.243651    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-9wkqm" event={"ID":"4bcede8b-bab1-4646-8bcf-e80787192fdb","Type":"ContainerStarted","Data":"6d05730959d701c02bd926f925f2abf223ec3d61035ad781856080e225208666"}
Jul 13 15:34:50.263408 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:34:50.263331    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-9wkqm" podStartSLOduration=1.060397491 podStartE2EDuration="1.263316083s" totalImagesPullingTime="202.918592ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 15:34:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 15:34:50.263259183 +0000 UTC m=+643.842494361" watchObservedRunningTime="2026-07-13 15:34:50.263316083 +0000 UTC m=+643.842551238"
Jul 13 15:34:51.742520 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:34:51.742483    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vhzkf"]
Jul 13 15:34:59.748305 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:34:59.748255    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-9wkqm"
Jul 13 15:34:59.748696 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:34:59.748320    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-9wkqm"
Jul 13 15:34:59.760861 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:34:59.760830    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-9wkqm"
Jul 13 15:35:00.307252 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:35:00.307225    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-9wkqm"
Jul 13 15:36:07.312892 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:36:07.312771    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-696b7747d-pm77l"]
Jul 13 15:36:07.317165 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:36:07.317138    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-696b7747d-pm77l"
Jul 13 15:36:07.320695 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:36:07.320666    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-drvmg\""
Jul 13 15:36:07.320838 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:36:07.320799    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\""
Jul 13 15:36:07.322422 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:36:07.322398    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-696b7747d-pm77l"]
Jul 13 15:36:07.470494 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:36:07.470465    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nl9j9\" (UniqueName: \"kubernetes.io/projected/49441811-4489-41af-98cc-637d93026f93-kube-api-access-nl9j9\") pod \"authorino-696b7747d-pm77l\" (UID: \"49441811-4489-41af-98cc-637d93026f93\") " pod="kuadrant-system/authorino-696b7747d-pm77l"
Jul 13 15:36:07.470668 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:36:07.470517    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/49441811-4489-41af-98cc-637d93026f93-tls-cert\") pod \"authorino-696b7747d-pm77l\" (UID: \"49441811-4489-41af-98cc-637d93026f93\") " pod="kuadrant-system/authorino-696b7747d-pm77l"
Jul 13 15:36:07.571983 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:36:07.571896    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/49441811-4489-41af-98cc-637d93026f93-tls-cert\") pod \"authorino-696b7747d-pm77l\" (UID: \"49441811-4489-41af-98cc-637d93026f93\") " pod="kuadrant-system/authorino-696b7747d-pm77l"
Jul 13 15:36:07.571983 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:36:07.571968    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nl9j9\" (UniqueName: \"kubernetes.io/projected/49441811-4489-41af-98cc-637d93026f93-kube-api-access-nl9j9\") pod \"authorino-696b7747d-pm77l\" (UID: \"49441811-4489-41af-98cc-637d93026f93\") " pod="kuadrant-system/authorino-696b7747d-pm77l"
Jul 13 15:36:07.574438 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:36:07.574416    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/49441811-4489-41af-98cc-637d93026f93-tls-cert\") pod \"authorino-696b7747d-pm77l\" (UID: \"49441811-4489-41af-98cc-637d93026f93\") " pod="kuadrant-system/authorino-696b7747d-pm77l"
Jul 13 15:36:07.585987 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:36:07.585958    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nl9j9\" (UniqueName: \"kubernetes.io/projected/49441811-4489-41af-98cc-637d93026f93-kube-api-access-nl9j9\") pod \"authorino-696b7747d-pm77l\" (UID: \"49441811-4489-41af-98cc-637d93026f93\") " pod="kuadrant-system/authorino-696b7747d-pm77l"
Jul 13 15:36:07.628137 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:36:07.628109    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-696b7747d-pm77l"
Jul 13 15:36:07.773527 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:36:07.773496    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-696b7747d-pm77l"]
Jul 13 15:36:07.776020 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:36:07.775990    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod49441811_4489_41af_98cc_637d93026f93.slice/crio-216b67483394af0763cb8d20d416bd0aaa08a5c8110c857d91fcdd115e69244f WatchSource:0}: Error finding container 216b67483394af0763cb8d20d416bd0aaa08a5c8110c857d91fcdd115e69244f: Status 404 returned error can't find the container with id 216b67483394af0763cb8d20d416bd0aaa08a5c8110c857d91fcdd115e69244f
Jul 13 15:36:07.777490 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:36:07.777473    2564 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 13 15:36:08.637446 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:36:08.637407    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-696b7747d-pm77l" event={"ID":"49441811-4489-41af-98cc-637d93026f93","Type":"ContainerStarted","Data":"ec978b7bfc111fb53c0cddb27af39d16fed39cff41159c18d33e1f6e2a77ef66"}
Jul 13 15:36:08.637446 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:36:08.637451    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-696b7747d-pm77l" event={"ID":"49441811-4489-41af-98cc-637d93026f93","Type":"ContainerStarted","Data":"216b67483394af0763cb8d20d416bd0aaa08a5c8110c857d91fcdd115e69244f"}
Jul 13 15:36:36.446420 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:36:36.446364    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-696b7747d-pm77l" podStartSLOduration=29.01753384 podStartE2EDuration="29.446345533s" totalImagesPullingTime="428.811693ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 15:36:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 15:36:08.662175804 +0000 UTC m=+722.241410982" watchObservedRunningTime="2026-07-13 15:36:36.446345533 +0000 UTC m=+750.025580712"
Jul 13 15:36:36.447001 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:36:36.446983    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vhzkf"]
Jul 13 15:36:47.432700 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:36:47.432660    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vhzkf"]
Jul 13 15:36:57.946819 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:36:57.946775    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vhzkf"]
Jul 13 15:37:06.444814 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:37:06.444778    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vhzkf"]
Jul 13 15:37:17.641411 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:37:17.641377    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vhzkf"]
Jul 13 15:37:46.541338 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:37:46.541298    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vhzkf"]
Jul 13 15:37:58.046814 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:37:58.046776    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vhzkf"]
Jul 13 15:38:33.030588 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:38:33.030546    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vhzkf"]
Jul 13 15:38:42.535330 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:38:42.535291    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vhzkf"]
Jul 13 15:38:53.146235 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:38:53.146198    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vhzkf"]
Jul 13 15:38:58.840401 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:38:58.840319    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vhzkf"]
Jul 13 15:38:58.937104 ip-10-0-140-255 kubenswrapper[2564]: E0713 15:38:58.937058    2564 cadvisor_stats_provider.go:567] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/system.slice/systemd-tmpfiles-clean.service\": RecentStats: unable to find data in memory cache]"
Jul 13 15:39:06.934768 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:39:06.934739    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9dq6z_258b7ae3-adf5-437a-8f8e-71bdd1cc665b/ovn-acl-logging/0.log"
Jul 13 15:39:06.936693 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:39:06.936673    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9dq6z_258b7ae3-adf5-437a-8f8e-71bdd1cc665b/ovn-acl-logging/0.log"
Jul 13 15:39:10.347474 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:39:10.347433    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vhzkf"]
Jul 13 15:39:21.037589 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:39:21.037554    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vhzkf"]
Jul 13 15:39:34.647501 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:39:34.647463    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vhzkf"]
Jul 13 15:39:42.442239 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:39:42.442199    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vhzkf"]
Jul 13 15:40:07.845722 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:40:07.845685    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vhzkf"]
Jul 13 15:40:19.663184 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:40:19.663147    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vhzkf"]
Jul 13 15:40:43.149718 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:40:43.149673    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vhzkf"]
Jul 13 15:40:53.846264 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:40:53.846231    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vhzkf"]
Jul 13 15:41:11.432065 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:41:11.432026    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vhzkf"]
Jul 13 15:41:20.737539 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:41:20.737498    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vhzkf"]
Jul 13 15:41:30.153237 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:41:30.153198    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vhzkf"]
Jul 13 15:41:38.559266 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:41:38.559231    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vhzkf"]
Jul 13 15:41:48.142558 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:41:48.142527    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vhzkf"]
Jul 13 15:43:38.760806 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:43:38.760721    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vhzkf"]
Jul 13 15:43:49.399951 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:43:49.399911    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vhzkf"]
Jul 13 15:44:00.748133 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:44:00.748100    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vhzkf"]
Jul 13 15:44:06.968893 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:44:06.968835    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9dq6z_258b7ae3-adf5-437a-8f8e-71bdd1cc665b/ovn-acl-logging/0.log"
Jul 13 15:44:06.973646 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:44:06.973625    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9dq6z_258b7ae3-adf5-437a-8f8e-71bdd1cc665b/ovn-acl-logging/0.log"
Jul 13 15:44:09.736353 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:44:09.736311    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vhzkf"]
Jul 13 15:44:19.561497 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:44:19.561460    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vhzkf"]
Jul 13 15:44:28.340111 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:44:28.340075    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vhzkf"]
Jul 13 15:44:39.638099 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:44:39.638065    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vhzkf"]
Jul 13 15:44:50.254860 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:44:50.254820    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vhzkf"]
Jul 13 15:44:59.467263 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:44:59.467178    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vhzkf"]
Jul 13 15:45:11.638453 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:45:11.638414    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vhzkf"]
Jul 13 15:45:21.244435 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:45:21.244399    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vhzkf"]
Jul 13 15:45:28.053362 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:45:28.053321    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vhzkf"]
Jul 13 15:45:49.536587 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:45:49.536552    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vhzkf"]
Jul 13 15:45:58.853674 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:45:58.853640    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vhzkf"]
Jul 13 15:46:08.935200 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:46:08.935156    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vhzkf"]
Jul 13 15:46:18.737806 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:46:18.737768    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vhzkf"]
Jul 13 15:46:25.436603 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:46:25.436567    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vhzkf"]
Jul 13 15:46:35.041472 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:46:35.041389    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vhzkf"]
Jul 13 15:46:42.143129 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:46:42.143091    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vhzkf"]
Jul 13 15:46:51.636783 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:46:51.636747    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vhzkf"]
Jul 13 15:47:01.137883 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:47:01.137844    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vhzkf"]
Jul 13 15:47:09.533954 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:47:09.533914    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vhzkf"]
Jul 13 15:47:18.937478 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:47:18.937440    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vhzkf"]
Jul 13 15:47:28.441531 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:47:28.441496    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vhzkf"]
Jul 13 15:47:41.831857 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:47:41.831811    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vhzkf"]
Jul 13 15:47:50.941299 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:47:50.941257    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vhzkf"]
Jul 13 15:48:00.636751 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:48:00.636665    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vhzkf"]
Jul 13 15:48:10.039088 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:48:10.039055    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vhzkf"]
Jul 13 15:48:22.033800 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:48:22.033759    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vhzkf"]
Jul 13 15:48:30.172891 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:48:30.172834    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vhzkf"]
Jul 13 15:48:41.735844 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:48:41.735810    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vhzkf"]
Jul 13 15:48:54.040360 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:48:54.040322    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vhzkf"]
Jul 13 15:49:05.640461 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:49:05.640421    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vhzkf"]
Jul 13 15:49:07.002316 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:49:07.002286    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9dq6z_258b7ae3-adf5-437a-8f8e-71bdd1cc665b/ovn-acl-logging/0.log"
Jul 13 15:49:07.009024 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:49:07.008997    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9dq6z_258b7ae3-adf5-437a-8f8e-71bdd1cc665b/ovn-acl-logging/0.log"
Jul 13 15:49:17.827103 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:49:17.827070    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vhzkf"]
Jul 13 15:49:26.833324 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:49:26.833288    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vhzkf"]
Jul 13 15:49:36.838272 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:49:36.838174    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vhzkf"]
Jul 13 15:49:47.356347 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:49:47.356317    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vhzkf"]
Jul 13 15:49:55.677518 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:49:55.677466    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vhzkf"]
Jul 13 15:50:19.142429 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:50:19.142393    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vhzkf"]
Jul 13 15:51:16.633897 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:51:16.633791    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vhzkf"]
Jul 13 15:51:26.028991 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:51:26.028953    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vhzkf"]
Jul 13 15:52:30.936501 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:52:30.936419    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vhzkf"]
Jul 13 15:52:53.634376 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:52:53.634342    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vhzkf"]
Jul 13 15:53:52.939974 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:53:52.939930    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vhzkf"]
Jul 13 15:54:07.042712 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:54:07.042686    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9dq6z_258b7ae3-adf5-437a-8f8e-71bdd1cc665b/ovn-acl-logging/0.log"
Jul 13 15:54:07.051358 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:54:07.051333    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9dq6z_258b7ae3-adf5-437a-8f8e-71bdd1cc665b/ovn-acl-logging/0.log"
Jul 13 15:55:29.838453 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:55:29.838368    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vhzkf"]
Jul 13 15:55:39.153238 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:55:39.153205    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vhzkf"]
Jul 13 15:55:50.231452 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:55:50.231417    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vhzkf"]
Jul 13 15:56:09.729171 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:56:09.729136    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vhzkf"]
Jul 13 15:56:52.036890 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:56:52.033666    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vhzkf"]
Jul 13 15:56:57.629548 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:56:57.629474    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-mt-5461ffdf/e2e-lifecycle-model-5461ffdf-kserve-67db94d9c5-5vvqv"]
Jul 13 15:56:57.632781 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:56:57.632766    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-5461ffdf/e2e-lifecycle-model-5461ffdf-kserve-67db94d9c5-5vvqv"
Jul 13 15:56:57.635977 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:56:57.635958    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-mt-5461ffdf\"/\"kube-root-ca.crt\""
Jul 13 15:56:57.636119 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:56:57.635976    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-mt-5461ffdf\"/\"openshift-service-ca.crt\""
Jul 13 15:56:57.636119 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:56:57.636001    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-mt-5461ffdf\"/\"e2e-lifecycle-model-5461ffdf-kserve-self-signed-certs\""
Jul 13 15:56:57.636119 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:56:57.635964    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-mt-5461ffdf\"/\"default-dockercfg-mhwkl\""
Jul 13 15:56:57.641343 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:56:57.641321    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-mt-5461ffdf/e2e-lifecycle-model-5461ffdf-kserve-67db94d9c5-5vvqv"]
Jul 13 15:56:57.753957 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:56:57.753917    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0df3d8a4-e346-4e48-aa68-1b31123d1127-tls-certs\") pod \"e2e-lifecycle-model-5461ffdf-kserve-67db94d9c5-5vvqv\" (UID: \"0df3d8a4-e346-4e48-aa68-1b31123d1127\") " pod="ai-tenant-e2e-mt-5461ffdf/e2e-lifecycle-model-5461ffdf-kserve-67db94d9c5-5vvqv"
Jul 13 15:56:57.753957 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:56:57.753961    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k4477\" (UniqueName: \"kubernetes.io/projected/0df3d8a4-e346-4e48-aa68-1b31123d1127-kube-api-access-k4477\") pod \"e2e-lifecycle-model-5461ffdf-kserve-67db94d9c5-5vvqv\" (UID: \"0df3d8a4-e346-4e48-aa68-1b31123d1127\") " pod="ai-tenant-e2e-mt-5461ffdf/e2e-lifecycle-model-5461ffdf-kserve-67db94d9c5-5vvqv"
Jul 13 15:56:57.754241 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:56:57.754098    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0df3d8a4-e346-4e48-aa68-1b31123d1127-model-cache\") pod \"e2e-lifecycle-model-5461ffdf-kserve-67db94d9c5-5vvqv\" (UID: \"0df3d8a4-e346-4e48-aa68-1b31123d1127\") " pod="ai-tenant-e2e-mt-5461ffdf/e2e-lifecycle-model-5461ffdf-kserve-67db94d9c5-5vvqv"
Jul 13 15:56:57.754241 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:56:57.754142    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0df3d8a4-e346-4e48-aa68-1b31123d1127-tmp-dir\") pod \"e2e-lifecycle-model-5461ffdf-kserve-67db94d9c5-5vvqv\" (UID: \"0df3d8a4-e346-4e48-aa68-1b31123d1127\") " pod="ai-tenant-e2e-mt-5461ffdf/e2e-lifecycle-model-5461ffdf-kserve-67db94d9c5-5vvqv"
Jul 13 15:56:57.754241 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:56:57.754217    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0df3d8a4-e346-4e48-aa68-1b31123d1127-home\") pod \"e2e-lifecycle-model-5461ffdf-kserve-67db94d9c5-5vvqv\" (UID: \"0df3d8a4-e346-4e48-aa68-1b31123d1127\") " pod="ai-tenant-e2e-mt-5461ffdf/e2e-lifecycle-model-5461ffdf-kserve-67db94d9c5-5vvqv"
Jul 13 15:56:57.754375 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:56:57.754259    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0df3d8a4-e346-4e48-aa68-1b31123d1127-dshm\") pod \"e2e-lifecycle-model-5461ffdf-kserve-67db94d9c5-5vvqv\" (UID: \"0df3d8a4-e346-4e48-aa68-1b31123d1127\") " pod="ai-tenant-e2e-mt-5461ffdf/e2e-lifecycle-model-5461ffdf-kserve-67db94d9c5-5vvqv"
Jul 13 15:56:57.855126 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:56:57.855083    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0df3d8a4-e346-4e48-aa68-1b31123d1127-home\") pod \"e2e-lifecycle-model-5461ffdf-kserve-67db94d9c5-5vvqv\" (UID: \"0df3d8a4-e346-4e48-aa68-1b31123d1127\") " pod="ai-tenant-e2e-mt-5461ffdf/e2e-lifecycle-model-5461ffdf-kserve-67db94d9c5-5vvqv"
Jul 13 15:56:57.855126 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:56:57.855126    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0df3d8a4-e346-4e48-aa68-1b31123d1127-dshm\") pod \"e2e-lifecycle-model-5461ffdf-kserve-67db94d9c5-5vvqv\" (UID: \"0df3d8a4-e346-4e48-aa68-1b31123d1127\") " pod="ai-tenant-e2e-mt-5461ffdf/e2e-lifecycle-model-5461ffdf-kserve-67db94d9c5-5vvqv"
Jul 13 15:56:57.855389 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:56:57.855153    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0df3d8a4-e346-4e48-aa68-1b31123d1127-tls-certs\") pod \"e2e-lifecycle-model-5461ffdf-kserve-67db94d9c5-5vvqv\" (UID: \"0df3d8a4-e346-4e48-aa68-1b31123d1127\") " pod="ai-tenant-e2e-mt-5461ffdf/e2e-lifecycle-model-5461ffdf-kserve-67db94d9c5-5vvqv"
Jul 13 15:56:57.855389 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:56:57.855307    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k4477\" (UniqueName: \"kubernetes.io/projected/0df3d8a4-e346-4e48-aa68-1b31123d1127-kube-api-access-k4477\") pod \"e2e-lifecycle-model-5461ffdf-kserve-67db94d9c5-5vvqv\" (UID: \"0df3d8a4-e346-4e48-aa68-1b31123d1127\") " pod="ai-tenant-e2e-mt-5461ffdf/e2e-lifecycle-model-5461ffdf-kserve-67db94d9c5-5vvqv"
Jul 13 15:56:57.855500 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:56:57.855435    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0df3d8a4-e346-4e48-aa68-1b31123d1127-model-cache\") pod \"e2e-lifecycle-model-5461ffdf-kserve-67db94d9c5-5vvqv\" (UID: \"0df3d8a4-e346-4e48-aa68-1b31123d1127\") " pod="ai-tenant-e2e-mt-5461ffdf/e2e-lifecycle-model-5461ffdf-kserve-67db94d9c5-5vvqv"
Jul 13 15:56:57.855500 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:56:57.855469    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0df3d8a4-e346-4e48-aa68-1b31123d1127-tmp-dir\") pod \"e2e-lifecycle-model-5461ffdf-kserve-67db94d9c5-5vvqv\" (UID: \"0df3d8a4-e346-4e48-aa68-1b31123d1127\") " pod="ai-tenant-e2e-mt-5461ffdf/e2e-lifecycle-model-5461ffdf-kserve-67db94d9c5-5vvqv"
Jul 13 15:56:57.855694 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:56:57.855665    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0df3d8a4-e346-4e48-aa68-1b31123d1127-home\") pod \"e2e-lifecycle-model-5461ffdf-kserve-67db94d9c5-5vvqv\" (UID: \"0df3d8a4-e346-4e48-aa68-1b31123d1127\") " pod="ai-tenant-e2e-mt-5461ffdf/e2e-lifecycle-model-5461ffdf-kserve-67db94d9c5-5vvqv"
Jul 13 15:56:57.856039 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:56:57.855788    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0df3d8a4-e346-4e48-aa68-1b31123d1127-tmp-dir\") pod \"e2e-lifecycle-model-5461ffdf-kserve-67db94d9c5-5vvqv\" (UID: \"0df3d8a4-e346-4e48-aa68-1b31123d1127\") " pod="ai-tenant-e2e-mt-5461ffdf/e2e-lifecycle-model-5461ffdf-kserve-67db94d9c5-5vvqv"
Jul 13 15:56:57.856039 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:56:57.855860    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0df3d8a4-e346-4e48-aa68-1b31123d1127-model-cache\") pod \"e2e-lifecycle-model-5461ffdf-kserve-67db94d9c5-5vvqv\" (UID: \"0df3d8a4-e346-4e48-aa68-1b31123d1127\") " pod="ai-tenant-e2e-mt-5461ffdf/e2e-lifecycle-model-5461ffdf-kserve-67db94d9c5-5vvqv"
Jul 13 15:56:57.857587 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:56:57.857560    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0df3d8a4-e346-4e48-aa68-1b31123d1127-dshm\") pod \"e2e-lifecycle-model-5461ffdf-kserve-67db94d9c5-5vvqv\" (UID: \"0df3d8a4-e346-4e48-aa68-1b31123d1127\") " pod="ai-tenant-e2e-mt-5461ffdf/e2e-lifecycle-model-5461ffdf-kserve-67db94d9c5-5vvqv"
Jul 13 15:56:57.857990 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:56:57.857971    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0df3d8a4-e346-4e48-aa68-1b31123d1127-tls-certs\") pod \"e2e-lifecycle-model-5461ffdf-kserve-67db94d9c5-5vvqv\" (UID: \"0df3d8a4-e346-4e48-aa68-1b31123d1127\") " pod="ai-tenant-e2e-mt-5461ffdf/e2e-lifecycle-model-5461ffdf-kserve-67db94d9c5-5vvqv"
Jul 13 15:56:57.863662 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:56:57.863637    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k4477\" (UniqueName: \"kubernetes.io/projected/0df3d8a4-e346-4e48-aa68-1b31123d1127-kube-api-access-k4477\") pod \"e2e-lifecycle-model-5461ffdf-kserve-67db94d9c5-5vvqv\" (UID: \"0df3d8a4-e346-4e48-aa68-1b31123d1127\") " pod="ai-tenant-e2e-mt-5461ffdf/e2e-lifecycle-model-5461ffdf-kserve-67db94d9c5-5vvqv"
Jul 13 15:56:57.942638 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:56:57.942540    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-5461ffdf/e2e-lifecycle-model-5461ffdf-kserve-67db94d9c5-5vvqv"
Jul 13 15:56:58.080229 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:56:58.080124    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-mt-5461ffdf/e2e-lifecycle-model-5461ffdf-kserve-67db94d9c5-5vvqv"]
Jul 13 15:56:58.082923 ip-10-0-140-255 kubenswrapper[2564]: W0713 15:56:58.082895    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod0df3d8a4_e346_4e48_aa68_1b31123d1127.slice/crio-9ef3da0a360b3b6b01c71609937e28278b338c9349c48aefa2ebe50c4837fe41 WatchSource:0}: Error finding container 9ef3da0a360b3b6b01c71609937e28278b338c9349c48aefa2ebe50c4837fe41: Status 404 returned error can't find the container with id 9ef3da0a360b3b6b01c71609937e28278b338c9349c48aefa2ebe50c4837fe41
Jul 13 15:56:59.081965 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:56:59.081918    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-5461ffdf/e2e-lifecycle-model-5461ffdf-kserve-67db94d9c5-5vvqv" event={"ID":"0df3d8a4-e346-4e48-aa68-1b31123d1127","Type":"ContainerStarted","Data":"6f530eef6477d94bbca87b1e24b1abcbd9cd59a80ed2491d2e01e0d7a5b23a37"}
Jul 13 15:56:59.081965 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:56:59.081969    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-5461ffdf/e2e-lifecycle-model-5461ffdf-kserve-67db94d9c5-5vvqv" event={"ID":"0df3d8a4-e346-4e48-aa68-1b31123d1127","Type":"ContainerStarted","Data":"9ef3da0a360b3b6b01c71609937e28278b338c9349c48aefa2ebe50c4837fe41"}
Jul 13 15:56:59.101767 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:56:59.101711    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-mt-5461ffdf/e2e-lifecycle-model-5461ffdf-kserve-67db94d9c5-5vvqv" podStartSLOduration=2.101692804 podStartE2EDuration="2.101692804s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 15:56:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 15:56:59.100681053 +0000 UTC m=+1972.679916264" watchObservedRunningTime="2026-07-13 15:56:59.101692804 +0000 UTC m=+1972.680927980"
Jul 13 15:57:00.831301 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:57:00.831266    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vhzkf"]
Jul 13 15:57:07.942782 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:57:07.942740    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-mt-5461ffdf/e2e-lifecycle-model-5461ffdf-kserve-67db94d9c5-5vvqv"
Jul 13 15:57:07.942782 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:57:07.942795    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-mt-5461ffdf/e2e-lifecycle-model-5461ffdf-kserve-67db94d9c5-5vvqv"
Jul 13 15:57:07.955396 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:57:07.955371    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-mt-5461ffdf/e2e-lifecycle-model-5461ffdf-kserve-67db94d9c5-5vvqv"
Jul 13 15:57:08.137680 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:57:08.137639    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-mt-5461ffdf/e2e-lifecycle-model-5461ffdf-kserve-67db94d9c5-5vvqv"
Jul 13 15:57:19.437085 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:57:19.437043    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vhzkf"]
Jul 13 15:57:36.535737 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:57:36.535697    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vhzkf"]
Jul 13 15:57:42.479773 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:57:42.479741    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-mt-5461ffdf/e2e-lifecycle-model-5461ffdf-kserve-67db94d9c5-5vvqv"]
Jul 13 15:57:57.500470 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:57:57.500427    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-mt-5461ffdf/e2e-lifecycle-model-5461ffdf-kserve-67db94d9c5-5vvqv" podUID="0df3d8a4-e346-4e48-aa68-1b31123d1127" containerName="main" containerID="cri-o://6f530eef6477d94bbca87b1e24b1abcbd9cd59a80ed2491d2e01e0d7a5b23a37" gracePeriod=45
Jul 13 15:57:57.757050 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:57:57.756988    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-5461ffdf/e2e-lifecycle-model-5461ffdf-kserve-67db94d9c5-5vvqv"
Jul 13 15:57:57.890777 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:57:57.890743    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0df3d8a4-e346-4e48-aa68-1b31123d1127-tmp-dir\") pod \"0df3d8a4-e346-4e48-aa68-1b31123d1127\" (UID: \"0df3d8a4-e346-4e48-aa68-1b31123d1127\") "
Jul 13 15:57:57.890995 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:57:57.890789    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-k4477\" (UniqueName: \"kubernetes.io/projected/0df3d8a4-e346-4e48-aa68-1b31123d1127-kube-api-access-k4477\") pod \"0df3d8a4-e346-4e48-aa68-1b31123d1127\" (UID: \"0df3d8a4-e346-4e48-aa68-1b31123d1127\") "
Jul 13 15:57:57.890995 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:57:57.890826    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0df3d8a4-e346-4e48-aa68-1b31123d1127-dshm\") pod \"0df3d8a4-e346-4e48-aa68-1b31123d1127\" (UID: \"0df3d8a4-e346-4e48-aa68-1b31123d1127\") "
Jul 13 15:57:57.890995 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:57:57.890855    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0df3d8a4-e346-4e48-aa68-1b31123d1127-tls-certs\") pod \"0df3d8a4-e346-4e48-aa68-1b31123d1127\" (UID: \"0df3d8a4-e346-4e48-aa68-1b31123d1127\") "
Jul 13 15:57:57.890995 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:57:57.890895    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0df3d8a4-e346-4e48-aa68-1b31123d1127-model-cache\") pod \"0df3d8a4-e346-4e48-aa68-1b31123d1127\" (UID: \"0df3d8a4-e346-4e48-aa68-1b31123d1127\") "
Jul 13 15:57:57.890995 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:57:57.890917    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0df3d8a4-e346-4e48-aa68-1b31123d1127-home\") pod \"0df3d8a4-e346-4e48-aa68-1b31123d1127\" (UID: \"0df3d8a4-e346-4e48-aa68-1b31123d1127\") "
Jul 13 15:57:57.891277 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:57:57.891061    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0df3d8a4-e346-4e48-aa68-1b31123d1127-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "0df3d8a4-e346-4e48-aa68-1b31123d1127" (UID: "0df3d8a4-e346-4e48-aa68-1b31123d1127"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 15:57:57.891277 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:57:57.891174    2564 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0df3d8a4-e346-4e48-aa68-1b31123d1127-tmp-dir\") on node \"ip-10-0-140-255.ec2.internal\" DevicePath \"\""
Jul 13 15:57:57.891277 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:57:57.891160    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0df3d8a4-e346-4e48-aa68-1b31123d1127-model-cache" (OuterVolumeSpecName: "model-cache") pod "0df3d8a4-e346-4e48-aa68-1b31123d1127" (UID: "0df3d8a4-e346-4e48-aa68-1b31123d1127"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 15:57:57.891277 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:57:57.891225    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0df3d8a4-e346-4e48-aa68-1b31123d1127-home" (OuterVolumeSpecName: "home") pod "0df3d8a4-e346-4e48-aa68-1b31123d1127" (UID: "0df3d8a4-e346-4e48-aa68-1b31123d1127"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 15:57:57.893191 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:57:57.893170    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0df3d8a4-e346-4e48-aa68-1b31123d1127-dshm" (OuterVolumeSpecName: "dshm") pod "0df3d8a4-e346-4e48-aa68-1b31123d1127" (UID: "0df3d8a4-e346-4e48-aa68-1b31123d1127"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 15:57:57.893279 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:57:57.893221    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0df3d8a4-e346-4e48-aa68-1b31123d1127-kube-api-access-k4477" (OuterVolumeSpecName: "kube-api-access-k4477") pod "0df3d8a4-e346-4e48-aa68-1b31123d1127" (UID: "0df3d8a4-e346-4e48-aa68-1b31123d1127"). InnerVolumeSpecName "kube-api-access-k4477". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 13 15:57:57.893330 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:57:57.893273    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0df3d8a4-e346-4e48-aa68-1b31123d1127-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "0df3d8a4-e346-4e48-aa68-1b31123d1127" (UID: "0df3d8a4-e346-4e48-aa68-1b31123d1127"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 13 15:57:57.991941 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:57:57.991896    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-k4477\" (UniqueName: \"kubernetes.io/projected/0df3d8a4-e346-4e48-aa68-1b31123d1127-kube-api-access-k4477\") on node \"ip-10-0-140-255.ec2.internal\" DevicePath \"\""
Jul 13 15:57:57.991941 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:57:57.991931    2564 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0df3d8a4-e346-4e48-aa68-1b31123d1127-dshm\") on node \"ip-10-0-140-255.ec2.internal\" DevicePath \"\""
Jul 13 15:57:57.991941 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:57:57.991943    2564 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0df3d8a4-e346-4e48-aa68-1b31123d1127-tls-certs\") on node \"ip-10-0-140-255.ec2.internal\" DevicePath \"\""
Jul 13 15:57:57.992204 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:57:57.991957    2564 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0df3d8a4-e346-4e48-aa68-1b31123d1127-model-cache\") on node \"ip-10-0-140-255.ec2.internal\" DevicePath \"\""
Jul 13 15:57:57.992204 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:57:57.991985    2564 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0df3d8a4-e346-4e48-aa68-1b31123d1127-home\") on node \"ip-10-0-140-255.ec2.internal\" DevicePath \"\""
Jul 13 15:57:58.389336 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:57:58.389304    2564 generic.go:356] "Generic (PLEG): container finished" podID="0df3d8a4-e346-4e48-aa68-1b31123d1127" containerID="6f530eef6477d94bbca87b1e24b1abcbd9cd59a80ed2491d2e01e0d7a5b23a37" exitCode=0
Jul 13 15:57:58.389526 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:57:58.389348    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-5461ffdf/e2e-lifecycle-model-5461ffdf-kserve-67db94d9c5-5vvqv"
Jul 13 15:57:58.389526 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:57:58.389390    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-5461ffdf/e2e-lifecycle-model-5461ffdf-kserve-67db94d9c5-5vvqv" event={"ID":"0df3d8a4-e346-4e48-aa68-1b31123d1127","Type":"ContainerDied","Data":"6f530eef6477d94bbca87b1e24b1abcbd9cd59a80ed2491d2e01e0d7a5b23a37"}
Jul 13 15:57:58.389526 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:57:58.389438    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-5461ffdf/e2e-lifecycle-model-5461ffdf-kserve-67db94d9c5-5vvqv" event={"ID":"0df3d8a4-e346-4e48-aa68-1b31123d1127","Type":"ContainerDied","Data":"9ef3da0a360b3b6b01c71609937e28278b338c9349c48aefa2ebe50c4837fe41"}
Jul 13 15:57:58.389526 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:57:58.389459    2564 scope.go:117] "RemoveContainer" containerID="6f530eef6477d94bbca87b1e24b1abcbd9cd59a80ed2491d2e01e0d7a5b23a37"
Jul 13 15:57:58.399791 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:57:58.399771    2564 scope.go:117] "RemoveContainer" containerID="6f530eef6477d94bbca87b1e24b1abcbd9cd59a80ed2491d2e01e0d7a5b23a37"
Jul 13 15:57:58.400107 ip-10-0-140-255 kubenswrapper[2564]: E0713 15:57:58.400088    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6f530eef6477d94bbca87b1e24b1abcbd9cd59a80ed2491d2e01e0d7a5b23a37\": container with ID starting with 6f530eef6477d94bbca87b1e24b1abcbd9cd59a80ed2491d2e01e0d7a5b23a37 not found: ID does not exist" containerID="6f530eef6477d94bbca87b1e24b1abcbd9cd59a80ed2491d2e01e0d7a5b23a37"
Jul 13 15:57:58.400182 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:57:58.400118    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6f530eef6477d94bbca87b1e24b1abcbd9cd59a80ed2491d2e01e0d7a5b23a37"} err="failed to get container status \"6f530eef6477d94bbca87b1e24b1abcbd9cd59a80ed2491d2e01e0d7a5b23a37\": rpc error: code = NotFound desc = could not find container \"6f530eef6477d94bbca87b1e24b1abcbd9cd59a80ed2491d2e01e0d7a5b23a37\": container with ID starting with 6f530eef6477d94bbca87b1e24b1abcbd9cd59a80ed2491d2e01e0d7a5b23a37 not found: ID does not exist"
Jul 13 15:57:58.411070 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:57:58.411040    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-mt-5461ffdf/e2e-lifecycle-model-5461ffdf-kserve-67db94d9c5-5vvqv"]
Jul 13 15:57:58.415277 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:57:58.415250    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-mt-5461ffdf/e2e-lifecycle-model-5461ffdf-kserve-67db94d9c5-5vvqv"]
Jul 13 15:57:59.121413 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:57:59.121377    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0df3d8a4-e346-4e48-aa68-1b31123d1127" path="/var/lib/kubelet/pods/0df3d8a4-e346-4e48-aa68-1b31123d1127/volumes"
Jul 13 15:58:43.846731 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:58:43.846699    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vhzkf"]
Jul 13 15:58:56.144669 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:58:56.144627    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vhzkf"]
Jul 13 15:59:07.076002 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:59:07.075971    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9dq6z_258b7ae3-adf5-437a-8f8e-71bdd1cc665b/ovn-acl-logging/0.log"
Jul 13 15:59:07.084990 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:59:07.084965    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9dq6z_258b7ae3-adf5-437a-8f8e-71bdd1cc665b/ovn-acl-logging/0.log"
Jul 13 15:59:44.933789 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:59:44.933751    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vhzkf"]
Jul 13 15:59:58.231579 ip-10-0-140-255 kubenswrapper[2564]: I0713 15:59:58.231488    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vhzkf"]
Jul 13 16:00:00.519278 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:00:00.519237    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-a-47280f/test-model-47280f-kserve-67559db859-w2ltn"]
Jul 13 16:00:00.519699 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:00:00.519680    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0df3d8a4-e346-4e48-aa68-1b31123d1127" containerName="main"
Jul 13 16:00:00.519699 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:00:00.519700    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="0df3d8a4-e346-4e48-aa68-1b31123d1127" containerName="main"
Jul 13 16:00:00.519850 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:00:00.519772    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="0df3d8a4-e346-4e48-aa68-1b31123d1127" containerName="main"
Jul 13 16:00:00.523048 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:00:00.523020    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-47280f/test-model-47280f-kserve-67559db859-w2ltn"
Jul 13 16:00:00.525505 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:00:00.525480    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-47280f\"/\"openshift-service-ca.crt\""
Jul 13 16:00:00.526584 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:00:00.526558    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-47280f\"/\"default-dockercfg-8nfbx\""
Jul 13 16:00:00.526690 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:00:00.526600    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-47280f\"/\"kube-root-ca.crt\""
Jul 13 16:00:00.526690 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:00:00.526603    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-47280f\"/\"test-model-47280f-kserve-self-signed-certs\""
Jul 13 16:00:00.533900 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:00:00.533849    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-47280f/test-model-47280f-kserve-67559db859-w2ltn"]
Jul 13 16:00:00.630267 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:00:00.630233    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8vh6p\" (UniqueName: \"kubernetes.io/projected/7c0c8555-d60b-48bf-93f4-f8ba16572967-kube-api-access-8vh6p\") pod \"test-model-47280f-kserve-67559db859-w2ltn\" (UID: \"7c0c8555-d60b-48bf-93f4-f8ba16572967\") " pod="ai-tenant-e2e-inf-a-47280f/test-model-47280f-kserve-67559db859-w2ltn"
Jul 13 16:00:00.630267 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:00:00.630269    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7c0c8555-d60b-48bf-93f4-f8ba16572967-home\") pod \"test-model-47280f-kserve-67559db859-w2ltn\" (UID: \"7c0c8555-d60b-48bf-93f4-f8ba16572967\") " pod="ai-tenant-e2e-inf-a-47280f/test-model-47280f-kserve-67559db859-w2ltn"
Jul 13 16:00:00.630496 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:00:00.630296    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7c0c8555-d60b-48bf-93f4-f8ba16572967-model-cache\") pod \"test-model-47280f-kserve-67559db859-w2ltn\" (UID: \"7c0c8555-d60b-48bf-93f4-f8ba16572967\") " pod="ai-tenant-e2e-inf-a-47280f/test-model-47280f-kserve-67559db859-w2ltn"
Jul 13 16:00:00.630496 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:00:00.630409    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7c0c8555-d60b-48bf-93f4-f8ba16572967-tls-certs\") pod \"test-model-47280f-kserve-67559db859-w2ltn\" (UID: \"7c0c8555-d60b-48bf-93f4-f8ba16572967\") " pod="ai-tenant-e2e-inf-a-47280f/test-model-47280f-kserve-67559db859-w2ltn"
Jul 13 16:00:00.630496 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:00:00.630466    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7c0c8555-d60b-48bf-93f4-f8ba16572967-tmp-dir\") pod \"test-model-47280f-kserve-67559db859-w2ltn\" (UID: \"7c0c8555-d60b-48bf-93f4-f8ba16572967\") " pod="ai-tenant-e2e-inf-a-47280f/test-model-47280f-kserve-67559db859-w2ltn"
Jul 13 16:00:00.630601 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:00:00.630497    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7c0c8555-d60b-48bf-93f4-f8ba16572967-dshm\") pod \"test-model-47280f-kserve-67559db859-w2ltn\" (UID: \"7c0c8555-d60b-48bf-93f4-f8ba16572967\") " pod="ai-tenant-e2e-inf-a-47280f/test-model-47280f-kserve-67559db859-w2ltn"
Jul 13 16:00:00.731314 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:00:00.731274    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8vh6p\" (UniqueName: \"kubernetes.io/projected/7c0c8555-d60b-48bf-93f4-f8ba16572967-kube-api-access-8vh6p\") pod \"test-model-47280f-kserve-67559db859-w2ltn\" (UID: \"7c0c8555-d60b-48bf-93f4-f8ba16572967\") " pod="ai-tenant-e2e-inf-a-47280f/test-model-47280f-kserve-67559db859-w2ltn"
Jul 13 16:00:00.731314 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:00:00.731313    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7c0c8555-d60b-48bf-93f4-f8ba16572967-home\") pod \"test-model-47280f-kserve-67559db859-w2ltn\" (UID: \"7c0c8555-d60b-48bf-93f4-f8ba16572967\") " pod="ai-tenant-e2e-inf-a-47280f/test-model-47280f-kserve-67559db859-w2ltn"
Jul 13 16:00:00.731592 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:00:00.731338    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7c0c8555-d60b-48bf-93f4-f8ba16572967-model-cache\") pod \"test-model-47280f-kserve-67559db859-w2ltn\" (UID: \"7c0c8555-d60b-48bf-93f4-f8ba16572967\") " pod="ai-tenant-e2e-inf-a-47280f/test-model-47280f-kserve-67559db859-w2ltn"
Jul 13 16:00:00.731592 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:00:00.731376    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7c0c8555-d60b-48bf-93f4-f8ba16572967-tls-certs\") pod \"test-model-47280f-kserve-67559db859-w2ltn\" (UID: \"7c0c8555-d60b-48bf-93f4-f8ba16572967\") " pod="ai-tenant-e2e-inf-a-47280f/test-model-47280f-kserve-67559db859-w2ltn"
Jul 13 16:00:00.731592 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:00:00.731427    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7c0c8555-d60b-48bf-93f4-f8ba16572967-tmp-dir\") pod \"test-model-47280f-kserve-67559db859-w2ltn\" (UID: \"7c0c8555-d60b-48bf-93f4-f8ba16572967\") " pod="ai-tenant-e2e-inf-a-47280f/test-model-47280f-kserve-67559db859-w2ltn"
Jul 13 16:00:00.731592 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:00:00.731459    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7c0c8555-d60b-48bf-93f4-f8ba16572967-dshm\") pod \"test-model-47280f-kserve-67559db859-w2ltn\" (UID: \"7c0c8555-d60b-48bf-93f4-f8ba16572967\") " pod="ai-tenant-e2e-inf-a-47280f/test-model-47280f-kserve-67559db859-w2ltn"
Jul 13 16:00:00.731797 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:00:00.731774    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7c0c8555-d60b-48bf-93f4-f8ba16572967-model-cache\") pod \"test-model-47280f-kserve-67559db859-w2ltn\" (UID: \"7c0c8555-d60b-48bf-93f4-f8ba16572967\") " pod="ai-tenant-e2e-inf-a-47280f/test-model-47280f-kserve-67559db859-w2ltn"
Jul 13 16:00:00.731861 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:00:00.731833    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7c0c8555-d60b-48bf-93f4-f8ba16572967-tmp-dir\") pod \"test-model-47280f-kserve-67559db859-w2ltn\" (UID: \"7c0c8555-d60b-48bf-93f4-f8ba16572967\") " pod="ai-tenant-e2e-inf-a-47280f/test-model-47280f-kserve-67559db859-w2ltn"
Jul 13 16:00:00.732021 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:00:00.731861    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7c0c8555-d60b-48bf-93f4-f8ba16572967-home\") pod \"test-model-47280f-kserve-67559db859-w2ltn\" (UID: \"7c0c8555-d60b-48bf-93f4-f8ba16572967\") " pod="ai-tenant-e2e-inf-a-47280f/test-model-47280f-kserve-67559db859-w2ltn"
Jul 13 16:00:00.733805 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:00:00.733775    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7c0c8555-d60b-48bf-93f4-f8ba16572967-dshm\") pod \"test-model-47280f-kserve-67559db859-w2ltn\" (UID: \"7c0c8555-d60b-48bf-93f4-f8ba16572967\") " pod="ai-tenant-e2e-inf-a-47280f/test-model-47280f-kserve-67559db859-w2ltn"
Jul 13 16:00:00.734088 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:00:00.734072    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7c0c8555-d60b-48bf-93f4-f8ba16572967-tls-certs\") pod \"test-model-47280f-kserve-67559db859-w2ltn\" (UID: \"7c0c8555-d60b-48bf-93f4-f8ba16572967\") " pod="ai-tenant-e2e-inf-a-47280f/test-model-47280f-kserve-67559db859-w2ltn"
Jul 13 16:00:00.750228 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:00:00.750202    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8vh6p\" (UniqueName: \"kubernetes.io/projected/7c0c8555-d60b-48bf-93f4-f8ba16572967-kube-api-access-8vh6p\") pod \"test-model-47280f-kserve-67559db859-w2ltn\" (UID: \"7c0c8555-d60b-48bf-93f4-f8ba16572967\") " pod="ai-tenant-e2e-inf-a-47280f/test-model-47280f-kserve-67559db859-w2ltn"
Jul 13 16:00:00.834071 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:00:00.833980    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-47280f/test-model-47280f-kserve-67559db859-w2ltn"
Jul 13 16:00:00.975262 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:00:00.975229    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-47280f/test-model-47280f-kserve-67559db859-w2ltn"]
Jul 13 16:00:00.978056 ip-10-0-140-255 kubenswrapper[2564]: W0713 16:00:00.978003    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod7c0c8555_d60b_48bf_93f4_f8ba16572967.slice/crio-cea1a3874b517853355182df6694363e1bf80ad922129dc909e985a922d5273c WatchSource:0}: Error finding container cea1a3874b517853355182df6694363e1bf80ad922129dc909e985a922d5273c: Status 404 returned error can't find the container with id cea1a3874b517853355182df6694363e1bf80ad922129dc909e985a922d5273c
Jul 13 16:00:01.020091 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:00:01.020054    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-47280f/test-model-47280f-kserve-67559db859-w2ltn" event={"ID":"7c0c8555-d60b-48bf-93f4-f8ba16572967","Type":"ContainerStarted","Data":"cea1a3874b517853355182df6694363e1bf80ad922129dc909e985a922d5273c"}
Jul 13 16:00:02.027095 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:00:02.027059    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-47280f/test-model-47280f-kserve-67559db859-w2ltn" event={"ID":"7c0c8555-d60b-48bf-93f4-f8ba16572967","Type":"ContainerStarted","Data":"3fa343e63fe3dca3e037c30c9221ed5006a3048790a4d63e3f4b5a5fe5ebea93"}
Jul 13 16:00:02.050154 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:00:02.050097    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-a-47280f/test-model-47280f-kserve-67559db859-w2ltn" podStartSLOduration=2.050079687 podStartE2EDuration="2.050079687s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 16:00:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 16:00:02.048304565 +0000 UTC m=+2155.627539744" watchObservedRunningTime="2026-07-13 16:00:02.050079687 +0000 UTC m=+2155.629314864"
Jul 13 16:00:10.835132 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:00:10.835088    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-a-47280f/test-model-47280f-kserve-67559db859-w2ltn"
Jul 13 16:00:10.835530 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:00:10.835345    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-a-47280f/test-model-47280f-kserve-67559db859-w2ltn"
Jul 13 16:00:10.847863 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:00:10.847833    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-a-47280f/test-model-47280f-kserve-67559db859-w2ltn"
Jul 13 16:00:11.085952 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:00:11.085852    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-a-47280f/test-model-47280f-kserve-67559db859-w2ltn"
Jul 13 16:00:11.428467 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:00:11.428431    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vhzkf"]
Jul 13 16:00:20.919173 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:00:20.919135    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-b-ef5b3f/test-model-ef5b3f-kserve-98fc9df6c-v8t2f"]
Jul 13 16:00:20.922822 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:00:20.922800    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-ef5b3f/test-model-ef5b3f-kserve-98fc9df6c-v8t2f"
Jul 13 16:00:20.926061 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:00:20.926035    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-ef5b3f\"/\"kube-root-ca.crt\""
Jul 13 16:00:20.926061 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:00:20.926035    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-ef5b3f\"/\"default-dockercfg-rfbr4\""
Jul 13 16:00:20.926266 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:00:20.926129    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-ef5b3f\"/\"test-model-ef5b3f-kserve-self-signed-certs\""
Jul 13 16:00:20.926266 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:00:20.926153    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-ef5b3f\"/\"openshift-service-ca.crt\""
Jul 13 16:00:20.935176 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:00:20.935151    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-ef5b3f/test-model-ef5b3f-kserve-98fc9df6c-v8t2f"]
Jul 13 16:00:21.012497 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:00:21.012462    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a8faf88f-fa8b-46bd-a183-968a8bc5948f-model-cache\") pod \"test-model-ef5b3f-kserve-98fc9df6c-v8t2f\" (UID: \"a8faf88f-fa8b-46bd-a183-968a8bc5948f\") " pod="ai-tenant-e2e-inf-b-ef5b3f/test-model-ef5b3f-kserve-98fc9df6c-v8t2f"
Jul 13 16:00:21.012675 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:00:21.012508    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a8faf88f-fa8b-46bd-a183-968a8bc5948f-tmp-dir\") pod \"test-model-ef5b3f-kserve-98fc9df6c-v8t2f\" (UID: \"a8faf88f-fa8b-46bd-a183-968a8bc5948f\") " pod="ai-tenant-e2e-inf-b-ef5b3f/test-model-ef5b3f-kserve-98fc9df6c-v8t2f"
Jul 13 16:00:21.012675 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:00:21.012536    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a8faf88f-fa8b-46bd-a183-968a8bc5948f-home\") pod \"test-model-ef5b3f-kserve-98fc9df6c-v8t2f\" (UID: \"a8faf88f-fa8b-46bd-a183-968a8bc5948f\") " pod="ai-tenant-e2e-inf-b-ef5b3f/test-model-ef5b3f-kserve-98fc9df6c-v8t2f"
Jul 13 16:00:21.012675 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:00:21.012635    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k56tw\" (UniqueName: \"kubernetes.io/projected/a8faf88f-fa8b-46bd-a183-968a8bc5948f-kube-api-access-k56tw\") pod \"test-model-ef5b3f-kserve-98fc9df6c-v8t2f\" (UID: \"a8faf88f-fa8b-46bd-a183-968a8bc5948f\") " pod="ai-tenant-e2e-inf-b-ef5b3f/test-model-ef5b3f-kserve-98fc9df6c-v8t2f"
Jul 13 16:00:21.012675 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:00:21.012670    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a8faf88f-fa8b-46bd-a183-968a8bc5948f-dshm\") pod \"test-model-ef5b3f-kserve-98fc9df6c-v8t2f\" (UID: \"a8faf88f-fa8b-46bd-a183-968a8bc5948f\") " pod="ai-tenant-e2e-inf-b-ef5b3f/test-model-ef5b3f-kserve-98fc9df6c-v8t2f"
Jul 13 16:00:21.012841 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:00:21.012704    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a8faf88f-fa8b-46bd-a183-968a8bc5948f-tls-certs\") pod \"test-model-ef5b3f-kserve-98fc9df6c-v8t2f\" (UID: \"a8faf88f-fa8b-46bd-a183-968a8bc5948f\") " pod="ai-tenant-e2e-inf-b-ef5b3f/test-model-ef5b3f-kserve-98fc9df6c-v8t2f"
Jul 13 16:00:21.113263 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:00:21.113225    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a8faf88f-fa8b-46bd-a183-968a8bc5948f-home\") pod \"test-model-ef5b3f-kserve-98fc9df6c-v8t2f\" (UID: \"a8faf88f-fa8b-46bd-a183-968a8bc5948f\") " pod="ai-tenant-e2e-inf-b-ef5b3f/test-model-ef5b3f-kserve-98fc9df6c-v8t2f"
Jul 13 16:00:21.113477 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:00:21.113326    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k56tw\" (UniqueName: \"kubernetes.io/projected/a8faf88f-fa8b-46bd-a183-968a8bc5948f-kube-api-access-k56tw\") pod \"test-model-ef5b3f-kserve-98fc9df6c-v8t2f\" (UID: \"a8faf88f-fa8b-46bd-a183-968a8bc5948f\") " pod="ai-tenant-e2e-inf-b-ef5b3f/test-model-ef5b3f-kserve-98fc9df6c-v8t2f"
Jul 13 16:00:21.113477 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:00:21.113358    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a8faf88f-fa8b-46bd-a183-968a8bc5948f-dshm\") pod \"test-model-ef5b3f-kserve-98fc9df6c-v8t2f\" (UID: \"a8faf88f-fa8b-46bd-a183-968a8bc5948f\") " pod="ai-tenant-e2e-inf-b-ef5b3f/test-model-ef5b3f-kserve-98fc9df6c-v8t2f"
Jul 13 16:00:21.113605 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:00:21.113494    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a8faf88f-fa8b-46bd-a183-968a8bc5948f-tls-certs\") pod \"test-model-ef5b3f-kserve-98fc9df6c-v8t2f\" (UID: \"a8faf88f-fa8b-46bd-a183-968a8bc5948f\") " pod="ai-tenant-e2e-inf-b-ef5b3f/test-model-ef5b3f-kserve-98fc9df6c-v8t2f"
Jul 13 16:00:21.113605 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:00:21.113546    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a8faf88f-fa8b-46bd-a183-968a8bc5948f-model-cache\") pod \"test-model-ef5b3f-kserve-98fc9df6c-v8t2f\" (UID: \"a8faf88f-fa8b-46bd-a183-968a8bc5948f\") " pod="ai-tenant-e2e-inf-b-ef5b3f/test-model-ef5b3f-kserve-98fc9df6c-v8t2f"
Jul 13 16:00:21.113605 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:00:21.113598    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a8faf88f-fa8b-46bd-a183-968a8bc5948f-tmp-dir\") pod \"test-model-ef5b3f-kserve-98fc9df6c-v8t2f\" (UID: \"a8faf88f-fa8b-46bd-a183-968a8bc5948f\") " pod="ai-tenant-e2e-inf-b-ef5b3f/test-model-ef5b3f-kserve-98fc9df6c-v8t2f"
Jul 13 16:00:21.113756 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:00:21.113685    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a8faf88f-fa8b-46bd-a183-968a8bc5948f-home\") pod \"test-model-ef5b3f-kserve-98fc9df6c-v8t2f\" (UID: \"a8faf88f-fa8b-46bd-a183-968a8bc5948f\") " pod="ai-tenant-e2e-inf-b-ef5b3f/test-model-ef5b3f-kserve-98fc9df6c-v8t2f"
Jul 13 16:00:21.114005 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:00:21.113978    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a8faf88f-fa8b-46bd-a183-968a8bc5948f-model-cache\") pod \"test-model-ef5b3f-kserve-98fc9df6c-v8t2f\" (UID: \"a8faf88f-fa8b-46bd-a183-968a8bc5948f\") " pod="ai-tenant-e2e-inf-b-ef5b3f/test-model-ef5b3f-kserve-98fc9df6c-v8t2f"
Jul 13 16:00:21.114117 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:00:21.114041    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a8faf88f-fa8b-46bd-a183-968a8bc5948f-tmp-dir\") pod \"test-model-ef5b3f-kserve-98fc9df6c-v8t2f\" (UID: \"a8faf88f-fa8b-46bd-a183-968a8bc5948f\") " pod="ai-tenant-e2e-inf-b-ef5b3f/test-model-ef5b3f-kserve-98fc9df6c-v8t2f"
Jul 13 16:00:21.115663 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:00:21.115636    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a8faf88f-fa8b-46bd-a183-968a8bc5948f-dshm\") pod \"test-model-ef5b3f-kserve-98fc9df6c-v8t2f\" (UID: \"a8faf88f-fa8b-46bd-a183-968a8bc5948f\") " pod="ai-tenant-e2e-inf-b-ef5b3f/test-model-ef5b3f-kserve-98fc9df6c-v8t2f"
Jul 13 16:00:21.116120 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:00:21.116101    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a8faf88f-fa8b-46bd-a183-968a8bc5948f-tls-certs\") pod \"test-model-ef5b3f-kserve-98fc9df6c-v8t2f\" (UID: \"a8faf88f-fa8b-46bd-a183-968a8bc5948f\") " pod="ai-tenant-e2e-inf-b-ef5b3f/test-model-ef5b3f-kserve-98fc9df6c-v8t2f"
Jul 13 16:00:21.121354 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:00:21.121331    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k56tw\" (UniqueName: \"kubernetes.io/projected/a8faf88f-fa8b-46bd-a183-968a8bc5948f-kube-api-access-k56tw\") pod \"test-model-ef5b3f-kserve-98fc9df6c-v8t2f\" (UID: \"a8faf88f-fa8b-46bd-a183-968a8bc5948f\") " pod="ai-tenant-e2e-inf-b-ef5b3f/test-model-ef5b3f-kserve-98fc9df6c-v8t2f"
Jul 13 16:00:21.233844 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:00:21.233744    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-ef5b3f/test-model-ef5b3f-kserve-98fc9df6c-v8t2f"
Jul 13 16:00:21.370979 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:00:21.370953    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-ef5b3f/test-model-ef5b3f-kserve-98fc9df6c-v8t2f"]
Jul 13 16:00:21.372993 ip-10-0-140-255 kubenswrapper[2564]: W0713 16:00:21.372963    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda8faf88f_fa8b_46bd_a183_968a8bc5948f.slice/crio-94531a15c71cb60a5294c90dea018c74d5951ddcc5184e321684e3c60f9c9ca9 WatchSource:0}: Error finding container 94531a15c71cb60a5294c90dea018c74d5951ddcc5184e321684e3c60f9c9ca9: Status 404 returned error can't find the container with id 94531a15c71cb60a5294c90dea018c74d5951ddcc5184e321684e3c60f9c9ca9
Jul 13 16:00:22.133122 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:00:22.133085    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-ef5b3f/test-model-ef5b3f-kserve-98fc9df6c-v8t2f" event={"ID":"a8faf88f-fa8b-46bd-a183-968a8bc5948f","Type":"ContainerStarted","Data":"f05464888bdf352ef469d2690d8e3ddf2e9dbbc6afad9e23ca688e2699596f49"}
Jul 13 16:00:22.133122 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:00:22.133126    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-ef5b3f/test-model-ef5b3f-kserve-98fc9df6c-v8t2f" event={"ID":"a8faf88f-fa8b-46bd-a183-968a8bc5948f","Type":"ContainerStarted","Data":"94531a15c71cb60a5294c90dea018c74d5951ddcc5184e321684e3c60f9c9ca9"}
Jul 13 16:00:22.174032 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:00:22.173965    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-b-ef5b3f/test-model-ef5b3f-kserve-98fc9df6c-v8t2f" podStartSLOduration=2.173948126 podStartE2EDuration="2.173948126s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 16:00:20 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 16:00:22.171900201 +0000 UTC m=+2175.751135383" watchObservedRunningTime="2026-07-13 16:00:22.173948126 +0000 UTC m=+2175.753183331"
Jul 13 16:00:28.963726 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:00:28.963692    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vhzkf"]
Jul 13 16:00:31.234563 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:00:31.234529    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-b-ef5b3f/test-model-ef5b3f-kserve-98fc9df6c-v8t2f"
Jul 13 16:00:31.234563 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:00:31.234573    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-b-ef5b3f/test-model-ef5b3f-kserve-98fc9df6c-v8t2f"
Jul 13 16:00:31.247423 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:00:31.247389    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-b-ef5b3f/test-model-ef5b3f-kserve-98fc9df6c-v8t2f"
Jul 13 16:00:32.194630 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:00:32.194592    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-b-ef5b3f/test-model-ef5b3f-kserve-98fc9df6c-v8t2f"
Jul 13 16:00:43.401362 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:00:43.401323    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-47280f/test-model-47280f-kserve-67559db859-w2ltn"]
Jul 13 16:00:44.345661 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:00:44.345629    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-ef5b3f/test-model-ef5b3f-kserve-98fc9df6c-v8t2f"]
Jul 13 16:00:50.144117 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:00:50.144076    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vhzkf"]
Jul 13 16:00:58.421235 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:00:58.421185    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-inf-a-47280f/test-model-47280f-kserve-67559db859-w2ltn" podUID="7c0c8555-d60b-48bf-93f4-f8ba16572967" containerName="main" containerID="cri-o://3fa343e63fe3dca3e037c30c9221ed5006a3048790a4d63e3f4b5a5fe5ebea93" gracePeriod=45
Jul 13 16:00:58.664671 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:00:58.664644    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-47280f/test-model-47280f-kserve-67559db859-w2ltn"
Jul 13 16:00:58.760268 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:00:58.760174    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8vh6p\" (UniqueName: \"kubernetes.io/projected/7c0c8555-d60b-48bf-93f4-f8ba16572967-kube-api-access-8vh6p\") pod \"7c0c8555-d60b-48bf-93f4-f8ba16572967\" (UID: \"7c0c8555-d60b-48bf-93f4-f8ba16572967\") "
Jul 13 16:00:58.760268 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:00:58.760214    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7c0c8555-d60b-48bf-93f4-f8ba16572967-home\") pod \"7c0c8555-d60b-48bf-93f4-f8ba16572967\" (UID: \"7c0c8555-d60b-48bf-93f4-f8ba16572967\") "
Jul 13 16:00:58.760268 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:00:58.760237    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7c0c8555-d60b-48bf-93f4-f8ba16572967-dshm\") pod \"7c0c8555-d60b-48bf-93f4-f8ba16572967\" (UID: \"7c0c8555-d60b-48bf-93f4-f8ba16572967\") "
Jul 13 16:00:58.760268 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:00:58.760265    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7c0c8555-d60b-48bf-93f4-f8ba16572967-model-cache\") pod \"7c0c8555-d60b-48bf-93f4-f8ba16572967\" (UID: \"7c0c8555-d60b-48bf-93f4-f8ba16572967\") "
Jul 13 16:00:58.760641 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:00:58.760300    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7c0c8555-d60b-48bf-93f4-f8ba16572967-tls-certs\") pod \"7c0c8555-d60b-48bf-93f4-f8ba16572967\" (UID: \"7c0c8555-d60b-48bf-93f4-f8ba16572967\") "
Jul 13 16:00:58.760641 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:00:58.760319    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7c0c8555-d60b-48bf-93f4-f8ba16572967-tmp-dir\") pod \"7c0c8555-d60b-48bf-93f4-f8ba16572967\" (UID: \"7c0c8555-d60b-48bf-93f4-f8ba16572967\") "
Jul 13 16:00:58.760641 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:00:58.760502    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7c0c8555-d60b-48bf-93f4-f8ba16572967-home" (OuterVolumeSpecName: "home") pod "7c0c8555-d60b-48bf-93f4-f8ba16572967" (UID: "7c0c8555-d60b-48bf-93f4-f8ba16572967"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 16:00:58.760641 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:00:58.760598    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7c0c8555-d60b-48bf-93f4-f8ba16572967-model-cache" (OuterVolumeSpecName: "model-cache") pod "7c0c8555-d60b-48bf-93f4-f8ba16572967" (UID: "7c0c8555-d60b-48bf-93f4-f8ba16572967"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 16:00:58.760800 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:00:58.760678    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7c0c8555-d60b-48bf-93f4-f8ba16572967-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "7c0c8555-d60b-48bf-93f4-f8ba16572967" (UID: "7c0c8555-d60b-48bf-93f4-f8ba16572967"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 16:00:58.762493 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:00:58.762469    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7c0c8555-d60b-48bf-93f4-f8ba16572967-dshm" (OuterVolumeSpecName: "dshm") pod "7c0c8555-d60b-48bf-93f4-f8ba16572967" (UID: "7c0c8555-d60b-48bf-93f4-f8ba16572967"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 16:00:58.762606 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:00:58.762494    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7c0c8555-d60b-48bf-93f4-f8ba16572967-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "7c0c8555-d60b-48bf-93f4-f8ba16572967" (UID: "7c0c8555-d60b-48bf-93f4-f8ba16572967"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 13 16:00:58.762606 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:00:58.762586    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7c0c8555-d60b-48bf-93f4-f8ba16572967-kube-api-access-8vh6p" (OuterVolumeSpecName: "kube-api-access-8vh6p") pod "7c0c8555-d60b-48bf-93f4-f8ba16572967" (UID: "7c0c8555-d60b-48bf-93f4-f8ba16572967"). InnerVolumeSpecName "kube-api-access-8vh6p". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 13 16:00:58.861547 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:00:58.861512    2564 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7c0c8555-d60b-48bf-93f4-f8ba16572967-tls-certs\") on node \"ip-10-0-140-255.ec2.internal\" DevicePath \"\""
Jul 13 16:00:58.861547 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:00:58.861539    2564 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7c0c8555-d60b-48bf-93f4-f8ba16572967-tmp-dir\") on node \"ip-10-0-140-255.ec2.internal\" DevicePath \"\""
Jul 13 16:00:58.861547 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:00:58.861548    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8vh6p\" (UniqueName: \"kubernetes.io/projected/7c0c8555-d60b-48bf-93f4-f8ba16572967-kube-api-access-8vh6p\") on node \"ip-10-0-140-255.ec2.internal\" DevicePath \"\""
Jul 13 16:00:58.861547 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:00:58.861557    2564 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7c0c8555-d60b-48bf-93f4-f8ba16572967-home\") on node \"ip-10-0-140-255.ec2.internal\" DevicePath \"\""
Jul 13 16:00:58.861818 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:00:58.861565    2564 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7c0c8555-d60b-48bf-93f4-f8ba16572967-dshm\") on node \"ip-10-0-140-255.ec2.internal\" DevicePath \"\""
Jul 13 16:00:58.861818 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:00:58.861573    2564 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7c0c8555-d60b-48bf-93f4-f8ba16572967-model-cache\") on node \"ip-10-0-140-255.ec2.internal\" DevicePath \"\""
Jul 13 16:00:59.326618 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:00:59.326583    2564 generic.go:356] "Generic (PLEG): container finished" podID="7c0c8555-d60b-48bf-93f4-f8ba16572967" containerID="3fa343e63fe3dca3e037c30c9221ed5006a3048790a4d63e3f4b5a5fe5ebea93" exitCode=0
Jul 13 16:00:59.326815 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:00:59.326639    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-47280f/test-model-47280f-kserve-67559db859-w2ltn" event={"ID":"7c0c8555-d60b-48bf-93f4-f8ba16572967","Type":"ContainerDied","Data":"3fa343e63fe3dca3e037c30c9221ed5006a3048790a4d63e3f4b5a5fe5ebea93"}
Jul 13 16:00:59.326815 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:00:59.326653    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-47280f/test-model-47280f-kserve-67559db859-w2ltn"
Jul 13 16:00:59.326815 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:00:59.326672    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-47280f/test-model-47280f-kserve-67559db859-w2ltn" event={"ID":"7c0c8555-d60b-48bf-93f4-f8ba16572967","Type":"ContainerDied","Data":"cea1a3874b517853355182df6694363e1bf80ad922129dc909e985a922d5273c"}
Jul 13 16:00:59.326815 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:00:59.326688    2564 scope.go:117] "RemoveContainer" containerID="3fa343e63fe3dca3e037c30c9221ed5006a3048790a4d63e3f4b5a5fe5ebea93"
Jul 13 16:00:59.335456 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:00:59.335436    2564 scope.go:117] "RemoveContainer" containerID="3fa343e63fe3dca3e037c30c9221ed5006a3048790a4d63e3f4b5a5fe5ebea93"
Jul 13 16:00:59.335741 ip-10-0-140-255 kubenswrapper[2564]: E0713 16:00:59.335723    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3fa343e63fe3dca3e037c30c9221ed5006a3048790a4d63e3f4b5a5fe5ebea93\": container with ID starting with 3fa343e63fe3dca3e037c30c9221ed5006a3048790a4d63e3f4b5a5fe5ebea93 not found: ID does not exist" containerID="3fa343e63fe3dca3e037c30c9221ed5006a3048790a4d63e3f4b5a5fe5ebea93"
Jul 13 16:00:59.335905 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:00:59.335749    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3fa343e63fe3dca3e037c30c9221ed5006a3048790a4d63e3f4b5a5fe5ebea93"} err="failed to get container status \"3fa343e63fe3dca3e037c30c9221ed5006a3048790a4d63e3f4b5a5fe5ebea93\": rpc error: code = NotFound desc = could not find container \"3fa343e63fe3dca3e037c30c9221ed5006a3048790a4d63e3f4b5a5fe5ebea93\": container with ID starting with 3fa343e63fe3dca3e037c30c9221ed5006a3048790a4d63e3f4b5a5fe5ebea93 not found: ID does not exist"
Jul 13 16:00:59.350054 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:00:59.350025    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-47280f/test-model-47280f-kserve-67559db859-w2ltn"]
Jul 13 16:00:59.354317 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:00:59.354288    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-a-47280f/test-model-47280f-kserve-67559db859-w2ltn"]
Jul 13 16:00:59.366295 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:00:59.366260    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-inf-b-ef5b3f/test-model-ef5b3f-kserve-98fc9df6c-v8t2f" podUID="a8faf88f-fa8b-46bd-a183-968a8bc5948f" containerName="main" containerID="cri-o://f05464888bdf352ef469d2690d8e3ddf2e9dbbc6afad9e23ca688e2699596f49" gracePeriod=45
Jul 13 16:00:59.621445 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:00:59.621415    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-ef5b3f/test-model-ef5b3f-kserve-98fc9df6c-v8t2f"
Jul 13 16:00:59.669480 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:00:59.669445    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a8faf88f-fa8b-46bd-a183-968a8bc5948f-dshm\") pod \"a8faf88f-fa8b-46bd-a183-968a8bc5948f\" (UID: \"a8faf88f-fa8b-46bd-a183-968a8bc5948f\") "
Jul 13 16:00:59.669674 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:00:59.669496    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-k56tw\" (UniqueName: \"kubernetes.io/projected/a8faf88f-fa8b-46bd-a183-968a8bc5948f-kube-api-access-k56tw\") pod \"a8faf88f-fa8b-46bd-a183-968a8bc5948f\" (UID: \"a8faf88f-fa8b-46bd-a183-968a8bc5948f\") "
Jul 13 16:00:59.669674 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:00:59.669527    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a8faf88f-fa8b-46bd-a183-968a8bc5948f-model-cache\") pod \"a8faf88f-fa8b-46bd-a183-968a8bc5948f\" (UID: \"a8faf88f-fa8b-46bd-a183-968a8bc5948f\") "
Jul 13 16:00:59.669674 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:00:59.669607    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a8faf88f-fa8b-46bd-a183-968a8bc5948f-home\") pod \"a8faf88f-fa8b-46bd-a183-968a8bc5948f\" (UID: \"a8faf88f-fa8b-46bd-a183-968a8bc5948f\") "
Jul 13 16:00:59.669674 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:00:59.669643    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a8faf88f-fa8b-46bd-a183-968a8bc5948f-tls-certs\") pod \"a8faf88f-fa8b-46bd-a183-968a8bc5948f\" (UID: \"a8faf88f-fa8b-46bd-a183-968a8bc5948f\") "
Jul 13 16:00:59.669674 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:00:59.669675    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a8faf88f-fa8b-46bd-a183-968a8bc5948f-tmp-dir\") pod \"a8faf88f-fa8b-46bd-a183-968a8bc5948f\" (UID: \"a8faf88f-fa8b-46bd-a183-968a8bc5948f\") "
Jul 13 16:00:59.669978 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:00:59.669929    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a8faf88f-fa8b-46bd-a183-968a8bc5948f-model-cache" (OuterVolumeSpecName: "model-cache") pod "a8faf88f-fa8b-46bd-a183-968a8bc5948f" (UID: "a8faf88f-fa8b-46bd-a183-968a8bc5948f"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 16:00:59.669978 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:00:59.669943    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a8faf88f-fa8b-46bd-a183-968a8bc5948f-home" (OuterVolumeSpecName: "home") pod "a8faf88f-fa8b-46bd-a183-968a8bc5948f" (UID: "a8faf88f-fa8b-46bd-a183-968a8bc5948f"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 16:00:59.670145 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:00:59.670121    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a8faf88f-fa8b-46bd-a183-968a8bc5948f-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "a8faf88f-fa8b-46bd-a183-968a8bc5948f" (UID: "a8faf88f-fa8b-46bd-a183-968a8bc5948f"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 16:00:59.671980 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:00:59.671955    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a8faf88f-fa8b-46bd-a183-968a8bc5948f-dshm" (OuterVolumeSpecName: "dshm") pod "a8faf88f-fa8b-46bd-a183-968a8bc5948f" (UID: "a8faf88f-fa8b-46bd-a183-968a8bc5948f"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 16:00:59.671980 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:00:59.671955    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a8faf88f-fa8b-46bd-a183-968a8bc5948f-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "a8faf88f-fa8b-46bd-a183-968a8bc5948f" (UID: "a8faf88f-fa8b-46bd-a183-968a8bc5948f"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 13 16:00:59.672117 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:00:59.671990    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a8faf88f-fa8b-46bd-a183-968a8bc5948f-kube-api-access-k56tw" (OuterVolumeSpecName: "kube-api-access-k56tw") pod "a8faf88f-fa8b-46bd-a183-968a8bc5948f" (UID: "a8faf88f-fa8b-46bd-a183-968a8bc5948f"). InnerVolumeSpecName "kube-api-access-k56tw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 13 16:00:59.771219 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:00:59.771129    2564 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a8faf88f-fa8b-46bd-a183-968a8bc5948f-dshm\") on node \"ip-10-0-140-255.ec2.internal\" DevicePath \"\""
Jul 13 16:00:59.771219 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:00:59.771159    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-k56tw\" (UniqueName: \"kubernetes.io/projected/a8faf88f-fa8b-46bd-a183-968a8bc5948f-kube-api-access-k56tw\") on node \"ip-10-0-140-255.ec2.internal\" DevicePath \"\""
Jul 13 16:00:59.771219 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:00:59.771170    2564 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a8faf88f-fa8b-46bd-a183-968a8bc5948f-model-cache\") on node \"ip-10-0-140-255.ec2.internal\" DevicePath \"\""
Jul 13 16:00:59.771219 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:00:59.771178    2564 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a8faf88f-fa8b-46bd-a183-968a8bc5948f-home\") on node \"ip-10-0-140-255.ec2.internal\" DevicePath \"\""
Jul 13 16:00:59.771219 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:00:59.771186    2564 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a8faf88f-fa8b-46bd-a183-968a8bc5948f-tls-certs\") on node \"ip-10-0-140-255.ec2.internal\" DevicePath \"\""
Jul 13 16:00:59.771219 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:00:59.771192    2564 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a8faf88f-fa8b-46bd-a183-968a8bc5948f-tmp-dir\") on node \"ip-10-0-140-255.ec2.internal\" DevicePath \"\""
Jul 13 16:01:00.334364 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:01:00.334330    2564 generic.go:356] "Generic (PLEG): container finished" podID="a8faf88f-fa8b-46bd-a183-968a8bc5948f" containerID="f05464888bdf352ef469d2690d8e3ddf2e9dbbc6afad9e23ca688e2699596f49" exitCode=0
Jul 13 16:01:00.334535 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:01:00.334429    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-ef5b3f/test-model-ef5b3f-kserve-98fc9df6c-v8t2f"
Jul 13 16:01:00.334535 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:01:00.334458    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-ef5b3f/test-model-ef5b3f-kserve-98fc9df6c-v8t2f" event={"ID":"a8faf88f-fa8b-46bd-a183-968a8bc5948f","Type":"ContainerDied","Data":"f05464888bdf352ef469d2690d8e3ddf2e9dbbc6afad9e23ca688e2699596f49"}
Jul 13 16:01:00.334535 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:01:00.334488    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-ef5b3f/test-model-ef5b3f-kserve-98fc9df6c-v8t2f" event={"ID":"a8faf88f-fa8b-46bd-a183-968a8bc5948f","Type":"ContainerDied","Data":"94531a15c71cb60a5294c90dea018c74d5951ddcc5184e321684e3c60f9c9ca9"}
Jul 13 16:01:00.334535 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:01:00.334504    2564 scope.go:117] "RemoveContainer" containerID="f05464888bdf352ef469d2690d8e3ddf2e9dbbc6afad9e23ca688e2699596f49"
Jul 13 16:01:00.343422 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:01:00.343402    2564 scope.go:117] "RemoveContainer" containerID="f05464888bdf352ef469d2690d8e3ddf2e9dbbc6afad9e23ca688e2699596f49"
Jul 13 16:01:00.343679 ip-10-0-140-255 kubenswrapper[2564]: E0713 16:01:00.343660    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f05464888bdf352ef469d2690d8e3ddf2e9dbbc6afad9e23ca688e2699596f49\": container with ID starting with f05464888bdf352ef469d2690d8e3ddf2e9dbbc6afad9e23ca688e2699596f49 not found: ID does not exist" containerID="f05464888bdf352ef469d2690d8e3ddf2e9dbbc6afad9e23ca688e2699596f49"
Jul 13 16:01:00.343741 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:01:00.343692    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f05464888bdf352ef469d2690d8e3ddf2e9dbbc6afad9e23ca688e2699596f49"} err="failed to get container status \"f05464888bdf352ef469d2690d8e3ddf2e9dbbc6afad9e23ca688e2699596f49\": rpc error: code = NotFound desc = could not find container \"f05464888bdf352ef469d2690d8e3ddf2e9dbbc6afad9e23ca688e2699596f49\": container with ID starting with f05464888bdf352ef469d2690d8e3ddf2e9dbbc6afad9e23ca688e2699596f49 not found: ID does not exist"
Jul 13 16:01:00.356253 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:01:00.356221    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-ef5b3f/test-model-ef5b3f-kserve-98fc9df6c-v8t2f"]
Jul 13 16:01:00.360485 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:01:00.360463    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-b-ef5b3f/test-model-ef5b3f-kserve-98fc9df6c-v8t2f"]
Jul 13 16:01:01.120912 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:01:01.120860    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7c0c8555-d60b-48bf-93f4-f8ba16572967" path="/var/lib/kubelet/pods/7c0c8555-d60b-48bf-93f4-f8ba16572967/volumes"
Jul 13 16:01:01.121301 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:01:01.121289    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a8faf88f-fa8b-46bd-a183-968a8bc5948f" path="/var/lib/kubelet/pods/a8faf88f-fa8b-46bd-a183-968a8bc5948f/volumes"
Jul 13 16:01:01.448862 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:01:01.448826    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vhzkf"]
Jul 13 16:01:24.748625 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:01:24.748583    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vhzkf"]
Jul 13 16:01:45.335550 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:01:45.335514    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vhzkf"]
Jul 13 16:02:00.640393 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:02:00.640358    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vhzkf"]
Jul 13 16:02:17.245513 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:02:17.245476    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vhzkf"]
Jul 13 16:02:40.739630 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:02:40.739589    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vhzkf"]
Jul 13 16:03:01.044051 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:03:01.043975    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vhzkf"]
Jul 13 16:03:12.533836 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:03:12.533797    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vhzkf"]
Jul 13 16:03:36.034233 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:03:36.034193    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-a1c3e5/auth-test-model-a1c3e5-kserve-795ff76bdc-5ss75"]
Jul 13 16:03:36.034711 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:03:36.034686    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7c0c8555-d60b-48bf-93f4-f8ba16572967" containerName="main"
Jul 13 16:03:36.034711 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:03:36.034703    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="7c0c8555-d60b-48bf-93f4-f8ba16572967" containerName="main"
Jul 13 16:03:36.034837 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:03:36.034746    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a8faf88f-fa8b-46bd-a183-968a8bc5948f" containerName="main"
Jul 13 16:03:36.034837 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:03:36.034755    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="a8faf88f-fa8b-46bd-a183-968a8bc5948f" containerName="main"
Jul 13 16:03:36.034979 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:03:36.034836    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="7c0c8555-d60b-48bf-93f4-f8ba16572967" containerName="main"
Jul 13 16:03:36.034979 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:03:36.034850    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="a8faf88f-fa8b-46bd-a183-968a8bc5948f" containerName="main"
Jul 13 16:03:36.037751 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:03:36.037732    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-a1c3e5/auth-test-model-a1c3e5-kserve-795ff76bdc-5ss75"
Jul 13 16:03:36.041120 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:03:36.041097    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-a1c3e5\"/\"default-dockercfg-gmfbl\""
Jul 13 16:03:36.041259 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:03:36.041144    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-a1c3e5\"/\"openshift-service-ca.crt\""
Jul 13 16:03:36.041259 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:03:36.041144    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-a1c3e5\"/\"auth-test-model-a1c3e5-kserve-self-signed-certs\""
Jul 13 16:03:36.041259 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:03:36.041177    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-a1c3e5\"/\"kube-root-ca.crt\""
Jul 13 16:03:36.046732 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:03:36.046699    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-a1c3e5/auth-test-model-a1c3e5-kserve-795ff76bdc-5ss75"]
Jul 13 16:03:36.184227 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:03:36.184192    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d1dfa6bc-6a21-470f-a6b0-9635dfa07a83-home\") pod \"auth-test-model-a1c3e5-kserve-795ff76bdc-5ss75\" (UID: \"d1dfa6bc-6a21-470f-a6b0-9635dfa07a83\") " pod="ai-tenant-e2e-shared-a-a1c3e5/auth-test-model-a1c3e5-kserve-795ff76bdc-5ss75"
Jul 13 16:03:36.184440 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:03:36.184243    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d1dfa6bc-6a21-470f-a6b0-9635dfa07a83-dshm\") pod \"auth-test-model-a1c3e5-kserve-795ff76bdc-5ss75\" (UID: \"d1dfa6bc-6a21-470f-a6b0-9635dfa07a83\") " pod="ai-tenant-e2e-shared-a-a1c3e5/auth-test-model-a1c3e5-kserve-795ff76bdc-5ss75"
Jul 13 16:03:36.184440 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:03:36.184335    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d1dfa6bc-6a21-470f-a6b0-9635dfa07a83-tmp-dir\") pod \"auth-test-model-a1c3e5-kserve-795ff76bdc-5ss75\" (UID: \"d1dfa6bc-6a21-470f-a6b0-9635dfa07a83\") " pod="ai-tenant-e2e-shared-a-a1c3e5/auth-test-model-a1c3e5-kserve-795ff76bdc-5ss75"
Jul 13 16:03:36.184440 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:03:36.184406    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d1dfa6bc-6a21-470f-a6b0-9635dfa07a83-model-cache\") pod \"auth-test-model-a1c3e5-kserve-795ff76bdc-5ss75\" (UID: \"d1dfa6bc-6a21-470f-a6b0-9635dfa07a83\") " pod="ai-tenant-e2e-shared-a-a1c3e5/auth-test-model-a1c3e5-kserve-795ff76bdc-5ss75"
Jul 13 16:03:36.184440 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:03:36.184432    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lhdq6\" (UniqueName: \"kubernetes.io/projected/d1dfa6bc-6a21-470f-a6b0-9635dfa07a83-kube-api-access-lhdq6\") pod \"auth-test-model-a1c3e5-kserve-795ff76bdc-5ss75\" (UID: \"d1dfa6bc-6a21-470f-a6b0-9635dfa07a83\") " pod="ai-tenant-e2e-shared-a-a1c3e5/auth-test-model-a1c3e5-kserve-795ff76bdc-5ss75"
Jul 13 16:03:36.184663 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:03:36.184463    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d1dfa6bc-6a21-470f-a6b0-9635dfa07a83-tls-certs\") pod \"auth-test-model-a1c3e5-kserve-795ff76bdc-5ss75\" (UID: \"d1dfa6bc-6a21-470f-a6b0-9635dfa07a83\") " pod="ai-tenant-e2e-shared-a-a1c3e5/auth-test-model-a1c3e5-kserve-795ff76bdc-5ss75"
Jul 13 16:03:36.285158 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:03:36.285058    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d1dfa6bc-6a21-470f-a6b0-9635dfa07a83-tmp-dir\") pod \"auth-test-model-a1c3e5-kserve-795ff76bdc-5ss75\" (UID: \"d1dfa6bc-6a21-470f-a6b0-9635dfa07a83\") " pod="ai-tenant-e2e-shared-a-a1c3e5/auth-test-model-a1c3e5-kserve-795ff76bdc-5ss75"
Jul 13 16:03:36.285158 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:03:36.285107    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d1dfa6bc-6a21-470f-a6b0-9635dfa07a83-model-cache\") pod \"auth-test-model-a1c3e5-kserve-795ff76bdc-5ss75\" (UID: \"d1dfa6bc-6a21-470f-a6b0-9635dfa07a83\") " pod="ai-tenant-e2e-shared-a-a1c3e5/auth-test-model-a1c3e5-kserve-795ff76bdc-5ss75"
Jul 13 16:03:36.285158 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:03:36.285126    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lhdq6\" (UniqueName: \"kubernetes.io/projected/d1dfa6bc-6a21-470f-a6b0-9635dfa07a83-kube-api-access-lhdq6\") pod \"auth-test-model-a1c3e5-kserve-795ff76bdc-5ss75\" (UID: \"d1dfa6bc-6a21-470f-a6b0-9635dfa07a83\") " pod="ai-tenant-e2e-shared-a-a1c3e5/auth-test-model-a1c3e5-kserve-795ff76bdc-5ss75"
Jul 13 16:03:36.285158 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:03:36.285146    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d1dfa6bc-6a21-470f-a6b0-9635dfa07a83-tls-certs\") pod \"auth-test-model-a1c3e5-kserve-795ff76bdc-5ss75\" (UID: \"d1dfa6bc-6a21-470f-a6b0-9635dfa07a83\") " pod="ai-tenant-e2e-shared-a-a1c3e5/auth-test-model-a1c3e5-kserve-795ff76bdc-5ss75"
Jul 13 16:03:36.285509 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:03:36.285273    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d1dfa6bc-6a21-470f-a6b0-9635dfa07a83-home\") pod \"auth-test-model-a1c3e5-kserve-795ff76bdc-5ss75\" (UID: \"d1dfa6bc-6a21-470f-a6b0-9635dfa07a83\") " pod="ai-tenant-e2e-shared-a-a1c3e5/auth-test-model-a1c3e5-kserve-795ff76bdc-5ss75"
Jul 13 16:03:36.285509 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:03:36.285356    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d1dfa6bc-6a21-470f-a6b0-9635dfa07a83-dshm\") pod \"auth-test-model-a1c3e5-kserve-795ff76bdc-5ss75\" (UID: \"d1dfa6bc-6a21-470f-a6b0-9635dfa07a83\") " pod="ai-tenant-e2e-shared-a-a1c3e5/auth-test-model-a1c3e5-kserve-795ff76bdc-5ss75"
Jul 13 16:03:36.285615 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:03:36.285567    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d1dfa6bc-6a21-470f-a6b0-9635dfa07a83-model-cache\") pod \"auth-test-model-a1c3e5-kserve-795ff76bdc-5ss75\" (UID: \"d1dfa6bc-6a21-470f-a6b0-9635dfa07a83\") " pod="ai-tenant-e2e-shared-a-a1c3e5/auth-test-model-a1c3e5-kserve-795ff76bdc-5ss75"
Jul 13 16:03:36.285615 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:03:36.285601    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d1dfa6bc-6a21-470f-a6b0-9635dfa07a83-tmp-dir\") pod \"auth-test-model-a1c3e5-kserve-795ff76bdc-5ss75\" (UID: \"d1dfa6bc-6a21-470f-a6b0-9635dfa07a83\") " pod="ai-tenant-e2e-shared-a-a1c3e5/auth-test-model-a1c3e5-kserve-795ff76bdc-5ss75"
Jul 13 16:03:36.285690 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:03:36.285613    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d1dfa6bc-6a21-470f-a6b0-9635dfa07a83-home\") pod \"auth-test-model-a1c3e5-kserve-795ff76bdc-5ss75\" (UID: \"d1dfa6bc-6a21-470f-a6b0-9635dfa07a83\") " pod="ai-tenant-e2e-shared-a-a1c3e5/auth-test-model-a1c3e5-kserve-795ff76bdc-5ss75"
Jul 13 16:03:36.287449 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:03:36.287422    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d1dfa6bc-6a21-470f-a6b0-9635dfa07a83-dshm\") pod \"auth-test-model-a1c3e5-kserve-795ff76bdc-5ss75\" (UID: \"d1dfa6bc-6a21-470f-a6b0-9635dfa07a83\") " pod="ai-tenant-e2e-shared-a-a1c3e5/auth-test-model-a1c3e5-kserve-795ff76bdc-5ss75"
Jul 13 16:03:36.287611 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:03:36.287595    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d1dfa6bc-6a21-470f-a6b0-9635dfa07a83-tls-certs\") pod \"auth-test-model-a1c3e5-kserve-795ff76bdc-5ss75\" (UID: \"d1dfa6bc-6a21-470f-a6b0-9635dfa07a83\") " pod="ai-tenant-e2e-shared-a-a1c3e5/auth-test-model-a1c3e5-kserve-795ff76bdc-5ss75"
Jul 13 16:03:36.293609 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:03:36.293588    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lhdq6\" (UniqueName: \"kubernetes.io/projected/d1dfa6bc-6a21-470f-a6b0-9635dfa07a83-kube-api-access-lhdq6\") pod \"auth-test-model-a1c3e5-kserve-795ff76bdc-5ss75\" (UID: \"d1dfa6bc-6a21-470f-a6b0-9635dfa07a83\") " pod="ai-tenant-e2e-shared-a-a1c3e5/auth-test-model-a1c3e5-kserve-795ff76bdc-5ss75"
Jul 13 16:03:36.347531 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:03:36.347482    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-a1c3e5/auth-test-model-a1c3e5-kserve-795ff76bdc-5ss75"
Jul 13 16:03:36.480620 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:03:36.480595    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-a1c3e5/auth-test-model-a1c3e5-kserve-795ff76bdc-5ss75"]
Jul 13 16:03:36.482401 ip-10-0-140-255 kubenswrapper[2564]: W0713 16:03:36.482370    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd1dfa6bc_6a21_470f_a6b0_9635dfa07a83.slice/crio-42bc7a84eadb5c1a4061608e13faaf9671b6158ffc009514fd0e52fd07084486 WatchSource:0}: Error finding container 42bc7a84eadb5c1a4061608e13faaf9671b6158ffc009514fd0e52fd07084486: Status 404 returned error can't find the container with id 42bc7a84eadb5c1a4061608e13faaf9671b6158ffc009514fd0e52fd07084486
Jul 13 16:03:37.151316 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:03:37.151286    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-a1c3e5/auth-test-model-a1c3e5-kserve-795ff76bdc-5ss75" event={"ID":"d1dfa6bc-6a21-470f-a6b0-9635dfa07a83","Type":"ContainerStarted","Data":"8d89177df625200bfd0c8fe40a40bc06e0df563fa7cc7c8bd5c8c1bd2d31a5ef"}
Jul 13 16:03:37.151316 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:03:37.151324    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-a1c3e5/auth-test-model-a1c3e5-kserve-795ff76bdc-5ss75" event={"ID":"d1dfa6bc-6a21-470f-a6b0-9635dfa07a83","Type":"ContainerStarted","Data":"42bc7a84eadb5c1a4061608e13faaf9671b6158ffc009514fd0e52fd07084486"}
Jul 13 16:03:37.169924 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:03:37.169838    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-a1c3e5/auth-test-model-a1c3e5-kserve-795ff76bdc-5ss75" podStartSLOduration=1.169820917 podStartE2EDuration="1.169820917s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 16:03:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 16:03:37.169493198 +0000 UTC m=+2370.748728377" watchObservedRunningTime="2026-07-13 16:03:37.169820917 +0000 UTC m=+2370.749056097"
Jul 13 16:03:39.532597 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:03:39.532560    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vhzkf"]
Jul 13 16:03:46.348556 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:03:46.348511    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-a1c3e5/auth-test-model-a1c3e5-kserve-795ff76bdc-5ss75"
Jul 13 16:03:46.349185 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:03:46.348579    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-a1c3e5/auth-test-model-a1c3e5-kserve-795ff76bdc-5ss75"
Jul 13 16:03:46.361227 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:03:46.361199    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-a1c3e5/auth-test-model-a1c3e5-kserve-795ff76bdc-5ss75"
Jul 13 16:03:47.219219 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:03:47.219183    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-a1c3e5/auth-test-model-a1c3e5-kserve-795ff76bdc-5ss75"
Jul 13 16:04:07.108942 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:04:07.108912    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9dq6z_258b7ae3-adf5-437a-8f8e-71bdd1cc665b/ovn-acl-logging/0.log"
Jul 13 16:04:07.119497 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:04:07.119475    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9dq6z_258b7ae3-adf5-437a-8f8e-71bdd1cc665b/ovn-acl-logging/0.log"
Jul 13 16:04:15.034421 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:04:15.034386    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-4293a7/auth-test-model-4293a7-kserve-5754678467-xnbdm"]
Jul 13 16:04:15.037634 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:04:15.037618    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-4293a7/auth-test-model-4293a7-kserve-5754678467-xnbdm"
Jul 13 16:04:15.041044 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:04:15.040912    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-4293a7\"/\"openshift-service-ca.crt\""
Jul 13 16:04:15.041044 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:04:15.040983    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-4293a7\"/\"default-dockercfg-fb786\""
Jul 13 16:04:15.041303 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:04:15.041079    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-4293a7\"/\"kube-root-ca.crt\""
Jul 13 16:04:15.041303 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:04:15.041104    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-4293a7\"/\"auth-test-model-4293a7-kserve-self-signed-certs\""
Jul 13 16:04:15.047582 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:04:15.047560    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-4293a7/auth-test-model-4293a7-kserve-5754678467-xnbdm"]
Jul 13 16:04:15.114596 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:04:15.114560    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ad39de89-555d-4550-a6c6-596fc35e4163-tmp-dir\") pod \"auth-test-model-4293a7-kserve-5754678467-xnbdm\" (UID: \"ad39de89-555d-4550-a6c6-596fc35e4163\") " pod="ai-tenant-e2e-shared-b-4293a7/auth-test-model-4293a7-kserve-5754678467-xnbdm"
Jul 13 16:04:15.114596 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:04:15.114595    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ad39de89-555d-4550-a6c6-596fc35e4163-tls-certs\") pod \"auth-test-model-4293a7-kserve-5754678467-xnbdm\" (UID: \"ad39de89-555d-4550-a6c6-596fc35e4163\") " pod="ai-tenant-e2e-shared-b-4293a7/auth-test-model-4293a7-kserve-5754678467-xnbdm"
Jul 13 16:04:15.114845 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:04:15.114654    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ad39de89-555d-4550-a6c6-596fc35e4163-home\") pod \"auth-test-model-4293a7-kserve-5754678467-xnbdm\" (UID: \"ad39de89-555d-4550-a6c6-596fc35e4163\") " pod="ai-tenant-e2e-shared-b-4293a7/auth-test-model-4293a7-kserve-5754678467-xnbdm"
Jul 13 16:04:15.114845 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:04:15.114741    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-526dj\" (UniqueName: \"kubernetes.io/projected/ad39de89-555d-4550-a6c6-596fc35e4163-kube-api-access-526dj\") pod \"auth-test-model-4293a7-kserve-5754678467-xnbdm\" (UID: \"ad39de89-555d-4550-a6c6-596fc35e4163\") " pod="ai-tenant-e2e-shared-b-4293a7/auth-test-model-4293a7-kserve-5754678467-xnbdm"
Jul 13 16:04:15.114845 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:04:15.114826    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ad39de89-555d-4550-a6c6-596fc35e4163-model-cache\") pod \"auth-test-model-4293a7-kserve-5754678467-xnbdm\" (UID: \"ad39de89-555d-4550-a6c6-596fc35e4163\") " pod="ai-tenant-e2e-shared-b-4293a7/auth-test-model-4293a7-kserve-5754678467-xnbdm"
Jul 13 16:04:15.115005 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:04:15.114857    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ad39de89-555d-4550-a6c6-596fc35e4163-dshm\") pod \"auth-test-model-4293a7-kserve-5754678467-xnbdm\" (UID: \"ad39de89-555d-4550-a6c6-596fc35e4163\") " pod="ai-tenant-e2e-shared-b-4293a7/auth-test-model-4293a7-kserve-5754678467-xnbdm"
Jul 13 16:04:15.215969 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:04:15.215933    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ad39de89-555d-4550-a6c6-596fc35e4163-dshm\") pod \"auth-test-model-4293a7-kserve-5754678467-xnbdm\" (UID: \"ad39de89-555d-4550-a6c6-596fc35e4163\") " pod="ai-tenant-e2e-shared-b-4293a7/auth-test-model-4293a7-kserve-5754678467-xnbdm"
Jul 13 16:04:15.215969 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:04:15.215974    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ad39de89-555d-4550-a6c6-596fc35e4163-tmp-dir\") pod \"auth-test-model-4293a7-kserve-5754678467-xnbdm\" (UID: \"ad39de89-555d-4550-a6c6-596fc35e4163\") " pod="ai-tenant-e2e-shared-b-4293a7/auth-test-model-4293a7-kserve-5754678467-xnbdm"
Jul 13 16:04:15.216181 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:04:15.215990    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ad39de89-555d-4550-a6c6-596fc35e4163-tls-certs\") pod \"auth-test-model-4293a7-kserve-5754678467-xnbdm\" (UID: \"ad39de89-555d-4550-a6c6-596fc35e4163\") " pod="ai-tenant-e2e-shared-b-4293a7/auth-test-model-4293a7-kserve-5754678467-xnbdm"
Jul 13 16:04:15.216181 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:04:15.216109    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ad39de89-555d-4550-a6c6-596fc35e4163-home\") pod \"auth-test-model-4293a7-kserve-5754678467-xnbdm\" (UID: \"ad39de89-555d-4550-a6c6-596fc35e4163\") " pod="ai-tenant-e2e-shared-b-4293a7/auth-test-model-4293a7-kserve-5754678467-xnbdm"
Jul 13 16:04:15.216295 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:04:15.216191    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-526dj\" (UniqueName: \"kubernetes.io/projected/ad39de89-555d-4550-a6c6-596fc35e4163-kube-api-access-526dj\") pod \"auth-test-model-4293a7-kserve-5754678467-xnbdm\" (UID: \"ad39de89-555d-4550-a6c6-596fc35e4163\") " pod="ai-tenant-e2e-shared-b-4293a7/auth-test-model-4293a7-kserve-5754678467-xnbdm"
Jul 13 16:04:15.216295 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:04:15.216262    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ad39de89-555d-4550-a6c6-596fc35e4163-model-cache\") pod \"auth-test-model-4293a7-kserve-5754678467-xnbdm\" (UID: \"ad39de89-555d-4550-a6c6-596fc35e4163\") " pod="ai-tenant-e2e-shared-b-4293a7/auth-test-model-4293a7-kserve-5754678467-xnbdm"
Jul 13 16:04:15.216495 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:04:15.216468    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ad39de89-555d-4550-a6c6-596fc35e4163-tmp-dir\") pod \"auth-test-model-4293a7-kserve-5754678467-xnbdm\" (UID: \"ad39de89-555d-4550-a6c6-596fc35e4163\") " pod="ai-tenant-e2e-shared-b-4293a7/auth-test-model-4293a7-kserve-5754678467-xnbdm"
Jul 13 16:04:15.216615 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:04:15.216528    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ad39de89-555d-4550-a6c6-596fc35e4163-home\") pod \"auth-test-model-4293a7-kserve-5754678467-xnbdm\" (UID: \"ad39de89-555d-4550-a6c6-596fc35e4163\") " pod="ai-tenant-e2e-shared-b-4293a7/auth-test-model-4293a7-kserve-5754678467-xnbdm"
Jul 13 16:04:15.216615 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:04:15.216585    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ad39de89-555d-4550-a6c6-596fc35e4163-model-cache\") pod \"auth-test-model-4293a7-kserve-5754678467-xnbdm\" (UID: \"ad39de89-555d-4550-a6c6-596fc35e4163\") " pod="ai-tenant-e2e-shared-b-4293a7/auth-test-model-4293a7-kserve-5754678467-xnbdm"
Jul 13 16:04:15.218370 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:04:15.218334    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ad39de89-555d-4550-a6c6-596fc35e4163-dshm\") pod \"auth-test-model-4293a7-kserve-5754678467-xnbdm\" (UID: \"ad39de89-555d-4550-a6c6-596fc35e4163\") " pod="ai-tenant-e2e-shared-b-4293a7/auth-test-model-4293a7-kserve-5754678467-xnbdm"
Jul 13 16:04:15.218497 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:04:15.218480    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ad39de89-555d-4550-a6c6-596fc35e4163-tls-certs\") pod \"auth-test-model-4293a7-kserve-5754678467-xnbdm\" (UID: \"ad39de89-555d-4550-a6c6-596fc35e4163\") " pod="ai-tenant-e2e-shared-b-4293a7/auth-test-model-4293a7-kserve-5754678467-xnbdm"
Jul 13 16:04:15.224162 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:04:15.224137    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-526dj\" (UniqueName: \"kubernetes.io/projected/ad39de89-555d-4550-a6c6-596fc35e4163-kube-api-access-526dj\") pod \"auth-test-model-4293a7-kserve-5754678467-xnbdm\" (UID: \"ad39de89-555d-4550-a6c6-596fc35e4163\") " pod="ai-tenant-e2e-shared-b-4293a7/auth-test-model-4293a7-kserve-5754678467-xnbdm"
Jul 13 16:04:15.346650 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:04:15.346558    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-4293a7/auth-test-model-4293a7-kserve-5754678467-xnbdm"
Jul 13 16:04:15.484517 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:04:15.484492    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-4293a7/auth-test-model-4293a7-kserve-5754678467-xnbdm"]
Jul 13 16:04:15.486320 ip-10-0-140-255 kubenswrapper[2564]: W0713 16:04:15.486290    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podad39de89_555d_4550_a6c6_596fc35e4163.slice/crio-dea350bae26d060676114ed2fc29698a7525fa0d3af48ae3a39038e51ba84c27 WatchSource:0}: Error finding container dea350bae26d060676114ed2fc29698a7525fa0d3af48ae3a39038e51ba84c27: Status 404 returned error can't find the container with id dea350bae26d060676114ed2fc29698a7525fa0d3af48ae3a39038e51ba84c27
Jul 13 16:04:16.357251 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:04:16.357206    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-4293a7/auth-test-model-4293a7-kserve-5754678467-xnbdm" event={"ID":"ad39de89-555d-4550-a6c6-596fc35e4163","Type":"ContainerStarted","Data":"bfba773cbc6161b532814c40f28c6ac7fb891d3f47c0d70b82f484c1d925c933"}
Jul 13 16:04:16.357666 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:04:16.357263    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-4293a7/auth-test-model-4293a7-kserve-5754678467-xnbdm" event={"ID":"ad39de89-555d-4550-a6c6-596fc35e4163","Type":"ContainerStarted","Data":"dea350bae26d060676114ed2fc29698a7525fa0d3af48ae3a39038e51ba84c27"}
Jul 13 16:04:16.374486 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:04:16.374441    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-4293a7/auth-test-model-4293a7-kserve-5754678467-xnbdm" podStartSLOduration=1.374426768 podStartE2EDuration="1.374426768s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 16:04:15 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 16:04:16.373409948 +0000 UTC m=+2409.952645125" watchObservedRunningTime="2026-07-13 16:04:16.374426768 +0000 UTC m=+2409.953661946"
Jul 13 16:04:18.633330 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:04:18.633294    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vhzkf"]
Jul 13 16:04:25.347251 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:04:25.347211    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-4293a7/auth-test-model-4293a7-kserve-5754678467-xnbdm"
Jul 13 16:04:25.347251 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:04:25.347255    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-4293a7/auth-test-model-4293a7-kserve-5754678467-xnbdm"
Jul 13 16:04:25.359905 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:04:25.359852    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-4293a7/auth-test-model-4293a7-kserve-5754678467-xnbdm"
Jul 13 16:04:25.415467 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:04:25.415441    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-4293a7/auth-test-model-4293a7-kserve-5754678467-xnbdm"
Jul 13 16:04:32.829655 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:04:32.829561    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vhzkf"]
Jul 13 16:04:52.243680 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:04:52.243641    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vhzkf"]
Jul 13 16:05:07.035854 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:05:07.035810    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vhzkf"]
Jul 13 16:05:23.529345 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:05:23.529312    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vhzkf"]
Jul 13 16:05:42.731020 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:05:42.730985    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vhzkf"]
Jul 13 16:06:00.331792 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:06:00.331714    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vhzkf"]
Jul 13 16:06:11.587362 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:06:11.587322    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-a1c3e5/auth-test-model-a1c3e5-kserve-795ff76bdc-5ss75"]
Jul 13 16:06:12.534157 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:06:12.534120    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-4293a7/auth-test-model-4293a7-kserve-5754678467-xnbdm"]
Jul 13 16:06:15.838584 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:06:15.838543    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vhzkf"]
Jul 13 16:06:26.607779 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:06:26.607712    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-a1c3e5/auth-test-model-a1c3e5-kserve-795ff76bdc-5ss75" podUID="d1dfa6bc-6a21-470f-a6b0-9635dfa07a83" containerName="main" containerID="cri-o://8d89177df625200bfd0c8fe40a40bc06e0df563fa7cc7c8bd5c8c1bd2d31a5ef" gracePeriod=45
Jul 13 16:06:26.857882 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:06:26.857804    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-a1c3e5/auth-test-model-a1c3e5-kserve-795ff76bdc-5ss75"
Jul 13 16:06:26.963251 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:06:26.963217    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d1dfa6bc-6a21-470f-a6b0-9635dfa07a83-home\") pod \"d1dfa6bc-6a21-470f-a6b0-9635dfa07a83\" (UID: \"d1dfa6bc-6a21-470f-a6b0-9635dfa07a83\") "
Jul 13 16:06:26.963420 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:06:26.963330    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d1dfa6bc-6a21-470f-a6b0-9635dfa07a83-model-cache\") pod \"d1dfa6bc-6a21-470f-a6b0-9635dfa07a83\" (UID: \"d1dfa6bc-6a21-470f-a6b0-9635dfa07a83\") "
Jul 13 16:06:26.963420 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:06:26.963351    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lhdq6\" (UniqueName: \"kubernetes.io/projected/d1dfa6bc-6a21-470f-a6b0-9635dfa07a83-kube-api-access-lhdq6\") pod \"d1dfa6bc-6a21-470f-a6b0-9635dfa07a83\" (UID: \"d1dfa6bc-6a21-470f-a6b0-9635dfa07a83\") "
Jul 13 16:06:26.963420 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:06:26.963380    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d1dfa6bc-6a21-470f-a6b0-9635dfa07a83-tls-certs\") pod \"d1dfa6bc-6a21-470f-a6b0-9635dfa07a83\" (UID: \"d1dfa6bc-6a21-470f-a6b0-9635dfa07a83\") "
Jul 13 16:06:26.963420 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:06:26.963399    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d1dfa6bc-6a21-470f-a6b0-9635dfa07a83-dshm\") pod \"d1dfa6bc-6a21-470f-a6b0-9635dfa07a83\" (UID: \"d1dfa6bc-6a21-470f-a6b0-9635dfa07a83\") "
Jul 13 16:06:26.963717 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:06:26.963429    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d1dfa6bc-6a21-470f-a6b0-9635dfa07a83-tmp-dir\") pod \"d1dfa6bc-6a21-470f-a6b0-9635dfa07a83\" (UID: \"d1dfa6bc-6a21-470f-a6b0-9635dfa07a83\") "
Jul 13 16:06:26.963717 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:06:26.963541    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d1dfa6bc-6a21-470f-a6b0-9635dfa07a83-home" (OuterVolumeSpecName: "home") pod "d1dfa6bc-6a21-470f-a6b0-9635dfa07a83" (UID: "d1dfa6bc-6a21-470f-a6b0-9635dfa07a83"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 16:06:26.963717 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:06:26.963606    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d1dfa6bc-6a21-470f-a6b0-9635dfa07a83-model-cache" (OuterVolumeSpecName: "model-cache") pod "d1dfa6bc-6a21-470f-a6b0-9635dfa07a83" (UID: "d1dfa6bc-6a21-470f-a6b0-9635dfa07a83"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 16:06:26.963978 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:06:26.963748    2564 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d1dfa6bc-6a21-470f-a6b0-9635dfa07a83-model-cache\") on node \"ip-10-0-140-255.ec2.internal\" DevicePath \"\""
Jul 13 16:06:26.963978 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:06:26.963765    2564 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d1dfa6bc-6a21-470f-a6b0-9635dfa07a83-home\") on node \"ip-10-0-140-255.ec2.internal\" DevicePath \"\""
Jul 13 16:06:26.963978 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:06:26.963772    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d1dfa6bc-6a21-470f-a6b0-9635dfa07a83-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "d1dfa6bc-6a21-470f-a6b0-9635dfa07a83" (UID: "d1dfa6bc-6a21-470f-a6b0-9635dfa07a83"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 16:06:26.965802 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:06:26.965774    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d1dfa6bc-6a21-470f-a6b0-9635dfa07a83-kube-api-access-lhdq6" (OuterVolumeSpecName: "kube-api-access-lhdq6") pod "d1dfa6bc-6a21-470f-a6b0-9635dfa07a83" (UID: "d1dfa6bc-6a21-470f-a6b0-9635dfa07a83"). InnerVolumeSpecName "kube-api-access-lhdq6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 13 16:06:26.965802 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:06:26.965787    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d1dfa6bc-6a21-470f-a6b0-9635dfa07a83-dshm" (OuterVolumeSpecName: "dshm") pod "d1dfa6bc-6a21-470f-a6b0-9635dfa07a83" (UID: "d1dfa6bc-6a21-470f-a6b0-9635dfa07a83"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 16:06:26.965989 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:06:26.965829    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d1dfa6bc-6a21-470f-a6b0-9635dfa07a83-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "d1dfa6bc-6a21-470f-a6b0-9635dfa07a83" (UID: "d1dfa6bc-6a21-470f-a6b0-9635dfa07a83"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 13 16:06:27.037813 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:06:27.037772    2564 generic.go:356] "Generic (PLEG): container finished" podID="d1dfa6bc-6a21-470f-a6b0-9635dfa07a83" containerID="8d89177df625200bfd0c8fe40a40bc06e0df563fa7cc7c8bd5c8c1bd2d31a5ef" exitCode=0
Jul 13 16:06:27.037813 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:06:27.037814    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-a1c3e5/auth-test-model-a1c3e5-kserve-795ff76bdc-5ss75"
Jul 13 16:06:27.038031 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:06:27.037828    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-a1c3e5/auth-test-model-a1c3e5-kserve-795ff76bdc-5ss75" event={"ID":"d1dfa6bc-6a21-470f-a6b0-9635dfa07a83","Type":"ContainerDied","Data":"8d89177df625200bfd0c8fe40a40bc06e0df563fa7cc7c8bd5c8c1bd2d31a5ef"}
Jul 13 16:06:27.038031 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:06:27.037893    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-a1c3e5/auth-test-model-a1c3e5-kserve-795ff76bdc-5ss75" event={"ID":"d1dfa6bc-6a21-470f-a6b0-9635dfa07a83","Type":"ContainerDied","Data":"42bc7a84eadb5c1a4061608e13faaf9671b6158ffc009514fd0e52fd07084486"}
Jul 13 16:06:27.038031 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:06:27.037892    2564 scope.go:117] "RemoveContainer" containerID="8d89177df625200bfd0c8fe40a40bc06e0df563fa7cc7c8bd5c8c1bd2d31a5ef"
Jul 13 16:06:27.047061 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:06:27.047043    2564 scope.go:117] "RemoveContainer" containerID="8d89177df625200bfd0c8fe40a40bc06e0df563fa7cc7c8bd5c8c1bd2d31a5ef"
Jul 13 16:06:27.047307 ip-10-0-140-255 kubenswrapper[2564]: E0713 16:06:27.047285    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8d89177df625200bfd0c8fe40a40bc06e0df563fa7cc7c8bd5c8c1bd2d31a5ef\": container with ID starting with 8d89177df625200bfd0c8fe40a40bc06e0df563fa7cc7c8bd5c8c1bd2d31a5ef not found: ID does not exist" containerID="8d89177df625200bfd0c8fe40a40bc06e0df563fa7cc7c8bd5c8c1bd2d31a5ef"
Jul 13 16:06:27.047351 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:06:27.047315    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8d89177df625200bfd0c8fe40a40bc06e0df563fa7cc7c8bd5c8c1bd2d31a5ef"} err="failed to get container status \"8d89177df625200bfd0c8fe40a40bc06e0df563fa7cc7c8bd5c8c1bd2d31a5ef\": rpc error: code = NotFound desc = could not find container \"8d89177df625200bfd0c8fe40a40bc06e0df563fa7cc7c8bd5c8c1bd2d31a5ef\": container with ID starting with 8d89177df625200bfd0c8fe40a40bc06e0df563fa7cc7c8bd5c8c1bd2d31a5ef not found: ID does not exist"
Jul 13 16:06:27.058945 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:06:27.058922    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-a1c3e5/auth-test-model-a1c3e5-kserve-795ff76bdc-5ss75"]
Jul 13 16:06:27.062655 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:06:27.062633    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-a1c3e5/auth-test-model-a1c3e5-kserve-795ff76bdc-5ss75"]
Jul 13 16:06:27.064794 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:06:27.064778    2564 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d1dfa6bc-6a21-470f-a6b0-9635dfa07a83-dshm\") on node \"ip-10-0-140-255.ec2.internal\" DevicePath \"\""
Jul 13 16:06:27.064858 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:06:27.064797    2564 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d1dfa6bc-6a21-470f-a6b0-9635dfa07a83-tmp-dir\") on node \"ip-10-0-140-255.ec2.internal\" DevicePath \"\""
Jul 13 16:06:27.064858 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:06:27.064808    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lhdq6\" (UniqueName: \"kubernetes.io/projected/d1dfa6bc-6a21-470f-a6b0-9635dfa07a83-kube-api-access-lhdq6\") on node \"ip-10-0-140-255.ec2.internal\" DevicePath \"\""
Jul 13 16:06:27.064858 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:06:27.064817    2564 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d1dfa6bc-6a21-470f-a6b0-9635dfa07a83-tls-certs\") on node \"ip-10-0-140-255.ec2.internal\" DevicePath \"\""
Jul 13 16:06:27.121692 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:06:27.121599    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d1dfa6bc-6a21-470f-a6b0-9635dfa07a83" path="/var/lib/kubelet/pods/d1dfa6bc-6a21-470f-a6b0-9635dfa07a83/volumes"
Jul 13 16:06:27.555497 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:06:27.555460    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-4293a7/auth-test-model-4293a7-kserve-5754678467-xnbdm" podUID="ad39de89-555d-4550-a6c6-596fc35e4163" containerName="main" containerID="cri-o://bfba773cbc6161b532814c40f28c6ac7fb891d3f47c0d70b82f484c1d925c933" gracePeriod=45
Jul 13 16:06:27.817955 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:06:27.817885    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-4293a7/auth-test-model-4293a7-kserve-5754678467-xnbdm"
Jul 13 16:06:27.835025 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:06:27.834991    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-a1c3e5/sub-test-model-a1c3e5-kserve-7bb95c5c47-n8nl6"]
Jul 13 16:06:27.835699 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:06:27.835677    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ad39de89-555d-4550-a6c6-596fc35e4163" containerName="main"
Jul 13 16:06:27.835862 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:06:27.835846    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="ad39de89-555d-4550-a6c6-596fc35e4163" containerName="main"
Jul 13 16:06:27.836035 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:06:27.836003    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d1dfa6bc-6a21-470f-a6b0-9635dfa07a83" containerName="main"
Jul 13 16:06:27.836035 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:06:27.836021    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="d1dfa6bc-6a21-470f-a6b0-9635dfa07a83" containerName="main"
Jul 13 16:06:27.836194 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:06:27.836149    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="ad39de89-555d-4550-a6c6-596fc35e4163" containerName="main"
Jul 13 16:06:27.836194 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:06:27.836169    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="d1dfa6bc-6a21-470f-a6b0-9635dfa07a83" containerName="main"
Jul 13 16:06:27.839170 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:06:27.839146    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-a1c3e5/sub-test-model-a1c3e5-kserve-7bb95c5c47-n8nl6"
Jul 13 16:06:27.841486 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:06:27.841468    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-a1c3e5\"/\"kube-root-ca.crt\""
Jul 13 16:06:27.841608 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:06:27.841594    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-a1c3e5\"/\"default-dockercfg-gmfbl\""
Jul 13 16:06:27.841682 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:06:27.841601    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-a1c3e5\"/\"openshift-service-ca.crt\""
Jul 13 16:06:27.841682 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:06:27.841604    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-a1c3e5\"/\"sub-test-model-a1c3e5-kserve-self-signed-certs\""
Jul 13 16:06:27.849919 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:06:27.849893    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-a1c3e5/sub-test-model-a1c3e5-kserve-7bb95c5c47-n8nl6"]
Jul 13 16:06:27.971513 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:06:27.971483    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ad39de89-555d-4550-a6c6-596fc35e4163-tmp-dir\") pod \"ad39de89-555d-4550-a6c6-596fc35e4163\" (UID: \"ad39de89-555d-4550-a6c6-596fc35e4163\") "
Jul 13 16:06:27.971691 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:06:27.971533    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ad39de89-555d-4550-a6c6-596fc35e4163-home\") pod \"ad39de89-555d-4550-a6c6-596fc35e4163\" (UID: \"ad39de89-555d-4550-a6c6-596fc35e4163\") "
Jul 13 16:06:27.971691 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:06:27.971571    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ad39de89-555d-4550-a6c6-596fc35e4163-tls-certs\") pod \"ad39de89-555d-4550-a6c6-596fc35e4163\" (UID: \"ad39de89-555d-4550-a6c6-596fc35e4163\") "
Jul 13 16:06:27.971691 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:06:27.971632    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-526dj\" (UniqueName: \"kubernetes.io/projected/ad39de89-555d-4550-a6c6-596fc35e4163-kube-api-access-526dj\") pod \"ad39de89-555d-4550-a6c6-596fc35e4163\" (UID: \"ad39de89-555d-4550-a6c6-596fc35e4163\") "
Jul 13 16:06:27.971691 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:06:27.971658    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ad39de89-555d-4550-a6c6-596fc35e4163-model-cache\") pod \"ad39de89-555d-4550-a6c6-596fc35e4163\" (UID: \"ad39de89-555d-4550-a6c6-596fc35e4163\") "
Jul 13 16:06:27.971950 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:06:27.971706    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ad39de89-555d-4550-a6c6-596fc35e4163-dshm\") pod \"ad39de89-555d-4550-a6c6-596fc35e4163\" (UID: \"ad39de89-555d-4550-a6c6-596fc35e4163\") "
Jul 13 16:06:27.971950 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:06:27.971834    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ad39de89-555d-4550-a6c6-596fc35e4163-home" (OuterVolumeSpecName: "home") pod "ad39de89-555d-4550-a6c6-596fc35e4163" (UID: "ad39de89-555d-4550-a6c6-596fc35e4163"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 16:06:27.971950 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:06:27.971841    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ad39de89-555d-4550-a6c6-596fc35e4163-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "ad39de89-555d-4550-a6c6-596fc35e4163" (UID: "ad39de89-555d-4550-a6c6-596fc35e4163"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 16:06:27.971950 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:06:27.971898    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ec6b44ad-2242-45a6-9dd7-ff46dda91bed-tmp-dir\") pod \"sub-test-model-a1c3e5-kserve-7bb95c5c47-n8nl6\" (UID: \"ec6b44ad-2242-45a6-9dd7-ff46dda91bed\") " pod="ai-tenant-e2e-shared-a-a1c3e5/sub-test-model-a1c3e5-kserve-7bb95c5c47-n8nl6"
Jul 13 16:06:27.972187 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:06:27.971961    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6v2nl\" (UniqueName: \"kubernetes.io/projected/ec6b44ad-2242-45a6-9dd7-ff46dda91bed-kube-api-access-6v2nl\") pod \"sub-test-model-a1c3e5-kserve-7bb95c5c47-n8nl6\" (UID: \"ec6b44ad-2242-45a6-9dd7-ff46dda91bed\") " pod="ai-tenant-e2e-shared-a-a1c3e5/sub-test-model-a1c3e5-kserve-7bb95c5c47-n8nl6"
Jul 13 16:06:27.972187 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:06:27.971989    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ec6b44ad-2242-45a6-9dd7-ff46dda91bed-dshm\") pod \"sub-test-model-a1c3e5-kserve-7bb95c5c47-n8nl6\" (UID: \"ec6b44ad-2242-45a6-9dd7-ff46dda91bed\") " pod="ai-tenant-e2e-shared-a-a1c3e5/sub-test-model-a1c3e5-kserve-7bb95c5c47-n8nl6"
Jul 13 16:06:27.972187 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:06:27.972000    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ad39de89-555d-4550-a6c6-596fc35e4163-model-cache" (OuterVolumeSpecName: "model-cache") pod "ad39de89-555d-4550-a6c6-596fc35e4163" (UID: "ad39de89-555d-4550-a6c6-596fc35e4163"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 16:06:27.972187 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:06:27.972077    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ec6b44ad-2242-45a6-9dd7-ff46dda91bed-home\") pod \"sub-test-model-a1c3e5-kserve-7bb95c5c47-n8nl6\" (UID: \"ec6b44ad-2242-45a6-9dd7-ff46dda91bed\") " pod="ai-tenant-e2e-shared-a-a1c3e5/sub-test-model-a1c3e5-kserve-7bb95c5c47-n8nl6"
Jul 13 16:06:27.972187 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:06:27.972111    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ec6b44ad-2242-45a6-9dd7-ff46dda91bed-model-cache\") pod \"sub-test-model-a1c3e5-kserve-7bb95c5c47-n8nl6\" (UID: \"ec6b44ad-2242-45a6-9dd7-ff46dda91bed\") " pod="ai-tenant-e2e-shared-a-a1c3e5/sub-test-model-a1c3e5-kserve-7bb95c5c47-n8nl6"
Jul 13 16:06:27.972445 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:06:27.972202    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ec6b44ad-2242-45a6-9dd7-ff46dda91bed-tls-certs\") pod \"sub-test-model-a1c3e5-kserve-7bb95c5c47-n8nl6\" (UID: \"ec6b44ad-2242-45a6-9dd7-ff46dda91bed\") " pod="ai-tenant-e2e-shared-a-a1c3e5/sub-test-model-a1c3e5-kserve-7bb95c5c47-n8nl6"
Jul 13 16:06:27.972445 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:06:27.972244    2564 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ad39de89-555d-4550-a6c6-596fc35e4163-model-cache\") on node \"ip-10-0-140-255.ec2.internal\" DevicePath \"\""
Jul 13 16:06:27.972445 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:06:27.972255    2564 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ad39de89-555d-4550-a6c6-596fc35e4163-tmp-dir\") on node \"ip-10-0-140-255.ec2.internal\" DevicePath \"\""
Jul 13 16:06:27.972445 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:06:27.972267    2564 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ad39de89-555d-4550-a6c6-596fc35e4163-home\") on node \"ip-10-0-140-255.ec2.internal\" DevicePath \"\""
Jul 13 16:06:27.973990 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:06:27.973958    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ad39de89-555d-4550-a6c6-596fc35e4163-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "ad39de89-555d-4550-a6c6-596fc35e4163" (UID: "ad39de89-555d-4550-a6c6-596fc35e4163"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 13 16:06:27.973990 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:06:27.973985    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ad39de89-555d-4550-a6c6-596fc35e4163-kube-api-access-526dj" (OuterVolumeSpecName: "kube-api-access-526dj") pod "ad39de89-555d-4550-a6c6-596fc35e4163" (UID: "ad39de89-555d-4550-a6c6-596fc35e4163"). InnerVolumeSpecName "kube-api-access-526dj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 13 16:06:27.974132 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:06:27.974057    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ad39de89-555d-4550-a6c6-596fc35e4163-dshm" (OuterVolumeSpecName: "dshm") pod "ad39de89-555d-4550-a6c6-596fc35e4163" (UID: "ad39de89-555d-4550-a6c6-596fc35e4163"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 16:06:28.044308 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:06:28.044273    2564 generic.go:356] "Generic (PLEG): container finished" podID="ad39de89-555d-4550-a6c6-596fc35e4163" containerID="bfba773cbc6161b532814c40f28c6ac7fb891d3f47c0d70b82f484c1d925c933" exitCode=0
Jul 13 16:06:28.044505 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:06:28.044317    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-4293a7/auth-test-model-4293a7-kserve-5754678467-xnbdm"
Jul 13 16:06:28.044505 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:06:28.044352    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-4293a7/auth-test-model-4293a7-kserve-5754678467-xnbdm" event={"ID":"ad39de89-555d-4550-a6c6-596fc35e4163","Type":"ContainerDied","Data":"bfba773cbc6161b532814c40f28c6ac7fb891d3f47c0d70b82f484c1d925c933"}
Jul 13 16:06:28.044505 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:06:28.044389    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-4293a7/auth-test-model-4293a7-kserve-5754678467-xnbdm" event={"ID":"ad39de89-555d-4550-a6c6-596fc35e4163","Type":"ContainerDied","Data":"dea350bae26d060676114ed2fc29698a7525fa0d3af48ae3a39038e51ba84c27"}
Jul 13 16:06:28.044505 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:06:28.044410    2564 scope.go:117] "RemoveContainer" containerID="bfba773cbc6161b532814c40f28c6ac7fb891d3f47c0d70b82f484c1d925c933"
Jul 13 16:06:28.054083 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:06:28.054063    2564 scope.go:117] "RemoveContainer" containerID="bfba773cbc6161b532814c40f28c6ac7fb891d3f47c0d70b82f484c1d925c933"
Jul 13 16:06:28.054382 ip-10-0-140-255 kubenswrapper[2564]: E0713 16:06:28.054358    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bfba773cbc6161b532814c40f28c6ac7fb891d3f47c0d70b82f484c1d925c933\": container with ID starting with bfba773cbc6161b532814c40f28c6ac7fb891d3f47c0d70b82f484c1d925c933 not found: ID does not exist" containerID="bfba773cbc6161b532814c40f28c6ac7fb891d3f47c0d70b82f484c1d925c933"
Jul 13 16:06:28.054475 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:06:28.054391    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bfba773cbc6161b532814c40f28c6ac7fb891d3f47c0d70b82f484c1d925c933"} err="failed to get container status \"bfba773cbc6161b532814c40f28c6ac7fb891d3f47c0d70b82f484c1d925c933\": rpc error: code = NotFound desc = could not find container \"bfba773cbc6161b532814c40f28c6ac7fb891d3f47c0d70b82f484c1d925c933\": container with ID starting with bfba773cbc6161b532814c40f28c6ac7fb891d3f47c0d70b82f484c1d925c933 not found: ID does not exist"
Jul 13 16:06:28.067500 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:06:28.067474    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-4293a7/auth-test-model-4293a7-kserve-5754678467-xnbdm"]
Jul 13 16:06:28.073185 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:06:28.073130    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ec6b44ad-2242-45a6-9dd7-ff46dda91bed-tmp-dir\") pod \"sub-test-model-a1c3e5-kserve-7bb95c5c47-n8nl6\" (UID: \"ec6b44ad-2242-45a6-9dd7-ff46dda91bed\") " pod="ai-tenant-e2e-shared-a-a1c3e5/sub-test-model-a1c3e5-kserve-7bb95c5c47-n8nl6"
Jul 13 16:06:28.073185 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:06:28.073167    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6v2nl\" (UniqueName: \"kubernetes.io/projected/ec6b44ad-2242-45a6-9dd7-ff46dda91bed-kube-api-access-6v2nl\") pod \"sub-test-model-a1c3e5-kserve-7bb95c5c47-n8nl6\" (UID: \"ec6b44ad-2242-45a6-9dd7-ff46dda91bed\") " pod="ai-tenant-e2e-shared-a-a1c3e5/sub-test-model-a1c3e5-kserve-7bb95c5c47-n8nl6"
Jul 13 16:06:28.073359 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:06:28.073187    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ec6b44ad-2242-45a6-9dd7-ff46dda91bed-dshm\") pod \"sub-test-model-a1c3e5-kserve-7bb95c5c47-n8nl6\" (UID: \"ec6b44ad-2242-45a6-9dd7-ff46dda91bed\") " pod="ai-tenant-e2e-shared-a-a1c3e5/sub-test-model-a1c3e5-kserve-7bb95c5c47-n8nl6"
Jul 13 16:06:28.073359 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:06:28.073214    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ec6b44ad-2242-45a6-9dd7-ff46dda91bed-home\") pod \"sub-test-model-a1c3e5-kserve-7bb95c5c47-n8nl6\" (UID: \"ec6b44ad-2242-45a6-9dd7-ff46dda91bed\") " pod="ai-tenant-e2e-shared-a-a1c3e5/sub-test-model-a1c3e5-kserve-7bb95c5c47-n8nl6"
Jul 13 16:06:28.073359 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:06:28.073231    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ec6b44ad-2242-45a6-9dd7-ff46dda91bed-model-cache\") pod \"sub-test-model-a1c3e5-kserve-7bb95c5c47-n8nl6\" (UID: \"ec6b44ad-2242-45a6-9dd7-ff46dda91bed\") " pod="ai-tenant-e2e-shared-a-a1c3e5/sub-test-model-a1c3e5-kserve-7bb95c5c47-n8nl6"
Jul 13 16:06:28.073359 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:06:28.073283    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ec6b44ad-2242-45a6-9dd7-ff46dda91bed-tls-certs\") pod \"sub-test-model-a1c3e5-kserve-7bb95c5c47-n8nl6\" (UID: \"ec6b44ad-2242-45a6-9dd7-ff46dda91bed\") " pod="ai-tenant-e2e-shared-a-a1c3e5/sub-test-model-a1c3e5-kserve-7bb95c5c47-n8nl6"
Jul 13 16:06:28.073359 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:06:28.073325    2564 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ad39de89-555d-4550-a6c6-596fc35e4163-dshm\") on node \"ip-10-0-140-255.ec2.internal\" DevicePath \"\""
Jul 13 16:06:28.073359 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:06:28.073340    2564 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ad39de89-555d-4550-a6c6-596fc35e4163-tls-certs\") on node \"ip-10-0-140-255.ec2.internal\" DevicePath \"\""
Jul 13 16:06:28.073359 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:06:28.073355    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-526dj\" (UniqueName: \"kubernetes.io/projected/ad39de89-555d-4550-a6c6-596fc35e4163-kube-api-access-526dj\") on node \"ip-10-0-140-255.ec2.internal\" DevicePath \"\""
Jul 13 16:06:28.073684 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:06:28.073571    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ec6b44ad-2242-45a6-9dd7-ff46dda91bed-tmp-dir\") pod \"sub-test-model-a1c3e5-kserve-7bb95c5c47-n8nl6\" (UID: \"ec6b44ad-2242-45a6-9dd7-ff46dda91bed\") " pod="ai-tenant-e2e-shared-a-a1c3e5/sub-test-model-a1c3e5-kserve-7bb95c5c47-n8nl6"
Jul 13 16:06:28.073684 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:06:28.073599    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ec6b44ad-2242-45a6-9dd7-ff46dda91bed-home\") pod \"sub-test-model-a1c3e5-kserve-7bb95c5c47-n8nl6\" (UID: \"ec6b44ad-2242-45a6-9dd7-ff46dda91bed\") " pod="ai-tenant-e2e-shared-a-a1c3e5/sub-test-model-a1c3e5-kserve-7bb95c5c47-n8nl6"
Jul 13 16:06:28.073799 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:06:28.073690    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ec6b44ad-2242-45a6-9dd7-ff46dda91bed-model-cache\") pod \"sub-test-model-a1c3e5-kserve-7bb95c5c47-n8nl6\" (UID: \"ec6b44ad-2242-45a6-9dd7-ff46dda91bed\") " pod="ai-tenant-e2e-shared-a-a1c3e5/sub-test-model-a1c3e5-kserve-7bb95c5c47-n8nl6"
Jul 13 16:06:28.073847 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:06:28.073801    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-4293a7/auth-test-model-4293a7-kserve-5754678467-xnbdm"]
Jul 13 16:06:28.075540 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:06:28.075517    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ec6b44ad-2242-45a6-9dd7-ff46dda91bed-dshm\") pod \"sub-test-model-a1c3e5-kserve-7bb95c5c47-n8nl6\" (UID: \"ec6b44ad-2242-45a6-9dd7-ff46dda91bed\") " pod="ai-tenant-e2e-shared-a-a1c3e5/sub-test-model-a1c3e5-kserve-7bb95c5c47-n8nl6"
Jul 13 16:06:28.075719 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:06:28.075705    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ec6b44ad-2242-45a6-9dd7-ff46dda91bed-tls-certs\") pod \"sub-test-model-a1c3e5-kserve-7bb95c5c47-n8nl6\" (UID: \"ec6b44ad-2242-45a6-9dd7-ff46dda91bed\") " pod="ai-tenant-e2e-shared-a-a1c3e5/sub-test-model-a1c3e5-kserve-7bb95c5c47-n8nl6"
Jul 13 16:06:28.082252 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:06:28.082234    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6v2nl\" (UniqueName: \"kubernetes.io/projected/ec6b44ad-2242-45a6-9dd7-ff46dda91bed-kube-api-access-6v2nl\") pod \"sub-test-model-a1c3e5-kserve-7bb95c5c47-n8nl6\" (UID: \"ec6b44ad-2242-45a6-9dd7-ff46dda91bed\") " pod="ai-tenant-e2e-shared-a-a1c3e5/sub-test-model-a1c3e5-kserve-7bb95c5c47-n8nl6"
Jul 13 16:06:28.153592 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:06:28.153556    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-a1c3e5/sub-test-model-a1c3e5-kserve-7bb95c5c47-n8nl6"
Jul 13 16:06:28.288550 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:06:28.288528    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-a1c3e5/sub-test-model-a1c3e5-kserve-7bb95c5c47-n8nl6"]
Jul 13 16:06:28.290681 ip-10-0-140-255 kubenswrapper[2564]: W0713 16:06:28.290657    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podec6b44ad_2242_45a6_9dd7_ff46dda91bed.slice/crio-b85cf14a49a915ebc91fa8eec7b1e1c8e93827a5cd123d9b96e764505d72529f WatchSource:0}: Error finding container b85cf14a49a915ebc91fa8eec7b1e1c8e93827a5cd123d9b96e764505d72529f: Status 404 returned error can't find the container with id b85cf14a49a915ebc91fa8eec7b1e1c8e93827a5cd123d9b96e764505d72529f
Jul 13 16:06:29.052251 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:06:29.052207    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-a1c3e5/sub-test-model-a1c3e5-kserve-7bb95c5c47-n8nl6" event={"ID":"ec6b44ad-2242-45a6-9dd7-ff46dda91bed","Type":"ContainerStarted","Data":"ddf6cf9af72a973480ada1b588f59e78129a6f61fc7b0d0d04690ffce351d3ce"}
Jul 13 16:06:29.052682 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:06:29.052259    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-a1c3e5/sub-test-model-a1c3e5-kserve-7bb95c5c47-n8nl6" event={"ID":"ec6b44ad-2242-45a6-9dd7-ff46dda91bed","Type":"ContainerStarted","Data":"b85cf14a49a915ebc91fa8eec7b1e1c8e93827a5cd123d9b96e764505d72529f"}
Jul 13 16:06:29.075056 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:06:29.075004    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-a1c3e5/sub-test-model-a1c3e5-kserve-7bb95c5c47-n8nl6" podStartSLOduration=2.074986579 podStartE2EDuration="2.074986579s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 16:06:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 16:06:29.07333103 +0000 UTC m=+2542.652566210" watchObservedRunningTime="2026-07-13 16:06:29.074986579 +0000 UTC m=+2542.654221757"
Jul 13 16:06:29.121967 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:06:29.121932    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ad39de89-555d-4550-a6c6-596fc35e4163" path="/var/lib/kubelet/pods/ad39de89-555d-4550-a6c6-596fc35e4163/volumes"
Jul 13 16:06:30.730500 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:06:30.730456    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vhzkf"]
Jul 13 16:06:38.154073 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:06:38.154017    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-a1c3e5/sub-test-model-a1c3e5-kserve-7bb95c5c47-n8nl6"
Jul 13 16:06:38.154482 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:06:38.154087    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-a1c3e5/sub-test-model-a1c3e5-kserve-7bb95c5c47-n8nl6"
Jul 13 16:06:38.166530 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:06:38.166502    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-a1c3e5/sub-test-model-a1c3e5-kserve-7bb95c5c47-n8nl6"
Jul 13 16:06:39.121108 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:06:39.121081    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-a1c3e5/sub-test-model-a1c3e5-kserve-7bb95c5c47-n8nl6"
Jul 13 16:06:50.540919 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:06:50.540862    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-4293a7/sub-test-model-4293a7-kserve-5994d98859-5svgw"]
Jul 13 16:06:50.544028 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:06:50.544009    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-4293a7/sub-test-model-4293a7-kserve-5994d98859-5svgw"
Jul 13 16:06:50.547393 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:06:50.547369    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-4293a7\"/\"default-dockercfg-fb786\""
Jul 13 16:06:50.547498 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:06:50.547398    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-4293a7\"/\"openshift-service-ca.crt\""
Jul 13 16:06:50.547498 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:06:50.547444    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-4293a7\"/\"sub-test-model-4293a7-kserve-self-signed-certs\""
Jul 13 16:06:50.547498 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:06:50.547369    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-4293a7\"/\"kube-root-ca.crt\""
Jul 13 16:06:50.553711 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:06:50.553685    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-4293a7/sub-test-model-4293a7-kserve-5994d98859-5svgw"]
Jul 13 16:06:50.575837 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:06:50.575809    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/66277749-1f2d-4c3b-8327-1525d5beb557-home\") pod \"sub-test-model-4293a7-kserve-5994d98859-5svgw\" (UID: \"66277749-1f2d-4c3b-8327-1525d5beb557\") " pod="ai-tenant-e2e-shared-b-4293a7/sub-test-model-4293a7-kserve-5994d98859-5svgw"
Jul 13 16:06:50.575988 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:06:50.575839    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/66277749-1f2d-4c3b-8327-1525d5beb557-model-cache\") pod \"sub-test-model-4293a7-kserve-5994d98859-5svgw\" (UID: \"66277749-1f2d-4c3b-8327-1525d5beb557\") " pod="ai-tenant-e2e-shared-b-4293a7/sub-test-model-4293a7-kserve-5994d98859-5svgw"
Jul 13 16:06:50.575988 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:06:50.575893    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/66277749-1f2d-4c3b-8327-1525d5beb557-tls-certs\") pod \"sub-test-model-4293a7-kserve-5994d98859-5svgw\" (UID: \"66277749-1f2d-4c3b-8327-1525d5beb557\") " pod="ai-tenant-e2e-shared-b-4293a7/sub-test-model-4293a7-kserve-5994d98859-5svgw"
Jul 13 16:06:50.575988 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:06:50.575913    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/66277749-1f2d-4c3b-8327-1525d5beb557-dshm\") pod \"sub-test-model-4293a7-kserve-5994d98859-5svgw\" (UID: \"66277749-1f2d-4c3b-8327-1525d5beb557\") " pod="ai-tenant-e2e-shared-b-4293a7/sub-test-model-4293a7-kserve-5994d98859-5svgw"
Jul 13 16:06:50.575988 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:06:50.575933    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/66277749-1f2d-4c3b-8327-1525d5beb557-tmp-dir\") pod \"sub-test-model-4293a7-kserve-5994d98859-5svgw\" (UID: \"66277749-1f2d-4c3b-8327-1525d5beb557\") " pod="ai-tenant-e2e-shared-b-4293a7/sub-test-model-4293a7-kserve-5994d98859-5svgw"
Jul 13 16:06:50.575988 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:06:50.575953    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rwlwp\" (UniqueName: \"kubernetes.io/projected/66277749-1f2d-4c3b-8327-1525d5beb557-kube-api-access-rwlwp\") pod \"sub-test-model-4293a7-kserve-5994d98859-5svgw\" (UID: \"66277749-1f2d-4c3b-8327-1525d5beb557\") " pod="ai-tenant-e2e-shared-b-4293a7/sub-test-model-4293a7-kserve-5994d98859-5svgw"
Jul 13 16:06:50.676385 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:06:50.676344    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/66277749-1f2d-4c3b-8327-1525d5beb557-home\") pod \"sub-test-model-4293a7-kserve-5994d98859-5svgw\" (UID: \"66277749-1f2d-4c3b-8327-1525d5beb557\") " pod="ai-tenant-e2e-shared-b-4293a7/sub-test-model-4293a7-kserve-5994d98859-5svgw"
Jul 13 16:06:50.676385 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:06:50.676385    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/66277749-1f2d-4c3b-8327-1525d5beb557-model-cache\") pod \"sub-test-model-4293a7-kserve-5994d98859-5svgw\" (UID: \"66277749-1f2d-4c3b-8327-1525d5beb557\") " pod="ai-tenant-e2e-shared-b-4293a7/sub-test-model-4293a7-kserve-5994d98859-5svgw"
Jul 13 16:06:50.676631 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:06:50.676418    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/66277749-1f2d-4c3b-8327-1525d5beb557-tls-certs\") pod \"sub-test-model-4293a7-kserve-5994d98859-5svgw\" (UID: \"66277749-1f2d-4c3b-8327-1525d5beb557\") " pod="ai-tenant-e2e-shared-b-4293a7/sub-test-model-4293a7-kserve-5994d98859-5svgw"
Jul 13 16:06:50.676631 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:06:50.676447    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/66277749-1f2d-4c3b-8327-1525d5beb557-dshm\") pod \"sub-test-model-4293a7-kserve-5994d98859-5svgw\" (UID: \"66277749-1f2d-4c3b-8327-1525d5beb557\") " pod="ai-tenant-e2e-shared-b-4293a7/sub-test-model-4293a7-kserve-5994d98859-5svgw"
Jul 13 16:06:50.676631 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:06:50.676472    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/66277749-1f2d-4c3b-8327-1525d5beb557-tmp-dir\") pod \"sub-test-model-4293a7-kserve-5994d98859-5svgw\" (UID: \"66277749-1f2d-4c3b-8327-1525d5beb557\") " pod="ai-tenant-e2e-shared-b-4293a7/sub-test-model-4293a7-kserve-5994d98859-5svgw"
Jul 13 16:06:50.676631 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:06:50.676495    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rwlwp\" (UniqueName: \"kubernetes.io/projected/66277749-1f2d-4c3b-8327-1525d5beb557-kube-api-access-rwlwp\") pod \"sub-test-model-4293a7-kserve-5994d98859-5svgw\" (UID: \"66277749-1f2d-4c3b-8327-1525d5beb557\") " pod="ai-tenant-e2e-shared-b-4293a7/sub-test-model-4293a7-kserve-5994d98859-5svgw"
Jul 13 16:06:50.676835 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:06:50.676762    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/66277749-1f2d-4c3b-8327-1525d5beb557-home\") pod \"sub-test-model-4293a7-kserve-5994d98859-5svgw\" (UID: \"66277749-1f2d-4c3b-8327-1525d5beb557\") " pod="ai-tenant-e2e-shared-b-4293a7/sub-test-model-4293a7-kserve-5994d98859-5svgw"
Jul 13 16:06:50.676835 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:06:50.676813    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/66277749-1f2d-4c3b-8327-1525d5beb557-model-cache\") pod \"sub-test-model-4293a7-kserve-5994d98859-5svgw\" (UID: \"66277749-1f2d-4c3b-8327-1525d5beb557\") " pod="ai-tenant-e2e-shared-b-4293a7/sub-test-model-4293a7-kserve-5994d98859-5svgw"
Jul 13 16:06:50.677040 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:06:50.677021    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/66277749-1f2d-4c3b-8327-1525d5beb557-tmp-dir\") pod \"sub-test-model-4293a7-kserve-5994d98859-5svgw\" (UID: \"66277749-1f2d-4c3b-8327-1525d5beb557\") " pod="ai-tenant-e2e-shared-b-4293a7/sub-test-model-4293a7-kserve-5994d98859-5svgw"
Jul 13 16:06:50.678756 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:06:50.678739    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/66277749-1f2d-4c3b-8327-1525d5beb557-dshm\") pod \"sub-test-model-4293a7-kserve-5994d98859-5svgw\" (UID: \"66277749-1f2d-4c3b-8327-1525d5beb557\") " pod="ai-tenant-e2e-shared-b-4293a7/sub-test-model-4293a7-kserve-5994d98859-5svgw"
Jul 13 16:06:50.679060 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:06:50.679040    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/66277749-1f2d-4c3b-8327-1525d5beb557-tls-certs\") pod \"sub-test-model-4293a7-kserve-5994d98859-5svgw\" (UID: \"66277749-1f2d-4c3b-8327-1525d5beb557\") " pod="ai-tenant-e2e-shared-b-4293a7/sub-test-model-4293a7-kserve-5994d98859-5svgw"
Jul 13 16:06:50.685975 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:06:50.685947    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rwlwp\" (UniqueName: \"kubernetes.io/projected/66277749-1f2d-4c3b-8327-1525d5beb557-kube-api-access-rwlwp\") pod \"sub-test-model-4293a7-kserve-5994d98859-5svgw\" (UID: \"66277749-1f2d-4c3b-8327-1525d5beb557\") " pod="ai-tenant-e2e-shared-b-4293a7/sub-test-model-4293a7-kserve-5994d98859-5svgw"
Jul 13 16:06:50.855095 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:06:50.855014    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-4293a7/sub-test-model-4293a7-kserve-5994d98859-5svgw"
Jul 13 16:06:50.987901 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:06:50.987857    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-4293a7/sub-test-model-4293a7-kserve-5994d98859-5svgw"]
Jul 13 16:06:50.989452 ip-10-0-140-255 kubenswrapper[2564]: W0713 16:06:50.989423    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod66277749_1f2d_4c3b_8327_1525d5beb557.slice/crio-a964efd69afbec1f36441ac255bf8dc227981f84eb5f8cbde2f1ecec65e520d3 WatchSource:0}: Error finding container a964efd69afbec1f36441ac255bf8dc227981f84eb5f8cbde2f1ecec65e520d3: Status 404 returned error can't find the container with id a964efd69afbec1f36441ac255bf8dc227981f84eb5f8cbde2f1ecec65e520d3
Jul 13 16:06:51.168996 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:06:51.168954    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-4293a7/sub-test-model-4293a7-kserve-5994d98859-5svgw" event={"ID":"66277749-1f2d-4c3b-8327-1525d5beb557","Type":"ContainerStarted","Data":"6bc518e81d7369cbeecf24b040ecef4c75b3d8fe11ef17e95d71e916649653b0"}
Jul 13 16:06:51.169172 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:06:51.169002    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-4293a7/sub-test-model-4293a7-kserve-5994d98859-5svgw" event={"ID":"66277749-1f2d-4c3b-8327-1525d5beb557","Type":"ContainerStarted","Data":"a964efd69afbec1f36441ac255bf8dc227981f84eb5f8cbde2f1ecec65e520d3"}
Jul 13 16:06:51.187067 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:06:51.187016    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-4293a7/sub-test-model-4293a7-kserve-5994d98859-5svgw" podStartSLOduration=1.187000658 podStartE2EDuration="1.187000658s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 16:06:50 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 16:06:51.186098301 +0000 UTC m=+2564.765333481" watchObservedRunningTime="2026-07-13 16:06:51.187000658 +0000 UTC m=+2564.766235835"
Jul 13 16:06:54.937116 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:06:54.937081    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vhzkf"]
Jul 13 16:07:00.855703 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:07:00.855657    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-4293a7/sub-test-model-4293a7-kserve-5994d98859-5svgw"
Jul 13 16:07:00.856376 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:07:00.855721    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-4293a7/sub-test-model-4293a7-kserve-5994d98859-5svgw"
Jul 13 16:07:00.868391 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:07:00.868360    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-4293a7/sub-test-model-4293a7-kserve-5994d98859-5svgw"
Jul 13 16:07:01.234707 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:07:01.234667    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-4293a7/sub-test-model-4293a7-kserve-5994d98859-5svgw"
Jul 13 16:07:12.944539 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:07:12.944508    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vhzkf"]
Jul 13 16:07:28.148381 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:07:28.148298    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-a1c3e5/sub-test-model-a1c3e5-kserve-7bb95c5c47-n8nl6"]
Jul 13 16:07:29.226756 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:07:29.226710    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-4293a7/sub-test-model-4293a7-kserve-5994d98859-5svgw"]
Jul 13 16:07:33.444810 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:07:33.444765    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vhzkf"]
Jul 13 16:07:40.635337 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:07:40.635304    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-a1c3e5/rate-test-model-a1c3e5-kserve-6fc9d544dc-s5bgw"]
Jul 13 16:07:40.638735 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:07:40.638718    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-a1c3e5/rate-test-model-a1c3e5-kserve-6fc9d544dc-s5bgw"
Jul 13 16:07:40.642318 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:07:40.642298    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-a1c3e5\"/\"rate-test-model-a1c3e5-kserve-self-signed-certs\""
Jul 13 16:07:40.661751 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:07:40.661719    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-a1c3e5/rate-test-model-a1c3e5-kserve-6fc9d544dc-s5bgw"]
Jul 13 16:07:40.720049 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:07:40.720001    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7ec2e049-d0c1-40c5-a3b6-523149ae3cf9-home\") pod \"rate-test-model-a1c3e5-kserve-6fc9d544dc-s5bgw\" (UID: \"7ec2e049-d0c1-40c5-a3b6-523149ae3cf9\") " pod="ai-tenant-e2e-shared-a-a1c3e5/rate-test-model-a1c3e5-kserve-6fc9d544dc-s5bgw"
Jul 13 16:07:40.720248 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:07:40.720092    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7ec2e049-d0c1-40c5-a3b6-523149ae3cf9-tls-certs\") pod \"rate-test-model-a1c3e5-kserve-6fc9d544dc-s5bgw\" (UID: \"7ec2e049-d0c1-40c5-a3b6-523149ae3cf9\") " pod="ai-tenant-e2e-shared-a-a1c3e5/rate-test-model-a1c3e5-kserve-6fc9d544dc-s5bgw"
Jul 13 16:07:40.720248 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:07:40.720170    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6nfp2\" (UniqueName: \"kubernetes.io/projected/7ec2e049-d0c1-40c5-a3b6-523149ae3cf9-kube-api-access-6nfp2\") pod \"rate-test-model-a1c3e5-kserve-6fc9d544dc-s5bgw\" (UID: \"7ec2e049-d0c1-40c5-a3b6-523149ae3cf9\") " pod="ai-tenant-e2e-shared-a-a1c3e5/rate-test-model-a1c3e5-kserve-6fc9d544dc-s5bgw"
Jul 13 16:07:40.720248 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:07:40.720226    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7ec2e049-d0c1-40c5-a3b6-523149ae3cf9-tmp-dir\") pod \"rate-test-model-a1c3e5-kserve-6fc9d544dc-s5bgw\" (UID: \"7ec2e049-d0c1-40c5-a3b6-523149ae3cf9\") " pod="ai-tenant-e2e-shared-a-a1c3e5/rate-test-model-a1c3e5-kserve-6fc9d544dc-s5bgw"
Jul 13 16:07:40.720390 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:07:40.720268    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7ec2e049-d0c1-40c5-a3b6-523149ae3cf9-dshm\") pod \"rate-test-model-a1c3e5-kserve-6fc9d544dc-s5bgw\" (UID: \"7ec2e049-d0c1-40c5-a3b6-523149ae3cf9\") " pod="ai-tenant-e2e-shared-a-a1c3e5/rate-test-model-a1c3e5-kserve-6fc9d544dc-s5bgw"
Jul 13 16:07:40.720390 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:07:40.720285    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7ec2e049-d0c1-40c5-a3b6-523149ae3cf9-model-cache\") pod \"rate-test-model-a1c3e5-kserve-6fc9d544dc-s5bgw\" (UID: \"7ec2e049-d0c1-40c5-a3b6-523149ae3cf9\") " pod="ai-tenant-e2e-shared-a-a1c3e5/rate-test-model-a1c3e5-kserve-6fc9d544dc-s5bgw"
Jul 13 16:07:40.821626 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:07:40.821585    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7ec2e049-d0c1-40c5-a3b6-523149ae3cf9-tls-certs\") pod \"rate-test-model-a1c3e5-kserve-6fc9d544dc-s5bgw\" (UID: \"7ec2e049-d0c1-40c5-a3b6-523149ae3cf9\") " pod="ai-tenant-e2e-shared-a-a1c3e5/rate-test-model-a1c3e5-kserve-6fc9d544dc-s5bgw"
Jul 13 16:07:40.821845 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:07:40.821671    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6nfp2\" (UniqueName: \"kubernetes.io/projected/7ec2e049-d0c1-40c5-a3b6-523149ae3cf9-kube-api-access-6nfp2\") pod \"rate-test-model-a1c3e5-kserve-6fc9d544dc-s5bgw\" (UID: \"7ec2e049-d0c1-40c5-a3b6-523149ae3cf9\") " pod="ai-tenant-e2e-shared-a-a1c3e5/rate-test-model-a1c3e5-kserve-6fc9d544dc-s5bgw"
Jul 13 16:07:40.821845 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:07:40.821700    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7ec2e049-d0c1-40c5-a3b6-523149ae3cf9-tmp-dir\") pod \"rate-test-model-a1c3e5-kserve-6fc9d544dc-s5bgw\" (UID: \"7ec2e049-d0c1-40c5-a3b6-523149ae3cf9\") " pod="ai-tenant-e2e-shared-a-a1c3e5/rate-test-model-a1c3e5-kserve-6fc9d544dc-s5bgw"
Jul 13 16:07:40.821845 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:07:40.821739    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7ec2e049-d0c1-40c5-a3b6-523149ae3cf9-dshm\") pod \"rate-test-model-a1c3e5-kserve-6fc9d544dc-s5bgw\" (UID: \"7ec2e049-d0c1-40c5-a3b6-523149ae3cf9\") " pod="ai-tenant-e2e-shared-a-a1c3e5/rate-test-model-a1c3e5-kserve-6fc9d544dc-s5bgw"
Jul 13 16:07:40.821845 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:07:40.821762    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7ec2e049-d0c1-40c5-a3b6-523149ae3cf9-model-cache\") pod \"rate-test-model-a1c3e5-kserve-6fc9d544dc-s5bgw\" (UID: \"7ec2e049-d0c1-40c5-a3b6-523149ae3cf9\") " pod="ai-tenant-e2e-shared-a-a1c3e5/rate-test-model-a1c3e5-kserve-6fc9d544dc-s5bgw"
Jul 13 16:07:40.821845 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:07:40.821805    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7ec2e049-d0c1-40c5-a3b6-523149ae3cf9-home\") pod \"rate-test-model-a1c3e5-kserve-6fc9d544dc-s5bgw\" (UID: \"7ec2e049-d0c1-40c5-a3b6-523149ae3cf9\") " pod="ai-tenant-e2e-shared-a-a1c3e5/rate-test-model-a1c3e5-kserve-6fc9d544dc-s5bgw"
Jul 13 16:07:40.822258 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:07:40.822224    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7ec2e049-d0c1-40c5-a3b6-523149ae3cf9-model-cache\") pod \"rate-test-model-a1c3e5-kserve-6fc9d544dc-s5bgw\" (UID: \"7ec2e049-d0c1-40c5-a3b6-523149ae3cf9\") " pod="ai-tenant-e2e-shared-a-a1c3e5/rate-test-model-a1c3e5-kserve-6fc9d544dc-s5bgw"
Jul 13 16:07:40.822366 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:07:40.822311    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7ec2e049-d0c1-40c5-a3b6-523149ae3cf9-tmp-dir\") pod \"rate-test-model-a1c3e5-kserve-6fc9d544dc-s5bgw\" (UID: \"7ec2e049-d0c1-40c5-a3b6-523149ae3cf9\") " pod="ai-tenant-e2e-shared-a-a1c3e5/rate-test-model-a1c3e5-kserve-6fc9d544dc-s5bgw"
Jul 13 16:07:40.822366 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:07:40.822337    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7ec2e049-d0c1-40c5-a3b6-523149ae3cf9-home\") pod \"rate-test-model-a1c3e5-kserve-6fc9d544dc-s5bgw\" (UID: \"7ec2e049-d0c1-40c5-a3b6-523149ae3cf9\") " pod="ai-tenant-e2e-shared-a-a1c3e5/rate-test-model-a1c3e5-kserve-6fc9d544dc-s5bgw"
Jul 13 16:07:40.824042 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:07:40.824020    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7ec2e049-d0c1-40c5-a3b6-523149ae3cf9-dshm\") pod \"rate-test-model-a1c3e5-kserve-6fc9d544dc-s5bgw\" (UID: \"7ec2e049-d0c1-40c5-a3b6-523149ae3cf9\") " pod="ai-tenant-e2e-shared-a-a1c3e5/rate-test-model-a1c3e5-kserve-6fc9d544dc-s5bgw"
Jul 13 16:07:40.824400 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:07:40.824381    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7ec2e049-d0c1-40c5-a3b6-523149ae3cf9-tls-certs\") pod \"rate-test-model-a1c3e5-kserve-6fc9d544dc-s5bgw\" (UID: \"7ec2e049-d0c1-40c5-a3b6-523149ae3cf9\") " pod="ai-tenant-e2e-shared-a-a1c3e5/rate-test-model-a1c3e5-kserve-6fc9d544dc-s5bgw"
Jul 13 16:07:40.830433 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:07:40.830413    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6nfp2\" (UniqueName: \"kubernetes.io/projected/7ec2e049-d0c1-40c5-a3b6-523149ae3cf9-kube-api-access-6nfp2\") pod \"rate-test-model-a1c3e5-kserve-6fc9d544dc-s5bgw\" (UID: \"7ec2e049-d0c1-40c5-a3b6-523149ae3cf9\") " pod="ai-tenant-e2e-shared-a-a1c3e5/rate-test-model-a1c3e5-kserve-6fc9d544dc-s5bgw"
Jul 13 16:07:40.947967 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:07:40.947850    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-a1c3e5/rate-test-model-a1c3e5-kserve-6fc9d544dc-s5bgw"
Jul 13 16:07:41.095333 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:07:41.095304    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-a1c3e5/rate-test-model-a1c3e5-kserve-6fc9d544dc-s5bgw"]
Jul 13 16:07:41.097459 ip-10-0-140-255 kubenswrapper[2564]: W0713 16:07:41.097433    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod7ec2e049_d0c1_40c5_a3b6_523149ae3cf9.slice/crio-cb16eec7b1d9a87faf7b48ec993ec45c98a513c95eb5865f2e04e5812fc3cd4e WatchSource:0}: Error finding container cb16eec7b1d9a87faf7b48ec993ec45c98a513c95eb5865f2e04e5812fc3cd4e: Status 404 returned error can't find the container with id cb16eec7b1d9a87faf7b48ec993ec45c98a513c95eb5865f2e04e5812fc3cd4e
Jul 13 16:07:41.440508 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:07:41.440474    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-a1c3e5/rate-test-model-a1c3e5-kserve-6fc9d544dc-s5bgw" event={"ID":"7ec2e049-d0c1-40c5-a3b6-523149ae3cf9","Type":"ContainerStarted","Data":"a3adb5b6e4288581c5596e94fd7a69fd5aab1b8e26f15dfa528d2d19d9c6c7c6"}
Jul 13 16:07:41.440508 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:07:41.440515    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-a1c3e5/rate-test-model-a1c3e5-kserve-6fc9d544dc-s5bgw" event={"ID":"7ec2e049-d0c1-40c5-a3b6-523149ae3cf9","Type":"ContainerStarted","Data":"cb16eec7b1d9a87faf7b48ec993ec45c98a513c95eb5865f2e04e5812fc3cd4e"}
Jul 13 16:07:41.460044 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:07:41.459984    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-a1c3e5/rate-test-model-a1c3e5-kserve-6fc9d544dc-s5bgw" podStartSLOduration=1.459966431 podStartE2EDuration="1.459966431s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 16:07:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 16:07:41.457920425 +0000 UTC m=+2615.037155603" watchObservedRunningTime="2026-07-13 16:07:41.459966431 +0000 UTC m=+2615.039201608"
Jul 13 16:07:43.168808 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:07:43.168765    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-a1c3e5/sub-test-model-a1c3e5-kserve-7bb95c5c47-n8nl6" podUID="ec6b44ad-2242-45a6-9dd7-ff46dda91bed" containerName="main" containerID="cri-o://ddf6cf9af72a973480ada1b588f59e78129a6f61fc7b0d0d04690ffce351d3ce" gracePeriod=45
Jul 13 16:07:43.426856 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:07:43.426788    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-a1c3e5/sub-test-model-a1c3e5-kserve-7bb95c5c47-n8nl6"
Jul 13 16:07:43.448634 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:07:43.448045    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ec6b44ad-2242-45a6-9dd7-ff46dda91bed-dshm\") pod \"ec6b44ad-2242-45a6-9dd7-ff46dda91bed\" (UID: \"ec6b44ad-2242-45a6-9dd7-ff46dda91bed\") "
Jul 13 16:07:43.448634 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:07:43.448169    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ec6b44ad-2242-45a6-9dd7-ff46dda91bed-tmp-dir\") pod \"ec6b44ad-2242-45a6-9dd7-ff46dda91bed\" (UID: \"ec6b44ad-2242-45a6-9dd7-ff46dda91bed\") "
Jul 13 16:07:43.448634 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:07:43.448194    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ec6b44ad-2242-45a6-9dd7-ff46dda91bed-model-cache\") pod \"ec6b44ad-2242-45a6-9dd7-ff46dda91bed\" (UID: \"ec6b44ad-2242-45a6-9dd7-ff46dda91bed\") "
Jul 13 16:07:43.448634 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:07:43.448250    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ec6b44ad-2242-45a6-9dd7-ff46dda91bed-home\") pod \"ec6b44ad-2242-45a6-9dd7-ff46dda91bed\" (UID: \"ec6b44ad-2242-45a6-9dd7-ff46dda91bed\") "
Jul 13 16:07:43.448634 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:07:43.448301    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ec6b44ad-2242-45a6-9dd7-ff46dda91bed-tls-certs\") pod \"ec6b44ad-2242-45a6-9dd7-ff46dda91bed\" (UID: \"ec6b44ad-2242-45a6-9dd7-ff46dda91bed\") "
Jul 13 16:07:43.448634 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:07:43.448336    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6v2nl\" (UniqueName: \"kubernetes.io/projected/ec6b44ad-2242-45a6-9dd7-ff46dda91bed-kube-api-access-6v2nl\") pod \"ec6b44ad-2242-45a6-9dd7-ff46dda91bed\" (UID: \"ec6b44ad-2242-45a6-9dd7-ff46dda91bed\") "
Jul 13 16:07:43.450262 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:07:43.448555    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ec6b44ad-2242-45a6-9dd7-ff46dda91bed-model-cache" (OuterVolumeSpecName: "model-cache") pod "ec6b44ad-2242-45a6-9dd7-ff46dda91bed" (UID: "ec6b44ad-2242-45a6-9dd7-ff46dda91bed"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 16:07:43.450262 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:07:43.449026    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ec6b44ad-2242-45a6-9dd7-ff46dda91bed-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "ec6b44ad-2242-45a6-9dd7-ff46dda91bed" (UID: "ec6b44ad-2242-45a6-9dd7-ff46dda91bed"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 16:07:43.450262 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:07:43.449069    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ec6b44ad-2242-45a6-9dd7-ff46dda91bed-home" (OuterVolumeSpecName: "home") pod "ec6b44ad-2242-45a6-9dd7-ff46dda91bed" (UID: "ec6b44ad-2242-45a6-9dd7-ff46dda91bed"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 16:07:43.451163 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:07:43.450729    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ec6b44ad-2242-45a6-9dd7-ff46dda91bed-dshm" (OuterVolumeSpecName: "dshm") pod "ec6b44ad-2242-45a6-9dd7-ff46dda91bed" (UID: "ec6b44ad-2242-45a6-9dd7-ff46dda91bed"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 16:07:43.451544 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:07:43.451509    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ec6b44ad-2242-45a6-9dd7-ff46dda91bed-kube-api-access-6v2nl" (OuterVolumeSpecName: "kube-api-access-6v2nl") pod "ec6b44ad-2242-45a6-9dd7-ff46dda91bed" (UID: "ec6b44ad-2242-45a6-9dd7-ff46dda91bed"). InnerVolumeSpecName "kube-api-access-6v2nl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 13 16:07:43.451854 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:07:43.451826    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ec6b44ad-2242-45a6-9dd7-ff46dda91bed-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "ec6b44ad-2242-45a6-9dd7-ff46dda91bed" (UID: "ec6b44ad-2242-45a6-9dd7-ff46dda91bed"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 13 16:07:43.453796 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:07:43.453773    2564 generic.go:356] "Generic (PLEG): container finished" podID="ec6b44ad-2242-45a6-9dd7-ff46dda91bed" containerID="ddf6cf9af72a973480ada1b588f59e78129a6f61fc7b0d0d04690ffce351d3ce" exitCode=0
Jul 13 16:07:43.453919 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:07:43.453819    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-a1c3e5/sub-test-model-a1c3e5-kserve-7bb95c5c47-n8nl6" event={"ID":"ec6b44ad-2242-45a6-9dd7-ff46dda91bed","Type":"ContainerDied","Data":"ddf6cf9af72a973480ada1b588f59e78129a6f61fc7b0d0d04690ffce351d3ce"}
Jul 13 16:07:43.453919 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:07:43.453827    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-a1c3e5/sub-test-model-a1c3e5-kserve-7bb95c5c47-n8nl6"
Jul 13 16:07:43.453919 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:07:43.453849    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-a1c3e5/sub-test-model-a1c3e5-kserve-7bb95c5c47-n8nl6" event={"ID":"ec6b44ad-2242-45a6-9dd7-ff46dda91bed","Type":"ContainerDied","Data":"b85cf14a49a915ebc91fa8eec7b1e1c8e93827a5cd123d9b96e764505d72529f"}
Jul 13 16:07:43.453919 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:07:43.453884    2564 scope.go:117] "RemoveContainer" containerID="ddf6cf9af72a973480ada1b588f59e78129a6f61fc7b0d0d04690ffce351d3ce"
Jul 13 16:07:43.470572 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:07:43.470552    2564 scope.go:117] "RemoveContainer" containerID="ddf6cf9af72a973480ada1b588f59e78129a6f61fc7b0d0d04690ffce351d3ce"
Jul 13 16:07:43.470898 ip-10-0-140-255 kubenswrapper[2564]: E0713 16:07:43.470838    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ddf6cf9af72a973480ada1b588f59e78129a6f61fc7b0d0d04690ffce351d3ce\": container with ID starting with ddf6cf9af72a973480ada1b588f59e78129a6f61fc7b0d0d04690ffce351d3ce not found: ID does not exist" containerID="ddf6cf9af72a973480ada1b588f59e78129a6f61fc7b0d0d04690ffce351d3ce"
Jul 13 16:07:43.470980 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:07:43.470906    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ddf6cf9af72a973480ada1b588f59e78129a6f61fc7b0d0d04690ffce351d3ce"} err="failed to get container status \"ddf6cf9af72a973480ada1b588f59e78129a6f61fc7b0d0d04690ffce351d3ce\": rpc error: code = NotFound desc = could not find container \"ddf6cf9af72a973480ada1b588f59e78129a6f61fc7b0d0d04690ffce351d3ce\": container with ID starting with ddf6cf9af72a973480ada1b588f59e78129a6f61fc7b0d0d04690ffce351d3ce not found: ID does not exist"
Jul 13 16:07:43.482468 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:07:43.482441    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-a1c3e5/sub-test-model-a1c3e5-kserve-7bb95c5c47-n8nl6"]
Jul 13 16:07:43.488385 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:07:43.488358    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-a1c3e5/sub-test-model-a1c3e5-kserve-7bb95c5c47-n8nl6"]
Jul 13 16:07:43.549321 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:07:43.549284    2564 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ec6b44ad-2242-45a6-9dd7-ff46dda91bed-home\") on node \"ip-10-0-140-255.ec2.internal\" DevicePath \"\""
Jul 13 16:07:43.549321 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:07:43.549315    2564 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ec6b44ad-2242-45a6-9dd7-ff46dda91bed-tls-certs\") on node \"ip-10-0-140-255.ec2.internal\" DevicePath \"\""
Jul 13 16:07:43.549321 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:07:43.549324    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6v2nl\" (UniqueName: \"kubernetes.io/projected/ec6b44ad-2242-45a6-9dd7-ff46dda91bed-kube-api-access-6v2nl\") on node \"ip-10-0-140-255.ec2.internal\" DevicePath \"\""
Jul 13 16:07:43.549548 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:07:43.549334    2564 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ec6b44ad-2242-45a6-9dd7-ff46dda91bed-dshm\") on node \"ip-10-0-140-255.ec2.internal\" DevicePath \"\""
Jul 13 16:07:43.549548 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:07:43.549345    2564 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ec6b44ad-2242-45a6-9dd7-ff46dda91bed-tmp-dir\") on node \"ip-10-0-140-255.ec2.internal\" DevicePath \"\""
Jul 13 16:07:43.549548 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:07:43.549354    2564 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ec6b44ad-2242-45a6-9dd7-ff46dda91bed-model-cache\") on node \"ip-10-0-140-255.ec2.internal\" DevicePath \"\""
Jul 13 16:07:44.247674 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:07:44.247636    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-4293a7/sub-test-model-4293a7-kserve-5994d98859-5svgw" podUID="66277749-1f2d-4c3b-8327-1525d5beb557" containerName="main" containerID="cri-o://6bc518e81d7369cbeecf24b040ecef4c75b3d8fe11ef17e95d71e916649653b0" gracePeriod=45
Jul 13 16:07:44.462319 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:07:44.462289    2564 generic.go:356] "Generic (PLEG): container finished" podID="66277749-1f2d-4c3b-8327-1525d5beb557" containerID="6bc518e81d7369cbeecf24b040ecef4c75b3d8fe11ef17e95d71e916649653b0" exitCode=0
Jul 13 16:07:44.462481 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:07:44.462369    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-4293a7/sub-test-model-4293a7-kserve-5994d98859-5svgw" event={"ID":"66277749-1f2d-4c3b-8327-1525d5beb557","Type":"ContainerDied","Data":"6bc518e81d7369cbeecf24b040ecef4c75b3d8fe11ef17e95d71e916649653b0"}
Jul 13 16:07:44.499445 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:07:44.499378    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-4293a7/sub-test-model-4293a7-kserve-5994d98859-5svgw"
Jul 13 16:07:44.559484 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:07:44.559450    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/66277749-1f2d-4c3b-8327-1525d5beb557-tmp-dir\") pod \"66277749-1f2d-4c3b-8327-1525d5beb557\" (UID: \"66277749-1f2d-4c3b-8327-1525d5beb557\") "
Jul 13 16:07:44.559683 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:07:44.559512    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/66277749-1f2d-4c3b-8327-1525d5beb557-model-cache\") pod \"66277749-1f2d-4c3b-8327-1525d5beb557\" (UID: \"66277749-1f2d-4c3b-8327-1525d5beb557\") "
Jul 13 16:07:44.559683 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:07:44.559587    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/66277749-1f2d-4c3b-8327-1525d5beb557-dshm\") pod \"66277749-1f2d-4c3b-8327-1525d5beb557\" (UID: \"66277749-1f2d-4c3b-8327-1525d5beb557\") "
Jul 13 16:07:44.559683 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:07:44.559622    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rwlwp\" (UniqueName: \"kubernetes.io/projected/66277749-1f2d-4c3b-8327-1525d5beb557-kube-api-access-rwlwp\") pod \"66277749-1f2d-4c3b-8327-1525d5beb557\" (UID: \"66277749-1f2d-4c3b-8327-1525d5beb557\") "
Jul 13 16:07:44.559683 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:07:44.559647    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/66277749-1f2d-4c3b-8327-1525d5beb557-home\") pod \"66277749-1f2d-4c3b-8327-1525d5beb557\" (UID: \"66277749-1f2d-4c3b-8327-1525d5beb557\") "
Jul 13 16:07:44.559683 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:07:44.559675    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/66277749-1f2d-4c3b-8327-1525d5beb557-tls-certs\") pod \"66277749-1f2d-4c3b-8327-1525d5beb557\" (UID: \"66277749-1f2d-4c3b-8327-1525d5beb557\") "
Jul 13 16:07:44.559989 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:07:44.559744    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/66277749-1f2d-4c3b-8327-1525d5beb557-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "66277749-1f2d-4c3b-8327-1525d5beb557" (UID: "66277749-1f2d-4c3b-8327-1525d5beb557"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 16:07:44.559989 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:07:44.559772    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/66277749-1f2d-4c3b-8327-1525d5beb557-model-cache" (OuterVolumeSpecName: "model-cache") pod "66277749-1f2d-4c3b-8327-1525d5beb557" (UID: "66277749-1f2d-4c3b-8327-1525d5beb557"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 16:07:44.559989 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:07:44.559854    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/66277749-1f2d-4c3b-8327-1525d5beb557-home" (OuterVolumeSpecName: "home") pod "66277749-1f2d-4c3b-8327-1525d5beb557" (UID: "66277749-1f2d-4c3b-8327-1525d5beb557"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 16:07:44.560100 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:07:44.559993    2564 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/66277749-1f2d-4c3b-8327-1525d5beb557-home\") on node \"ip-10-0-140-255.ec2.internal\" DevicePath \"\""
Jul 13 16:07:44.560100 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:07:44.560006    2564 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/66277749-1f2d-4c3b-8327-1525d5beb557-tmp-dir\") on node \"ip-10-0-140-255.ec2.internal\" DevicePath \"\""
Jul 13 16:07:44.560100 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:07:44.560016    2564 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/66277749-1f2d-4c3b-8327-1525d5beb557-model-cache\") on node \"ip-10-0-140-255.ec2.internal\" DevicePath \"\""
Jul 13 16:07:44.561910 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:07:44.561883    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/66277749-1f2d-4c3b-8327-1525d5beb557-dshm" (OuterVolumeSpecName: "dshm") pod "66277749-1f2d-4c3b-8327-1525d5beb557" (UID: "66277749-1f2d-4c3b-8327-1525d5beb557"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 16:07:44.561910 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:07:44.561895    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/66277749-1f2d-4c3b-8327-1525d5beb557-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "66277749-1f2d-4c3b-8327-1525d5beb557" (UID: "66277749-1f2d-4c3b-8327-1525d5beb557"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 13 16:07:44.562076 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:07:44.561954    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/66277749-1f2d-4c3b-8327-1525d5beb557-kube-api-access-rwlwp" (OuterVolumeSpecName: "kube-api-access-rwlwp") pod "66277749-1f2d-4c3b-8327-1525d5beb557" (UID: "66277749-1f2d-4c3b-8327-1525d5beb557"). InnerVolumeSpecName "kube-api-access-rwlwp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 13 16:07:44.661099 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:07:44.661064    2564 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/66277749-1f2d-4c3b-8327-1525d5beb557-dshm\") on node \"ip-10-0-140-255.ec2.internal\" DevicePath \"\""
Jul 13 16:07:44.661099 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:07:44.661096    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rwlwp\" (UniqueName: \"kubernetes.io/projected/66277749-1f2d-4c3b-8327-1525d5beb557-kube-api-access-rwlwp\") on node \"ip-10-0-140-255.ec2.internal\" DevicePath \"\""
Jul 13 16:07:44.661099 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:07:44.661107    2564 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/66277749-1f2d-4c3b-8327-1525d5beb557-tls-certs\") on node \"ip-10-0-140-255.ec2.internal\" DevicePath \"\""
Jul 13 16:07:45.121980 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:07:45.121946    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ec6b44ad-2242-45a6-9dd7-ff46dda91bed" path="/var/lib/kubelet/pods/ec6b44ad-2242-45a6-9dd7-ff46dda91bed/volumes"
Jul 13 16:07:45.469980 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:07:45.469954    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-4293a7/sub-test-model-4293a7-kserve-5994d98859-5svgw"
Jul 13 16:07:45.470433 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:07:45.469957    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-4293a7/sub-test-model-4293a7-kserve-5994d98859-5svgw" event={"ID":"66277749-1f2d-4c3b-8327-1525d5beb557","Type":"ContainerDied","Data":"a964efd69afbec1f36441ac255bf8dc227981f84eb5f8cbde2f1ecec65e520d3"}
Jul 13 16:07:45.470433 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:07:45.470082    2564 scope.go:117] "RemoveContainer" containerID="6bc518e81d7369cbeecf24b040ecef4c75b3d8fe11ef17e95d71e916649653b0"
Jul 13 16:07:45.487675 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:07:45.487652    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-4293a7/sub-test-model-4293a7-kserve-5994d98859-5svgw"]
Jul 13 16:07:45.491788 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:07:45.491767    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-4293a7/sub-test-model-4293a7-kserve-5994d98859-5svgw"]
Jul 13 16:07:47.125566 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:07:47.121930    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="66277749-1f2d-4c3b-8327-1525d5beb557" path="/var/lib/kubelet/pods/66277749-1f2d-4c3b-8327-1525d5beb557/volumes"
Jul 13 16:07:50.948722 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:07:50.948681    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-a1c3e5/rate-test-model-a1c3e5-kserve-6fc9d544dc-s5bgw"
Jul 13 16:07:50.949144 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:07:50.948762    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-a1c3e5/rate-test-model-a1c3e5-kserve-6fc9d544dc-s5bgw"
Jul 13 16:07:50.961446 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:07:50.961423    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-a1c3e5/rate-test-model-a1c3e5-kserve-6fc9d544dc-s5bgw"
Jul 13 16:07:51.513112 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:07:51.513081    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-a1c3e5/rate-test-model-a1c3e5-kserve-6fc9d544dc-s5bgw"
Jul 13 16:07:54.647663 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:07:54.647624    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vhzkf"]
Jul 13 16:07:59.554113 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:07:59.554078    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-4293a7/rate-test-model-4293a7-kserve-5c578b9bb7-zpvv5"]
Jul 13 16:07:59.554567 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:07:59.554418    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="66277749-1f2d-4c3b-8327-1525d5beb557" containerName="main"
Jul 13 16:07:59.554567 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:07:59.554428    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="66277749-1f2d-4c3b-8327-1525d5beb557" containerName="main"
Jul 13 16:07:59.554567 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:07:59.554443    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ec6b44ad-2242-45a6-9dd7-ff46dda91bed" containerName="main"
Jul 13 16:07:59.554567 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:07:59.554448    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="ec6b44ad-2242-45a6-9dd7-ff46dda91bed" containerName="main"
Jul 13 16:07:59.554567 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:07:59.554512    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="ec6b44ad-2242-45a6-9dd7-ff46dda91bed" containerName="main"
Jul 13 16:07:59.554567 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:07:59.554519    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="66277749-1f2d-4c3b-8327-1525d5beb557" containerName="main"
Jul 13 16:07:59.558828 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:07:59.558809    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-4293a7/rate-test-model-4293a7-kserve-5c578b9bb7-zpvv5"
Jul 13 16:07:59.562614 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:07:59.562583    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-4293a7\"/\"default-dockercfg-fb786\""
Jul 13 16:07:59.562753 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:07:59.562633    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-4293a7\"/\"openshift-service-ca.crt\""
Jul 13 16:07:59.562753 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:07:59.562634    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-4293a7\"/\"rate-test-model-4293a7-kserve-self-signed-certs\""
Jul 13 16:07:59.562753 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:07:59.562637    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-4293a7\"/\"kube-root-ca.crt\""
Jul 13 16:07:59.569769 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:07:59.569749    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-4293a7/rate-test-model-4293a7-kserve-5c578b9bb7-zpvv5"]
Jul 13 16:07:59.687497 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:07:59.687464    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wtxrw\" (UniqueName: \"kubernetes.io/projected/56d537e9-c9df-4bd0-bd9c-35a9badfeca3-kube-api-access-wtxrw\") pod \"rate-test-model-4293a7-kserve-5c578b9bb7-zpvv5\" (UID: \"56d537e9-c9df-4bd0-bd9c-35a9badfeca3\") " pod="ai-tenant-e2e-shared-b-4293a7/rate-test-model-4293a7-kserve-5c578b9bb7-zpvv5"
Jul 13 16:07:59.687694 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:07:59.687536    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/56d537e9-c9df-4bd0-bd9c-35a9badfeca3-tls-certs\") pod \"rate-test-model-4293a7-kserve-5c578b9bb7-zpvv5\" (UID: \"56d537e9-c9df-4bd0-bd9c-35a9badfeca3\") " pod="ai-tenant-e2e-shared-b-4293a7/rate-test-model-4293a7-kserve-5c578b9bb7-zpvv5"
Jul 13 16:07:59.687694 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:07:59.687601    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/56d537e9-c9df-4bd0-bd9c-35a9badfeca3-dshm\") pod \"rate-test-model-4293a7-kserve-5c578b9bb7-zpvv5\" (UID: \"56d537e9-c9df-4bd0-bd9c-35a9badfeca3\") " pod="ai-tenant-e2e-shared-b-4293a7/rate-test-model-4293a7-kserve-5c578b9bb7-zpvv5"
Jul 13 16:07:59.687694 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:07:59.687648    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/56d537e9-c9df-4bd0-bd9c-35a9badfeca3-tmp-dir\") pod \"rate-test-model-4293a7-kserve-5c578b9bb7-zpvv5\" (UID: \"56d537e9-c9df-4bd0-bd9c-35a9badfeca3\") " pod="ai-tenant-e2e-shared-b-4293a7/rate-test-model-4293a7-kserve-5c578b9bb7-zpvv5"
Jul 13 16:07:59.687694 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:07:59.687672    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/56d537e9-c9df-4bd0-bd9c-35a9badfeca3-model-cache\") pod \"rate-test-model-4293a7-kserve-5c578b9bb7-zpvv5\" (UID: \"56d537e9-c9df-4bd0-bd9c-35a9badfeca3\") " pod="ai-tenant-e2e-shared-b-4293a7/rate-test-model-4293a7-kserve-5c578b9bb7-zpvv5"
Jul 13 16:07:59.687694 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:07:59.687691    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/56d537e9-c9df-4bd0-bd9c-35a9badfeca3-home\") pod \"rate-test-model-4293a7-kserve-5c578b9bb7-zpvv5\" (UID: \"56d537e9-c9df-4bd0-bd9c-35a9badfeca3\") " pod="ai-tenant-e2e-shared-b-4293a7/rate-test-model-4293a7-kserve-5c578b9bb7-zpvv5"
Jul 13 16:07:59.788861 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:07:59.788822    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/56d537e9-c9df-4bd0-bd9c-35a9badfeca3-tls-certs\") pod \"rate-test-model-4293a7-kserve-5c578b9bb7-zpvv5\" (UID: \"56d537e9-c9df-4bd0-bd9c-35a9badfeca3\") " pod="ai-tenant-e2e-shared-b-4293a7/rate-test-model-4293a7-kserve-5c578b9bb7-zpvv5"
Jul 13 16:07:59.789067 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:07:59.788903    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/56d537e9-c9df-4bd0-bd9c-35a9badfeca3-dshm\") pod \"rate-test-model-4293a7-kserve-5c578b9bb7-zpvv5\" (UID: \"56d537e9-c9df-4bd0-bd9c-35a9badfeca3\") " pod="ai-tenant-e2e-shared-b-4293a7/rate-test-model-4293a7-kserve-5c578b9bb7-zpvv5"
Jul 13 16:07:59.789067 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:07:59.788944    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/56d537e9-c9df-4bd0-bd9c-35a9badfeca3-tmp-dir\") pod \"rate-test-model-4293a7-kserve-5c578b9bb7-zpvv5\" (UID: \"56d537e9-c9df-4bd0-bd9c-35a9badfeca3\") " pod="ai-tenant-e2e-shared-b-4293a7/rate-test-model-4293a7-kserve-5c578b9bb7-zpvv5"
Jul 13 16:07:59.789067 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:07:59.788973    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/56d537e9-c9df-4bd0-bd9c-35a9badfeca3-model-cache\") pod \"rate-test-model-4293a7-kserve-5c578b9bb7-zpvv5\" (UID: \"56d537e9-c9df-4bd0-bd9c-35a9badfeca3\") " pod="ai-tenant-e2e-shared-b-4293a7/rate-test-model-4293a7-kserve-5c578b9bb7-zpvv5"
Jul 13 16:07:59.789067 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:07:59.789002    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/56d537e9-c9df-4bd0-bd9c-35a9badfeca3-home\") pod \"rate-test-model-4293a7-kserve-5c578b9bb7-zpvv5\" (UID: \"56d537e9-c9df-4bd0-bd9c-35a9badfeca3\") " pod="ai-tenant-e2e-shared-b-4293a7/rate-test-model-4293a7-kserve-5c578b9bb7-zpvv5"
Jul 13 16:07:59.789301 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:07:59.789075    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wtxrw\" (UniqueName: \"kubernetes.io/projected/56d537e9-c9df-4bd0-bd9c-35a9badfeca3-kube-api-access-wtxrw\") pod \"rate-test-model-4293a7-kserve-5c578b9bb7-zpvv5\" (UID: \"56d537e9-c9df-4bd0-bd9c-35a9badfeca3\") " pod="ai-tenant-e2e-shared-b-4293a7/rate-test-model-4293a7-kserve-5c578b9bb7-zpvv5"
Jul 13 16:07:59.789430 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:07:59.789401    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/56d537e9-c9df-4bd0-bd9c-35a9badfeca3-model-cache\") pod \"rate-test-model-4293a7-kserve-5c578b9bb7-zpvv5\" (UID: \"56d537e9-c9df-4bd0-bd9c-35a9badfeca3\") " pod="ai-tenant-e2e-shared-b-4293a7/rate-test-model-4293a7-kserve-5c578b9bb7-zpvv5"
Jul 13 16:07:59.789529 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:07:59.789446    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/56d537e9-c9df-4bd0-bd9c-35a9badfeca3-tmp-dir\") pod \"rate-test-model-4293a7-kserve-5c578b9bb7-zpvv5\" (UID: \"56d537e9-c9df-4bd0-bd9c-35a9badfeca3\") " pod="ai-tenant-e2e-shared-b-4293a7/rate-test-model-4293a7-kserve-5c578b9bb7-zpvv5"
Jul 13 16:07:59.789529 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:07:59.789509    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/56d537e9-c9df-4bd0-bd9c-35a9badfeca3-home\") pod \"rate-test-model-4293a7-kserve-5c578b9bb7-zpvv5\" (UID: \"56d537e9-c9df-4bd0-bd9c-35a9badfeca3\") " pod="ai-tenant-e2e-shared-b-4293a7/rate-test-model-4293a7-kserve-5c578b9bb7-zpvv5"
Jul 13 16:07:59.791275 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:07:59.791256    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/56d537e9-c9df-4bd0-bd9c-35a9badfeca3-dshm\") pod \"rate-test-model-4293a7-kserve-5c578b9bb7-zpvv5\" (UID: \"56d537e9-c9df-4bd0-bd9c-35a9badfeca3\") " pod="ai-tenant-e2e-shared-b-4293a7/rate-test-model-4293a7-kserve-5c578b9bb7-zpvv5"
Jul 13 16:07:59.791456 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:07:59.791438    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/56d537e9-c9df-4bd0-bd9c-35a9badfeca3-tls-certs\") pod \"rate-test-model-4293a7-kserve-5c578b9bb7-zpvv5\" (UID: \"56d537e9-c9df-4bd0-bd9c-35a9badfeca3\") " pod="ai-tenant-e2e-shared-b-4293a7/rate-test-model-4293a7-kserve-5c578b9bb7-zpvv5"
Jul 13 16:07:59.798368 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:07:59.798346    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wtxrw\" (UniqueName: \"kubernetes.io/projected/56d537e9-c9df-4bd0-bd9c-35a9badfeca3-kube-api-access-wtxrw\") pod \"rate-test-model-4293a7-kserve-5c578b9bb7-zpvv5\" (UID: \"56d537e9-c9df-4bd0-bd9c-35a9badfeca3\") " pod="ai-tenant-e2e-shared-b-4293a7/rate-test-model-4293a7-kserve-5c578b9bb7-zpvv5"
Jul 13 16:07:59.868639 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:07:59.868549    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-4293a7/rate-test-model-4293a7-kserve-5c578b9bb7-zpvv5"
Jul 13 16:08:00.006393 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:08:00.006367    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-4293a7/rate-test-model-4293a7-kserve-5c578b9bb7-zpvv5"]
Jul 13 16:08:00.008440 ip-10-0-140-255 kubenswrapper[2564]: W0713 16:08:00.008410    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod56d537e9_c9df_4bd0_bd9c_35a9badfeca3.slice/crio-7d6bbcdd96483f7589f05876a0a336e5351ae234ff3fbe9465d5b67b99bc703c WatchSource:0}: Error finding container 7d6bbcdd96483f7589f05876a0a336e5351ae234ff3fbe9465d5b67b99bc703c: Status 404 returned error can't find the container with id 7d6bbcdd96483f7589f05876a0a336e5351ae234ff3fbe9465d5b67b99bc703c
Jul 13 16:08:00.561156 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:08:00.560682    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-4293a7/rate-test-model-4293a7-kserve-5c578b9bb7-zpvv5" event={"ID":"56d537e9-c9df-4bd0-bd9c-35a9badfeca3","Type":"ContainerStarted","Data":"e8606a8286a9df8e1b8f7c9670c4df3535ae32462642ef16420f103c12cc9cd8"}
Jul 13 16:08:00.561156 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:08:00.560737    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-4293a7/rate-test-model-4293a7-kserve-5c578b9bb7-zpvv5" event={"ID":"56d537e9-c9df-4bd0-bd9c-35a9badfeca3","Type":"ContainerStarted","Data":"7d6bbcdd96483f7589f05876a0a336e5351ae234ff3fbe9465d5b67b99bc703c"}
Jul 13 16:08:00.579641 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:08:00.579591    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-4293a7/rate-test-model-4293a7-kserve-5c578b9bb7-zpvv5" podStartSLOduration=1.579575686 podStartE2EDuration="1.579575686s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 16:07:59 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 16:08:00.579242163 +0000 UTC m=+2634.158477342" watchObservedRunningTime="2026-07-13 16:08:00.579575686 +0000 UTC m=+2634.158810863"
Jul 13 16:08:06.046388 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:08:06.046348    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vhzkf"]
Jul 13 16:08:09.869419 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:08:09.869380    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-4293a7/rate-test-model-4293a7-kserve-5c578b9bb7-zpvv5"
Jul 13 16:08:09.869926 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:08:09.869438    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-4293a7/rate-test-model-4293a7-kserve-5c578b9bb7-zpvv5"
Jul 13 16:08:09.888161 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:08:09.888120    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-4293a7/rate-test-model-4293a7-kserve-5c578b9bb7-zpvv5"
Jul 13 16:08:10.627970 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:08:10.627941    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-4293a7/rate-test-model-4293a7-kserve-5c578b9bb7-zpvv5"
Jul 13 16:08:36.848636 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:08:36.848597    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vhzkf"]
Jul 13 16:08:52.533748 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:08:52.533714    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vhzkf"]
Jul 13 16:08:58.782617 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:08:58.782379    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-a1c3e5/rate-test-model-a1c3e5-kserve-6fc9d544dc-s5bgw"]
Jul 13 16:08:59.792719 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:08:59.792678    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-4293a7/rate-test-model-4293a7-kserve-5c578b9bb7-zpvv5"]
Jul 13 16:09:06.536266 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:09:06.536228    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vhzkf"]
Jul 13 16:09:06.898862 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:09:06.898823    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/test-curl-7712-139938564456496"]
Jul 13 16:09:06.902301 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:09:06.902279    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7712-139938564456496"
Jul 13 16:09:06.905127 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:09:06.905097    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-dockercfg-9j5ph\""
Jul 13 16:09:06.907856 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:09:06.907832    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/test-curl-7712-139938564456496"]
Jul 13 16:09:06.990055 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:09:06.990022    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6vfv5\" (UniqueName: \"kubernetes.io/projected/c764ca88-eba0-4494-9e11-671fe58de74c-kube-api-access-6vfv5\") pod \"test-curl-7712-139938564456496\" (UID: \"c764ca88-eba0-4494-9e11-671fe58de74c\") " pod="openshift-ingress/test-curl-7712-139938564456496"
Jul 13 16:09:07.090658 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:09:07.090625    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6vfv5\" (UniqueName: \"kubernetes.io/projected/c764ca88-eba0-4494-9e11-671fe58de74c-kube-api-access-6vfv5\") pod \"test-curl-7712-139938564456496\" (UID: \"c764ca88-eba0-4494-9e11-671fe58de74c\") " pod="openshift-ingress/test-curl-7712-139938564456496"
Jul 13 16:09:07.099003 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:09:07.098974    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6vfv5\" (UniqueName: \"kubernetes.io/projected/c764ca88-eba0-4494-9e11-671fe58de74c-kube-api-access-6vfv5\") pod \"test-curl-7712-139938564456496\" (UID: \"c764ca88-eba0-4494-9e11-671fe58de74c\") " pod="openshift-ingress/test-curl-7712-139938564456496"
Jul 13 16:09:07.142341 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:09:07.142318    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9dq6z_258b7ae3-adf5-437a-8f8e-71bdd1cc665b/ovn-acl-logging/0.log"
Jul 13 16:09:07.153469 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:09:07.153391    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9dq6z_258b7ae3-adf5-437a-8f8e-71bdd1cc665b/ovn-acl-logging/0.log"
Jul 13 16:09:07.212715 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:09:07.212677    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7712-139938564456496"
Jul 13 16:09:07.345238 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:09:07.345209    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/test-curl-7712-139938564456496"]
Jul 13 16:09:07.347135 ip-10-0-140-255 kubenswrapper[2564]: W0713 16:09:07.347074    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc764ca88_eba0_4494_9e11_671fe58de74c.slice/crio-393596e119d3ef3e6da7490e4593ce26a2279a3d8b26797b00a208d3ff631673 WatchSource:0}: Error finding container 393596e119d3ef3e6da7490e4593ce26a2279a3d8b26797b00a208d3ff631673: Status 404 returned error can't find the container with id 393596e119d3ef3e6da7490e4593ce26a2279a3d8b26797b00a208d3ff631673
Jul 13 16:09:07.348736 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:09:07.348709    2564 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 13 16:09:07.915024 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:09:07.914992    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/test-curl-7712-139938564456496" event={"ID":"c764ca88-eba0-4494-9e11-671fe58de74c","Type":"ContainerStarted","Data":"393596e119d3ef3e6da7490e4593ce26a2279a3d8b26797b00a208d3ff631673"}
Jul 13 16:09:08.921771 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:09:08.921734    2564 generic.go:356] "Generic (PLEG): container finished" podID="c764ca88-eba0-4494-9e11-671fe58de74c" containerID="8f7dd5f1cdeee77856a5da4175319126e865e32fc65a37884b831d13b16bdaa9" exitCode=0
Jul 13 16:09:08.921771 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:09:08.921774    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/test-curl-7712-139938564456496" event={"ID":"c764ca88-eba0-4494-9e11-671fe58de74c","Type":"ContainerDied","Data":"8f7dd5f1cdeee77856a5da4175319126e865e32fc65a37884b831d13b16bdaa9"}
Jul 13 16:09:10.072883 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:09:10.072849    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7712-139938564456496"
Jul 13 16:09:10.108637 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:09:10.108604    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_test-curl-7712-139938564456496_c764ca88-eba0-4494-9e11-671fe58de74c/test-curl-7712-139938564456496/0.log"
Jul 13 16:09:10.136802 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:09:10.136762    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/test-curl-7712-139938564456496"]
Jul 13 16:09:10.142327 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:09:10.142300    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/test-curl-7712-139938564456496"]
Jul 13 16:09:10.215968 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:09:10.215856    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6vfv5\" (UniqueName: \"kubernetes.io/projected/c764ca88-eba0-4494-9e11-671fe58de74c-kube-api-access-6vfv5\") pod \"c764ca88-eba0-4494-9e11-671fe58de74c\" (UID: \"c764ca88-eba0-4494-9e11-671fe58de74c\") "
Jul 13 16:09:10.217970 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:09:10.217936    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c764ca88-eba0-4494-9e11-671fe58de74c-kube-api-access-6vfv5" (OuterVolumeSpecName: "kube-api-access-6vfv5") pod "c764ca88-eba0-4494-9e11-671fe58de74c" (UID: "c764ca88-eba0-4494-9e11-671fe58de74c"). InnerVolumeSpecName "kube-api-access-6vfv5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 13 16:09:10.277147 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:09:10.277109    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/test-curl-7712-139938564456496"]
Jul 13 16:09:10.277479 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:09:10.277463    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c764ca88-eba0-4494-9e11-671fe58de74c" containerName="test-curl-7712-139938564456496"
Jul 13 16:09:10.277530 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:09:10.277482    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="c764ca88-eba0-4494-9e11-671fe58de74c" containerName="test-curl-7712-139938564456496"
Jul 13 16:09:10.277572 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:09:10.277560    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="c764ca88-eba0-4494-9e11-671fe58de74c" containerName="test-curl-7712-139938564456496"
Jul 13 16:09:10.280557 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:09:10.280541    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7712-139938564456496"
Jul 13 16:09:10.287780 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:09:10.287720    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/test-curl-7712-139938564456496"]
Jul 13 16:09:10.316587 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:09:10.316552    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6vfv5\" (UniqueName: \"kubernetes.io/projected/c764ca88-eba0-4494-9e11-671fe58de74c-kube-api-access-6vfv5\") on node \"ip-10-0-140-255.ec2.internal\" DevicePath \"\""
Jul 13 16:09:10.417069 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:09:10.417030    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ldwkv\" (UniqueName: \"kubernetes.io/projected/0e28e656-86fe-42cb-8dd8-7e5f9718165c-kube-api-access-ldwkv\") pod \"test-curl-7712-139938564456496\" (UID: \"0e28e656-86fe-42cb-8dd8-7e5f9718165c\") " pod="openshift-ingress/test-curl-7712-139938564456496"
Jul 13 16:09:10.518228 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:09:10.518135    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ldwkv\" (UniqueName: \"kubernetes.io/projected/0e28e656-86fe-42cb-8dd8-7e5f9718165c-kube-api-access-ldwkv\") pod \"test-curl-7712-139938564456496\" (UID: \"0e28e656-86fe-42cb-8dd8-7e5f9718165c\") " pod="openshift-ingress/test-curl-7712-139938564456496"
Jul 13 16:09:10.528040 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:09:10.528017    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ldwkv\" (UniqueName: \"kubernetes.io/projected/0e28e656-86fe-42cb-8dd8-7e5f9718165c-kube-api-access-ldwkv\") pod \"test-curl-7712-139938564456496\" (UID: \"0e28e656-86fe-42cb-8dd8-7e5f9718165c\") " pod="openshift-ingress/test-curl-7712-139938564456496"
Jul 13 16:09:10.590682 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:09:10.590647    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7712-139938564456496"
Jul 13 16:09:10.727366 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:09:10.727336    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/test-curl-7712-139938564456496"]
Jul 13 16:09:10.729069 ip-10-0-140-255 kubenswrapper[2564]: W0713 16:09:10.729040    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod0e28e656_86fe_42cb_8dd8_7e5f9718165c.slice/crio-958855f3532daaa99ecb425f86434053bb4efc7fb199442531fbb87120eb2c09 WatchSource:0}: Error finding container 958855f3532daaa99ecb425f86434053bb4efc7fb199442531fbb87120eb2c09: Status 404 returned error can't find the container with id 958855f3532daaa99ecb425f86434053bb4efc7fb199442531fbb87120eb2c09
Jul 13 16:09:10.933776 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:09:10.933742    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7712-139938564456496"
Jul 13 16:09:10.933962 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:09:10.933798    2564 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="393596e119d3ef3e6da7490e4593ce26a2279a3d8b26797b00a208d3ff631673"
Jul 13 16:09:10.934970 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:09:10.934944    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/test-curl-7712-139938564456496" event={"ID":"0e28e656-86fe-42cb-8dd8-7e5f9718165c","Type":"ContainerStarted","Data":"958855f3532daaa99ecb425f86434053bb4efc7fb199442531fbb87120eb2c09"}
Jul 13 16:09:10.945166 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:09:10.945135    2564 status_manager.go:1027] "Pod was deleted and then recreated, skipping status update" pod="openshift-ingress/test-curl-7712-139938564456496" oldPodUID="c764ca88-eba0-4494-9e11-671fe58de74c" podUID="0e28e656-86fe-42cb-8dd8-7e5f9718165c"
Jul 13 16:09:11.121581 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:09:11.121555    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c764ca88-eba0-4494-9e11-671fe58de74c" path="/var/lib/kubelet/pods/c764ca88-eba0-4494-9e11-671fe58de74c/volumes"
Jul 13 16:09:11.941642 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:09:11.941608    2564 generic.go:356] "Generic (PLEG): container finished" podID="0e28e656-86fe-42cb-8dd8-7e5f9718165c" containerID="7257340cface4bb23c2356b1526614fa5e8bf72172b0f955eccc230bd41a786e" exitCode=0
Jul 13 16:09:11.941826 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:09:11.941691    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/test-curl-7712-139938564456496" event={"ID":"0e28e656-86fe-42cb-8dd8-7e5f9718165c","Type":"ContainerDied","Data":"7257340cface4bb23c2356b1526614fa5e8bf72172b0f955eccc230bd41a786e"}
Jul 13 16:09:13.088748 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:09:13.088727    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7712-139938564456496"
Jul 13 16:09:13.111671 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:09:13.111646    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_test-curl-7712-139938564456496_0e28e656-86fe-42cb-8dd8-7e5f9718165c/test-curl-7712-139938564456496/0.log"
Jul 13 16:09:13.136351 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:09:13.136319    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/test-curl-7712-139938564456496"]
Jul 13 16:09:13.142201 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:09:13.142177    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/test-curl-7712-139938564456496"]
Jul 13 16:09:13.242843 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:09:13.242752    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ldwkv\" (UniqueName: \"kubernetes.io/projected/0e28e656-86fe-42cb-8dd8-7e5f9718165c-kube-api-access-ldwkv\") pod \"0e28e656-86fe-42cb-8dd8-7e5f9718165c\" (UID: \"0e28e656-86fe-42cb-8dd8-7e5f9718165c\") "
Jul 13 16:09:13.244898 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:09:13.244841    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0e28e656-86fe-42cb-8dd8-7e5f9718165c-kube-api-access-ldwkv" (OuterVolumeSpecName: "kube-api-access-ldwkv") pod "0e28e656-86fe-42cb-8dd8-7e5f9718165c" (UID: "0e28e656-86fe-42cb-8dd8-7e5f9718165c"). InnerVolumeSpecName "kube-api-access-ldwkv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 13 16:09:13.344050 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:09:13.344013    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ldwkv\" (UniqueName: \"kubernetes.io/projected/0e28e656-86fe-42cb-8dd8-7e5f9718165c-kube-api-access-ldwkv\") on node \"ip-10-0-140-255.ec2.internal\" DevicePath \"\""
Jul 13 16:09:13.803793 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:09:13.803730    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-a1c3e5/rate-test-model-a1c3e5-kserve-6fc9d544dc-s5bgw" podUID="7ec2e049-d0c1-40c5-a3b6-523149ae3cf9" containerName="main" containerID="cri-o://a3adb5b6e4288581c5596e94fd7a69fd5aab1b8e26f15dfa528d2d19d9c6c7c6" gracePeriod=45
Jul 13 16:09:13.955016 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:09:13.954985    2564 generic.go:356] "Generic (PLEG): container finished" podID="7ec2e049-d0c1-40c5-a3b6-523149ae3cf9" containerID="a3adb5b6e4288581c5596e94fd7a69fd5aab1b8e26f15dfa528d2d19d9c6c7c6" exitCode=0
Jul 13 16:09:13.955173 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:09:13.955056    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-a1c3e5/rate-test-model-a1c3e5-kserve-6fc9d544dc-s5bgw" event={"ID":"7ec2e049-d0c1-40c5-a3b6-523149ae3cf9","Type":"ContainerDied","Data":"a3adb5b6e4288581c5596e94fd7a69fd5aab1b8e26f15dfa528d2d19d9c6c7c6"}
Jul 13 16:09:13.956351 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:09:13.956331    2564 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="958855f3532daaa99ecb425f86434053bb4efc7fb199442531fbb87120eb2c09"
Jul 13 16:09:13.956468 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:09:13.956364    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7712-139938564456496"
Jul 13 16:09:13.967086 ip-10-0-140-255 kubenswrapper[2564]: E0713 16:09:13.967057    2564 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7712-139938564456496\" is forbidden: User \"system:node:ip-10-0-140-255.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-ingress\": no relationship found between node 'ip-10-0-140-255.ec2.internal' and this object" podUID="0e28e656-86fe-42cb-8dd8-7e5f9718165c" pod="openshift-ingress/test-curl-7712-139938564456496"
Jul 13 16:09:14.058672 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:09:14.058608    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-a1c3e5/rate-test-model-a1c3e5-kserve-6fc9d544dc-s5bgw"
Jul 13 16:09:14.061040 ip-10-0-140-255 kubenswrapper[2564]: E0713 16:09:14.061015    2564 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7712-139938564456496\" is forbidden: User \"system:node:ip-10-0-140-255.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-ingress\": no relationship found between node 'ip-10-0-140-255.ec2.internal' and this object" podUID="0e28e656-86fe-42cb-8dd8-7e5f9718165c" pod="openshift-ingress/test-curl-7712-139938564456496"
Jul 13 16:09:14.151257 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:09:14.151212    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7ec2e049-d0c1-40c5-a3b6-523149ae3cf9-tls-certs\") pod \"7ec2e049-d0c1-40c5-a3b6-523149ae3cf9\" (UID: \"7ec2e049-d0c1-40c5-a3b6-523149ae3cf9\") "
Jul 13 16:09:14.151257 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:09:14.151266    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6nfp2\" (UniqueName: \"kubernetes.io/projected/7ec2e049-d0c1-40c5-a3b6-523149ae3cf9-kube-api-access-6nfp2\") pod \"7ec2e049-d0c1-40c5-a3b6-523149ae3cf9\" (UID: \"7ec2e049-d0c1-40c5-a3b6-523149ae3cf9\") "
Jul 13 16:09:14.151829 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:09:14.151344    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7ec2e049-d0c1-40c5-a3b6-523149ae3cf9-dshm\") pod \"7ec2e049-d0c1-40c5-a3b6-523149ae3cf9\" (UID: \"7ec2e049-d0c1-40c5-a3b6-523149ae3cf9\") "
Jul 13 16:09:14.151829 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:09:14.151375    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7ec2e049-d0c1-40c5-a3b6-523149ae3cf9-tmp-dir\") pod \"7ec2e049-d0c1-40c5-a3b6-523149ae3cf9\" (UID: \"7ec2e049-d0c1-40c5-a3b6-523149ae3cf9\") "
Jul 13 16:09:14.151829 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:09:14.151398    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7ec2e049-d0c1-40c5-a3b6-523149ae3cf9-model-cache\") pod \"7ec2e049-d0c1-40c5-a3b6-523149ae3cf9\" (UID: \"7ec2e049-d0c1-40c5-a3b6-523149ae3cf9\") "
Jul 13 16:09:14.151829 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:09:14.151441    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7ec2e049-d0c1-40c5-a3b6-523149ae3cf9-home\") pod \"7ec2e049-d0c1-40c5-a3b6-523149ae3cf9\" (UID: \"7ec2e049-d0c1-40c5-a3b6-523149ae3cf9\") "
Jul 13 16:09:14.151829 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:09:14.151688    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7ec2e049-d0c1-40c5-a3b6-523149ae3cf9-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "7ec2e049-d0c1-40c5-a3b6-523149ae3cf9" (UID: "7ec2e049-d0c1-40c5-a3b6-523149ae3cf9"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 16:09:14.151829 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:09:14.151705    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7ec2e049-d0c1-40c5-a3b6-523149ae3cf9-model-cache" (OuterVolumeSpecName: "model-cache") pod "7ec2e049-d0c1-40c5-a3b6-523149ae3cf9" (UID: "7ec2e049-d0c1-40c5-a3b6-523149ae3cf9"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 16:09:14.151829 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:09:14.151756    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7ec2e049-d0c1-40c5-a3b6-523149ae3cf9-home" (OuterVolumeSpecName: "home") pod "7ec2e049-d0c1-40c5-a3b6-523149ae3cf9" (UID: "7ec2e049-d0c1-40c5-a3b6-523149ae3cf9"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 16:09:14.153548 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:09:14.153527    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7ec2e049-d0c1-40c5-a3b6-523149ae3cf9-dshm" (OuterVolumeSpecName: "dshm") pod "7ec2e049-d0c1-40c5-a3b6-523149ae3cf9" (UID: "7ec2e049-d0c1-40c5-a3b6-523149ae3cf9"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 16:09:14.153657 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:09:14.153639    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7ec2e049-d0c1-40c5-a3b6-523149ae3cf9-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "7ec2e049-d0c1-40c5-a3b6-523149ae3cf9" (UID: "7ec2e049-d0c1-40c5-a3b6-523149ae3cf9"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 13 16:09:14.153752 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:09:14.153731    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7ec2e049-d0c1-40c5-a3b6-523149ae3cf9-kube-api-access-6nfp2" (OuterVolumeSpecName: "kube-api-access-6nfp2") pod "7ec2e049-d0c1-40c5-a3b6-523149ae3cf9" (UID: "7ec2e049-d0c1-40c5-a3b6-523149ae3cf9"). InnerVolumeSpecName "kube-api-access-6nfp2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 13 16:09:14.252818 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:09:14.252770    2564 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7ec2e049-d0c1-40c5-a3b6-523149ae3cf9-tls-certs\") on node \"ip-10-0-140-255.ec2.internal\" DevicePath \"\""
Jul 13 16:09:14.252818 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:09:14.252812    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6nfp2\" (UniqueName: \"kubernetes.io/projected/7ec2e049-d0c1-40c5-a3b6-523149ae3cf9-kube-api-access-6nfp2\") on node \"ip-10-0-140-255.ec2.internal\" DevicePath \"\""
Jul 13 16:09:14.252818 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:09:14.252822    2564 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7ec2e049-d0c1-40c5-a3b6-523149ae3cf9-dshm\") on node \"ip-10-0-140-255.ec2.internal\" DevicePath \"\""
Jul 13 16:09:14.253090 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:09:14.252853    2564 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7ec2e049-d0c1-40c5-a3b6-523149ae3cf9-tmp-dir\") on node \"ip-10-0-140-255.ec2.internal\" DevicePath \"\""
Jul 13 16:09:14.253090 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:09:14.252862    2564 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7ec2e049-d0c1-40c5-a3b6-523149ae3cf9-model-cache\") on node \"ip-10-0-140-255.ec2.internal\" DevicePath \"\""
Jul 13 16:09:14.253090 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:09:14.252892    2564 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7ec2e049-d0c1-40c5-a3b6-523149ae3cf9-home\") on node \"ip-10-0-140-255.ec2.internal\" DevicePath \"\""
Jul 13 16:09:14.812503 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:09:14.812462    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-4293a7/rate-test-model-4293a7-kserve-5c578b9bb7-zpvv5" podUID="56d537e9-c9df-4bd0-bd9c-35a9badfeca3" containerName="main" containerID="cri-o://e8606a8286a9df8e1b8f7c9670c4df3535ae32462642ef16420f103c12cc9cd8" gracePeriod=45
Jul 13 16:09:14.963908 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:09:14.963855    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-a1c3e5/rate-test-model-a1c3e5-kserve-6fc9d544dc-s5bgw"
Jul 13 16:09:14.963908 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:09:14.963886    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-a1c3e5/rate-test-model-a1c3e5-kserve-6fc9d544dc-s5bgw" event={"ID":"7ec2e049-d0c1-40c5-a3b6-523149ae3cf9","Type":"ContainerDied","Data":"cb16eec7b1d9a87faf7b48ec993ec45c98a513c95eb5865f2e04e5812fc3cd4e"}
Jul 13 16:09:14.964143 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:09:14.963935    2564 scope.go:117] "RemoveContainer" containerID="a3adb5b6e4288581c5596e94fd7a69fd5aab1b8e26f15dfa528d2d19d9c6c7c6"
Jul 13 16:09:14.965599 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:09:14.965575    2564 generic.go:356] "Generic (PLEG): container finished" podID="56d537e9-c9df-4bd0-bd9c-35a9badfeca3" containerID="e8606a8286a9df8e1b8f7c9670c4df3535ae32462642ef16420f103c12cc9cd8" exitCode=0
Jul 13 16:09:14.965702 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:09:14.965629    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-4293a7/rate-test-model-4293a7-kserve-5c578b9bb7-zpvv5" event={"ID":"56d537e9-c9df-4bd0-bd9c-35a9badfeca3","Type":"ContainerDied","Data":"e8606a8286a9df8e1b8f7c9670c4df3535ae32462642ef16420f103c12cc9cd8"}
Jul 13 16:09:14.966553 ip-10-0-140-255 kubenswrapper[2564]: E0713 16:09:14.966527    2564 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7712-139938564456496\" is forbidden: User \"system:node:ip-10-0-140-255.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-ingress\": no relationship found between node 'ip-10-0-140-255.ec2.internal' and this object" podUID="0e28e656-86fe-42cb-8dd8-7e5f9718165c" pod="openshift-ingress/test-curl-7712-139938564456496"
Jul 13 16:09:14.974512 ip-10-0-140-255 kubenswrapper[2564]: E0713 16:09:14.974491    2564 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7712-139938564456496\" is forbidden: User \"system:node:ip-10-0-140-255.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-ingress\": no relationship found between node 'ip-10-0-140-255.ec2.internal' and this object" podUID="0e28e656-86fe-42cb-8dd8-7e5f9718165c" pod="openshift-ingress/test-curl-7712-139938564456496"
Jul 13 16:09:14.987288 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:09:14.987264    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-a1c3e5/rate-test-model-a1c3e5-kserve-6fc9d544dc-s5bgw"]
Jul 13 16:09:14.990324 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:09:14.990300    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-a1c3e5/rate-test-model-a1c3e5-kserve-6fc9d544dc-s5bgw"]
Jul 13 16:09:15.063208 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:09:15.063154    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-4293a7/rate-test-model-4293a7-kserve-5c578b9bb7-zpvv5"
Jul 13 16:09:15.082522 ip-10-0-140-255 kubenswrapper[2564]: E0713 16:09:15.082489    2564 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7712-139938564456496\" is forbidden: User \"system:node:ip-10-0-140-255.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-ingress\": no relationship found between node 'ip-10-0-140-255.ec2.internal' and this object" podUID="0e28e656-86fe-42cb-8dd8-7e5f9718165c" pod="openshift-ingress/test-curl-7712-139938564456496"
Jul 13 16:09:15.121192 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:09:15.121158    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0e28e656-86fe-42cb-8dd8-7e5f9718165c" path="/var/lib/kubelet/pods/0e28e656-86fe-42cb-8dd8-7e5f9718165c/volumes"
Jul 13 16:09:15.121594 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:09:15.121580    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7ec2e049-d0c1-40c5-a3b6-523149ae3cf9" path="/var/lib/kubelet/pods/7ec2e049-d0c1-40c5-a3b6-523149ae3cf9/volumes"
Jul 13 16:09:15.160819 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:09:15.160788    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/56d537e9-c9df-4bd0-bd9c-35a9badfeca3-model-cache\") pod \"56d537e9-c9df-4bd0-bd9c-35a9badfeca3\" (UID: \"56d537e9-c9df-4bd0-bd9c-35a9badfeca3\") "
Jul 13 16:09:15.161294 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:09:15.160833    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/56d537e9-c9df-4bd0-bd9c-35a9badfeca3-tmp-dir\") pod \"56d537e9-c9df-4bd0-bd9c-35a9badfeca3\" (UID: \"56d537e9-c9df-4bd0-bd9c-35a9badfeca3\") "
Jul 13 16:09:15.161294 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:09:15.160919    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/56d537e9-c9df-4bd0-bd9c-35a9badfeca3-home\") pod \"56d537e9-c9df-4bd0-bd9c-35a9badfeca3\" (UID: \"56d537e9-c9df-4bd0-bd9c-35a9badfeca3\") "
Jul 13 16:09:15.161294 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:09:15.160948    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/56d537e9-c9df-4bd0-bd9c-35a9badfeca3-dshm\") pod \"56d537e9-c9df-4bd0-bd9c-35a9badfeca3\" (UID: \"56d537e9-c9df-4bd0-bd9c-35a9badfeca3\") "
Jul 13 16:09:15.161294 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:09:15.161017    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/56d537e9-c9df-4bd0-bd9c-35a9badfeca3-tls-certs\") pod \"56d537e9-c9df-4bd0-bd9c-35a9badfeca3\" (UID: \"56d537e9-c9df-4bd0-bd9c-35a9badfeca3\") "
Jul 13 16:09:15.161294 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:09:15.161059    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wtxrw\" (UniqueName: \"kubernetes.io/projected/56d537e9-c9df-4bd0-bd9c-35a9badfeca3-kube-api-access-wtxrw\") pod \"56d537e9-c9df-4bd0-bd9c-35a9badfeca3\" (UID: \"56d537e9-c9df-4bd0-bd9c-35a9badfeca3\") "
Jul 13 16:09:15.161294 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:09:15.161126    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/56d537e9-c9df-4bd0-bd9c-35a9badfeca3-model-cache" (OuterVolumeSpecName: "model-cache") pod "56d537e9-c9df-4bd0-bd9c-35a9badfeca3" (UID: "56d537e9-c9df-4bd0-bd9c-35a9badfeca3"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 16:09:15.161294 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:09:15.161136    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/56d537e9-c9df-4bd0-bd9c-35a9badfeca3-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "56d537e9-c9df-4bd0-bd9c-35a9badfeca3" (UID: "56d537e9-c9df-4bd0-bd9c-35a9badfeca3"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 16:09:15.161294 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:09:15.161235    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/56d537e9-c9df-4bd0-bd9c-35a9badfeca3-home" (OuterVolumeSpecName: "home") pod "56d537e9-c9df-4bd0-bd9c-35a9badfeca3" (UID: "56d537e9-c9df-4bd0-bd9c-35a9badfeca3"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 16:09:15.161615 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:09:15.161327    2564 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/56d537e9-c9df-4bd0-bd9c-35a9badfeca3-model-cache\") on node \"ip-10-0-140-255.ec2.internal\" DevicePath \"\""
Jul 13 16:09:15.161615 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:09:15.161344    2564 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/56d537e9-c9df-4bd0-bd9c-35a9badfeca3-tmp-dir\") on node \"ip-10-0-140-255.ec2.internal\" DevicePath \"\""
Jul 13 16:09:15.161615 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:09:15.161355    2564 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/56d537e9-c9df-4bd0-bd9c-35a9badfeca3-home\") on node \"ip-10-0-140-255.ec2.internal\" DevicePath \"\""
Jul 13 16:09:15.163160 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:09:15.163139    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/56d537e9-c9df-4bd0-bd9c-35a9badfeca3-dshm" (OuterVolumeSpecName: "dshm") pod "56d537e9-c9df-4bd0-bd9c-35a9badfeca3" (UID: "56d537e9-c9df-4bd0-bd9c-35a9badfeca3"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 16:09:15.163247 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:09:15.163233    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/56d537e9-c9df-4bd0-bd9c-35a9badfeca3-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "56d537e9-c9df-4bd0-bd9c-35a9badfeca3" (UID: "56d537e9-c9df-4bd0-bd9c-35a9badfeca3"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 13 16:09:15.163300 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:09:15.163266    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/56d537e9-c9df-4bd0-bd9c-35a9badfeca3-kube-api-access-wtxrw" (OuterVolumeSpecName: "kube-api-access-wtxrw") pod "56d537e9-c9df-4bd0-bd9c-35a9badfeca3" (UID: "56d537e9-c9df-4bd0-bd9c-35a9badfeca3"). InnerVolumeSpecName "kube-api-access-wtxrw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 13 16:09:15.261859 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:09:15.261817    2564 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/56d537e9-c9df-4bd0-bd9c-35a9badfeca3-tls-certs\") on node \"ip-10-0-140-255.ec2.internal\" DevicePath \"\""
Jul 13 16:09:15.261859 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:09:15.261849    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wtxrw\" (UniqueName: \"kubernetes.io/projected/56d537e9-c9df-4bd0-bd9c-35a9badfeca3-kube-api-access-wtxrw\") on node \"ip-10-0-140-255.ec2.internal\" DevicePath \"\""
Jul 13 16:09:15.261859 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:09:15.261862    2564 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/56d537e9-c9df-4bd0-bd9c-35a9badfeca3-dshm\") on node \"ip-10-0-140-255.ec2.internal\" DevicePath \"\""
Jul 13 16:09:15.892144 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:09:15.892099    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/test-curl-7712-139938564457504"]
Jul 13 16:09:15.892468 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:09:15.892457    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7ec2e049-d0c1-40c5-a3b6-523149ae3cf9" containerName="main"
Jul 13 16:09:15.892523 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:09:15.892470    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="7ec2e049-d0c1-40c5-a3b6-523149ae3cf9" containerName="main"
Jul 13 16:09:15.892523 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:09:15.892479    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="56d537e9-c9df-4bd0-bd9c-35a9badfeca3" containerName="main"
Jul 13 16:09:15.892523 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:09:15.892485    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="56d537e9-c9df-4bd0-bd9c-35a9badfeca3" containerName="main"
Jul 13 16:09:15.892523 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:09:15.892495    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0e28e656-86fe-42cb-8dd8-7e5f9718165c" containerName="test-curl-7712-139938564456496"
Jul 13 16:09:15.892523 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:09:15.892501    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="0e28e656-86fe-42cb-8dd8-7e5f9718165c" containerName="test-curl-7712-139938564456496"
Jul 13 16:09:15.892682 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:09:15.892563    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="7ec2e049-d0c1-40c5-a3b6-523149ae3cf9" containerName="main"
Jul 13 16:09:15.892682 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:09:15.892569    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="0e28e656-86fe-42cb-8dd8-7e5f9718165c" containerName="test-curl-7712-139938564456496"
Jul 13 16:09:15.892682 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:09:15.892577    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="56d537e9-c9df-4bd0-bd9c-35a9badfeca3" containerName="main"
Jul 13 16:09:15.896440 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:09:15.896424    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7712-139938564457504"
Jul 13 16:09:15.898981 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:09:15.898957    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-dockercfg-9j5ph\""
Jul 13 16:09:15.900307 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:09:15.900284    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/test-curl-7712-139938564457504"]
Jul 13 16:09:15.973286 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:09:15.973255    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-4293a7/rate-test-model-4293a7-kserve-5c578b9bb7-zpvv5"
Jul 13 16:09:15.973451 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:09:15.973255    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-4293a7/rate-test-model-4293a7-kserve-5c578b9bb7-zpvv5" event={"ID":"56d537e9-c9df-4bd0-bd9c-35a9badfeca3","Type":"ContainerDied","Data":"7d6bbcdd96483f7589f05876a0a336e5351ae234ff3fbe9465d5b67b99bc703c"}
Jul 13 16:09:15.973451 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:09:15.973376    2564 scope.go:117] "RemoveContainer" containerID="e8606a8286a9df8e1b8f7c9670c4df3535ae32462642ef16420f103c12cc9cd8"
Jul 13 16:09:15.994313 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:09:15.994283    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-4293a7/rate-test-model-4293a7-kserve-5c578b9bb7-zpvv5"]
Jul 13 16:09:15.997982 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:09:15.997955    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-4293a7/rate-test-model-4293a7-kserve-5c578b9bb7-zpvv5"]
Jul 13 16:09:16.069561 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:09:16.069520    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vdp66\" (UniqueName: \"kubernetes.io/projected/1152eb5c-10d3-424b-88eb-02687d3401c5-kube-api-access-vdp66\") pod \"test-curl-7712-139938564457504\" (UID: \"1152eb5c-10d3-424b-88eb-02687d3401c5\") " pod="openshift-ingress/test-curl-7712-139938564457504"
Jul 13 16:09:16.171197 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:09:16.171115    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vdp66\" (UniqueName: \"kubernetes.io/projected/1152eb5c-10d3-424b-88eb-02687d3401c5-kube-api-access-vdp66\") pod \"test-curl-7712-139938564457504\" (UID: \"1152eb5c-10d3-424b-88eb-02687d3401c5\") " pod="openshift-ingress/test-curl-7712-139938564457504"
Jul 13 16:09:16.179572 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:09:16.179541    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vdp66\" (UniqueName: \"kubernetes.io/projected/1152eb5c-10d3-424b-88eb-02687d3401c5-kube-api-access-vdp66\") pod \"test-curl-7712-139938564457504\" (UID: \"1152eb5c-10d3-424b-88eb-02687d3401c5\") " pod="openshift-ingress/test-curl-7712-139938564457504"
Jul 13 16:09:16.206387 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:09:16.206361    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7712-139938564457504"
Jul 13 16:09:16.339348 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:09:16.339319    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/test-curl-7712-139938564457504"]
Jul 13 16:09:16.340972 ip-10-0-140-255 kubenswrapper[2564]: W0713 16:09:16.340951    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod1152eb5c_10d3_424b_88eb_02687d3401c5.slice/crio-183ba53279e63a4dd190c4db474728d352f6840f45f27a4dade6ec2bdbe9c4cd WatchSource:0}: Error finding container 183ba53279e63a4dd190c4db474728d352f6840f45f27a4dade6ec2bdbe9c4cd: Status 404 returned error can't find the container with id 183ba53279e63a4dd190c4db474728d352f6840f45f27a4dade6ec2bdbe9c4cd
Jul 13 16:09:16.979536 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:09:16.979440    2564 generic.go:356] "Generic (PLEG): container finished" podID="1152eb5c-10d3-424b-88eb-02687d3401c5" containerID="0bce6b6d2cfbcce725dbd1b1924f6b2e6940118c37c67391a6f2a425316acb4d" exitCode=0
Jul 13 16:09:16.979536 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:09:16.979525    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/test-curl-7712-139938564457504" event={"ID":"1152eb5c-10d3-424b-88eb-02687d3401c5","Type":"ContainerDied","Data":"0bce6b6d2cfbcce725dbd1b1924f6b2e6940118c37c67391a6f2a425316acb4d"}
Jul 13 16:09:16.979767 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:09:16.979561    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/test-curl-7712-139938564457504" event={"ID":"1152eb5c-10d3-424b-88eb-02687d3401c5","Type":"ContainerStarted","Data":"183ba53279e63a4dd190c4db474728d352f6840f45f27a4dade6ec2bdbe9c4cd"}
Jul 13 16:09:17.120724 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:09:17.120686    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="56d537e9-c9df-4bd0-bd9c-35a9badfeca3" path="/var/lib/kubelet/pods/56d537e9-c9df-4bd0-bd9c-35a9badfeca3/volumes"
Jul 13 16:09:18.129859 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:09:18.129836    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7712-139938564457504"
Jul 13 16:09:18.152669 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:09:18.152647    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_test-curl-7712-139938564457504_1152eb5c-10d3-424b-88eb-02687d3401c5/test-curl-7712-139938564457504/0.log"
Jul 13 16:09:18.184402 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:09:18.184362    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/test-curl-7712-139938564457504"]
Jul 13 16:09:18.186143 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:09:18.186120    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/test-curl-7712-139938564457504"]
Jul 13 16:09:18.189046 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:09:18.189016    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vdp66\" (UniqueName: \"kubernetes.io/projected/1152eb5c-10d3-424b-88eb-02687d3401c5-kube-api-access-vdp66\") pod \"1152eb5c-10d3-424b-88eb-02687d3401c5\" (UID: \"1152eb5c-10d3-424b-88eb-02687d3401c5\") "
Jul 13 16:09:18.191053 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:09:18.191031    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1152eb5c-10d3-424b-88eb-02687d3401c5-kube-api-access-vdp66" (OuterVolumeSpecName: "kube-api-access-vdp66") pod "1152eb5c-10d3-424b-88eb-02687d3401c5" (UID: "1152eb5c-10d3-424b-88eb-02687d3401c5"). InnerVolumeSpecName "kube-api-access-vdp66". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 13 16:09:18.290019 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:09:18.289935    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vdp66\" (UniqueName: \"kubernetes.io/projected/1152eb5c-10d3-424b-88eb-02687d3401c5-kube-api-access-vdp66\") on node \"ip-10-0-140-255.ec2.internal\" DevicePath \"\""
Jul 13 16:09:18.993165 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:09:18.993133    2564 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="183ba53279e63a4dd190c4db474728d352f6840f45f27a4dade6ec2bdbe9c4cd"
Jul 13 16:09:18.993315 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:09:18.993176    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7712-139938564457504"
Jul 13 16:09:19.003488 ip-10-0-140-255 kubenswrapper[2564]: E0713 16:09:19.003454    2564 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7712-139938564457504\" is forbidden: User \"system:node:ip-10-0-140-255.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-ingress\": no relationship found between node 'ip-10-0-140-255.ec2.internal' and this object" podUID="1152eb5c-10d3-424b-88eb-02687d3401c5" pod="openshift-ingress/test-curl-7712-139938564457504"
Jul 13 16:09:19.121835 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:09:19.121801    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1152eb5c-10d3-424b-88eb-02687d3401c5" path="/var/lib/kubelet/pods/1152eb5c-10d3-424b-88eb-02687d3401c5/volumes"
Jul 13 16:09:32.726997 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:09:32.726966    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vhzkf"]
Jul 13 16:09:58.329724 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:09:58.329691    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vhzkf"]
Jul 13 16:10:10.982751 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:10:10.982713    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-696b7747d-pm77l_49441811-4489-41af-98cc-637d93026f93/authorino/0.log"
Jul 13 16:10:16.270634 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:10:16.270598    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-jxf6r_23916f62-f418-4c34-a70e-5c0de1d648ff/server/0.log"
Jul 13 16:10:16.393851 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:10:16.393816    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-dqc4z_83fb3625-eb75-4872-8a24-703f2b5455dd/manager/0.log"
Jul 13 16:10:16.508240 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:10:16.508211    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7695c54b44-ftgf9_805b0797-42e8-46a5-b519-328b7411896e/copy-manifests/0.log"
Jul 13 16:10:16.516296 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:10:16.516271    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7695c54b44-ftgf9_805b0797-42e8-46a5-b519-328b7411896e/manager/0.log"
Jul 13 16:10:19.617092 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:10:19.617059    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759vslrv_a29f56cc-5a85-4bb7-a894-2241247faf6a/util/0.log"
Jul 13 16:10:19.623700 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:10:19.623674    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759vslrv_a29f56cc-5a85-4bb7-a894-2241247faf6a/pull/0.log"
Jul 13 16:10:19.629582 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:10:19.629554    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759vslrv_a29f56cc-5a85-4bb7-a894-2241247faf6a/extract/0.log"
Jul 13 16:10:19.743946 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:10:19.743916    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0lp4tx_7f3a77c5-69ba-408f-9094-8141f494ba9b/util/0.log"
Jul 13 16:10:19.750541 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:10:19.750511    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0lp4tx_7f3a77c5-69ba-408f-9094-8141f494ba9b/pull/0.log"
Jul 13 16:10:19.756989 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:10:19.756959    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0lp4tx_7f3a77c5-69ba-408f-9094-8141f494ba9b/extract/0.log"
Jul 13 16:10:19.868536 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:10:19.868453    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73czf72_759670f8-b077-456c-b4bf-e65e8ceca720/util/0.log"
Jul 13 16:10:19.875305 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:10:19.875280    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73czf72_759670f8-b077-456c-b4bf-e65e8ceca720/pull/0.log"
Jul 13 16:10:19.881946 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:10:19.881923    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73czf72_759670f8-b077-456c-b4bf-e65e8ceca720/extract/0.log"
Jul 13 16:10:19.994209 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:10:19.994179    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12fr6s_c7b0aa49-e174-4a4d-ba47-0f56e757cc28/util/0.log"
Jul 13 16:10:20.000481 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:10:20.000446    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12fr6s_c7b0aa49-e174-4a4d-ba47-0f56e757cc28/pull/0.log"
Jul 13 16:10:20.007468 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:10:20.007442    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12fr6s_c7b0aa49-e174-4a4d-ba47-0f56e757cc28/extract/0.log"
Jul 13 16:10:20.133226 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:10:20.133189    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-696b7747d-pm77l_49441811-4489-41af-98cc-637d93026f93/authorino/0.log"
Jul 13 16:10:20.370917 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:10:20.370860    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-qj6f8_a2812859-d0c6-4564-84f0-5dbd80a45dd1/manager/0.log"
Jul 13 16:10:20.482856 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:10:20.482779    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-m4kqm_9b58983c-3823-4319-9664-96111d5494bc/kuadrant-console-plugin/0.log"
Jul 13 16:10:20.875578 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:10:20.875494    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-vhzkf_c5b486ab-64ea-44d9-86a0-cb7d18d49dcf/limitador/0.log"
Jul 13 16:10:21.724612 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:10:21.724579    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-6f57b96f59-q68cf_3440af5d-72f3-48bf-bf40-d85097bac921/kube-auth-proxy/0.log"
Jul 13 16:10:22.787019 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:10:22.786991    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-598466548d-ktz5c_716d9d72-0646-46dd-964c-2d0d0278d23e/main/0.log"
Jul 13 16:10:23.131508 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:10:23.131474    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-5fc6fb456f-9wkqm_4bcede8b-bab1-4646-8bcf-e80787192fdb/main/0.log"
Jul 13 16:10:30.600705 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:10:30.600626    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-75h9t_84c5054b-6b5c-4b21-992a-cbd68bf1b4f2/global-pull-secret-syncer/0.log"
Jul 13 16:10:30.856268 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:10:30.856182    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-v8r47_7687fe5c-b22f-40ba-af3e-b74095ec910c/konnectivity-agent/0.log"
Jul 13 16:10:30.919849 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:10:30.919822    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-140-255.ec2.internal_92665f5a3cb50772f6b086b04422f9c8/haproxy/0.log"
Jul 13 16:10:34.804359 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:10:34.804319    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759vslrv_a29f56cc-5a85-4bb7-a894-2241247faf6a/extract/0.log"
Jul 13 16:10:34.825165 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:10:34.825137    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759vslrv_a29f56cc-5a85-4bb7-a894-2241247faf6a/util/0.log"
Jul 13 16:10:34.844836 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:10:34.844809    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759vslrv_a29f56cc-5a85-4bb7-a894-2241247faf6a/pull/0.log"
Jul 13 16:10:34.871002 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:10:34.870964    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0lp4tx_7f3a77c5-69ba-408f-9094-8141f494ba9b/extract/0.log"
Jul 13 16:10:34.906921 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:10:34.906852    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0lp4tx_7f3a77c5-69ba-408f-9094-8141f494ba9b/util/0.log"
Jul 13 16:10:34.937259 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:10:34.937228    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0lp4tx_7f3a77c5-69ba-408f-9094-8141f494ba9b/pull/0.log"
Jul 13 16:10:34.962733 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:10:34.962701    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73czf72_759670f8-b077-456c-b4bf-e65e8ceca720/extract/0.log"
Jul 13 16:10:34.983507 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:10:34.983484    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73czf72_759670f8-b077-456c-b4bf-e65e8ceca720/util/0.log"
Jul 13 16:10:35.013775 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:10:35.013742    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73czf72_759670f8-b077-456c-b4bf-e65e8ceca720/pull/0.log"
Jul 13 16:10:35.037931 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:10:35.037907    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12fr6s_c7b0aa49-e174-4a4d-ba47-0f56e757cc28/extract/0.log"
Jul 13 16:10:35.056037 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:10:35.055957    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12fr6s_c7b0aa49-e174-4a4d-ba47-0f56e757cc28/util/0.log"
Jul 13 16:10:35.077607 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:10:35.077575    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12fr6s_c7b0aa49-e174-4a4d-ba47-0f56e757cc28/pull/0.log"
Jul 13 16:10:35.580741 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:10:35.580709    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-696b7747d-pm77l_49441811-4489-41af-98cc-637d93026f93/authorino/0.log"
Jul 13 16:10:35.628306 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:10:35.628275    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-qj6f8_a2812859-d0c6-4564-84f0-5dbd80a45dd1/manager/0.log"
Jul 13 16:10:35.667886 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:10:35.667852    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-m4kqm_9b58983c-3823-4319-9664-96111d5494bc/kuadrant-console-plugin/0.log"
Jul 13 16:10:35.911882 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:10:35.911835    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-vhzkf_c5b486ab-64ea-44d9-86a0-cb7d18d49dcf/limitador/0.log"
Jul 13 16:10:37.522553 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:10:37.522521    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_10c75331-88b1-4742-b10b-bc974e245162/alertmanager/0.log"
Jul 13 16:10:37.541540 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:10:37.541507    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_10c75331-88b1-4742-b10b-bc974e245162/config-reloader/0.log"
Jul 13 16:10:37.559509 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:10:37.559438    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_10c75331-88b1-4742-b10b-bc974e245162/kube-rbac-proxy-web/0.log"
Jul 13 16:10:37.582361 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:10:37.582340    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_10c75331-88b1-4742-b10b-bc974e245162/kube-rbac-proxy/0.log"
Jul 13 16:10:37.606139 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:10:37.606111    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_10c75331-88b1-4742-b10b-bc974e245162/kube-rbac-proxy-metric/0.log"
Jul 13 16:10:37.625399 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:10:37.625371    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_10c75331-88b1-4742-b10b-bc974e245162/prom-label-proxy/0.log"
Jul 13 16:10:37.649739 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:10:37.649711    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_10c75331-88b1-4742-b10b-bc974e245162/init-config-reloader/0.log"
Jul 13 16:10:37.732828 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:10:37.732797    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-785778ff74-9nmfd_36c089c7-2008-444f-bb90-c398b04bd569/kube-state-metrics/0.log"
Jul 13 16:10:37.750099 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:10:37.750075    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-785778ff74-9nmfd_36c089c7-2008-444f-bb90-c398b04bd569/kube-rbac-proxy-main/0.log"
Jul 13 16:10:37.769027 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:10:37.769002    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-785778ff74-9nmfd_36c089c7-2008-444f-bb90-c398b04bd569/kube-rbac-proxy-self/0.log"
Jul 13 16:10:37.816039 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:10:37.815956    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-5f68df7f58-c7nm7_13ed4799-2ed4-44a9-93a5-89dacfe15702/monitoring-plugin/0.log"
Jul 13 16:10:37.843590 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:10:37.843562    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-59248_269be8b3-99be-405a-bbcc-f0c8c65d7a01/node-exporter/0.log"
Jul 13 16:10:37.861045 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:10:37.861024    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-59248_269be8b3-99be-405a-bbcc-f0c8c65d7a01/kube-rbac-proxy/0.log"
Jul 13 16:10:37.879103 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:10:37.879083    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-59248_269be8b3-99be-405a-bbcc-f0c8c65d7a01/init-textfile/0.log"
Jul 13 16:10:38.411749 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:10:38.411722    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-77d98bc786-v6bcf_120cd9ec-defa-4943-9679-79cc335cc915/prometheus-operator-admission-webhook/0.log"
Jul 13 16:10:38.445576 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:10:38.445547    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-68fbd76bb6-d8pmc_997a6543-33f9-4f8c-a8e8-9f625137038f/telemeter-client/0.log"
Jul 13 16:10:38.471714 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:10:38.471685    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-68fbd76bb6-d8pmc_997a6543-33f9-4f8c-a8e8-9f625137038f/reload/0.log"
Jul 13 16:10:38.495708 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:10:38.495678    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-68fbd76bb6-d8pmc_997a6543-33f9-4f8c-a8e8-9f625137038f/kube-rbac-proxy/0.log"
Jul 13 16:10:40.725778 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:10:40.725740    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-s8tpw/perf-node-gather-daemonset-w9v7k"]
Jul 13 16:10:40.726307 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:10:40.726183    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1152eb5c-10d3-424b-88eb-02687d3401c5" containerName="test-curl-7712-139938564457504"
Jul 13 16:10:40.726307 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:10:40.726223    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="1152eb5c-10d3-424b-88eb-02687d3401c5" containerName="test-curl-7712-139938564457504"
Jul 13 16:10:40.726469 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:10:40.726339    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="1152eb5c-10d3-424b-88eb-02687d3401c5" containerName="test-curl-7712-139938564457504"
Jul 13 16:10:40.729752 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:10:40.729735    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-s8tpw/perf-node-gather-daemonset-w9v7k"
Jul 13 16:10:40.732128 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:10:40.732103    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-s8tpw\"/\"openshift-service-ca.crt\""
Jul 13 16:10:40.732235 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:10:40.732195    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-s8tpw\"/\"kube-root-ca.crt\""
Jul 13 16:10:40.733117 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:10:40.733096    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-s8tpw\"/\"default-dockercfg-qxzff\""
Jul 13 16:10:40.739216 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:10:40.739193    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-s8tpw/perf-node-gather-daemonset-w9v7k"]
Jul 13 16:10:40.830029 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:10:40.829993    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/bf7309dd-3ae6-4084-bbb2-e78481742d02-podres\") pod \"perf-node-gather-daemonset-w9v7k\" (UID: \"bf7309dd-3ae6-4084-bbb2-e78481742d02\") " pod="openshift-must-gather-s8tpw/perf-node-gather-daemonset-w9v7k"
Jul 13 16:10:40.830029 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:10:40.830032    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-frfqs\" (UniqueName: \"kubernetes.io/projected/bf7309dd-3ae6-4084-bbb2-e78481742d02-kube-api-access-frfqs\") pod \"perf-node-gather-daemonset-w9v7k\" (UID: \"bf7309dd-3ae6-4084-bbb2-e78481742d02\") " pod="openshift-must-gather-s8tpw/perf-node-gather-daemonset-w9v7k"
Jul 13 16:10:40.830241 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:10:40.830162    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/bf7309dd-3ae6-4084-bbb2-e78481742d02-proc\") pod \"perf-node-gather-daemonset-w9v7k\" (UID: \"bf7309dd-3ae6-4084-bbb2-e78481742d02\") " pod="openshift-must-gather-s8tpw/perf-node-gather-daemonset-w9v7k"
Jul 13 16:10:40.830241 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:10:40.830191    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/bf7309dd-3ae6-4084-bbb2-e78481742d02-sys\") pod \"perf-node-gather-daemonset-w9v7k\" (UID: \"bf7309dd-3ae6-4084-bbb2-e78481742d02\") " pod="openshift-must-gather-s8tpw/perf-node-gather-daemonset-w9v7k"
Jul 13 16:10:40.830241 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:10:40.830220    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/bf7309dd-3ae6-4084-bbb2-e78481742d02-lib-modules\") pod \"perf-node-gather-daemonset-w9v7k\" (UID: \"bf7309dd-3ae6-4084-bbb2-e78481742d02\") " pod="openshift-must-gather-s8tpw/perf-node-gather-daemonset-w9v7k"
Jul 13 16:10:40.931065 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:10:40.931031    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/bf7309dd-3ae6-4084-bbb2-e78481742d02-podres\") pod \"perf-node-gather-daemonset-w9v7k\" (UID: \"bf7309dd-3ae6-4084-bbb2-e78481742d02\") " pod="openshift-must-gather-s8tpw/perf-node-gather-daemonset-w9v7k"
Jul 13 16:10:40.931065 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:10:40.931068    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-frfqs\" (UniqueName: \"kubernetes.io/projected/bf7309dd-3ae6-4084-bbb2-e78481742d02-kube-api-access-frfqs\") pod \"perf-node-gather-daemonset-w9v7k\" (UID: \"bf7309dd-3ae6-4084-bbb2-e78481742d02\") " pod="openshift-must-gather-s8tpw/perf-node-gather-daemonset-w9v7k"
Jul 13 16:10:40.931279 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:10:40.931168    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/bf7309dd-3ae6-4084-bbb2-e78481742d02-proc\") pod \"perf-node-gather-daemonset-w9v7k\" (UID: \"bf7309dd-3ae6-4084-bbb2-e78481742d02\") " pod="openshift-must-gather-s8tpw/perf-node-gather-daemonset-w9v7k"
Jul 13 16:10:40.931279 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:10:40.931192    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/bf7309dd-3ae6-4084-bbb2-e78481742d02-sys\") pod \"perf-node-gather-daemonset-w9v7k\" (UID: \"bf7309dd-3ae6-4084-bbb2-e78481742d02\") " pod="openshift-must-gather-s8tpw/perf-node-gather-daemonset-w9v7k"
Jul 13 16:10:40.931279 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:10:40.931218    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/bf7309dd-3ae6-4084-bbb2-e78481742d02-podres\") pod \"perf-node-gather-daemonset-w9v7k\" (UID: \"bf7309dd-3ae6-4084-bbb2-e78481742d02\") " pod="openshift-must-gather-s8tpw/perf-node-gather-daemonset-w9v7k"
Jul 13 16:10:40.931279 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:10:40.931229    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/bf7309dd-3ae6-4084-bbb2-e78481742d02-lib-modules\") pod \"perf-node-gather-daemonset-w9v7k\" (UID: \"bf7309dd-3ae6-4084-bbb2-e78481742d02\") " pod="openshift-must-gather-s8tpw/perf-node-gather-daemonset-w9v7k"
Jul 13 16:10:40.931413 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:10:40.931313    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/bf7309dd-3ae6-4084-bbb2-e78481742d02-lib-modules\") pod \"perf-node-gather-daemonset-w9v7k\" (UID: \"bf7309dd-3ae6-4084-bbb2-e78481742d02\") " pod="openshift-must-gather-s8tpw/perf-node-gather-daemonset-w9v7k"
Jul 13 16:10:40.931413 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:10:40.931317    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/bf7309dd-3ae6-4084-bbb2-e78481742d02-sys\") pod \"perf-node-gather-daemonset-w9v7k\" (UID: \"bf7309dd-3ae6-4084-bbb2-e78481742d02\") " pod="openshift-must-gather-s8tpw/perf-node-gather-daemonset-w9v7k"
Jul 13 16:10:40.931413 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:10:40.931317    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/bf7309dd-3ae6-4084-bbb2-e78481742d02-proc\") pod \"perf-node-gather-daemonset-w9v7k\" (UID: \"bf7309dd-3ae6-4084-bbb2-e78481742d02\") " pod="openshift-must-gather-s8tpw/perf-node-gather-daemonset-w9v7k"
Jul 13 16:10:40.939783 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:10:40.939758    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-frfqs\" (UniqueName: \"kubernetes.io/projected/bf7309dd-3ae6-4084-bbb2-e78481742d02-kube-api-access-frfqs\") pod \"perf-node-gather-daemonset-w9v7k\" (UID: \"bf7309dd-3ae6-4084-bbb2-e78481742d02\") " pod="openshift-must-gather-s8tpw/perf-node-gather-daemonset-w9v7k"
Jul 13 16:10:41.040860 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:10:41.040765    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-s8tpw/perf-node-gather-daemonset-w9v7k"
Jul 13 16:10:41.175899 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:10:41.175851    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-s8tpw/perf-node-gather-daemonset-w9v7k"]
Jul 13 16:10:41.178335 ip-10-0-140-255 kubenswrapper[2564]: W0713 16:10:41.178302    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podbf7309dd_3ae6_4084_bbb2_e78481742d02.slice/crio-3097e39b8d7046edfeabd104e004a7e669561b773102c6f74b9d9ef87a410fa9 WatchSource:0}: Error finding container 3097e39b8d7046edfeabd104e004a7e669561b773102c6f74b9d9ef87a410fa9: Status 404 returned error can't find the container with id 3097e39b8d7046edfeabd104e004a7e669561b773102c6f74b9d9ef87a410fa9
Jul 13 16:10:41.443998 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:10:41.443965    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-s8tpw/perf-node-gather-daemonset-w9v7k" event={"ID":"bf7309dd-3ae6-4084-bbb2-e78481742d02","Type":"ContainerStarted","Data":"bc0f24a4757157a092845af7d7899c56872b42094caf482a353749d8d5e09a9f"}
Jul 13 16:10:41.444175 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:10:41.444017    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-s8tpw/perf-node-gather-daemonset-w9v7k" event={"ID":"bf7309dd-3ae6-4084-bbb2-e78481742d02","Type":"ContainerStarted","Data":"3097e39b8d7046edfeabd104e004a7e669561b773102c6f74b9d9ef87a410fa9"}
Jul 13 16:10:41.444175 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:10:41.444104    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-s8tpw/perf-node-gather-daemonset-w9v7k"
Jul 13 16:10:41.460946 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:10:41.460893    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-s8tpw/perf-node-gather-daemonset-w9v7k" podStartSLOduration=1.460857193 podStartE2EDuration="1.460857193s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-13 16:10:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 16:10:41.46019012 +0000 UTC m=+2795.039425299" watchObservedRunningTime="2026-07-13 16:10:41.460857193 +0000 UTC m=+2795.040092370"
Jul 13 16:10:42.848131 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:10:42.848094    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-xml8d_79a02cca-4b4d-4550-8a21-f20f13e159af/dns/0.log"
Jul 13 16:10:42.866070 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:10:42.866043    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-xml8d_79a02cca-4b4d-4550-8a21-f20f13e159af/kube-rbac-proxy/0.log"
Jul 13 16:10:42.929951 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:10:42.929926    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-vmz75_697aa34e-8473-49a1-a7dd-8be4f23ea1b3/dns-node-resolver/0.log"
Jul 13 16:10:43.476389 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:10:43.476354    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-56fb9f5477-z82hh_da805e4c-bc0d-461a-a749-f3493be924b8/registry/0.log"
Jul 13 16:10:43.545034 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:10:43.545003    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-zq68g_7897ab94-b445-4dd1-9475-4a316db407a2/node-ca/0.log"
Jul 13 16:10:44.712625 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:10:44.712593    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-6f57b96f59-q68cf_3440af5d-72f3-48bf-bf40-d85097bac921/kube-auth-proxy/0.log"
Jul 13 16:10:45.584509 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:10:45.584474    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-sc4kw_e33696de-d117-4fb9-a514-ad79951752f3/serve-healthcheck-canary/0.log"
Jul 13 16:10:46.159549 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:10:46.159521    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-j9pwk_2b3d1ed0-50ff-416a-8589-ef4124fdee16/kube-rbac-proxy/0.log"
Jul 13 16:10:46.179095 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:10:46.179061    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-j9pwk_2b3d1ed0-50ff-416a-8589-ef4124fdee16/exporter/0.log"
Jul 13 16:10:46.203653 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:10:46.203624    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-j9pwk_2b3d1ed0-50ff-416a-8589-ef4124fdee16/extractor/0.log"
Jul 13 16:10:47.458747 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:10:47.458718    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-s8tpw/perf-node-gather-daemonset-w9v7k"
Jul 13 16:10:48.788096 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:10:48.788052    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-jxf6r_23916f62-f418-4c34-a70e-5c0de1d648ff/server/0.log"
Jul 13 16:10:48.888454 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:10:48.888425    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-dqc4z_83fb3625-eb75-4872-8a24-703f2b5455dd/manager/0.log"
Jul 13 16:10:48.911538 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:10:48.911504    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7695c54b44-ftgf9_805b0797-42e8-46a5-b519-328b7411896e/manager/0.log"
Jul 13 16:10:48.928231 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:10:48.928203    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7695c54b44-ftgf9_805b0797-42e8-46a5-b519-328b7411896e/copy-manifests/0.log"
Jul 13 16:10:50.217530 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:10:50.217501    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-7b567978d6-sp4hs_5240d9b4-ff9e-495b-a184-2e5753c828cd/manager/0.log"
Jul 13 16:10:51.195381 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:10:51.195344    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-6f57b96f59-q68cf_3440af5d-72f3-48bf-bf40-d85097bac921/kube-auth-proxy/0.log"
Jul 13 16:10:52.807675 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:10:52.807643    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-6f57b96f59-q68cf_3440af5d-72f3-48bf-bf40-d85097bac921/kube-auth-proxy/0.log"
Jul 13 16:10:57.337444 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:10:57.337396    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-t8ljw_a0cd4788-5dd7-402b-9364-7588dcd91951/kube-multus-additional-cni-plugins/0.log"
Jul 13 16:10:57.356228 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:10:57.356197    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-t8ljw_a0cd4788-5dd7-402b-9364-7588dcd91951/egress-router-binary-copy/0.log"
Jul 13 16:10:57.375532 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:10:57.375508    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-t8ljw_a0cd4788-5dd7-402b-9364-7588dcd91951/cni-plugins/0.log"
Jul 13 16:10:57.394160 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:10:57.394137    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-t8ljw_a0cd4788-5dd7-402b-9364-7588dcd91951/bond-cni-plugin/0.log"
Jul 13 16:10:57.415473 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:10:57.415449    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-t8ljw_a0cd4788-5dd7-402b-9364-7588dcd91951/routeoverride-cni/0.log"
Jul 13 16:10:57.436135 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:10:57.436099    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-t8ljw_a0cd4788-5dd7-402b-9364-7588dcd91951/whereabouts-cni-bincopy/0.log"
Jul 13 16:10:57.453569 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:10:57.453549    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-t8ljw_a0cd4788-5dd7-402b-9364-7588dcd91951/whereabouts-cni/0.log"
Jul 13 16:10:57.641207 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:10:57.641181    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-q24vk_ca6016f5-c1af-4395-bdf0-e642bf637019/kube-multus/0.log"
Jul 13 16:10:57.702955 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:10:57.702924    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-8whd7_9c040000-a5ce-49b2-b7a8-6faedac4708f/network-metrics-daemon/0.log"
Jul 13 16:10:57.719585 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:10:57.719556    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-8whd7_9c040000-a5ce-49b2-b7a8-6faedac4708f/kube-rbac-proxy/0.log"
Jul 13 16:10:58.599470 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:10:58.599436    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9dq6z_258b7ae3-adf5-437a-8f8e-71bdd1cc665b/ovn-controller/0.log"
Jul 13 16:10:58.613718 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:10:58.613691    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9dq6z_258b7ae3-adf5-437a-8f8e-71bdd1cc665b/ovn-acl-logging/1.log"
Jul 13 16:10:58.613911 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:10:58.613729    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9dq6z_258b7ae3-adf5-437a-8f8e-71bdd1cc665b/ovn-acl-logging/0.log"
Jul 13 16:10:58.628882 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:10:58.628844    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9dq6z_258b7ae3-adf5-437a-8f8e-71bdd1cc665b/kube-rbac-proxy-node/0.log"
Jul 13 16:10:58.646934 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:10:58.646894    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9dq6z_258b7ae3-adf5-437a-8f8e-71bdd1cc665b/kube-rbac-proxy-ovn-metrics/0.log"
Jul 13 16:10:58.665453 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:10:58.665426    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9dq6z_258b7ae3-adf5-437a-8f8e-71bdd1cc665b/northd/0.log"
Jul 13 16:10:58.684223 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:10:58.684197    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9dq6z_258b7ae3-adf5-437a-8f8e-71bdd1cc665b/nbdb/0.log"
Jul 13 16:10:58.704075 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:10:58.704046    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9dq6z_258b7ae3-adf5-437a-8f8e-71bdd1cc665b/sbdb/0.log"
Jul 13 16:10:58.782164 ip-10-0-140-255 kubenswrapper[2564]: I0713 16:10:58.782134    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9dq6z_258b7ae3-adf5-437a-8f8e-71bdd1cc665b/ovnkube-controller/0.log"