Jul 09 18:25:28.973045 ip-10-0-141-101 systemd[1]: Starting Kubernetes Kubelet...
Jul 09 18:25:29.382348 ip-10-0-141-101 kubenswrapper[2557]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 09 18:25:29.382348 ip-10-0-141-101 kubenswrapper[2557]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jul 09 18:25:29.382348 ip-10-0-141-101 kubenswrapper[2557]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 09 18:25:29.382348 ip-10-0-141-101 kubenswrapper[2557]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jul 09 18:25:29.382348 ip-10-0-141-101 kubenswrapper[2557]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 09 18:25:29.382348 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:29.301597    2557 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jul 09 18:25:29.382348 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:25:29.305221    2557 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 09 18:25:29.382348 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:25:29.305234    2557 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 09 18:25:29.382348 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:25:29.305239    2557 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 09 18:25:29.382348 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:25:29.305244    2557 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 09 18:25:29.382348 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:25:29.305248    2557 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 09 18:25:29.382348 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:25:29.305251    2557 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 09 18:25:29.382348 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:25:29.305254    2557 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 09 18:25:29.382348 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:25:29.305257    2557 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 09 18:25:29.372471 ip-10-0-141-101 systemd[1]: Started Kubernetes Kubelet.
Jul 09 18:25:29.383455 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:25:29.305260    2557 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 09 18:25:29.383455 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:25:29.305263    2557 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 09 18:25:29.383455 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:25:29.305266    2557 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 09 18:25:29.383455 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:25:29.305269    2557 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 09 18:25:29.383455 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:25:29.305272    2557 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 09 18:25:29.383455 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:25:29.305276    2557 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 09 18:25:29.383455 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:25:29.305286    2557 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 09 18:25:29.383455 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:25:29.305290    2557 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 09 18:25:29.383455 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:25:29.305293    2557 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 09 18:25:29.383455 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:25:29.305296    2557 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 09 18:25:29.383455 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:25:29.305299    2557 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 09 18:25:29.383455 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:25:29.305301    2557 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 09 18:25:29.383455 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:25:29.305304    2557 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 09 18:25:29.383455 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:25:29.305306    2557 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 09 18:25:29.383455 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:25:29.305309    2557 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 09 18:25:29.383455 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:25:29.305312    2557 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 09 18:25:29.383455 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:25:29.305314    2557 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 09 18:25:29.383455 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:25:29.305317    2557 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 09 18:25:29.383455 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:25:29.305319    2557 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 09 18:25:29.383455 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:25:29.305322    2557 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 09 18:25:29.384522 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:25:29.305325    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 09 18:25:29.384522 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:25:29.305328    2557 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 09 18:25:29.384522 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:25:29.305331    2557 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 09 18:25:29.384522 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:25:29.305333    2557 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 09 18:25:29.384522 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:25:29.305336    2557 feature_gate.go:328] unrecognized feature gate: Example
Jul 09 18:25:29.384522 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:25:29.305338    2557 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 09 18:25:29.384522 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:25:29.305340    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 09 18:25:29.384522 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:25:29.305343    2557 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 09 18:25:29.384522 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:25:29.305345    2557 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 09 18:25:29.384522 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:25:29.305348    2557 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 09 18:25:29.384522 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:25:29.305351    2557 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 09 18:25:29.384522 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:25:29.305353    2557 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 09 18:25:29.384522 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:25:29.305356    2557 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 09 18:25:29.384522 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:25:29.305359    2557 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 09 18:25:29.384522 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:25:29.305362    2557 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 09 18:25:29.384522 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:25:29.305365    2557 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 09 18:25:29.384522 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:25:29.305368    2557 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 09 18:25:29.384522 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:25:29.305371    2557 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 09 18:25:29.384522 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:25:29.305373    2557 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 09 18:25:29.384522 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:25:29.305376    2557 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 09 18:25:29.385211 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:25:29.305378    2557 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 09 18:25:29.385211 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:25:29.305381    2557 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 09 18:25:29.385211 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:25:29.305383    2557 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 09 18:25:29.385211 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:25:29.305386    2557 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 09 18:25:29.385211 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:25:29.305388    2557 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 09 18:25:29.385211 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:25:29.305391    2557 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 09 18:25:29.385211 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:25:29.305393    2557 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 09 18:25:29.385211 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:25:29.305396    2557 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 09 18:25:29.385211 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:25:29.305398    2557 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 09 18:25:29.385211 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:25:29.305402    2557 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 09 18:25:29.385211 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:25:29.305405    2557 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 09 18:25:29.385211 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:25:29.305408    2557 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 09 18:25:29.385211 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:25:29.305410    2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 09 18:25:29.385211 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:25:29.305412    2557 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 09 18:25:29.385211 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:25:29.305415    2557 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 09 18:25:29.385211 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:25:29.305417    2557 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 09 18:25:29.385211 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:25:29.305420    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 09 18:25:29.385211 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:25:29.305422    2557 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 09 18:25:29.385211 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:25:29.305425    2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 09 18:25:29.385211 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:25:29.305428    2557 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 09 18:25:29.389178 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:25:29.305430    2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 09 18:25:29.389178 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:25:29.305434    2557 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 09 18:25:29.389178 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:25:29.305436    2557 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 09 18:25:29.389178 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:25:29.305439    2557 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 09 18:25:29.389178 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:25:29.305442    2557 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 09 18:25:29.389178 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:25:29.305444    2557 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 09 18:25:29.389178 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:25:29.305448    2557 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 09 18:25:29.389178 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:25:29.305451    2557 feature_gate.go:328] unrecognized feature gate: Example2
Jul 09 18:25:29.389178 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:25:29.305453    2557 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 09 18:25:29.389178 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:25:29.305456    2557 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 09 18:25:29.389178 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:25:29.305459    2557 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 09 18:25:29.389178 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:25:29.305462    2557 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 09 18:25:29.389178 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:25:29.305467    2557 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 09 18:25:29.389178 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:25:29.305469    2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 09 18:25:29.389178 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:25:29.305472    2557 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 09 18:25:29.389178 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:25:29.305474    2557 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 09 18:25:29.389178 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:25:29.305477    2557 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 09 18:25:29.389178 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:25:29.305481    2557 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 09 18:25:29.389178 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:25:29.305486    2557 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 09 18:25:29.391063 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:25:29.305489    2557 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 09 18:25:29.391063 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:25:29.305492    2557 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 09 18:25:29.391063 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:25:29.305495    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 09 18:25:29.391063 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:25:29.305498    2557 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 09 18:25:29.391063 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:25:29.305503    2557 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 09 18:25:29.391063 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:25:29.305506    2557 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 09 18:25:29.391063 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:25:29.305509    2557 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 09 18:25:29.391063 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:25:29.305512    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 09 18:25:29.391063 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:25:29.305514    2557 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 09 18:25:29.391063 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:25:29.305517    2557 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 09 18:25:29.391063 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:25:29.305519    2557 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 09 18:25:29.391063 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:25:29.305522    2557 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 09 18:25:29.391063 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:25:29.306229    2557 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 09 18:25:29.391063 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:25:29.306236    2557 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 09 18:25:29.391063 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:25:29.306239    2557 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 09 18:25:29.391063 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:25:29.306242    2557 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 09 18:25:29.391063 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:25:29.306245    2557 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 09 18:25:29.391063 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:25:29.306249    2557 feature_gate.go:328] unrecognized feature gate: Example2
Jul 09 18:25:29.391063 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:25:29.306252    2557 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 09 18:25:29.391063 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:25:29.306255    2557 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 09 18:25:29.391752 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:25:29.306258    2557 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 09 18:25:29.391752 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:25:29.306261    2557 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 09 18:25:29.391752 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:25:29.306263    2557 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 09 18:25:29.391752 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:25:29.306266    2557 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 09 18:25:29.391752 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:25:29.306269    2557 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 09 18:25:29.391752 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:25:29.306272    2557 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 09 18:25:29.391752 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:25:29.306275    2557 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 09 18:25:29.391752 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:25:29.306277    2557 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 09 18:25:29.391752 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:25:29.306281    2557 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 09 18:25:29.391752 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:25:29.306285    2557 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 09 18:25:29.391752 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:25:29.306287    2557 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 09 18:25:29.391752 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:25:29.306290    2557 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 09 18:25:29.391752 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:25:29.306293    2557 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 09 18:25:29.391752 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:25:29.306296    2557 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 09 18:25:29.391752 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:25:29.306299    2557 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 09 18:25:29.391752 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:25:29.306301    2557 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 09 18:25:29.391752 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:25:29.306304    2557 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 09 18:25:29.391752 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:25:29.306306    2557 feature_gate.go:328] unrecognized feature gate: Example
Jul 09 18:25:29.391752 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:25:29.306309    2557 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 09 18:25:29.394566 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:25:29.306311    2557 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 09 18:25:29.394566 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:25:29.306314    2557 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 09 18:25:29.394566 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:25:29.306316    2557 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 09 18:25:29.394566 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:25:29.306319    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 09 18:25:29.394566 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:25:29.306321    2557 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 09 18:25:29.394566 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:25:29.306324    2557 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 09 18:25:29.394566 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:25:29.306326    2557 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 09 18:25:29.394566 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:25:29.306328    2557 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 09 18:25:29.394566 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:25:29.306331    2557 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 09 18:25:29.394566 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:25:29.306334    2557 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 09 18:25:29.394566 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:25:29.306336    2557 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 09 18:25:29.394566 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:25:29.306340    2557 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 09 18:25:29.394566 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:25:29.306343    2557 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 09 18:25:29.394566 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:25:29.306346    2557 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 09 18:25:29.394566 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:25:29.306350    2557 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 09 18:25:29.394566 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:25:29.306353    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 09 18:25:29.394566 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:25:29.306356    2557 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 09 18:25:29.394566 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:25:29.306359    2557 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 09 18:25:29.394566 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:25:29.306361    2557 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 09 18:25:29.394566 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:25:29.306364    2557 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 09 18:25:29.395208 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:25:29.306366    2557 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 09 18:25:29.395208 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:25:29.306369    2557 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 09 18:25:29.395208 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:25:29.306371    2557 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 09 18:25:29.395208 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:25:29.306374    2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 09 18:25:29.395208 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:25:29.306377    2557 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 09 18:25:29.395208 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:25:29.306379    2557 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 09 18:25:29.395208 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:25:29.306382    2557 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 09 18:25:29.395208 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:25:29.306386    2557 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 09 18:25:29.395208 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:25:29.306390    2557 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 09 18:25:29.395208 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:25:29.306394    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 09 18:25:29.395208 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:25:29.306396    2557 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 09 18:25:29.395208 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:25:29.306399    2557 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 09 18:25:29.395208 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:25:29.306402    2557 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 09 18:25:29.395208 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:25:29.306406    2557 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 09 18:25:29.395208 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:25:29.306410    2557 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 09 18:25:29.395208 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:25:29.306413    2557 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 09 18:25:29.395208 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:25:29.306415    2557 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 09 18:25:29.395208 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:25:29.306419    2557 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 09 18:25:29.395208 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:25:29.306421    2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 09 18:25:31.261422 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:25:29.306424    2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 09 18:25:31.261422 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:25:29.306426    2557 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 09 18:25:31.261422 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:25:29.306429    2557 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 09 18:25:31.261422 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:25:29.306435    2557 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 09 18:25:31.261422 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:25:29.306437    2557 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 09 18:25:31.261422 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:25:29.306441    2557 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 09 18:25:31.261422 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:25:29.306444    2557 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 09 18:25:31.261422 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:25:29.306447    2557 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 09 18:25:31.261422 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:25:29.306449    2557 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 09 18:25:31.261422 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:25:29.306452    2557 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 09 18:25:31.261422 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:25:29.306454    2557 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 09 18:25:31.261422 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:25:29.306457    2557 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 09 18:25:31.261422 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:25:29.306459    2557 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 09 18:25:31.261422 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:25:29.306462    2557 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 09 18:25:31.261422 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:25:29.306465    2557 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 09 18:25:31.261422 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:25:29.306467    2557 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 09 18:25:31.261422 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:25:29.306470    2557 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 09 18:25:31.261422 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:25:29.306472    2557 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 09 18:25:31.261422 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:25:29.306475    2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 09 18:25:31.261422 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:25:29.306477    2557 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 09 18:25:31.282984 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:25:29.306480    2557 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 09 18:25:31.282984 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:25:29.306482    2557 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 09 18:25:31.282984 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:25:29.306485    2557 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 09 18:25:31.282984 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:25:29.306488    2557 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 09 18:25:31.282984 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:25:29.306490    2557 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 09 18:25:31.282984 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:25:29.306493    2557 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 09 18:25:31.282984 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:25:29.306495    2557 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 09 18:25:31.282984 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:25:29.306498    2557 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 09 18:25:31.282984 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:25:29.306502    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 09 18:25:31.282984 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:25:29.306505    2557 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 09 18:25:31.282984 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:25:29.306507    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 09 18:25:31.282984 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:25:29.306510    2557 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 09 18:25:31.282984 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:25:29.306513    2557 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 09 18:25:31.282984 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:25:29.306965    2557 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 09 18:25:31.282984 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:25:29.306972    2557 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 09 18:25:31.282984 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:25:29.306976    2557 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 09 18:25:31.282984 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:25:29.306979    2557 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 09 18:25:31.282984 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:25:29.306983    2557 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 09 18:25:31.282984 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:25:29.306986    2557 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 09 18:25:31.282984 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:25:29.306989    2557 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 09 18:25:31.292648 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:25:29.306992    2557 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 09 18:25:31.292648 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:25:29.306995    2557 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 09 18:25:31.292648 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:25:29.306998    2557 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 09 18:25:31.292648 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:25:29.307001    2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 09 18:25:31.292648 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:25:29.307003    2557 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 09 18:25:31.292648 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:25:29.307007    2557 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 09 18:25:31.292648 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:25:29.307010    2557 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 09 18:25:31.292648 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:25:29.307013    2557 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 09 18:25:31.292648 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:25:29.307016    2557 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 09 18:25:31.292648 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:25:29.307018    2557 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 09 18:25:31.292648 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:25:29.307021    2557 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 09 18:25:31.292648 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:25:29.307024    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 09 18:25:31.292648 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:25:29.307026    2557 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 09 18:25:31.292648 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:25:29.307028    2557 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 09 18:25:31.292648 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:25:29.307031    2557 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 09 18:25:31.292648 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:25:29.307034    2557 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 09 18:25:31.292648 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:25:29.307036    2557 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 09 18:25:31.292648 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:25:29.307039    2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 09 18:25:31.292648 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:25:29.307041    2557 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 09 18:25:31.294468 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:25:29.307044    2557 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 09 18:25:31.294468 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:25:29.307048    2557 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 09 18:25:31.294468 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:25:29.307051    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 09 18:25:31.294468 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:25:29.307053    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 09 18:25:31.294468 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:25:29.307056    2557 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 09 18:25:31.294468 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:25:29.307059    2557 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 09 18:25:31.294468 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:25:29.307062    2557 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 09 18:25:31.294468 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:25:29.307064    2557 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 09 18:25:31.294468 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:25:29.307068    2557 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 09 18:25:31.294468 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:25:29.307071    2557 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 09 18:25:31.294468 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:25:29.307073    2557 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 09 18:25:31.294468 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:25:29.307079    2557 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 09 18:25:31.294468 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:25:29.307083    2557 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 09 18:25:31.294468 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:25:29.307086    2557 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 09 18:25:31.294468 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:25:29.307089    2557 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 09 18:25:31.294468 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:25:29.307091    2557 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 09 18:25:31.294468 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:25:29.307094    2557 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 09 18:25:31.294468 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:25:29.307097    2557 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 09 18:25:31.294468 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:25:29.307099    2557 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 09 18:25:31.294468 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:25:29.307102    2557 feature_gate.go:328] unrecognized feature gate: Example2
Jul 09 18:25:31.295424 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:25:29.307104    2557 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 09 18:25:31.295424 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:25:29.307107    2557 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 09 18:25:31.295424 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:25:29.307109    2557 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 09 18:25:31.295424 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:25:29.307112    2557 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 09 18:25:31.295424 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:25:29.307115    2557 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 09 18:25:31.295424 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:25:29.307117    2557 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 09 18:25:31.295424 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:25:29.307120    2557 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 09 18:25:31.295424 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:25:29.307122    2557 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 09 18:25:31.295424 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:25:29.307125    2557 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 09 18:25:31.295424 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:25:29.307127    2557 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 09 18:25:31.295424 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:25:29.307130    2557 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 09 18:25:31.295424 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:25:29.307132    2557 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 09 18:25:31.295424 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:25:29.307135    2557 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 09 18:25:31.295424 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:25:29.307140    2557 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 09 18:25:31.295424 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:25:29.307143    2557 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 09 18:25:31.295424 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:25:29.307146    2557 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 09 18:25:31.295424 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:25:29.307148    2557 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 09 18:25:31.295424 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:25:29.307151    2557 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 09 18:25:31.295424 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:25:29.307153    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 09 18:25:31.295424 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:25:29.307156    2557 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 09 18:25:31.297377 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:25:29.307160    2557 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 09 18:25:31.297377 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:25:29.307163    2557 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 09 18:25:31.297377 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:25:29.307165    2557 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 09 18:25:31.297377 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:25:29.307168    2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 09 18:25:31.297377 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:25:29.307171    2557 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 09 18:25:31.297377 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:25:29.307174    2557 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 09 18:25:31.297377 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:25:29.307176    2557 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 09 18:25:31.297377 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:25:29.307179    2557 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 09 18:25:31.297377 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:25:29.307181    2557 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 09 18:25:31.297377 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:25:29.307184    2557 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 09 18:25:31.297377 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:25:29.307186    2557 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 09 18:25:31.297377 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:25:29.307189    2557 feature_gate.go:328] unrecognized feature gate: Example
Jul 09 18:25:31.297377 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:25:29.307191    2557 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 09 18:25:31.297377 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:25:29.307194    2557 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 09 18:25:31.297377 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:25:29.307196    2557 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 09 18:25:31.297377 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:25:29.307199    2557 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 09 18:25:31.297377 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:25:29.307201    2557 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 09 18:25:31.297377 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:25:29.307204    2557 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 09 18:25:31.297377 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:25:29.307207    2557 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 09 18:25:31.297377 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:25:29.307209    2557 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 09 18:25:31.298368 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:25:29.307212    2557 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 09 18:25:31.298368 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:25:29.307215    2557 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 09 18:25:31.298368 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:25:29.307217    2557 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 09 18:25:31.298368 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:25:29.307220    2557 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 09 18:25:31.298368 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:25:29.307222    2557 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 09 18:25:31.298368 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:25:29.307226    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 09 18:25:31.298368 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:25:29.307229    2557 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 09 18:25:31.298368 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:25:29.307231    2557 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 09 18:25:31.298368 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:25:29.307234    2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 09 18:25:31.298368 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:25:29.307236    2557 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 09 18:25:31.298368 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:25:29.307239    2557 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 09 18:25:31.298368 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:25:29.307243    2557 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 09 18:25:31.298368 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:25:29.307247    2557 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 09 18:25:31.298368 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:29.307315    2557 flags.go:64] FLAG: --address="0.0.0.0"
Jul 09 18:25:31.298368 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:29.307322    2557 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jul 09 18:25:31.298368 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:29.307329    2557 flags.go:64] FLAG: --anonymous-auth="true"
Jul 09 18:25:31.298368 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:29.307334    2557 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jul 09 18:25:31.298368 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:29.307338    2557 flags.go:64] FLAG: --authentication-token-webhook="false"
Jul 09 18:25:31.298368 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:29.307342    2557 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jul 09 18:25:31.298368 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:29.307347    2557 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jul 09 18:25:31.298368 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:29.307356    2557 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jul 09 18:25:31.299826 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:29.307359    2557 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jul 09 18:25:31.299826 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:29.307362    2557 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jul 09 18:25:31.299826 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:29.307366    2557 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jul 09 18:25:31.299826 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:29.307369    2557 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jul 09 18:25:31.299826 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:29.307372    2557 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jul 09 18:25:31.299826 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:29.307375    2557 flags.go:64] FLAG: --cgroup-root=""
Jul 09 18:25:31.299826 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:29.307378    2557 flags.go:64] FLAG: --cgroups-per-qos="true"
Jul 09 18:25:31.299826 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:29.307381    2557 flags.go:64] FLAG: --client-ca-file=""
Jul 09 18:25:31.299826 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:29.307384    2557 flags.go:64] FLAG: --cloud-provider="external"
Jul 09 18:25:31.299826 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:29.307387    2557 flags.go:64] FLAG: --cluster-dns="[]"
Jul 09 18:25:31.299826 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:29.307391    2557 flags.go:64] FLAG: --cluster-domain=""
Jul 09 18:25:31.299826 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:29.307394    2557 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jul 09 18:25:31.299826 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:29.307397    2557 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jul 09 18:25:31.299826 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:29.307400    2557 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jul 09 18:25:31.299826 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:29.307403    2557 flags.go:64] FLAG: --container-log-max-files="5"
Jul 09 18:25:31.299826 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:29.307407    2557 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jul 09 18:25:31.299826 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:29.307411    2557 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jul 09 18:25:31.299826 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:29.307414    2557 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jul 09 18:25:31.299826 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:29.307417    2557 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jul 09 18:25:31.299826 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:29.307420    2557 flags.go:64] FLAG: --contention-profiling="false"
Jul 09 18:25:31.299826 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:29.307423    2557 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jul 09 18:25:31.299826 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:29.307426    2557 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jul 09 18:25:31.299826 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:29.307429    2557 flags.go:64] FLAG: --cpu-manager-policy="none"
Jul 09 18:25:31.299826 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:29.307433    2557 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jul 09 18:25:31.301270 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:29.307438    2557 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jul 09 18:25:31.301270 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:29.307441    2557 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jul 09 18:25:31.301270 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:29.307444    2557 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jul 09 18:25:31.301270 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:29.307447    2557 flags.go:64] FLAG: --enable-load-reader="false"
Jul 09 18:25:31.301270 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:29.307450    2557 flags.go:64] FLAG: --enable-server="true"
Jul 09 18:25:31.301270 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:29.307454    2557 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jul 09 18:25:31.301270 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:29.307459    2557 flags.go:64] FLAG: --event-burst="100"
Jul 09 18:25:31.301270 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:29.307462    2557 flags.go:64] FLAG: --event-qps="50"
Jul 09 18:25:31.301270 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:29.307464    2557 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jul 09 18:25:31.301270 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:29.307468    2557 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jul 09 18:25:31.301270 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:29.307471    2557 flags.go:64] FLAG: --eviction-hard=""
Jul 09 18:25:31.301270 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:29.307474    2557 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jul 09 18:25:31.301270 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:29.307477    2557 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jul 09 18:25:31.301270 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:29.307480    2557 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jul 09 18:25:31.301270 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:29.307483    2557 flags.go:64] FLAG: --eviction-soft=""
Jul 09 18:25:31.301270 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:29.307486    2557 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jul 09 18:25:31.301270 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:29.307489    2557 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jul 09 18:25:31.301270 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:29.307492    2557 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jul 09 18:25:31.301270 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:29.307495    2557 flags.go:64] FLAG: --experimental-mounter-path=""
Jul 09 18:25:31.301270 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:29.307497    2557 flags.go:64] FLAG: --fail-cgroupv1="false"
Jul 09 18:25:31.301270 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:29.307500    2557 flags.go:64] FLAG: --fail-swap-on="true"
Jul 09 18:25:31.301270 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:29.307503    2557 flags.go:64] FLAG: --feature-gates=""
Jul 09 18:25:31.301270 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:29.307507    2557 flags.go:64] FLAG: --file-check-frequency="20s"
Jul 09 18:25:31.301270 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:29.307510    2557 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jul 09 18:25:31.301270 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:29.307514    2557 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jul 09 18:25:31.302774 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:29.307518    2557 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jul 09 18:25:31.302774 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:29.307521    2557 flags.go:64] FLAG: --healthz-port="10248"
Jul 09 18:25:31.302774 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:29.307524    2557 flags.go:64] FLAG: --help="false"
Jul 09 18:25:31.302774 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:29.307527    2557 flags.go:64] FLAG: --hostname-override="ip-10-0-141-101.ec2.internal"
Jul 09 18:25:31.302774 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:29.307530    2557 flags.go:64] FLAG: --housekeeping-interval="10s"
Jul 09 18:25:31.302774 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:29.307533    2557 flags.go:64] FLAG: --http-check-frequency="20s"
Jul 09 18:25:31.302774 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:29.307537    2557 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jul 09 18:25:31.302774 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:29.307540    2557 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jul 09 18:25:31.302774 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:29.307544    2557 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jul 09 18:25:31.302774 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:29.307547    2557 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jul 09 18:25:31.302774 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:29.307550    2557 flags.go:64] FLAG: --image-service-endpoint=""
Jul 09 18:25:31.302774 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:29.307552    2557 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jul 09 18:25:31.302774 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:29.307555    2557 flags.go:64] FLAG: --kube-api-burst="100"
Jul 09 18:25:31.302774 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:29.307559    2557 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jul 09 18:25:31.302774 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:29.307562    2557 flags.go:64] FLAG: --kube-api-qps="50"
Jul 09 18:25:31.302774 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:29.307565    2557 flags.go:64] FLAG: --kube-reserved=""
Jul 09 18:25:31.302774 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:29.307567    2557 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jul 09 18:25:31.302774 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:29.307571    2557 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jul 09 18:25:31.302774 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:29.307574    2557 flags.go:64] FLAG: --kubelet-cgroups=""
Jul 09 18:25:31.302774 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:29.307577    2557 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jul 09 18:25:31.302774 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:29.307579    2557 flags.go:64] FLAG: --lock-file=""
Jul 09 18:25:31.302774 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:29.307582    2557 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jul 09 18:25:31.302774 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:29.307585    2557 flags.go:64] FLAG: --log-flush-frequency="5s"
Jul 09 18:25:31.302774 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:29.307588    2557 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jul 09 18:25:31.305587 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:29.307593    2557 flags.go:64] FLAG: --log-json-split-stream="false"
Jul 09 18:25:31.305587 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:29.307596    2557 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jul 09 18:25:31.305587 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:29.307599    2557 flags.go:64] FLAG: --log-text-split-stream="false"
Jul 09 18:25:31.305587 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:29.307602    2557 flags.go:64] FLAG: --logging-format="text"
Jul 09 18:25:31.305587 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:29.307604    2557 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jul 09 18:25:31.305587 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:29.307608    2557 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jul 09 18:25:31.305587 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:29.307610    2557 flags.go:64] FLAG: --manifest-url=""
Jul 09 18:25:31.305587 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:29.307615    2557 flags.go:64] FLAG: --manifest-url-header=""
Jul 09 18:25:31.305587 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:29.307619    2557 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jul 09 18:25:31.305587 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:29.307622    2557 flags.go:64] FLAG: --max-open-files="1000000"
Jul 09 18:25:31.305587 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:29.307626    2557 flags.go:64] FLAG: --max-pods="110"
Jul 09 18:25:31.305587 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:29.307629    2557 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jul 09 18:25:31.305587 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:29.307632    2557 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jul 09 18:25:31.305587 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:29.307634    2557 flags.go:64] FLAG: --memory-manager-policy="None"
Jul 09 18:25:31.305587 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:29.307639    2557 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jul 09 18:25:31.305587 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:29.307642    2557 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jul 09 18:25:31.305587 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:29.307645    2557 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jul 09 18:25:31.305587 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:29.307648    2557 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jul 09 18:25:31.305587 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:29.307654    2557 flags.go:64] FLAG: --node-status-max-images="50"
Jul 09 18:25:31.305587 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:29.307657    2557 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jul 09 18:25:31.305587 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:29.307660    2557 flags.go:64] FLAG: --oom-score-adj="-999"
Jul 09 18:25:31.305587 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:29.307663    2557 flags.go:64] FLAG: --pod-cidr=""
Jul 09 18:25:31.305587 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:29.307666    2557 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b04c0b1f73af4d021dd8f0b51bfeb302c24482c093de5f2c43654ab56c506926"
Jul 09 18:25:31.306547 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:29.307672    2557 flags.go:64] FLAG: --pod-manifest-path=""
Jul 09 18:25:31.306547 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:29.307675    2557 flags.go:64] FLAG: --pod-max-pids="-1"
Jul 09 18:25:31.306547 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:29.307678    2557 flags.go:64] FLAG: --pods-per-core="0"
Jul 09 18:25:31.306547 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:29.307681    2557 flags.go:64] FLAG: --port="10250"
Jul 09 18:25:31.306547 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:29.307684    2557 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jul 09 18:25:31.306547 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:29.307686    2557 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-03dba5f7b60456355"
Jul 09 18:25:31.306547 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:29.307690    2557 flags.go:64] FLAG: --qos-reserved=""
Jul 09 18:25:31.306547 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:29.307692    2557 flags.go:64] FLAG: --read-only-port="10255"
Jul 09 18:25:31.306547 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:29.307696    2557 flags.go:64] FLAG: --register-node="true"
Jul 09 18:25:31.306547 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:29.307699    2557 flags.go:64] FLAG: --register-with-taints=""
Jul 09 18:25:31.306547 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:29.307702    2557 flags.go:64] FLAG: --registry-burst="10"
Jul 09 18:25:31.306547 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:29.307705    2557 flags.go:64] FLAG: --registry-qps="5"
Jul 09 18:25:31.306547 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:29.307708    2557 flags.go:64] FLAG: --reserved-cpus=""
Jul 09 18:25:31.306547 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:29.307711    2557 flags.go:64] FLAG: --reserved-memory=""
Jul 09 18:25:31.306547 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:29.307714    2557 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jul 09 18:25:31.306547 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:29.307717    2557 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jul 09 18:25:31.306547 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:29.307721    2557 flags.go:64] FLAG: --rotate-certificates="false"
Jul 09 18:25:31.306547 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:29.307725    2557 flags.go:64] FLAG: --rotate-server-certificates="false"
Jul 09 18:25:31.306547 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:29.307728    2557 flags.go:64] FLAG: --runonce="false"
Jul 09 18:25:31.306547 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:29.307730    2557 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jul 09 18:25:31.306547 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:29.307733    2557 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jul 09 18:25:31.306547 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:29.307749    2557 flags.go:64] FLAG: --seccomp-default="false"
Jul 09 18:25:31.306547 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:29.307752    2557 flags.go:64] FLAG: --serialize-image-pulls="true"
Jul 09 18:25:31.306547 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:29.307756    2557 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jul 09 18:25:31.306547 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:29.307759    2557 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jul 09 18:25:31.306547 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:29.307763    2557 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jul 09 18:25:31.307546 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:29.307766    2557 flags.go:64] FLAG: --storage-driver-password="root"
Jul 09 18:25:31.307546 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:29.307769    2557 flags.go:64] FLAG: --storage-driver-secure="false"
Jul 09 18:25:31.307546 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:29.307772    2557 flags.go:64] FLAG: --storage-driver-table="stats"
Jul 09 18:25:31.307546 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:29.307775    2557 flags.go:64] FLAG: --storage-driver-user="root"
Jul 09 18:25:31.307546 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:29.307778    2557 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jul 09 18:25:31.307546 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:29.307781    2557 flags.go:64] FLAG: --sync-frequency="1m0s"
Jul 09 18:25:31.307546 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:29.307785    2557 flags.go:64] FLAG: --system-cgroups=""
Jul 09 18:25:31.307546 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:29.307788    2557 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jul 09 18:25:31.307546 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:29.307793    2557 flags.go:64] FLAG: --system-reserved-cgroup=""
Jul 09 18:25:31.307546 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:29.307796    2557 flags.go:64] FLAG: --tls-cert-file=""
Jul 09 18:25:31.307546 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:29.307799    2557 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jul 09 18:25:31.307546 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:29.307803    2557 flags.go:64] FLAG: --tls-min-version=""
Jul 09 18:25:31.307546 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:29.307806    2557 flags.go:64] FLAG: --tls-private-key-file=""
Jul 09 18:25:31.307546 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:29.307808    2557 flags.go:64] FLAG: --topology-manager-policy="none"
Jul 09 18:25:31.307546 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:29.307811    2557 flags.go:64] FLAG: --topology-manager-policy-options=""
Jul 09 18:25:31.307546 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:29.307814    2557 flags.go:64] FLAG: --topology-manager-scope="container"
Jul 09 18:25:31.307546 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:29.307817    2557 flags.go:64] FLAG: --v="2"
Jul 09 18:25:31.307546 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:29.307821    2557 flags.go:64] FLAG: --version="false"
Jul 09 18:25:31.307546 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:29.307825    2557 flags.go:64] FLAG: --vmodule=""
Jul 09 18:25:31.307546 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:29.307829    2557 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jul 09 18:25:31.307546 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:29.307832    2557 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jul 09 18:25:31.307546 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:25:29.307962    2557 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 09 18:25:31.307546 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:25:29.307966    2557 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 09 18:25:31.307546 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:25:29.307971    2557 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 09 18:25:31.308463 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:25:29.307974    2557 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 09 18:25:31.308463 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:25:29.307977    2557 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 09 18:25:31.308463 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:25:29.307980    2557 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 09 18:25:31.308463 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:25:29.307983    2557 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 09 18:25:31.308463 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:25:29.307986    2557 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 09 18:25:31.308463 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:25:29.307990    2557 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 09 18:25:31.308463 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:25:29.307992    2557 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 09 18:25:31.308463 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:25:29.307995    2557 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 09 18:25:31.308463 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:25:29.307997    2557 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 09 18:25:31.308463 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:25:29.308000    2557 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 09 18:25:31.308463 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:25:29.308002    2557 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 09 18:25:31.308463 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:25:29.308005    2557 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 09 18:25:31.308463 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:25:29.308008    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 09 18:25:31.308463 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:25:29.308010    2557 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 09 18:25:31.308463 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:25:29.308013    2557 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 09 18:25:31.308463 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:25:29.308016    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 09 18:25:31.308463 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:25:29.308018    2557 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 09 18:25:31.308463 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:25:29.308021    2557 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 09 18:25:31.308463 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:25:29.308024    2557 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 09 18:25:31.308463 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:25:29.308026    2557 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 09 18:25:31.309309 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:25:29.308028    2557 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 09 18:25:31.309309 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:25:29.308031    2557 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 09 18:25:31.309309 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:25:29.308034    2557 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 09 18:25:31.309309 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:25:29.308036    2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 09 18:25:31.309309 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:25:29.308039    2557 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 09 18:25:31.309309 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:25:29.308041    2557 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 09 18:25:31.309309 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:25:29.308046    2557 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 09 18:25:31.309309 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:25:29.308049    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 09 18:25:31.309309 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:25:29.308052    2557 feature_gate.go:328] unrecognized feature gate: Example2
Jul 09 18:25:31.309309 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:25:29.308055    2557 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 09 18:25:31.309309 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:25:29.308058    2557 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 09 18:25:31.309309 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:25:29.308063    2557 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 09 18:25:31.309309 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:25:29.308067    2557 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 09 18:25:31.309309 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:25:29.308070    2557 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 09 18:25:31.309309 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:25:29.308073    2557 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 09 18:25:31.309309 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:25:29.308075    2557 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 09 18:25:31.309309 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:25:29.308078    2557 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 09 18:25:31.309309 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:25:29.308082    2557 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 09 18:25:31.309309 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:25:29.308085    2557 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 09 18:25:31.310067 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:25:29.308087    2557 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 09 18:25:31.310067 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:25:29.308090    2557 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 09 18:25:31.310067 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:25:29.308092    2557 feature_gate.go:328] unrecognized feature gate: Example
Jul 09 18:25:31.310067 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:25:29.308095    2557 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 09 18:25:31.310067 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:25:29.308097    2557 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 09 18:25:31.310067 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:25:29.308100    2557 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 09 18:25:31.310067 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:25:29.308102    2557 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 09 18:25:31.310067 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:25:29.308105    2557 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 09 18:25:31.310067 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:25:29.308108    2557 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 09 18:25:31.310067 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:25:29.308113    2557 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 09 18:25:31.310067 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:25:29.308116    2557 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 09 18:25:31.310067 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:25:29.308119    2557 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 09 18:25:31.310067 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:25:29.308121    2557 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 09 18:25:31.310067 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:25:29.308124    2557 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 09 18:25:31.310067 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:25:29.308127    2557 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 09 18:25:31.310067 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:25:29.308129    2557 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 09 18:25:31.310067 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:25:29.308132    2557 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 09 18:25:31.310067 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:25:29.308134    2557 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 09 18:25:31.310067 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:25:29.308137    2557 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 09 18:25:31.310067 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:25:29.308139    2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 09 18:25:31.310861 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:25:29.308141    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 09 18:25:31.310861 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:25:29.308144    2557 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 09 18:25:31.310861 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:25:29.308146    2557 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 09 18:25:31.310861 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:25:29.308149    2557 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 09 18:25:31.310861 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:25:29.308154    2557 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 09 18:25:31.310861 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:25:29.308158    2557 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 09 18:25:31.310861 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:25:29.308161    2557 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 09 18:25:31.310861 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:25:29.308164    2557 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 09 18:25:31.310861 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:25:29.308167    2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 09 18:25:31.310861 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:25:29.308169    2557 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 09 18:25:31.310861 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:25:29.308173    2557 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 09 18:25:31.310861 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:25:29.308175    2557 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 09 18:25:31.310861 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:25:29.308178    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 09 18:25:31.310861 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:25:29.308181    2557 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 09 18:25:31.310861 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:25:29.308183    2557 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 09 18:25:31.310861 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:25:29.308186    2557 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 09 18:25:31.310861 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:25:29.308188    2557 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 09 18:25:31.310861 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:25:29.308191    2557 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 09 18:25:31.310861 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:25:29.308194    2557 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 09 18:25:31.311593 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:25:29.308196    2557 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 09 18:25:31.311593 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:25:29.308199    2557 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 09 18:25:31.311593 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:25:29.308201    2557 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 09 18:25:31.311593 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:25:29.308204    2557 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 09 18:25:31.311593 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:25:29.308207    2557 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 09 18:25:31.311593 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:25:29.308209    2557 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 09 18:25:31.311593 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:25:29.308212    2557 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 09 18:25:31.311593 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:25:29.308215    2557 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 09 18:25:31.311593 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:25:29.308217    2557 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 09 18:25:31.311593 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:25:29.308220    2557 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 09 18:25:31.311593 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:25:29.308222    2557 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 09 18:25:31.311593 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:25:29.308225    2557 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 09 18:25:31.311593 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:25:29.308227    2557 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 09 18:25:31.311593 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:25:29.308230    2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 09 18:25:31.311593 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:25:29.308233    2557 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 09 18:25:31.311593 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:25:29.308235    2557 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 09 18:25:31.311593 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:25:29.308237    2557 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 09 18:25:31.311593 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:25:29.308241    2557 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 09 18:25:31.312368 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:29.308970    2557 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 09 18:25:31.312368 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:29.315900    2557 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Jul 09 18:25:31.312368 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:29.315915    2557 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jul 09 18:25:31.312368 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:29.315935    2557 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jul 09 18:25:31.312368 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:29.315941    2557 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jul 09 18:25:31.312368 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:25:29.316001    2557 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 09 18:25:31.312368 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:25:29.316006    2557 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 09 18:25:31.312368 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:25:29.316009    2557 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 09 18:25:31.312368 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:25:29.316012    2557 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 09 18:25:31.312368 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:25:29.316014    2557 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 09 18:25:31.312368 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:25:29.316017    2557 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 09 18:25:31.312368 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:25:29.316019    2557 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 09 18:25:31.312368 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:25:29.316022    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 09 18:25:31.312368 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:25:29.316024    2557 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 09 18:25:31.312368 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:25:29.316027    2557 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 09 18:25:31.312982 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:25:29.316030    2557 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 09 18:25:31.312982 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:25:29.316032    2557 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 09 18:25:31.312982 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:25:29.316036    2557 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 09 18:25:31.312982 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:25:29.316040    2557 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 09 18:25:31.312982 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:25:29.316044    2557 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 09 18:25:31.312982 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:25:29.316046    2557 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 09 18:25:31.312982 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:25:29.316049    2557 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 09 18:25:31.312982 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:25:29.316051    2557 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 09 18:25:31.312982 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:25:29.316054    2557 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 09 18:25:31.312982 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:25:29.316057    2557 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 09 18:25:31.312982 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:25:29.316060    2557 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 09 18:25:31.312982 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:25:29.316064    2557 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 09 18:25:31.312982 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:25:29.316067    2557 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 09 18:25:31.312982 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:25:29.316070    2557 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 09 18:25:31.312982 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:25:29.316074    2557 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 09 18:25:31.312982 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:25:29.316078    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 09 18:25:31.312982 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:25:29.316081    2557 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 09 18:25:31.312982 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:25:29.316086    2557 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 09 18:25:31.313689 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:25:29.316089    2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 09 18:25:31.313689 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:25:29.316093    2557 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 09 18:25:31.313689 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:25:29.316096    2557 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 09 18:25:31.313689 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:25:29.316099    2557 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 09 18:25:31.313689 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:25:29.316103    2557 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 09 18:25:31.313689 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:25:29.316106    2557 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 09 18:25:31.313689 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:25:29.316108    2557 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 09 18:25:31.313689 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:25:29.316111    2557 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 09 18:25:31.313689 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:25:29.316113    2557 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 09 18:25:31.313689 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:25:29.316116    2557 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 09 18:25:31.313689 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:25:29.316118    2557 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 09 18:25:31.313689 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:25:29.316120    2557 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 09 18:25:31.313689 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:25:29.316123    2557 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 09 18:25:31.313689 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:25:29.316126    2557 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 09 18:25:31.313689 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:25:29.316128    2557 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 09 18:25:31.313689 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:25:29.316131    2557 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 09 18:25:31.313689 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:25:29.316133    2557 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 09 18:25:31.313689 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:25:29.316136    2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 09 18:25:31.313689 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:25:29.316138    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 09 18:25:31.313689 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:25:29.316141    2557 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 09 18:25:31.314455 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:25:29.316143    2557 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 09 18:25:31.314455 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:25:29.316146    2557 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 09 18:25:31.314455 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:25:29.316149    2557 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 09 18:25:31.314455 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:25:29.316152    2557 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 09 18:25:31.314455 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:25:29.316154    2557 feature_gate.go:328] unrecognized feature gate: Example
Jul 09 18:25:31.314455 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:25:29.316156    2557 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 09 18:25:31.314455 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:25:29.316159    2557 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 09 18:25:31.314455 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:25:29.316161    2557 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 09 18:25:31.314455 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:25:29.316164    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 09 18:25:31.314455 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:25:29.316166    2557 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 09 18:25:31.314455 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:25:29.316169    2557 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 09 18:25:31.314455 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:25:29.316173    2557 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 09 18:25:31.314455 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:25:29.316175    2557 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 09 18:25:31.314455 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:25:29.316178    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 09 18:25:31.314455 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:25:29.316182    2557 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 09 18:25:31.314455 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:25:29.316185    2557 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 09 18:25:31.314455 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:25:29.316189    2557 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 09 18:25:31.314455 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:25:29.316192    2557 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 09 18:25:31.314455 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:25:29.316194    2557 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 09 18:25:31.314455 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:25:29.316197    2557 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 09 18:25:31.315232 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:25:29.316199    2557 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 09 18:25:31.315232 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:25:29.316202    2557 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 09 18:25:31.315232 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:25:29.316204    2557 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 09 18:25:31.315232 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:25:29.316207    2557 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 09 18:25:31.315232 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:25:29.316209    2557 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 09 18:25:31.315232 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:25:29.316212    2557 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 09 18:25:31.315232 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:25:29.316214    2557 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 09 18:25:31.315232 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:25:29.316217    2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 09 18:25:31.315232 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:25:29.316219    2557 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 09 18:25:31.315232 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:25:29.316221    2557 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 09 18:25:31.315232 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:25:29.316224    2557 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 09 18:25:31.315232 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:25:29.316227    2557 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 09 18:25:31.315232 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:25:29.316229    2557 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 09 18:25:31.315232 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:25:29.316231    2557 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 09 18:25:31.315232 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:25:29.316234    2557 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 09 18:25:31.315232 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:25:29.316236    2557 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 09 18:25:31.315232 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:25:29.316239    2557 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 09 18:25:31.315232 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:25:29.316241    2557 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 09 18:25:31.315232 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:25:29.316244    2557 feature_gate.go:328] unrecognized feature gate: Example2
Jul 09 18:25:31.315232 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:25:29.316246    2557 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 09 18:25:31.315998 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:25:29.316249    2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 09 18:25:31.315998 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:25:29.316251    2557 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 09 18:25:31.315998 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:25:29.316253    2557 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 09 18:25:31.315998 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:25:29.316258    2557 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 09 18:25:31.315998 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:25:29.316260    2557 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 09 18:25:31.315998 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:25:29.316263    2557 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 09 18:25:31.315998 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:25:29.316266    2557 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 09 18:25:31.315998 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:25:29.316268    2557 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 09 18:25:31.315998 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:25:29.316272    2557 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 09 18:25:31.315998 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:25:29.316275    2557 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 09 18:25:31.315998 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:25:29.316277    2557 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 09 18:25:31.315998 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:29.316283    2557 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 09 18:25:31.315998 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:25:29.316394    2557 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 09 18:25:31.315998 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:25:29.316399    2557 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 09 18:25:31.315998 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:25:29.316402    2557 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 09 18:25:31.316600 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:25:29.316405    2557 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 09 18:25:31.316600 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:25:29.316407    2557 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 09 18:25:31.316600 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:25:29.316410    2557 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 09 18:25:31.316600 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:25:29.316413    2557 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 09 18:25:31.316600 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:25:29.316415    2557 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 09 18:25:31.316600 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:25:29.316419    2557 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 09 18:25:31.316600 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:25:29.316422    2557 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 09 18:25:31.316600 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:25:29.316424    2557 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 09 18:25:31.316600 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:25:29.316427    2557 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 09 18:25:31.316600 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:25:29.316430    2557 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 09 18:25:31.316600 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:25:29.316432    2557 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 09 18:25:31.316600 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:25:29.316435    2557 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 09 18:25:31.316600 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:25:29.316437    2557 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 09 18:25:31.316600 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:25:29.316440    2557 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 09 18:25:31.316600 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:25:29.316442    2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 09 18:25:31.316600 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:25:29.316445    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 09 18:25:31.316600 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:25:29.316447    2557 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 09 18:25:31.316600 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:25:29.316450    2557 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 09 18:25:31.316600 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:25:29.316452    2557 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 09 18:25:31.317345 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:25:29.316455    2557 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 09 18:25:31.317345 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:25:29.316457    2557 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 09 18:25:31.317345 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:25:29.316461    2557 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 09 18:25:31.317345 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:25:29.316464    2557 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 09 18:25:31.317345 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:25:29.316467    2557 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 09 18:25:31.317345 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:25:29.316469    2557 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 09 18:25:31.317345 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:25:29.316474    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 09 18:25:31.317345 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:25:29.316476    2557 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 09 18:25:31.317345 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:25:29.316479    2557 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 09 18:25:31.317345 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:25:29.316481    2557 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 09 18:25:31.317345 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:25:29.316484    2557 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 09 18:25:31.317345 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:25:29.316486    2557 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 09 18:25:31.317345 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:25:29.316489    2557 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 09 18:25:31.317345 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:25:29.316491    2557 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 09 18:25:31.317345 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:25:29.316494    2557 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 09 18:25:31.317345 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:25:29.316496    2557 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 09 18:25:31.317345 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:25:29.316499    2557 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 09 18:25:31.317345 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:25:29.316502    2557 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 09 18:25:31.317345 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:25:29.316504    2557 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 09 18:25:31.317345 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:25:29.316507    2557 feature_gate.go:328] unrecognized feature gate: Example
Jul 09 18:25:31.317345 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:25:29.316510    2557 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 09 18:25:31.318149 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:25:29.316512    2557 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 09 18:25:31.318149 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:25:29.316515    2557 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 09 18:25:31.318149 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:25:29.316517    2557 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 09 18:25:31.318149 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:25:29.316520    2557 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 09 18:25:31.318149 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:25:29.316522    2557 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 09 18:25:31.318149 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:25:29.316525    2557 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 09 18:25:31.318149 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:25:29.316527    2557 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 09 18:25:31.318149 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:25:29.316530    2557 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 09 18:25:31.318149 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:25:29.316533    2557 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 09 18:25:31.318149 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:25:29.316536    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 09 18:25:31.318149 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:25:29.316538    2557 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 09 18:25:31.318149 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:25:29.316540    2557 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 09 18:25:31.318149 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:25:29.316543    2557 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 09 18:25:31.318149 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:25:29.316547    2557 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 09 18:25:31.318149 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:25:29.316549    2557 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 09 18:25:31.318149 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:25:29.316552    2557 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 09 18:25:31.318149 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:25:29.316554    2557 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 09 18:25:31.318149 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:25:29.316558    2557 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 09 18:25:31.318149 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:25:29.316578    2557 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 09 18:25:31.318885 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:25:29.316582    2557 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 09 18:25:31.318885 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:25:29.316586    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 09 18:25:31.318885 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:25:29.316589    2557 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 09 18:25:31.318885 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:25:29.316593    2557 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 09 18:25:31.318885 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:25:29.316596    2557 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 09 18:25:31.318885 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:25:29.316599    2557 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 09 18:25:31.318885 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:25:29.316601    2557 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 09 18:25:31.318885 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:25:29.316604    2557 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 09 18:25:31.318885 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:25:29.316607    2557 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 09 18:25:31.318885 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:25:29.316610    2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 09 18:25:31.318885 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:25:29.316612    2557 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 09 18:25:31.318885 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:25:29.316615    2557 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 09 18:25:31.318885 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:25:29.316617    2557 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 09 18:25:31.318885 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:25:29.316620    2557 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 09 18:25:31.318885 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:25:29.316622    2557 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 09 18:25:31.318885 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:25:29.316625    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 09 18:25:31.318885 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:25:29.316627    2557 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 09 18:25:31.318885 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:25:29.316630    2557 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 09 18:25:31.318885 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:25:29.316632    2557 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 09 18:25:31.319625 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:25:29.316637    2557 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 09 18:25:31.319625 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:25:29.316641    2557 feature_gate.go:328] unrecognized feature gate: Example2
Jul 09 18:25:31.319625 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:25:29.316644    2557 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 09 18:25:31.319625 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:25:29.316646    2557 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 09 18:25:31.319625 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:25:29.316650    2557 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 09 18:25:31.319625 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:25:29.316652    2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 09 18:25:31.319625 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:25:29.316655    2557 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 09 18:25:31.319625 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:25:29.316660    2557 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 09 18:25:31.319625 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:25:29.316663    2557 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 09 18:25:31.319625 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:25:29.316666    2557 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 09 18:25:31.319625 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:25:29.316668    2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 09 18:25:31.319625 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:25:29.316672    2557 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 09 18:25:31.319625 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:25:29.316675    2557 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 09 18:25:31.319625 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:25:29.316678    2557 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 09 18:25:31.319625 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:25:29.316680    2557 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 09 18:25:31.319625 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:25:29.316683    2557 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 09 18:25:31.319625 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:25:29.316686    2557 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 09 18:25:31.319625 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:25:29.316689    2557 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 09 18:25:31.320342 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:29.316695    2557 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 09 18:25:31.320342 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:29.316849    2557 server.go:962] "Client rotation is on, will bootstrap in background"
Jul 09 18:25:31.320342 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:29.318893    2557 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jul 09 18:25:31.320342 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:29.320189    2557 server.go:1019] "Starting client certificate rotation"
Jul 09 18:25:31.320342 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:29.320281    2557 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 09 18:25:31.320342 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:29.320348    2557 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 09 18:25:31.320342 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:29.327171    2557 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 09 18:25:31.320342 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:29.329989    2557 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 09 18:25:31.320342 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:29.337561    2557 log.go:25] "Validated CRI v1 runtime API"
Jul 09 18:25:31.320342 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:29.339908    2557 log.go:25] "Validated CRI v1 image API"
Jul 09 18:25:31.320342 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:29.341191    2557 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jul 09 18:25:31.320342 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:29.345274    2557 fs.go:135] Filesystem UUIDs: map[3649e601-f021-4eec-99b8-11861d4fae1a:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 dac84bd5-6695-4cba-b2f8-9c5ee8084442:/dev/nvme0n1p4]
Jul 09 18:25:31.320837 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:29.345298    2557 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jul 09 18:25:31.320887 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:29.349509    2557 manager.go:216] Machine: {Timestamp:2026-07-09 18:25:29.349014642 +0000 UTC m=+0.276097587 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3100667 MemoryCapacity:33164492800 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec263a6cba5f662379ef26984aad0178 SystemUUID:ec263a6c-ba5f-6623-79ef-26984aad0178 BootID:c4851e95-8769-4d7a-b051-f442d4254e2e Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582246400 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:42:cf:76:30:f5 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:42:cf:76:30:f5 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:d2:3b:81:02:5e:ff Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164492800 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jul 09 18:25:31.320887 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:29.349611    2557 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jul 09 18:25:31.320887 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:29.349689    2557 manager.go:232] Version: {KernelVersion:5.14.0-570.126.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260702-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jul 09 18:25:31.320887 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:29.352272    2557 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jul 09 18:25:31.320887 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:29.352299    2557 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-141-101.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jul 09 18:25:31.320887 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:29.352937    2557 topology_manager.go:138] "Creating topology manager with none policy"
Jul 09 18:25:31.320887 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:29.352947    2557 container_manager_linux.go:309] "Creating device plugin manager"
Jul 09 18:25:31.320887 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:29.352955    2557 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 09 18:25:31.321259 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:29.352973    2557 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 09 18:25:31.321259 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:29.354228    2557 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jul 09 18:25:31.321259 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:29.358502    2557 state_mem.go:36] "Initialized new in-memory state store"
Jul 09 18:25:31.321259 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:29.358612    2557 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jul 09 18:25:31.321259 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:29.359381    2557 kubelet.go:486] "Attempting to sync node with API server"
Jul 09 18:25:31.321259 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:29.359394    2557 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jul 09 18:25:31.321259 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:29.359412    2557 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jul 09 18:25:31.321259 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:29.359423    2557 kubelet.go:398] "Adding apiserver pod source"
Jul 09 18:25:31.321259 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:29.359433    2557 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jul 09 18:25:31.321259 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:29.359791    2557 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 09 18:25:31.321259 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:29.359807    2557 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 09 18:25:31.321259 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:29.361784    2557 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1"
Jul 09 18:25:31.321259 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:29.363885    2557 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jul 09 18:25:31.321259 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:29.363914    2557 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jul 09 18:25:31.321259 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:29.364076    2557 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jul 09 18:25:31.321259 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:29.364089    2557 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jul 09 18:25:31.321259 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:29.364095    2557 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jul 09 18:25:31.321259 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:29.364101    2557 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jul 09 18:25:31.321259 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:29.364109    2557 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jul 09 18:25:31.321259 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:29.364115    2557 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jul 09 18:25:31.321259 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:29.364499    2557 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jul 09 18:25:31.321259 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:29.364506    2557 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jul 09 18:25:31.321259 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:29.364513    2557 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jul 09 18:25:31.321259 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:29.364518    2557 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jul 09 18:25:31.321259 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:29.364526    2557 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jul 09 18:25:31.321259 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:29.364535    2557 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jul 09 18:25:31.321259 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:29.365146    2557 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jul 09 18:25:31.321259 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:29.365153    2557 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jul 09 18:25:31.321259 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:29.368513    2557 server.go:1268] "Started kubelet"
Jul 09 18:25:31.321259 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:29.368596    2557 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jul 09 18:25:31.321259 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:29.368611    2557 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jul 09 18:25:31.321259 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:29.368682    2557 server_v1.go:49] "podresources" method="list" useActivePods=true
Jul 09 18:25:31.321259 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:29.372213    2557 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jul 09 18:25:31.321259 ip-10-0-141-101 kubenswrapper[2557]: E0709 18:25:29.374014    2557 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jul 09 18:25:31.321259 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:29.374190    2557 server.go:310] "Adding debug handlers to kubelet server"
Jul 09 18:25:31.321259 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:29.379690    2557 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-141-101.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 09 18:25:31.321259 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:29.380191    2557 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jul 09 18:25:31.321259 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:29.380521    2557 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jul 09 18:25:31.321259 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:29.381318    2557 volume_manager.go:311] "The desired_state_of_world populator starts"
Jul 09 18:25:31.321259 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:29.381335    2557 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jul 09 18:25:31.321259 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:29.381343    2557 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jul 09 18:25:31.321259 ip-10-0-141-101 kubenswrapper[2557]: E0709 18:25:29.381408    2557 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-101.ec2.internal\" not found"
Jul 09 18:25:31.321259 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:29.381418    2557 reconstruct.go:97] "Volume reconstruction finished"
Jul 09 18:25:31.321259 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:29.381426    2557 reconciler.go:29] "Reconciler: start to sync state"
Jul 09 18:25:31.322987 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:29.382606    2557 factory.go:153] Registering CRI-O factory
Jul 09 18:25:31.322987 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:29.382621    2557 factory.go:223] Registration of the crio container factory successfully
Jul 09 18:25:31.322987 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:29.382675    2557 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jul 09 18:25:31.322987 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:29.382684    2557 factory.go:55] Registering systemd factory
Jul 09 18:25:31.322987 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:29.382692    2557 factory.go:223] Registration of the systemd container factory successfully
Jul 09 18:25:31.322987 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:29.382716    2557 factory.go:103] Registering Raw factory
Jul 09 18:25:31.322987 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:29.382731    2557 manager.go:1196] Started watching for new ooms in manager
Jul 09 18:25:31.322987 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:29.383154    2557 manager.go:349] Starting recovery of all containers
Jul 09 18:25:31.322987 ip-10-0-141-101 kubenswrapper[2557]: E0709 18:25:29.388438    2557 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-141-101.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Jul 09 18:25:31.322987 ip-10-0-141-101 kubenswrapper[2557]: E0709 18:25:29.388857    2557 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-141-101.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 09 18:25:31.322987 ip-10-0-141-101 kubenswrapper[2557]: E0709 18:25:29.388885    2557 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 09 18:25:31.322987 ip-10-0-141-101 kubenswrapper[2557]: E0709 18:25:29.389027    2557 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Jul 09 18:25:31.322987 ip-10-0-141-101 kubenswrapper[2557]: E0709 18:25:29.388887    2557 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-141-101.ec2.internal.18c0b254b7bf4559  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-141-101.ec2.internal,UID:ip-10-0-141-101.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-141-101.ec2.internal,},FirstTimestamp:2026-07-09 18:25:29.368479065 +0000 UTC m=+0.295562017,LastTimestamp:2026-07-09 18:25:29.368479065 +0000 UTC m=+0.295562017,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-141-101.ec2.internal,}"
Jul 09 18:25:31.322987 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:29.393734    2557 manager.go:354] Recovery completed
Jul 09 18:25:31.322987 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:29.397913    2557 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 09 18:25:31.322987 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:29.399826    2557 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 09 18:25:31.322987 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:29.400084    2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-101.ec2.internal" event="NodeHasSufficientMemory"
Jul 09 18:25:31.322987 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:29.400116    2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-101.ec2.internal" event="NodeHasNoDiskPressure"
Jul 09 18:25:31.322987 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:29.400128    2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-101.ec2.internal" event="NodeHasSufficientPID"
Jul 09 18:25:31.322987 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:29.400665    2557 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jul 09 18:25:31.322987 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:29.400676    2557 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jul 09 18:25:31.322987 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:29.400682    2557 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 09 18:25:31.322987 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:29.400693    2557 state_mem.go:36] "Initialized new in-memory state store"
Jul 09 18:25:31.322987 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:29.402924    2557 policy_none.go:49] "None policy: Start"
Jul 09 18:25:31.322987 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:29.402942    2557 memory_manager.go:187] "Starting memorymanager" policy="None"
Jul 09 18:25:31.322987 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:29.402955    2557 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jul 09 18:25:31.322987 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:29.404939    2557 policy_none.go:47] "Start"
Jul 09 18:25:31.322987 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:29.407543    2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-101.ec2.internal" event="NodeHasSufficientMemory"
Jul 09 18:25:31.322987 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:29.407587    2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-101.ec2.internal" event="NodeHasNoDiskPressure"
Jul 09 18:25:31.324159 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:29.407607    2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-101.ec2.internal" event="NodeHasSufficientPID"
Jul 09 18:25:31.324159 ip-10-0-141-101 kubenswrapper[2557]: E0709 18:25:29.407631    2557 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-141-101.ec2.internal.18c0b254b9a1c109  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-141-101.ec2.internal,UID:ip-10-0-141-101.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-141-101.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-141-101.ec2.internal,},FirstTimestamp:2026-07-09 18:25:29.400099081 +0000 UTC m=+0.327182024,LastTimestamp:2026-07-09 18:25:29.400099081 +0000 UTC m=+0.327182024,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-141-101.ec2.internal,}"
Jul 09 18:25:31.324159 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:29.407949    2557 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-jzzv9"
Jul 09 18:25:31.324159 ip-10-0-141-101 kubenswrapper[2557]: E0709 18:25:29.415751    2557 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-141-101.ec2.internal.18c0b254b9a2149f  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-141-101.ec2.internal,UID:ip-10-0-141-101.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-141-101.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-141-101.ec2.internal,},FirstTimestamp:2026-07-09 18:25:29.400120479 +0000 UTC m=+0.327203421,LastTimestamp:2026-07-09 18:25:29.400120479 +0000 UTC m=+0.327203421,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-141-101.ec2.internal,}"
Jul 09 18:25:31.324159 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:29.427961    2557 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-jzzv9"
Jul 09 18:25:31.324159 ip-10-0-141-101 kubenswrapper[2557]: E0709 18:25:29.430633    2557 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-141-101.ec2.internal.18c0b254b9a241b5  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-141-101.ec2.internal,UID:ip-10-0-141-101.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-141-101.ec2.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-141-101.ec2.internal,},FirstTimestamp:2026-07-09 18:25:29.400132021 +0000 UTC m=+0.327214963,LastTimestamp:2026-07-09 18:25:29.400132021 +0000 UTC m=+0.327214963,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-141-101.ec2.internal,}"
Jul 09 18:25:31.324159 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:29.440428    2557 manager.go:337] "Starting Device Plugin manager"
Jul 09 18:25:31.324159 ip-10-0-141-101 kubenswrapper[2557]: E0709 18:25:29.440591    2557 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jul 09 18:25:31.324159 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:29.440605    2557 server.go:87] "Starting device plugin registration server"
Jul 09 18:25:31.324159 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:29.440889    2557 eviction_manager.go:189] "Eviction manager: starting control loop"
Jul 09 18:25:31.324159 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:29.440902    2557 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jul 09 18:25:31.324159 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:29.440983    2557 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jul 09 18:25:31.324159 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:29.441072    2557 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jul 09 18:25:31.324159 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:29.441080    2557 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jul 09 18:25:31.324159 ip-10-0-141-101 kubenswrapper[2557]: E0709 18:25:29.441624    2557 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jul 09 18:25:31.324159 ip-10-0-141-101 kubenswrapper[2557]: E0709 18:25:29.441670    2557 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-141-101.ec2.internal\" not found"
Jul 09 18:25:31.324159 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:31.229421    2557 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 09 18:25:31.324159 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:31.230457    2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-101.ec2.internal" event="NodeHasSufficientMemory"
Jul 09 18:25:31.324911 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:31.230503    2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-101.ec2.internal" event="NodeHasNoDiskPressure"
Jul 09 18:25:31.324911 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:31.230514    2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-101.ec2.internal" event="NodeHasSufficientPID"
Jul 09 18:25:31.324911 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:31.230542    2557 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-141-101.ec2.internal"
Jul 09 18:25:31.324911 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:31.245504    2557 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-141-101.ec2.internal"
Jul 09 18:25:31.324911 ip-10-0-141-101 kubenswrapper[2557]: E0709 18:25:31.245526    2557 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-141-101.ec2.internal\": node \"ip-10-0-141-101.ec2.internal\" not found"
Jul 09 18:25:31.324911 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:31.253830    2557 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jul 09 18:25:31.324911 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:31.255052    2557 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jul 09 18:25:31.324911 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:31.255098    2557 status_manager.go:244] "Starting to sync pod status with apiserver"
Jul 09 18:25:31.324911 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:31.255122    2557 kubelet.go:2448] "Starting kubelet main sync loop"
Jul 09 18:25:31.324911 ip-10-0-141-101 kubenswrapper[2557]: E0709 18:25:31.255159    2557 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jul 09 18:25:31.324911 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:31.261234    2557 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 09 18:25:31.324911 ip-10-0-141-101 kubenswrapper[2557]: E0709 18:25:31.281382    2557 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-101.ec2.internal\" not found"
Jul 09 18:25:31.355448 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:31.355412    2557 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-101.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-141-101.ec2.internal"]
Jul 09 18:25:31.355536 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:31.355513    2557 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 09 18:25:31.357182 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:31.357158    2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-101.ec2.internal" event="NodeHasSufficientMemory"
Jul 09 18:25:31.357251 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:31.357186    2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-101.ec2.internal" event="NodeHasNoDiskPressure"
Jul 09 18:25:31.357251 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:31.357197    2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-101.ec2.internal" event="NodeHasSufficientPID"
Jul 09 18:25:31.359357 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:31.359343    2557 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 09 18:25:31.359519 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:31.359503    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-101.ec2.internal"
Jul 09 18:25:31.359581 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:31.359537    2557 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 09 18:25:31.360410 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:31.360387    2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-101.ec2.internal" event="NodeHasSufficientMemory"
Jul 09 18:25:31.360543 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:31.360418    2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-101.ec2.internal" event="NodeHasSufficientMemory"
Jul 09 18:25:31.360543 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:31.360442    2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-101.ec2.internal" event="NodeHasNoDiskPressure"
Jul 09 18:25:31.360543 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:31.360453    2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-101.ec2.internal" event="NodeHasSufficientPID"
Jul 09 18:25:31.360543 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:31.360424    2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-101.ec2.internal" event="NodeHasNoDiskPressure"
Jul 09 18:25:31.360543 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:31.360514    2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-101.ec2.internal" event="NodeHasSufficientPID"
Jul 09 18:25:31.362598 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:31.362584    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-101.ec2.internal"
Jul 09 18:25:31.362661 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:31.362610    2557 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 09 18:25:31.363382 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:31.363365    2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-101.ec2.internal" event="NodeHasSufficientMemory"
Jul 09 18:25:31.363470 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:31.363391    2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-101.ec2.internal" event="NodeHasNoDiskPressure"
Jul 09 18:25:31.363470 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:31.363400    2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-101.ec2.internal" event="NodeHasSufficientPID"
Jul 09 18:25:31.371077 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:31.371056    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/8d7f955ecd105eda414726db5de540d0-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-141-101.ec2.internal\" (UID: \"8d7f955ecd105eda414726db5de540d0\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-101.ec2.internal"
Jul 09 18:25:31.371170 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:31.371092    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8d7f955ecd105eda414726db5de540d0-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-141-101.ec2.internal\" (UID: \"8d7f955ecd105eda414726db5de540d0\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-101.ec2.internal"
Jul 09 18:25:31.371170 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:31.371132    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/b2c36589f62defe44458de06cdd5da38-config\") pod \"kube-apiserver-proxy-ip-10-0-141-101.ec2.internal\" (UID: \"b2c36589f62defe44458de06cdd5da38\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-141-101.ec2.internal"
Jul 09 18:25:31.382189 ip-10-0-141-101 kubenswrapper[2557]: E0709 18:25:31.382164    2557 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-101.ec2.internal\" not found"
Jul 09 18:25:31.414423 ip-10-0-141-101 kubenswrapper[2557]: E0709 18:25:31.414399    2557 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-141-101.ec2.internal\" not found" node="ip-10-0-141-101.ec2.internal"
Jul 09 18:25:31.419038 ip-10-0-141-101 kubenswrapper[2557]: E0709 18:25:31.419021    2557 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-141-101.ec2.internal\" not found" node="ip-10-0-141-101.ec2.internal"
Jul 09 18:25:31.471955 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:31.471927    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/b2c36589f62defe44458de06cdd5da38-config\") pod \"kube-apiserver-proxy-ip-10-0-141-101.ec2.internal\" (UID: \"b2c36589f62defe44458de06cdd5da38\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-141-101.ec2.internal"
Jul 09 18:25:31.471955 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:31.471942    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/b2c36589f62defe44458de06cdd5da38-config\") pod \"kube-apiserver-proxy-ip-10-0-141-101.ec2.internal\" (UID: \"b2c36589f62defe44458de06cdd5da38\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-141-101.ec2.internal"
Jul 09 18:25:31.472153 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:31.471978    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/8d7f955ecd105eda414726db5de540d0-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-141-101.ec2.internal\" (UID: \"8d7f955ecd105eda414726db5de540d0\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-101.ec2.internal"
Jul 09 18:25:31.472153 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:31.472003    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8d7f955ecd105eda414726db5de540d0-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-141-101.ec2.internal\" (UID: \"8d7f955ecd105eda414726db5de540d0\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-101.ec2.internal"
Jul 09 18:25:31.472153 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:31.472047    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8d7f955ecd105eda414726db5de540d0-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-141-101.ec2.internal\" (UID: \"8d7f955ecd105eda414726db5de540d0\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-101.ec2.internal"
Jul 09 18:25:31.472153 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:31.472069    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/8d7f955ecd105eda414726db5de540d0-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-141-101.ec2.internal\" (UID: \"8d7f955ecd105eda414726db5de540d0\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-101.ec2.internal"
Jul 09 18:25:31.483060 ip-10-0-141-101 kubenswrapper[2557]: E0709 18:25:31.483025    2557 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-101.ec2.internal\" not found"
Jul 09 18:25:31.583997 ip-10-0-141-101 kubenswrapper[2557]: E0709 18:25:31.583921    2557 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-101.ec2.internal\" not found"
Jul 09 18:25:31.684641 ip-10-0-141-101 kubenswrapper[2557]: E0709 18:25:31.684608    2557 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-101.ec2.internal\" not found"
Jul 09 18:25:31.716123 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:31.716095    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-101.ec2.internal"
Jul 09 18:25:31.721767 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:31.721747    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-101.ec2.internal"
Jul 09 18:25:31.785621 ip-10-0-141-101 kubenswrapper[2557]: E0709 18:25:31.785585    2557 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-101.ec2.internal\" not found"
Jul 09 18:25:31.886377 ip-10-0-141-101 kubenswrapper[2557]: E0709 18:25:31.886291    2557 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-101.ec2.internal\" not found"
Jul 09 18:25:31.986811 ip-10-0-141-101 kubenswrapper[2557]: E0709 18:25:31.986784    2557 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-101.ec2.internal\" not found"
Jul 09 18:25:32.007978 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:32.007940    2557 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jul 09 18:25:32.008130 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:32.008110    2557 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 09 18:25:32.087011 ip-10-0-141-101 kubenswrapper[2557]: E0709 18:25:32.086985    2557 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-101.ec2.internal\" not found"
Jul 09 18:25:32.120711 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:32.120665    2557 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-08 18:20:31 +0000 UTC" deadline="2028-01-28 13:45:49.618870743 +0000 UTC"
Jul 09 18:25:32.120711 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:32.120704    2557 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13627h20m17.49817073s"
Jul 09 18:25:32.187493 ip-10-0-141-101 kubenswrapper[2557]: E0709 18:25:32.187411    2557 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-101.ec2.internal\" not found"
Jul 09 18:25:32.193243 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:32.193219    2557 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 09 18:25:32.212172 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:32.212151    2557 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 09 18:25:32.213760 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:32.213742    2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-101.ec2.internal" event="NodeHasSufficientMemory"
Jul 09 18:25:32.213848 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:32.213776    2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-101.ec2.internal" event="NodeHasNoDiskPressure"
Jul 09 18:25:32.213848 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:32.213789    2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-101.ec2.internal" event="NodeHasSufficientPID"
Jul 09 18:25:32.288247 ip-10-0-141-101 kubenswrapper[2557]: E0709 18:25:32.288216    2557 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-101.ec2.internal\" not found"
Jul 09 18:25:32.388705 ip-10-0-141-101 kubenswrapper[2557]: E0709 18:25:32.388667    2557 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-101.ec2.internal\" not found"
Jul 09 18:25:32.406176 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:25:32.406142    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8d7f955ecd105eda414726db5de540d0.slice/crio-513560c6c9a43883759cd840ac19c27a292a9ee4d5e80e74b63746f6eb35f75f WatchSource:0}: Error finding container 513560c6c9a43883759cd840ac19c27a292a9ee4d5e80e74b63746f6eb35f75f: Status 404 returned error can't find the container with id 513560c6c9a43883759cd840ac19c27a292a9ee4d5e80e74b63746f6eb35f75f
Jul 09 18:25:32.406841 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:25:32.406818    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb2c36589f62defe44458de06cdd5da38.slice/crio-9dc50819d7726a9d5d742d5bf26e5a8ffd38306cfa7fa46653f6e66765d6dd2a WatchSource:0}: Error finding container 9dc50819d7726a9d5d742d5bf26e5a8ffd38306cfa7fa46653f6e66765d6dd2a: Status 404 returned error can't find the container with id 9dc50819d7726a9d5d742d5bf26e5a8ffd38306cfa7fa46653f6e66765d6dd2a
Jul 09 18:25:32.411661 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:32.411647    2557 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 09 18:25:32.467535 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:32.467428    2557 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 09 18:25:32.489598 ip-10-0-141-101 kubenswrapper[2557]: E0709 18:25:32.489564    2557 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-101.ec2.internal\" not found"
Jul 09 18:25:32.590304 ip-10-0-141-101 kubenswrapper[2557]: E0709 18:25:32.590268    2557 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-101.ec2.internal\" not found"
Jul 09 18:25:32.664926 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:32.664894    2557 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 09 18:25:32.669933 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:32.669914    2557 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-101.ec2.internal"
Jul 09 18:25:32.691772 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:32.691745    2557 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 09 18:25:32.692794 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:32.692780    2557 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-101.ec2.internal"
Jul 09 18:25:32.703536 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:32.702277    2557 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 09 18:25:32.869808 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:32.869701    2557 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 09 18:25:33.048448 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:33.048417    2557 apiserver.go:52] "Watching apiserver"
Jul 09 18:25:33.059831 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:33.059799    2557 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 09 18:25:33.062564 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:33.062533    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/node-ca-w5wgl","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-101.ec2.internal","openshift-multus/network-metrics-daemon-sk5xh","openshift-network-diagnostics/network-check-target-j7h7r","kube-system/konnectivity-agent-v55vr","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-khxbf","openshift-multus/multus-additional-cni-plugins-s6ptt","openshift-multus/multus-pgtwb","openshift-network-operator/iptables-alerter-kldmh","openshift-ovn-kubernetes/ovnkube-node-6vp8c","kube-system/global-pull-secret-syncer-9f9j6","kube-system/kube-apiserver-proxy-ip-10-0-141-101.ec2.internal","openshift-cluster-node-tuning-operator/tuned-w6nvx","openshift-dns/node-resolver-smljn"]
Jul 09 18:25:33.065281 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:33.065257    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-s6ptt"
Jul 09 18:25:33.067546 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:33.067521    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-w6nvx"
Jul 09 18:25:33.070246 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:33.070202    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sk5xh"
Jul 09 18:25:33.070351 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:33.070257    2557 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jul 09 18:25:33.070351 ip-10-0-141-101 kubenswrapper[2557]: E0709 18:25:33.070296    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sk5xh" podUID="3799d80f-6238-4782-913f-7dba2c15884e"
Jul 09 18:25:33.071787 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:33.071767    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 09 18:25:33.072607 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:33.072588    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 09 18:25:33.072856 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:33.072837    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-258kw\""
Jul 09 18:25:33.073108 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:33.073090    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-j7h7r"
Jul 09 18:25:33.073275 ip-10-0-141-101 kubenswrapper[2557]: E0709 18:25:33.073195    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-j7h7r" podUID="167643e1-1c6b-47ce-8541-e145c13acdb1"
Jul 09 18:25:33.073711 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:33.073690    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-585g8\""
Jul 09 18:25:33.073957 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:33.073939    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 09 18:25:33.074140 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:33.074124    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 09 18:25:33.075001 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:33.074858    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 09 18:25:33.075069 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:33.075048    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 09 18:25:33.075252 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:33.075234    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 09 18:25:33.075845 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:33.075828    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-v55vr"
Jul 09 18:25:33.077615 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:33.077590    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-khxbf"
Jul 09 18:25:33.079887 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:33.079868    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-kldmh"
Jul 09 18:25:33.082115 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:33.082089    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3799d80f-6238-4782-913f-7dba2c15884e-metrics-certs\") pod \"network-metrics-daemon-sk5xh\" (UID: \"3799d80f-6238-4782-913f-7dba2c15884e\") " pod="openshift-multus/network-metrics-daemon-sk5xh"
Jul 09 18:25:33.082203 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:33.082135    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ckxnn\" (UniqueName: \"kubernetes.io/projected/3799d80f-6238-4782-913f-7dba2c15884e-kube-api-access-ckxnn\") pod \"network-metrics-daemon-sk5xh\" (UID: \"3799d80f-6238-4782-913f-7dba2c15884e\") " pod="openshift-multus/network-metrics-daemon-sk5xh"
Jul 09 18:25:33.082203 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:33.082167    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/a6ea2124-43d0-494e-b2ad-6b2933014f0d-etc-sysconfig\") pod \"tuned-w6nvx\" (UID: \"a6ea2124-43d0-494e-b2ad-6b2933014f0d\") " pod="openshift-cluster-node-tuning-operator/tuned-w6nvx"
Jul 09 18:25:33.082203 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:33.082192    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a6ea2124-43d0-494e-b2ad-6b2933014f0d-var-lib-kubelet\") pod \"tuned-w6nvx\" (UID: \"a6ea2124-43d0-494e-b2ad-6b2933014f0d\") " pod="openshift-cluster-node-tuning-operator/tuned-w6nvx"
Jul 09 18:25:33.082353 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:33.082218    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ntqs7\" (UniqueName: \"kubernetes.io/projected/167643e1-1c6b-47ce-8541-e145c13acdb1-kube-api-access-ntqs7\") pod \"network-check-target-j7h7r\" (UID: \"167643e1-1c6b-47ce-8541-e145c13acdb1\") " pod="openshift-network-diagnostics/network-check-target-j7h7r"
Jul 09 18:25:33.082353 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:33.082244    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/cb415bf4-3279-48dc-a565-43e470e3508c-os-release\") pod \"multus-additional-cni-plugins-s6ptt\" (UID: \"cb415bf4-3279-48dc-a565-43e470e3508c\") " pod="openshift-multus/multus-additional-cni-plugins-s6ptt"
Jul 09 18:25:33.082353 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:33.082288    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/a6ea2124-43d0-494e-b2ad-6b2933014f0d-lib-modules\") pod \"tuned-w6nvx\" (UID: \"a6ea2124-43d0-494e-b2ad-6b2933014f0d\") " pod="openshift-cluster-node-tuning-operator/tuned-w6nvx"
Jul 09 18:25:33.082353 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:33.082323    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/a6ea2124-43d0-494e-b2ad-6b2933014f0d-host\") pod \"tuned-w6nvx\" (UID: \"a6ea2124-43d0-494e-b2ad-6b2933014f0d\") " pod="openshift-cluster-node-tuning-operator/tuned-w6nvx"
Jul 09 18:25:33.082353 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:33.082350    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a6ea2124-43d0-494e-b2ad-6b2933014f0d-etc-kubernetes\") pod \"tuned-w6nvx\" (UID: \"a6ea2124-43d0-494e-b2ad-6b2933014f0d\") " pod="openshift-cluster-node-tuning-operator/tuned-w6nvx"
Jul 09 18:25:33.082610 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:33.082372    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/a6ea2124-43d0-494e-b2ad-6b2933014f0d-etc-sysctl-conf\") pod \"tuned-w6nvx\" (UID: \"a6ea2124-43d0-494e-b2ad-6b2933014f0d\") " pod="openshift-cluster-node-tuning-operator/tuned-w6nvx"
Jul 09 18:25:33.082610 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:33.082395    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4qqkb\" (UniqueName: \"kubernetes.io/projected/a6ea2124-43d0-494e-b2ad-6b2933014f0d-kube-api-access-4qqkb\") pod \"tuned-w6nvx\" (UID: \"a6ea2124-43d0-494e-b2ad-6b2933014f0d\") " pod="openshift-cluster-node-tuning-operator/tuned-w6nvx"
Jul 09 18:25:33.082610 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:33.082420    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-w5wgl"
Jul 09 18:25:33.082610 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:33.082419    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/cb415bf4-3279-48dc-a565-43e470e3508c-system-cni-dir\") pod \"multus-additional-cni-plugins-s6ptt\" (UID: \"cb415bf4-3279-48dc-a565-43e470e3508c\") " pod="openshift-multus/multus-additional-cni-plugins-s6ptt"
Jul 09 18:25:33.082610 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:33.082515    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a6ea2124-43d0-494e-b2ad-6b2933014f0d-sys\") pod \"tuned-w6nvx\" (UID: \"a6ea2124-43d0-494e-b2ad-6b2933014f0d\") " pod="openshift-cluster-node-tuning-operator/tuned-w6nvx"
Jul 09 18:25:33.082610 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:33.082538    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/a6ea2124-43d0-494e-b2ad-6b2933014f0d-etc-tuned\") pod \"tuned-w6nvx\" (UID: \"a6ea2124-43d0-494e-b2ad-6b2933014f0d\") " pod="openshift-cluster-node-tuning-operator/tuned-w6nvx"
Jul 09 18:25:33.082610 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:33.082560    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/cb415bf4-3279-48dc-a565-43e470e3508c-cnibin\") pod \"multus-additional-cni-plugins-s6ptt\" (UID: \"cb415bf4-3279-48dc-a565-43e470e3508c\") " pod="openshift-multus/multus-additional-cni-plugins-s6ptt"
Jul 09 18:25:33.082610 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:33.082583    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/cb415bf4-3279-48dc-a565-43e470e3508c-cni-binary-copy\") pod \"multus-additional-cni-plugins-s6ptt\" (UID: \"cb415bf4-3279-48dc-a565-43e470e3508c\") " pod="openshift-multus/multus-additional-cni-plugins-s6ptt"
Jul 09 18:25:33.082610 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:33.082605    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/cb415bf4-3279-48dc-a565-43e470e3508c-tuning-conf-dir\") pod \"multus-additional-cni-plugins-s6ptt\" (UID: \"cb415bf4-3279-48dc-a565-43e470e3508c\") " pod="openshift-multus/multus-additional-cni-plugins-s6ptt"
Jul 09 18:25:33.083003 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:33.082628    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/cb415bf4-3279-48dc-a565-43e470e3508c-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-s6ptt\" (UID: \"cb415bf4-3279-48dc-a565-43e470e3508c\") " pod="openshift-multus/multus-additional-cni-plugins-s6ptt"
Jul 09 18:25:33.083003 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:33.082652    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/cb415bf4-3279-48dc-a565-43e470e3508c-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-s6ptt\" (UID: \"cb415bf4-3279-48dc-a565-43e470e3508c\") " pod="openshift-multus/multus-additional-cni-plugins-s6ptt"
Jul 09 18:25:33.083003 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:33.082688    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jns6l\" (UniqueName: \"kubernetes.io/projected/cb415bf4-3279-48dc-a565-43e470e3508c-kube-api-access-jns6l\") pod \"multus-additional-cni-plugins-s6ptt\" (UID: \"cb415bf4-3279-48dc-a565-43e470e3508c\") " pod="openshift-multus/multus-additional-cni-plugins-s6ptt"
Jul 09 18:25:33.083003 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:33.082713    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/a6ea2124-43d0-494e-b2ad-6b2933014f0d-run\") pod \"tuned-w6nvx\" (UID: \"a6ea2124-43d0-494e-b2ad-6b2933014f0d\") " pod="openshift-cluster-node-tuning-operator/tuned-w6nvx"
Jul 09 18:25:33.083003 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:33.082736    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/a6ea2124-43d0-494e-b2ad-6b2933014f0d-etc-modprobe-d\") pod \"tuned-w6nvx\" (UID: \"a6ea2124-43d0-494e-b2ad-6b2933014f0d\") " pod="openshift-cluster-node-tuning-operator/tuned-w6nvx"
Jul 09 18:25:33.083003 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:33.082758    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/a6ea2124-43d0-494e-b2ad-6b2933014f0d-etc-sysctl-d\") pod \"tuned-w6nvx\" (UID: \"a6ea2124-43d0-494e-b2ad-6b2933014f0d\") " pod="openshift-cluster-node-tuning-operator/tuned-w6nvx"
Jul 09 18:25:33.083003 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:33.082799    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/a6ea2124-43d0-494e-b2ad-6b2933014f0d-etc-systemd\") pod \"tuned-w6nvx\" (UID: \"a6ea2124-43d0-494e-b2ad-6b2933014f0d\") " pod="openshift-cluster-node-tuning-operator/tuned-w6nvx"
Jul 09 18:25:33.083003 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:33.082821    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a6ea2124-43d0-494e-b2ad-6b2933014f0d-tmp\") pod \"tuned-w6nvx\" (UID: \"a6ea2124-43d0-494e-b2ad-6b2933014f0d\") " pod="openshift-cluster-node-tuning-operator/tuned-w6nvx"
Jul 09 18:25:33.083354 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:33.083225    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 09 18:25:33.083354 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:33.083239    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 09 18:25:33.083354 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:33.083329    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 09 18:25:33.083974 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:33.083531    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 09 18:25:33.083974 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:33.083583    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jul 09 18:25:33.083974 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:33.083645    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 09 18:25:33.083974 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:33.083662    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 09 18:25:33.083974 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:33.083730    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 09 18:25:33.084259 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:33.084218    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-2jvbp\""
Jul 09 18:25:33.084259 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:33.084248    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-r4cnv\""
Jul 09 18:25:33.084544 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:33.084510    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-m4wfl\""
Jul 09 18:25:33.084646 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:33.084622    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-smljn"
Jul 09 18:25:33.091724 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:33.090471    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-6vp8c"
Jul 09 18:25:33.093125 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:33.093004    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9f9j6"
Jul 09 18:25:33.093125 ip-10-0-141-101 kubenswrapper[2557]: E0709 18:25:33.093116    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9f9j6" podUID="cdb7f3b5-f8db-4d3f-8067-371e5eda9f3e"
Jul 09 18:25:33.094286 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:33.094247    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 09 18:25:33.096047 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:33.096013    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-pgtwb"
Jul 09 18:25:33.098874 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:33.097132    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 09 18:25:33.098874 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:33.097358    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 09 18:25:33.098874 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:33.097369    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 09 18:25:33.098874 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:33.097628    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 09 18:25:33.098874 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:33.097650    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 09 18:25:33.098874 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:33.097650    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 09 18:25:33.098874 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:33.098181    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 09 18:25:33.098874 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:33.098231    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 09 18:25:33.098874 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:33.098344    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-5mfs6\""
Jul 09 18:25:33.098874 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:33.098377    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-7zgpl\""
Jul 09 18:25:33.098874 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:33.098411    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 09 18:25:33.098874 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:33.098520    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-bdzsk\""
Jul 09 18:25:33.098874 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:33.098601    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 09 18:25:33.101401 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:33.100760    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-h2mrl\""
Jul 09 18:25:33.101401 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:33.101012    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 09 18:25:33.117440 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:33.117412    2557 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 09 18:25:33.135117 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:33.135093    2557 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-j7kt5"
Jul 09 18:25:33.150324 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:33.150297    2557 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-j7kt5"
Jul 09 18:25:33.170859 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:33.170835    2557 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jul 09 18:25:33.183159 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:33.183132    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/6f90a96e-46ae-48f0-b35b-31201873c7e2-multus-socket-dir-parent\") pod \"multus-pgtwb\" (UID: \"6f90a96e-46ae-48f0-b35b-31201873c7e2\") " pod="openshift-multus/multus-pgtwb"
Jul 09 18:25:33.183308 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:33.183169    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/8424b53e-dc3c-4c74-85bd-105eaeb77aa4-device-dir\") pod \"aws-ebs-csi-driver-node-khxbf\" (UID: \"8424b53e-dc3c-4c74-85bd-105eaeb77aa4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-khxbf"
Jul 09 18:25:33.183308 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:33.183200    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pjkpm\" (UniqueName: \"kubernetes.io/projected/8424b53e-dc3c-4c74-85bd-105eaeb77aa4-kube-api-access-pjkpm\") pod \"aws-ebs-csi-driver-node-khxbf\" (UID: \"8424b53e-dc3c-4c74-85bd-105eaeb77aa4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-khxbf"
Jul 09 18:25:33.183308 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:33.183228    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/26a69634-4e01-424c-9d63-7c572b081eaa-systemd-units\") pod \"ovnkube-node-6vp8c\" (UID: \"26a69634-4e01-424c-9d63-7c572b081eaa\") " pod="openshift-ovn-kubernetes/ovnkube-node-6vp8c"
Jul 09 18:25:33.183308 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:33.183280    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a6ea2124-43d0-494e-b2ad-6b2933014f0d-tmp\") pod \"tuned-w6nvx\" (UID: \"a6ea2124-43d0-494e-b2ad-6b2933014f0d\") " pod="openshift-cluster-node-tuning-operator/tuned-w6nvx"
Jul 09 18:25:33.183554 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:33.183313    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ckxnn\" (UniqueName: \"kubernetes.io/projected/3799d80f-6238-4782-913f-7dba2c15884e-kube-api-access-ckxnn\") pod \"network-metrics-daemon-sk5xh\" (UID: \"3799d80f-6238-4782-913f-7dba2c15884e\") " pod="openshift-multus/network-metrics-daemon-sk5xh"
Jul 09 18:25:33.183554 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:33.183342    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/6f90a96e-46ae-48f0-b35b-31201873c7e2-os-release\") pod \"multus-pgtwb\" (UID: \"6f90a96e-46ae-48f0-b35b-31201873c7e2\") " pod="openshift-multus/multus-pgtwb"
Jul 09 18:25:33.183554 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:33.183366    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6f90a96e-46ae-48f0-b35b-31201873c7e2-host-var-lib-kubelet\") pod \"multus-pgtwb\" (UID: \"6f90a96e-46ae-48f0-b35b-31201873c7e2\") " pod="openshift-multus/multus-pgtwb"
Jul 09 18:25:33.183554 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:33.183390    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/8424b53e-dc3c-4c74-85bd-105eaeb77aa4-sys-fs\") pod \"aws-ebs-csi-driver-node-khxbf\" (UID: \"8424b53e-dc3c-4c74-85bd-105eaeb77aa4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-khxbf"
Jul 09 18:25:33.183554 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:33.183412    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/26a69634-4e01-424c-9d63-7c572b081eaa-env-overrides\") pod \"ovnkube-node-6vp8c\" (UID: \"26a69634-4e01-424c-9d63-7c572b081eaa\") " pod="openshift-ovn-kubernetes/ovnkube-node-6vp8c"
Jul 09 18:25:33.183554 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:33.183458    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/26a69634-4e01-424c-9d63-7c572b081eaa-ovnkube-config\") pod \"ovnkube-node-6vp8c\" (UID: \"26a69634-4e01-424c-9d63-7c572b081eaa\") " pod="openshift-ovn-kubernetes/ovnkube-node-6vp8c"
Jul 09 18:25:33.183554 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:33.183499    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/cdb7f3b5-f8db-4d3f-8067-371e5eda9f3e-kubelet-config\") pod \"global-pull-secret-syncer-9f9j6\" (UID: \"cdb7f3b5-f8db-4d3f-8067-371e5eda9f3e\") " pod="kube-system/global-pull-secret-syncer-9f9j6"
Jul 09 18:25:33.183554 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:33.183527    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jns6l\" (UniqueName: \"kubernetes.io/projected/cb415bf4-3279-48dc-a565-43e470e3508c-kube-api-access-jns6l\") pod \"multus-additional-cni-plugins-s6ptt\" (UID: \"cb415bf4-3279-48dc-a565-43e470e3508c\") " pod="openshift-multus/multus-additional-cni-plugins-s6ptt"
Jul 09 18:25:33.183554 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:33.183551    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/a6ea2124-43d0-494e-b2ad-6b2933014f0d-lib-modules\") pod \"tuned-w6nvx\" (UID: \"a6ea2124-43d0-494e-b2ad-6b2933014f0d\") " pod="openshift-cluster-node-tuning-operator/tuned-w6nvx"
Jul 09 18:25:33.184072 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:33.183577    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/a6ea2124-43d0-494e-b2ad-6b2933014f0d-etc-sysctl-conf\") pod \"tuned-w6nvx\" (UID: \"a6ea2124-43d0-494e-b2ad-6b2933014f0d\") " pod="openshift-cluster-node-tuning-operator/tuned-w6nvx"
Jul 09 18:25:33.184072 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:33.183600    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/6f90a96e-46ae-48f0-b35b-31201873c7e2-host-run-k8s-cni-cncf-io\") pod \"multus-pgtwb\" (UID: \"6f90a96e-46ae-48f0-b35b-31201873c7e2\") " pod="openshift-multus/multus-pgtwb"
Jul 09 18:25:33.184072 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:33.183622    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/6f90a96e-46ae-48f0-b35b-31201873c7e2-multus-daemon-config\") pod \"multus-pgtwb\" (UID: \"6f90a96e-46ae-48f0-b35b-31201873c7e2\") " pod="openshift-multus/multus-pgtwb"
Jul 09 18:25:33.184072 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:33.183645    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/cc49c9d1-6be4-487b-adf1-ee18094747b6-serviceca\") pod \"node-ca-w5wgl\" (UID: \"cc49c9d1-6be4-487b-adf1-ee18094747b6\") " pod="openshift-image-registry/node-ca-w5wgl"
Jul 09 18:25:33.184072 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:33.183669    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cmcrn\" (UniqueName: \"kubernetes.io/projected/26a69634-4e01-424c-9d63-7c572b081eaa-kube-api-access-cmcrn\") pod \"ovnkube-node-6vp8c\" (UID: \"26a69634-4e01-424c-9d63-7c572b081eaa\") " pod="openshift-ovn-kubernetes/ovnkube-node-6vp8c"
Jul 09 18:25:33.184072 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:33.183695    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/cb415bf4-3279-48dc-a565-43e470e3508c-cni-binary-copy\") pod \"multus-additional-cni-plugins-s6ptt\" (UID: \"cb415bf4-3279-48dc-a565-43e470e3508c\") " pod="openshift-multus/multus-additional-cni-plugins-s6ptt"
Jul 09 18:25:33.184072 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:33.183699    2557 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jul 09 18:25:33.184072 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:33.183718    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/cb415bf4-3279-48dc-a565-43e470e3508c-tuning-conf-dir\") pod \"multus-additional-cni-plugins-s6ptt\" (UID: \"cb415bf4-3279-48dc-a565-43e470e3508c\") " pod="openshift-multus/multus-additional-cni-plugins-s6ptt"
Jul 09 18:25:33.184072 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:33.183756    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/26a69634-4e01-424c-9d63-7c572b081eaa-etc-openvswitch\") pod \"ovnkube-node-6vp8c\" (UID: \"26a69634-4e01-424c-9d63-7c572b081eaa\") " pod="openshift-ovn-kubernetes/ovnkube-node-6vp8c"
Jul 09 18:25:33.184072 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:33.183776    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/26a69634-4e01-424c-9d63-7c572b081eaa-log-socket\") pod \"ovnkube-node-6vp8c\" (UID: \"26a69634-4e01-424c-9d63-7c572b081eaa\") " pod="openshift-ovn-kubernetes/ovnkube-node-6vp8c"
Jul 09 18:25:33.184072 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:33.183816    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/a6ea2124-43d0-494e-b2ad-6b2933014f0d-etc-systemd\") pod \"tuned-w6nvx\" (UID: \"a6ea2124-43d0-494e-b2ad-6b2933014f0d\") " pod="openshift-cluster-node-tuning-operator/tuned-w6nvx"
Jul 09 18:25:33.184072 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:33.183852    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3799d80f-6238-4782-913f-7dba2c15884e-metrics-certs\") pod \"network-metrics-daemon-sk5xh\" (UID: \"3799d80f-6238-4782-913f-7dba2c15884e\") " pod="openshift-multus/network-metrics-daemon-sk5xh"
Jul 09 18:25:33.184072 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:33.183885    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/6f90a96e-46ae-48f0-b35b-31201873c7e2-host-var-lib-cni-multus\") pod \"multus-pgtwb\" (UID: \"6f90a96e-46ae-48f0-b35b-31201873c7e2\") " pod="openshift-multus/multus-pgtwb"
Jul 09 18:25:33.184072 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:33.183905    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/6f90a96e-46ae-48f0-b35b-31201873c7e2-multus-conf-dir\") pod \"multus-pgtwb\" (UID: \"6f90a96e-46ae-48f0-b35b-31201873c7e2\") " pod="openshift-multus/multus-pgtwb"
Jul 09 18:25:33.184883 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:33.183937    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/8424b53e-dc3c-4c74-85bd-105eaeb77aa4-socket-dir\") pod \"aws-ebs-csi-driver-node-khxbf\" (UID: \"8424b53e-dc3c-4c74-85bd-105eaeb77aa4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-khxbf"
Jul 09 18:25:33.184883 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:33.183979    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/26a69634-4e01-424c-9d63-7c572b081eaa-node-log\") pod \"ovnkube-node-6vp8c\" (UID: \"26a69634-4e01-424c-9d63-7c572b081eaa\") " pod="openshift-ovn-kubernetes/ovnkube-node-6vp8c"
Jul 09 18:25:33.184883 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:33.184003    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/26a69634-4e01-424c-9d63-7c572b081eaa-ovnkube-script-lib\") pod \"ovnkube-node-6vp8c\" (UID: \"26a69634-4e01-424c-9d63-7c572b081eaa\") " pod="openshift-ovn-kubernetes/ovnkube-node-6vp8c"
Jul 09 18:25:33.184883 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:33.184026    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/327c1eaf-28aa-4971-8053-7d3e67515edd-tmp-dir\") pod \"node-resolver-smljn\" (UID: \"327c1eaf-28aa-4971-8053-7d3e67515edd\") " pod="openshift-dns/node-resolver-smljn"
Jul 09 18:25:33.184883 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:33.184048    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4k7xj\" (UniqueName: \"kubernetes.io/projected/6f90a96e-46ae-48f0-b35b-31201873c7e2-kube-api-access-4k7xj\") pod \"multus-pgtwb\" (UID: \"6f90a96e-46ae-48f0-b35b-31201873c7e2\") " pod="openshift-multus/multus-pgtwb"
Jul 09 18:25:33.184883 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:33.184068    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/26a69634-4e01-424c-9d63-7c572b081eaa-run-openvswitch\") pod \"ovnkube-node-6vp8c\" (UID: \"26a69634-4e01-424c-9d63-7c572b081eaa\") " pod="openshift-ovn-kubernetes/ovnkube-node-6vp8c"
Jul 09 18:25:33.184883 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:33.184099    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/a6ea2124-43d0-494e-b2ad-6b2933014f0d-host\") pod \"tuned-w6nvx\" (UID: \"a6ea2124-43d0-494e-b2ad-6b2933014f0d\") " pod="openshift-cluster-node-tuning-operator/tuned-w6nvx"
Jul 09 18:25:33.184883 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:33.184132    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4qqkb\" (UniqueName: \"kubernetes.io/projected/a6ea2124-43d0-494e-b2ad-6b2933014f0d-kube-api-access-4qqkb\") pod \"tuned-w6nvx\" (UID: \"a6ea2124-43d0-494e-b2ad-6b2933014f0d\") " pod="openshift-cluster-node-tuning-operator/tuned-w6nvx"
Jul 09 18:25:33.184883 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:33.184242    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6f90a96e-46ae-48f0-b35b-31201873c7e2-multus-cni-dir\") pod \"multus-pgtwb\" (UID: \"6f90a96e-46ae-48f0-b35b-31201873c7e2\") " pod="openshift-multus/multus-pgtwb"
Jul 09 18:25:33.184883 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:33.184263    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/a6ea2124-43d0-494e-b2ad-6b2933014f0d-host\") pod \"tuned-w6nvx\" (UID: \"a6ea2124-43d0-494e-b2ad-6b2933014f0d\") " pod="openshift-cluster-node-tuning-operator/tuned-w6nvx"
Jul 09 18:25:33.184883 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:33.184352    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/6f90a96e-46ae-48f0-b35b-31201873c7e2-host-var-lib-cni-bin\") pod \"multus-pgtwb\" (UID: \"6f90a96e-46ae-48f0-b35b-31201873c7e2\") " pod="openshift-multus/multus-pgtwb"
Jul 09 18:25:33.184883 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:33.184414    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/8424b53e-dc3c-4c74-85bd-105eaeb77aa4-etc-selinux\") pod \"aws-ebs-csi-driver-node-khxbf\" (UID: \"8424b53e-dc3c-4c74-85bd-105eaeb77aa4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-khxbf"
Jul 09 18:25:33.184883 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:33.184453    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/26a69634-4e01-424c-9d63-7c572b081eaa-run-ovn\") pod \"ovnkube-node-6vp8c\" (UID: \"26a69634-4e01-424c-9d63-7c572b081eaa\") " pod="openshift-ovn-kubernetes/ovnkube-node-6vp8c"
Jul 09 18:25:33.184883 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:33.184465    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/a6ea2124-43d0-494e-b2ad-6b2933014f0d-etc-sysctl-conf\") pod \"tuned-w6nvx\" (UID: \"a6ea2124-43d0-494e-b2ad-6b2933014f0d\") " pod="openshift-cluster-node-tuning-operator/tuned-w6nvx"
Jul 09 18:25:33.185592 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:33.184513    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/26a69634-4e01-424c-9d63-7c572b081eaa-host-cni-bin\") pod \"ovnkube-node-6vp8c\" (UID: \"26a69634-4e01-424c-9d63-7c572b081eaa\") " pod="openshift-ovn-kubernetes/ovnkube-node-6vp8c"
Jul 09 18:25:33.185592 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:33.184569    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bgxmf\" (UniqueName: \"kubernetes.io/projected/327c1eaf-28aa-4971-8053-7d3e67515edd-kube-api-access-bgxmf\") pod \"node-resolver-smljn\" (UID: \"327c1eaf-28aa-4971-8053-7d3e67515edd\") " pod="openshift-dns/node-resolver-smljn"
Jul 09 18:25:33.185592 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:33.184593    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/a6ea2124-43d0-494e-b2ad-6b2933014f0d-lib-modules\") pod \"tuned-w6nvx\" (UID: \"a6ea2124-43d0-494e-b2ad-6b2933014f0d\") " pod="openshift-cluster-node-tuning-operator/tuned-w6nvx"
Jul 09 18:25:33.185592 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:33.184612    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/a6ea2124-43d0-494e-b2ad-6b2933014f0d-etc-tuned\") pod \"tuned-w6nvx\" (UID: \"a6ea2124-43d0-494e-b2ad-6b2933014f0d\") " pod="openshift-cluster-node-tuning-operator/tuned-w6nvx"
Jul 09 18:25:33.185592 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:33.184653    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/cb415bf4-3279-48dc-a565-43e470e3508c-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-s6ptt\" (UID: \"cb415bf4-3279-48dc-a565-43e470e3508c\") " pod="openshift-multus/multus-additional-cni-plugins-s6ptt"
Jul 09 18:25:33.185592 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:33.184682    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/cb415bf4-3279-48dc-a565-43e470e3508c-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-s6ptt\" (UID: \"cb415bf4-3279-48dc-a565-43e470e3508c\") " pod="openshift-multus/multus-additional-cni-plugins-s6ptt"
Jul 09 18:25:33.185592 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:33.184727    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6f90a96e-46ae-48f0-b35b-31201873c7e2-etc-kubernetes\") pod \"multus-pgtwb\" (UID: \"6f90a96e-46ae-48f0-b35b-31201873c7e2\") " pod="openshift-multus/multus-pgtwb"
Jul 09 18:25:33.185592 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:33.184783    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/cb415bf4-3279-48dc-a565-43e470e3508c-tuning-conf-dir\") pod \"multus-additional-cni-plugins-s6ptt\" (UID: \"cb415bf4-3279-48dc-a565-43e470e3508c\") " pod="openshift-multus/multus-additional-cni-plugins-s6ptt"
Jul 09 18:25:33.185592 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:33.184823    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/26a69634-4e01-424c-9d63-7c572b081eaa-host-cni-netd\") pod \"ovnkube-node-6vp8c\" (UID: \"26a69634-4e01-424c-9d63-7c572b081eaa\") " pod="openshift-ovn-kubernetes/ovnkube-node-6vp8c"
Jul 09 18:25:33.185592 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:33.184839    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/a6ea2124-43d0-494e-b2ad-6b2933014f0d-etc-systemd\") pod \"tuned-w6nvx\" (UID: \"a6ea2124-43d0-494e-b2ad-6b2933014f0d\") " pod="openshift-cluster-node-tuning-operator/tuned-w6nvx"
Jul 09 18:25:33.185592 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:33.184854    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/a6ea2124-43d0-494e-b2ad-6b2933014f0d-run\") pod \"tuned-w6nvx\" (UID: \"a6ea2124-43d0-494e-b2ad-6b2933014f0d\") " pod="openshift-cluster-node-tuning-operator/tuned-w6nvx"
Jul 09 18:25:33.185592 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:33.184863    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/cb415bf4-3279-48dc-a565-43e470e3508c-cni-binary-copy\") pod \"multus-additional-cni-plugins-s6ptt\" (UID: \"cb415bf4-3279-48dc-a565-43e470e3508c\") " pod="openshift-multus/multus-additional-cni-plugins-s6ptt"
Jul 09 18:25:33.185592 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:33.184884    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/a6ea2124-43d0-494e-b2ad-6b2933014f0d-etc-modprobe-d\") pod \"tuned-w6nvx\" (UID: \"a6ea2124-43d0-494e-b2ad-6b2933014f0d\") " pod="openshift-cluster-node-tuning-operator/tuned-w6nvx"
Jul 09 18:25:33.185592 ip-10-0-141-101 kubenswrapper[2557]: E0709 18:25:33.184868    2557 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 09 18:25:33.186269 ip-10-0-141-101 kubenswrapper[2557]: E0709 18:25:33.185076    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3799d80f-6238-4782-913f-7dba2c15884e-metrics-certs podName:3799d80f-6238-4782-913f-7dba2c15884e nodeName:}" failed. No retries permitted until 2026-07-09 18:25:33.685053068 +0000 UTC m=+2.924397688 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3799d80f-6238-4782-913f-7dba2c15884e-metrics-certs") pod "network-metrics-daemon-sk5xh" (UID: "3799d80f-6238-4782-913f-7dba2c15884e") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 09 18:25:33.186269 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:33.185100    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/a6ea2124-43d0-494e-b2ad-6b2933014f0d-etc-sysctl-d\") pod \"tuned-w6nvx\" (UID: \"a6ea2124-43d0-494e-b2ad-6b2933014f0d\") " pod="openshift-cluster-node-tuning-operator/tuned-w6nvx"
Jul 09 18:25:33.186269 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:33.185105    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/a6ea2124-43d0-494e-b2ad-6b2933014f0d-run\") pod \"tuned-w6nvx\" (UID: \"a6ea2124-43d0-494e-b2ad-6b2933014f0d\") " pod="openshift-cluster-node-tuning-operator/tuned-w6nvx"
Jul 09 18:25:33.186269 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:33.185146    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/26a69634-4e01-424c-9d63-7c572b081eaa-var-lib-openvswitch\") pod \"ovnkube-node-6vp8c\" (UID: \"26a69634-4e01-424c-9d63-7c572b081eaa\") " pod="openshift-ovn-kubernetes/ovnkube-node-6vp8c"
Jul 09 18:25:33.186269 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:33.185200    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/cdb7f3b5-f8db-4d3f-8067-371e5eda9f3e-dbus\") pod \"global-pull-secret-syncer-9f9j6\" (UID: \"cdb7f3b5-f8db-4d3f-8067-371e5eda9f3e\") " pod="kube-system/global-pull-secret-syncer-9f9j6"
Jul 09 18:25:33.186269 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:33.185230    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wb977\" (UniqueName: \"kubernetes.io/projected/90d2aea7-1ee6-42f5-a94e-7b4f92963831-kube-api-access-wb977\") pod \"iptables-alerter-kldmh\" (UID: \"90d2aea7-1ee6-42f5-a94e-7b4f92963831\") " pod="openshift-network-operator/iptables-alerter-kldmh"
Jul 09 18:25:33.186269 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:33.185266    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/a6ea2124-43d0-494e-b2ad-6b2933014f0d-etc-sysconfig\") pod \"tuned-w6nvx\" (UID: \"a6ea2124-43d0-494e-b2ad-6b2933014f0d\") " pod="openshift-cluster-node-tuning-operator/tuned-w6nvx"
Jul 09 18:25:33.186269 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:33.185205    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/a6ea2124-43d0-494e-b2ad-6b2933014f0d-etc-sysctl-d\") pod \"tuned-w6nvx\" (UID: \"a6ea2124-43d0-494e-b2ad-6b2933014f0d\") " pod="openshift-cluster-node-tuning-operator/tuned-w6nvx"
Jul 09 18:25:33.186269 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:33.185314    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a6ea2124-43d0-494e-b2ad-6b2933014f0d-var-lib-kubelet\") pod \"tuned-w6nvx\" (UID: \"a6ea2124-43d0-494e-b2ad-6b2933014f0d\") " pod="openshift-cluster-node-tuning-operator/tuned-w6nvx"
Jul 09 18:25:33.186269 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:33.185345    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/6f90a96e-46ae-48f0-b35b-31201873c7e2-cni-binary-copy\") pod \"multus-pgtwb\" (UID: \"6f90a96e-46ae-48f0-b35b-31201873c7e2\") " pod="openshift-multus/multus-pgtwb"
Jul 09 18:25:33.186269 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:33.185357    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/a6ea2124-43d0-494e-b2ad-6b2933014f0d-etc-sysconfig\") pod \"tuned-w6nvx\" (UID: \"a6ea2124-43d0-494e-b2ad-6b2933014f0d\") " pod="openshift-cluster-node-tuning-operator/tuned-w6nvx"
Jul 09 18:25:33.186269 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:33.185313    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/cb415bf4-3279-48dc-a565-43e470e3508c-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-s6ptt\" (UID: \"cb415bf4-3279-48dc-a565-43e470e3508c\") " pod="openshift-multus/multus-additional-cni-plugins-s6ptt"
Jul 09 18:25:33.186269 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:33.185393    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/26a69634-4e01-424c-9d63-7c572b081eaa-host-slash\") pod \"ovnkube-node-6vp8c\" (UID: \"26a69634-4e01-424c-9d63-7c572b081eaa\") " pod="openshift-ovn-kubernetes/ovnkube-node-6vp8c"
Jul 09 18:25:33.187017 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:33.185399    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/a6ea2124-43d0-494e-b2ad-6b2933014f0d-etc-modprobe-d\") pod \"tuned-w6nvx\" (UID: \"a6ea2124-43d0-494e-b2ad-6b2933014f0d\") " pod="openshift-cluster-node-tuning-operator/tuned-w6nvx"
Jul 09 18:25:33.187017 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:33.185398    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/cb415bf4-3279-48dc-a565-43e470e3508c-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-s6ptt\" (UID: \"cb415bf4-3279-48dc-a565-43e470e3508c\") " pod="openshift-multus/multus-additional-cni-plugins-s6ptt"
Jul 09 18:25:33.187017 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:33.185412    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a6ea2124-43d0-494e-b2ad-6b2933014f0d-var-lib-kubelet\") pod \"tuned-w6nvx\" (UID: \"a6ea2124-43d0-494e-b2ad-6b2933014f0d\") " pod="openshift-cluster-node-tuning-operator/tuned-w6nvx"
Jul 09 18:25:33.187017 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:33.185440    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/90d2aea7-1ee6-42f5-a94e-7b4f92963831-iptables-alerter-script\") pod \"iptables-alerter-kldmh\" (UID: \"90d2aea7-1ee6-42f5-a94e-7b4f92963831\") " pod="openshift-network-operator/iptables-alerter-kldmh"
Jul 09 18:25:33.187017 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:33.185504    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/cb415bf4-3279-48dc-a565-43e470e3508c-system-cni-dir\") pod \"multus-additional-cni-plugins-s6ptt\" (UID: \"cb415bf4-3279-48dc-a565-43e470e3508c\") " pod="openshift-multus/multus-additional-cni-plugins-s6ptt"
Jul 09 18:25:33.187017 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:33.185534    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/cb415bf4-3279-48dc-a565-43e470e3508c-cnibin\") pod \"multus-additional-cni-plugins-s6ptt\" (UID: \"cb415bf4-3279-48dc-a565-43e470e3508c\") " pod="openshift-multus/multus-additional-cni-plugins-s6ptt"
Jul 09 18:25:33.187017 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:33.185574    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/cb415bf4-3279-48dc-a565-43e470e3508c-system-cni-dir\") pod \"multus-additional-cni-plugins-s6ptt\" (UID: \"cb415bf4-3279-48dc-a565-43e470e3508c\") " pod="openshift-multus/multus-additional-cni-plugins-s6ptt"
Jul 09 18:25:33.187017 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:33.185625    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/6f90a96e-46ae-48f0-b35b-31201873c7e2-cnibin\") pod \"multus-pgtwb\" (UID: \"6f90a96e-46ae-48f0-b35b-31201873c7e2\") " pod="openshift-multus/multus-pgtwb"
Jul 09 18:25:33.187017 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:33.185650    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/cb415bf4-3279-48dc-a565-43e470e3508c-cnibin\") pod \"multus-additional-cni-plugins-s6ptt\" (UID: \"cb415bf4-3279-48dc-a565-43e470e3508c\") " pod="openshift-multus/multus-additional-cni-plugins-s6ptt"
Jul 09 18:25:33.187017 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:33.185694    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/cb415bf4-3279-48dc-a565-43e470e3508c-os-release\") pod \"multus-additional-cni-plugins-s6ptt\" (UID: \"cb415bf4-3279-48dc-a565-43e470e3508c\") " pod="openshift-multus/multus-additional-cni-plugins-s6ptt"
Jul 09 18:25:33.187017 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:33.185732    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6f90a96e-46ae-48f0-b35b-31201873c7e2-system-cni-dir\") pod \"multus-pgtwb\" (UID: \"6f90a96e-46ae-48f0-b35b-31201873c7e2\") " pod="openshift-multus/multus-pgtwb"
Jul 09 18:25:33.187017 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:33.185761    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/cb415bf4-3279-48dc-a565-43e470e3508c-os-release\") pod \"multus-additional-cni-plugins-s6ptt\" (UID: \"cb415bf4-3279-48dc-a565-43e470e3508c\") " pod="openshift-multus/multus-additional-cni-plugins-s6ptt"
Jul 09 18:25:33.187017 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:33.185763    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/6f90a96e-46ae-48f0-b35b-31201873c7e2-host-run-multus-certs\") pod \"multus-pgtwb\" (UID: \"6f90a96e-46ae-48f0-b35b-31201873c7e2\") " pod="openshift-multus/multus-pgtwb"
Jul 09 18:25:33.187017 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:33.185802    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/8424b53e-dc3c-4c74-85bd-105eaeb77aa4-registration-dir\") pod \"aws-ebs-csi-driver-node-khxbf\" (UID: \"8424b53e-dc3c-4c74-85bd-105eaeb77aa4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-khxbf"
Jul 09 18:25:33.187710 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:33.185839    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/26a69634-4e01-424c-9d63-7c572b081eaa-ovn-node-metrics-cert\") pod \"ovnkube-node-6vp8c\" (UID: \"26a69634-4e01-424c-9d63-7c572b081eaa\") " pod="openshift-ovn-kubernetes/ovnkube-node-6vp8c"
Jul 09 18:25:33.187710 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:33.185884    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/90d2aea7-1ee6-42f5-a94e-7b4f92963831-host-slash\") pod \"iptables-alerter-kldmh\" (UID: \"90d2aea7-1ee6-42f5-a94e-7b4f92963831\") " pod="openshift-network-operator/iptables-alerter-kldmh"
Jul 09 18:25:33.187710 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:33.185918    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/327c1eaf-28aa-4971-8053-7d3e67515edd-hosts-file\") pod \"node-resolver-smljn\" (UID: \"327c1eaf-28aa-4971-8053-7d3e67515edd\") " pod="openshift-dns/node-resolver-smljn"
Jul 09 18:25:33.187710 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:33.185966    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ntqs7\" (UniqueName: \"kubernetes.io/projected/167643e1-1c6b-47ce-8541-e145c13acdb1-kube-api-access-ntqs7\") pod \"network-check-target-j7h7r\" (UID: \"167643e1-1c6b-47ce-8541-e145c13acdb1\") " pod="openshift-network-diagnostics/network-check-target-j7h7r"
Jul 09 18:25:33.187710 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:33.186072    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/6f90a96e-46ae-48f0-b35b-31201873c7e2-hostroot\") pod \"multus-pgtwb\" (UID: \"6f90a96e-46ae-48f0-b35b-31201873c7e2\") " pod="openshift-multus/multus-pgtwb"
Jul 09 18:25:33.187710 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:33.186116    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/8424b53e-dc3c-4c74-85bd-105eaeb77aa4-kubelet-dir\") pod \"aws-ebs-csi-driver-node-khxbf\" (UID: \"8424b53e-dc3c-4c74-85bd-105eaeb77aa4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-khxbf"
Jul 09 18:25:33.187710 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:33.186144    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/26a69634-4e01-424c-9d63-7c572b081eaa-host-run-netns\") pod \"ovnkube-node-6vp8c\" (UID: \"26a69634-4e01-424c-9d63-7c572b081eaa\") " pod="openshift-ovn-kubernetes/ovnkube-node-6vp8c"
Jul 09 18:25:33.187710 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:33.186187    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/26a69634-4e01-424c-9d63-7c572b081eaa-run-systemd\") pod \"ovnkube-node-6vp8c\" (UID: \"26a69634-4e01-424c-9d63-7c572b081eaa\") " pod="openshift-ovn-kubernetes/ovnkube-node-6vp8c"
Jul 09 18:25:33.187710 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:33.186231    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/26a69634-4e01-424c-9d63-7c572b081eaa-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-6vp8c\" (UID: \"26a69634-4e01-424c-9d63-7c572b081eaa\") " pod="openshift-ovn-kubernetes/ovnkube-node-6vp8c"
Jul 09 18:25:33.187710 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:33.186266    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/cdb7f3b5-f8db-4d3f-8067-371e5eda9f3e-original-pull-secret\") pod \"global-pull-secret-syncer-9f9j6\" (UID: \"cdb7f3b5-f8db-4d3f-8067-371e5eda9f3e\") " pod="kube-system/global-pull-secret-syncer-9f9j6"
Jul 09 18:25:33.187710 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:33.186292    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/62a8b86b-6eaf-4e72-aa0b-2de8fa04ed16-agent-certs\") pod \"konnectivity-agent-v55vr\" (UID: \"62a8b86b-6eaf-4e72-aa0b-2de8fa04ed16\") " pod="kube-system/konnectivity-agent-v55vr"
Jul 09 18:25:33.187710 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:33.186329    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a6ea2124-43d0-494e-b2ad-6b2933014f0d-etc-kubernetes\") pod \"tuned-w6nvx\" (UID: \"a6ea2124-43d0-494e-b2ad-6b2933014f0d\") " pod="openshift-cluster-node-tuning-operator/tuned-w6nvx"
Jul 09 18:25:33.187710 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:33.186363    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/6f90a96e-46ae-48f0-b35b-31201873c7e2-host-run-netns\") pod \"multus-pgtwb\" (UID: \"6f90a96e-46ae-48f0-b35b-31201873c7e2\") " pod="openshift-multus/multus-pgtwb"
Jul 09 18:25:33.187710 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:33.186425    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a6ea2124-43d0-494e-b2ad-6b2933014f0d-etc-kubernetes\") pod \"tuned-w6nvx\" (UID: \"a6ea2124-43d0-494e-b2ad-6b2933014f0d\") " pod="openshift-cluster-node-tuning-operator/tuned-w6nvx"
Jul 09 18:25:33.188400 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:33.186427    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/cc49c9d1-6be4-487b-adf1-ee18094747b6-host\") pod \"node-ca-w5wgl\" (UID: \"cc49c9d1-6be4-487b-adf1-ee18094747b6\") " pod="openshift-image-registry/node-ca-w5wgl"
Jul 09 18:25:33.188400 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:33.186467    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g4ht5\" (UniqueName: \"kubernetes.io/projected/cc49c9d1-6be4-487b-adf1-ee18094747b6-kube-api-access-g4ht5\") pod \"node-ca-w5wgl\" (UID: \"cc49c9d1-6be4-487b-adf1-ee18094747b6\") " pod="openshift-image-registry/node-ca-w5wgl"
Jul 09 18:25:33.188400 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:33.186514    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/26a69634-4e01-424c-9d63-7c572b081eaa-host-kubelet\") pod \"ovnkube-node-6vp8c\" (UID: \"26a69634-4e01-424c-9d63-7c572b081eaa\") " pod="openshift-ovn-kubernetes/ovnkube-node-6vp8c"
Jul 09 18:25:33.188400 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:33.186549    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/26a69634-4e01-424c-9d63-7c572b081eaa-host-run-ovn-kubernetes\") pod \"ovnkube-node-6vp8c\" (UID: \"26a69634-4e01-424c-9d63-7c572b081eaa\") " pod="openshift-ovn-kubernetes/ovnkube-node-6vp8c"
Jul 09 18:25:33.188400 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:33.186575    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/62a8b86b-6eaf-4e72-aa0b-2de8fa04ed16-konnectivity-ca\") pod \"konnectivity-agent-v55vr\" (UID: \"62a8b86b-6eaf-4e72-aa0b-2de8fa04ed16\") " pod="kube-system/konnectivity-agent-v55vr"
Jul 09 18:25:33.188400 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:33.186605    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a6ea2124-43d0-494e-b2ad-6b2933014f0d-sys\") pod \"tuned-w6nvx\" (UID: \"a6ea2124-43d0-494e-b2ad-6b2933014f0d\") " pod="openshift-cluster-node-tuning-operator/tuned-w6nvx"
Jul 09 18:25:33.188400 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:33.186697    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a6ea2124-43d0-494e-b2ad-6b2933014f0d-sys\") pod \"tuned-w6nvx\" (UID: \"a6ea2124-43d0-494e-b2ad-6b2933014f0d\") " pod="openshift-cluster-node-tuning-operator/tuned-w6nvx"
Jul 09 18:25:33.188400 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:33.187653    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a6ea2124-43d0-494e-b2ad-6b2933014f0d-tmp\") pod \"tuned-w6nvx\" (UID: \"a6ea2124-43d0-494e-b2ad-6b2933014f0d\") " pod="openshift-cluster-node-tuning-operator/tuned-w6nvx"
Jul 09 18:25:33.189187 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:33.189163    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/a6ea2124-43d0-494e-b2ad-6b2933014f0d-etc-tuned\") pod \"tuned-w6nvx\" (UID: \"a6ea2124-43d0-494e-b2ad-6b2933014f0d\") " pod="openshift-cluster-node-tuning-operator/tuned-w6nvx"
Jul 09 18:25:33.206137 ip-10-0-141-101 kubenswrapper[2557]: E0709 18:25:33.206041    2557 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 09 18:25:33.206137 ip-10-0-141-101 kubenswrapper[2557]: E0709 18:25:33.206065    2557 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 09 18:25:33.206137 ip-10-0-141-101 kubenswrapper[2557]: E0709 18:25:33.206085    2557 projected.go:196] Error preparing data for projected volume kube-api-access-ntqs7 for pod openshift-network-diagnostics/network-check-target-j7h7r: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 09 18:25:33.206392 ip-10-0-141-101 kubenswrapper[2557]: E0709 18:25:33.206150    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/167643e1-1c6b-47ce-8541-e145c13acdb1-kube-api-access-ntqs7 podName:167643e1-1c6b-47ce-8541-e145c13acdb1 nodeName:}" failed. No retries permitted until 2026-07-09 18:25:33.706130309 +0000 UTC m=+2.945474917 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-ntqs7" (UniqueName: "kubernetes.io/projected/167643e1-1c6b-47ce-8541-e145c13acdb1-kube-api-access-ntqs7") pod "network-check-target-j7h7r" (UID: "167643e1-1c6b-47ce-8541-e145c13acdb1") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 09 18:25:33.206907 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:33.206884    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4qqkb\" (UniqueName: \"kubernetes.io/projected/a6ea2124-43d0-494e-b2ad-6b2933014f0d-kube-api-access-4qqkb\") pod \"tuned-w6nvx\" (UID: \"a6ea2124-43d0-494e-b2ad-6b2933014f0d\") " pod="openshift-cluster-node-tuning-operator/tuned-w6nvx"
Jul 09 18:25:33.212307 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:33.212263    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ckxnn\" (UniqueName: \"kubernetes.io/projected/3799d80f-6238-4782-913f-7dba2c15884e-kube-api-access-ckxnn\") pod \"network-metrics-daemon-sk5xh\" (UID: \"3799d80f-6238-4782-913f-7dba2c15884e\") " pod="openshift-multus/network-metrics-daemon-sk5xh"
Jul 09 18:25:33.213906 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:33.213882    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jns6l\" (UniqueName: \"kubernetes.io/projected/cb415bf4-3279-48dc-a565-43e470e3508c-kube-api-access-jns6l\") pod \"multus-additional-cni-plugins-s6ptt\" (UID: \"cb415bf4-3279-48dc-a565-43e470e3508c\") " pod="openshift-multus/multus-additional-cni-plugins-s6ptt"
Jul 09 18:25:33.263910 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:33.263844    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-101.ec2.internal" event={"ID":"b2c36589f62defe44458de06cdd5da38","Type":"ContainerStarted","Data":"9dc50819d7726a9d5d742d5bf26e5a8ffd38306cfa7fa46653f6e66765d6dd2a"}
Jul 09 18:25:33.265918 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:33.265883    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-101.ec2.internal" event={"ID":"8d7f955ecd105eda414726db5de540d0","Type":"ContainerStarted","Data":"513560c6c9a43883759cd840ac19c27a292a9ee4d5e80e74b63746f6eb35f75f"}
Jul 09 18:25:33.287078 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:33.287033    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6f90a96e-46ae-48f0-b35b-31201873c7e2-multus-cni-dir\") pod \"multus-pgtwb\" (UID: \"6f90a96e-46ae-48f0-b35b-31201873c7e2\") " pod="openshift-multus/multus-pgtwb"
Jul 09 18:25:33.287078 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:33.287082    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/6f90a96e-46ae-48f0-b35b-31201873c7e2-host-var-lib-cni-bin\") pod \"multus-pgtwb\" (UID: \"6f90a96e-46ae-48f0-b35b-31201873c7e2\") " pod="openshift-multus/multus-pgtwb"
Jul 09 18:25:33.287319 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:33.287110    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/8424b53e-dc3c-4c74-85bd-105eaeb77aa4-etc-selinux\") pod \"aws-ebs-csi-driver-node-khxbf\" (UID: \"8424b53e-dc3c-4c74-85bd-105eaeb77aa4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-khxbf"
Jul 09 18:25:33.287319 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:33.287135    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/26a69634-4e01-424c-9d63-7c572b081eaa-run-ovn\") pod \"ovnkube-node-6vp8c\" (UID: \"26a69634-4e01-424c-9d63-7c572b081eaa\") " pod="openshift-ovn-kubernetes/ovnkube-node-6vp8c"
Jul 09 18:25:33.287319 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:33.287160    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/26a69634-4e01-424c-9d63-7c572b081eaa-host-cni-bin\") pod \"ovnkube-node-6vp8c\" (UID: \"26a69634-4e01-424c-9d63-7c572b081eaa\") " pod="openshift-ovn-kubernetes/ovnkube-node-6vp8c"
Jul 09 18:25:33.287319 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:33.287184    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bgxmf\" (UniqueName: \"kubernetes.io/projected/327c1eaf-28aa-4971-8053-7d3e67515edd-kube-api-access-bgxmf\") pod \"node-resolver-smljn\" (UID: \"327c1eaf-28aa-4971-8053-7d3e67515edd\") " pod="openshift-dns/node-resolver-smljn"
Jul 09 18:25:33.287319 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:33.287212    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6f90a96e-46ae-48f0-b35b-31201873c7e2-etc-kubernetes\") pod \"multus-pgtwb\" (UID: \"6f90a96e-46ae-48f0-b35b-31201873c7e2\") " pod="openshift-multus/multus-pgtwb"
Jul 09 18:25:33.287319 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:33.287236    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/26a69634-4e01-424c-9d63-7c572b081eaa-host-cni-netd\") pod \"ovnkube-node-6vp8c\" (UID: \"26a69634-4e01-424c-9d63-7c572b081eaa\") " pod="openshift-ovn-kubernetes/ovnkube-node-6vp8c"
Jul 09 18:25:33.287319 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:33.287261    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/26a69634-4e01-424c-9d63-7c572b081eaa-var-lib-openvswitch\") pod \"ovnkube-node-6vp8c\" (UID: \"26a69634-4e01-424c-9d63-7c572b081eaa\") " pod="openshift-ovn-kubernetes/ovnkube-node-6vp8c"
Jul 09 18:25:33.287319 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:33.287284    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/cdb7f3b5-f8db-4d3f-8067-371e5eda9f3e-dbus\") pod \"global-pull-secret-syncer-9f9j6\" (UID: \"cdb7f3b5-f8db-4d3f-8067-371e5eda9f3e\") " pod="kube-system/global-pull-secret-syncer-9f9j6"
Jul 09 18:25:33.287319 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:33.287309    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wb977\" (UniqueName: \"kubernetes.io/projected/90d2aea7-1ee6-42f5-a94e-7b4f92963831-kube-api-access-wb977\") pod \"iptables-alerter-kldmh\" (UID: \"90d2aea7-1ee6-42f5-a94e-7b4f92963831\") " pod="openshift-network-operator/iptables-alerter-kldmh"
Jul 09 18:25:33.287319 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:33.287311    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/26a69634-4e01-424c-9d63-7c572b081eaa-run-ovn\") pod \"ovnkube-node-6vp8c\" (UID: \"26a69634-4e01-424c-9d63-7c572b081eaa\") " pod="openshift-ovn-kubernetes/ovnkube-node-6vp8c"
Jul 09 18:25:33.287824 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:33.287335    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/6f90a96e-46ae-48f0-b35b-31201873c7e2-cni-binary-copy\") pod \"multus-pgtwb\" (UID: \"6f90a96e-46ae-48f0-b35b-31201873c7e2\") " pod="openshift-multus/multus-pgtwb"
Jul 09 18:25:33.287824 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:33.287358    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/26a69634-4e01-424c-9d63-7c572b081eaa-host-slash\") pod \"ovnkube-node-6vp8c\" (UID: \"26a69634-4e01-424c-9d63-7c572b081eaa\") " pod="openshift-ovn-kubernetes/ovnkube-node-6vp8c"
Jul 09 18:25:33.287824 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:33.287408    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/90d2aea7-1ee6-42f5-a94e-7b4f92963831-iptables-alerter-script\") pod \"iptables-alerter-kldmh\" (UID: \"90d2aea7-1ee6-42f5-a94e-7b4f92963831\") " pod="openshift-network-operator/iptables-alerter-kldmh"
Jul 09 18:25:33.287824 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:33.287416    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/26a69634-4e01-424c-9d63-7c572b081eaa-host-cni-netd\") pod \"ovnkube-node-6vp8c\" (UID: \"26a69634-4e01-424c-9d63-7c572b081eaa\") " pod="openshift-ovn-kubernetes/ovnkube-node-6vp8c"
Jul 09 18:25:33.287824 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:33.287435    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/6f90a96e-46ae-48f0-b35b-31201873c7e2-cnibin\") pod \"multus-pgtwb\" (UID: \"6f90a96e-46ae-48f0-b35b-31201873c7e2\") " pod="openshift-multus/multus-pgtwb"
Jul 09 18:25:33.287824 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:33.287492    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6f90a96e-46ae-48f0-b35b-31201873c7e2-multus-cni-dir\") pod \"multus-pgtwb\" (UID: \"6f90a96e-46ae-48f0-b35b-31201873c7e2\") " pod="openshift-multus/multus-pgtwb"
Jul 09 18:25:33.287824 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:33.287510    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/6f90a96e-46ae-48f0-b35b-31201873c7e2-cnibin\") pod \"multus-pgtwb\" (UID: \"6f90a96e-46ae-48f0-b35b-31201873c7e2\") " pod="openshift-multus/multus-pgtwb"
Jul 09 18:25:33.287824 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:33.287534    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/26a69634-4e01-424c-9d63-7c572b081eaa-host-cni-bin\") pod \"ovnkube-node-6vp8c\" (UID: \"26a69634-4e01-424c-9d63-7c572b081eaa\") " pod="openshift-ovn-kubernetes/ovnkube-node-6vp8c"
Jul 09 18:25:33.287824 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:33.287551    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/26a69634-4e01-424c-9d63-7c572b081eaa-var-lib-openvswitch\") pod \"ovnkube-node-6vp8c\" (UID: \"26a69634-4e01-424c-9d63-7c572b081eaa\") " pod="openshift-ovn-kubernetes/ovnkube-node-6vp8c"
Jul 09 18:25:33.287824 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:33.287578    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6f90a96e-46ae-48f0-b35b-31201873c7e2-system-cni-dir\") pod \"multus-pgtwb\" (UID: \"6f90a96e-46ae-48f0-b35b-31201873c7e2\") " pod="openshift-multus/multus-pgtwb"
Jul 09 18:25:33.287824 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:33.287605    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/8424b53e-dc3c-4c74-85bd-105eaeb77aa4-etc-selinux\") pod \"aws-ebs-csi-driver-node-khxbf\" (UID: \"8424b53e-dc3c-4c74-85bd-105eaeb77aa4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-khxbf"
Jul 09 18:25:33.287824 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:33.287611    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/cdb7f3b5-f8db-4d3f-8067-371e5eda9f3e-dbus\") pod \"global-pull-secret-syncer-9f9j6\" (UID: \"cdb7f3b5-f8db-4d3f-8067-371e5eda9f3e\") " pod="kube-system/global-pull-secret-syncer-9f9j6"
Jul 09 18:25:33.287824 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:33.287646    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/6f90a96e-46ae-48f0-b35b-31201873c7e2-host-var-lib-cni-bin\") pod \"multus-pgtwb\" (UID: \"6f90a96e-46ae-48f0-b35b-31201873c7e2\") " pod="openshift-multus/multus-pgtwb"
Jul 09 18:25:33.287824 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:33.287655    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6f90a96e-46ae-48f0-b35b-31201873c7e2-etc-kubernetes\") pod \"multus-pgtwb\" (UID: \"6f90a96e-46ae-48f0-b35b-31201873c7e2\") " pod="openshift-multus/multus-pgtwb"
Jul 09 18:25:33.287824 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:33.287699    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/26a69634-4e01-424c-9d63-7c572b081eaa-host-slash\") pod \"ovnkube-node-6vp8c\" (UID: \"26a69634-4e01-424c-9d63-7c572b081eaa\") " pod="openshift-ovn-kubernetes/ovnkube-node-6vp8c"
Jul 09 18:25:33.288335 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:33.287493    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6f90a96e-46ae-48f0-b35b-31201873c7e2-system-cni-dir\") pod \"multus-pgtwb\" (UID: \"6f90a96e-46ae-48f0-b35b-31201873c7e2\") " pod="openshift-multus/multus-pgtwb"
Jul 09 18:25:33.288335 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:33.287808    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/6f90a96e-46ae-48f0-b35b-31201873c7e2-host-run-multus-certs\") pod \"multus-pgtwb\" (UID: \"6f90a96e-46ae-48f0-b35b-31201873c7e2\") " pod="openshift-multus/multus-pgtwb"
Jul 09 18:25:33.288335 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:33.287833    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/8424b53e-dc3c-4c74-85bd-105eaeb77aa4-registration-dir\") pod \"aws-ebs-csi-driver-node-khxbf\" (UID: \"8424b53e-dc3c-4c74-85bd-105eaeb77aa4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-khxbf"
Jul 09 18:25:33.288335 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:33.287856    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/26a69634-4e01-424c-9d63-7c572b081eaa-ovn-node-metrics-cert\") pod \"ovnkube-node-6vp8c\" (UID: \"26a69634-4e01-424c-9d63-7c572b081eaa\") " pod="openshift-ovn-kubernetes/ovnkube-node-6vp8c"
Jul 09 18:25:33.288335 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:33.287882    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/90d2aea7-1ee6-42f5-a94e-7b4f92963831-host-slash\") pod \"iptables-alerter-kldmh\" (UID: \"90d2aea7-1ee6-42f5-a94e-7b4f92963831\") " pod="openshift-network-operator/iptables-alerter-kldmh"
Jul 09 18:25:33.288335 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:33.287907    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/327c1eaf-28aa-4971-8053-7d3e67515edd-hosts-file\") pod \"node-resolver-smljn\" (UID: \"327c1eaf-28aa-4971-8053-7d3e67515edd\") " pod="openshift-dns/node-resolver-smljn"
Jul 09 18:25:33.288335 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:33.287946    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/8424b53e-dc3c-4c74-85bd-105eaeb77aa4-registration-dir\") pod \"aws-ebs-csi-driver-node-khxbf\" (UID: \"8424b53e-dc3c-4c74-85bd-105eaeb77aa4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-khxbf"
Jul 09 18:25:33.288335 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:33.287948    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/6f90a96e-46ae-48f0-b35b-31201873c7e2-hostroot\") pod \"multus-pgtwb\" (UID: \"6f90a96e-46ae-48f0-b35b-31201873c7e2\") " pod="openshift-multus/multus-pgtwb"
Jul 09 18:25:33.288335 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:33.287987    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/6f90a96e-46ae-48f0-b35b-31201873c7e2-hostroot\") pod \"multus-pgtwb\" (UID: \"6f90a96e-46ae-48f0-b35b-31201873c7e2\") " pod="openshift-multus/multus-pgtwb"
Jul 09 18:25:33.288335 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:33.288022    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/6f90a96e-46ae-48f0-b35b-31201873c7e2-host-run-multus-certs\") pod \"multus-pgtwb\" (UID: \"6f90a96e-46ae-48f0-b35b-31201873c7e2\") " pod="openshift-multus/multus-pgtwb"
Jul 09 18:25:33.288335 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:33.288036    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/8424b53e-dc3c-4c74-85bd-105eaeb77aa4-kubelet-dir\") pod \"aws-ebs-csi-driver-node-khxbf\" (UID: \"8424b53e-dc3c-4c74-85bd-105eaeb77aa4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-khxbf"
Jul 09 18:25:33.288335 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:33.288316    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/6f90a96e-46ae-48f0-b35b-31201873c7e2-cni-binary-copy\") pod \"multus-pgtwb\" (UID: \"6f90a96e-46ae-48f0-b35b-31201873c7e2\") " pod="openshift-multus/multus-pgtwb"
Jul 09 18:25:33.288902 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:33.288383    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/90d2aea7-1ee6-42f5-a94e-7b4f92963831-host-slash\") pod \"iptables-alerter-kldmh\" (UID: \"90d2aea7-1ee6-42f5-a94e-7b4f92963831\") " pod="openshift-network-operator/iptables-alerter-kldmh"
Jul 09 18:25:33.288902 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:33.288384    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/327c1eaf-28aa-4971-8053-7d3e67515edd-hosts-file\") pod \"node-resolver-smljn\" (UID: \"327c1eaf-28aa-4971-8053-7d3e67515edd\") " pod="openshift-dns/node-resolver-smljn"
Jul 09 18:25:33.288902 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:33.287989    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/8424b53e-dc3c-4c74-85bd-105eaeb77aa4-kubelet-dir\") pod \"aws-ebs-csi-driver-node-khxbf\" (UID: \"8424b53e-dc3c-4c74-85bd-105eaeb77aa4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-khxbf"
Jul 09 18:25:33.288902 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:33.288440    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/26a69634-4e01-424c-9d63-7c572b081eaa-host-run-netns\") pod \"ovnkube-node-6vp8c\" (UID: \"26a69634-4e01-424c-9d63-7c572b081eaa\") " pod="openshift-ovn-kubernetes/ovnkube-node-6vp8c"
Jul 09 18:25:33.288902 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:33.288468    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/26a69634-4e01-424c-9d63-7c572b081eaa-run-systemd\") pod \"ovnkube-node-6vp8c\" (UID: \"26a69634-4e01-424c-9d63-7c572b081eaa\") " pod="openshift-ovn-kubernetes/ovnkube-node-6vp8c"
Jul 09 18:25:33.288902 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:33.288512    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/26a69634-4e01-424c-9d63-7c572b081eaa-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-6vp8c\" (UID: \"26a69634-4e01-424c-9d63-7c572b081eaa\") " pod="openshift-ovn-kubernetes/ovnkube-node-6vp8c"
Jul 09 18:25:33.288902 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:33.288540    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/cdb7f3b5-f8db-4d3f-8067-371e5eda9f3e-original-pull-secret\") pod \"global-pull-secret-syncer-9f9j6\" (UID: \"cdb7f3b5-f8db-4d3f-8067-371e5eda9f3e\") " pod="kube-system/global-pull-secret-syncer-9f9j6"
Jul 09 18:25:33.288902 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:33.288563    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/62a8b86b-6eaf-4e72-aa0b-2de8fa04ed16-agent-certs\") pod \"konnectivity-agent-v55vr\" (UID: \"62a8b86b-6eaf-4e72-aa0b-2de8fa04ed16\") " pod="kube-system/konnectivity-agent-v55vr"
Jul 09 18:25:33.288902 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:33.288592    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/6f90a96e-46ae-48f0-b35b-31201873c7e2-host-run-netns\") pod \"multus-pgtwb\" (UID: \"6f90a96e-46ae-48f0-b35b-31201873c7e2\") " pod="openshift-multus/multus-pgtwb"
Jul 09 18:25:33.288902 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:33.288638    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/cc49c9d1-6be4-487b-adf1-ee18094747b6-host\") pod \"node-ca-w5wgl\" (UID: \"cc49c9d1-6be4-487b-adf1-ee18094747b6\") " pod="openshift-image-registry/node-ca-w5wgl"
Jul 09 18:25:33.288902 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:33.288664    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g4ht5\" (UniqueName: \"kubernetes.io/projected/cc49c9d1-6be4-487b-adf1-ee18094747b6-kube-api-access-g4ht5\") pod \"node-ca-w5wgl\" (UID: \"cc49c9d1-6be4-487b-adf1-ee18094747b6\") " pod="openshift-image-registry/node-ca-w5wgl"
Jul 09 18:25:33.288902 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:33.288688    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/26a69634-4e01-424c-9d63-7c572b081eaa-host-kubelet\") pod \"ovnkube-node-6vp8c\" (UID: \"26a69634-4e01-424c-9d63-7c572b081eaa\") " pod="openshift-ovn-kubernetes/ovnkube-node-6vp8c"
Jul 09 18:25:33.288902 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:33.288714    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/26a69634-4e01-424c-9d63-7c572b081eaa-host-run-ovn-kubernetes\") pod \"ovnkube-node-6vp8c\" (UID: \"26a69634-4e01-424c-9d63-7c572b081eaa\") " pod="openshift-ovn-kubernetes/ovnkube-node-6vp8c"
Jul 09 18:25:33.288902 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:33.288737    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/62a8b86b-6eaf-4e72-aa0b-2de8fa04ed16-konnectivity-ca\") pod \"konnectivity-agent-v55vr\" (UID: \"62a8b86b-6eaf-4e72-aa0b-2de8fa04ed16\") " pod="kube-system/konnectivity-agent-v55vr"
Jul 09 18:25:33.289566 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:33.288764    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/6f90a96e-46ae-48f0-b35b-31201873c7e2-multus-socket-dir-parent\") pod \"multus-pgtwb\" (UID: \"6f90a96e-46ae-48f0-b35b-31201873c7e2\") " pod="openshift-multus/multus-pgtwb"
Jul 09 18:25:33.289566 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:33.288790    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/8424b53e-dc3c-4c74-85bd-105eaeb77aa4-device-dir\") pod \"aws-ebs-csi-driver-node-khxbf\" (UID: \"8424b53e-dc3c-4c74-85bd-105eaeb77aa4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-khxbf"
Jul 09 18:25:33.289566 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:33.288816    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pjkpm\" (UniqueName: \"kubernetes.io/projected/8424b53e-dc3c-4c74-85bd-105eaeb77aa4-kube-api-access-pjkpm\") pod \"aws-ebs-csi-driver-node-khxbf\" (UID: \"8424b53e-dc3c-4c74-85bd-105eaeb77aa4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-khxbf"
Jul 09 18:25:33.289566 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:33.288845    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/26a69634-4e01-424c-9d63-7c572b081eaa-systemd-units\") pod \"ovnkube-node-6vp8c\" (UID: \"26a69634-4e01-424c-9d63-7c572b081eaa\") " pod="openshift-ovn-kubernetes/ovnkube-node-6vp8c"
Jul 09 18:25:33.289566 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:33.288859    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/26a69634-4e01-424c-9d63-7c572b081eaa-host-run-netns\") pod \"ovnkube-node-6vp8c\" (UID: \"26a69634-4e01-424c-9d63-7c572b081eaa\") " pod="openshift-ovn-kubernetes/ovnkube-node-6vp8c"
Jul 09 18:25:33.289566 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:33.288871    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/6f90a96e-46ae-48f0-b35b-31201873c7e2-os-release\") pod \"multus-pgtwb\" (UID: \"6f90a96e-46ae-48f0-b35b-31201873c7e2\") " pod="openshift-multus/multus-pgtwb"
Jul 09 18:25:33.289566 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:33.288911    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6f90a96e-46ae-48f0-b35b-31201873c7e2-host-var-lib-kubelet\") pod \"multus-pgtwb\" (UID: \"6f90a96e-46ae-48f0-b35b-31201873c7e2\") " pod="openshift-multus/multus-pgtwb"
Jul 09 18:25:33.289566 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:33.288933    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/8424b53e-dc3c-4c74-85bd-105eaeb77aa4-sys-fs\") pod \"aws-ebs-csi-driver-node-khxbf\" (UID: \"8424b53e-dc3c-4c74-85bd-105eaeb77aa4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-khxbf"
Jul 09 18:25:33.289566 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:33.288936    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/6f90a96e-46ae-48f0-b35b-31201873c7e2-os-release\") pod \"multus-pgtwb\" (UID: \"6f90a96e-46ae-48f0-b35b-31201873c7e2\") " pod="openshift-multus/multus-pgtwb"
Jul 09 18:25:33.289566 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:33.288951    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/26a69634-4e01-424c-9d63-7c572b081eaa-env-overrides\") pod \"ovnkube-node-6vp8c\" (UID: \"26a69634-4e01-424c-9d63-7c572b081eaa\") " pod="openshift-ovn-kubernetes/ovnkube-node-6vp8c"
Jul 09 18:25:33.289566 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:33.288967    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/26a69634-4e01-424c-9d63-7c572b081eaa-ovnkube-config\") pod \"ovnkube-node-6vp8c\" (UID: \"26a69634-4e01-424c-9d63-7c572b081eaa\") " pod="openshift-ovn-kubernetes/ovnkube-node-6vp8c"
Jul 09 18:25:33.289566 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:33.288982    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/cdb7f3b5-f8db-4d3f-8067-371e5eda9f3e-kubelet-config\") pod \"global-pull-secret-syncer-9f9j6\" (UID: \"cdb7f3b5-f8db-4d3f-8067-371e5eda9f3e\") " pod="kube-system/global-pull-secret-syncer-9f9j6"
Jul 09 18:25:33.289566 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:33.289002    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/6f90a96e-46ae-48f0-b35b-31201873c7e2-host-run-k8s-cni-cncf-io\") pod \"multus-pgtwb\" (UID: \"6f90a96e-46ae-48f0-b35b-31201873c7e2\") " pod="openshift-multus/multus-pgtwb"
Jul 09 18:25:33.289566 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:33.289028    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/6f90a96e-46ae-48f0-b35b-31201873c7e2-multus-daemon-config\") pod \"multus-pgtwb\" (UID: \"6f90a96e-46ae-48f0-b35b-31201873c7e2\") " pod="openshift-multus/multus-pgtwb"
Jul 09 18:25:33.289566 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:33.289049    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/cc49c9d1-6be4-487b-adf1-ee18094747b6-serviceca\") pod \"node-ca-w5wgl\" (UID: \"cc49c9d1-6be4-487b-adf1-ee18094747b6\") " pod="openshift-image-registry/node-ca-w5wgl"
Jul 09 18:25:33.291541 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:33.289074    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cmcrn\" (UniqueName: \"kubernetes.io/projected/26a69634-4e01-424c-9d63-7c572b081eaa-kube-api-access-cmcrn\") pod \"ovnkube-node-6vp8c\" (UID: \"26a69634-4e01-424c-9d63-7c572b081eaa\") " pod="openshift-ovn-kubernetes/ovnkube-node-6vp8c"
Jul 09 18:25:33.291541 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:33.289114    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/26a69634-4e01-424c-9d63-7c572b081eaa-etc-openvswitch\") pod \"ovnkube-node-6vp8c\" (UID: \"26a69634-4e01-424c-9d63-7c572b081eaa\") " pod="openshift-ovn-kubernetes/ovnkube-node-6vp8c"
Jul 09 18:25:33.291541 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:33.289137    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/26a69634-4e01-424c-9d63-7c572b081eaa-log-socket\") pod \"ovnkube-node-6vp8c\" (UID: \"26a69634-4e01-424c-9d63-7c572b081eaa\") " pod="openshift-ovn-kubernetes/ovnkube-node-6vp8c"
Jul 09 18:25:33.291541 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:33.289176    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/6f90a96e-46ae-48f0-b35b-31201873c7e2-host-var-lib-cni-multus\") pod \"multus-pgtwb\" (UID: \"6f90a96e-46ae-48f0-b35b-31201873c7e2\") " pod="openshift-multus/multus-pgtwb"
Jul 09 18:25:33.291541 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:33.289179    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/90d2aea7-1ee6-42f5-a94e-7b4f92963831-iptables-alerter-script\") pod \"iptables-alerter-kldmh\" (UID: \"90d2aea7-1ee6-42f5-a94e-7b4f92963831\") " pod="openshift-network-operator/iptables-alerter-kldmh"
Jul 09 18:25:33.291541 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:33.289198    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/6f90a96e-46ae-48f0-b35b-31201873c7e2-multus-conf-dir\") pod \"multus-pgtwb\" (UID: \"6f90a96e-46ae-48f0-b35b-31201873c7e2\") " pod="openshift-multus/multus-pgtwb"
Jul 09 18:25:33.291541 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:33.289265    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/8424b53e-dc3c-4c74-85bd-105eaeb77aa4-socket-dir\") pod \"aws-ebs-csi-driver-node-khxbf\" (UID: \"8424b53e-dc3c-4c74-85bd-105eaeb77aa4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-khxbf"
Jul 09 18:25:33.291541 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:33.289338    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/26a69634-4e01-424c-9d63-7c572b081eaa-node-log\") pod \"ovnkube-node-6vp8c\" (UID: \"26a69634-4e01-424c-9d63-7c572b081eaa\") " pod="openshift-ovn-kubernetes/ovnkube-node-6vp8c"
Jul 09 18:25:33.291541 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:33.289398    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/26a69634-4e01-424c-9d63-7c572b081eaa-node-log\") pod \"ovnkube-node-6vp8c\" (UID: \"26a69634-4e01-424c-9d63-7c572b081eaa\") " pod="openshift-ovn-kubernetes/ovnkube-node-6vp8c"
Jul 09 18:25:33.291541 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:33.289401    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/26a69634-4e01-424c-9d63-7c572b081eaa-run-systemd\") pod \"ovnkube-node-6vp8c\" (UID: \"26a69634-4e01-424c-9d63-7c572b081eaa\") " pod="openshift-ovn-kubernetes/ovnkube-node-6vp8c"
Jul 09 18:25:33.291541 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:33.289497    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/26a69634-4e01-424c-9d63-7c572b081eaa-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-6vp8c\" (UID: \"26a69634-4e01-424c-9d63-7c572b081eaa\") " pod="openshift-ovn-kubernetes/ovnkube-node-6vp8c"
Jul 09 18:25:33.291541 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:33.289548    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6f90a96e-46ae-48f0-b35b-31201873c7e2-host-var-lib-kubelet\") pod \"multus-pgtwb\" (UID: \"6f90a96e-46ae-48f0-b35b-31201873c7e2\") " pod="openshift-multus/multus-pgtwb"
Jul 09 18:25:33.291541 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:33.289598    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/6f90a96e-46ae-48f0-b35b-31201873c7e2-multus-socket-dir-parent\") pod \"multus-pgtwb\" (UID: \"6f90a96e-46ae-48f0-b35b-31201873c7e2\") " pod="openshift-multus/multus-pgtwb"
Jul 09 18:25:33.291541 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:33.289604    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/8424b53e-dc3c-4c74-85bd-105eaeb77aa4-sys-fs\") pod \"aws-ebs-csi-driver-node-khxbf\" (UID: \"8424b53e-dc3c-4c74-85bd-105eaeb77aa4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-khxbf"
Jul 09 18:25:33.292321 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:33.289671    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/8424b53e-dc3c-4c74-85bd-105eaeb77aa4-device-dir\") pod \"aws-ebs-csi-driver-node-khxbf\" (UID: \"8424b53e-dc3c-4c74-85bd-105eaeb77aa4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-khxbf"
Jul 09 18:25:33.292321 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:33.289682    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/62a8b86b-6eaf-4e72-aa0b-2de8fa04ed16-konnectivity-ca\") pod \"konnectivity-agent-v55vr\" (UID: \"62a8b86b-6eaf-4e72-aa0b-2de8fa04ed16\") " pod="kube-system/konnectivity-agent-v55vr"
Jul 09 18:25:33.292321 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:33.289711    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/6f90a96e-46ae-48f0-b35b-31201873c7e2-host-run-k8s-cni-cncf-io\") pod \"multus-pgtwb\" (UID: \"6f90a96e-46ae-48f0-b35b-31201873c7e2\") " pod="openshift-multus/multus-pgtwb"
Jul 09 18:25:33.292321 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:33.289735    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/6f90a96e-46ae-48f0-b35b-31201873c7e2-host-run-netns\") pod \"multus-pgtwb\" (UID: \"6f90a96e-46ae-48f0-b35b-31201873c7e2\") " pod="openshift-multus/multus-pgtwb"
Jul 09 18:25:33.292321 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:33.289757    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/26a69634-4e01-424c-9d63-7c572b081eaa-log-socket\") pod \"ovnkube-node-6vp8c\" (UID: \"26a69634-4e01-424c-9d63-7c572b081eaa\") " pod="openshift-ovn-kubernetes/ovnkube-node-6vp8c"
Jul 09 18:25:33.292321 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:33.289781    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/cc49c9d1-6be4-487b-adf1-ee18094747b6-host\") pod \"node-ca-w5wgl\" (UID: \"cc49c9d1-6be4-487b-adf1-ee18094747b6\") " pod="openshift-image-registry/node-ca-w5wgl"
Jul 09 18:25:33.292321 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:33.289840    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/cc49c9d1-6be4-487b-adf1-ee18094747b6-serviceca\") pod \"node-ca-w5wgl\" (UID: \"cc49c9d1-6be4-487b-adf1-ee18094747b6\") " pod="openshift-image-registry/node-ca-w5wgl"
Jul 09 18:25:33.292321 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:33.289941    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/26a69634-4e01-424c-9d63-7c572b081eaa-host-kubelet\") pod \"ovnkube-node-6vp8c\" (UID: \"26a69634-4e01-424c-9d63-7c572b081eaa\") " pod="openshift-ovn-kubernetes/ovnkube-node-6vp8c"
Jul 09 18:25:33.292321 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:33.289989    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/26a69634-4e01-424c-9d63-7c572b081eaa-host-run-ovn-kubernetes\") pod \"ovnkube-node-6vp8c\" (UID: \"26a69634-4e01-424c-9d63-7c572b081eaa\") " pod="openshift-ovn-kubernetes/ovnkube-node-6vp8c"
Jul 09 18:25:33.292321 ip-10-0-141-101 kubenswrapper[2557]: E0709 18:25:33.288817    2557 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 09 18:25:33.292321 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:33.290017    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/26a69634-4e01-424c-9d63-7c572b081eaa-env-overrides\") pod \"ovnkube-node-6vp8c\" (UID: \"26a69634-4e01-424c-9d63-7c572b081eaa\") " pod="openshift-ovn-kubernetes/ovnkube-node-6vp8c"
Jul 09 18:25:33.292321 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:33.290034    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/26a69634-4e01-424c-9d63-7c572b081eaa-etc-openvswitch\") pod \"ovnkube-node-6vp8c\" (UID: \"26a69634-4e01-424c-9d63-7c572b081eaa\") " pod="openshift-ovn-kubernetes/ovnkube-node-6vp8c"
Jul 09 18:25:33.292321 ip-10-0-141-101 kubenswrapper[2557]: E0709 18:25:33.290057    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cdb7f3b5-f8db-4d3f-8067-371e5eda9f3e-original-pull-secret podName:cdb7f3b5-f8db-4d3f-8067-371e5eda9f3e nodeName:}" failed. No retries permitted until 2026-07-09 18:25:33.790038512 +0000 UTC m=+3.029383131 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/cdb7f3b5-f8db-4d3f-8067-371e5eda9f3e-original-pull-secret") pod "global-pull-secret-syncer-9f9j6" (UID: "cdb7f3b5-f8db-4d3f-8067-371e5eda9f3e") : object "kube-system"/"original-pull-secret" not registered
Jul 09 18:25:33.292321 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:33.290104    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/6f90a96e-46ae-48f0-b35b-31201873c7e2-multus-conf-dir\") pod \"multus-pgtwb\" (UID: \"6f90a96e-46ae-48f0-b35b-31201873c7e2\") " pod="openshift-multus/multus-pgtwb"
Jul 09 18:25:33.292321 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:33.290145    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/6f90a96e-46ae-48f0-b35b-31201873c7e2-host-var-lib-cni-multus\") pod \"multus-pgtwb\" (UID: \"6f90a96e-46ae-48f0-b35b-31201873c7e2\") " pod="openshift-multus/multus-pgtwb"
Jul 09 18:25:33.293056 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:33.290186    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/26a69634-4e01-424c-9d63-7c572b081eaa-systemd-units\") pod \"ovnkube-node-6vp8c\" (UID: \"26a69634-4e01-424c-9d63-7c572b081eaa\") " pod="openshift-ovn-kubernetes/ovnkube-node-6vp8c"
Jul 09 18:25:33.293056 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:33.290277    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/cdb7f3b5-f8db-4d3f-8067-371e5eda9f3e-kubelet-config\") pod \"global-pull-secret-syncer-9f9j6\" (UID: \"cdb7f3b5-f8db-4d3f-8067-371e5eda9f3e\") " pod="kube-system/global-pull-secret-syncer-9f9j6"
Jul 09 18:25:33.293056 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:33.290285    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/8424b53e-dc3c-4c74-85bd-105eaeb77aa4-socket-dir\") pod \"aws-ebs-csi-driver-node-khxbf\" (UID: \"8424b53e-dc3c-4c74-85bd-105eaeb77aa4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-khxbf"
Jul 09 18:25:33.293056 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:33.290290    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/6f90a96e-46ae-48f0-b35b-31201873c7e2-multus-daemon-config\") pod \"multus-pgtwb\" (UID: \"6f90a96e-46ae-48f0-b35b-31201873c7e2\") " pod="openshift-multus/multus-pgtwb"
Jul 09 18:25:33.293056 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:33.290316    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/26a69634-4e01-424c-9d63-7c572b081eaa-ovnkube-script-lib\") pod \"ovnkube-node-6vp8c\" (UID: \"26a69634-4e01-424c-9d63-7c572b081eaa\") " pod="openshift-ovn-kubernetes/ovnkube-node-6vp8c"
Jul 09 18:25:33.293056 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:33.290350    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/327c1eaf-28aa-4971-8053-7d3e67515edd-tmp-dir\") pod \"node-resolver-smljn\" (UID: \"327c1eaf-28aa-4971-8053-7d3e67515edd\") " pod="openshift-dns/node-resolver-smljn"
Jul 09 18:25:33.293056 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:33.290384    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4k7xj\" (UniqueName: \"kubernetes.io/projected/6f90a96e-46ae-48f0-b35b-31201873c7e2-kube-api-access-4k7xj\") pod \"multus-pgtwb\" (UID: \"6f90a96e-46ae-48f0-b35b-31201873c7e2\") " pod="openshift-multus/multus-pgtwb"
Jul 09 18:25:33.293056 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:33.290417    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/26a69634-4e01-424c-9d63-7c572b081eaa-run-openvswitch\") pod \"ovnkube-node-6vp8c\" (UID: \"26a69634-4e01-424c-9d63-7c572b081eaa\") " pod="openshift-ovn-kubernetes/ovnkube-node-6vp8c"
Jul 09 18:25:33.293056 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:33.290505    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/26a69634-4e01-424c-9d63-7c572b081eaa-run-openvswitch\") pod \"ovnkube-node-6vp8c\" (UID: \"26a69634-4e01-424c-9d63-7c572b081eaa\") " pod="openshift-ovn-kubernetes/ovnkube-node-6vp8c"
Jul 09 18:25:33.293056 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:33.290665    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/327c1eaf-28aa-4971-8053-7d3e67515edd-tmp-dir\") pod \"node-resolver-smljn\" (UID: \"327c1eaf-28aa-4971-8053-7d3e67515edd\") " pod="openshift-dns/node-resolver-smljn"
Jul 09 18:25:33.293056 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:33.290793    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/26a69634-4e01-424c-9d63-7c572b081eaa-ovnkube-config\") pod \"ovnkube-node-6vp8c\" (UID: \"26a69634-4e01-424c-9d63-7c572b081eaa\") " pod="openshift-ovn-kubernetes/ovnkube-node-6vp8c"
Jul 09 18:25:33.293056 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:33.290850    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/26a69634-4e01-424c-9d63-7c572b081eaa-ovnkube-script-lib\") pod \"ovnkube-node-6vp8c\" (UID: \"26a69634-4e01-424c-9d63-7c572b081eaa\") " pod="openshift-ovn-kubernetes/ovnkube-node-6vp8c"
Jul 09 18:25:33.293056 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:33.291096    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/26a69634-4e01-424c-9d63-7c572b081eaa-ovn-node-metrics-cert\") pod \"ovnkube-node-6vp8c\" (UID: \"26a69634-4e01-424c-9d63-7c572b081eaa\") " pod="openshift-ovn-kubernetes/ovnkube-node-6vp8c"
Jul 09 18:25:33.293056 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:33.291671    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/62a8b86b-6eaf-4e72-aa0b-2de8fa04ed16-agent-certs\") pod \"konnectivity-agent-v55vr\" (UID: \"62a8b86b-6eaf-4e72-aa0b-2de8fa04ed16\") " pod="kube-system/konnectivity-agent-v55vr"
Jul 09 18:25:33.316647 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:33.316612    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cmcrn\" (UniqueName: \"kubernetes.io/projected/26a69634-4e01-424c-9d63-7c572b081eaa-kube-api-access-cmcrn\") pod \"ovnkube-node-6vp8c\" (UID: \"26a69634-4e01-424c-9d63-7c572b081eaa\") " pod="openshift-ovn-kubernetes/ovnkube-node-6vp8c"
Jul 09 18:25:33.317610 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:33.317573    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4k7xj\" (UniqueName: \"kubernetes.io/projected/6f90a96e-46ae-48f0-b35b-31201873c7e2-kube-api-access-4k7xj\") pod \"multus-pgtwb\" (UID: \"6f90a96e-46ae-48f0-b35b-31201873c7e2\") " pod="openshift-multus/multus-pgtwb"
Jul 09 18:25:33.317610 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:33.317593    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wb977\" (UniqueName: \"kubernetes.io/projected/90d2aea7-1ee6-42f5-a94e-7b4f92963831-kube-api-access-wb977\") pod \"iptables-alerter-kldmh\" (UID: \"90d2aea7-1ee6-42f5-a94e-7b4f92963831\") " pod="openshift-network-operator/iptables-alerter-kldmh"
Jul 09 18:25:33.318462 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:33.318436    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pjkpm\" (UniqueName: \"kubernetes.io/projected/8424b53e-dc3c-4c74-85bd-105eaeb77aa4-kube-api-access-pjkpm\") pod \"aws-ebs-csi-driver-node-khxbf\" (UID: \"8424b53e-dc3c-4c74-85bd-105eaeb77aa4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-khxbf"
Jul 09 18:25:33.321588 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:33.321563    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g4ht5\" (UniqueName: \"kubernetes.io/projected/cc49c9d1-6be4-487b-adf1-ee18094747b6-kube-api-access-g4ht5\") pod \"node-ca-w5wgl\" (UID: \"cc49c9d1-6be4-487b-adf1-ee18094747b6\") " pod="openshift-image-registry/node-ca-w5wgl"
Jul 09 18:25:33.321588 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:33.321579    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bgxmf\" (UniqueName: \"kubernetes.io/projected/327c1eaf-28aa-4971-8053-7d3e67515edd-kube-api-access-bgxmf\") pod \"node-resolver-smljn\" (UID: \"327c1eaf-28aa-4971-8053-7d3e67515edd\") " pod="openshift-dns/node-resolver-smljn"
Jul 09 18:25:33.379303 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:33.379217    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-s6ptt"
Jul 09 18:25:33.392388 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:33.392359    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-w6nvx"
Jul 09 18:25:33.401817 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:25:33.401772    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda6ea2124_43d0_494e_b2ad_6b2933014f0d.slice/crio-38823694fc11360f9900050c9ab9129f34f4c3685cb4c567b0d046599535c3f6 WatchSource:0}: Error finding container 38823694fc11360f9900050c9ab9129f34f4c3685cb4c567b0d046599535c3f6: Status 404 returned error can't find the container with id 38823694fc11360f9900050c9ab9129f34f4c3685cb4c567b0d046599535c3f6
Jul 09 18:25:33.403351 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:33.403257    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-v55vr"
Jul 09 18:25:33.408826 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:33.408802    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-khxbf"
Jul 09 18:25:33.413784 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:25:33.413751    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod62a8b86b_6eaf_4e72_aa0b_2de8fa04ed16.slice/crio-388dde1b9dfc12e3c47a3f0014493f3879c89d51975eb2c23c1061944d33b053 WatchSource:0}: Error finding container 388dde1b9dfc12e3c47a3f0014493f3879c89d51975eb2c23c1061944d33b053: Status 404 returned error can't find the container with id 388dde1b9dfc12e3c47a3f0014493f3879c89d51975eb2c23c1061944d33b053
Jul 09 18:25:33.418809 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:33.418742    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-kldmh"
Jul 09 18:25:33.420506 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:25:33.420460    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8424b53e_dc3c_4c74_85bd_105eaeb77aa4.slice/crio-a7fd86e634e830d795d204fff89e23bed5f96b6451fc3d3092d6a99c76aba821 WatchSource:0}: Error finding container a7fd86e634e830d795d204fff89e23bed5f96b6451fc3d3092d6a99c76aba821: Status 404 returned error can't find the container with id a7fd86e634e830d795d204fff89e23bed5f96b6451fc3d3092d6a99c76aba821
Jul 09 18:25:33.426583 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:33.426555    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-w5wgl"
Jul 09 18:25:33.430269 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:25:33.429852    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod90d2aea7_1ee6_42f5_a94e_7b4f92963831.slice/crio-74f72c44d52d72e4697cb3bcb081c56ebb22d54532f864c01a38b0428b7ce9bd WatchSource:0}: Error finding container 74f72c44d52d72e4697cb3bcb081c56ebb22d54532f864c01a38b0428b7ce9bd: Status 404 returned error can't find the container with id 74f72c44d52d72e4697cb3bcb081c56ebb22d54532f864c01a38b0428b7ce9bd
Jul 09 18:25:33.434993 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:33.434972    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-smljn"
Jul 09 18:25:33.435233 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:25:33.435214    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcc49c9d1_6be4_487b_adf1_ee18094747b6.slice/crio-5cb7e29217e81ed8062291d88cd6d988029b17380a7a3602f3bebe51bc94bfb0 WatchSource:0}: Error finding container 5cb7e29217e81ed8062291d88cd6d988029b17380a7a3602f3bebe51bc94bfb0: Status 404 returned error can't find the container with id 5cb7e29217e81ed8062291d88cd6d988029b17380a7a3602f3bebe51bc94bfb0
Jul 09 18:25:33.442680 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:33.442662    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-6vp8c"
Jul 09 18:25:33.448104 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:33.448081    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-pgtwb"
Jul 09 18:25:33.694253 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:33.694161    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3799d80f-6238-4782-913f-7dba2c15884e-metrics-certs\") pod \"network-metrics-daemon-sk5xh\" (UID: \"3799d80f-6238-4782-913f-7dba2c15884e\") " pod="openshift-multus/network-metrics-daemon-sk5xh"
Jul 09 18:25:33.694413 ip-10-0-141-101 kubenswrapper[2557]: E0709 18:25:33.694294    2557 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 09 18:25:33.694413 ip-10-0-141-101 kubenswrapper[2557]: E0709 18:25:33.694374    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3799d80f-6238-4782-913f-7dba2c15884e-metrics-certs podName:3799d80f-6238-4782-913f-7dba2c15884e nodeName:}" failed. No retries permitted until 2026-07-09 18:25:34.694351425 +0000 UTC m=+3.933696031 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3799d80f-6238-4782-913f-7dba2c15884e-metrics-certs") pod "network-metrics-daemon-sk5xh" (UID: "3799d80f-6238-4782-913f-7dba2c15884e") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 09 18:25:33.794759 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:33.794722    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ntqs7\" (UniqueName: \"kubernetes.io/projected/167643e1-1c6b-47ce-8541-e145c13acdb1-kube-api-access-ntqs7\") pod \"network-check-target-j7h7r\" (UID: \"167643e1-1c6b-47ce-8541-e145c13acdb1\") " pod="openshift-network-diagnostics/network-check-target-j7h7r"
Jul 09 18:25:33.794759 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:33.794762    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/cdb7f3b5-f8db-4d3f-8067-371e5eda9f3e-original-pull-secret\") pod \"global-pull-secret-syncer-9f9j6\" (UID: \"cdb7f3b5-f8db-4d3f-8067-371e5eda9f3e\") " pod="kube-system/global-pull-secret-syncer-9f9j6"
Jul 09 18:25:33.794951 ip-10-0-141-101 kubenswrapper[2557]: E0709 18:25:33.794881    2557 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 09 18:25:33.794951 ip-10-0-141-101 kubenswrapper[2557]: E0709 18:25:33.794901    2557 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 09 18:25:33.794951 ip-10-0-141-101 kubenswrapper[2557]: E0709 18:25:33.794930    2557 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 09 18:25:33.794951 ip-10-0-141-101 kubenswrapper[2557]: E0709 18:25:33.794942    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cdb7f3b5-f8db-4d3f-8067-371e5eda9f3e-original-pull-secret podName:cdb7f3b5-f8db-4d3f-8067-371e5eda9f3e nodeName:}" failed. No retries permitted until 2026-07-09 18:25:34.794923983 +0000 UTC m=+4.034268586 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/cdb7f3b5-f8db-4d3f-8067-371e5eda9f3e-original-pull-secret") pod "global-pull-secret-syncer-9f9j6" (UID: "cdb7f3b5-f8db-4d3f-8067-371e5eda9f3e") : object "kube-system"/"original-pull-secret" not registered
Jul 09 18:25:33.794951 ip-10-0-141-101 kubenswrapper[2557]: E0709 18:25:33.794946    2557 projected.go:196] Error preparing data for projected volume kube-api-access-ntqs7 for pod openshift-network-diagnostics/network-check-target-j7h7r: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 09 18:25:33.795144 ip-10-0-141-101 kubenswrapper[2557]: E0709 18:25:33.795002    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/167643e1-1c6b-47ce-8541-e145c13acdb1-kube-api-access-ntqs7 podName:167643e1-1c6b-47ce-8541-e145c13acdb1 nodeName:}" failed. No retries permitted until 2026-07-09 18:25:34.794983628 +0000 UTC m=+4.034328253 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-ntqs7" (UniqueName: "kubernetes.io/projected/167643e1-1c6b-47ce-8541-e145c13acdb1-kube-api-access-ntqs7") pod "network-check-target-j7h7r" (UID: "167643e1-1c6b-47ce-8541-e145c13acdb1") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 09 18:25:34.153866 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:34.153751    2557 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-08 18:20:33 +0000 UTC" deadline="2027-12-25 04:03:11.417350556 +0000 UTC"
Jul 09 18:25:34.153866 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:34.153818    2557 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12801h37m37.263537246s"
Jul 09 18:25:34.255595 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:34.255499    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9f9j6"
Jul 09 18:25:34.255775 ip-10-0-141-101 kubenswrapper[2557]: E0709 18:25:34.255698    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9f9j6" podUID="cdb7f3b5-f8db-4d3f-8067-371e5eda9f3e"
Jul 09 18:25:34.269976 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:34.269939    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-s6ptt" event={"ID":"cb415bf4-3279-48dc-a565-43e470e3508c","Type":"ContainerStarted","Data":"cdc1d83d908089f83a89530233912fcf5461b33028f8915873b4a23a3ab5d315"}
Jul 09 18:25:34.271587 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:34.271557    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-w5wgl" event={"ID":"cc49c9d1-6be4-487b-adf1-ee18094747b6","Type":"ContainerStarted","Data":"5cb7e29217e81ed8062291d88cd6d988029b17380a7a3602f3bebe51bc94bfb0"}
Jul 09 18:25:34.273600 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:34.273572    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-kldmh" event={"ID":"90d2aea7-1ee6-42f5-a94e-7b4f92963831","Type":"ContainerStarted","Data":"74f72c44d52d72e4697cb3bcb081c56ebb22d54532f864c01a38b0428b7ce9bd"}
Jul 09 18:25:34.274802 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:34.274777    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-khxbf" event={"ID":"8424b53e-dc3c-4c74-85bd-105eaeb77aa4","Type":"ContainerStarted","Data":"a7fd86e634e830d795d204fff89e23bed5f96b6451fc3d3092d6a99c76aba821"}
Jul 09 18:25:34.276607 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:34.276584    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-v55vr" event={"ID":"62a8b86b-6eaf-4e72-aa0b-2de8fa04ed16","Type":"ContainerStarted","Data":"388dde1b9dfc12e3c47a3f0014493f3879c89d51975eb2c23c1061944d33b053"}
Jul 09 18:25:34.278370 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:34.278324    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-w6nvx" event={"ID":"a6ea2124-43d0-494e-b2ad-6b2933014f0d","Type":"ContainerStarted","Data":"38823694fc11360f9900050c9ab9129f34f4c3685cb4c567b0d046599535c3f6"}
Jul 09 18:25:34.607747 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:25:34.607673    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod26a69634_4e01_424c_9d63_7c572b081eaa.slice/crio-d6b2c85b57df34a956a0ac3a02c6f3a1315b0213b704ac5721973570820b9977 WatchSource:0}: Error finding container d6b2c85b57df34a956a0ac3a02c6f3a1315b0213b704ac5721973570820b9977: Status 404 returned error can't find the container with id d6b2c85b57df34a956a0ac3a02c6f3a1315b0213b704ac5721973570820b9977
Jul 09 18:25:34.610871 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:25:34.608997    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6f90a96e_46ae_48f0_b35b_31201873c7e2.slice/crio-619584f3c006fc9589f625c663e4870a04886208c8a698afd5d50751a8e532f2 WatchSource:0}: Error finding container 619584f3c006fc9589f625c663e4870a04886208c8a698afd5d50751a8e532f2: Status 404 returned error can't find the container with id 619584f3c006fc9589f625c663e4870a04886208c8a698afd5d50751a8e532f2
Jul 09 18:25:34.611745 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:25:34.611578    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod327c1eaf_28aa_4971_8053_7d3e67515edd.slice/crio-fd75ce699130a5abdeb0e8f246c4c5ded3702e0dcdd1a9eba3ddcc47e173cd14 WatchSource:0}: Error finding container fd75ce699130a5abdeb0e8f246c4c5ded3702e0dcdd1a9eba3ddcc47e173cd14: Status 404 returned error can't find the container with id fd75ce699130a5abdeb0e8f246c4c5ded3702e0dcdd1a9eba3ddcc47e173cd14
Jul 09 18:25:34.702578 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:34.701879    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3799d80f-6238-4782-913f-7dba2c15884e-metrics-certs\") pod \"network-metrics-daemon-sk5xh\" (UID: \"3799d80f-6238-4782-913f-7dba2c15884e\") " pod="openshift-multus/network-metrics-daemon-sk5xh"
Jul 09 18:25:34.702578 ip-10-0-141-101 kubenswrapper[2557]: E0709 18:25:34.702056    2557 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 09 18:25:34.702578 ip-10-0-141-101 kubenswrapper[2557]: E0709 18:25:34.702213    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3799d80f-6238-4782-913f-7dba2c15884e-metrics-certs podName:3799d80f-6238-4782-913f-7dba2c15884e nodeName:}" failed. No retries permitted until 2026-07-09 18:25:36.702190021 +0000 UTC m=+5.941534626 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3799d80f-6238-4782-913f-7dba2c15884e-metrics-certs") pod "network-metrics-daemon-sk5xh" (UID: "3799d80f-6238-4782-913f-7dba2c15884e") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 09 18:25:34.803308 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:34.803260    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/cdb7f3b5-f8db-4d3f-8067-371e5eda9f3e-original-pull-secret\") pod \"global-pull-secret-syncer-9f9j6\" (UID: \"cdb7f3b5-f8db-4d3f-8067-371e5eda9f3e\") " pod="kube-system/global-pull-secret-syncer-9f9j6"
Jul 09 18:25:34.803506 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:34.803386    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ntqs7\" (UniqueName: \"kubernetes.io/projected/167643e1-1c6b-47ce-8541-e145c13acdb1-kube-api-access-ntqs7\") pod \"network-check-target-j7h7r\" (UID: \"167643e1-1c6b-47ce-8541-e145c13acdb1\") " pod="openshift-network-diagnostics/network-check-target-j7h7r"
Jul 09 18:25:34.803589 ip-10-0-141-101 kubenswrapper[2557]: E0709 18:25:34.803545    2557 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 09 18:25:34.803589 ip-10-0-141-101 kubenswrapper[2557]: E0709 18:25:34.803566    2557 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 09 18:25:34.803589 ip-10-0-141-101 kubenswrapper[2557]: E0709 18:25:34.803579    2557 projected.go:196] Error preparing data for projected volume kube-api-access-ntqs7 for pod openshift-network-diagnostics/network-check-target-j7h7r: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 09 18:25:34.803735 ip-10-0-141-101 kubenswrapper[2557]: E0709 18:25:34.803642    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/167643e1-1c6b-47ce-8541-e145c13acdb1-kube-api-access-ntqs7 podName:167643e1-1c6b-47ce-8541-e145c13acdb1 nodeName:}" failed. No retries permitted until 2026-07-09 18:25:36.803623184 +0000 UTC m=+6.042967810 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-ntqs7" (UniqueName: "kubernetes.io/projected/167643e1-1c6b-47ce-8541-e145c13acdb1-kube-api-access-ntqs7") pod "network-check-target-j7h7r" (UID: "167643e1-1c6b-47ce-8541-e145c13acdb1") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 09 18:25:34.804061 ip-10-0-141-101 kubenswrapper[2557]: E0709 18:25:34.804038    2557 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 09 18:25:34.804152 ip-10-0-141-101 kubenswrapper[2557]: E0709 18:25:34.804092    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cdb7f3b5-f8db-4d3f-8067-371e5eda9f3e-original-pull-secret podName:cdb7f3b5-f8db-4d3f-8067-371e5eda9f3e nodeName:}" failed. No retries permitted until 2026-07-09 18:25:36.804077118 +0000 UTC m=+6.043421724 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/cdb7f3b5-f8db-4d3f-8067-371e5eda9f3e-original-pull-secret") pod "global-pull-secret-syncer-9f9j6" (UID: "cdb7f3b5-f8db-4d3f-8067-371e5eda9f3e") : object "kube-system"/"original-pull-secret" not registered
Jul 09 18:25:35.154631 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:35.154582    2557 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-08 18:20:33 +0000 UTC" deadline="2028-03-17 23:30:21.597843406 +0000 UTC"
Jul 09 18:25:35.154631 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:35.154624    2557 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14813h4m46.44322454s"
Jul 09 18:25:35.265251 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:35.265216    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sk5xh"
Jul 09 18:25:35.265438 ip-10-0-141-101 kubenswrapper[2557]: E0709 18:25:35.265364    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sk5xh" podUID="3799d80f-6238-4782-913f-7dba2c15884e"
Jul 09 18:25:35.265668 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:35.265651    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-j7h7r"
Jul 09 18:25:35.265751 ip-10-0-141-101 kubenswrapper[2557]: E0709 18:25:35.265731    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-j7h7r" podUID="167643e1-1c6b-47ce-8541-e145c13acdb1"
Jul 09 18:25:35.287308 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:35.287272    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-101.ec2.internal" event={"ID":"b2c36589f62defe44458de06cdd5da38","Type":"ContainerStarted","Data":"90409d1d4e6709c1776ae1b0bd6d28b96af2a09ac73767646d7ae4797c8f463d"}
Jul 09 18:25:35.289438 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:35.289408    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-smljn" event={"ID":"327c1eaf-28aa-4971-8053-7d3e67515edd","Type":"ContainerStarted","Data":"fd75ce699130a5abdeb0e8f246c4c5ded3702e0dcdd1a9eba3ddcc47e173cd14"}
Jul 09 18:25:35.311218 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:35.311159    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-101.ec2.internal" podStartSLOduration=3.311139655 podStartE2EDuration="3.311139655s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 18:25:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 18:25:35.310264882 +0000 UTC m=+4.549609509" watchObservedRunningTime="2026-07-09 18:25:35.311139655 +0000 UTC m=+4.550484282"
Jul 09 18:25:35.313857 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:35.313831    2557 generic.go:356] "Generic (PLEG): container finished" podID="8d7f955ecd105eda414726db5de540d0" containerID="745a0a047c570f96e865e30250c964cfbf10385c089f334d53308ea16b6b2ad9" exitCode=0
Jul 09 18:25:35.314002 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:35.313927    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-101.ec2.internal" event={"ID":"8d7f955ecd105eda414726db5de540d0","Type":"ContainerDied","Data":"745a0a047c570f96e865e30250c964cfbf10385c089f334d53308ea16b6b2ad9"}
Jul 09 18:25:35.319772 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:35.319597    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-pgtwb" event={"ID":"6f90a96e-46ae-48f0-b35b-31201873c7e2","Type":"ContainerStarted","Data":"619584f3c006fc9589f625c663e4870a04886208c8a698afd5d50751a8e532f2"}
Jul 09 18:25:35.322843 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:35.322724    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-6vp8c" event={"ID":"26a69634-4e01-424c-9d63-7c572b081eaa","Type":"ContainerStarted","Data":"d6b2c85b57df34a956a0ac3a02c6f3a1315b0213b704ac5721973570820b9977"}
Jul 09 18:25:36.255524 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:36.255473    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9f9j6"
Jul 09 18:25:36.256007 ip-10-0-141-101 kubenswrapper[2557]: E0709 18:25:36.255669    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9f9j6" podUID="cdb7f3b5-f8db-4d3f-8067-371e5eda9f3e"
Jul 09 18:25:36.333574 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:36.333541    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-101.ec2.internal" event={"ID":"8d7f955ecd105eda414726db5de540d0","Type":"ContainerStarted","Data":"c484f374a3cbb4a181981cb3c429288dc02896c740fa50728edc6a0e096cb588"}
Jul 09 18:25:36.722075 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:36.721990    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3799d80f-6238-4782-913f-7dba2c15884e-metrics-certs\") pod \"network-metrics-daemon-sk5xh\" (UID: \"3799d80f-6238-4782-913f-7dba2c15884e\") " pod="openshift-multus/network-metrics-daemon-sk5xh"
Jul 09 18:25:36.722235 ip-10-0-141-101 kubenswrapper[2557]: E0709 18:25:36.722141    2557 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 09 18:25:36.722235 ip-10-0-141-101 kubenswrapper[2557]: E0709 18:25:36.722206    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3799d80f-6238-4782-913f-7dba2c15884e-metrics-certs podName:3799d80f-6238-4782-913f-7dba2c15884e nodeName:}" failed. No retries permitted until 2026-07-09 18:25:40.72218638 +0000 UTC m=+9.961530989 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3799d80f-6238-4782-913f-7dba2c15884e-metrics-certs") pod "network-metrics-daemon-sk5xh" (UID: "3799d80f-6238-4782-913f-7dba2c15884e") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 09 18:25:36.823329 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:36.823275    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ntqs7\" (UniqueName: \"kubernetes.io/projected/167643e1-1c6b-47ce-8541-e145c13acdb1-kube-api-access-ntqs7\") pod \"network-check-target-j7h7r\" (UID: \"167643e1-1c6b-47ce-8541-e145c13acdb1\") " pod="openshift-network-diagnostics/network-check-target-j7h7r"
Jul 09 18:25:36.823329 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:36.823328    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/cdb7f3b5-f8db-4d3f-8067-371e5eda9f3e-original-pull-secret\") pod \"global-pull-secret-syncer-9f9j6\" (UID: \"cdb7f3b5-f8db-4d3f-8067-371e5eda9f3e\") " pod="kube-system/global-pull-secret-syncer-9f9j6"
Jul 09 18:25:36.823572 ip-10-0-141-101 kubenswrapper[2557]: E0709 18:25:36.823472    2557 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 09 18:25:36.823572 ip-10-0-141-101 kubenswrapper[2557]: E0709 18:25:36.823545    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cdb7f3b5-f8db-4d3f-8067-371e5eda9f3e-original-pull-secret podName:cdb7f3b5-f8db-4d3f-8067-371e5eda9f3e nodeName:}" failed. No retries permitted until 2026-07-09 18:25:40.823527271 +0000 UTC m=+10.062871877 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/cdb7f3b5-f8db-4d3f-8067-371e5eda9f3e-original-pull-secret") pod "global-pull-secret-syncer-9f9j6" (UID: "cdb7f3b5-f8db-4d3f-8067-371e5eda9f3e") : object "kube-system"/"original-pull-secret" not registered
Jul 09 18:25:36.824203 ip-10-0-141-101 kubenswrapper[2557]: E0709 18:25:36.823937    2557 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 09 18:25:36.824203 ip-10-0-141-101 kubenswrapper[2557]: E0709 18:25:36.823958    2557 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 09 18:25:36.824203 ip-10-0-141-101 kubenswrapper[2557]: E0709 18:25:36.823970    2557 projected.go:196] Error preparing data for projected volume kube-api-access-ntqs7 for pod openshift-network-diagnostics/network-check-target-j7h7r: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 09 18:25:36.824203 ip-10-0-141-101 kubenswrapper[2557]: E0709 18:25:36.824013    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/167643e1-1c6b-47ce-8541-e145c13acdb1-kube-api-access-ntqs7 podName:167643e1-1c6b-47ce-8541-e145c13acdb1 nodeName:}" failed. No retries permitted until 2026-07-09 18:25:40.823999226 +0000 UTC m=+10.063343832 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-ntqs7" (UniqueName: "kubernetes.io/projected/167643e1-1c6b-47ce-8541-e145c13acdb1-kube-api-access-ntqs7") pod "network-check-target-j7h7r" (UID: "167643e1-1c6b-47ce-8541-e145c13acdb1") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 09 18:25:37.256578 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:37.256234    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sk5xh"
Jul 09 18:25:37.256578 ip-10-0-141-101 kubenswrapper[2557]: E0709 18:25:37.256388    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sk5xh" podUID="3799d80f-6238-4782-913f-7dba2c15884e"
Jul 09 18:25:37.256578 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:37.256500    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-j7h7r"
Jul 09 18:25:37.257172 ip-10-0-141-101 kubenswrapper[2557]: E0709 18:25:37.256619    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-j7h7r" podUID="167643e1-1c6b-47ce-8541-e145c13acdb1"
Jul 09 18:25:38.255979 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:38.255915    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9f9j6"
Jul 09 18:25:38.256167 ip-10-0-141-101 kubenswrapper[2557]: E0709 18:25:38.256049    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9f9j6" podUID="cdb7f3b5-f8db-4d3f-8067-371e5eda9f3e"
Jul 09 18:25:39.259246 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:39.259217    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sk5xh"
Jul 09 18:25:39.259692 ip-10-0-141-101 kubenswrapper[2557]: E0709 18:25:39.259358    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sk5xh" podUID="3799d80f-6238-4782-913f-7dba2c15884e"
Jul 09 18:25:39.259692 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:39.259386    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-j7h7r"
Jul 09 18:25:39.259692 ip-10-0-141-101 kubenswrapper[2557]: E0709 18:25:39.259528    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-j7h7r" podUID="167643e1-1c6b-47ce-8541-e145c13acdb1"
Jul 09 18:25:40.255852 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:40.255814    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9f9j6"
Jul 09 18:25:40.256086 ip-10-0-141-101 kubenswrapper[2557]: E0709 18:25:40.255957    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9f9j6" podUID="cdb7f3b5-f8db-4d3f-8067-371e5eda9f3e"
Jul 09 18:25:40.754040 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:40.753954    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3799d80f-6238-4782-913f-7dba2c15884e-metrics-certs\") pod \"network-metrics-daemon-sk5xh\" (UID: \"3799d80f-6238-4782-913f-7dba2c15884e\") " pod="openshift-multus/network-metrics-daemon-sk5xh"
Jul 09 18:25:40.754511 ip-10-0-141-101 kubenswrapper[2557]: E0709 18:25:40.754094    2557 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 09 18:25:40.754511 ip-10-0-141-101 kubenswrapper[2557]: E0709 18:25:40.754174    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3799d80f-6238-4782-913f-7dba2c15884e-metrics-certs podName:3799d80f-6238-4782-913f-7dba2c15884e nodeName:}" failed. No retries permitted until 2026-07-09 18:25:48.75415074 +0000 UTC m=+17.993495360 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3799d80f-6238-4782-913f-7dba2c15884e-metrics-certs") pod "network-metrics-daemon-sk5xh" (UID: "3799d80f-6238-4782-913f-7dba2c15884e") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 09 18:25:40.855171 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:40.855127    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ntqs7\" (UniqueName: \"kubernetes.io/projected/167643e1-1c6b-47ce-8541-e145c13acdb1-kube-api-access-ntqs7\") pod \"network-check-target-j7h7r\" (UID: \"167643e1-1c6b-47ce-8541-e145c13acdb1\") " pod="openshift-network-diagnostics/network-check-target-j7h7r"
Jul 09 18:25:40.855373 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:40.855182    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/cdb7f3b5-f8db-4d3f-8067-371e5eda9f3e-original-pull-secret\") pod \"global-pull-secret-syncer-9f9j6\" (UID: \"cdb7f3b5-f8db-4d3f-8067-371e5eda9f3e\") " pod="kube-system/global-pull-secret-syncer-9f9j6"
Jul 09 18:25:40.855373 ip-10-0-141-101 kubenswrapper[2557]: E0709 18:25:40.855287    2557 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 09 18:25:40.855373 ip-10-0-141-101 kubenswrapper[2557]: E0709 18:25:40.855318    2557 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 09 18:25:40.855373 ip-10-0-141-101 kubenswrapper[2557]: E0709 18:25:40.855333    2557 projected.go:196] Error preparing data for projected volume kube-api-access-ntqs7 for pod openshift-network-diagnostics/network-check-target-j7h7r: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 09 18:25:40.855373 ip-10-0-141-101 kubenswrapper[2557]: E0709 18:25:40.855334    2557 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 09 18:25:40.855636 ip-10-0-141-101 kubenswrapper[2557]: E0709 18:25:40.855404    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cdb7f3b5-f8db-4d3f-8067-371e5eda9f3e-original-pull-secret podName:cdb7f3b5-f8db-4d3f-8067-371e5eda9f3e nodeName:}" failed. No retries permitted until 2026-07-09 18:25:48.85538501 +0000 UTC m=+18.094729620 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/cdb7f3b5-f8db-4d3f-8067-371e5eda9f3e-original-pull-secret") pod "global-pull-secret-syncer-9f9j6" (UID: "cdb7f3b5-f8db-4d3f-8067-371e5eda9f3e") : object "kube-system"/"original-pull-secret" not registered
Jul 09 18:25:40.855636 ip-10-0-141-101 kubenswrapper[2557]: E0709 18:25:40.855427    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/167643e1-1c6b-47ce-8541-e145c13acdb1-kube-api-access-ntqs7 podName:167643e1-1c6b-47ce-8541-e145c13acdb1 nodeName:}" failed. No retries permitted until 2026-07-09 18:25:48.855417207 +0000 UTC m=+18.094761826 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-ntqs7" (UniqueName: "kubernetes.io/projected/167643e1-1c6b-47ce-8541-e145c13acdb1-kube-api-access-ntqs7") pod "network-check-target-j7h7r" (UID: "167643e1-1c6b-47ce-8541-e145c13acdb1") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 09 18:25:41.262769 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:41.261616    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-j7h7r"
Jul 09 18:25:41.262769 ip-10-0-141-101 kubenswrapper[2557]: E0709 18:25:41.261763    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-j7h7r" podUID="167643e1-1c6b-47ce-8541-e145c13acdb1"
Jul 09 18:25:41.262769 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:41.262171    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sk5xh"
Jul 09 18:25:41.262769 ip-10-0-141-101 kubenswrapper[2557]: E0709 18:25:41.262319    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sk5xh" podUID="3799d80f-6238-4782-913f-7dba2c15884e"
Jul 09 18:25:42.255781 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:42.255752    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9f9j6"
Jul 09 18:25:42.256212 ip-10-0-141-101 kubenswrapper[2557]: E0709 18:25:42.255884    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9f9j6" podUID="cdb7f3b5-f8db-4d3f-8067-371e5eda9f3e"
Jul 09 18:25:43.255579 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:43.255536    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sk5xh"
Jul 09 18:25:43.255797 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:43.255536    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-j7h7r"
Jul 09 18:25:43.255797 ip-10-0-141-101 kubenswrapper[2557]: E0709 18:25:43.255678    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sk5xh" podUID="3799d80f-6238-4782-913f-7dba2c15884e"
Jul 09 18:25:43.255797 ip-10-0-141-101 kubenswrapper[2557]: E0709 18:25:43.255699    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-j7h7r" podUID="167643e1-1c6b-47ce-8541-e145c13acdb1"
Jul 09 18:25:44.256131 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:44.256053    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9f9j6"
Jul 09 18:25:44.256545 ip-10-0-141-101 kubenswrapper[2557]: E0709 18:25:44.256167    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9f9j6" podUID="cdb7f3b5-f8db-4d3f-8067-371e5eda9f3e"
Jul 09 18:25:44.353393 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:44.353302    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-khxbf" event={"ID":"8424b53e-dc3c-4c74-85bd-105eaeb77aa4","Type":"ContainerStarted","Data":"fa8bffdef0af71de7ee63e4f0c2abc28055c90b33360099a720b31aba3f69aae"}
Jul 09 18:25:44.355023 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:44.354990    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-v55vr" event={"ID":"62a8b86b-6eaf-4e72-aa0b-2de8fa04ed16","Type":"ContainerStarted","Data":"e1ef6b68dafd67008f45d60d0d8244ed691dfdcffe3f6c0a3c3451c571a28fd2"}
Jul 09 18:25:44.357685 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:44.357205    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-w6nvx" event={"ID":"a6ea2124-43d0-494e-b2ad-6b2933014f0d","Type":"ContainerStarted","Data":"abc096002e13a15ab98b06d72b8a9e925a95eb25eea13a68cf03f0537255987b"}
Jul 09 18:25:44.360923 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:44.360311    2557 generic.go:356] "Generic (PLEG): container finished" podID="cb415bf4-3279-48dc-a565-43e470e3508c" containerID="ccfa0ab6824381d0491cda0d551b5cac16464d180c5eeeddccd7dbdb7e4e4390" exitCode=0
Jul 09 18:25:44.360923 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:44.360397    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-s6ptt" event={"ID":"cb415bf4-3279-48dc-a565-43e470e3508c","Type":"ContainerDied","Data":"ccfa0ab6824381d0491cda0d551b5cac16464d180c5eeeddccd7dbdb7e4e4390"}
Jul 09 18:25:44.362773 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:44.362746    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-smljn" event={"ID":"327c1eaf-28aa-4971-8053-7d3e67515edd","Type":"ContainerStarted","Data":"52c631cbd2b2d9db1b33a1847eceebaf98456f2a8acec7355f920d765d7c8dbf"}
Jul 09 18:25:44.364780 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:44.364754    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-w5wgl" event={"ID":"cc49c9d1-6be4-487b-adf1-ee18094747b6","Type":"ContainerStarted","Data":"9a4b2ded7430849fb4645813d5e737e0f873ca194fe573176e85fa26ab70f39f"}
Jul 09 18:25:44.371209 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:44.371170    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-101.ec2.internal" podStartSLOduration=12.371157533 podStartE2EDuration="12.371157533s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 18:25:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 18:25:36.361238189 +0000 UTC m=+5.600582795" watchObservedRunningTime="2026-07-09 18:25:44.371157533 +0000 UTC m=+13.610502167"
Jul 09 18:25:44.371357 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:44.371333    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-v55vr" podStartSLOduration=3.477945247 podStartE2EDuration="13.371326982s" totalImagesPullingTime="9.893381735s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 18:25:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 18:25:44.37040557 +0000 UTC m=+13.609750219" watchObservedRunningTime="2026-07-09 18:25:44.371326982 +0000 UTC m=+13.610671609"
Jul 09 18:25:44.385467 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:44.385416    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-w5wgl" podStartSLOduration=3.512611889 podStartE2EDuration="13.385399883s" totalImagesPullingTime="9.872787994s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 18:25:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 18:25:44.385353439 +0000 UTC m=+13.624698066" watchObservedRunningTime="2026-07-09 18:25:44.385399883 +0000 UTC m=+13.624744514"
Jul 09 18:25:44.401429 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:44.401372    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-smljn" podStartSLOduration=4.725811458 podStartE2EDuration="13.401349974s" totalImagesPullingTime="8.675538516s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 18:25:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 18:25:44.401155324 +0000 UTC m=+13.640499971" watchObservedRunningTime="2026-07-09 18:25:44.401349974 +0000 UTC m=+13.640694600"
Jul 09 18:25:44.439828 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:44.439768    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-w6nvx" podStartSLOduration=3.519942559 podStartE2EDuration="13.439748288s" totalImagesPullingTime="9.919805729s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 18:25:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 18:25:44.43965729 +0000 UTC m=+13.679001938" watchObservedRunningTime="2026-07-09 18:25:44.439748288 +0000 UTC m=+13.679092916"
Jul 09 18:25:45.256107 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:45.256073    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sk5xh"
Jul 09 18:25:45.256233 ip-10-0-141-101 kubenswrapper[2557]: E0709 18:25:45.256211    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sk5xh" podUID="3799d80f-6238-4782-913f-7dba2c15884e"
Jul 09 18:25:45.256614 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:45.256246    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-j7h7r"
Jul 09 18:25:45.256614 ip-10-0-141-101 kubenswrapper[2557]: E0709 18:25:45.256318    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-j7h7r" podUID="167643e1-1c6b-47ce-8541-e145c13acdb1"
Jul 09 18:25:45.368558 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:45.368471    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-kldmh" event={"ID":"90d2aea7-1ee6-42f5-a94e-7b4f92963831","Type":"ContainerStarted","Data":"caefa45967786e6f5dbdccbfc75d3937c2194b8425ef7b357537e48df62e7333"}
Jul 09 18:25:45.385178 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:45.385044    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-kldmh" podStartSLOduration=4.50142857 podStartE2EDuration="14.385022339s" totalImagesPullingTime="9.883593769s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 18:25:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 18:25:45.384236555 +0000 UTC m=+14.623581182" watchObservedRunningTime="2026-07-09 18:25:45.385022339 +0000 UTC m=+14.624366966"
Jul 09 18:25:45.411790 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:45.411748    2557 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jul 09 18:25:46.138409 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:46.138293    2557 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-09T18:25:45.411770646Z","UUID":"6beeb659-158a-4011-a8ed-b5a46ed2e654","Handler":null,"Name":"","Endpoint":""}
Jul 09 18:25:46.140468 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:46.140051    2557 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jul 09 18:25:46.140468 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:46.140096    2557 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jul 09 18:25:46.256068 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:46.256035    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9f9j6"
Jul 09 18:25:46.256259 ip-10-0-141-101 kubenswrapper[2557]: E0709 18:25:46.256163    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9f9j6" podUID="cdb7f3b5-f8db-4d3f-8067-371e5eda9f3e"
Jul 09 18:25:46.374324 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:46.373897    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-khxbf" event={"ID":"8424b53e-dc3c-4c74-85bd-105eaeb77aa4","Type":"ContainerStarted","Data":"c5e62d8722c2fe2dcb3839478119986f9983c55e6018ee8b10ddc9a48f9237bb"}
Jul 09 18:25:47.256079 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:47.256043    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-j7h7r"
Jul 09 18:25:47.256242 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:47.256046    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sk5xh"
Jul 09 18:25:47.256242 ip-10-0-141-101 kubenswrapper[2557]: E0709 18:25:47.256180    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-j7h7r" podUID="167643e1-1c6b-47ce-8541-e145c13acdb1"
Jul 09 18:25:47.256836 ip-10-0-141-101 kubenswrapper[2557]: E0709 18:25:47.256281    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sk5xh" podUID="3799d80f-6238-4782-913f-7dba2c15884e"
Jul 09 18:25:47.331345 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:47.331309    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-v55vr"
Jul 09 18:25:47.332098 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:47.332072    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-v55vr"
Jul 09 18:25:47.376409 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:47.376381    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-v55vr"
Jul 09 18:25:47.377029 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:47.376998    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-v55vr"
Jul 09 18:25:48.255562 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:48.255532    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9f9j6"
Jul 09 18:25:48.255767 ip-10-0-141-101 kubenswrapper[2557]: E0709 18:25:48.255653    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9f9j6" podUID="cdb7f3b5-f8db-4d3f-8067-371e5eda9f3e"
Jul 09 18:25:48.819077 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:48.818810    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3799d80f-6238-4782-913f-7dba2c15884e-metrics-certs\") pod \"network-metrics-daemon-sk5xh\" (UID: \"3799d80f-6238-4782-913f-7dba2c15884e\") " pod="openshift-multus/network-metrics-daemon-sk5xh"
Jul 09 18:25:48.819584 ip-10-0-141-101 kubenswrapper[2557]: E0709 18:25:48.819003    2557 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 09 18:25:48.819584 ip-10-0-141-101 kubenswrapper[2557]: E0709 18:25:48.819199    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3799d80f-6238-4782-913f-7dba2c15884e-metrics-certs podName:3799d80f-6238-4782-913f-7dba2c15884e nodeName:}" failed. No retries permitted until 2026-07-09 18:26:04.819175763 +0000 UTC m=+34.058520384 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3799d80f-6238-4782-913f-7dba2c15884e-metrics-certs") pod "network-metrics-daemon-sk5xh" (UID: "3799d80f-6238-4782-913f-7dba2c15884e") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 09 18:25:48.920049 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:48.920011    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ntqs7\" (UniqueName: \"kubernetes.io/projected/167643e1-1c6b-47ce-8541-e145c13acdb1-kube-api-access-ntqs7\") pod \"network-check-target-j7h7r\" (UID: \"167643e1-1c6b-47ce-8541-e145c13acdb1\") " pod="openshift-network-diagnostics/network-check-target-j7h7r"
Jul 09 18:25:48.920221 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:48.920060    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/cdb7f3b5-f8db-4d3f-8067-371e5eda9f3e-original-pull-secret\") pod \"global-pull-secret-syncer-9f9j6\" (UID: \"cdb7f3b5-f8db-4d3f-8067-371e5eda9f3e\") " pod="kube-system/global-pull-secret-syncer-9f9j6"
Jul 09 18:25:48.920221 ip-10-0-141-101 kubenswrapper[2557]: E0709 18:25:48.920187    2557 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 09 18:25:48.920221 ip-10-0-141-101 kubenswrapper[2557]: E0709 18:25:48.920204    2557 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 09 18:25:48.920221 ip-10-0-141-101 kubenswrapper[2557]: E0709 18:25:48.920220    2557 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 09 18:25:48.920404 ip-10-0-141-101 kubenswrapper[2557]: E0709 18:25:48.920235    2557 projected.go:196] Error preparing data for projected volume kube-api-access-ntqs7 for pod openshift-network-diagnostics/network-check-target-j7h7r: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 09 18:25:48.920404 ip-10-0-141-101 kubenswrapper[2557]: E0709 18:25:48.920280    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cdb7f3b5-f8db-4d3f-8067-371e5eda9f3e-original-pull-secret podName:cdb7f3b5-f8db-4d3f-8067-371e5eda9f3e nodeName:}" failed. No retries permitted until 2026-07-09 18:26:04.920260582 +0000 UTC m=+34.159605187 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/cdb7f3b5-f8db-4d3f-8067-371e5eda9f3e-original-pull-secret") pod "global-pull-secret-syncer-9f9j6" (UID: "cdb7f3b5-f8db-4d3f-8067-371e5eda9f3e") : object "kube-system"/"original-pull-secret" not registered
Jul 09 18:25:48.920404 ip-10-0-141-101 kubenswrapper[2557]: E0709 18:25:48.920300    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/167643e1-1c6b-47ce-8541-e145c13acdb1-kube-api-access-ntqs7 podName:167643e1-1c6b-47ce-8541-e145c13acdb1 nodeName:}" failed. No retries permitted until 2026-07-09 18:26:04.92029047 +0000 UTC m=+34.159635077 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-ntqs7" (UniqueName: "kubernetes.io/projected/167643e1-1c6b-47ce-8541-e145c13acdb1-kube-api-access-ntqs7") pod "network-check-target-j7h7r" (UID: "167643e1-1c6b-47ce-8541-e145c13acdb1") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 09 18:25:49.256042 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:49.255762    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sk5xh"
Jul 09 18:25:49.256042 ip-10-0-141-101 kubenswrapper[2557]: E0709 18:25:49.255906    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sk5xh" podUID="3799d80f-6238-4782-913f-7dba2c15884e"
Jul 09 18:25:49.256042 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:49.255942    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-j7h7r"
Jul 09 18:25:49.256317 ip-10-0-141-101 kubenswrapper[2557]: E0709 18:25:49.256052    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-j7h7r" podUID="167643e1-1c6b-47ce-8541-e145c13acdb1"
Jul 09 18:25:50.256311 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:50.256273    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9f9j6"
Jul 09 18:25:50.256729 ip-10-0-141-101 kubenswrapper[2557]: E0709 18:25:50.256412    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9f9j6" podUID="cdb7f3b5-f8db-4d3f-8067-371e5eda9f3e"
Jul 09 18:25:51.256405 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:51.256373    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sk5xh"
Jul 09 18:25:51.256883 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:51.256473    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-j7h7r"
Jul 09 18:25:51.256883 ip-10-0-141-101 kubenswrapper[2557]: E0709 18:25:51.256506    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sk5xh" podUID="3799d80f-6238-4782-913f-7dba2c15884e"
Jul 09 18:25:51.256883 ip-10-0-141-101 kubenswrapper[2557]: E0709 18:25:51.256604    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-j7h7r" podUID="167643e1-1c6b-47ce-8541-e145c13acdb1"
Jul 09 18:25:52.255359 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:52.255321    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9f9j6"
Jul 09 18:25:52.255558 ip-10-0-141-101 kubenswrapper[2557]: E0709 18:25:52.255452    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9f9j6" podUID="cdb7f3b5-f8db-4d3f-8067-371e5eda9f3e"
Jul 09 18:25:53.255877 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:53.255841    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sk5xh"
Jul 09 18:25:53.256419 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:53.255887    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-j7h7r"
Jul 09 18:25:53.256419 ip-10-0-141-101 kubenswrapper[2557]: E0709 18:25:53.255988    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sk5xh" podUID="3799d80f-6238-4782-913f-7dba2c15884e"
Jul 09 18:25:53.256419 ip-10-0-141-101 kubenswrapper[2557]: E0709 18:25:53.256120    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-j7h7r" podUID="167643e1-1c6b-47ce-8541-e145c13acdb1"
Jul 09 18:25:54.256194 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:54.256159    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9f9j6"
Jul 09 18:25:54.256798 ip-10-0-141-101 kubenswrapper[2557]: E0709 18:25:54.256283    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9f9j6" podUID="cdb7f3b5-f8db-4d3f-8067-371e5eda9f3e"
Jul 09 18:25:55.256458 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:55.256380    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-j7h7r"
Jul 09 18:25:55.256883 ip-10-0-141-101 kubenswrapper[2557]: E0709 18:25:55.256510    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-j7h7r" podUID="167643e1-1c6b-47ce-8541-e145c13acdb1"
Jul 09 18:25:55.256883 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:55.256378    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sk5xh"
Jul 09 18:25:55.256965 ip-10-0-141-101 kubenswrapper[2557]: E0709 18:25:55.256880    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sk5xh" podUID="3799d80f-6238-4782-913f-7dba2c15884e"
Jul 09 18:25:56.256056 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:56.256018    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9f9j6"
Jul 09 18:25:56.256274 ip-10-0-141-101 kubenswrapper[2557]: E0709 18:25:56.256132    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9f9j6" podUID="cdb7f3b5-f8db-4d3f-8067-371e5eda9f3e"
Jul 09 18:25:57.256135 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:57.255932    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sk5xh"
Jul 09 18:25:57.256847 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:57.256007    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-j7h7r"
Jul 09 18:25:57.256847 ip-10-0-141-101 kubenswrapper[2557]: E0709 18:25:57.256230    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sk5xh" podUID="3799d80f-6238-4782-913f-7dba2c15884e"
Jul 09 18:25:57.256847 ip-10-0-141-101 kubenswrapper[2557]: E0709 18:25:57.256334    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-j7h7r" podUID="167643e1-1c6b-47ce-8541-e145c13acdb1"
Jul 09 18:25:57.397349 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:57.397308    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-pgtwb" event={"ID":"6f90a96e-46ae-48f0-b35b-31201873c7e2","Type":"ContainerStarted","Data":"713da56c31ca793bb8b2c0a25e4bdf44169f747ff0cb5259b3b392d3fba8e91d"}
Jul 09 18:25:57.400372 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:57.400344    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-6vp8c" event={"ID":"26a69634-4e01-424c-9d63-7c572b081eaa","Type":"ContainerStarted","Data":"2d4992fba2324eacabb7bde707a19546eded364bbfbc9bbdbdf92835fe149be0"}
Jul 09 18:25:57.400531 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:57.400408    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-6vp8c" event={"ID":"26a69634-4e01-424c-9d63-7c572b081eaa","Type":"ContainerStarted","Data":"71ba2f27951211d9123bb120754e1af4cbafb57099c075e1e942839b6dab31da"}
Jul 09 18:25:57.400531 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:57.400451    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-6vp8c" event={"ID":"26a69634-4e01-424c-9d63-7c572b081eaa","Type":"ContainerStarted","Data":"2510cdb4c4fd4e3f7474198510ab4ae3dbe1ea4e11c6164b29a7d818065b45fa"}
Jul 09 18:25:57.400531 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:57.400511    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-6vp8c" event={"ID":"26a69634-4e01-424c-9d63-7c572b081eaa","Type":"ContainerStarted","Data":"2a1b450ec753bda9719bc57f81c4f9fbc13ef9650f409a47f9f16c8f61c9e48b"}
Jul 09 18:25:57.400664 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:57.400543    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-6vp8c" event={"ID":"26a69634-4e01-424c-9d63-7c572b081eaa","Type":"ContainerStarted","Data":"e2a5a694db8de52f382c6ee0c3a545c881794dcd02316b780513a20f031c6db5"}
Jul 09 18:25:57.400664 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:57.400586    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-6vp8c" event={"ID":"26a69634-4e01-424c-9d63-7c572b081eaa","Type":"ContainerStarted","Data":"4e1a6720edb2b70f8f6dfd818a322f1cb3d9a1beabfd7a47e5a8d0a807c6ce51"}
Jul 09 18:25:57.402433 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:57.402408    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-khxbf" event={"ID":"8424b53e-dc3c-4c74-85bd-105eaeb77aa4","Type":"ContainerStarted","Data":"668fbe13f881a15572dd2181b4b2ae424dc5a7f128ff4d8db0ec29a15d52e35c"}
Jul 09 18:25:57.404112 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:57.404088    2557 generic.go:356] "Generic (PLEG): container finished" podID="cb415bf4-3279-48dc-a565-43e470e3508c" containerID="ac80ae9938f6c62e8445e8238924d9f612958cc5aae1aac48ca9c3cc86fde73c" exitCode=0
Jul 09 18:25:57.404218 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:57.404122    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-s6ptt" event={"ID":"cb415bf4-3279-48dc-a565-43e470e3508c","Type":"ContainerDied","Data":"ac80ae9938f6c62e8445e8238924d9f612958cc5aae1aac48ca9c3cc86fde73c"}
Jul 09 18:25:57.447691 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:57.447628    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-pgtwb" podStartSLOduration=4.503805988 podStartE2EDuration="26.447609548s" totalImagesPullingTime="21.94380356s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 18:25:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 18:25:57.421175284 +0000 UTC m=+26.660519911" watchObservedRunningTime="2026-07-09 18:25:57.447609548 +0000 UTC m=+26.686954174"
Jul 09 18:25:58.256295 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:58.256255    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9f9j6"
Jul 09 18:25:58.256888 ip-10-0-141-101 kubenswrapper[2557]: E0709 18:25:58.256365    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9f9j6" podUID="cdb7f3b5-f8db-4d3f-8067-371e5eda9f3e"
Jul 09 18:25:59.255336 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:59.255299    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sk5xh"
Jul 09 18:25:59.255552 ip-10-0-141-101 kubenswrapper[2557]: E0709 18:25:59.255420    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sk5xh" podUID="3799d80f-6238-4782-913f-7dba2c15884e"
Jul 09 18:25:59.255552 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:59.255457    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-j7h7r"
Jul 09 18:25:59.255552 ip-10-0-141-101 kubenswrapper[2557]: E0709 18:25:59.255534    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-j7h7r" podUID="167643e1-1c6b-47ce-8541-e145c13acdb1"
Jul 09 18:25:59.412243 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:59.412197    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-6vp8c" event={"ID":"26a69634-4e01-424c-9d63-7c572b081eaa","Type":"ContainerStarted","Data":"3e9910b0db3a7cf9ac2b5442a5d34d0c33e386f05931e07091f3c6c972778a2f"}
Jul 09 18:25:59.414373 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:59.414344    2557 generic.go:356] "Generic (PLEG): container finished" podID="cb415bf4-3279-48dc-a565-43e470e3508c" containerID="fbfae131e8c2c9a4176de37133139b1b1bd11e5108d7bacfa540e2636b84ca3a" exitCode=0
Jul 09 18:25:59.414527 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:59.414387    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-s6ptt" event={"ID":"cb415bf4-3279-48dc-a565-43e470e3508c","Type":"ContainerDied","Data":"fbfae131e8c2c9a4176de37133139b1b1bd11e5108d7bacfa540e2636b84ca3a"}
Jul 09 18:25:59.443532 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:25:59.443458    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-khxbf" podStartSLOduration=5.703491816 podStartE2EDuration="28.443442198s" totalImagesPullingTime="22.739950382s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 18:25:31 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 18:25:57.474689185 +0000 UTC m=+26.714033811" watchObservedRunningTime="2026-07-09 18:25:59.443442198 +0000 UTC m=+28.682786868"
Jul 09 18:26:00.256041 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:26:00.256008    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9f9j6"
Jul 09 18:26:00.256202 ip-10-0-141-101 kubenswrapper[2557]: E0709 18:26:00.256115    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9f9j6" podUID="cdb7f3b5-f8db-4d3f-8067-371e5eda9f3e"
Jul 09 18:26:01.256459 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:26:01.256426    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sk5xh"
Jul 09 18:26:01.256890 ip-10-0-141-101 kubenswrapper[2557]: E0709 18:26:01.256538    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sk5xh" podUID="3799d80f-6238-4782-913f-7dba2c15884e"
Jul 09 18:26:01.256890 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:26:01.256595    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-j7h7r"
Jul 09 18:26:01.256890 ip-10-0-141-101 kubenswrapper[2557]: E0709 18:26:01.256685    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-j7h7r" podUID="167643e1-1c6b-47ce-8541-e145c13acdb1"
Jul 09 18:26:01.424082 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:26:01.423853    2557 generic.go:356] "Generic (PLEG): container finished" podID="cb415bf4-3279-48dc-a565-43e470e3508c" containerID="0e80cb15d86c1abfbe7eb1f4c50026797fd80bc7b6f4a98809e2b6b3875d101e" exitCode=0
Jul 09 18:26:01.424192 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:26:01.423920    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-s6ptt" event={"ID":"cb415bf4-3279-48dc-a565-43e470e3508c","Type":"ContainerDied","Data":"0e80cb15d86c1abfbe7eb1f4c50026797fd80bc7b6f4a98809e2b6b3875d101e"}
Jul 09 18:26:02.256151 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:26:02.256121    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9f9j6"
Jul 09 18:26:02.256370 ip-10-0-141-101 kubenswrapper[2557]: E0709 18:26:02.256233    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9f9j6" podUID="cdb7f3b5-f8db-4d3f-8067-371e5eda9f3e"
Jul 09 18:26:02.429787 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:26:02.429756    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-6vp8c" event={"ID":"26a69634-4e01-424c-9d63-7c572b081eaa","Type":"ContainerStarted","Data":"7b8e620a421c1c6cb89c81d0c916b2113259dde36d835a29670db20db24bad3f"}
Jul 09 18:26:02.430240 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:26:02.430001    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-6vp8c"
Jul 09 18:26:02.446108 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:26:02.446077    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-6vp8c"
Jul 09 18:26:02.503040 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:26:02.502989    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-6vp8c" podStartSLOduration=9.571944398 podStartE2EDuration="31.502973028s" totalImagesPullingTime="21.93102863s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 18:25:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 18:26:02.465934677 +0000 UTC m=+31.705279321" watchObservedRunningTime="2026-07-09 18:26:02.502973028 +0000 UTC m=+31.742317680"
Jul 09 18:26:03.256129 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:26:03.256090    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sk5xh"
Jul 09 18:26:03.256278 ip-10-0-141-101 kubenswrapper[2557]: E0709 18:26:03.256211    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sk5xh" podUID="3799d80f-6238-4782-913f-7dba2c15884e"
Jul 09 18:26:03.256333 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:26:03.256275    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-j7h7r"
Jul 09 18:26:03.256418 ip-10-0-141-101 kubenswrapper[2557]: E0709 18:26:03.256391    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-j7h7r" podUID="167643e1-1c6b-47ce-8541-e145c13acdb1"
Jul 09 18:26:03.432467 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:26:03.432430    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-6vp8c"
Jul 09 18:26:03.432902 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:26:03.432546    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-6vp8c"
Jul 09 18:26:03.447388 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:26:03.447364    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-6vp8c"
Jul 09 18:26:03.895193 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:26:03.895154    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-sk5xh"]
Jul 09 18:26:03.895375 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:26:03.895308    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sk5xh"
Jul 09 18:26:03.895441 ip-10-0-141-101 kubenswrapper[2557]: E0709 18:26:03.895409    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sk5xh" podUID="3799d80f-6238-4782-913f-7dba2c15884e"
Jul 09 18:26:03.920193 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:26:03.920114    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-j7h7r"]
Jul 09 18:26:03.920317 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:26:03.920237    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-j7h7r"
Jul 09 18:26:03.920360 ip-10-0-141-101 kubenswrapper[2557]: E0709 18:26:03.920323    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-j7h7r" podUID="167643e1-1c6b-47ce-8541-e145c13acdb1"
Jul 09 18:26:03.920863 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:26:03.920841    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-9f9j6"]
Jul 09 18:26:03.920940 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:26:03.920931    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9f9j6"
Jul 09 18:26:03.921015 ip-10-0-141-101 kubenswrapper[2557]: E0709 18:26:03.920999    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9f9j6" podUID="cdb7f3b5-f8db-4d3f-8067-371e5eda9f3e"
Jul 09 18:26:04.834437 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:26:04.834398    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3799d80f-6238-4782-913f-7dba2c15884e-metrics-certs\") pod \"network-metrics-daemon-sk5xh\" (UID: \"3799d80f-6238-4782-913f-7dba2c15884e\") " pod="openshift-multus/network-metrics-daemon-sk5xh"
Jul 09 18:26:04.834842 ip-10-0-141-101 kubenswrapper[2557]: E0709 18:26:04.834531    2557 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 09 18:26:04.834842 ip-10-0-141-101 kubenswrapper[2557]: E0709 18:26:04.834585    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3799d80f-6238-4782-913f-7dba2c15884e-metrics-certs podName:3799d80f-6238-4782-913f-7dba2c15884e nodeName:}" failed. No retries permitted until 2026-07-09 18:26:36.834569725 +0000 UTC m=+66.073914329 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3799d80f-6238-4782-913f-7dba2c15884e-metrics-certs") pod "network-metrics-daemon-sk5xh" (UID: "3799d80f-6238-4782-913f-7dba2c15884e") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 09 18:26:04.935751 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:26:04.935713    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ntqs7\" (UniqueName: \"kubernetes.io/projected/167643e1-1c6b-47ce-8541-e145c13acdb1-kube-api-access-ntqs7\") pod \"network-check-target-j7h7r\" (UID: \"167643e1-1c6b-47ce-8541-e145c13acdb1\") " pod="openshift-network-diagnostics/network-check-target-j7h7r"
Jul 09 18:26:04.935751 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:26:04.935754    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/cdb7f3b5-f8db-4d3f-8067-371e5eda9f3e-original-pull-secret\") pod \"global-pull-secret-syncer-9f9j6\" (UID: \"cdb7f3b5-f8db-4d3f-8067-371e5eda9f3e\") " pod="kube-system/global-pull-secret-syncer-9f9j6"
Jul 09 18:26:04.935950 ip-10-0-141-101 kubenswrapper[2557]: E0709 18:26:04.935895    2557 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 09 18:26:04.935950 ip-10-0-141-101 kubenswrapper[2557]: E0709 18:26:04.935925    2557 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 09 18:26:04.935950 ip-10-0-141-101 kubenswrapper[2557]: E0709 18:26:04.935928    2557 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 09 18:26:04.936029 ip-10-0-141-101 kubenswrapper[2557]: E0709 18:26:04.935991    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cdb7f3b5-f8db-4d3f-8067-371e5eda9f3e-original-pull-secret podName:cdb7f3b5-f8db-4d3f-8067-371e5eda9f3e nodeName:}" failed. No retries permitted until 2026-07-09 18:26:36.935973823 +0000 UTC m=+66.175318432 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/cdb7f3b5-f8db-4d3f-8067-371e5eda9f3e-original-pull-secret") pod "global-pull-secret-syncer-9f9j6" (UID: "cdb7f3b5-f8db-4d3f-8067-371e5eda9f3e") : object "kube-system"/"original-pull-secret" not registered
Jul 09 18:26:04.936029 ip-10-0-141-101 kubenswrapper[2557]: E0709 18:26:04.935935    2557 projected.go:196] Error preparing data for projected volume kube-api-access-ntqs7 for pod openshift-network-diagnostics/network-check-target-j7h7r: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 09 18:26:04.936097 ip-10-0-141-101 kubenswrapper[2557]: E0709 18:26:04.936065    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/167643e1-1c6b-47ce-8541-e145c13acdb1-kube-api-access-ntqs7 podName:167643e1-1c6b-47ce-8541-e145c13acdb1 nodeName:}" failed. No retries permitted until 2026-07-09 18:26:36.93605384 +0000 UTC m=+66.175398444 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-ntqs7" (UniqueName: "kubernetes.io/projected/167643e1-1c6b-47ce-8541-e145c13acdb1-kube-api-access-ntqs7") pod "network-check-target-j7h7r" (UID: "167643e1-1c6b-47ce-8541-e145c13acdb1") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 09 18:26:05.255992 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:26:05.255755    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sk5xh"
Jul 09 18:26:05.256123 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:26:05.255795    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-j7h7r"
Jul 09 18:26:05.256123 ip-10-0-141-101 kubenswrapper[2557]: E0709 18:26:05.256090    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sk5xh" podUID="3799d80f-6238-4782-913f-7dba2c15884e"
Jul 09 18:26:05.256192 ip-10-0-141-101 kubenswrapper[2557]: E0709 18:26:05.256170    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-j7h7r" podUID="167643e1-1c6b-47ce-8541-e145c13acdb1"
Jul 09 18:26:06.256341 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:26:06.256257    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9f9j6"
Jul 09 18:26:06.256718 ip-10-0-141-101 kubenswrapper[2557]: E0709 18:26:06.256382    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9f9j6" podUID="cdb7f3b5-f8db-4d3f-8067-371e5eda9f3e"
Jul 09 18:26:07.255635 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:26:07.255601    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-j7h7r"
Jul 09 18:26:07.255814 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:26:07.255600    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sk5xh"
Jul 09 18:26:07.255814 ip-10-0-141-101 kubenswrapper[2557]: E0709 18:26:07.255719    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-j7h7r" podUID="167643e1-1c6b-47ce-8541-e145c13acdb1"
Jul 09 18:26:07.255814 ip-10-0-141-101 kubenswrapper[2557]: E0709 18:26:07.255794    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sk5xh" podUID="3799d80f-6238-4782-913f-7dba2c15884e"
Jul 09 18:26:08.256335 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:26:08.256297    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9f9j6"
Jul 09 18:26:08.256843 ip-10-0-141-101 kubenswrapper[2557]: E0709 18:26:08.256427    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9f9j6" podUID="cdb7f3b5-f8db-4d3f-8067-371e5eda9f3e"
Jul 09 18:26:09.062208 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:26:09.062185    2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-101.ec2.internal" event="NodeReady"
Jul 09 18:26:09.062373 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:26:09.062312    2557 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jul 09 18:26:09.124204 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:26:09.124169    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-6fcpf"]
Jul 09 18:26:09.139518 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:26:09.139472    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-g8csp"]
Jul 09 18:26:09.139659 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:26:09.139585    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-6fcpf"
Jul 09 18:26:09.148367 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:26:09.148346    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 09 18:26:09.148367 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:26:09.148372    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 09 18:26:09.148579 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:26:09.148422    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-dqpcm\""
Jul 09 18:26:09.148695 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:26:09.148680    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 09 18:26:09.149378 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:26:09.149359    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-6fcpf"]
Jul 09 18:26:09.149494 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:26:09.149462    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-g8csp"
Jul 09 18:26:09.151643 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:26:09.151614    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-jnv68\""
Jul 09 18:26:09.151871 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:26:09.151855    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 09 18:26:09.151990 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:26:09.151974    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 09 18:26:09.161527 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:26:09.161502    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-g8csp"]
Jul 09 18:26:09.255373 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:26:09.255337    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sk5xh"
Jul 09 18:26:09.255583 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:26:09.255337    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-j7h7r"
Jul 09 18:26:09.262368 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:26:09.262350    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 09 18:26:09.263030 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:26:09.262400    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-7pc9s\""
Jul 09 18:26:09.263030 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:26:09.262667    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 09 18:26:09.263030 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:26:09.262759    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-qx56j\""
Jul 09 18:26:09.263030 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:26:09.262894    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 09 18:26:09.271066 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:26:09.268460    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rfdm9\" (UniqueName: \"kubernetes.io/projected/7a9dd0f3-7cbc-4c47-b47a-14437182de3a-kube-api-access-rfdm9\") pod \"dns-default-g8csp\" (UID: \"7a9dd0f3-7cbc-4c47-b47a-14437182de3a\") " pod="openshift-dns/dns-default-g8csp"
Jul 09 18:26:09.271066 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:26:09.268557    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0bf48160-eb5b-4cb4-abf8-eafde0baca56-cert\") pod \"ingress-canary-6fcpf\" (UID: \"0bf48160-eb5b-4cb4-abf8-eafde0baca56\") " pod="openshift-ingress-canary/ingress-canary-6fcpf"
Jul 09 18:26:09.271066 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:26:09.268617    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7a9dd0f3-7cbc-4c47-b47a-14437182de3a-metrics-tls\") pod \"dns-default-g8csp\" (UID: \"7a9dd0f3-7cbc-4c47-b47a-14437182de3a\") " pod="openshift-dns/dns-default-g8csp"
Jul 09 18:26:09.271066 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:26:09.268704    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bffv9\" (UniqueName: \"kubernetes.io/projected/0bf48160-eb5b-4cb4-abf8-eafde0baca56-kube-api-access-bffv9\") pod \"ingress-canary-6fcpf\" (UID: \"0bf48160-eb5b-4cb4-abf8-eafde0baca56\") " pod="openshift-ingress-canary/ingress-canary-6fcpf"
Jul 09 18:26:09.271066 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:26:09.268743    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/7a9dd0f3-7cbc-4c47-b47a-14437182de3a-config-volume\") pod \"dns-default-g8csp\" (UID: \"7a9dd0f3-7cbc-4c47-b47a-14437182de3a\") " pod="openshift-dns/dns-default-g8csp"
Jul 09 18:26:09.271066 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:26:09.268775    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7a9dd0f3-7cbc-4c47-b47a-14437182de3a-tmp-dir\") pod \"dns-default-g8csp\" (UID: \"7a9dd0f3-7cbc-4c47-b47a-14437182de3a\") " pod="openshift-dns/dns-default-g8csp"
Jul 09 18:26:09.369930 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:26:09.369832    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bffv9\" (UniqueName: \"kubernetes.io/projected/0bf48160-eb5b-4cb4-abf8-eafde0baca56-kube-api-access-bffv9\") pod \"ingress-canary-6fcpf\" (UID: \"0bf48160-eb5b-4cb4-abf8-eafde0baca56\") " pod="openshift-ingress-canary/ingress-canary-6fcpf"
Jul 09 18:26:09.369930 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:26:09.369889    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/7a9dd0f3-7cbc-4c47-b47a-14437182de3a-config-volume\") pod \"dns-default-g8csp\" (UID: \"7a9dd0f3-7cbc-4c47-b47a-14437182de3a\") " pod="openshift-dns/dns-default-g8csp"
Jul 09 18:26:09.369930 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:26:09.369906    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7a9dd0f3-7cbc-4c47-b47a-14437182de3a-tmp-dir\") pod \"dns-default-g8csp\" (UID: \"7a9dd0f3-7cbc-4c47-b47a-14437182de3a\") " pod="openshift-dns/dns-default-g8csp"
Jul 09 18:26:09.369930 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:26:09.369927    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rfdm9\" (UniqueName: \"kubernetes.io/projected/7a9dd0f3-7cbc-4c47-b47a-14437182de3a-kube-api-access-rfdm9\") pod \"dns-default-g8csp\" (UID: \"7a9dd0f3-7cbc-4c47-b47a-14437182de3a\") " pod="openshift-dns/dns-default-g8csp"
Jul 09 18:26:09.370243 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:26:09.370030    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0bf48160-eb5b-4cb4-abf8-eafde0baca56-cert\") pod \"ingress-canary-6fcpf\" (UID: \"0bf48160-eb5b-4cb4-abf8-eafde0baca56\") " pod="openshift-ingress-canary/ingress-canary-6fcpf"
Jul 09 18:26:09.370243 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:26:09.370086    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7a9dd0f3-7cbc-4c47-b47a-14437182de3a-metrics-tls\") pod \"dns-default-g8csp\" (UID: \"7a9dd0f3-7cbc-4c47-b47a-14437182de3a\") " pod="openshift-dns/dns-default-g8csp"
Jul 09 18:26:09.370243 ip-10-0-141-101 kubenswrapper[2557]: E0709 18:26:09.370181    2557 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 09 18:26:09.370243 ip-10-0-141-101 kubenswrapper[2557]: E0709 18:26:09.370234    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7a9dd0f3-7cbc-4c47-b47a-14437182de3a-metrics-tls podName:7a9dd0f3-7cbc-4c47-b47a-14437182de3a nodeName:}" failed. No retries permitted until 2026-07-09 18:26:09.870217665 +0000 UTC m=+39.109562280 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/7a9dd0f3-7cbc-4c47-b47a-14437182de3a-metrics-tls") pod "dns-default-g8csp" (UID: "7a9dd0f3-7cbc-4c47-b47a-14437182de3a") : secret "dns-default-metrics-tls" not found
Jul 09 18:26:09.370431 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:26:09.370330    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7a9dd0f3-7cbc-4c47-b47a-14437182de3a-tmp-dir\") pod \"dns-default-g8csp\" (UID: \"7a9dd0f3-7cbc-4c47-b47a-14437182de3a\") " pod="openshift-dns/dns-default-g8csp"
Jul 09 18:26:09.370583 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:26:09.370563    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/7a9dd0f3-7cbc-4c47-b47a-14437182de3a-config-volume\") pod \"dns-default-g8csp\" (UID: \"7a9dd0f3-7cbc-4c47-b47a-14437182de3a\") " pod="openshift-dns/dns-default-g8csp"
Jul 09 18:26:09.374308 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:26:09.374288    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0bf48160-eb5b-4cb4-abf8-eafde0baca56-cert\") pod \"ingress-canary-6fcpf\" (UID: \"0bf48160-eb5b-4cb4-abf8-eafde0baca56\") " pod="openshift-ingress-canary/ingress-canary-6fcpf"
Jul 09 18:26:09.379068 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:26:09.379048    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rfdm9\" (UniqueName: \"kubernetes.io/projected/7a9dd0f3-7cbc-4c47-b47a-14437182de3a-kube-api-access-rfdm9\") pod \"dns-default-g8csp\" (UID: \"7a9dd0f3-7cbc-4c47-b47a-14437182de3a\") " pod="openshift-dns/dns-default-g8csp"
Jul 09 18:26:09.379427 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:26:09.379409    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bffv9\" (UniqueName: \"kubernetes.io/projected/0bf48160-eb5b-4cb4-abf8-eafde0baca56-kube-api-access-bffv9\") pod \"ingress-canary-6fcpf\" (UID: \"0bf48160-eb5b-4cb4-abf8-eafde0baca56\") " pod="openshift-ingress-canary/ingress-canary-6fcpf"
Jul 09 18:26:09.448002 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:26:09.447975    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-6fcpf"
Jul 09 18:26:09.448648 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:26:09.448621    2557 generic.go:356] "Generic (PLEG): container finished" podID="cb415bf4-3279-48dc-a565-43e470e3508c" containerID="943ed11884368e5b5311d4f37d932be6062e28b83dfbf8fadab7af084ce9dbab" exitCode=0
Jul 09 18:26:09.448761 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:26:09.448674    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-s6ptt" event={"ID":"cb415bf4-3279-48dc-a565-43e470e3508c","Type":"ContainerDied","Data":"943ed11884368e5b5311d4f37d932be6062e28b83dfbf8fadab7af084ce9dbab"}
Jul 09 18:26:09.640689 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:26:09.640520    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-6fcpf"]
Jul 09 18:26:09.643979 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:26:09.643956    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0bf48160_eb5b_4cb4_abf8_eafde0baca56.slice/crio-1393e95803272d2a0cdda1b8ae188777582c041a327a96179e0fa8bfb7cae5a8 WatchSource:0}: Error finding container 1393e95803272d2a0cdda1b8ae188777582c041a327a96179e0fa8bfb7cae5a8: Status 404 returned error can't find the container with id 1393e95803272d2a0cdda1b8ae188777582c041a327a96179e0fa8bfb7cae5a8
Jul 09 18:26:09.873840 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:26:09.873796    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7a9dd0f3-7cbc-4c47-b47a-14437182de3a-metrics-tls\") pod \"dns-default-g8csp\" (UID: \"7a9dd0f3-7cbc-4c47-b47a-14437182de3a\") " pod="openshift-dns/dns-default-g8csp"
Jul 09 18:26:09.874009 ip-10-0-141-101 kubenswrapper[2557]: E0709 18:26:09.873943    2557 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 09 18:26:09.874009 ip-10-0-141-101 kubenswrapper[2557]: E0709 18:26:09.874007    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7a9dd0f3-7cbc-4c47-b47a-14437182de3a-metrics-tls podName:7a9dd0f3-7cbc-4c47-b47a-14437182de3a nodeName:}" failed. No retries permitted until 2026-07-09 18:26:10.873990915 +0000 UTC m=+40.113335519 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/7a9dd0f3-7cbc-4c47-b47a-14437182de3a-metrics-tls") pod "dns-default-g8csp" (UID: "7a9dd0f3-7cbc-4c47-b47a-14437182de3a") : secret "dns-default-metrics-tls" not found
Jul 09 18:26:10.256215 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:26:10.256175    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9f9j6"
Jul 09 18:26:10.259219 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:26:10.259183    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 09 18:26:10.453167 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:26:10.453127    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-6fcpf" event={"ID":"0bf48160-eb5b-4cb4-abf8-eafde0baca56","Type":"ContainerStarted","Data":"1393e95803272d2a0cdda1b8ae188777582c041a327a96179e0fa8bfb7cae5a8"}
Jul 09 18:26:10.456787 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:26:10.456761    2557 generic.go:356] "Generic (PLEG): container finished" podID="cb415bf4-3279-48dc-a565-43e470e3508c" containerID="a9cdc988bd4a3cf7006fff01535fd3dd6e177419e4186e3e2608c85f0824ef2b" exitCode=0
Jul 09 18:26:10.456924 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:26:10.456808    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-s6ptt" event={"ID":"cb415bf4-3279-48dc-a565-43e470e3508c","Type":"ContainerDied","Data":"a9cdc988bd4a3cf7006fff01535fd3dd6e177419e4186e3e2608c85f0824ef2b"}
Jul 09 18:26:10.881782 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:26:10.881745    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7a9dd0f3-7cbc-4c47-b47a-14437182de3a-metrics-tls\") pod \"dns-default-g8csp\" (UID: \"7a9dd0f3-7cbc-4c47-b47a-14437182de3a\") " pod="openshift-dns/dns-default-g8csp"
Jul 09 18:26:10.881987 ip-10-0-141-101 kubenswrapper[2557]: E0709 18:26:10.881906    2557 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 09 18:26:10.881987 ip-10-0-141-101 kubenswrapper[2557]: E0709 18:26:10.881978    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7a9dd0f3-7cbc-4c47-b47a-14437182de3a-metrics-tls podName:7a9dd0f3-7cbc-4c47-b47a-14437182de3a nodeName:}" failed. No retries permitted until 2026-07-09 18:26:12.881958655 +0000 UTC m=+42.121303261 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/7a9dd0f3-7cbc-4c47-b47a-14437182de3a-metrics-tls") pod "dns-default-g8csp" (UID: "7a9dd0f3-7cbc-4c47-b47a-14437182de3a") : secret "dns-default-metrics-tls" not found
Jul 09 18:26:11.463274 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:26:11.463230    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-s6ptt" event={"ID":"cb415bf4-3279-48dc-a565-43e470e3508c","Type":"ContainerStarted","Data":"353ded982b54d891c6e5762fd03da46dabd26919a4c2fee3fc050e72da767acb"}
Jul 09 18:26:11.494652 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:26:11.494599    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-s6ptt" podStartSLOduration=9.075839703 podStartE2EDuration="40.49458168s" totalImagesPullingTime="31.418741977s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 18:25:31 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 18:26:11.494539584 +0000 UTC m=+40.733884210" watchObservedRunningTime="2026-07-09 18:26:11.49458168 +0000 UTC m=+40.733926307"
Jul 09 18:26:12.761450 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:26:12.761264    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-286zp"]
Jul 09 18:26:12.778667 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:26:12.778643    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-286zp"
Jul 09 18:26:12.783504 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:26:12.783465    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\""
Jul 09 18:26:12.783671 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:26:12.783644    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\""
Jul 09 18:26:12.784627 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:26:12.784607    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-sj6c8\""
Jul 09 18:26:12.797533 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:26:12.797412    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-286zp"]
Jul 09 18:26:12.896936 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:26:12.896899    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7a9dd0f3-7cbc-4c47-b47a-14437182de3a-metrics-tls\") pod \"dns-default-g8csp\" (UID: \"7a9dd0f3-7cbc-4c47-b47a-14437182de3a\") " pod="openshift-dns/dns-default-g8csp"
Jul 09 18:26:12.897103 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:26:12.896996    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ct47w\" (UniqueName: \"kubernetes.io/projected/4f171f20-0b3b-4ef7-a679-b3e58fa4d7cc-kube-api-access-ct47w\") pod \"volume-data-source-validator-78495597f6-286zp\" (UID: \"4f171f20-0b3b-4ef7-a679-b3e58fa4d7cc\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-286zp"
Jul 09 18:26:12.897103 ip-10-0-141-101 kubenswrapper[2557]: E0709 18:26:12.897055    2557 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 09 18:26:12.897170 ip-10-0-141-101 kubenswrapper[2557]: E0709 18:26:12.897122    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7a9dd0f3-7cbc-4c47-b47a-14437182de3a-metrics-tls podName:7a9dd0f3-7cbc-4c47-b47a-14437182de3a nodeName:}" failed. No retries permitted until 2026-07-09 18:26:16.897102272 +0000 UTC m=+46.136446877 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/7a9dd0f3-7cbc-4c47-b47a-14437182de3a-metrics-tls") pod "dns-default-g8csp" (UID: "7a9dd0f3-7cbc-4c47-b47a-14437182de3a") : secret "dns-default-metrics-tls" not found
Jul 09 18:26:12.998330 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:26:12.998289    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ct47w\" (UniqueName: \"kubernetes.io/projected/4f171f20-0b3b-4ef7-a679-b3e58fa4d7cc-kube-api-access-ct47w\") pod \"volume-data-source-validator-78495597f6-286zp\" (UID: \"4f171f20-0b3b-4ef7-a679-b3e58fa4d7cc\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-286zp"
Jul 09 18:26:13.016268 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:26:13.016237    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-kqj92"]
Jul 09 18:26:13.025351 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:26:13.025318    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ct47w\" (UniqueName: \"kubernetes.io/projected/4f171f20-0b3b-4ef7-a679-b3e58fa4d7cc-kube-api-access-ct47w\") pod \"volume-data-source-validator-78495597f6-286zp\" (UID: \"4f171f20-0b3b-4ef7-a679-b3e58fa4d7cc\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-286zp"
Jul 09 18:26:13.034385 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:26:13.034361    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-588b5c546d-7ssb9"]
Jul 09 18:26:13.034551 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:26:13.034531    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-kqj92"
Jul 09 18:26:13.039035 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:26:13.039011    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\""
Jul 09 18:26:13.039035 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:26:13.039033    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-h95bw\""
Jul 09 18:26:13.040116 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:26:13.040101    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\""
Jul 09 18:26:13.040216 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:26:13.040193    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\""
Jul 09 18:26:13.041249 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:26:13.041225    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\""
Jul 09 18:26:13.056456 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:26:13.056381    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-kqj92"]
Jul 09 18:26:13.056456 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:26:13.056414    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-588b5c546d-7ssb9"]
Jul 09 18:26:13.056623 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:26:13.056514    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-588b5c546d-7ssb9"
Jul 09 18:26:13.058812 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:26:13.058792    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-lxd8z\""
Jul 09 18:26:13.059311 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:26:13.059291    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Jul 09 18:26:13.059428 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:26:13.059295    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Jul 09 18:26:13.059428 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:26:13.059295    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Jul 09 18:26:13.063909 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:26:13.063883    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Jul 09 18:26:13.087311 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:26:13.087283    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-286zp"
Jul 09 18:26:13.200803 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:26:13.200771    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/cb5fba7f-844d-4dc3-9f9d-f77fe9d18eda-image-registry-private-configuration\") pod \"image-registry-588b5c546d-7ssb9\" (UID: \"cb5fba7f-844d-4dc3-9f9d-f77fe9d18eda\") " pod="openshift-image-registry/image-registry-588b5c546d-7ssb9"
Jul 09 18:26:13.200973 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:26:13.200819    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/cb5fba7f-844d-4dc3-9f9d-f77fe9d18eda-registry-tls\") pod \"image-registry-588b5c546d-7ssb9\" (UID: \"cb5fba7f-844d-4dc3-9f9d-f77fe9d18eda\") " pod="openshift-image-registry/image-registry-588b5c546d-7ssb9"
Jul 09 18:26:13.200973 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:26:13.200839    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/cb5fba7f-844d-4dc3-9f9d-f77fe9d18eda-installation-pull-secrets\") pod \"image-registry-588b5c546d-7ssb9\" (UID: \"cb5fba7f-844d-4dc3-9f9d-f77fe9d18eda\") " pod="openshift-image-registry/image-registry-588b5c546d-7ssb9"
Jul 09 18:26:13.200973 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:26:13.200958    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/d5871ae2-0cbd-4038-8269-6343110b7b56-config\") pod \"kube-storage-version-migrator-operator-799cb7f958-kqj92\" (UID: \"d5871ae2-0cbd-4038-8269-6343110b7b56\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-kqj92"
Jul 09 18:26:13.201183 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:26:13.200997    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-98bbr\" (UniqueName: \"kubernetes.io/projected/d5871ae2-0cbd-4038-8269-6343110b7b56-kube-api-access-98bbr\") pod \"kube-storage-version-migrator-operator-799cb7f958-kqj92\" (UID: \"d5871ae2-0cbd-4038-8269-6343110b7b56\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-kqj92"
Jul 09 18:26:13.201183 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:26:13.201015    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/cb5fba7f-844d-4dc3-9f9d-f77fe9d18eda-registry-certificates\") pod \"image-registry-588b5c546d-7ssb9\" (UID: \"cb5fba7f-844d-4dc3-9f9d-f77fe9d18eda\") " pod="openshift-image-registry/image-registry-588b5c546d-7ssb9"
Jul 09 18:26:13.201183 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:26:13.201109    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/d5871ae2-0cbd-4038-8269-6343110b7b56-serving-cert\") pod \"kube-storage-version-migrator-operator-799cb7f958-kqj92\" (UID: \"d5871ae2-0cbd-4038-8269-6343110b7b56\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-kqj92"
Jul 09 18:26:13.201183 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:26:13.201135    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/cb5fba7f-844d-4dc3-9f9d-f77fe9d18eda-ca-trust-extracted\") pod \"image-registry-588b5c546d-7ssb9\" (UID: \"cb5fba7f-844d-4dc3-9f9d-f77fe9d18eda\") " pod="openshift-image-registry/image-registry-588b5c546d-7ssb9"
Jul 09 18:26:13.201183 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:26:13.201152    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/cb5fba7f-844d-4dc3-9f9d-f77fe9d18eda-trusted-ca\") pod \"image-registry-588b5c546d-7ssb9\" (UID: \"cb5fba7f-844d-4dc3-9f9d-f77fe9d18eda\") " pod="openshift-image-registry/image-registry-588b5c546d-7ssb9"
Jul 09 18:26:13.201183 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:26:13.201169    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/cb5fba7f-844d-4dc3-9f9d-f77fe9d18eda-bound-sa-token\") pod \"image-registry-588b5c546d-7ssb9\" (UID: \"cb5fba7f-844d-4dc3-9f9d-f77fe9d18eda\") " pod="openshift-image-registry/image-registry-588b5c546d-7ssb9"
Jul 09 18:26:13.201450 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:26:13.201226    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fs7rw\" (UniqueName: \"kubernetes.io/projected/cb5fba7f-844d-4dc3-9f9d-f77fe9d18eda-kube-api-access-fs7rw\") pod \"image-registry-588b5c546d-7ssb9\" (UID: \"cb5fba7f-844d-4dc3-9f9d-f77fe9d18eda\") " pod="openshift-image-registry/image-registry-588b5c546d-7ssb9"
Jul 09 18:26:13.228494 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:26:13.228445    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-286zp"]
Jul 09 18:26:13.240965 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:26:13.240934    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4f171f20_0b3b_4ef7_a679_b3e58fa4d7cc.slice/crio-5d7607376e1521131dd8c6d4bd8cf4a0828dc73f38d24688c6c176eb1d4558af WatchSource:0}: Error finding container 5d7607376e1521131dd8c6d4bd8cf4a0828dc73f38d24688c6c176eb1d4558af: Status 404 returned error can't find the container with id 5d7607376e1521131dd8c6d4bd8cf4a0828dc73f38d24688c6c176eb1d4558af
Jul 09 18:26:13.301766 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:26:13.301728    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/cb5fba7f-844d-4dc3-9f9d-f77fe9d18eda-registry-certificates\") pod \"image-registry-588b5c546d-7ssb9\" (UID: \"cb5fba7f-844d-4dc3-9f9d-f77fe9d18eda\") " pod="openshift-image-registry/image-registry-588b5c546d-7ssb9"
Jul 09 18:26:13.301951 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:26:13.301787    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/d5871ae2-0cbd-4038-8269-6343110b7b56-serving-cert\") pod \"kube-storage-version-migrator-operator-799cb7f958-kqj92\" (UID: \"d5871ae2-0cbd-4038-8269-6343110b7b56\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-kqj92"
Jul 09 18:26:13.301951 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:26:13.301804    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/cb5fba7f-844d-4dc3-9f9d-f77fe9d18eda-ca-trust-extracted\") pod \"image-registry-588b5c546d-7ssb9\" (UID: \"cb5fba7f-844d-4dc3-9f9d-f77fe9d18eda\") " pod="openshift-image-registry/image-registry-588b5c546d-7ssb9"
Jul 09 18:26:13.301951 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:26:13.301823    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/cb5fba7f-844d-4dc3-9f9d-f77fe9d18eda-trusted-ca\") pod \"image-registry-588b5c546d-7ssb9\" (UID: \"cb5fba7f-844d-4dc3-9f9d-f77fe9d18eda\") " pod="openshift-image-registry/image-registry-588b5c546d-7ssb9"
Jul 09 18:26:13.301951 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:26:13.301841    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/cb5fba7f-844d-4dc3-9f9d-f77fe9d18eda-bound-sa-token\") pod \"image-registry-588b5c546d-7ssb9\" (UID: \"cb5fba7f-844d-4dc3-9f9d-f77fe9d18eda\") " pod="openshift-image-registry/image-registry-588b5c546d-7ssb9"
Jul 09 18:26:13.301951 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:26:13.301863    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fs7rw\" (UniqueName: \"kubernetes.io/projected/cb5fba7f-844d-4dc3-9f9d-f77fe9d18eda-kube-api-access-fs7rw\") pod \"image-registry-588b5c546d-7ssb9\" (UID: \"cb5fba7f-844d-4dc3-9f9d-f77fe9d18eda\") " pod="openshift-image-registry/image-registry-588b5c546d-7ssb9"
Jul 09 18:26:13.301951 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:26:13.301889    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/cb5fba7f-844d-4dc3-9f9d-f77fe9d18eda-image-registry-private-configuration\") pod \"image-registry-588b5c546d-7ssb9\" (UID: \"cb5fba7f-844d-4dc3-9f9d-f77fe9d18eda\") " pod="openshift-image-registry/image-registry-588b5c546d-7ssb9"
Jul 09 18:26:13.301951 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:26:13.301927    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/cb5fba7f-844d-4dc3-9f9d-f77fe9d18eda-registry-tls\") pod \"image-registry-588b5c546d-7ssb9\" (UID: \"cb5fba7f-844d-4dc3-9f9d-f77fe9d18eda\") " pod="openshift-image-registry/image-registry-588b5c546d-7ssb9"
Jul 09 18:26:13.302267 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:26:13.301955    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/cb5fba7f-844d-4dc3-9f9d-f77fe9d18eda-installation-pull-secrets\") pod \"image-registry-588b5c546d-7ssb9\" (UID: \"cb5fba7f-844d-4dc3-9f9d-f77fe9d18eda\") " pod="openshift-image-registry/image-registry-588b5c546d-7ssb9"
Jul 09 18:26:13.302267 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:26:13.302023    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/d5871ae2-0cbd-4038-8269-6343110b7b56-config\") pod \"kube-storage-version-migrator-operator-799cb7f958-kqj92\" (UID: \"d5871ae2-0cbd-4038-8269-6343110b7b56\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-kqj92"
Jul 09 18:26:13.302267 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:26:13.302064    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-98bbr\" (UniqueName: \"kubernetes.io/projected/d5871ae2-0cbd-4038-8269-6343110b7b56-kube-api-access-98bbr\") pod \"kube-storage-version-migrator-operator-799cb7f958-kqj92\" (UID: \"d5871ae2-0cbd-4038-8269-6343110b7b56\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-kqj92"
Jul 09 18:26:13.302447 ip-10-0-141-101 kubenswrapper[2557]: E0709 18:26:13.302427    2557 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 09 18:26:13.302539 ip-10-0-141-101 kubenswrapper[2557]: E0709 18:26:13.302450    2557 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-588b5c546d-7ssb9: secret "image-registry-tls" not found
Jul 09 18:26:13.302539 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:26:13.302522    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/cb5fba7f-844d-4dc3-9f9d-f77fe9d18eda-ca-trust-extracted\") pod \"image-registry-588b5c546d-7ssb9\" (UID: \"cb5fba7f-844d-4dc3-9f9d-f77fe9d18eda\") " pod="openshift-image-registry/image-registry-588b5c546d-7ssb9"
Jul 09 18:26:13.302646 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:26:13.302538    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/cb5fba7f-844d-4dc3-9f9d-f77fe9d18eda-registry-certificates\") pod \"image-registry-588b5c546d-7ssb9\" (UID: \"cb5fba7f-844d-4dc3-9f9d-f77fe9d18eda\") " pod="openshift-image-registry/image-registry-588b5c546d-7ssb9"
Jul 09 18:26:13.302646 ip-10-0-141-101 kubenswrapper[2557]: E0709 18:26:13.302547    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/cb5fba7f-844d-4dc3-9f9d-f77fe9d18eda-registry-tls podName:cb5fba7f-844d-4dc3-9f9d-f77fe9d18eda nodeName:}" failed. No retries permitted until 2026-07-09 18:26:13.802525124 +0000 UTC m=+43.041869742 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/cb5fba7f-844d-4dc3-9f9d-f77fe9d18eda-registry-tls") pod "image-registry-588b5c546d-7ssb9" (UID: "cb5fba7f-844d-4dc3-9f9d-f77fe9d18eda") : secret "image-registry-tls" not found
Jul 09 18:26:13.302812 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:26:13.302766    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/d5871ae2-0cbd-4038-8269-6343110b7b56-config\") pod \"kube-storage-version-migrator-operator-799cb7f958-kqj92\" (UID: \"d5871ae2-0cbd-4038-8269-6343110b7b56\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-kqj92"
Jul 09 18:26:13.303211 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:26:13.303181    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/cb5fba7f-844d-4dc3-9f9d-f77fe9d18eda-trusted-ca\") pod \"image-registry-588b5c546d-7ssb9\" (UID: \"cb5fba7f-844d-4dc3-9f9d-f77fe9d18eda\") " pod="openshift-image-registry/image-registry-588b5c546d-7ssb9"
Jul 09 18:26:13.304777 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:26:13.304608    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/d5871ae2-0cbd-4038-8269-6343110b7b56-serving-cert\") pod \"kube-storage-version-migrator-operator-799cb7f958-kqj92\" (UID: \"d5871ae2-0cbd-4038-8269-6343110b7b56\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-kqj92"
Jul 09 18:26:13.304854 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:26:13.304716    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/cb5fba7f-844d-4dc3-9f9d-f77fe9d18eda-image-registry-private-configuration\") pod \"image-registry-588b5c546d-7ssb9\" (UID: \"cb5fba7f-844d-4dc3-9f9d-f77fe9d18eda\") " pod="openshift-image-registry/image-registry-588b5c546d-7ssb9"
Jul 09 18:26:13.310639 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:26:13.310577    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/cb5fba7f-844d-4dc3-9f9d-f77fe9d18eda-installation-pull-secrets\") pod \"image-registry-588b5c546d-7ssb9\" (UID: \"cb5fba7f-844d-4dc3-9f9d-f77fe9d18eda\") " pod="openshift-image-registry/image-registry-588b5c546d-7ssb9"
Jul 09 18:26:13.311822 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:26:13.311803    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-98bbr\" (UniqueName: \"kubernetes.io/projected/d5871ae2-0cbd-4038-8269-6343110b7b56-kube-api-access-98bbr\") pod \"kube-storage-version-migrator-operator-799cb7f958-kqj92\" (UID: \"d5871ae2-0cbd-4038-8269-6343110b7b56\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-kqj92"
Jul 09 18:26:13.315571 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:26:13.315547    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fs7rw\" (UniqueName: \"kubernetes.io/projected/cb5fba7f-844d-4dc3-9f9d-f77fe9d18eda-kube-api-access-fs7rw\") pod \"image-registry-588b5c546d-7ssb9\" (UID: \"cb5fba7f-844d-4dc3-9f9d-f77fe9d18eda\") " pod="openshift-image-registry/image-registry-588b5c546d-7ssb9"
Jul 09 18:26:13.322571 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:26:13.322547    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/cb5fba7f-844d-4dc3-9f9d-f77fe9d18eda-bound-sa-token\") pod \"image-registry-588b5c546d-7ssb9\" (UID: \"cb5fba7f-844d-4dc3-9f9d-f77fe9d18eda\") " pod="openshift-image-registry/image-registry-588b5c546d-7ssb9"
Jul 09 18:26:13.344522 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:26:13.344470    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-kqj92"
Jul 09 18:26:13.471190 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:26:13.471154    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-6fcpf" event={"ID":"0bf48160-eb5b-4cb4-abf8-eafde0baca56","Type":"ContainerStarted","Data":"b34b1c28b1fa35284b79255fa852f14ecc95d12d4e89b2763119199fe2852249"}
Jul 09 18:26:13.472226 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:26:13.472200    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-286zp" event={"ID":"4f171f20-0b3b-4ef7-a679-b3e58fa4d7cc","Type":"ContainerStarted","Data":"5d7607376e1521131dd8c6d4bd8cf4a0828dc73f38d24688c6c176eb1d4558af"}
Jul 09 18:26:13.488871 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:26:13.488846    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-kqj92"]
Jul 09 18:26:13.492652 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:26:13.492621    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd5871ae2_0cbd_4038_8269_6343110b7b56.slice/crio-d3598525e3132a636b97ed3d93a910a57c4021dac6a2141cd097eaa91cde7617 WatchSource:0}: Error finding container d3598525e3132a636b97ed3d93a910a57c4021dac6a2141cd097eaa91cde7617: Status 404 returned error can't find the container with id d3598525e3132a636b97ed3d93a910a57c4021dac6a2141cd097eaa91cde7617
Jul 09 18:26:13.497276 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:26:13.497234    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-6fcpf" podStartSLOduration=1.595874713 podStartE2EDuration="4.497220339s" totalImagesPullingTime="2.901345626s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 18:26:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 18:26:13.495670499 +0000 UTC m=+42.735015175" watchObservedRunningTime="2026-07-09 18:26:13.497220339 +0000 UTC m=+42.736564965"
Jul 09 18:26:13.806782 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:26:13.806749    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/cb5fba7f-844d-4dc3-9f9d-f77fe9d18eda-registry-tls\") pod \"image-registry-588b5c546d-7ssb9\" (UID: \"cb5fba7f-844d-4dc3-9f9d-f77fe9d18eda\") " pod="openshift-image-registry/image-registry-588b5c546d-7ssb9"
Jul 09 18:26:13.807445 ip-10-0-141-101 kubenswrapper[2557]: E0709 18:26:13.806860    2557 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 09 18:26:13.807445 ip-10-0-141-101 kubenswrapper[2557]: E0709 18:26:13.806873    2557 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-588b5c546d-7ssb9: secret "image-registry-tls" not found
Jul 09 18:26:13.807445 ip-10-0-141-101 kubenswrapper[2557]: E0709 18:26:13.806925    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/cb5fba7f-844d-4dc3-9f9d-f77fe9d18eda-registry-tls podName:cb5fba7f-844d-4dc3-9f9d-f77fe9d18eda nodeName:}" failed. No retries permitted until 2026-07-09 18:26:14.806910058 +0000 UTC m=+44.046254661 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/cb5fba7f-844d-4dc3-9f9d-f77fe9d18eda-registry-tls") pod "image-registry-588b5c546d-7ssb9" (UID: "cb5fba7f-844d-4dc3-9f9d-f77fe9d18eda") : secret "image-registry-tls" not found
Jul 09 18:26:14.476288 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:26:14.476249    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-kqj92" event={"ID":"d5871ae2-0cbd-4038-8269-6343110b7b56","Type":"ContainerStarted","Data":"d3598525e3132a636b97ed3d93a910a57c4021dac6a2141cd097eaa91cde7617"}
Jul 09 18:26:14.813846 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:26:14.813813    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/cb5fba7f-844d-4dc3-9f9d-f77fe9d18eda-registry-tls\") pod \"image-registry-588b5c546d-7ssb9\" (UID: \"cb5fba7f-844d-4dc3-9f9d-f77fe9d18eda\") " pod="openshift-image-registry/image-registry-588b5c546d-7ssb9"
Jul 09 18:26:14.814233 ip-10-0-141-101 kubenswrapper[2557]: E0709 18:26:14.813964    2557 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 09 18:26:14.814233 ip-10-0-141-101 kubenswrapper[2557]: E0709 18:26:14.813983    2557 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-588b5c546d-7ssb9: secret "image-registry-tls" not found
Jul 09 18:26:14.814233 ip-10-0-141-101 kubenswrapper[2557]: E0709 18:26:14.814039    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/cb5fba7f-844d-4dc3-9f9d-f77fe9d18eda-registry-tls podName:cb5fba7f-844d-4dc3-9f9d-f77fe9d18eda nodeName:}" failed. No retries permitted until 2026-07-09 18:26:16.81402416 +0000 UTC m=+46.053368769 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/cb5fba7f-844d-4dc3-9f9d-f77fe9d18eda-registry-tls") pod "image-registry-588b5c546d-7ssb9" (UID: "cb5fba7f-844d-4dc3-9f9d-f77fe9d18eda") : secret "image-registry-tls" not found
Jul 09 18:26:15.479901 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:26:15.479820    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-286zp" event={"ID":"4f171f20-0b3b-4ef7-a679-b3e58fa4d7cc","Type":"ContainerStarted","Data":"cf17caf98f49cb4eb7aa6f04d1a656e52118e4008da47be55bb32c004bee4b43"}
Jul 09 18:26:15.502275 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:26:15.502229    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-286zp" podStartSLOduration=1.678647344 podStartE2EDuration="3.502213215s" totalImagesPullingTime="1.823565871s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 18:26:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 18:26:15.501473026 +0000 UTC m=+44.740817653" watchObservedRunningTime="2026-07-09 18:26:15.502213215 +0000 UTC m=+44.741557818"
Jul 09 18:26:16.829880 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:26:16.829849    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/cb5fba7f-844d-4dc3-9f9d-f77fe9d18eda-registry-tls\") pod \"image-registry-588b5c546d-7ssb9\" (UID: \"cb5fba7f-844d-4dc3-9f9d-f77fe9d18eda\") " pod="openshift-image-registry/image-registry-588b5c546d-7ssb9"
Jul 09 18:26:16.830230 ip-10-0-141-101 kubenswrapper[2557]: E0709 18:26:16.829974    2557 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 09 18:26:16.830230 ip-10-0-141-101 kubenswrapper[2557]: E0709 18:26:16.829987    2557 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-588b5c546d-7ssb9: secret "image-registry-tls" not found
Jul 09 18:26:16.830230 ip-10-0-141-101 kubenswrapper[2557]: E0709 18:26:16.830045    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/cb5fba7f-844d-4dc3-9f9d-f77fe9d18eda-registry-tls podName:cb5fba7f-844d-4dc3-9f9d-f77fe9d18eda nodeName:}" failed. No retries permitted until 2026-07-09 18:26:20.83002703 +0000 UTC m=+50.069371656 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/cb5fba7f-844d-4dc3-9f9d-f77fe9d18eda-registry-tls") pod "image-registry-588b5c546d-7ssb9" (UID: "cb5fba7f-844d-4dc3-9f9d-f77fe9d18eda") : secret "image-registry-tls" not found
Jul 09 18:26:16.930384 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:26:16.930345    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7a9dd0f3-7cbc-4c47-b47a-14437182de3a-metrics-tls\") pod \"dns-default-g8csp\" (UID: \"7a9dd0f3-7cbc-4c47-b47a-14437182de3a\") " pod="openshift-dns/dns-default-g8csp"
Jul 09 18:26:16.930601 ip-10-0-141-101 kubenswrapper[2557]: E0709 18:26:16.930474    2557 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 09 18:26:16.930601 ip-10-0-141-101 kubenswrapper[2557]: E0709 18:26:16.930552    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7a9dd0f3-7cbc-4c47-b47a-14437182de3a-metrics-tls podName:7a9dd0f3-7cbc-4c47-b47a-14437182de3a nodeName:}" failed. No retries permitted until 2026-07-09 18:26:24.930538755 +0000 UTC m=+54.169883359 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/7a9dd0f3-7cbc-4c47-b47a-14437182de3a-metrics-tls") pod "dns-default-g8csp" (UID: "7a9dd0f3-7cbc-4c47-b47a-14437182de3a") : secret "dns-default-metrics-tls" not found
Jul 09 18:26:17.486395 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:26:17.486196    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-kqj92" event={"ID":"d5871ae2-0cbd-4038-8269-6343110b7b56","Type":"ContainerStarted","Data":"72140fa0877e3c4801e289862686c10c13e676cc967d90ec0a972472703e8cbe"}
Jul 09 18:26:17.508238 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:26:17.508181    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-kqj92" podStartSLOduration=2.219653732 podStartE2EDuration="5.508162815s" totalImagesPullingTime="3.288509083s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 18:26:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 18:26:17.507918342 +0000 UTC m=+46.747262970" watchObservedRunningTime="2026-07-09 18:26:17.508162815 +0000 UTC m=+46.747507442"
Jul 09 18:26:18.061878 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:26:18.061843    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-7f59b54f6c-gqqk7"]
Jul 09 18:26:18.077240 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:26:18.077210    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-7f59b54f6c-gqqk7"]
Jul 09 18:26:18.077426 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:26:18.077327    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-gqqk7"
Jul 09 18:26:18.079867 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:26:18.079841    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\""
Jul 09 18:26:18.080001 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:26:18.079933    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-4c96l\""
Jul 09 18:26:18.080751 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:26:18.080731    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\""
Jul 09 18:26:18.240951 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:26:18.240900    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fbl9h\" (UniqueName: \"kubernetes.io/projected/6ceea004-b5ab-456b-b34a-476a78286530-kube-api-access-fbl9h\") pod \"migrator-7f59b54f6c-gqqk7\" (UID: \"6ceea004-b5ab-456b-b34a-476a78286530\") " pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-gqqk7"
Jul 09 18:26:18.341744 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:26:18.341659    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fbl9h\" (UniqueName: \"kubernetes.io/projected/6ceea004-b5ab-456b-b34a-476a78286530-kube-api-access-fbl9h\") pod \"migrator-7f59b54f6c-gqqk7\" (UID: \"6ceea004-b5ab-456b-b34a-476a78286530\") " pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-gqqk7"
Jul 09 18:26:18.352196 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:26:18.352163    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fbl9h\" (UniqueName: \"kubernetes.io/projected/6ceea004-b5ab-456b-b34a-476a78286530-kube-api-access-fbl9h\") pod \"migrator-7f59b54f6c-gqqk7\" (UID: \"6ceea004-b5ab-456b-b34a-476a78286530\") " pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-gqqk7"
Jul 09 18:26:18.387187 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:26:18.387134    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-gqqk7"
Jul 09 18:26:18.538694 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:26:18.538662    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-7f59b54f6c-gqqk7"]
Jul 09 18:26:18.541824 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:26:18.541798    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6ceea004_b5ab_456b_b34a_476a78286530.slice/crio-4ce738bbb1d34049966d65fd8c54ca08871521d37984ae9b9ca8b382e2377f2d WatchSource:0}: Error finding container 4ce738bbb1d34049966d65fd8c54ca08871521d37984ae9b9ca8b382e2377f2d: Status 404 returned error can't find the container with id 4ce738bbb1d34049966d65fd8c54ca08871521d37984ae9b9ca8b382e2377f2d
Jul 09 18:26:19.077274 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:26:19.077237    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-lwdkv"]
Jul 09 18:26:19.102609 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:26:19.102578    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-lwdkv"]
Jul 09 18:26:19.102769 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:26:19.102686    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-lwdkv"
Jul 09 18:26:19.105061 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:26:19.105034    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 09 18:26:19.105320 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:26:19.105305    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 09 18:26:19.105420 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:26:19.105324    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-tvx4s\""
Jul 09 18:26:19.105972 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:26:19.105953    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 09 18:26:19.106176 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:26:19.106162    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 09 18:26:19.249606 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:26:19.249567    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/d3f42221-8165-4208-aeb4-9a42c7769d2b-crio-socket\") pod \"insights-runtime-extractor-lwdkv\" (UID: \"d3f42221-8165-4208-aeb4-9a42c7769d2b\") " pod="openshift-insights/insights-runtime-extractor-lwdkv"
Jul 09 18:26:19.249868 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:26:19.249626    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/d3f42221-8165-4208-aeb4-9a42c7769d2b-data-volume\") pod \"insights-runtime-extractor-lwdkv\" (UID: \"d3f42221-8165-4208-aeb4-9a42c7769d2b\") " pod="openshift-insights/insights-runtime-extractor-lwdkv"
Jul 09 18:26:19.249868 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:26:19.249655    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/d3f42221-8165-4208-aeb4-9a42c7769d2b-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-lwdkv\" (UID: \"d3f42221-8165-4208-aeb4-9a42c7769d2b\") " pod="openshift-insights/insights-runtime-extractor-lwdkv"
Jul 09 18:26:19.249868 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:26:19.249681    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-smkb5\" (UniqueName: \"kubernetes.io/projected/d3f42221-8165-4208-aeb4-9a42c7769d2b-kube-api-access-smkb5\") pod \"insights-runtime-extractor-lwdkv\" (UID: \"d3f42221-8165-4208-aeb4-9a42c7769d2b\") " pod="openshift-insights/insights-runtime-extractor-lwdkv"
Jul 09 18:26:19.249868 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:26:19.249794    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/d3f42221-8165-4208-aeb4-9a42c7769d2b-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-lwdkv\" (UID: \"d3f42221-8165-4208-aeb4-9a42c7769d2b\") " pod="openshift-insights/insights-runtime-extractor-lwdkv"
Jul 09 18:26:19.351213 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:26:19.351119    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/d3f42221-8165-4208-aeb4-9a42c7769d2b-crio-socket\") pod \"insights-runtime-extractor-lwdkv\" (UID: \"d3f42221-8165-4208-aeb4-9a42c7769d2b\") " pod="openshift-insights/insights-runtime-extractor-lwdkv"
Jul 09 18:26:19.351213 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:26:19.351182    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/d3f42221-8165-4208-aeb4-9a42c7769d2b-data-volume\") pod \"insights-runtime-extractor-lwdkv\" (UID: \"d3f42221-8165-4208-aeb4-9a42c7769d2b\") " pod="openshift-insights/insights-runtime-extractor-lwdkv"
Jul 09 18:26:19.351213 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:26:19.351201    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/d3f42221-8165-4208-aeb4-9a42c7769d2b-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-lwdkv\" (UID: \"d3f42221-8165-4208-aeb4-9a42c7769d2b\") " pod="openshift-insights/insights-runtime-extractor-lwdkv"
Jul 09 18:26:19.351213 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:26:19.351217    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-smkb5\" (UniqueName: \"kubernetes.io/projected/d3f42221-8165-4208-aeb4-9a42c7769d2b-kube-api-access-smkb5\") pod \"insights-runtime-extractor-lwdkv\" (UID: \"d3f42221-8165-4208-aeb4-9a42c7769d2b\") " pod="openshift-insights/insights-runtime-extractor-lwdkv"
Jul 09 18:26:19.351564 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:26:19.351266    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/d3f42221-8165-4208-aeb4-9a42c7769d2b-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-lwdkv\" (UID: \"d3f42221-8165-4208-aeb4-9a42c7769d2b\") " pod="openshift-insights/insights-runtime-extractor-lwdkv"
Jul 09 18:26:19.351564 ip-10-0-141-101 kubenswrapper[2557]: E0709 18:26:19.351364    2557 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 09 18:26:19.351564 ip-10-0-141-101 kubenswrapper[2557]: E0709 18:26:19.351375    2557 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 09 18:26:19.351564 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:26:19.351408    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/d3f42221-8165-4208-aeb4-9a42c7769d2b-crio-socket\") pod \"insights-runtime-extractor-lwdkv\" (UID: \"d3f42221-8165-4208-aeb4-9a42c7769d2b\") " pod="openshift-insights/insights-runtime-extractor-lwdkv"
Jul 09 18:26:19.351564 ip-10-0-141-101 kubenswrapper[2557]: E0709 18:26:19.351424    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/d3f42221-8165-4208-aeb4-9a42c7769d2b-kube-rbac-proxy-cm podName:d3f42221-8165-4208-aeb4-9a42c7769d2b nodeName:}" failed. No retries permitted until 2026-07-09 18:26:19.851410559 +0000 UTC m=+49.090755164 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/d3f42221-8165-4208-aeb4-9a42c7769d2b-kube-rbac-proxy-cm") pod "insights-runtime-extractor-lwdkv" (UID: "d3f42221-8165-4208-aeb4-9a42c7769d2b") : configmap "kube-rbac-proxy" not found
Jul 09 18:26:19.351564 ip-10-0-141-101 kubenswrapper[2557]: E0709 18:26:19.351436    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d3f42221-8165-4208-aeb4-9a42c7769d2b-insights-runtime-extractor-tls podName:d3f42221-8165-4208-aeb4-9a42c7769d2b nodeName:}" failed. No retries permitted until 2026-07-09 18:26:19.851430059 +0000 UTC m=+49.090774664 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/d3f42221-8165-4208-aeb4-9a42c7769d2b-insights-runtime-extractor-tls") pod "insights-runtime-extractor-lwdkv" (UID: "d3f42221-8165-4208-aeb4-9a42c7769d2b") : secret "insights-runtime-extractor-tls" not found
Jul 09 18:26:19.351750 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:26:19.351598    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/d3f42221-8165-4208-aeb4-9a42c7769d2b-data-volume\") pod \"insights-runtime-extractor-lwdkv\" (UID: \"d3f42221-8165-4208-aeb4-9a42c7769d2b\") " pod="openshift-insights/insights-runtime-extractor-lwdkv"
Jul 09 18:26:19.361708 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:26:19.361679    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-smkb5\" (UniqueName: \"kubernetes.io/projected/d3f42221-8165-4208-aeb4-9a42c7769d2b-kube-api-access-smkb5\") pod \"insights-runtime-extractor-lwdkv\" (UID: \"d3f42221-8165-4208-aeb4-9a42c7769d2b\") " pod="openshift-insights/insights-runtime-extractor-lwdkv"
Jul 09 18:26:19.493522 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:26:19.493469    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-gqqk7" event={"ID":"6ceea004-b5ab-456b-b34a-476a78286530","Type":"ContainerStarted","Data":"4ce738bbb1d34049966d65fd8c54ca08871521d37984ae9b9ca8b382e2377f2d"}
Jul 09 18:26:19.855589 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:26:19.855552    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/d3f42221-8165-4208-aeb4-9a42c7769d2b-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-lwdkv\" (UID: \"d3f42221-8165-4208-aeb4-9a42c7769d2b\") " pod="openshift-insights/insights-runtime-extractor-lwdkv"
Jul 09 18:26:19.855798 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:26:19.855655    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/d3f42221-8165-4208-aeb4-9a42c7769d2b-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-lwdkv\" (UID: \"d3f42221-8165-4208-aeb4-9a42c7769d2b\") " pod="openshift-insights/insights-runtime-extractor-lwdkv"
Jul 09 18:26:19.855798 ip-10-0-141-101 kubenswrapper[2557]: E0709 18:26:19.855750    2557 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 09 18:26:19.855798 ip-10-0-141-101 kubenswrapper[2557]: E0709 18:26:19.855781    2557 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 09 18:26:19.855946 ip-10-0-141-101 kubenswrapper[2557]: E0709 18:26:19.855843    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d3f42221-8165-4208-aeb4-9a42c7769d2b-insights-runtime-extractor-tls podName:d3f42221-8165-4208-aeb4-9a42c7769d2b nodeName:}" failed. No retries permitted until 2026-07-09 18:26:20.85581897 +0000 UTC m=+50.095163598 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/d3f42221-8165-4208-aeb4-9a42c7769d2b-insights-runtime-extractor-tls") pod "insights-runtime-extractor-lwdkv" (UID: "d3f42221-8165-4208-aeb4-9a42c7769d2b") : secret "insights-runtime-extractor-tls" not found
Jul 09 18:26:19.855946 ip-10-0-141-101 kubenswrapper[2557]: E0709 18:26:19.855867    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/d3f42221-8165-4208-aeb4-9a42c7769d2b-kube-rbac-proxy-cm podName:d3f42221-8165-4208-aeb4-9a42c7769d2b nodeName:}" failed. No retries permitted until 2026-07-09 18:26:20.855855757 +0000 UTC m=+50.095200367 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/d3f42221-8165-4208-aeb4-9a42c7769d2b-kube-rbac-proxy-cm") pod "insights-runtime-extractor-lwdkv" (UID: "d3f42221-8165-4208-aeb4-9a42c7769d2b") : configmap "kube-rbac-proxy" not found
Jul 09 18:26:20.864305 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:26:20.864266    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/d3f42221-8165-4208-aeb4-9a42c7769d2b-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-lwdkv\" (UID: \"d3f42221-8165-4208-aeb4-9a42c7769d2b\") " pod="openshift-insights/insights-runtime-extractor-lwdkv"
Jul 09 18:26:20.864667 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:26:20.864341    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/cb5fba7f-844d-4dc3-9f9d-f77fe9d18eda-registry-tls\") pod \"image-registry-588b5c546d-7ssb9\" (UID: \"cb5fba7f-844d-4dc3-9f9d-f77fe9d18eda\") " pod="openshift-image-registry/image-registry-588b5c546d-7ssb9"
Jul 09 18:26:20.864667 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:26:20.864359    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/d3f42221-8165-4208-aeb4-9a42c7769d2b-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-lwdkv\" (UID: \"d3f42221-8165-4208-aeb4-9a42c7769d2b\") " pod="openshift-insights/insights-runtime-extractor-lwdkv"
Jul 09 18:26:20.864667 ip-10-0-141-101 kubenswrapper[2557]: E0709 18:26:20.864384    2557 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 09 18:26:20.864667 ip-10-0-141-101 kubenswrapper[2557]: E0709 18:26:20.864448    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/d3f42221-8165-4208-aeb4-9a42c7769d2b-kube-rbac-proxy-cm podName:d3f42221-8165-4208-aeb4-9a42c7769d2b nodeName:}" failed. No retries permitted until 2026-07-09 18:26:22.864433637 +0000 UTC m=+52.103778240 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/d3f42221-8165-4208-aeb4-9a42c7769d2b-kube-rbac-proxy-cm") pod "insights-runtime-extractor-lwdkv" (UID: "d3f42221-8165-4208-aeb4-9a42c7769d2b") : configmap "kube-rbac-proxy" not found
Jul 09 18:26:20.864667 ip-10-0-141-101 kubenswrapper[2557]: E0709 18:26:20.864461    2557 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 09 18:26:20.864667 ip-10-0-141-101 kubenswrapper[2557]: E0709 18:26:20.864509    2557 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 09 18:26:20.864667 ip-10-0-141-101 kubenswrapper[2557]: E0709 18:26:20.864527    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d3f42221-8165-4208-aeb4-9a42c7769d2b-insights-runtime-extractor-tls podName:d3f42221-8165-4208-aeb4-9a42c7769d2b nodeName:}" failed. No retries permitted until 2026-07-09 18:26:22.864512084 +0000 UTC m=+52.103856688 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/d3f42221-8165-4208-aeb4-9a42c7769d2b-insights-runtime-extractor-tls") pod "insights-runtime-extractor-lwdkv" (UID: "d3f42221-8165-4208-aeb4-9a42c7769d2b") : secret "insights-runtime-extractor-tls" not found
Jul 09 18:26:20.864667 ip-10-0-141-101 kubenswrapper[2557]: E0709 18:26:20.864529    2557 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-588b5c546d-7ssb9: secret "image-registry-tls" not found
Jul 09 18:26:20.864667 ip-10-0-141-101 kubenswrapper[2557]: E0709 18:26:20.864570    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/cb5fba7f-844d-4dc3-9f9d-f77fe9d18eda-registry-tls podName:cb5fba7f-844d-4dc3-9f9d-f77fe9d18eda nodeName:}" failed. No retries permitted until 2026-07-09 18:26:28.864558502 +0000 UTC m=+58.103903106 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/cb5fba7f-844d-4dc3-9f9d-f77fe9d18eda-registry-tls") pod "image-registry-588b5c546d-7ssb9" (UID: "cb5fba7f-844d-4dc3-9f9d-f77fe9d18eda") : secret "image-registry-tls" not found
Jul 09 18:26:21.499758 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:26:21.499726    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-gqqk7" event={"ID":"6ceea004-b5ab-456b-b34a-476a78286530","Type":"ContainerStarted","Data":"dcde26a8a78c92e250d7c9e095757fcbcf7dedc1fac92e24e6fd3a82be456c71"}
Jul 09 18:26:21.499973 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:26:21.499793    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-gqqk7" event={"ID":"6ceea004-b5ab-456b-b34a-476a78286530","Type":"ContainerStarted","Data":"ea5d699196fc76d345e3f9e0c870042e1c8ed057d52a71c7b9ebab16e4ee256d"}
Jul 09 18:26:21.524405 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:26:21.524347    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-gqqk7" podStartSLOduration=1.380394217 podStartE2EDuration="3.524330688s" totalImagesPullingTime="2.143936471s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 18:26:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 18:26:21.523644898 +0000 UTC m=+50.762989523" watchObservedRunningTime="2026-07-09 18:26:21.524330688 +0000 UTC m=+50.763675313"
Jul 09 18:26:21.894468 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:26:21.894442    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-smljn_327c1eaf-28aa-4971-8053-7d3e67515edd/dns-node-resolver/0.log"
Jul 09 18:26:22.879362 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:26:22.879319    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/d3f42221-8165-4208-aeb4-9a42c7769d2b-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-lwdkv\" (UID: \"d3f42221-8165-4208-aeb4-9a42c7769d2b\") " pod="openshift-insights/insights-runtime-extractor-lwdkv"
Jul 09 18:26:22.879535 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:26:22.879432    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/d3f42221-8165-4208-aeb4-9a42c7769d2b-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-lwdkv\" (UID: \"d3f42221-8165-4208-aeb4-9a42c7769d2b\") " pod="openshift-insights/insights-runtime-extractor-lwdkv"
Jul 09 18:26:22.879535 ip-10-0-141-101 kubenswrapper[2557]: E0709 18:26:22.879448    2557 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 09 18:26:22.879629 ip-10-0-141-101 kubenswrapper[2557]: E0709 18:26:22.879540    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/d3f42221-8165-4208-aeb4-9a42c7769d2b-kube-rbac-proxy-cm podName:d3f42221-8165-4208-aeb4-9a42c7769d2b nodeName:}" failed. No retries permitted until 2026-07-09 18:26:26.879520838 +0000 UTC m=+56.118865449 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/d3f42221-8165-4208-aeb4-9a42c7769d2b-kube-rbac-proxy-cm") pod "insights-runtime-extractor-lwdkv" (UID: "d3f42221-8165-4208-aeb4-9a42c7769d2b") : configmap "kube-rbac-proxy" not found
Jul 09 18:26:22.879629 ip-10-0-141-101 kubenswrapper[2557]: E0709 18:26:22.879561    2557 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 09 18:26:22.879629 ip-10-0-141-101 kubenswrapper[2557]: E0709 18:26:22.879600    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d3f42221-8165-4208-aeb4-9a42c7769d2b-insights-runtime-extractor-tls podName:d3f42221-8165-4208-aeb4-9a42c7769d2b nodeName:}" failed. No retries permitted until 2026-07-09 18:26:26.879589788 +0000 UTC m=+56.118934392 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/d3f42221-8165-4208-aeb4-9a42c7769d2b-insights-runtime-extractor-tls") pod "insights-runtime-extractor-lwdkv" (UID: "d3f42221-8165-4208-aeb4-9a42c7769d2b") : secret "insights-runtime-extractor-tls" not found
Jul 09 18:26:23.077079 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:26:23.077043    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-w5wgl_cc49c9d1-6be4-487b-adf1-ee18094747b6/node-ca/0.log"
Jul 09 18:26:23.477676 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:26:23.477650    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-6fcpf_0bf48160-eb5b-4cb4-abf8-eafde0baca56/serve-healthcheck-canary/0.log"
Jul 09 18:26:24.082901 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:26:24.082872    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-7f59b54f6c-gqqk7_6ceea004-b5ab-456b-b34a-476a78286530/migrator/0.log"
Jul 09 18:26:24.276789 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:26:24.276764    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-7f59b54f6c-gqqk7_6ceea004-b5ab-456b-b34a-476a78286530/graceful-termination/0.log"
Jul 09 18:26:24.477945 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:26:24.477867    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-799cb7f958-kqj92_d5871ae2-0cbd-4038-8269-6343110b7b56/kube-storage-version-migrator-operator/0.log"
Jul 09 18:26:24.996825 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:26:24.996781    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7a9dd0f3-7cbc-4c47-b47a-14437182de3a-metrics-tls\") pod \"dns-default-g8csp\" (UID: \"7a9dd0f3-7cbc-4c47-b47a-14437182de3a\") " pod="openshift-dns/dns-default-g8csp"
Jul 09 18:26:24.997057 ip-10-0-141-101 kubenswrapper[2557]: E0709 18:26:24.996969    2557 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 09 18:26:24.997057 ip-10-0-141-101 kubenswrapper[2557]: E0709 18:26:24.997031    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7a9dd0f3-7cbc-4c47-b47a-14437182de3a-metrics-tls podName:7a9dd0f3-7cbc-4c47-b47a-14437182de3a nodeName:}" failed. No retries permitted until 2026-07-09 18:26:40.997014523 +0000 UTC m=+70.236359151 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/7a9dd0f3-7cbc-4c47-b47a-14437182de3a-metrics-tls") pod "dns-default-g8csp" (UID: "7a9dd0f3-7cbc-4c47-b47a-14437182de3a") : secret "dns-default-metrics-tls" not found
Jul 09 18:26:26.912376 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:26:26.912342    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/d3f42221-8165-4208-aeb4-9a42c7769d2b-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-lwdkv\" (UID: \"d3f42221-8165-4208-aeb4-9a42c7769d2b\") " pod="openshift-insights/insights-runtime-extractor-lwdkv"
Jul 09 18:26:26.912848 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:26:26.912411    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/d3f42221-8165-4208-aeb4-9a42c7769d2b-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-lwdkv\" (UID: \"d3f42221-8165-4208-aeb4-9a42c7769d2b\") " pod="openshift-insights/insights-runtime-extractor-lwdkv"
Jul 09 18:26:26.912848 ip-10-0-141-101 kubenswrapper[2557]: E0709 18:26:26.912523    2557 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 09 18:26:26.912848 ip-10-0-141-101 kubenswrapper[2557]: E0709 18:26:26.912595    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d3f42221-8165-4208-aeb4-9a42c7769d2b-insights-runtime-extractor-tls podName:d3f42221-8165-4208-aeb4-9a42c7769d2b nodeName:}" failed. No retries permitted until 2026-07-09 18:26:34.912580023 +0000 UTC m=+64.151924627 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/d3f42221-8165-4208-aeb4-9a42c7769d2b-insights-runtime-extractor-tls") pod "insights-runtime-extractor-lwdkv" (UID: "d3f42221-8165-4208-aeb4-9a42c7769d2b") : secret "insights-runtime-extractor-tls" not found
Jul 09 18:26:26.912848 ip-10-0-141-101 kubenswrapper[2557]: E0709 18:26:26.912523    2557 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 09 18:26:26.912848 ip-10-0-141-101 kubenswrapper[2557]: E0709 18:26:26.912657    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/d3f42221-8165-4208-aeb4-9a42c7769d2b-kube-rbac-proxy-cm podName:d3f42221-8165-4208-aeb4-9a42c7769d2b nodeName:}" failed. No retries permitted until 2026-07-09 18:26:34.912645895 +0000 UTC m=+64.151990513 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/d3f42221-8165-4208-aeb4-9a42c7769d2b-kube-rbac-proxy-cm") pod "insights-runtime-extractor-lwdkv" (UID: "d3f42221-8165-4208-aeb4-9a42c7769d2b") : configmap "kube-rbac-proxy" not found
Jul 09 18:26:28.925798 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:26:28.925760    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/cb5fba7f-844d-4dc3-9f9d-f77fe9d18eda-registry-tls\") pod \"image-registry-588b5c546d-7ssb9\" (UID: \"cb5fba7f-844d-4dc3-9f9d-f77fe9d18eda\") " pod="openshift-image-registry/image-registry-588b5c546d-7ssb9"
Jul 09 18:26:28.928093 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:26:28.928059    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/cb5fba7f-844d-4dc3-9f9d-f77fe9d18eda-registry-tls\") pod \"image-registry-588b5c546d-7ssb9\" (UID: \"cb5fba7f-844d-4dc3-9f9d-f77fe9d18eda\") " pod="openshift-image-registry/image-registry-588b5c546d-7ssb9"
Jul 09 18:26:28.969169 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:26:28.969136    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-588b5c546d-7ssb9"
Jul 09 18:26:29.099653 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:26:29.099624    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-588b5c546d-7ssb9"]
Jul 09 18:26:29.102592 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:26:29.102562    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcb5fba7f_844d_4dc3_9f9d_f77fe9d18eda.slice/crio-af37d7318433b5cf80f83caa6df9842fc80a61ae76650d01dc83afde2488f89d WatchSource:0}: Error finding container af37d7318433b5cf80f83caa6df9842fc80a61ae76650d01dc83afde2488f89d: Status 404 returned error can't find the container with id af37d7318433b5cf80f83caa6df9842fc80a61ae76650d01dc83afde2488f89d
Jul 09 18:26:29.518886 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:26:29.518851    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-588b5c546d-7ssb9" event={"ID":"cb5fba7f-844d-4dc3-9f9d-f77fe9d18eda","Type":"ContainerStarted","Data":"4f654af56da7f0977f5d7ac9473e10fb4de1404f31df22ce88bca52997368af1"}
Jul 09 18:26:29.519045 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:26:29.518901    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-588b5c546d-7ssb9" event={"ID":"cb5fba7f-844d-4dc3-9f9d-f77fe9d18eda","Type":"ContainerStarted","Data":"af37d7318433b5cf80f83caa6df9842fc80a61ae76650d01dc83afde2488f89d"}
Jul 09 18:26:29.519045 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:26:29.519016    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-588b5c546d-7ssb9"
Jul 09 18:26:29.551352 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:26:29.551303    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-588b5c546d-7ssb9" podStartSLOduration=17.55128926 podStartE2EDuration="17.55128926s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 18:26:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 18:26:29.550704348 +0000 UTC m=+58.790049002" watchObservedRunningTime="2026-07-09 18:26:29.55128926 +0000 UTC m=+58.790633912"
Jul 09 18:26:34.971173 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:26:34.971130    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/d3f42221-8165-4208-aeb4-9a42c7769d2b-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-lwdkv\" (UID: \"d3f42221-8165-4208-aeb4-9a42c7769d2b\") " pod="openshift-insights/insights-runtime-extractor-lwdkv"
Jul 09 18:26:34.971579 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:26:34.971199    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/d3f42221-8165-4208-aeb4-9a42c7769d2b-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-lwdkv\" (UID: \"d3f42221-8165-4208-aeb4-9a42c7769d2b\") " pod="openshift-insights/insights-runtime-extractor-lwdkv"
Jul 09 18:26:34.971692 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:26:34.971673    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/d3f42221-8165-4208-aeb4-9a42c7769d2b-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-lwdkv\" (UID: \"d3f42221-8165-4208-aeb4-9a42c7769d2b\") " pod="openshift-insights/insights-runtime-extractor-lwdkv"
Jul 09 18:26:34.973506 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:26:34.973472    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/d3f42221-8165-4208-aeb4-9a42c7769d2b-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-lwdkv\" (UID: \"d3f42221-8165-4208-aeb4-9a42c7769d2b\") " pod="openshift-insights/insights-runtime-extractor-lwdkv"
Jul 09 18:26:35.014728 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:26:35.014690    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-tvx4s\""
Jul 09 18:26:35.022736 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:26:35.022713    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-lwdkv"
Jul 09 18:26:35.155992 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:26:35.155959    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-lwdkv"]
Jul 09 18:26:35.158962 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:26:35.158939    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd3f42221_8165_4208_aeb4_9a42c7769d2b.slice/crio-de21ac6910a0b5e26c47b8619f0ffbe27ab31805a0507698b056ef6e5fd60f60 WatchSource:0}: Error finding container de21ac6910a0b5e26c47b8619f0ffbe27ab31805a0507698b056ef6e5fd60f60: Status 404 returned error can't find the container with id de21ac6910a0b5e26c47b8619f0ffbe27ab31805a0507698b056ef6e5fd60f60
Jul 09 18:26:35.447356 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:26:35.447330    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-6vp8c"
Jul 09 18:26:35.539446 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:26:35.539412    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-lwdkv" event={"ID":"d3f42221-8165-4208-aeb4-9a42c7769d2b","Type":"ContainerStarted","Data":"de21ac6910a0b5e26c47b8619f0ffbe27ab31805a0507698b056ef6e5fd60f60"}
Jul 09 18:26:36.887554 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:26:36.887520    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3799d80f-6238-4782-913f-7dba2c15884e-metrics-certs\") pod \"network-metrics-daemon-sk5xh\" (UID: \"3799d80f-6238-4782-913f-7dba2c15884e\") " pod="openshift-multus/network-metrics-daemon-sk5xh"
Jul 09 18:26:36.890197 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:26:36.890173    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 09 18:26:36.901219 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:26:36.901190    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3799d80f-6238-4782-913f-7dba2c15884e-metrics-certs\") pod \"network-metrics-daemon-sk5xh\" (UID: \"3799d80f-6238-4782-913f-7dba2c15884e\") " pod="openshift-multus/network-metrics-daemon-sk5xh"
Jul 09 18:26:36.988531 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:26:36.988470    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/cdb7f3b5-f8db-4d3f-8067-371e5eda9f3e-original-pull-secret\") pod \"global-pull-secret-syncer-9f9j6\" (UID: \"cdb7f3b5-f8db-4d3f-8067-371e5eda9f3e\") " pod="kube-system/global-pull-secret-syncer-9f9j6"
Jul 09 18:26:36.988694 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:26:36.988610    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ntqs7\" (UniqueName: \"kubernetes.io/projected/167643e1-1c6b-47ce-8541-e145c13acdb1-kube-api-access-ntqs7\") pod \"network-check-target-j7h7r\" (UID: \"167643e1-1c6b-47ce-8541-e145c13acdb1\") " pod="openshift-network-diagnostics/network-check-target-j7h7r"
Jul 09 18:26:36.991559 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:26:36.991534    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 09 18:26:36.992491 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:26:36.992460    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 09 18:26:37.001798 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:26:37.001770    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 09 18:26:37.001798 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:26:37.001769    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/cdb7f3b5-f8db-4d3f-8067-371e5eda9f3e-original-pull-secret\") pod \"global-pull-secret-syncer-9f9j6\" (UID: \"cdb7f3b5-f8db-4d3f-8067-371e5eda9f3e\") " pod="kube-system/global-pull-secret-syncer-9f9j6"
Jul 09 18:26:37.012420 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:26:37.012394    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ntqs7\" (UniqueName: \"kubernetes.io/projected/167643e1-1c6b-47ce-8541-e145c13acdb1-kube-api-access-ntqs7\") pod \"network-check-target-j7h7r\" (UID: \"167643e1-1c6b-47ce-8541-e145c13acdb1\") " pod="openshift-network-diagnostics/network-check-target-j7h7r"
Jul 09 18:26:37.167443 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:26:37.167374    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-7pc9s\""
Jul 09 18:26:37.174843 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:26:37.174816    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-qx56j\""
Jul 09 18:26:37.175016 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:26:37.174884    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sk5xh"
Jul 09 18:26:37.182774 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:26:37.182744    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-j7h7r"
Jul 09 18:26:37.267643 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:26:37.267615    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9f9j6"
Jul 09 18:26:39.432084 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:26:39.432053    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-sk5xh"]
Jul 09 18:26:39.436171 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:26:39.436130    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3799d80f_6238_4782_913f_7dba2c15884e.slice/crio-98f0c8d4f53d086d7f7730610dcd365dd266495a6c5ff03d653c7102c7f18161 WatchSource:0}: Error finding container 98f0c8d4f53d086d7f7730610dcd365dd266495a6c5ff03d653c7102c7f18161: Status 404 returned error can't find the container with id 98f0c8d4f53d086d7f7730610dcd365dd266495a6c5ff03d653c7102c7f18161
Jul 09 18:26:39.449552 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:26:39.449518    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-9f9j6"]
Jul 09 18:26:39.452248 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:26:39.452224    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcdb7f3b5_f8db_4d3f_8067_371e5eda9f3e.slice/crio-64b34bfdb2a83904c8599ee17dc4df754b613f22484303b0975d5f27e547798f WatchSource:0}: Error finding container 64b34bfdb2a83904c8599ee17dc4df754b613f22484303b0975d5f27e547798f: Status 404 returned error can't find the container with id 64b34bfdb2a83904c8599ee17dc4df754b613f22484303b0975d5f27e547798f
Jul 09 18:26:39.467687 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:26:39.467665    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-j7h7r"]
Jul 09 18:26:39.555494 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:26:39.555400    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-9f9j6" event={"ID":"cdb7f3b5-f8db-4d3f-8067-371e5eda9f3e","Type":"ContainerStarted","Data":"64b34bfdb2a83904c8599ee17dc4df754b613f22484303b0975d5f27e547798f"}
Jul 09 18:26:39.556487 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:26:39.556455    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-sk5xh" event={"ID":"3799d80f-6238-4782-913f-7dba2c15884e","Type":"ContainerStarted","Data":"98f0c8d4f53d086d7f7730610dcd365dd266495a6c5ff03d653c7102c7f18161"}
Jul 09 18:26:39.636837 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:26:39.636794    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod167643e1_1c6b_47ce_8541_e145c13acdb1.slice/crio-2a6583104e7e2a31e9609dc9891e6b30a114cb6a783be33fbadd027504333059 WatchSource:0}: Error finding container 2a6583104e7e2a31e9609dc9891e6b30a114cb6a783be33fbadd027504333059: Status 404 returned error can't find the container with id 2a6583104e7e2a31e9609dc9891e6b30a114cb6a783be33fbadd027504333059
Jul 09 18:26:39.930875 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:26:39.930799    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-97d596f7d-t98p2"]
Jul 09 18:26:39.949244 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:26:39.949216    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-97d596f7d-t98p2"]
Jul 09 18:26:39.949386 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:26:39.949311    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-97d596f7d-t98p2"
Jul 09 18:26:39.953874 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:26:39.953763    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
Jul 09 18:26:39.953874 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:26:39.953796    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-588b5c546d-7ssb9"]
Jul 09 18:26:39.953874 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:26:39.953813    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\""
Jul 09 18:26:39.953874 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:26:39.953844    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
Jul 09 18:26:39.954163 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:26:39.953889    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-snkqj\""
Jul 09 18:26:39.954233 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:26:39.954213    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
Jul 09 18:26:40.004729 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:26:40.004690    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-76c8f744f7-855qg"]
Jul 09 18:26:40.015118 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:26:40.015084    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/9066a0a2-7cf8-476d-a47f-c385bc49574d-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-97d596f7d-t98p2\" (UID: \"9066a0a2-7cf8-476d-a47f-c385bc49574d\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-97d596f7d-t98p2"
Jul 09 18:26:40.015273 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:26:40.015150    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f44t2\" (UniqueName: \"kubernetes.io/projected/9066a0a2-7cf8-476d-a47f-c385bc49574d-kube-api-access-f44t2\") pod \"managed-serviceaccount-addon-agent-97d596f7d-t98p2\" (UID: \"9066a0a2-7cf8-476d-a47f-c385bc49574d\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-97d596f7d-t98p2"
Jul 09 18:26:40.017536 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:26:40.017516    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-76c8f744f7-855qg"
Jul 09 18:26:40.023603 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:26:40.023574    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-76c8f744f7-855qg"]
Jul 09 18:26:40.115945 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:26:40.115904    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e0e90d41-39dc-4348-b7b7-3eb634d9de4d-bound-sa-token\") pod \"image-registry-76c8f744f7-855qg\" (UID: \"e0e90d41-39dc-4348-b7b7-3eb634d9de4d\") " pod="openshift-image-registry/image-registry-76c8f744f7-855qg"
Jul 09 18:26:40.115945 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:26:40.115950    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2vbn8\" (UniqueName: \"kubernetes.io/projected/e0e90d41-39dc-4348-b7b7-3eb634d9de4d-kube-api-access-2vbn8\") pod \"image-registry-76c8f744f7-855qg\" (UID: \"e0e90d41-39dc-4348-b7b7-3eb634d9de4d\") " pod="openshift-image-registry/image-registry-76c8f744f7-855qg"
Jul 09 18:26:40.116203 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:26:40.116004    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e0e90d41-39dc-4348-b7b7-3eb634d9de4d-registry-tls\") pod \"image-registry-76c8f744f7-855qg\" (UID: \"e0e90d41-39dc-4348-b7b7-3eb634d9de4d\") " pod="openshift-image-registry/image-registry-76c8f744f7-855qg"
Jul 09 18:26:40.116203 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:26:40.116096    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/e0e90d41-39dc-4348-b7b7-3eb634d9de4d-ca-trust-extracted\") pod \"image-registry-76c8f744f7-855qg\" (UID: \"e0e90d41-39dc-4348-b7b7-3eb634d9de4d\") " pod="openshift-image-registry/image-registry-76c8f744f7-855qg"
Jul 09 18:26:40.116203 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:26:40.116159    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f44t2\" (UniqueName: \"kubernetes.io/projected/9066a0a2-7cf8-476d-a47f-c385bc49574d-kube-api-access-f44t2\") pod \"managed-serviceaccount-addon-agent-97d596f7d-t98p2\" (UID: \"9066a0a2-7cf8-476d-a47f-c385bc49574d\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-97d596f7d-t98p2"
Jul 09 18:26:40.116352 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:26:40.116206    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/e0e90d41-39dc-4348-b7b7-3eb634d9de4d-image-registry-private-configuration\") pod \"image-registry-76c8f744f7-855qg\" (UID: \"e0e90d41-39dc-4348-b7b7-3eb634d9de4d\") " pod="openshift-image-registry/image-registry-76c8f744f7-855qg"
Jul 09 18:26:40.116352 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:26:40.116241    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/e0e90d41-39dc-4348-b7b7-3eb634d9de4d-trusted-ca\") pod \"image-registry-76c8f744f7-855qg\" (UID: \"e0e90d41-39dc-4348-b7b7-3eb634d9de4d\") " pod="openshift-image-registry/image-registry-76c8f744f7-855qg"
Jul 09 18:26:40.116352 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:26:40.116282    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/9066a0a2-7cf8-476d-a47f-c385bc49574d-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-97d596f7d-t98p2\" (UID: \"9066a0a2-7cf8-476d-a47f-c385bc49574d\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-97d596f7d-t98p2"
Jul 09 18:26:40.116528 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:26:40.116382    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/e0e90d41-39dc-4348-b7b7-3eb634d9de4d-installation-pull-secrets\") pod \"image-registry-76c8f744f7-855qg\" (UID: \"e0e90d41-39dc-4348-b7b7-3eb634d9de4d\") " pod="openshift-image-registry/image-registry-76c8f744f7-855qg"
Jul 09 18:26:40.116528 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:26:40.116429    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/e0e90d41-39dc-4348-b7b7-3eb634d9de4d-registry-certificates\") pod \"image-registry-76c8f744f7-855qg\" (UID: \"e0e90d41-39dc-4348-b7b7-3eb634d9de4d\") " pod="openshift-image-registry/image-registry-76c8f744f7-855qg"
Jul 09 18:26:40.119196 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:26:40.119173    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/9066a0a2-7cf8-476d-a47f-c385bc49574d-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-97d596f7d-t98p2\" (UID: \"9066a0a2-7cf8-476d-a47f-c385bc49574d\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-97d596f7d-t98p2"
Jul 09 18:26:40.125842 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:26:40.125818    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f44t2\" (UniqueName: \"kubernetes.io/projected/9066a0a2-7cf8-476d-a47f-c385bc49574d-kube-api-access-f44t2\") pod \"managed-serviceaccount-addon-agent-97d596f7d-t98p2\" (UID: \"9066a0a2-7cf8-476d-a47f-c385bc49574d\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-97d596f7d-t98p2"
Jul 09 18:26:40.217725 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:26:40.217644    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2vbn8\" (UniqueName: \"kubernetes.io/projected/e0e90d41-39dc-4348-b7b7-3eb634d9de4d-kube-api-access-2vbn8\") pod \"image-registry-76c8f744f7-855qg\" (UID: \"e0e90d41-39dc-4348-b7b7-3eb634d9de4d\") " pod="openshift-image-registry/image-registry-76c8f744f7-855qg"
Jul 09 18:26:40.217725 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:26:40.217683    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e0e90d41-39dc-4348-b7b7-3eb634d9de4d-registry-tls\") pod \"image-registry-76c8f744f7-855qg\" (UID: \"e0e90d41-39dc-4348-b7b7-3eb634d9de4d\") " pod="openshift-image-registry/image-registry-76c8f744f7-855qg"
Jul 09 18:26:40.217725 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:26:40.217708    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/e0e90d41-39dc-4348-b7b7-3eb634d9de4d-ca-trust-extracted\") pod \"image-registry-76c8f744f7-855qg\" (UID: \"e0e90d41-39dc-4348-b7b7-3eb634d9de4d\") " pod="openshift-image-registry/image-registry-76c8f744f7-855qg"
Jul 09 18:26:40.218008 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:26:40.217753    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/e0e90d41-39dc-4348-b7b7-3eb634d9de4d-image-registry-private-configuration\") pod \"image-registry-76c8f744f7-855qg\" (UID: \"e0e90d41-39dc-4348-b7b7-3eb634d9de4d\") " pod="openshift-image-registry/image-registry-76c8f744f7-855qg"
Jul 09 18:26:40.218008 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:26:40.217771    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/e0e90d41-39dc-4348-b7b7-3eb634d9de4d-trusted-ca\") pod \"image-registry-76c8f744f7-855qg\" (UID: \"e0e90d41-39dc-4348-b7b7-3eb634d9de4d\") " pod="openshift-image-registry/image-registry-76c8f744f7-855qg"
Jul 09 18:26:40.218008 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:26:40.217791    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/e0e90d41-39dc-4348-b7b7-3eb634d9de4d-installation-pull-secrets\") pod \"image-registry-76c8f744f7-855qg\" (UID: \"e0e90d41-39dc-4348-b7b7-3eb634d9de4d\") " pod="openshift-image-registry/image-registry-76c8f744f7-855qg"
Jul 09 18:26:40.218008 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:26:40.217820    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/e0e90d41-39dc-4348-b7b7-3eb634d9de4d-registry-certificates\") pod \"image-registry-76c8f744f7-855qg\" (UID: \"e0e90d41-39dc-4348-b7b7-3eb634d9de4d\") " pod="openshift-image-registry/image-registry-76c8f744f7-855qg"
Jul 09 18:26:40.218008 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:26:40.217851    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e0e90d41-39dc-4348-b7b7-3eb634d9de4d-bound-sa-token\") pod \"image-registry-76c8f744f7-855qg\" (UID: \"e0e90d41-39dc-4348-b7b7-3eb634d9de4d\") " pod="openshift-image-registry/image-registry-76c8f744f7-855qg"
Jul 09 18:26:40.218266 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:26:40.218236    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/e0e90d41-39dc-4348-b7b7-3eb634d9de4d-ca-trust-extracted\") pod \"image-registry-76c8f744f7-855qg\" (UID: \"e0e90d41-39dc-4348-b7b7-3eb634d9de4d\") " pod="openshift-image-registry/image-registry-76c8f744f7-855qg"
Jul 09 18:26:40.218750 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:26:40.218720    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/e0e90d41-39dc-4348-b7b7-3eb634d9de4d-registry-certificates\") pod \"image-registry-76c8f744f7-855qg\" (UID: \"e0e90d41-39dc-4348-b7b7-3eb634d9de4d\") " pod="openshift-image-registry/image-registry-76c8f744f7-855qg"
Jul 09 18:26:40.219141 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:26:40.219112    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/e0e90d41-39dc-4348-b7b7-3eb634d9de4d-trusted-ca\") pod \"image-registry-76c8f744f7-855qg\" (UID: \"e0e90d41-39dc-4348-b7b7-3eb634d9de4d\") " pod="openshift-image-registry/image-registry-76c8f744f7-855qg"
Jul 09 18:26:40.220271 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:26:40.220234    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/e0e90d41-39dc-4348-b7b7-3eb634d9de4d-image-registry-private-configuration\") pod \"image-registry-76c8f744f7-855qg\" (UID: \"e0e90d41-39dc-4348-b7b7-3eb634d9de4d\") " pod="openshift-image-registry/image-registry-76c8f744f7-855qg"
Jul 09 18:26:40.220386 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:26:40.220281    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/e0e90d41-39dc-4348-b7b7-3eb634d9de4d-installation-pull-secrets\") pod \"image-registry-76c8f744f7-855qg\" (UID: \"e0e90d41-39dc-4348-b7b7-3eb634d9de4d\") " pod="openshift-image-registry/image-registry-76c8f744f7-855qg"
Jul 09 18:26:40.220456 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:26:40.220388    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e0e90d41-39dc-4348-b7b7-3eb634d9de4d-registry-tls\") pod \"image-registry-76c8f744f7-855qg\" (UID: \"e0e90d41-39dc-4348-b7b7-3eb634d9de4d\") " pod="openshift-image-registry/image-registry-76c8f744f7-855qg"
Jul 09 18:26:40.234307 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:26:40.234281    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e0e90d41-39dc-4348-b7b7-3eb634d9de4d-bound-sa-token\") pod \"image-registry-76c8f744f7-855qg\" (UID: \"e0e90d41-39dc-4348-b7b7-3eb634d9de4d\") " pod="openshift-image-registry/image-registry-76c8f744f7-855qg"
Jul 09 18:26:40.238020 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:26:40.237992    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2vbn8\" (UniqueName: \"kubernetes.io/projected/e0e90d41-39dc-4348-b7b7-3eb634d9de4d-kube-api-access-2vbn8\") pod \"image-registry-76c8f744f7-855qg\" (UID: \"e0e90d41-39dc-4348-b7b7-3eb634d9de4d\") " pod="openshift-image-registry/image-registry-76c8f744f7-855qg"
Jul 09 18:26:40.265043 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:26:40.265007    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-97d596f7d-t98p2"
Jul 09 18:26:40.330144 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:26:40.329579    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-76c8f744f7-855qg"
Jul 09 18:26:40.443179 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:26:40.443088    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-97d596f7d-t98p2"]
Jul 09 18:26:40.519351 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:26:40.519276    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod9066a0a2_7cf8_476d_a47f_c385bc49574d.slice/crio-070d1f8b67f00c2f40afe8fdbfb61136ce252aefca301c79166522382a8d5e0e WatchSource:0}: Error finding container 070d1f8b67f00c2f40afe8fdbfb61136ce252aefca301c79166522382a8d5e0e: Status 404 returned error can't find the container with id 070d1f8b67f00c2f40afe8fdbfb61136ce252aefca301c79166522382a8d5e0e
Jul 09 18:26:40.525260 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:26:40.525189    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-76c8f744f7-855qg"]
Jul 09 18:26:40.529016 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:26:40.528987    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode0e90d41_39dc_4348_b7b7_3eb634d9de4d.slice/crio-157248238f361f3a6a687ac49756fae7dd0200296d0f33458fe310776f1d35f0 WatchSource:0}: Error finding container 157248238f361f3a6a687ac49756fae7dd0200296d0f33458fe310776f1d35f0: Status 404 returned error can't find the container with id 157248238f361f3a6a687ac49756fae7dd0200296d0f33458fe310776f1d35f0
Jul 09 18:26:40.562715 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:26:40.562634    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-76c8f744f7-855qg" event={"ID":"e0e90d41-39dc-4348-b7b7-3eb634d9de4d","Type":"ContainerStarted","Data":"157248238f361f3a6a687ac49756fae7dd0200296d0f33458fe310776f1d35f0"}
Jul 09 18:26:40.564347 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:26:40.564318    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-97d596f7d-t98p2" event={"ID":"9066a0a2-7cf8-476d-a47f-c385bc49574d","Type":"ContainerStarted","Data":"070d1f8b67f00c2f40afe8fdbfb61136ce252aefca301c79166522382a8d5e0e"}
Jul 09 18:26:40.567677 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:26:40.567645    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-j7h7r" event={"ID":"167643e1-1c6b-47ce-8541-e145c13acdb1","Type":"ContainerStarted","Data":"2a6583104e7e2a31e9609dc9891e6b30a114cb6a783be33fbadd027504333059"}
Jul 09 18:26:40.570107 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:26:40.570078    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-lwdkv" event={"ID":"d3f42221-8165-4208-aeb4-9a42c7769d2b","Type":"ContainerStarted","Data":"906ffbaf284614a740a540e017a659b7ea41f02267ae7f3c317b98f4488dab9b"}
Jul 09 18:26:41.026439 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:26:41.026404    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7a9dd0f3-7cbc-4c47-b47a-14437182de3a-metrics-tls\") pod \"dns-default-g8csp\" (UID: \"7a9dd0f3-7cbc-4c47-b47a-14437182de3a\") " pod="openshift-dns/dns-default-g8csp"
Jul 09 18:26:41.031505 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:26:41.031452    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7a9dd0f3-7cbc-4c47-b47a-14437182de3a-metrics-tls\") pod \"dns-default-g8csp\" (UID: \"7a9dd0f3-7cbc-4c47-b47a-14437182de3a\") " pod="openshift-dns/dns-default-g8csp"
Jul 09 18:26:41.259858 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:26:41.259832    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-jnv68\""
Jul 09 18:26:41.267505 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:26:41.267466    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-g8csp"
Jul 09 18:26:41.476189 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:26:41.476134    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-g8csp"]
Jul 09 18:26:41.477630 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:26:41.477598    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7a9dd0f3_7cbc_4c47_b47a_14437182de3a.slice/crio-805c2d853945dc97b6f37cdbf6630c1c0d5a05bd85748c70b7fdcee1c1726fa6 WatchSource:0}: Error finding container 805c2d853945dc97b6f37cdbf6630c1c0d5a05bd85748c70b7fdcee1c1726fa6: Status 404 returned error can't find the container with id 805c2d853945dc97b6f37cdbf6630c1c0d5a05bd85748c70b7fdcee1c1726fa6
Jul 09 18:26:41.578234 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:26:41.578196    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-sk5xh" event={"ID":"3799d80f-6238-4782-913f-7dba2c15884e","Type":"ContainerStarted","Data":"b253ed6e5f56d0896b155e7940f0d9fb776fc1238c39ccf80318334b0b5b5daa"}
Jul 09 18:26:41.578437 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:26:41.578261    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-sk5xh" event={"ID":"3799d80f-6238-4782-913f-7dba2c15884e","Type":"ContainerStarted","Data":"627d28dbb0426a782ba182b1c383d5e7d63eb76f316aa79df9437b992e7fe92f"}
Jul 09 18:26:41.580416 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:26:41.580318    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-76c8f744f7-855qg" event={"ID":"e0e90d41-39dc-4348-b7b7-3eb634d9de4d","Type":"ContainerStarted","Data":"ce8d5189961f34d29ea7a6ebe4f250b8ca930610d361e8ad11803335f65a337d"}
Jul 09 18:26:41.580550 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:26:41.580453    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-76c8f744f7-855qg"
Jul 09 18:26:41.581949 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:26:41.581920    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-g8csp" event={"ID":"7a9dd0f3-7cbc-4c47-b47a-14437182de3a","Type":"ContainerStarted","Data":"805c2d853945dc97b6f37cdbf6630c1c0d5a05bd85748c70b7fdcee1c1726fa6"}
Jul 09 18:26:41.584280 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:26:41.584253    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-lwdkv" event={"ID":"d3f42221-8165-4208-aeb4-9a42c7769d2b","Type":"ContainerStarted","Data":"12a39c6d09bba7e277c118f4af98ffd2c1e8812f01a188393c7a46d6b8375685"}
Jul 09 18:26:41.601662 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:26:41.601538    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-sk5xh" podStartSLOduration=68.754400156 podStartE2EDuration="1m10.601516739s" totalImagesPullingTime="1.847116583s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 18:25:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 18:26:41.599956107 +0000 UTC m=+70.839300733" watchObservedRunningTime="2026-07-09 18:26:41.601516739 +0000 UTC m=+70.840861366"
Jul 09 18:26:41.627430 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:26:41.627362    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-76c8f744f7-855qg" podStartSLOduration=2.627343806 podStartE2EDuration="2.627343806s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 18:26:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 18:26:41.62627271 +0000 UTC m=+70.865617352" watchObservedRunningTime="2026-07-09 18:26:41.627343806 +0000 UTC m=+70.866688409"
Jul 09 18:26:48.612966 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:26:48.612904    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-9f9j6" event={"ID":"cdb7f3b5-f8db-4d3f-8067-371e5eda9f3e","Type":"ContainerStarted","Data":"5203b2fe478bc281eb3281633760b72899adc4c6f08bd220f0af00c613c67666"}
Jul 09 18:26:48.614495 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:26:48.614452    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-j7h7r" event={"ID":"167643e1-1c6b-47ce-8541-e145c13acdb1","Type":"ContainerStarted","Data":"f343dfc31d442f74be90a270a44f625c9dc2b75f1c935c16db1ec7f7fc41320f"}
Jul 09 18:26:48.614614 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:26:48.614531    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-j7h7r"
Jul 09 18:26:48.616218 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:26:48.616186    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-g8csp" event={"ID":"7a9dd0f3-7cbc-4c47-b47a-14437182de3a","Type":"ContainerStarted","Data":"73761cfc3149c26f776993f4425d0288000a04df6a145c1c6ae8300ad6e315d5"}
Jul 09 18:26:48.616348 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:26:48.616233    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-g8csp" event={"ID":"7a9dd0f3-7cbc-4c47-b47a-14437182de3a","Type":"ContainerStarted","Data":"f97151b5262452f27c5322ead488b2a076080ff7c7f3dcec6789a46710615285"}
Jul 09 18:26:48.616348 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:26:48.616275    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-g8csp"
Jul 09 18:26:48.618377 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:26:48.618350    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-lwdkv" event={"ID":"d3f42221-8165-4208-aeb4-9a42c7769d2b","Type":"ContainerStarted","Data":"fb460b2d6189d1a306f37b710d4062f5ce2a6ab860032acaabe08b57a9f9b346"}
Jul 09 18:26:48.633930 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:26:48.633879    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-9f9j6" podStartSLOduration=69.5420635 podStartE2EDuration="1m17.633857189s" totalImagesPullingTime="8.091793689s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 18:25:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 18:26:48.632975202 +0000 UTC m=+77.872319876" watchObservedRunningTime="2026-07-09 18:26:48.633857189 +0000 UTC m=+77.873201816"
Jul 09 18:26:48.651945 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:26:48.651883    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-lwdkv" podStartSLOduration=17.4939305 podStartE2EDuration="29.651862436s" totalImagesPullingTime="12.157931936s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 18:26:19 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 18:26:48.650668477 +0000 UTC m=+77.890013104" watchObservedRunningTime="2026-07-09 18:26:48.651862436 +0000 UTC m=+77.891207064"
Jul 09 18:26:48.665775 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:26:48.665711    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-j7h7r" podStartSLOduration=69.800881626 podStartE2EDuration="1m17.665692176s" totalImagesPullingTime="7.86481055s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 18:25:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 18:26:48.665666882 +0000 UTC m=+77.905011519" watchObservedRunningTime="2026-07-09 18:26:48.665692176 +0000 UTC m=+77.905036803"
Jul 09 18:26:48.684955 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:26:48.684884    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-g8csp" podStartSLOduration=33.637760588 podStartE2EDuration="39.684861043s" totalImagesPullingTime="6.047100455s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 18:26:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 18:26:48.683681033 +0000 UTC m=+77.923025696" watchObservedRunningTime="2026-07-09 18:26:48.684861043 +0000 UTC m=+77.924205670"
Jul 09 18:26:49.624102 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:26:49.624062    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-97d596f7d-t98p2" event={"ID":"9066a0a2-7cf8-476d-a47f-c385bc49574d","Type":"ContainerStarted","Data":"094858a01b0062f84ffd094b5402209be46cfa24461101ca179053f7ac2266d6"}
Jul 09 18:26:49.641201 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:26:49.641142    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-97d596f7d-t98p2" podStartSLOduration=2.368770248 podStartE2EDuration="10.641123353s" totalImagesPullingTime="8.272353105s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 18:26:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 18:26:49.64075708 +0000 UTC m=+78.880101730" watchObservedRunningTime="2026-07-09 18:26:49.641123353 +0000 UTC m=+78.880467980"
Jul 09 18:26:49.960021 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:26:49.959921    2557 patch_prober.go:28] interesting pod/image-registry-588b5c546d-7ssb9 container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Jul 09 18:26:49.960194 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:26:49.960011    2557 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-588b5c546d-7ssb9" podUID="cb5fba7f-844d-4dc3-9f9d-f77fe9d18eda" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 09 18:26:53.330916 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:26:53.330791    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-64785b6675-gsftd"]
Jul 09 18:26:53.336723 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:26:53.336701    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-64785b6675-gsftd"
Jul 09 18:26:53.339983 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:26:53.339957    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 09 18:26:53.340132 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:26:53.339998    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-drzt2\""
Jul 09 18:26:53.340132 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:26:53.339999    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 09 18:26:53.340132 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:26:53.340056    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\""
Jul 09 18:26:53.340298 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:26:53.340056    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 09 18:26:53.340298 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:26:53.339998    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\""
Jul 09 18:26:53.345094 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:26:53.345070    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-64785b6675-gsftd"]
Jul 09 18:26:53.429871 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:26:53.429835    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/84dab160-6562-45ea-bb84-50a0437b1ed5-prometheus-operator-tls\") pod \"prometheus-operator-64785b6675-gsftd\" (UID: \"84dab160-6562-45ea-bb84-50a0437b1ed5\") " pod="openshift-monitoring/prometheus-operator-64785b6675-gsftd"
Jul 09 18:26:53.430055 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:26:53.429878    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/84dab160-6562-45ea-bb84-50a0437b1ed5-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-64785b6675-gsftd\" (UID: \"84dab160-6562-45ea-bb84-50a0437b1ed5\") " pod="openshift-monitoring/prometheus-operator-64785b6675-gsftd"
Jul 09 18:26:53.430055 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:26:53.429902    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tb2dj\" (UniqueName: \"kubernetes.io/projected/84dab160-6562-45ea-bb84-50a0437b1ed5-kube-api-access-tb2dj\") pod \"prometheus-operator-64785b6675-gsftd\" (UID: \"84dab160-6562-45ea-bb84-50a0437b1ed5\") " pod="openshift-monitoring/prometheus-operator-64785b6675-gsftd"
Jul 09 18:26:53.430055 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:26:53.430010    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/84dab160-6562-45ea-bb84-50a0437b1ed5-metrics-client-ca\") pod \"prometheus-operator-64785b6675-gsftd\" (UID: \"84dab160-6562-45ea-bb84-50a0437b1ed5\") " pod="openshift-monitoring/prometheus-operator-64785b6675-gsftd"
Jul 09 18:26:53.530828 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:26:53.530782    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/84dab160-6562-45ea-bb84-50a0437b1ed5-prometheus-operator-tls\") pod \"prometheus-operator-64785b6675-gsftd\" (UID: \"84dab160-6562-45ea-bb84-50a0437b1ed5\") " pod="openshift-monitoring/prometheus-operator-64785b6675-gsftd"
Jul 09 18:26:53.530828 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:26:53.530828    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/84dab160-6562-45ea-bb84-50a0437b1ed5-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-64785b6675-gsftd\" (UID: \"84dab160-6562-45ea-bb84-50a0437b1ed5\") " pod="openshift-monitoring/prometheus-operator-64785b6675-gsftd"
Jul 09 18:26:53.531101 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:26:53.530851    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tb2dj\" (UniqueName: \"kubernetes.io/projected/84dab160-6562-45ea-bb84-50a0437b1ed5-kube-api-access-tb2dj\") pod \"prometheus-operator-64785b6675-gsftd\" (UID: \"84dab160-6562-45ea-bb84-50a0437b1ed5\") " pod="openshift-monitoring/prometheus-operator-64785b6675-gsftd"
Jul 09 18:26:53.531101 ip-10-0-141-101 kubenswrapper[2557]: E0709 18:26:53.530955    2557 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-tls: secret "prometheus-operator-tls" not found
Jul 09 18:26:53.531101 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:26:53.531000    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/84dab160-6562-45ea-bb84-50a0437b1ed5-metrics-client-ca\") pod \"prometheus-operator-64785b6675-gsftd\" (UID: \"84dab160-6562-45ea-bb84-50a0437b1ed5\") " pod="openshift-monitoring/prometheus-operator-64785b6675-gsftd"
Jul 09 18:26:53.531101 ip-10-0-141-101 kubenswrapper[2557]: E0709 18:26:53.531027    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/84dab160-6562-45ea-bb84-50a0437b1ed5-prometheus-operator-tls podName:84dab160-6562-45ea-bb84-50a0437b1ed5 nodeName:}" failed. No retries permitted until 2026-07-09 18:26:54.0310068 +0000 UTC m=+83.270351403 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "prometheus-operator-tls" (UniqueName: "kubernetes.io/secret/84dab160-6562-45ea-bb84-50a0437b1ed5-prometheus-operator-tls") pod "prometheus-operator-64785b6675-gsftd" (UID: "84dab160-6562-45ea-bb84-50a0437b1ed5") : secret "prometheus-operator-tls" not found
Jul 09 18:26:53.531668 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:26:53.531650    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/84dab160-6562-45ea-bb84-50a0437b1ed5-metrics-client-ca\") pod \"prometheus-operator-64785b6675-gsftd\" (UID: \"84dab160-6562-45ea-bb84-50a0437b1ed5\") " pod="openshift-monitoring/prometheus-operator-64785b6675-gsftd"
Jul 09 18:26:53.533213 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:26:53.533197    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/84dab160-6562-45ea-bb84-50a0437b1ed5-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-64785b6675-gsftd\" (UID: \"84dab160-6562-45ea-bb84-50a0437b1ed5\") " pod="openshift-monitoring/prometheus-operator-64785b6675-gsftd"
Jul 09 18:26:53.542766 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:26:53.542733    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tb2dj\" (UniqueName: \"kubernetes.io/projected/84dab160-6562-45ea-bb84-50a0437b1ed5-kube-api-access-tb2dj\") pod \"prometheus-operator-64785b6675-gsftd\" (UID: \"84dab160-6562-45ea-bb84-50a0437b1ed5\") " pod="openshift-monitoring/prometheus-operator-64785b6675-gsftd"
Jul 09 18:26:54.035164 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:26:54.035121    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/84dab160-6562-45ea-bb84-50a0437b1ed5-prometheus-operator-tls\") pod \"prometheus-operator-64785b6675-gsftd\" (UID: \"84dab160-6562-45ea-bb84-50a0437b1ed5\") " pod="openshift-monitoring/prometheus-operator-64785b6675-gsftd"
Jul 09 18:26:54.037503 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:26:54.037460    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/84dab160-6562-45ea-bb84-50a0437b1ed5-prometheus-operator-tls\") pod \"prometheus-operator-64785b6675-gsftd\" (UID: \"84dab160-6562-45ea-bb84-50a0437b1ed5\") " pod="openshift-monitoring/prometheus-operator-64785b6675-gsftd"
Jul 09 18:26:54.246984 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:26:54.246943    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-64785b6675-gsftd"
Jul 09 18:26:54.374128 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:26:54.374092    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-64785b6675-gsftd"]
Jul 09 18:26:54.376741 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:26:54.376717    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod84dab160_6562_45ea_bb84_50a0437b1ed5.slice/crio-90098254a65f207c4efa80ab5e708051e17c93e545d22db084f5793cc9b23ba4 WatchSource:0}: Error finding container 90098254a65f207c4efa80ab5e708051e17c93e545d22db084f5793cc9b23ba4: Status 404 returned error can't find the container with id 90098254a65f207c4efa80ab5e708051e17c93e545d22db084f5793cc9b23ba4
Jul 09 18:26:54.640763 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:26:54.640665    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-64785b6675-gsftd" event={"ID":"84dab160-6562-45ea-bb84-50a0437b1ed5","Type":"ContainerStarted","Data":"90098254a65f207c4efa80ab5e708051e17c93e545d22db084f5793cc9b23ba4"}
Jul 09 18:26:56.651210 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:26:56.651171    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-64785b6675-gsftd" event={"ID":"84dab160-6562-45ea-bb84-50a0437b1ed5","Type":"ContainerStarted","Data":"a7734d9af1596b9a94fda652e4fc012d89eb752e8855165c647e2496fe7e47da"}
Jul 09 18:26:56.651624 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:26:56.651258    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-64785b6675-gsftd" event={"ID":"84dab160-6562-45ea-bb84-50a0437b1ed5","Type":"ContainerStarted","Data":"067926c346092ff1bdc0a76511dc2b277f245e2c11f42c60247fb48370ba85aa"}
Jul 09 18:26:56.674332 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:26:56.674283    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-64785b6675-gsftd" podStartSLOduration=2.237638217 podStartE2EDuration="3.674266145s" totalImagesPullingTime="1.436627928s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 18:26:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 18:26:56.673543357 +0000 UTC m=+85.912887986" watchObservedRunningTime="2026-07-09 18:26:56.674266145 +0000 UTC m=+85.913610771"
Jul 09 18:26:58.626373 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:26:58.626339    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-g8csp"
Jul 09 18:26:58.818953 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:26:58.818908    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-mtj54"]
Jul 09 18:26:58.823341 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:26:58.823320    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-785778ff74-h4zmb"]
Jul 09 18:26:58.823514 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:26:58.823469    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-mtj54"
Jul 09 18:26:58.826579 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:26:58.826560    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-785778ff74-h4zmb"
Jul 09 18:26:58.827041 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:26:58.827022    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 09 18:26:58.827041 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:26:58.827038    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-xcq5v\""
Jul 09 18:26:58.827201 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:26:58.827074    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 09 18:26:58.827201 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:26:58.827159    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 09 18:26:58.829708 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:26:58.829676    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\""
Jul 09 18:26:58.829820 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:26:58.829748    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\""
Jul 09 18:26:58.829820 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:26:58.829808    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\""
Jul 09 18:26:58.829957 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:26:58.829812    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-ht8xl\""
Jul 09 18:26:58.843113 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:26:58.843090    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-785778ff74-h4zmb"]
Jul 09 18:26:58.972164 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:26:58.972063    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6fb37314-ea4d-453b-9fe5-67adcdcc5536-sys\") pod \"node-exporter-mtj54\" (UID: \"6fb37314-ea4d-453b-9fe5-67adcdcc5536\") " pod="openshift-monitoring/node-exporter-mtj54"
Jul 09 18:26:58.972164 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:26:58.972109    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r87cn\" (UniqueName: \"kubernetes.io/projected/8fd6226a-1b0a-4489-b160-ff87e0c0eb0b-kube-api-access-r87cn\") pod \"kube-state-metrics-785778ff74-h4zmb\" (UID: \"8fd6226a-1b0a-4489-b160-ff87e0c0eb0b\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-h4zmb"
Jul 09 18:26:58.972366 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:26:58.972165    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/6fb37314-ea4d-453b-9fe5-67adcdcc5536-node-exporter-textfile\") pod \"node-exporter-mtj54\" (UID: \"6fb37314-ea4d-453b-9fe5-67adcdcc5536\") " pod="openshift-monitoring/node-exporter-mtj54"
Jul 09 18:26:58.972366 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:26:58.972222    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/6fb37314-ea4d-453b-9fe5-67adcdcc5536-node-exporter-wtmp\") pod \"node-exporter-mtj54\" (UID: \"6fb37314-ea4d-453b-9fe5-67adcdcc5536\") " pod="openshift-monitoring/node-exporter-mtj54"
Jul 09 18:26:58.972366 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:26:58.972254    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/6fb37314-ea4d-453b-9fe5-67adcdcc5536-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-mtj54\" (UID: \"6fb37314-ea4d-453b-9fe5-67adcdcc5536\") " pod="openshift-monitoring/node-exporter-mtj54"
Jul 09 18:26:58.972366 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:26:58.972307    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8fd6226a-1b0a-4489-b160-ff87e0c0eb0b-metrics-client-ca\") pod \"kube-state-metrics-785778ff74-h4zmb\" (UID: \"8fd6226a-1b0a-4489-b160-ff87e0c0eb0b\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-h4zmb"
Jul 09 18:26:58.972366 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:26:58.972340    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/6fb37314-ea4d-453b-9fe5-67adcdcc5536-node-exporter-accelerators-collector-config\") pod \"node-exporter-mtj54\" (UID: \"6fb37314-ea4d-453b-9fe5-67adcdcc5536\") " pod="openshift-monitoring/node-exporter-mtj54"
Jul 09 18:26:58.972366 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:26:58.972359    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/8fd6226a-1b0a-4489-b160-ff87e0c0eb0b-kube-state-metrics-tls\") pod \"kube-state-metrics-785778ff74-h4zmb\" (UID: \"8fd6226a-1b0a-4489-b160-ff87e0c0eb0b\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-h4zmb"
Jul 09 18:26:58.972637 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:26:58.972388    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l8nrp\" (UniqueName: \"kubernetes.io/projected/6fb37314-ea4d-453b-9fe5-67adcdcc5536-kube-api-access-l8nrp\") pod \"node-exporter-mtj54\" (UID: \"6fb37314-ea4d-453b-9fe5-67adcdcc5536\") " pod="openshift-monitoring/node-exporter-mtj54"
Jul 09 18:26:58.972637 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:26:58.972428    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/6fb37314-ea4d-453b-9fe5-67adcdcc5536-root\") pod \"node-exporter-mtj54\" (UID: \"6fb37314-ea4d-453b-9fe5-67adcdcc5536\") " pod="openshift-monitoring/node-exporter-mtj54"
Jul 09 18:26:58.972637 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:26:58.972460    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6fb37314-ea4d-453b-9fe5-67adcdcc5536-metrics-client-ca\") pod \"node-exporter-mtj54\" (UID: \"6fb37314-ea4d-453b-9fe5-67adcdcc5536\") " pod="openshift-monitoring/node-exporter-mtj54"
Jul 09 18:26:58.972637 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:26:58.972515    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/8fd6226a-1b0a-4489-b160-ff87e0c0eb0b-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-785778ff74-h4zmb\" (UID: \"8fd6226a-1b0a-4489-b160-ff87e0c0eb0b\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-h4zmb"
Jul 09 18:26:58.972637 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:26:58.972541    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/8fd6226a-1b0a-4489-b160-ff87e0c0eb0b-volume-directive-shadow\") pod \"kube-state-metrics-785778ff74-h4zmb\" (UID: \"8fd6226a-1b0a-4489-b160-ff87e0c0eb0b\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-h4zmb"
Jul 09 18:26:58.972637 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:26:58.972560    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/8fd6226a-1b0a-4489-b160-ff87e0c0eb0b-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-785778ff74-h4zmb\" (UID: \"8fd6226a-1b0a-4489-b160-ff87e0c0eb0b\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-h4zmb"
Jul 09 18:26:58.972637 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:26:58.972581    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/6fb37314-ea4d-453b-9fe5-67adcdcc5536-node-exporter-tls\") pod \"node-exporter-mtj54\" (UID: \"6fb37314-ea4d-453b-9fe5-67adcdcc5536\") " pod="openshift-monitoring/node-exporter-mtj54"
Jul 09 18:26:59.073500 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:26:59.073442    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8fd6226a-1b0a-4489-b160-ff87e0c0eb0b-metrics-client-ca\") pod \"kube-state-metrics-785778ff74-h4zmb\" (UID: \"8fd6226a-1b0a-4489-b160-ff87e0c0eb0b\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-h4zmb"
Jul 09 18:26:59.073681 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:26:59.073518    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/6fb37314-ea4d-453b-9fe5-67adcdcc5536-node-exporter-accelerators-collector-config\") pod \"node-exporter-mtj54\" (UID: \"6fb37314-ea4d-453b-9fe5-67adcdcc5536\") " pod="openshift-monitoring/node-exporter-mtj54"
Jul 09 18:26:59.073681 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:26:59.073544    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/8fd6226a-1b0a-4489-b160-ff87e0c0eb0b-kube-state-metrics-tls\") pod \"kube-state-metrics-785778ff74-h4zmb\" (UID: \"8fd6226a-1b0a-4489-b160-ff87e0c0eb0b\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-h4zmb"
Jul 09 18:26:59.073681 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:26:59.073569    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l8nrp\" (UniqueName: \"kubernetes.io/projected/6fb37314-ea4d-453b-9fe5-67adcdcc5536-kube-api-access-l8nrp\") pod \"node-exporter-mtj54\" (UID: \"6fb37314-ea4d-453b-9fe5-67adcdcc5536\") " pod="openshift-monitoring/node-exporter-mtj54"
Jul 09 18:26:59.073681 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:26:59.073588    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/6fb37314-ea4d-453b-9fe5-67adcdcc5536-root\") pod \"node-exporter-mtj54\" (UID: \"6fb37314-ea4d-453b-9fe5-67adcdcc5536\") " pod="openshift-monitoring/node-exporter-mtj54"
Jul 09 18:26:59.073681 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:26:59.073606    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6fb37314-ea4d-453b-9fe5-67adcdcc5536-metrics-client-ca\") pod \"node-exporter-mtj54\" (UID: \"6fb37314-ea4d-453b-9fe5-67adcdcc5536\") " pod="openshift-monitoring/node-exporter-mtj54"
Jul 09 18:26:59.073681 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:26:59.073625    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/8fd6226a-1b0a-4489-b160-ff87e0c0eb0b-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-785778ff74-h4zmb\" (UID: \"8fd6226a-1b0a-4489-b160-ff87e0c0eb0b\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-h4zmb"
Jul 09 18:26:59.073681 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:26:59.073655    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/8fd6226a-1b0a-4489-b160-ff87e0c0eb0b-volume-directive-shadow\") pod \"kube-state-metrics-785778ff74-h4zmb\" (UID: \"8fd6226a-1b0a-4489-b160-ff87e0c0eb0b\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-h4zmb"
Jul 09 18:26:59.073681 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:26:59.073674    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/6fb37314-ea4d-453b-9fe5-67adcdcc5536-root\") pod \"node-exporter-mtj54\" (UID: \"6fb37314-ea4d-453b-9fe5-67adcdcc5536\") " pod="openshift-monitoring/node-exporter-mtj54"
Jul 09 18:26:59.074073 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:26:59.073682    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/8fd6226a-1b0a-4489-b160-ff87e0c0eb0b-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-785778ff74-h4zmb\" (UID: \"8fd6226a-1b0a-4489-b160-ff87e0c0eb0b\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-h4zmb"
Jul 09 18:26:59.074073 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:26:59.073744    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/6fb37314-ea4d-453b-9fe5-67adcdcc5536-node-exporter-tls\") pod \"node-exporter-mtj54\" (UID: \"6fb37314-ea4d-453b-9fe5-67adcdcc5536\") " pod="openshift-monitoring/node-exporter-mtj54"
Jul 09 18:26:59.074073 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:26:59.073779    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6fb37314-ea4d-453b-9fe5-67adcdcc5536-sys\") pod \"node-exporter-mtj54\" (UID: \"6fb37314-ea4d-453b-9fe5-67adcdcc5536\") " pod="openshift-monitoring/node-exporter-mtj54"
Jul 09 18:26:59.074073 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:26:59.073806    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r87cn\" (UniqueName: \"kubernetes.io/projected/8fd6226a-1b0a-4489-b160-ff87e0c0eb0b-kube-api-access-r87cn\") pod \"kube-state-metrics-785778ff74-h4zmb\" (UID: \"8fd6226a-1b0a-4489-b160-ff87e0c0eb0b\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-h4zmb"
Jul 09 18:26:59.074073 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:26:59.073833    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/6fb37314-ea4d-453b-9fe5-67adcdcc5536-node-exporter-textfile\") pod \"node-exporter-mtj54\" (UID: \"6fb37314-ea4d-453b-9fe5-67adcdcc5536\") " pod="openshift-monitoring/node-exporter-mtj54"
Jul 09 18:26:59.074318 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:26:59.074120    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/6fb37314-ea4d-453b-9fe5-67adcdcc5536-node-exporter-textfile\") pod \"node-exporter-mtj54\" (UID: \"6fb37314-ea4d-453b-9fe5-67adcdcc5536\") " pod="openshift-monitoring/node-exporter-mtj54"
Jul 09 18:26:59.074318 ip-10-0-141-101 kubenswrapper[2557]: E0709 18:26:59.074208    2557 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found
Jul 09 18:26:59.074318 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:26:59.074246    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/6fb37314-ea4d-453b-9fe5-67adcdcc5536-node-exporter-accelerators-collector-config\") pod \"node-exporter-mtj54\" (UID: \"6fb37314-ea4d-453b-9fe5-67adcdcc5536\") " pod="openshift-monitoring/node-exporter-mtj54"
Jul 09 18:26:59.074318 ip-10-0-141-101 kubenswrapper[2557]: E0709 18:26:59.074274    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6fb37314-ea4d-453b-9fe5-67adcdcc5536-node-exporter-tls podName:6fb37314-ea4d-453b-9fe5-67adcdcc5536 nodeName:}" failed. No retries permitted until 2026-07-09 18:26:59.574255366 +0000 UTC m=+88.813599983 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/6fb37314-ea4d-453b-9fe5-67adcdcc5536-node-exporter-tls") pod "node-exporter-mtj54" (UID: "6fb37314-ea4d-453b-9fe5-67adcdcc5536") : secret "node-exporter-tls" not found
Jul 09 18:26:59.074318 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:26:59.074302    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8fd6226a-1b0a-4489-b160-ff87e0c0eb0b-metrics-client-ca\") pod \"kube-state-metrics-785778ff74-h4zmb\" (UID: \"8fd6226a-1b0a-4489-b160-ff87e0c0eb0b\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-h4zmb"
Jul 09 18:26:59.074318 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:26:59.074317    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6fb37314-ea4d-453b-9fe5-67adcdcc5536-sys\") pod \"node-exporter-mtj54\" (UID: \"6fb37314-ea4d-453b-9fe5-67adcdcc5536\") " pod="openshift-monitoring/node-exporter-mtj54"
Jul 09 18:26:59.074661 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:26:59.074337    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/8fd6226a-1b0a-4489-b160-ff87e0c0eb0b-volume-directive-shadow\") pod \"kube-state-metrics-785778ff74-h4zmb\" (UID: \"8fd6226a-1b0a-4489-b160-ff87e0c0eb0b\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-h4zmb"
Jul 09 18:26:59.074661 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:26:59.074352    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/6fb37314-ea4d-453b-9fe5-67adcdcc5536-node-exporter-wtmp\") pod \"node-exporter-mtj54\" (UID: \"6fb37314-ea4d-453b-9fe5-67adcdcc5536\") " pod="openshift-monitoring/node-exporter-mtj54"
Jul 09 18:26:59.074661 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:26:59.074384    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/8fd6226a-1b0a-4489-b160-ff87e0c0eb0b-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-785778ff74-h4zmb\" (UID: \"8fd6226a-1b0a-4489-b160-ff87e0c0eb0b\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-h4zmb"
Jul 09 18:26:59.074661 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:26:59.074391    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6fb37314-ea4d-453b-9fe5-67adcdcc5536-metrics-client-ca\") pod \"node-exporter-mtj54\" (UID: \"6fb37314-ea4d-453b-9fe5-67adcdcc5536\") " pod="openshift-monitoring/node-exporter-mtj54"
Jul 09 18:26:59.074661 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:26:59.074400    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/6fb37314-ea4d-453b-9fe5-67adcdcc5536-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-mtj54\" (UID: \"6fb37314-ea4d-453b-9fe5-67adcdcc5536\") " pod="openshift-monitoring/node-exporter-mtj54"
Jul 09 18:26:59.074661 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:26:59.074466    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/6fb37314-ea4d-453b-9fe5-67adcdcc5536-node-exporter-wtmp\") pod \"node-exporter-mtj54\" (UID: \"6fb37314-ea4d-453b-9fe5-67adcdcc5536\") " pod="openshift-monitoring/node-exporter-mtj54"
Jul 09 18:26:59.076262 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:26:59.076237    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/8fd6226a-1b0a-4489-b160-ff87e0c0eb0b-kube-state-metrics-tls\") pod \"kube-state-metrics-785778ff74-h4zmb\" (UID: \"8fd6226a-1b0a-4489-b160-ff87e0c0eb0b\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-h4zmb"
Jul 09 18:26:59.076420 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:26:59.076403    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/6fb37314-ea4d-453b-9fe5-67adcdcc5536-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-mtj54\" (UID: \"6fb37314-ea4d-453b-9fe5-67adcdcc5536\") " pod="openshift-monitoring/node-exporter-mtj54"
Jul 09 18:26:59.076695 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:26:59.076677    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/8fd6226a-1b0a-4489-b160-ff87e0c0eb0b-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-785778ff74-h4zmb\" (UID: \"8fd6226a-1b0a-4489-b160-ff87e0c0eb0b\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-h4zmb"
Jul 09 18:26:59.081515 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:26:59.081471    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l8nrp\" (UniqueName: \"kubernetes.io/projected/6fb37314-ea4d-453b-9fe5-67adcdcc5536-kube-api-access-l8nrp\") pod \"node-exporter-mtj54\" (UID: \"6fb37314-ea4d-453b-9fe5-67adcdcc5536\") " pod="openshift-monitoring/node-exporter-mtj54"
Jul 09 18:26:59.082154 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:26:59.082129    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r87cn\" (UniqueName: \"kubernetes.io/projected/8fd6226a-1b0a-4489-b160-ff87e0c0eb0b-kube-api-access-r87cn\") pod \"kube-state-metrics-785778ff74-h4zmb\" (UID: \"8fd6226a-1b0a-4489-b160-ff87e0c0eb0b\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-h4zmb"
Jul 09 18:26:59.139166 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:26:59.139128    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-785778ff74-h4zmb"
Jul 09 18:26:59.273044 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:26:59.272989    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-785778ff74-h4zmb"]
Jul 09 18:26:59.275497 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:26:59.275455    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8fd6226a_1b0a_4489_b160_ff87e0c0eb0b.slice/crio-b5c184668e15cb32681f1ac0d6ebd820128a48204ae12b95ef3bd0be28c04499 WatchSource:0}: Error finding container b5c184668e15cb32681f1ac0d6ebd820128a48204ae12b95ef3bd0be28c04499: Status 404 returned error can't find the container with id b5c184668e15cb32681f1ac0d6ebd820128a48204ae12b95ef3bd0be28c04499
Jul 09 18:26:59.578397 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:26:59.578365    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/6fb37314-ea4d-453b-9fe5-67adcdcc5536-node-exporter-tls\") pod \"node-exporter-mtj54\" (UID: \"6fb37314-ea4d-453b-9fe5-67adcdcc5536\") " pod="openshift-monitoring/node-exporter-mtj54"
Jul 09 18:26:59.580692 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:26:59.580671    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/6fb37314-ea4d-453b-9fe5-67adcdcc5536-node-exporter-tls\") pod \"node-exporter-mtj54\" (UID: \"6fb37314-ea4d-453b-9fe5-67adcdcc5536\") " pod="openshift-monitoring/node-exporter-mtj54"
Jul 09 18:26:59.663021 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:26:59.662987    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-785778ff74-h4zmb" event={"ID":"8fd6226a-1b0a-4489-b160-ff87e0c0eb0b","Type":"ContainerStarted","Data":"b5c184668e15cb32681f1ac0d6ebd820128a48204ae12b95ef3bd0be28c04499"}
Jul 09 18:26:59.734391 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:26:59.734357    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-mtj54"
Jul 09 18:26:59.746262 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:26:59.746233    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6fb37314_ea4d_453b_9fe5_67adcdcc5536.slice/crio-8cf83acbb8fa5e0a22deb0ebbe0b94562688889d8744e4feede406ce0c73b6f4 WatchSource:0}: Error finding container 8cf83acbb8fa5e0a22deb0ebbe0b94562688889d8744e4feede406ce0c73b6f4: Status 404 returned error can't find the container with id 8cf83acbb8fa5e0a22deb0ebbe0b94562688889d8744e4feede406ce0c73b6f4
Jul 09 18:26:59.959365 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:26:59.959280    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-588b5c546d-7ssb9"
Jul 09 18:27:00.668504 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:27:00.668450    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-mtj54" event={"ID":"6fb37314-ea4d-453b-9fe5-67adcdcc5536","Type":"ContainerStarted","Data":"8cf83acbb8fa5e0a22deb0ebbe0b94562688889d8744e4feede406ce0c73b6f4"}
Jul 09 18:27:01.673854 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:27:01.673823    2557 generic.go:356] "Generic (PLEG): container finished" podID="6fb37314-ea4d-453b-9fe5-67adcdcc5536" containerID="f223a33f3e4875dc156e0afa3fd644e549ef2e3a02a5f4bdb31eb6caaebf1847" exitCode=0
Jul 09 18:27:01.674344 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:27:01.673912    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-mtj54" event={"ID":"6fb37314-ea4d-453b-9fe5-67adcdcc5536","Type":"ContainerDied","Data":"f223a33f3e4875dc156e0afa3fd644e549ef2e3a02a5f4bdb31eb6caaebf1847"}
Jul 09 18:27:01.676121 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:27:01.676098    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-785778ff74-h4zmb" event={"ID":"8fd6226a-1b0a-4489-b160-ff87e0c0eb0b","Type":"ContainerStarted","Data":"789bb677123f828384f1330fc452488a4852fb7820b5c98b93aa2d1bb3ba3a7a"}
Jul 09 18:27:01.676272 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:27:01.676151    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-785778ff74-h4zmb" event={"ID":"8fd6226a-1b0a-4489-b160-ff87e0c0eb0b","Type":"ContainerStarted","Data":"e44c756d5a66b4a994204a6945688d83568bf1b470a39459f9599cfb20bbe493"}
Jul 09 18:27:01.676272 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:27:01.676180    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-785778ff74-h4zmb" event={"ID":"8fd6226a-1b0a-4489-b160-ff87e0c0eb0b","Type":"ContainerStarted","Data":"6138228bfb3a8febcab329e079df072863a92b1c285a850d53c50b05157fcee8"}
Jul 09 18:27:01.741168 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:27:01.741121    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-785778ff74-h4zmb" podStartSLOduration=2.341244559 podStartE2EDuration="3.741102489s" totalImagesPullingTime="1.39985793s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 18:26:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 18:27:01.739361056 +0000 UTC m=+90.978705697" watchObservedRunningTime="2026-07-09 18:27:01.741102489 +0000 UTC m=+90.980447152"
Jul 09 18:27:01.770549 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:27:01.770519    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-6cc9d89b54-r4pjf"]
Jul 09 18:27:01.775827 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:27:01.775797    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-6cc9d89b54-r4pjf"
Jul 09 18:27:01.781743 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:27:01.781720    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\""
Jul 09 18:27:01.785923 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:27:01.785899    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\""
Jul 09 18:27:01.786041 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:27:01.785928    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\""
Jul 09 18:27:01.786041 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:27:01.785934    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-a14mlnp5rmmc8\""
Jul 09 18:27:01.786041 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:27:01.785945    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-wjzk9\""
Jul 09 18:27:01.786544 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:27:01.786524    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\""
Jul 09 18:27:01.786678 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:27:01.786663    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\""
Jul 09 18:27:01.808849 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:27:01.808827    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-6cc9d89b54-r4pjf"]
Jul 09 18:27:01.899343 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:27:01.899305    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/a79d7993-1a36-4038-9893-d643dd8ce0c3-secret-grpc-tls\") pod \"thanos-querier-6cc9d89b54-r4pjf\" (UID: \"a79d7993-1a36-4038-9893-d643dd8ce0c3\") " pod="openshift-monitoring/thanos-querier-6cc9d89b54-r4pjf"
Jul 09 18:27:01.899542 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:27:01.899353    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a79d7993-1a36-4038-9893-d643dd8ce0c3-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-6cc9d89b54-r4pjf\" (UID: \"a79d7993-1a36-4038-9893-d643dd8ce0c3\") " pod="openshift-monitoring/thanos-querier-6cc9d89b54-r4pjf"
Jul 09 18:27:01.899542 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:27:01.899378    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/a79d7993-1a36-4038-9893-d643dd8ce0c3-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-6cc9d89b54-r4pjf\" (UID: \"a79d7993-1a36-4038-9893-d643dd8ce0c3\") " pod="openshift-monitoring/thanos-querier-6cc9d89b54-r4pjf"
Jul 09 18:27:01.899542 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:27:01.899435    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/a79d7993-1a36-4038-9893-d643dd8ce0c3-secret-thanos-querier-tls\") pod \"thanos-querier-6cc9d89b54-r4pjf\" (UID: \"a79d7993-1a36-4038-9893-d643dd8ce0c3\") " pod="openshift-monitoring/thanos-querier-6cc9d89b54-r4pjf"
Jul 09 18:27:01.899542 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:27:01.899465    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a79d7993-1a36-4038-9893-d643dd8ce0c3-metrics-client-ca\") pod \"thanos-querier-6cc9d89b54-r4pjf\" (UID: \"a79d7993-1a36-4038-9893-d643dd8ce0c3\") " pod="openshift-monitoring/thanos-querier-6cc9d89b54-r4pjf"
Jul 09 18:27:01.899542 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:27:01.899512    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/a79d7993-1a36-4038-9893-d643dd8ce0c3-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-6cc9d89b54-r4pjf\" (UID: \"a79d7993-1a36-4038-9893-d643dd8ce0c3\") " pod="openshift-monitoring/thanos-querier-6cc9d89b54-r4pjf"
Jul 09 18:27:01.899725 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:27:01.899577    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mscvh\" (UniqueName: \"kubernetes.io/projected/a79d7993-1a36-4038-9893-d643dd8ce0c3-kube-api-access-mscvh\") pod \"thanos-querier-6cc9d89b54-r4pjf\" (UID: \"a79d7993-1a36-4038-9893-d643dd8ce0c3\") " pod="openshift-monitoring/thanos-querier-6cc9d89b54-r4pjf"
Jul 09 18:27:01.899725 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:27:01.899659    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a79d7993-1a36-4038-9893-d643dd8ce0c3-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-6cc9d89b54-r4pjf\" (UID: \"a79d7993-1a36-4038-9893-d643dd8ce0c3\") " pod="openshift-monitoring/thanos-querier-6cc9d89b54-r4pjf"
Jul 09 18:27:02.000744 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:27:02.000655    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/a79d7993-1a36-4038-9893-d643dd8ce0c3-secret-grpc-tls\") pod \"thanos-querier-6cc9d89b54-r4pjf\" (UID: \"a79d7993-1a36-4038-9893-d643dd8ce0c3\") " pod="openshift-monitoring/thanos-querier-6cc9d89b54-r4pjf"
Jul 09 18:27:02.000744 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:27:02.000703    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a79d7993-1a36-4038-9893-d643dd8ce0c3-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-6cc9d89b54-r4pjf\" (UID: \"a79d7993-1a36-4038-9893-d643dd8ce0c3\") " pod="openshift-monitoring/thanos-querier-6cc9d89b54-r4pjf"
Jul 09 18:27:02.000744 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:27:02.000728    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/a79d7993-1a36-4038-9893-d643dd8ce0c3-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-6cc9d89b54-r4pjf\" (UID: \"a79d7993-1a36-4038-9893-d643dd8ce0c3\") " pod="openshift-monitoring/thanos-querier-6cc9d89b54-r4pjf"
Jul 09 18:27:02.000999 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:27:02.000757    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/a79d7993-1a36-4038-9893-d643dd8ce0c3-secret-thanos-querier-tls\") pod \"thanos-querier-6cc9d89b54-r4pjf\" (UID: \"a79d7993-1a36-4038-9893-d643dd8ce0c3\") " pod="openshift-monitoring/thanos-querier-6cc9d89b54-r4pjf"
Jul 09 18:27:02.000999 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:27:02.000787    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a79d7993-1a36-4038-9893-d643dd8ce0c3-metrics-client-ca\") pod \"thanos-querier-6cc9d89b54-r4pjf\" (UID: \"a79d7993-1a36-4038-9893-d643dd8ce0c3\") " pod="openshift-monitoring/thanos-querier-6cc9d89b54-r4pjf"
Jul 09 18:27:02.000999 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:27:02.000813    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/a79d7993-1a36-4038-9893-d643dd8ce0c3-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-6cc9d89b54-r4pjf\" (UID: \"a79d7993-1a36-4038-9893-d643dd8ce0c3\") " pod="openshift-monitoring/thanos-querier-6cc9d89b54-r4pjf"
Jul 09 18:27:02.001147 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:27:02.001014    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mscvh\" (UniqueName: \"kubernetes.io/projected/a79d7993-1a36-4038-9893-d643dd8ce0c3-kube-api-access-mscvh\") pod \"thanos-querier-6cc9d89b54-r4pjf\" (UID: \"a79d7993-1a36-4038-9893-d643dd8ce0c3\") " pod="openshift-monitoring/thanos-querier-6cc9d89b54-r4pjf"
Jul 09 18:27:02.001147 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:27:02.001093    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a79d7993-1a36-4038-9893-d643dd8ce0c3-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-6cc9d89b54-r4pjf\" (UID: \"a79d7993-1a36-4038-9893-d643dd8ce0c3\") " pod="openshift-monitoring/thanos-querier-6cc9d89b54-r4pjf"
Jul 09 18:27:02.003637 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:27:02.003606    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a79d7993-1a36-4038-9893-d643dd8ce0c3-metrics-client-ca\") pod \"thanos-querier-6cc9d89b54-r4pjf\" (UID: \"a79d7993-1a36-4038-9893-d643dd8ce0c3\") " pod="openshift-monitoring/thanos-querier-6cc9d89b54-r4pjf"
Jul 09 18:27:02.007222 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:27:02.003871    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/a79d7993-1a36-4038-9893-d643dd8ce0c3-secret-grpc-tls\") pod \"thanos-querier-6cc9d89b54-r4pjf\" (UID: \"a79d7993-1a36-4038-9893-d643dd8ce0c3\") " pod="openshift-monitoring/thanos-querier-6cc9d89b54-r4pjf"
Jul 09 18:27:02.007222 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:27:02.004146    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a79d7993-1a36-4038-9893-d643dd8ce0c3-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-6cc9d89b54-r4pjf\" (UID: \"a79d7993-1a36-4038-9893-d643dd8ce0c3\") " pod="openshift-monitoring/thanos-querier-6cc9d89b54-r4pjf"
Jul 09 18:27:02.007222 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:27:02.005567    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a79d7993-1a36-4038-9893-d643dd8ce0c3-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-6cc9d89b54-r4pjf\" (UID: \"a79d7993-1a36-4038-9893-d643dd8ce0c3\") " pod="openshift-monitoring/thanos-querier-6cc9d89b54-r4pjf"
Jul 09 18:27:02.008014 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:27:02.007988    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/a79d7993-1a36-4038-9893-d643dd8ce0c3-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-6cc9d89b54-r4pjf\" (UID: \"a79d7993-1a36-4038-9893-d643dd8ce0c3\") " pod="openshift-monitoring/thanos-querier-6cc9d89b54-r4pjf"
Jul 09 18:27:02.008138 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:27:02.008031    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/a79d7993-1a36-4038-9893-d643dd8ce0c3-secret-thanos-querier-tls\") pod \"thanos-querier-6cc9d89b54-r4pjf\" (UID: \"a79d7993-1a36-4038-9893-d643dd8ce0c3\") " pod="openshift-monitoring/thanos-querier-6cc9d89b54-r4pjf"
Jul 09 18:27:02.008267 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:27:02.008248    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/a79d7993-1a36-4038-9893-d643dd8ce0c3-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-6cc9d89b54-r4pjf\" (UID: \"a79d7993-1a36-4038-9893-d643dd8ce0c3\") " pod="openshift-monitoring/thanos-querier-6cc9d89b54-r4pjf"
Jul 09 18:27:02.019392 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:27:02.019368    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mscvh\" (UniqueName: \"kubernetes.io/projected/a79d7993-1a36-4038-9893-d643dd8ce0c3-kube-api-access-mscvh\") pod \"thanos-querier-6cc9d89b54-r4pjf\" (UID: \"a79d7993-1a36-4038-9893-d643dd8ce0c3\") " pod="openshift-monitoring/thanos-querier-6cc9d89b54-r4pjf"
Jul 09 18:27:02.095669 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:27:02.095632    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-6cc9d89b54-r4pjf"
Jul 09 18:27:02.241805 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:27:02.241774    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-6cc9d89b54-r4pjf"]
Jul 09 18:27:02.242241 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:27:02.242217    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda79d7993_1a36_4038_9893_d643dd8ce0c3.slice/crio-5adb950516bbbcf75eb42b553efe0b3aa5e68e59b9d47813a80faf5e1806f398 WatchSource:0}: Error finding container 5adb950516bbbcf75eb42b553efe0b3aa5e68e59b9d47813a80faf5e1806f398: Status 404 returned error can't find the container with id 5adb950516bbbcf75eb42b553efe0b3aa5e68e59b9d47813a80faf5e1806f398
Jul 09 18:27:02.593692 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:27:02.593662    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-76c8f744f7-855qg"
Jul 09 18:27:02.682866 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:27:02.682833    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-mtj54" event={"ID":"6fb37314-ea4d-453b-9fe5-67adcdcc5536","Type":"ContainerStarted","Data":"05d3224700ad2dd862c8d18f476a25271829644c9252a6dbc2deca04a2de87dc"}
Jul 09 18:27:02.683308 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:27:02.682893    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-mtj54" event={"ID":"6fb37314-ea4d-453b-9fe5-67adcdcc5536","Type":"ContainerStarted","Data":"a8d1fd6ff16f527019ad41a769ea33bae48955446eb0a33dab82bcd8ee1fcdf9"}
Jul 09 18:27:02.684275 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:27:02.684248    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6cc9d89b54-r4pjf" event={"ID":"a79d7993-1a36-4038-9893-d643dd8ce0c3","Type":"ContainerStarted","Data":"5adb950516bbbcf75eb42b553efe0b3aa5e68e59b9d47813a80faf5e1806f398"}
Jul 09 18:27:02.730564 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:27:02.730507    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-mtj54" podStartSLOduration=3.386170627 podStartE2EDuration="4.730466235s" totalImagesPullingTime="1.274240013s" totalInitContainerRuntime="70.055595ms" isStatefulPod=true podCreationTimestamp="2026-07-09 18:26:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 18:27:02.729860836 +0000 UTC m=+91.969205479" watchObservedRunningTime="2026-07-09 18:27:02.730466235 +0000 UTC m=+91.969810866"
Jul 09 18:27:03.264424 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:27:03.264390    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-76ddf9975b-7s4fw"]
Jul 09 18:27:03.267534 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:27:03.267518    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-76ddf9975b-7s4fw"
Jul 09 18:27:03.271076 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:27:03.271055    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-1kf5q938hd8vr\""
Jul 09 18:27:03.271981 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:27:03.271958    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Jul 09 18:27:03.271981 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:27:03.271975    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-pv9tl\""
Jul 09 18:27:03.272142 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:27:03.272056    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\""
Jul 09 18:27:03.272142 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:27:03.272060    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\""
Jul 09 18:27:03.272142 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:27:03.272086    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\""
Jul 09 18:27:03.330336 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:27:03.330299    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-76ddf9975b-7s4fw"]
Jul 09 18:27:03.413901 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:27:03.413863    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/60679719-f3ae-4a26-9827-5a0293035317-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-76ddf9975b-7s4fw\" (UID: \"60679719-f3ae-4a26-9827-5a0293035317\") " pod="openshift-monitoring/metrics-server-76ddf9975b-7s4fw"
Jul 09 18:27:03.413901 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:27:03.413904    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/60679719-f3ae-4a26-9827-5a0293035317-secret-metrics-server-client-certs\") pod \"metrics-server-76ddf9975b-7s4fw\" (UID: \"60679719-f3ae-4a26-9827-5a0293035317\") " pod="openshift-monitoring/metrics-server-76ddf9975b-7s4fw"
Jul 09 18:27:03.414096 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:27:03.413975    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/60679719-f3ae-4a26-9827-5a0293035317-secret-metrics-server-tls\") pod \"metrics-server-76ddf9975b-7s4fw\" (UID: \"60679719-f3ae-4a26-9827-5a0293035317\") " pod="openshift-monitoring/metrics-server-76ddf9975b-7s4fw"
Jul 09 18:27:03.414096 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:27:03.414016    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zkt4f\" (UniqueName: \"kubernetes.io/projected/60679719-f3ae-4a26-9827-5a0293035317-kube-api-access-zkt4f\") pod \"metrics-server-76ddf9975b-7s4fw\" (UID: \"60679719-f3ae-4a26-9827-5a0293035317\") " pod="openshift-monitoring/metrics-server-76ddf9975b-7s4fw"
Jul 09 18:27:03.414096 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:27:03.414059    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/60679719-f3ae-4a26-9827-5a0293035317-audit-log\") pod \"metrics-server-76ddf9975b-7s4fw\" (UID: \"60679719-f3ae-4a26-9827-5a0293035317\") " pod="openshift-monitoring/metrics-server-76ddf9975b-7s4fw"
Jul 09 18:27:03.414096 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:27:03.414089    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/60679719-f3ae-4a26-9827-5a0293035317-metrics-server-audit-profiles\") pod \"metrics-server-76ddf9975b-7s4fw\" (UID: \"60679719-f3ae-4a26-9827-5a0293035317\") " pod="openshift-monitoring/metrics-server-76ddf9975b-7s4fw"
Jul 09 18:27:03.414215 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:27:03.414114    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/60679719-f3ae-4a26-9827-5a0293035317-client-ca-bundle\") pod \"metrics-server-76ddf9975b-7s4fw\" (UID: \"60679719-f3ae-4a26-9827-5a0293035317\") " pod="openshift-monitoring/metrics-server-76ddf9975b-7s4fw"
Jul 09 18:27:03.514816 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:27:03.514691    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zkt4f\" (UniqueName: \"kubernetes.io/projected/60679719-f3ae-4a26-9827-5a0293035317-kube-api-access-zkt4f\") pod \"metrics-server-76ddf9975b-7s4fw\" (UID: \"60679719-f3ae-4a26-9827-5a0293035317\") " pod="openshift-monitoring/metrics-server-76ddf9975b-7s4fw"
Jul 09 18:27:03.514816 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:27:03.514742    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/60679719-f3ae-4a26-9827-5a0293035317-audit-log\") pod \"metrics-server-76ddf9975b-7s4fw\" (UID: \"60679719-f3ae-4a26-9827-5a0293035317\") " pod="openshift-monitoring/metrics-server-76ddf9975b-7s4fw"
Jul 09 18:27:03.515091 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:27:03.514907    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/60679719-f3ae-4a26-9827-5a0293035317-metrics-server-audit-profiles\") pod \"metrics-server-76ddf9975b-7s4fw\" (UID: \"60679719-f3ae-4a26-9827-5a0293035317\") " pod="openshift-monitoring/metrics-server-76ddf9975b-7s4fw"
Jul 09 18:27:03.515091 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:27:03.514973    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/60679719-f3ae-4a26-9827-5a0293035317-client-ca-bundle\") pod \"metrics-server-76ddf9975b-7s4fw\" (UID: \"60679719-f3ae-4a26-9827-5a0293035317\") " pod="openshift-monitoring/metrics-server-76ddf9975b-7s4fw"
Jul 09 18:27:03.515091 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:27:03.515078    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/60679719-f3ae-4a26-9827-5a0293035317-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-76ddf9975b-7s4fw\" (UID: \"60679719-f3ae-4a26-9827-5a0293035317\") " pod="openshift-monitoring/metrics-server-76ddf9975b-7s4fw"
Jul 09 18:27:03.515245 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:27:03.515118    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/60679719-f3ae-4a26-9827-5a0293035317-secret-metrics-server-client-certs\") pod \"metrics-server-76ddf9975b-7s4fw\" (UID: \"60679719-f3ae-4a26-9827-5a0293035317\") " pod="openshift-monitoring/metrics-server-76ddf9975b-7s4fw"
Jul 09 18:27:03.515245 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:27:03.515154    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/60679719-f3ae-4a26-9827-5a0293035317-audit-log\") pod \"metrics-server-76ddf9975b-7s4fw\" (UID: \"60679719-f3ae-4a26-9827-5a0293035317\") " pod="openshift-monitoring/metrics-server-76ddf9975b-7s4fw"
Jul 09 18:27:03.515245 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:27:03.515179    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/60679719-f3ae-4a26-9827-5a0293035317-secret-metrics-server-tls\") pod \"metrics-server-76ddf9975b-7s4fw\" (UID: \"60679719-f3ae-4a26-9827-5a0293035317\") " pod="openshift-monitoring/metrics-server-76ddf9975b-7s4fw"
Jul 09 18:27:03.515880 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:27:03.515825    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/60679719-f3ae-4a26-9827-5a0293035317-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-76ddf9975b-7s4fw\" (UID: \"60679719-f3ae-4a26-9827-5a0293035317\") " pod="openshift-monitoring/metrics-server-76ddf9975b-7s4fw"
Jul 09 18:27:03.516030 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:27:03.515997    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/60679719-f3ae-4a26-9827-5a0293035317-metrics-server-audit-profiles\") pod \"metrics-server-76ddf9975b-7s4fw\" (UID: \"60679719-f3ae-4a26-9827-5a0293035317\") " pod="openshift-monitoring/metrics-server-76ddf9975b-7s4fw"
Jul 09 18:27:03.518057 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:27:03.518035    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/60679719-f3ae-4a26-9827-5a0293035317-secret-metrics-server-client-certs\") pod \"metrics-server-76ddf9975b-7s4fw\" (UID: \"60679719-f3ae-4a26-9827-5a0293035317\") " pod="openshift-monitoring/metrics-server-76ddf9975b-7s4fw"
Jul 09 18:27:03.518168 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:27:03.518122    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/60679719-f3ae-4a26-9827-5a0293035317-client-ca-bundle\") pod \"metrics-server-76ddf9975b-7s4fw\" (UID: \"60679719-f3ae-4a26-9827-5a0293035317\") " pod="openshift-monitoring/metrics-server-76ddf9975b-7s4fw"
Jul 09 18:27:03.518336 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:27:03.518317    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/60679719-f3ae-4a26-9827-5a0293035317-secret-metrics-server-tls\") pod \"metrics-server-76ddf9975b-7s4fw\" (UID: \"60679719-f3ae-4a26-9827-5a0293035317\") " pod="openshift-monitoring/metrics-server-76ddf9975b-7s4fw"
Jul 09 18:27:03.532473 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:27:03.532444    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zkt4f\" (UniqueName: \"kubernetes.io/projected/60679719-f3ae-4a26-9827-5a0293035317-kube-api-access-zkt4f\") pod \"metrics-server-76ddf9975b-7s4fw\" (UID: \"60679719-f3ae-4a26-9827-5a0293035317\") " pod="openshift-monitoring/metrics-server-76ddf9975b-7s4fw"
Jul 09 18:27:03.562872 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:27:03.562841    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-5f68df7f58-9bstm"]
Jul 09 18:27:03.567241 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:27:03.567221    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-9bstm"
Jul 09 18:27:03.570514 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:27:03.570470    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-78fpr\""
Jul 09 18:27:03.570598 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:27:03.570543    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\""
Jul 09 18:27:03.577310 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:27:03.577271    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-76ddf9975b-7s4fw"
Jul 09 18:27:03.607115 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:27:03.607081    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-5f68df7f58-9bstm"]
Jul 09 18:27:03.716544 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:27:03.716447    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bzs9p\" (UniqueName: \"kubernetes.io/projected/5f9f12a5-4aaf-46c8-8385-a9aac79713c2-kube-api-access-bzs9p\") pod \"monitoring-plugin-5f68df7f58-9bstm\" (UID: \"5f9f12a5-4aaf-46c8-8385-a9aac79713c2\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-9bstm"
Jul 09 18:27:03.717011 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:27:03.716603    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/5f9f12a5-4aaf-46c8-8385-a9aac79713c2-monitoring-plugin-cert\") pod \"monitoring-plugin-5f68df7f58-9bstm\" (UID: \"5f9f12a5-4aaf-46c8-8385-a9aac79713c2\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-9bstm"
Jul 09 18:27:03.720337 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:27:03.720313    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-76ddf9975b-7s4fw"]
Jul 09 18:27:03.721102 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:27:03.721078    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod60679719_f3ae_4a26_9827_5a0293035317.slice/crio-3a55896f4f8664b0261695c3fe3357e51224c4efd7d1a9f2260dc29eb209a178 WatchSource:0}: Error finding container 3a55896f4f8664b0261695c3fe3357e51224c4efd7d1a9f2260dc29eb209a178: Status 404 returned error can't find the container with id 3a55896f4f8664b0261695c3fe3357e51224c4efd7d1a9f2260dc29eb209a178
Jul 09 18:27:03.818194 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:27:03.818158    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bzs9p\" (UniqueName: \"kubernetes.io/projected/5f9f12a5-4aaf-46c8-8385-a9aac79713c2-kube-api-access-bzs9p\") pod \"monitoring-plugin-5f68df7f58-9bstm\" (UID: \"5f9f12a5-4aaf-46c8-8385-a9aac79713c2\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-9bstm"
Jul 09 18:27:03.818389 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:27:03.818213    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/5f9f12a5-4aaf-46c8-8385-a9aac79713c2-monitoring-plugin-cert\") pod \"monitoring-plugin-5f68df7f58-9bstm\" (UID: \"5f9f12a5-4aaf-46c8-8385-a9aac79713c2\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-9bstm"
Jul 09 18:27:03.821380 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:27:03.821343    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/5f9f12a5-4aaf-46c8-8385-a9aac79713c2-monitoring-plugin-cert\") pod \"monitoring-plugin-5f68df7f58-9bstm\" (UID: \"5f9f12a5-4aaf-46c8-8385-a9aac79713c2\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-9bstm"
Jul 09 18:27:03.837418 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:27:03.837381    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bzs9p\" (UniqueName: \"kubernetes.io/projected/5f9f12a5-4aaf-46c8-8385-a9aac79713c2-kube-api-access-bzs9p\") pod \"monitoring-plugin-5f68df7f58-9bstm\" (UID: \"5f9f12a5-4aaf-46c8-8385-a9aac79713c2\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-9bstm"
Jul 09 18:27:03.878196 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:27:03.878126    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-9bstm"
Jul 09 18:27:04.037190 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:27:04.036832    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-5f68df7f58-9bstm"]
Jul 09 18:27:04.041658 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:27:04.041617    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5f9f12a5_4aaf_46c8_8385_a9aac79713c2.slice/crio-f90c709cb19818d7adfae34cb9b7bea97c4dd95a1876ff89a0cf7c55527b5936 WatchSource:0}: Error finding container f90c709cb19818d7adfae34cb9b7bea97c4dd95a1876ff89a0cf7c55527b5936: Status 404 returned error can't find the container with id f90c709cb19818d7adfae34cb9b7bea97c4dd95a1876ff89a0cf7c55527b5936
Jul 09 18:27:04.694901 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:27:04.694855    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-9bstm" event={"ID":"5f9f12a5-4aaf-46c8-8385-a9aac79713c2","Type":"ContainerStarted","Data":"f90c709cb19818d7adfae34cb9b7bea97c4dd95a1876ff89a0cf7c55527b5936"}
Jul 09 18:27:04.696298 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:27:04.696265    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-76ddf9975b-7s4fw" event={"ID":"60679719-f3ae-4a26-9827-5a0293035317","Type":"ContainerStarted","Data":"3a55896f4f8664b0261695c3fe3357e51224c4efd7d1a9f2260dc29eb209a178"}
Jul 09 18:27:04.974684 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:27:04.974584    2557 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-588b5c546d-7ssb9" podUID="cb5fba7f-844d-4dc3-9f9d-f77fe9d18eda" containerName="registry" containerID="cri-o://4f654af56da7f0977f5d7ac9473e10fb4de1404f31df22ce88bca52997368af1" gracePeriod=30
Jul 09 18:27:05.707181 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:27:05.707005    2557 generic.go:356] "Generic (PLEG): container finished" podID="cb5fba7f-844d-4dc3-9f9d-f77fe9d18eda" containerID="4f654af56da7f0977f5d7ac9473e10fb4de1404f31df22ce88bca52997368af1" exitCode=0
Jul 09 18:27:05.707181 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:27:05.707090    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-588b5c546d-7ssb9" event={"ID":"cb5fba7f-844d-4dc3-9f9d-f77fe9d18eda","Type":"ContainerDied","Data":"4f654af56da7f0977f5d7ac9473e10fb4de1404f31df22ce88bca52997368af1"}
Jul 09 18:27:05.833147 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:27:05.833123    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-588b5c546d-7ssb9"
Jul 09 18:27:05.938260 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:27:05.938226    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/cb5fba7f-844d-4dc3-9f9d-f77fe9d18eda-bound-sa-token\") pod \"cb5fba7f-844d-4dc3-9f9d-f77fe9d18eda\" (UID: \"cb5fba7f-844d-4dc3-9f9d-f77fe9d18eda\") "
Jul 09 18:27:05.938455 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:27:05.938265    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/cb5fba7f-844d-4dc3-9f9d-f77fe9d18eda-installation-pull-secrets\") pod \"cb5fba7f-844d-4dc3-9f9d-f77fe9d18eda\" (UID: \"cb5fba7f-844d-4dc3-9f9d-f77fe9d18eda\") "
Jul 09 18:27:05.938455 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:27:05.938301    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/cb5fba7f-844d-4dc3-9f9d-f77fe9d18eda-registry-tls\") pod \"cb5fba7f-844d-4dc3-9f9d-f77fe9d18eda\" (UID: \"cb5fba7f-844d-4dc3-9f9d-f77fe9d18eda\") "
Jul 09 18:27:05.938455 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:27:05.938327    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/cb5fba7f-844d-4dc3-9f9d-f77fe9d18eda-ca-trust-extracted\") pod \"cb5fba7f-844d-4dc3-9f9d-f77fe9d18eda\" (UID: \"cb5fba7f-844d-4dc3-9f9d-f77fe9d18eda\") "
Jul 09 18:27:05.938455 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:27:05.938352    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/cb5fba7f-844d-4dc3-9f9d-f77fe9d18eda-trusted-ca\") pod \"cb5fba7f-844d-4dc3-9f9d-f77fe9d18eda\" (UID: \"cb5fba7f-844d-4dc3-9f9d-f77fe9d18eda\") "
Jul 09 18:27:05.938455 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:27:05.938374    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fs7rw\" (UniqueName: \"kubernetes.io/projected/cb5fba7f-844d-4dc3-9f9d-f77fe9d18eda-kube-api-access-fs7rw\") pod \"cb5fba7f-844d-4dc3-9f9d-f77fe9d18eda\" (UID: \"cb5fba7f-844d-4dc3-9f9d-f77fe9d18eda\") "
Jul 09 18:27:05.938455 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:27:05.938439    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/cb5fba7f-844d-4dc3-9f9d-f77fe9d18eda-registry-certificates\") pod \"cb5fba7f-844d-4dc3-9f9d-f77fe9d18eda\" (UID: \"cb5fba7f-844d-4dc3-9f9d-f77fe9d18eda\") "
Jul 09 18:27:05.938785 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:27:05.938473    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/cb5fba7f-844d-4dc3-9f9d-f77fe9d18eda-image-registry-private-configuration\") pod \"cb5fba7f-844d-4dc3-9f9d-f77fe9d18eda\" (UID: \"cb5fba7f-844d-4dc3-9f9d-f77fe9d18eda\") "
Jul 09 18:27:05.939014 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:27:05.938978    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cb5fba7f-844d-4dc3-9f9d-f77fe9d18eda-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "cb5fba7f-844d-4dc3-9f9d-f77fe9d18eda" (UID: "cb5fba7f-844d-4dc3-9f9d-f77fe9d18eda"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 09 18:27:05.939389 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:27:05.939347    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cb5fba7f-844d-4dc3-9f9d-f77fe9d18eda-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "cb5fba7f-844d-4dc3-9f9d-f77fe9d18eda" (UID: "cb5fba7f-844d-4dc3-9f9d-f77fe9d18eda"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 09 18:27:05.941358 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:27:05.941314    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cb5fba7f-844d-4dc3-9f9d-f77fe9d18eda-kube-api-access-fs7rw" (OuterVolumeSpecName: "kube-api-access-fs7rw") pod "cb5fba7f-844d-4dc3-9f9d-f77fe9d18eda" (UID: "cb5fba7f-844d-4dc3-9f9d-f77fe9d18eda"). InnerVolumeSpecName "kube-api-access-fs7rw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 18:27:05.941459 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:27:05.941431    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cb5fba7f-844d-4dc3-9f9d-f77fe9d18eda-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "cb5fba7f-844d-4dc3-9f9d-f77fe9d18eda" (UID: "cb5fba7f-844d-4dc3-9f9d-f77fe9d18eda"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 18:27:05.941635 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:27:05.941581    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cb5fba7f-844d-4dc3-9f9d-f77fe9d18eda-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "cb5fba7f-844d-4dc3-9f9d-f77fe9d18eda" (UID: "cb5fba7f-844d-4dc3-9f9d-f77fe9d18eda"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 18:27:05.941635 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:27:05.941619    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cb5fba7f-844d-4dc3-9f9d-f77fe9d18eda-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "cb5fba7f-844d-4dc3-9f9d-f77fe9d18eda" (UID: "cb5fba7f-844d-4dc3-9f9d-f77fe9d18eda"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 18:27:05.941915 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:27:05.941886    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cb5fba7f-844d-4dc3-9f9d-f77fe9d18eda-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "cb5fba7f-844d-4dc3-9f9d-f77fe9d18eda" (UID: "cb5fba7f-844d-4dc3-9f9d-f77fe9d18eda"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 18:27:05.949696 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:27:05.949668    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cb5fba7f-844d-4dc3-9f9d-f77fe9d18eda-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "cb5fba7f-844d-4dc3-9f9d-f77fe9d18eda" (UID: "cb5fba7f-844d-4dc3-9f9d-f77fe9d18eda"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 18:27:06.040151 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:27:06.040122    2557 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/cb5fba7f-844d-4dc3-9f9d-f77fe9d18eda-registry-tls\") on node \"ip-10-0-141-101.ec2.internal\" DevicePath \"\""
Jul 09 18:27:06.040151 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:27:06.040152    2557 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/cb5fba7f-844d-4dc3-9f9d-f77fe9d18eda-ca-trust-extracted\") on node \"ip-10-0-141-101.ec2.internal\" DevicePath \"\""
Jul 09 18:27:06.040628 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:27:06.040162    2557 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/cb5fba7f-844d-4dc3-9f9d-f77fe9d18eda-trusted-ca\") on node \"ip-10-0-141-101.ec2.internal\" DevicePath \"\""
Jul 09 18:27:06.040628 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:27:06.040175    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fs7rw\" (UniqueName: \"kubernetes.io/projected/cb5fba7f-844d-4dc3-9f9d-f77fe9d18eda-kube-api-access-fs7rw\") on node \"ip-10-0-141-101.ec2.internal\" DevicePath \"\""
Jul 09 18:27:06.040628 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:27:06.040188    2557 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/cb5fba7f-844d-4dc3-9f9d-f77fe9d18eda-registry-certificates\") on node \"ip-10-0-141-101.ec2.internal\" DevicePath \"\""
Jul 09 18:27:06.040628 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:27:06.040203    2557 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/cb5fba7f-844d-4dc3-9f9d-f77fe9d18eda-image-registry-private-configuration\") on node \"ip-10-0-141-101.ec2.internal\" DevicePath \"\""
Jul 09 18:27:06.040628 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:27:06.040219    2557 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/cb5fba7f-844d-4dc3-9f9d-f77fe9d18eda-bound-sa-token\") on node \"ip-10-0-141-101.ec2.internal\" DevicePath \"\""
Jul 09 18:27:06.040628 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:27:06.040234    2557 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/cb5fba7f-844d-4dc3-9f9d-f77fe9d18eda-installation-pull-secrets\") on node \"ip-10-0-141-101.ec2.internal\" DevicePath \"\""
Jul 09 18:27:06.713175 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:27:06.713073    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-9bstm" event={"ID":"5f9f12a5-4aaf-46c8-8385-a9aac79713c2","Type":"ContainerStarted","Data":"c0c5f57aad690d00b099d0a2ac44cc94301af58e69d4c3447dd03abc0118fcaf"}
Jul 09 18:27:06.713335 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:27:06.713227    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-9bstm"
Jul 09 18:27:06.714501 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:27:06.714452    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-588b5c546d-7ssb9"
Jul 09 18:27:06.714649 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:27:06.714512    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-588b5c546d-7ssb9" event={"ID":"cb5fba7f-844d-4dc3-9f9d-f77fe9d18eda","Type":"ContainerDied","Data":"af37d7318433b5cf80f83caa6df9842fc80a61ae76650d01dc83afde2488f89d"}
Jul 09 18:27:06.714649 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:27:06.714579    2557 scope.go:117] "RemoveContainer" containerID="4f654af56da7f0977f5d7ac9473e10fb4de1404f31df22ce88bca52997368af1"
Jul 09 18:27:06.717275 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:27:06.717252    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6cc9d89b54-r4pjf" event={"ID":"a79d7993-1a36-4038-9893-d643dd8ce0c3","Type":"ContainerStarted","Data":"6620d62a03c41af5052b838b2f16b27165d2959720ff0d09205f88dc3e7c1a90"}
Jul 09 18:27:06.717389 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:27:06.717318    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6cc9d89b54-r4pjf" event={"ID":"a79d7993-1a36-4038-9893-d643dd8ce0c3","Type":"ContainerStarted","Data":"505c9efd3961c750867a2e7c85ddcecf8fc0d9c5efb7bf43b04a65a50f3b6949"}
Jul 09 18:27:06.717389 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:27:06.717358    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6cc9d89b54-r4pjf" event={"ID":"a79d7993-1a36-4038-9893-d643dd8ce0c3","Type":"ContainerStarted","Data":"6b0db4382574770bd2c8dfb1d39de58dea56fe3c8bb0532bd710063af5adff2e"}
Jul 09 18:27:06.719360 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:27:06.719336    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-76ddf9975b-7s4fw" event={"ID":"60679719-f3ae-4a26-9827-5a0293035317","Type":"ContainerStarted","Data":"f21f8ef8f3f92710f2a021db0ba23fff90b94e9c08d0b46f5466480917a304c2"}
Jul 09 18:27:06.719524 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:27:06.719502    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-9bstm"
Jul 09 18:27:06.731186 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:27:06.731141    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-9bstm" podStartSLOduration=1.551976963 podStartE2EDuration="3.731124979s" totalImagesPullingTime="2.179148016s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 18:27:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 18:27:06.73007922 +0000 UTC m=+95.969423846" watchObservedRunningTime="2026-07-09 18:27:06.731124979 +0000 UTC m=+95.970469604"
Jul 09 18:27:06.746981 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:27:06.746935    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-76ddf9975b-7s4fw" podStartSLOduration=1.208391326 podStartE2EDuration="3.746920066s" totalImagesPullingTime="2.53852874s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 18:27:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 18:27:06.746437666 +0000 UTC m=+95.985782294" watchObservedRunningTime="2026-07-09 18:27:06.746920066 +0000 UTC m=+95.986264693"
Jul 09 18:27:06.778225 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:27:06.778199    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-588b5c546d-7ssb9"]
Jul 09 18:27:06.785059 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:27:06.785030    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-588b5c546d-7ssb9"]
Jul 09 18:27:07.266035 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:27:07.266003    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cb5fba7f-844d-4dc3-9f9d-f77fe9d18eda" path="/var/lib/kubelet/pods/cb5fba7f-844d-4dc3-9f9d-f77fe9d18eda/volumes"
Jul 09 18:27:08.730959 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:27:08.730925    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6cc9d89b54-r4pjf" event={"ID":"a79d7993-1a36-4038-9893-d643dd8ce0c3","Type":"ContainerStarted","Data":"7553b95c4516ef6a55f58b3ca7b193c133430c347dd582314297bd38c6e89b20"}
Jul 09 18:27:08.731338 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:27:08.730984    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6cc9d89b54-r4pjf" event={"ID":"a79d7993-1a36-4038-9893-d643dd8ce0c3","Type":"ContainerStarted","Data":"456d3fd391dc79b9106fc5b44dae490040ffa84a793aa570d60c78b5c8b17f70"}
Jul 09 18:27:08.731338 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:27:08.731010    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6cc9d89b54-r4pjf" event={"ID":"a79d7993-1a36-4038-9893-d643dd8ce0c3","Type":"ContainerStarted","Data":"7676d0a30b10fc554f4e76cb7236e2b2f7a33f5c36107c7558d1b3c5532d57ef"}
Jul 09 18:27:08.764983 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:27:08.764945    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-784d944dbc-s575d"]
Jul 09 18:27:08.765288 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:27:08.765274    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cb5fba7f-844d-4dc3-9f9d-f77fe9d18eda" containerName="registry"
Jul 09 18:27:08.765335 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:27:08.765289    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="cb5fba7f-844d-4dc3-9f9d-f77fe9d18eda" containerName="registry"
Jul 09 18:27:08.765367 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:27:08.765339    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="cb5fba7f-844d-4dc3-9f9d-f77fe9d18eda" containerName="registry"
Jul 09 18:27:08.768531 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:27:08.768443    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-784d944dbc-s575d"
Jul 09 18:27:08.773232 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:27:08.773210    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Jul 09 18:27:08.773413 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:27:08.773395    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Jul 09 18:27:08.773517 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:27:08.773438    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Jul 09 18:27:08.773629 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:27:08.773614    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Jul 09 18:27:08.773692 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:27:08.773629    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Jul 09 18:27:08.773692 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:27:08.773614    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Jul 09 18:27:08.773776 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:27:08.773720    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-8bstw\""
Jul 09 18:27:08.773960 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:27:08.773947    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Jul 09 18:27:08.779207 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:27:08.779191    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Jul 09 18:27:08.785628 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:27:08.785587    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-6cc9d89b54-r4pjf" podStartSLOduration=2.501106047 podStartE2EDuration="7.785571272s" totalImagesPullingTime="5.284465225s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 18:27:01 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 18:27:08.768418757 +0000 UTC m=+98.007763423" watchObservedRunningTime="2026-07-09 18:27:08.785571272 +0000 UTC m=+98.024915898"
Jul 09 18:27:08.786303 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:27:08.786286    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-784d944dbc-s575d"]
Jul 09 18:27:08.868852 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:27:08.868810    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vj9kv\" (UniqueName: \"kubernetes.io/projected/713dbdfd-40f7-4d62-86a3-ab763c887da6-kube-api-access-vj9kv\") pod \"console-784d944dbc-s575d\" (UID: \"713dbdfd-40f7-4d62-86a3-ab763c887da6\") " pod="openshift-console/console-784d944dbc-s575d"
Jul 09 18:27:08.869040 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:27:08.868920    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/713dbdfd-40f7-4d62-86a3-ab763c887da6-oauth-serving-cert\") pod \"console-784d944dbc-s575d\" (UID: \"713dbdfd-40f7-4d62-86a3-ab763c887da6\") " pod="openshift-console/console-784d944dbc-s575d"
Jul 09 18:27:08.869102 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:27:08.869062    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/713dbdfd-40f7-4d62-86a3-ab763c887da6-console-config\") pod \"console-784d944dbc-s575d\" (UID: \"713dbdfd-40f7-4d62-86a3-ab763c887da6\") " pod="openshift-console/console-784d944dbc-s575d"
Jul 09 18:27:08.869154 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:27:08.869109    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/713dbdfd-40f7-4d62-86a3-ab763c887da6-trusted-ca-bundle\") pod \"console-784d944dbc-s575d\" (UID: \"713dbdfd-40f7-4d62-86a3-ab763c887da6\") " pod="openshift-console/console-784d944dbc-s575d"
Jul 09 18:27:08.869206 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:27:08.869173    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/713dbdfd-40f7-4d62-86a3-ab763c887da6-console-serving-cert\") pod \"console-784d944dbc-s575d\" (UID: \"713dbdfd-40f7-4d62-86a3-ab763c887da6\") " pod="openshift-console/console-784d944dbc-s575d"
Jul 09 18:27:08.869286 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:27:08.869243    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/713dbdfd-40f7-4d62-86a3-ab763c887da6-service-ca\") pod \"console-784d944dbc-s575d\" (UID: \"713dbdfd-40f7-4d62-86a3-ab763c887da6\") " pod="openshift-console/console-784d944dbc-s575d"
Jul 09 18:27:08.869522 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:27:08.869457    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/713dbdfd-40f7-4d62-86a3-ab763c887da6-console-oauth-config\") pod \"console-784d944dbc-s575d\" (UID: \"713dbdfd-40f7-4d62-86a3-ab763c887da6\") " pod="openshift-console/console-784d944dbc-s575d"
Jul 09 18:27:08.970779 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:27:08.970744    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/713dbdfd-40f7-4d62-86a3-ab763c887da6-console-serving-cert\") pod \"console-784d944dbc-s575d\" (UID: \"713dbdfd-40f7-4d62-86a3-ab763c887da6\") " pod="openshift-console/console-784d944dbc-s575d"
Jul 09 18:27:08.970779 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:27:08.970786    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/713dbdfd-40f7-4d62-86a3-ab763c887da6-service-ca\") pod \"console-784d944dbc-s575d\" (UID: \"713dbdfd-40f7-4d62-86a3-ab763c887da6\") " pod="openshift-console/console-784d944dbc-s575d"
Jul 09 18:27:08.971072 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:27:08.970896    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/713dbdfd-40f7-4d62-86a3-ab763c887da6-console-oauth-config\") pod \"console-784d944dbc-s575d\" (UID: \"713dbdfd-40f7-4d62-86a3-ab763c887da6\") " pod="openshift-console/console-784d944dbc-s575d"
Jul 09 18:27:08.971072 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:27:08.970925    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vj9kv\" (UniqueName: \"kubernetes.io/projected/713dbdfd-40f7-4d62-86a3-ab763c887da6-kube-api-access-vj9kv\") pod \"console-784d944dbc-s575d\" (UID: \"713dbdfd-40f7-4d62-86a3-ab763c887da6\") " pod="openshift-console/console-784d944dbc-s575d"
Jul 09 18:27:08.971072 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:27:08.970950    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/713dbdfd-40f7-4d62-86a3-ab763c887da6-oauth-serving-cert\") pod \"console-784d944dbc-s575d\" (UID: \"713dbdfd-40f7-4d62-86a3-ab763c887da6\") " pod="openshift-console/console-784d944dbc-s575d"
Jul 09 18:27:08.971072 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:27:08.970978    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/713dbdfd-40f7-4d62-86a3-ab763c887da6-console-config\") pod \"console-784d944dbc-s575d\" (UID: \"713dbdfd-40f7-4d62-86a3-ab763c887da6\") " pod="openshift-console/console-784d944dbc-s575d"
Jul 09 18:27:08.971072 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:27:08.971004    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/713dbdfd-40f7-4d62-86a3-ab763c887da6-trusted-ca-bundle\") pod \"console-784d944dbc-s575d\" (UID: \"713dbdfd-40f7-4d62-86a3-ab763c887da6\") " pod="openshift-console/console-784d944dbc-s575d"
Jul 09 18:27:08.971833 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:27:08.971805    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/713dbdfd-40f7-4d62-86a3-ab763c887da6-oauth-serving-cert\") pod \"console-784d944dbc-s575d\" (UID: \"713dbdfd-40f7-4d62-86a3-ab763c887da6\") " pod="openshift-console/console-784d944dbc-s575d"
Jul 09 18:27:08.971969 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:27:08.971809    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/713dbdfd-40f7-4d62-86a3-ab763c887da6-service-ca\") pod \"console-784d944dbc-s575d\" (UID: \"713dbdfd-40f7-4d62-86a3-ab763c887da6\") " pod="openshift-console/console-784d944dbc-s575d"
Jul 09 18:27:08.971969 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:27:08.971860    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/713dbdfd-40f7-4d62-86a3-ab763c887da6-console-config\") pod \"console-784d944dbc-s575d\" (UID: \"713dbdfd-40f7-4d62-86a3-ab763c887da6\") " pod="openshift-console/console-784d944dbc-s575d"
Jul 09 18:27:08.971969 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:27:08.971873    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/713dbdfd-40f7-4d62-86a3-ab763c887da6-trusted-ca-bundle\") pod \"console-784d944dbc-s575d\" (UID: \"713dbdfd-40f7-4d62-86a3-ab763c887da6\") " pod="openshift-console/console-784d944dbc-s575d"
Jul 09 18:27:08.973290 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:27:08.973267    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/713dbdfd-40f7-4d62-86a3-ab763c887da6-console-serving-cert\") pod \"console-784d944dbc-s575d\" (UID: \"713dbdfd-40f7-4d62-86a3-ab763c887da6\") " pod="openshift-console/console-784d944dbc-s575d"
Jul 09 18:27:08.973290 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:27:08.973290    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/713dbdfd-40f7-4d62-86a3-ab763c887da6-console-oauth-config\") pod \"console-784d944dbc-s575d\" (UID: \"713dbdfd-40f7-4d62-86a3-ab763c887da6\") " pod="openshift-console/console-784d944dbc-s575d"
Jul 09 18:27:08.986296 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:27:08.986236    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vj9kv\" (UniqueName: \"kubernetes.io/projected/713dbdfd-40f7-4d62-86a3-ab763c887da6-kube-api-access-vj9kv\") pod \"console-784d944dbc-s575d\" (UID: \"713dbdfd-40f7-4d62-86a3-ab763c887da6\") " pod="openshift-console/console-784d944dbc-s575d"
Jul 09 18:27:09.078259 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:27:09.078216    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-784d944dbc-s575d"
Jul 09 18:27:09.235917 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:27:09.235886    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-784d944dbc-s575d"]
Jul 09 18:27:09.239254 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:27:09.239220    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod713dbdfd_40f7_4d62_86a3_ab763c887da6.slice/crio-c079c819792e7f9292954d53cba0e06be3469052955aacee3206d885f9684de3 WatchSource:0}: Error finding container c079c819792e7f9292954d53cba0e06be3469052955aacee3206d885f9684de3: Status 404 returned error can't find the container with id c079c819792e7f9292954d53cba0e06be3469052955aacee3206d885f9684de3
Jul 09 18:27:09.735679 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:27:09.735643    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-784d944dbc-s575d" event={"ID":"713dbdfd-40f7-4d62-86a3-ab763c887da6","Type":"ContainerStarted","Data":"c079c819792e7f9292954d53cba0e06be3469052955aacee3206d885f9684de3"}
Jul 09 18:27:09.736186 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:27:09.736005    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-6cc9d89b54-r4pjf"
Jul 09 18:27:12.333783 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:27:12.333753    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-784d944dbc-s575d"]
Jul 09 18:27:12.397004 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:27:12.396957    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-f76c89c75-tv7vf"]
Jul 09 18:27:12.406137 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:27:12.406107    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-f76c89c75-tv7vf"
Jul 09 18:27:12.415663 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:27:12.415632    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-f76c89c75-tv7vf"]
Jul 09 18:27:12.501536 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:27:12.501499    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hq87h\" (UniqueName: \"kubernetes.io/projected/db7eefeb-40bf-49bb-b998-f10a30dfcd12-kube-api-access-hq87h\") pod \"console-f76c89c75-tv7vf\" (UID: \"db7eefeb-40bf-49bb-b998-f10a30dfcd12\") " pod="openshift-console/console-f76c89c75-tv7vf"
Jul 09 18:27:12.501721 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:27:12.501556    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/db7eefeb-40bf-49bb-b998-f10a30dfcd12-trusted-ca-bundle\") pod \"console-f76c89c75-tv7vf\" (UID: \"db7eefeb-40bf-49bb-b998-f10a30dfcd12\") " pod="openshift-console/console-f76c89c75-tv7vf"
Jul 09 18:27:12.501721 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:27:12.501586    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/db7eefeb-40bf-49bb-b998-f10a30dfcd12-service-ca\") pod \"console-f76c89c75-tv7vf\" (UID: \"db7eefeb-40bf-49bb-b998-f10a30dfcd12\") " pod="openshift-console/console-f76c89c75-tv7vf"
Jul 09 18:27:12.501721 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:27:12.501613    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/db7eefeb-40bf-49bb-b998-f10a30dfcd12-console-serving-cert\") pod \"console-f76c89c75-tv7vf\" (UID: \"db7eefeb-40bf-49bb-b998-f10a30dfcd12\") " pod="openshift-console/console-f76c89c75-tv7vf"
Jul 09 18:27:12.501893 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:27:12.501722    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/db7eefeb-40bf-49bb-b998-f10a30dfcd12-console-oauth-config\") pod \"console-f76c89c75-tv7vf\" (UID: \"db7eefeb-40bf-49bb-b998-f10a30dfcd12\") " pod="openshift-console/console-f76c89c75-tv7vf"
Jul 09 18:27:12.501893 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:27:12.501792    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/db7eefeb-40bf-49bb-b998-f10a30dfcd12-console-config\") pod \"console-f76c89c75-tv7vf\" (UID: \"db7eefeb-40bf-49bb-b998-f10a30dfcd12\") " pod="openshift-console/console-f76c89c75-tv7vf"
Jul 09 18:27:12.501893 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:27:12.501822    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/db7eefeb-40bf-49bb-b998-f10a30dfcd12-oauth-serving-cert\") pod \"console-f76c89c75-tv7vf\" (UID: \"db7eefeb-40bf-49bb-b998-f10a30dfcd12\") " pod="openshift-console/console-f76c89c75-tv7vf"
Jul 09 18:27:12.603141 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:27:12.603114    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/db7eefeb-40bf-49bb-b998-f10a30dfcd12-console-config\") pod \"console-f76c89c75-tv7vf\" (UID: \"db7eefeb-40bf-49bb-b998-f10a30dfcd12\") " pod="openshift-console/console-f76c89c75-tv7vf"
Jul 09 18:27:12.603277 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:27:12.603150    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/db7eefeb-40bf-49bb-b998-f10a30dfcd12-oauth-serving-cert\") pod \"console-f76c89c75-tv7vf\" (UID: \"db7eefeb-40bf-49bb-b998-f10a30dfcd12\") " pod="openshift-console/console-f76c89c75-tv7vf"
Jul 09 18:27:12.603277 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:27:12.603189    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hq87h\" (UniqueName: \"kubernetes.io/projected/db7eefeb-40bf-49bb-b998-f10a30dfcd12-kube-api-access-hq87h\") pod \"console-f76c89c75-tv7vf\" (UID: \"db7eefeb-40bf-49bb-b998-f10a30dfcd12\") " pod="openshift-console/console-f76c89c75-tv7vf"
Jul 09 18:27:12.603277 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:27:12.603227    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/db7eefeb-40bf-49bb-b998-f10a30dfcd12-trusted-ca-bundle\") pod \"console-f76c89c75-tv7vf\" (UID: \"db7eefeb-40bf-49bb-b998-f10a30dfcd12\") " pod="openshift-console/console-f76c89c75-tv7vf"
Jul 09 18:27:12.603462 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:27:12.603293    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/db7eefeb-40bf-49bb-b998-f10a30dfcd12-service-ca\") pod \"console-f76c89c75-tv7vf\" (UID: \"db7eefeb-40bf-49bb-b998-f10a30dfcd12\") " pod="openshift-console/console-f76c89c75-tv7vf"
Jul 09 18:27:12.603462 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:27:12.603336    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/db7eefeb-40bf-49bb-b998-f10a30dfcd12-console-serving-cert\") pod \"console-f76c89c75-tv7vf\" (UID: \"db7eefeb-40bf-49bb-b998-f10a30dfcd12\") " pod="openshift-console/console-f76c89c75-tv7vf"
Jul 09 18:27:12.603462 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:27:12.603385    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/db7eefeb-40bf-49bb-b998-f10a30dfcd12-console-oauth-config\") pod \"console-f76c89c75-tv7vf\" (UID: \"db7eefeb-40bf-49bb-b998-f10a30dfcd12\") " pod="openshift-console/console-f76c89c75-tv7vf"
Jul 09 18:27:12.603804 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:27:12.603778    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/db7eefeb-40bf-49bb-b998-f10a30dfcd12-oauth-serving-cert\") pod \"console-f76c89c75-tv7vf\" (UID: \"db7eefeb-40bf-49bb-b998-f10a30dfcd12\") " pod="openshift-console/console-f76c89c75-tv7vf"
Jul 09 18:27:12.603898 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:27:12.603862    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/db7eefeb-40bf-49bb-b998-f10a30dfcd12-console-config\") pod \"console-f76c89c75-tv7vf\" (UID: \"db7eefeb-40bf-49bb-b998-f10a30dfcd12\") " pod="openshift-console/console-f76c89c75-tv7vf"
Jul 09 18:27:12.604261 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:27:12.604237    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/db7eefeb-40bf-49bb-b998-f10a30dfcd12-service-ca\") pod \"console-f76c89c75-tv7vf\" (UID: \"db7eefeb-40bf-49bb-b998-f10a30dfcd12\") " pod="openshift-console/console-f76c89c75-tv7vf"
Jul 09 18:27:12.604343 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:27:12.604258    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/db7eefeb-40bf-49bb-b998-f10a30dfcd12-trusted-ca-bundle\") pod \"console-f76c89c75-tv7vf\" (UID: \"db7eefeb-40bf-49bb-b998-f10a30dfcd12\") " pod="openshift-console/console-f76c89c75-tv7vf"
Jul 09 18:27:12.605855 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:27:12.605831    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/db7eefeb-40bf-49bb-b998-f10a30dfcd12-console-serving-cert\") pod \"console-f76c89c75-tv7vf\" (UID: \"db7eefeb-40bf-49bb-b998-f10a30dfcd12\") " pod="openshift-console/console-f76c89c75-tv7vf"
Jul 09 18:27:12.606020 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:27:12.606003    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/db7eefeb-40bf-49bb-b998-f10a30dfcd12-console-oauth-config\") pod \"console-f76c89c75-tv7vf\" (UID: \"db7eefeb-40bf-49bb-b998-f10a30dfcd12\") " pod="openshift-console/console-f76c89c75-tv7vf"
Jul 09 18:27:12.612525 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:27:12.612472    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hq87h\" (UniqueName: \"kubernetes.io/projected/db7eefeb-40bf-49bb-b998-f10a30dfcd12-kube-api-access-hq87h\") pod \"console-f76c89c75-tv7vf\" (UID: \"db7eefeb-40bf-49bb-b998-f10a30dfcd12\") " pod="openshift-console/console-f76c89c75-tv7vf"
Jul 09 18:27:12.718319 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:27:12.718281    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-f76c89c75-tv7vf"
Jul 09 18:27:12.750577 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:27:12.750530    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-784d944dbc-s575d" event={"ID":"713dbdfd-40f7-4d62-86a3-ab763c887da6","Type":"ContainerStarted","Data":"5f0b1a2ce7b5d1f78d50c175f7451832c5af41ea169881922711b097e9ceb3ce"}
Jul 09 18:27:12.774748 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:27:12.772813    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-784d944dbc-s575d" podStartSLOduration=1.438319786 podStartE2EDuration="4.772791239s" totalImagesPullingTime="3.334471453s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 18:27:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 18:27:12.771013746 +0000 UTC m=+102.010358397" watchObservedRunningTime="2026-07-09 18:27:12.772791239 +0000 UTC m=+102.012135868"
Jul 09 18:27:12.870971 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:27:12.870756    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-f76c89c75-tv7vf"]
Jul 09 18:27:12.873439 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:27:12.873412    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddb7eefeb_40bf_49bb_b998_f10a30dfcd12.slice/crio-1a613982bc509b7876be22a8b67aaffc2a8340bd379282ad308072e3fe2ec5bf WatchSource:0}: Error finding container 1a613982bc509b7876be22a8b67aaffc2a8340bd379282ad308072e3fe2ec5bf: Status 404 returned error can't find the container with id 1a613982bc509b7876be22a8b67aaffc2a8340bd379282ad308072e3fe2ec5bf
Jul 09 18:27:13.755366 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:27:13.755272    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-f76c89c75-tv7vf" event={"ID":"db7eefeb-40bf-49bb-b998-f10a30dfcd12","Type":"ContainerStarted","Data":"d951ee73de411dfdbf8e28bb90634124751c69ac95c50b23932be42820455e6a"}
Jul 09 18:27:13.755366 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:27:13.755339    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-f76c89c75-tv7vf" event={"ID":"db7eefeb-40bf-49bb-b998-f10a30dfcd12","Type":"ContainerStarted","Data":"1a613982bc509b7876be22a8b67aaffc2a8340bd379282ad308072e3fe2ec5bf"}
Jul 09 18:27:13.776239 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:27:13.776161    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-f76c89c75-tv7vf" podStartSLOduration=1.7761382220000002 podStartE2EDuration="1.776138222s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 18:27:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 18:27:13.775215837 +0000 UTC m=+103.014560478" watchObservedRunningTime="2026-07-09 18:27:13.776138222 +0000 UTC m=+103.015482845"
Jul 09 18:27:15.746961 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:27:15.746928    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-6cc9d89b54-r4pjf"
Jul 09 18:27:19.078865 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:27:19.078826    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-784d944dbc-s575d"
Jul 09 18:27:19.626852 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:27:19.626817    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-j7h7r"
Jul 09 18:27:22.719431 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:27:22.719395    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-f76c89c75-tv7vf"
Jul 09 18:27:22.719925 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:27:22.719454    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-f76c89c75-tv7vf"
Jul 09 18:27:22.724411 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:27:22.724391    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-f76c89c75-tv7vf"
Jul 09 18:27:22.797243 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:27:22.797214    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-f76c89c75-tv7vf"
Jul 09 18:27:23.578395 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:27:23.578356    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-76ddf9975b-7s4fw"
Jul 09 18:27:23.578599 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:27:23.578415    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-76ddf9975b-7s4fw"
Jul 09 18:27:37.772850 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:27:37.772789    2557 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-784d944dbc-s575d" podUID="713dbdfd-40f7-4d62-86a3-ab763c887da6" containerName="console" containerID="cri-o://5f0b1a2ce7b5d1f78d50c175f7451832c5af41ea169881922711b097e9ceb3ce" gracePeriod=15
Jul 09 18:27:37.810343 ip-10-0-141-101 kubenswrapper[2557]: E0709 18:27:37.810304    2557 cadvisor_stats_provider.go:567] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod713dbdfd_40f7_4d62_86a3_ab763c887da6.slice/crio-conmon-5f0b1a2ce7b5d1f78d50c175f7451832c5af41ea169881922711b097e9ceb3ce.scope\": RecentStats: unable to find data in memory cache]"
Jul 09 18:27:38.017974 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:27:38.017949    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-784d944dbc-s575d"
Jul 09 18:27:38.128275 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:27:38.128241    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/713dbdfd-40f7-4d62-86a3-ab763c887da6-console-serving-cert\") pod \"713dbdfd-40f7-4d62-86a3-ab763c887da6\" (UID: \"713dbdfd-40f7-4d62-86a3-ab763c887da6\") "
Jul 09 18:27:38.128275 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:27:38.128278    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/713dbdfd-40f7-4d62-86a3-ab763c887da6-console-oauth-config\") pod \"713dbdfd-40f7-4d62-86a3-ab763c887da6\" (UID: \"713dbdfd-40f7-4d62-86a3-ab763c887da6\") "
Jul 09 18:27:38.128542 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:27:38.128312    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/713dbdfd-40f7-4d62-86a3-ab763c887da6-trusted-ca-bundle\") pod \"713dbdfd-40f7-4d62-86a3-ab763c887da6\" (UID: \"713dbdfd-40f7-4d62-86a3-ab763c887da6\") "
Jul 09 18:27:38.128542 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:27:38.128384    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vj9kv\" (UniqueName: \"kubernetes.io/projected/713dbdfd-40f7-4d62-86a3-ab763c887da6-kube-api-access-vj9kv\") pod \"713dbdfd-40f7-4d62-86a3-ab763c887da6\" (UID: \"713dbdfd-40f7-4d62-86a3-ab763c887da6\") "
Jul 09 18:27:38.128542 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:27:38.128440    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/713dbdfd-40f7-4d62-86a3-ab763c887da6-service-ca\") pod \"713dbdfd-40f7-4d62-86a3-ab763c887da6\" (UID: \"713dbdfd-40f7-4d62-86a3-ab763c887da6\") "
Jul 09 18:27:38.128542 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:27:38.128504    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/713dbdfd-40f7-4d62-86a3-ab763c887da6-console-config\") pod \"713dbdfd-40f7-4d62-86a3-ab763c887da6\" (UID: \"713dbdfd-40f7-4d62-86a3-ab763c887da6\") "
Jul 09 18:27:38.128750 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:27:38.128560    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/713dbdfd-40f7-4d62-86a3-ab763c887da6-oauth-serving-cert\") pod \"713dbdfd-40f7-4d62-86a3-ab763c887da6\" (UID: \"713dbdfd-40f7-4d62-86a3-ab763c887da6\") "
Jul 09 18:27:38.128863 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:27:38.128834    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/713dbdfd-40f7-4d62-86a3-ab763c887da6-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "713dbdfd-40f7-4d62-86a3-ab763c887da6" (UID: "713dbdfd-40f7-4d62-86a3-ab763c887da6"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 09 18:27:38.128925 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:27:38.128878    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/713dbdfd-40f7-4d62-86a3-ab763c887da6-console-config" (OuterVolumeSpecName: "console-config") pod "713dbdfd-40f7-4d62-86a3-ab763c887da6" (UID: "713dbdfd-40f7-4d62-86a3-ab763c887da6"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 09 18:27:38.128925 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:27:38.128873    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/713dbdfd-40f7-4d62-86a3-ab763c887da6-service-ca" (OuterVolumeSpecName: "service-ca") pod "713dbdfd-40f7-4d62-86a3-ab763c887da6" (UID: "713dbdfd-40f7-4d62-86a3-ab763c887da6"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 09 18:27:38.129128 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:27:38.129106    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/713dbdfd-40f7-4d62-86a3-ab763c887da6-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "713dbdfd-40f7-4d62-86a3-ab763c887da6" (UID: "713dbdfd-40f7-4d62-86a3-ab763c887da6"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 09 18:27:38.130691 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:27:38.130668    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/713dbdfd-40f7-4d62-86a3-ab763c887da6-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "713dbdfd-40f7-4d62-86a3-ab763c887da6" (UID: "713dbdfd-40f7-4d62-86a3-ab763c887da6"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 18:27:38.131031 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:27:38.131003    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/713dbdfd-40f7-4d62-86a3-ab763c887da6-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "713dbdfd-40f7-4d62-86a3-ab763c887da6" (UID: "713dbdfd-40f7-4d62-86a3-ab763c887da6"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 18:27:38.131031 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:27:38.131008    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/713dbdfd-40f7-4d62-86a3-ab763c887da6-kube-api-access-vj9kv" (OuterVolumeSpecName: "kube-api-access-vj9kv") pod "713dbdfd-40f7-4d62-86a3-ab763c887da6" (UID: "713dbdfd-40f7-4d62-86a3-ab763c887da6"). InnerVolumeSpecName "kube-api-access-vj9kv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 18:27:38.229872 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:27:38.229831    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vj9kv\" (UniqueName: \"kubernetes.io/projected/713dbdfd-40f7-4d62-86a3-ab763c887da6-kube-api-access-vj9kv\") on node \"ip-10-0-141-101.ec2.internal\" DevicePath \"\""
Jul 09 18:27:38.229872 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:27:38.229866    2557 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/713dbdfd-40f7-4d62-86a3-ab763c887da6-service-ca\") on node \"ip-10-0-141-101.ec2.internal\" DevicePath \"\""
Jul 09 18:27:38.229872 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:27:38.229876    2557 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/713dbdfd-40f7-4d62-86a3-ab763c887da6-console-config\") on node \"ip-10-0-141-101.ec2.internal\" DevicePath \"\""
Jul 09 18:27:38.229872 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:27:38.229884    2557 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/713dbdfd-40f7-4d62-86a3-ab763c887da6-oauth-serving-cert\") on node \"ip-10-0-141-101.ec2.internal\" DevicePath \"\""
Jul 09 18:27:38.230134 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:27:38.229892    2557 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/713dbdfd-40f7-4d62-86a3-ab763c887da6-console-serving-cert\") on node \"ip-10-0-141-101.ec2.internal\" DevicePath \"\""
Jul 09 18:27:38.230134 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:27:38.229901    2557 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/713dbdfd-40f7-4d62-86a3-ab763c887da6-console-oauth-config\") on node \"ip-10-0-141-101.ec2.internal\" DevicePath \"\""
Jul 09 18:27:38.230134 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:27:38.229909    2557 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/713dbdfd-40f7-4d62-86a3-ab763c887da6-trusted-ca-bundle\") on node \"ip-10-0-141-101.ec2.internal\" DevicePath \"\""
Jul 09 18:27:38.851702 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:27:38.851665    2557 generic.go:356] "Generic (PLEG): container finished" podID="713dbdfd-40f7-4d62-86a3-ab763c887da6" containerID="5f0b1a2ce7b5d1f78d50c175f7451832c5af41ea169881922711b097e9ceb3ce" exitCode=0
Jul 09 18:27:38.852077 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:27:38.851709    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-784d944dbc-s575d"
Jul 09 18:27:38.852077 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:27:38.851740    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-784d944dbc-s575d" event={"ID":"713dbdfd-40f7-4d62-86a3-ab763c887da6","Type":"ContainerDied","Data":"5f0b1a2ce7b5d1f78d50c175f7451832c5af41ea169881922711b097e9ceb3ce"}
Jul 09 18:27:38.852077 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:27:38.851780    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-784d944dbc-s575d" event={"ID":"713dbdfd-40f7-4d62-86a3-ab763c887da6","Type":"ContainerDied","Data":"c079c819792e7f9292954d53cba0e06be3469052955aacee3206d885f9684de3"}
Jul 09 18:27:38.852077 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:27:38.851800    2557 scope.go:117] "RemoveContainer" containerID="5f0b1a2ce7b5d1f78d50c175f7451832c5af41ea169881922711b097e9ceb3ce"
Jul 09 18:27:38.860143 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:27:38.860126    2557 scope.go:117] "RemoveContainer" containerID="5f0b1a2ce7b5d1f78d50c175f7451832c5af41ea169881922711b097e9ceb3ce"
Jul 09 18:27:38.860410 ip-10-0-141-101 kubenswrapper[2557]: E0709 18:27:38.860390    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5f0b1a2ce7b5d1f78d50c175f7451832c5af41ea169881922711b097e9ceb3ce\": container with ID starting with 5f0b1a2ce7b5d1f78d50c175f7451832c5af41ea169881922711b097e9ceb3ce not found: ID does not exist" containerID="5f0b1a2ce7b5d1f78d50c175f7451832c5af41ea169881922711b097e9ceb3ce"
Jul 09 18:27:38.860461 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:27:38.860419    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5f0b1a2ce7b5d1f78d50c175f7451832c5af41ea169881922711b097e9ceb3ce"} err="failed to get container status \"5f0b1a2ce7b5d1f78d50c175f7451832c5af41ea169881922711b097e9ceb3ce\": rpc error: code = NotFound desc = could not find container \"5f0b1a2ce7b5d1f78d50c175f7451832c5af41ea169881922711b097e9ceb3ce\": container with ID starting with 5f0b1a2ce7b5d1f78d50c175f7451832c5af41ea169881922711b097e9ceb3ce not found: ID does not exist"
Jul 09 18:27:38.877772 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:27:38.877746    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-784d944dbc-s575d"]
Jul 09 18:27:38.883442 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:27:38.883420    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-784d944dbc-s575d"]
Jul 09 18:27:39.260786 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:27:39.260709    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="713dbdfd-40f7-4d62-86a3-ab763c887da6" path="/var/lib/kubelet/pods/713dbdfd-40f7-4d62-86a3-ab763c887da6/volumes"
Jul 09 18:27:42.869626 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:27:42.869589    2557 generic.go:356] "Generic (PLEG): container finished" podID="d5871ae2-0cbd-4038-8269-6343110b7b56" containerID="72140fa0877e3c4801e289862686c10c13e676cc967d90ec0a972472703e8cbe" exitCode=0
Jul 09 18:27:42.870089 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:27:42.869652    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-kqj92" event={"ID":"d5871ae2-0cbd-4038-8269-6343110b7b56","Type":"ContainerDied","Data":"72140fa0877e3c4801e289862686c10c13e676cc967d90ec0a972472703e8cbe"}
Jul 09 18:27:42.870089 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:27:42.869970    2557 scope.go:117] "RemoveContainer" containerID="72140fa0877e3c4801e289862686c10c13e676cc967d90ec0a972472703e8cbe"
Jul 09 18:27:43.584697 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:27:43.584668    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-76ddf9975b-7s4fw"
Jul 09 18:27:43.588741 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:27:43.588712    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-76ddf9975b-7s4fw"
Jul 09 18:27:43.875587 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:27:43.875493    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-kqj92" event={"ID":"d5871ae2-0cbd-4038-8269-6343110b7b56","Type":"ContainerStarted","Data":"84118585375a15352c22bacc64c4c711a28a0e6b5ee1a1ac14ac5a078f192f80"}
Jul 09 18:28:40.294159 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:28:40.294121    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-5564d575bf-vsck4"]
Jul 09 18:28:40.294599 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:28:40.294416    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="713dbdfd-40f7-4d62-86a3-ab763c887da6" containerName="console"
Jul 09 18:28:40.294599 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:28:40.294427    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="713dbdfd-40f7-4d62-86a3-ab763c887da6" containerName="console"
Jul 09 18:28:40.294599 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:28:40.294524    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="713dbdfd-40f7-4d62-86a3-ab763c887da6" containerName="console"
Jul 09 18:28:40.298618 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:28:40.298600    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5564d575bf-vsck4"
Jul 09 18:28:40.337604 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:28:40.337566    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5564d575bf-vsck4"]
Jul 09 18:28:40.470280 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:28:40.470243    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/6fad3f7e-c1f8-4509-b143-042254135cfa-console-oauth-config\") pod \"console-5564d575bf-vsck4\" (UID: \"6fad3f7e-c1f8-4509-b143-042254135cfa\") " pod="openshift-console/console-5564d575bf-vsck4"
Jul 09 18:28:40.470514 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:28:40.470309    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mpxnz\" (UniqueName: \"kubernetes.io/projected/6fad3f7e-c1f8-4509-b143-042254135cfa-kube-api-access-mpxnz\") pod \"console-5564d575bf-vsck4\" (UID: \"6fad3f7e-c1f8-4509-b143-042254135cfa\") " pod="openshift-console/console-5564d575bf-vsck4"
Jul 09 18:28:40.470514 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:28:40.470385    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/6fad3f7e-c1f8-4509-b143-042254135cfa-console-serving-cert\") pod \"console-5564d575bf-vsck4\" (UID: \"6fad3f7e-c1f8-4509-b143-042254135cfa\") " pod="openshift-console/console-5564d575bf-vsck4"
Jul 09 18:28:40.470514 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:28:40.470416    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/6fad3f7e-c1f8-4509-b143-042254135cfa-oauth-serving-cert\") pod \"console-5564d575bf-vsck4\" (UID: \"6fad3f7e-c1f8-4509-b143-042254135cfa\") " pod="openshift-console/console-5564d575bf-vsck4"
Jul 09 18:28:40.470514 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:28:40.470440    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/6fad3f7e-c1f8-4509-b143-042254135cfa-console-config\") pod \"console-5564d575bf-vsck4\" (UID: \"6fad3f7e-c1f8-4509-b143-042254135cfa\") " pod="openshift-console/console-5564d575bf-vsck4"
Jul 09 18:28:40.470699 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:28:40.470522    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6fad3f7e-c1f8-4509-b143-042254135cfa-trusted-ca-bundle\") pod \"console-5564d575bf-vsck4\" (UID: \"6fad3f7e-c1f8-4509-b143-042254135cfa\") " pod="openshift-console/console-5564d575bf-vsck4"
Jul 09 18:28:40.470699 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:28:40.470556    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/6fad3f7e-c1f8-4509-b143-042254135cfa-service-ca\") pod \"console-5564d575bf-vsck4\" (UID: \"6fad3f7e-c1f8-4509-b143-042254135cfa\") " pod="openshift-console/console-5564d575bf-vsck4"
Jul 09 18:28:40.571045 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:28:40.570951    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mpxnz\" (UniqueName: \"kubernetes.io/projected/6fad3f7e-c1f8-4509-b143-042254135cfa-kube-api-access-mpxnz\") pod \"console-5564d575bf-vsck4\" (UID: \"6fad3f7e-c1f8-4509-b143-042254135cfa\") " pod="openshift-console/console-5564d575bf-vsck4"
Jul 09 18:28:40.571045 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:28:40.570991    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/6fad3f7e-c1f8-4509-b143-042254135cfa-console-serving-cert\") pod \"console-5564d575bf-vsck4\" (UID: \"6fad3f7e-c1f8-4509-b143-042254135cfa\") " pod="openshift-console/console-5564d575bf-vsck4"
Jul 09 18:28:40.571045 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:28:40.571006    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/6fad3f7e-c1f8-4509-b143-042254135cfa-oauth-serving-cert\") pod \"console-5564d575bf-vsck4\" (UID: \"6fad3f7e-c1f8-4509-b143-042254135cfa\") " pod="openshift-console/console-5564d575bf-vsck4"
Jul 09 18:28:40.571045 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:28:40.571027    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/6fad3f7e-c1f8-4509-b143-042254135cfa-console-config\") pod \"console-5564d575bf-vsck4\" (UID: \"6fad3f7e-c1f8-4509-b143-042254135cfa\") " pod="openshift-console/console-5564d575bf-vsck4"
Jul 09 18:28:40.571376 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:28:40.571067    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6fad3f7e-c1f8-4509-b143-042254135cfa-trusted-ca-bundle\") pod \"console-5564d575bf-vsck4\" (UID: \"6fad3f7e-c1f8-4509-b143-042254135cfa\") " pod="openshift-console/console-5564d575bf-vsck4"
Jul 09 18:28:40.571376 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:28:40.571106    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/6fad3f7e-c1f8-4509-b143-042254135cfa-service-ca\") pod \"console-5564d575bf-vsck4\" (UID: \"6fad3f7e-c1f8-4509-b143-042254135cfa\") " pod="openshift-console/console-5564d575bf-vsck4"
Jul 09 18:28:40.571376 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:28:40.571163    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/6fad3f7e-c1f8-4509-b143-042254135cfa-console-oauth-config\") pod \"console-5564d575bf-vsck4\" (UID: \"6fad3f7e-c1f8-4509-b143-042254135cfa\") " pod="openshift-console/console-5564d575bf-vsck4"
Jul 09 18:28:40.571834 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:28:40.571810    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/6fad3f7e-c1f8-4509-b143-042254135cfa-console-config\") pod \"console-5564d575bf-vsck4\" (UID: \"6fad3f7e-c1f8-4509-b143-042254135cfa\") " pod="openshift-console/console-5564d575bf-vsck4"
Jul 09 18:28:40.571939 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:28:40.571880    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/6fad3f7e-c1f8-4509-b143-042254135cfa-oauth-serving-cert\") pod \"console-5564d575bf-vsck4\" (UID: \"6fad3f7e-c1f8-4509-b143-042254135cfa\") " pod="openshift-console/console-5564d575bf-vsck4"
Jul 09 18:28:40.571982 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:28:40.571934    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/6fad3f7e-c1f8-4509-b143-042254135cfa-service-ca\") pod \"console-5564d575bf-vsck4\" (UID: \"6fad3f7e-c1f8-4509-b143-042254135cfa\") " pod="openshift-console/console-5564d575bf-vsck4"
Jul 09 18:28:40.572109 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:28:40.572090    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6fad3f7e-c1f8-4509-b143-042254135cfa-trusted-ca-bundle\") pod \"console-5564d575bf-vsck4\" (UID: \"6fad3f7e-c1f8-4509-b143-042254135cfa\") " pod="openshift-console/console-5564d575bf-vsck4"
Jul 09 18:28:40.574027 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:28:40.574006    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/6fad3f7e-c1f8-4509-b143-042254135cfa-console-serving-cert\") pod \"console-5564d575bf-vsck4\" (UID: \"6fad3f7e-c1f8-4509-b143-042254135cfa\") " pod="openshift-console/console-5564d575bf-vsck4"
Jul 09 18:28:40.574109 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:28:40.574042    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/6fad3f7e-c1f8-4509-b143-042254135cfa-console-oauth-config\") pod \"console-5564d575bf-vsck4\" (UID: \"6fad3f7e-c1f8-4509-b143-042254135cfa\") " pod="openshift-console/console-5564d575bf-vsck4"
Jul 09 18:28:40.582744 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:28:40.582724    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mpxnz\" (UniqueName: \"kubernetes.io/projected/6fad3f7e-c1f8-4509-b143-042254135cfa-kube-api-access-mpxnz\") pod \"console-5564d575bf-vsck4\" (UID: \"6fad3f7e-c1f8-4509-b143-042254135cfa\") " pod="openshift-console/console-5564d575bf-vsck4"
Jul 09 18:28:40.607920 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:28:40.607890    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5564d575bf-vsck4"
Jul 09 18:28:40.753454 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:28:40.753289    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5564d575bf-vsck4"]
Jul 09 18:28:40.756192 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:28:40.756164    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6fad3f7e_c1f8_4509_b143_042254135cfa.slice/crio-c967326fd9925005cc6f3cda44949ff6d175b9530ff08c3f9b2dbdcd5fd79615 WatchSource:0}: Error finding container c967326fd9925005cc6f3cda44949ff6d175b9530ff08c3f9b2dbdcd5fd79615: Status 404 returned error can't find the container with id c967326fd9925005cc6f3cda44949ff6d175b9530ff08c3f9b2dbdcd5fd79615
Jul 09 18:28:41.094973 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:28:41.094933    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5564d575bf-vsck4" event={"ID":"6fad3f7e-c1f8-4509-b143-042254135cfa","Type":"ContainerStarted","Data":"3dc3ee9ad1c485baf1c85d9eae248362ca17e3a1710193ffaaae8df415d0ad2b"}
Jul 09 18:28:41.095161 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:28:41.094992    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5564d575bf-vsck4" event={"ID":"6fad3f7e-c1f8-4509-b143-042254135cfa","Type":"ContainerStarted","Data":"c967326fd9925005cc6f3cda44949ff6d175b9530ff08c3f9b2dbdcd5fd79615"}
Jul 09 18:28:41.132195 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:28:41.132129    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-5564d575bf-vsck4" podStartSLOduration=1.1321130799999999 podStartE2EDuration="1.13211308s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 18:28:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 18:28:41.130445064 +0000 UTC m=+190.369789709" watchObservedRunningTime="2026-07-09 18:28:41.13211308 +0000 UTC m=+190.371457706"
Jul 09 18:28:50.608081 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:28:50.608025    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-5564d575bf-vsck4"
Jul 09 18:28:50.608614 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:28:50.608117    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-5564d575bf-vsck4"
Jul 09 18:28:50.612874 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:28:50.612852    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-5564d575bf-vsck4"
Jul 09 18:28:51.139771 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:28:51.139735    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-5564d575bf-vsck4"
Jul 09 18:28:51.214650 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:28:51.214616    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-f76c89c75-tv7vf"]
Jul 09 18:29:01.490574 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:29:01.490536    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e6754075629"]
Jul 09 18:29:01.493966 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:29:01.493947    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e6754075629"
Jul 09 18:29:01.498345 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:29:01.498325    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Jul 09 18:29:01.498925 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:29:01.498909    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Jul 09 18:29:01.499924 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:29:01.499886    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-5rb4f\""
Jul 09 18:29:01.508614 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:29:01.508591    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e6754075629"]
Jul 09 18:29:01.538689 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:29:01.538655    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2jrm4\" (UniqueName: \"kubernetes.io/projected/186ab558-7ceb-45f4-9d36-2159077e5e44-kube-api-access-2jrm4\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e6754075629\" (UID: \"186ab558-7ceb-45f4-9d36-2159077e5e44\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e6754075629"
Jul 09 18:29:01.538847 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:29:01.538719    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/186ab558-7ceb-45f4-9d36-2159077e5e44-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e6754075629\" (UID: \"186ab558-7ceb-45f4-9d36-2159077e5e44\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e6754075629"
Jul 09 18:29:01.538847 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:29:01.538765    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/186ab558-7ceb-45f4-9d36-2159077e5e44-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e6754075629\" (UID: \"186ab558-7ceb-45f4-9d36-2159077e5e44\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e6754075629"
Jul 09 18:29:01.639110 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:29:01.639081    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2jrm4\" (UniqueName: \"kubernetes.io/projected/186ab558-7ceb-45f4-9d36-2159077e5e44-kube-api-access-2jrm4\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e6754075629\" (UID: \"186ab558-7ceb-45f4-9d36-2159077e5e44\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e6754075629"
Jul 09 18:29:01.639274 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:29:01.639139    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/186ab558-7ceb-45f4-9d36-2159077e5e44-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e6754075629\" (UID: \"186ab558-7ceb-45f4-9d36-2159077e5e44\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e6754075629"
Jul 09 18:29:01.639274 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:29:01.639189    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/186ab558-7ceb-45f4-9d36-2159077e5e44-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e6754075629\" (UID: \"186ab558-7ceb-45f4-9d36-2159077e5e44\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e6754075629"
Jul 09 18:29:01.639632 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:29:01.639612    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/186ab558-7ceb-45f4-9d36-2159077e5e44-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e6754075629\" (UID: \"186ab558-7ceb-45f4-9d36-2159077e5e44\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e6754075629"
Jul 09 18:29:01.639677 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:29:01.639622    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/186ab558-7ceb-45f4-9d36-2159077e5e44-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e6754075629\" (UID: \"186ab558-7ceb-45f4-9d36-2159077e5e44\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e6754075629"
Jul 09 18:29:01.649268 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:29:01.649239    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2jrm4\" (UniqueName: \"kubernetes.io/projected/186ab558-7ceb-45f4-9d36-2159077e5e44-kube-api-access-2jrm4\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e6754075629\" (UID: \"186ab558-7ceb-45f4-9d36-2159077e5e44\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e6754075629"
Jul 09 18:29:01.803073 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:29:01.803045    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e6754075629"
Jul 09 18:29:01.935645 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:29:01.935609    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e6754075629"]
Jul 09 18:29:01.938687 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:29:01.938658    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod186ab558_7ceb_45f4_9d36_2159077e5e44.slice/crio-5aa879dddc099888c3bd3860e0c70f147d9141a9e15a2df5071b006ff0e793a3 WatchSource:0}: Error finding container 5aa879dddc099888c3bd3860e0c70f147d9141a9e15a2df5071b006ff0e793a3: Status 404 returned error can't find the container with id 5aa879dddc099888c3bd3860e0c70f147d9141a9e15a2df5071b006ff0e793a3
Jul 09 18:29:02.178684 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:29:02.178591    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e6754075629" event={"ID":"186ab558-7ceb-45f4-9d36-2159077e5e44","Type":"ContainerStarted","Data":"5aa879dddc099888c3bd3860e0c70f147d9141a9e15a2df5071b006ff0e793a3"}
Jul 09 18:29:08.205134 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:29:08.205094    2557 generic.go:356] "Generic (PLEG): container finished" podID="186ab558-7ceb-45f4-9d36-2159077e5e44" containerID="1548ca7fafb9e58902357d6c3f430206be42bfd82403edec7dafd7af62d9d5e7" exitCode=0
Jul 09 18:29:08.205591 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:29:08.205158    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e6754075629" event={"ID":"186ab558-7ceb-45f4-9d36-2159077e5e44","Type":"ContainerDied","Data":"1548ca7fafb9e58902357d6c3f430206be42bfd82403edec7dafd7af62d9d5e7"}
Jul 09 18:29:11.219594 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:29:11.219558    2557 generic.go:356] "Generic (PLEG): container finished" podID="186ab558-7ceb-45f4-9d36-2159077e5e44" containerID="536f3a0e58595aa4b99272d096ae849a6d6e38c7e1c36421f94ac3154993c402" exitCode=0
Jul 09 18:29:11.220004 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:29:11.219653    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e6754075629" event={"ID":"186ab558-7ceb-45f4-9d36-2159077e5e44","Type":"ContainerDied","Data":"536f3a0e58595aa4b99272d096ae849a6d6e38c7e1c36421f94ac3154993c402"}
Jul 09 18:29:16.235088 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:29:16.235015    2557 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-f76c89c75-tv7vf" podUID="db7eefeb-40bf-49bb-b998-f10a30dfcd12" containerName="console" containerID="cri-o://d951ee73de411dfdbf8e28bb90634124751c69ac95c50b23932be42820455e6a" gracePeriod=15
Jul 09 18:29:16.509575 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:29:16.509545    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-f76c89c75-tv7vf"
Jul 09 18:29:16.571509 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:29:16.571465    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/db7eefeb-40bf-49bb-b998-f10a30dfcd12-service-ca\") pod \"db7eefeb-40bf-49bb-b998-f10a30dfcd12\" (UID: \"db7eefeb-40bf-49bb-b998-f10a30dfcd12\") "
Jul 09 18:29:16.571695 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:29:16.571528    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/db7eefeb-40bf-49bb-b998-f10a30dfcd12-console-config\") pod \"db7eefeb-40bf-49bb-b998-f10a30dfcd12\" (UID: \"db7eefeb-40bf-49bb-b998-f10a30dfcd12\") "
Jul 09 18:29:16.571695 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:29:16.571573    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hq87h\" (UniqueName: \"kubernetes.io/projected/db7eefeb-40bf-49bb-b998-f10a30dfcd12-kube-api-access-hq87h\") pod \"db7eefeb-40bf-49bb-b998-f10a30dfcd12\" (UID: \"db7eefeb-40bf-49bb-b998-f10a30dfcd12\") "
Jul 09 18:29:16.571695 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:29:16.571620    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/db7eefeb-40bf-49bb-b998-f10a30dfcd12-oauth-serving-cert\") pod \"db7eefeb-40bf-49bb-b998-f10a30dfcd12\" (UID: \"db7eefeb-40bf-49bb-b998-f10a30dfcd12\") "
Jul 09 18:29:16.571695 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:29:16.571683    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/db7eefeb-40bf-49bb-b998-f10a30dfcd12-console-serving-cert\") pod \"db7eefeb-40bf-49bb-b998-f10a30dfcd12\" (UID: \"db7eefeb-40bf-49bb-b998-f10a30dfcd12\") "
Jul 09 18:29:16.571904 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:29:16.571705    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/db7eefeb-40bf-49bb-b998-f10a30dfcd12-console-oauth-config\") pod \"db7eefeb-40bf-49bb-b998-f10a30dfcd12\" (UID: \"db7eefeb-40bf-49bb-b998-f10a30dfcd12\") "
Jul 09 18:29:16.571904 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:29:16.571733    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/db7eefeb-40bf-49bb-b998-f10a30dfcd12-trusted-ca-bundle\") pod \"db7eefeb-40bf-49bb-b998-f10a30dfcd12\" (UID: \"db7eefeb-40bf-49bb-b998-f10a30dfcd12\") "
Jul 09 18:29:16.572013 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:29:16.571976    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/db7eefeb-40bf-49bb-b998-f10a30dfcd12-service-ca" (OuterVolumeSpecName: "service-ca") pod "db7eefeb-40bf-49bb-b998-f10a30dfcd12" (UID: "db7eefeb-40bf-49bb-b998-f10a30dfcd12"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 09 18:29:16.572142 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:29:16.572077    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/db7eefeb-40bf-49bb-b998-f10a30dfcd12-console-config" (OuterVolumeSpecName: "console-config") pod "db7eefeb-40bf-49bb-b998-f10a30dfcd12" (UID: "db7eefeb-40bf-49bb-b998-f10a30dfcd12"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 09 18:29:16.572320 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:29:16.572282    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/db7eefeb-40bf-49bb-b998-f10a30dfcd12-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "db7eefeb-40bf-49bb-b998-f10a30dfcd12" (UID: "db7eefeb-40bf-49bb-b998-f10a30dfcd12"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 09 18:29:16.572431 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:29:16.572335    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/db7eefeb-40bf-49bb-b998-f10a30dfcd12-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "db7eefeb-40bf-49bb-b998-f10a30dfcd12" (UID: "db7eefeb-40bf-49bb-b998-f10a30dfcd12"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 09 18:29:16.574227 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:29:16.574196    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/db7eefeb-40bf-49bb-b998-f10a30dfcd12-kube-api-access-hq87h" (OuterVolumeSpecName: "kube-api-access-hq87h") pod "db7eefeb-40bf-49bb-b998-f10a30dfcd12" (UID: "db7eefeb-40bf-49bb-b998-f10a30dfcd12"). InnerVolumeSpecName "kube-api-access-hq87h". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 18:29:16.574227 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:29:16.574211    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/db7eefeb-40bf-49bb-b998-f10a30dfcd12-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "db7eefeb-40bf-49bb-b998-f10a30dfcd12" (UID: "db7eefeb-40bf-49bb-b998-f10a30dfcd12"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 18:29:16.574364 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:29:16.574295    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/db7eefeb-40bf-49bb-b998-f10a30dfcd12-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "db7eefeb-40bf-49bb-b998-f10a30dfcd12" (UID: "db7eefeb-40bf-49bb-b998-f10a30dfcd12"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 18:29:16.672787 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:29:16.672742    2557 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/db7eefeb-40bf-49bb-b998-f10a30dfcd12-console-serving-cert\") on node \"ip-10-0-141-101.ec2.internal\" DevicePath \"\""
Jul 09 18:29:16.672787 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:29:16.672782    2557 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/db7eefeb-40bf-49bb-b998-f10a30dfcd12-console-oauth-config\") on node \"ip-10-0-141-101.ec2.internal\" DevicePath \"\""
Jul 09 18:29:16.672787 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:29:16.672794    2557 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/db7eefeb-40bf-49bb-b998-f10a30dfcd12-trusted-ca-bundle\") on node \"ip-10-0-141-101.ec2.internal\" DevicePath \"\""
Jul 09 18:29:16.673032 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:29:16.672810    2557 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/db7eefeb-40bf-49bb-b998-f10a30dfcd12-service-ca\") on node \"ip-10-0-141-101.ec2.internal\" DevicePath \"\""
Jul 09 18:29:16.673032 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:29:16.672821    2557 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/db7eefeb-40bf-49bb-b998-f10a30dfcd12-console-config\") on node \"ip-10-0-141-101.ec2.internal\" DevicePath \"\""
Jul 09 18:29:16.673032 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:29:16.672829    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hq87h\" (UniqueName: \"kubernetes.io/projected/db7eefeb-40bf-49bb-b998-f10a30dfcd12-kube-api-access-hq87h\") on node \"ip-10-0-141-101.ec2.internal\" DevicePath \"\""
Jul 09 18:29:16.673032 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:29:16.672838    2557 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/db7eefeb-40bf-49bb-b998-f10a30dfcd12-oauth-serving-cert\") on node \"ip-10-0-141-101.ec2.internal\" DevicePath \"\""
Jul 09 18:29:17.247703 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:29:17.247655    2557 generic.go:356] "Generic (PLEG): container finished" podID="db7eefeb-40bf-49bb-b998-f10a30dfcd12" containerID="d951ee73de411dfdbf8e28bb90634124751c69ac95c50b23932be42820455e6a" exitCode=0
Jul 09 18:29:17.248171 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:29:17.247713    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-f76c89c75-tv7vf"
Jul 09 18:29:17.248171 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:29:17.247751    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-f76c89c75-tv7vf" event={"ID":"db7eefeb-40bf-49bb-b998-f10a30dfcd12","Type":"ContainerDied","Data":"d951ee73de411dfdbf8e28bb90634124751c69ac95c50b23932be42820455e6a"}
Jul 09 18:29:17.248171 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:29:17.247823    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-f76c89c75-tv7vf" event={"ID":"db7eefeb-40bf-49bb-b998-f10a30dfcd12","Type":"ContainerDied","Data":"1a613982bc509b7876be22a8b67aaffc2a8340bd379282ad308072e3fe2ec5bf"}
Jul 09 18:29:17.248320 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:29:17.248160    2557 scope.go:117] "RemoveContainer" containerID="d951ee73de411dfdbf8e28bb90634124751c69ac95c50b23932be42820455e6a"
Jul 09 18:29:17.275056 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:29:17.275018    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-f76c89c75-tv7vf"]
Jul 09 18:29:17.281023 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:29:17.280993    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-f76c89c75-tv7vf"]
Jul 09 18:29:18.839935 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:29:18.839790    2557 scope.go:117] "RemoveContainer" containerID="d951ee73de411dfdbf8e28bb90634124751c69ac95c50b23932be42820455e6a"
Jul 09 18:29:18.840214 ip-10-0-141-101 kubenswrapper[2557]: E0709 18:29:18.840154    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d951ee73de411dfdbf8e28bb90634124751c69ac95c50b23932be42820455e6a\": container with ID starting with d951ee73de411dfdbf8e28bb90634124751c69ac95c50b23932be42820455e6a not found: ID does not exist" containerID="d951ee73de411dfdbf8e28bb90634124751c69ac95c50b23932be42820455e6a"
Jul 09 18:29:18.840214 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:29:18.840191    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d951ee73de411dfdbf8e28bb90634124751c69ac95c50b23932be42820455e6a"} err="failed to get container status \"d951ee73de411dfdbf8e28bb90634124751c69ac95c50b23932be42820455e6a\": rpc error: code = NotFound desc = could not find container \"d951ee73de411dfdbf8e28bb90634124751c69ac95c50b23932be42820455e6a\": container with ID starting with d951ee73de411dfdbf8e28bb90634124751c69ac95c50b23932be42820455e6a not found: ID does not exist"
Jul 09 18:29:19.258724 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:29:19.258628    2557 generic.go:356] "Generic (PLEG): container finished" podID="186ab558-7ceb-45f4-9d36-2159077e5e44" containerID="d7ff7e6f676ca493b8cd53d1c6a5ce62347849d1371e2d64324ce5880cde4b79" exitCode=0
Jul 09 18:29:19.260591 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:29:19.260566    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="db7eefeb-40bf-49bb-b998-f10a30dfcd12" path="/var/lib/kubelet/pods/db7eefeb-40bf-49bb-b998-f10a30dfcd12/volumes"
Jul 09 18:29:19.260834 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:29:19.260816    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e6754075629" event={"ID":"186ab558-7ceb-45f4-9d36-2159077e5e44","Type":"ContainerDied","Data":"d7ff7e6f676ca493b8cd53d1c6a5ce62347849d1371e2d64324ce5880cde4b79"}
Jul 09 18:29:20.389697 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:29:20.389670    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e6754075629"
Jul 09 18:29:20.508168 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:29:20.508129    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/186ab558-7ceb-45f4-9d36-2159077e5e44-bundle\") pod \"186ab558-7ceb-45f4-9d36-2159077e5e44\" (UID: \"186ab558-7ceb-45f4-9d36-2159077e5e44\") "
Jul 09 18:29:20.508357 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:29:20.508187    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/186ab558-7ceb-45f4-9d36-2159077e5e44-util\") pod \"186ab558-7ceb-45f4-9d36-2159077e5e44\" (UID: \"186ab558-7ceb-45f4-9d36-2159077e5e44\") "
Jul 09 18:29:20.508357 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:29:20.508267    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2jrm4\" (UniqueName: \"kubernetes.io/projected/186ab558-7ceb-45f4-9d36-2159077e5e44-kube-api-access-2jrm4\") pod \"186ab558-7ceb-45f4-9d36-2159077e5e44\" (UID: \"186ab558-7ceb-45f4-9d36-2159077e5e44\") "
Jul 09 18:29:20.508883 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:29:20.508845    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/186ab558-7ceb-45f4-9d36-2159077e5e44-bundle" (OuterVolumeSpecName: "bundle") pod "186ab558-7ceb-45f4-9d36-2159077e5e44" (UID: "186ab558-7ceb-45f4-9d36-2159077e5e44"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 18:29:20.510539 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:29:20.510514    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/186ab558-7ceb-45f4-9d36-2159077e5e44-kube-api-access-2jrm4" (OuterVolumeSpecName: "kube-api-access-2jrm4") pod "186ab558-7ceb-45f4-9d36-2159077e5e44" (UID: "186ab558-7ceb-45f4-9d36-2159077e5e44"). InnerVolumeSpecName "kube-api-access-2jrm4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 18:29:20.512113 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:29:20.512091    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/186ab558-7ceb-45f4-9d36-2159077e5e44-util" (OuterVolumeSpecName: "util") pod "186ab558-7ceb-45f4-9d36-2159077e5e44" (UID: "186ab558-7ceb-45f4-9d36-2159077e5e44"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 18:29:20.608963 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:29:20.608917    2557 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/186ab558-7ceb-45f4-9d36-2159077e5e44-util\") on node \"ip-10-0-141-101.ec2.internal\" DevicePath \"\""
Jul 09 18:29:20.608963 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:29:20.608965    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2jrm4\" (UniqueName: \"kubernetes.io/projected/186ab558-7ceb-45f4-9d36-2159077e5e44-kube-api-access-2jrm4\") on node \"ip-10-0-141-101.ec2.internal\" DevicePath \"\""
Jul 09 18:29:20.609240 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:29:20.608982    2557 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/186ab558-7ceb-45f4-9d36-2159077e5e44-bundle\") on node \"ip-10-0-141-101.ec2.internal\" DevicePath \"\""
Jul 09 18:29:21.268447 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:29:21.268413    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e6754075629" event={"ID":"186ab558-7ceb-45f4-9d36-2159077e5e44","Type":"ContainerDied","Data":"5aa879dddc099888c3bd3860e0c70f147d9141a9e15a2df5071b006ff0e793a3"}
Jul 09 18:29:21.268594 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:29:21.268450    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e6754075629"
Jul 09 18:29:21.268594 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:29:21.268456    2557 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="5aa879dddc099888c3bd3860e0c70f147d9141a9e15a2df5071b006ff0e793a3"
Jul 09 18:29:29.241521 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:29:29.241470    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-dn2dw"]
Jul 09 18:29:29.242147 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:29:29.241798    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="186ab558-7ceb-45f4-9d36-2159077e5e44" containerName="util"
Jul 09 18:29:29.242147 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:29:29.241808    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="186ab558-7ceb-45f4-9d36-2159077e5e44" containerName="util"
Jul 09 18:29:29.242147 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:29:29.241817    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="186ab558-7ceb-45f4-9d36-2159077e5e44" containerName="extract"
Jul 09 18:29:29.242147 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:29:29.241822    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="186ab558-7ceb-45f4-9d36-2159077e5e44" containerName="extract"
Jul 09 18:29:29.242147 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:29:29.241837    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="186ab558-7ceb-45f4-9d36-2159077e5e44" containerName="pull"
Jul 09 18:29:29.242147 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:29:29.241843    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="186ab558-7ceb-45f4-9d36-2159077e5e44" containerName="pull"
Jul 09 18:29:29.242147 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:29:29.241854    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="db7eefeb-40bf-49bb-b998-f10a30dfcd12" containerName="console"
Jul 09 18:29:29.242147 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:29:29.241860    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="db7eefeb-40bf-49bb-b998-f10a30dfcd12" containerName="console"
Jul 09 18:29:29.242147 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:29:29.241902    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="db7eefeb-40bf-49bb-b998-f10a30dfcd12" containerName="console"
Jul 09 18:29:29.242147 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:29:29.241909    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="186ab558-7ceb-45f4-9d36-2159077e5e44" containerName="extract"
Jul 09 18:29:29.246329 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:29:29.246309    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-dn2dw"
Jul 09 18:29:29.248858 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:29:29.248835    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
Jul 09 18:29:29.249661 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:29:29.249636    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-pcmmk\""
Jul 09 18:29:29.249765 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:29:29.249639    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
Jul 09 18:29:29.254717 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:29:29.254690    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-dn2dw"]
Jul 09 18:29:29.384860 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:29:29.384822    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/667beea9-c79b-4482-a5cf-a9c3780aef24-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-dn2dw\" (UID: \"667beea9-c79b-4482-a5cf-a9c3780aef24\") " pod="cert-manager/cert-manager-webhook-6486ffd997-dn2dw"
Jul 09 18:29:29.385062 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:29:29.384884    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ksswl\" (UniqueName: \"kubernetes.io/projected/667beea9-c79b-4482-a5cf-a9c3780aef24-kube-api-access-ksswl\") pod \"cert-manager-webhook-6486ffd997-dn2dw\" (UID: \"667beea9-c79b-4482-a5cf-a9c3780aef24\") " pod="cert-manager/cert-manager-webhook-6486ffd997-dn2dw"
Jul 09 18:29:29.486170 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:29:29.486122    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ksswl\" (UniqueName: \"kubernetes.io/projected/667beea9-c79b-4482-a5cf-a9c3780aef24-kube-api-access-ksswl\") pod \"cert-manager-webhook-6486ffd997-dn2dw\" (UID: \"667beea9-c79b-4482-a5cf-a9c3780aef24\") " pod="cert-manager/cert-manager-webhook-6486ffd997-dn2dw"
Jul 09 18:29:29.486365 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:29:29.486230    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/667beea9-c79b-4482-a5cf-a9c3780aef24-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-dn2dw\" (UID: \"667beea9-c79b-4482-a5cf-a9c3780aef24\") " pod="cert-manager/cert-manager-webhook-6486ffd997-dn2dw"
Jul 09 18:29:29.496534 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:29:29.496453    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/667beea9-c79b-4482-a5cf-a9c3780aef24-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-dn2dw\" (UID: \"667beea9-c79b-4482-a5cf-a9c3780aef24\") " pod="cert-manager/cert-manager-webhook-6486ffd997-dn2dw"
Jul 09 18:29:29.502178 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:29:29.502152    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ksswl\" (UniqueName: \"kubernetes.io/projected/667beea9-c79b-4482-a5cf-a9c3780aef24-kube-api-access-ksswl\") pod \"cert-manager-webhook-6486ffd997-dn2dw\" (UID: \"667beea9-c79b-4482-a5cf-a9c3780aef24\") " pod="cert-manager/cert-manager-webhook-6486ffd997-dn2dw"
Jul 09 18:29:29.555992 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:29:29.555959    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-dn2dw"
Jul 09 18:29:29.680823 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:29:29.680784    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-dn2dw"]
Jul 09 18:29:29.683622 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:29:29.683596    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod667beea9_c79b_4482_a5cf_a9c3780aef24.slice/crio-28b67cf0e605d1acbc194d0593552440ef4e2c8f8396d1fe6c38e7e8a2dbd1ea WatchSource:0}: Error finding container 28b67cf0e605d1acbc194d0593552440ef4e2c8f8396d1fe6c38e7e8a2dbd1ea: Status 404 returned error can't find the container with id 28b67cf0e605d1acbc194d0593552440ef4e2c8f8396d1fe6c38e7e8a2dbd1ea
Jul 09 18:29:30.303298 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:29:30.303261    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-dn2dw" event={"ID":"667beea9-c79b-4482-a5cf-a9c3780aef24","Type":"ContainerStarted","Data":"28b67cf0e605d1acbc194d0593552440ef4e2c8f8396d1fe6c38e7e8a2dbd1ea"}
Jul 09 18:29:33.317687 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:29:33.317644    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-dn2dw" event={"ID":"667beea9-c79b-4482-a5cf-a9c3780aef24","Type":"ContainerStarted","Data":"203ac5070217e2e634445093f3cfae90267426bbb775c8f39cb1232cdceef663"}
Jul 09 18:29:33.318033 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:29:33.317710    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-6486ffd997-dn2dw"
Jul 09 18:29:33.350509 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:29:33.350439    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-6486ffd997-dn2dw" podStartSLOduration=1.5966345149999999 podStartE2EDuration="4.350421401s" totalImagesPullingTime="2.753786886s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 18:29:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 18:29:33.350281704 +0000 UTC m=+242.589626351" watchObservedRunningTime="2026-07-09 18:29:33.350421401 +0000 UTC m=+242.589766026"
Jul 09 18:29:39.323943 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:29:39.323911    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-6486ffd997-dn2dw"
Jul 09 18:29:48.779884 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:29:48.779849    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-55b4d954d5-l29zj"]
Jul 09 18:29:48.781978 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:29:48.781962    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-l29zj"
Jul 09 18:29:48.784327 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:29:48.784309    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-q4kzl\""
Jul 09 18:29:48.792731 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:29:48.792706    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-l29zj"]
Jul 09 18:29:48.956776 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:29:48.956737    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d2zm8\" (UniqueName: \"kubernetes.io/projected/0faff540-160e-4a83-9a74-b7714e08c3bc-kube-api-access-d2zm8\") pod \"cert-manager-55b4d954d5-l29zj\" (UID: \"0faff540-160e-4a83-9a74-b7714e08c3bc\") " pod="cert-manager/cert-manager-55b4d954d5-l29zj"
Jul 09 18:29:48.956962 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:29:48.956823    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/0faff540-160e-4a83-9a74-b7714e08c3bc-bound-sa-token\") pod \"cert-manager-55b4d954d5-l29zj\" (UID: \"0faff540-160e-4a83-9a74-b7714e08c3bc\") " pod="cert-manager/cert-manager-55b4d954d5-l29zj"
Jul 09 18:29:49.058082 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:29:49.058046    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/0faff540-160e-4a83-9a74-b7714e08c3bc-bound-sa-token\") pod \"cert-manager-55b4d954d5-l29zj\" (UID: \"0faff540-160e-4a83-9a74-b7714e08c3bc\") " pod="cert-manager/cert-manager-55b4d954d5-l29zj"
Jul 09 18:29:49.058240 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:29:49.058098    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d2zm8\" (UniqueName: \"kubernetes.io/projected/0faff540-160e-4a83-9a74-b7714e08c3bc-kube-api-access-d2zm8\") pod \"cert-manager-55b4d954d5-l29zj\" (UID: \"0faff540-160e-4a83-9a74-b7714e08c3bc\") " pod="cert-manager/cert-manager-55b4d954d5-l29zj"
Jul 09 18:29:49.067043 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:29:49.067009    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/0faff540-160e-4a83-9a74-b7714e08c3bc-bound-sa-token\") pod \"cert-manager-55b4d954d5-l29zj\" (UID: \"0faff540-160e-4a83-9a74-b7714e08c3bc\") " pod="cert-manager/cert-manager-55b4d954d5-l29zj"
Jul 09 18:29:49.067166 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:29:49.067075    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d2zm8\" (UniqueName: \"kubernetes.io/projected/0faff540-160e-4a83-9a74-b7714e08c3bc-kube-api-access-d2zm8\") pod \"cert-manager-55b4d954d5-l29zj\" (UID: \"0faff540-160e-4a83-9a74-b7714e08c3bc\") " pod="cert-manager/cert-manager-55b4d954d5-l29zj"
Jul 09 18:29:49.090859 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:29:49.090824    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-l29zj"
Jul 09 18:29:49.218275 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:29:49.218240    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-l29zj"]
Jul 09 18:29:49.221181 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:29:49.221147    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod0faff540_160e_4a83_9a74_b7714e08c3bc.slice/crio-ae904ffdd67c88086a21c4789e30b87b85c2c295d14484901aa2d5a7171a522e WatchSource:0}: Error finding container ae904ffdd67c88086a21c4789e30b87b85c2c295d14484901aa2d5a7171a522e: Status 404 returned error can't find the container with id ae904ffdd67c88086a21c4789e30b87b85c2c295d14484901aa2d5a7171a522e
Jul 09 18:29:49.383942 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:29:49.383855    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-l29zj" event={"ID":"0faff540-160e-4a83-9a74-b7714e08c3bc","Type":"ContainerStarted","Data":"6eeb8bdace6f27186c395596e635c438e87a4d8d72a4d3aeacd4ef3f4fa3f4ad"}
Jul 09 18:29:49.383942 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:29:49.383899    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-l29zj" event={"ID":"0faff540-160e-4a83-9a74-b7714e08c3bc","Type":"ContainerStarted","Data":"ae904ffdd67c88086a21c4789e30b87b85c2c295d14484901aa2d5a7171a522e"}
Jul 09 18:29:49.410693 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:29:49.410642    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-55b4d954d5-l29zj" podStartSLOduration=1.4106246 podStartE2EDuration="1.4106246s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 18:29:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 18:29:49.409909037 +0000 UTC m=+258.649253664" watchObservedRunningTime="2026-07-09 18:29:49.4106246 +0000 UTC m=+258.649969226"
Jul 09 18:29:56.549124 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:29:56.549043    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-jcqbf"]
Jul 09 18:29:56.551271 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:29:56.551245    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-jcqbf"
Jul 09 18:29:56.555111 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:29:56.555087    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-sdz7x\""
Jul 09 18:29:56.555634 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:29:56.555613    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Jul 09 18:29:56.555718 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:29:56.555623    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Jul 09 18:29:56.569326 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:29:56.569300    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-jcqbf"]
Jul 09 18:29:56.623122 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:29:56.623082    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ad22e01b-90f3-4031-86d1-5b8faca477ca-tmp\") pod \"openshift-lws-operator-fd8ccff4c-jcqbf\" (UID: \"ad22e01b-90f3-4031-86d1-5b8faca477ca\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-jcqbf"
Jul 09 18:29:56.623122 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:29:56.623127    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5l2zz\" (UniqueName: \"kubernetes.io/projected/ad22e01b-90f3-4031-86d1-5b8faca477ca-kube-api-access-5l2zz\") pod \"openshift-lws-operator-fd8ccff4c-jcqbf\" (UID: \"ad22e01b-90f3-4031-86d1-5b8faca477ca\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-jcqbf"
Jul 09 18:29:56.724274 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:29:56.724239    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5l2zz\" (UniqueName: \"kubernetes.io/projected/ad22e01b-90f3-4031-86d1-5b8faca477ca-kube-api-access-5l2zz\") pod \"openshift-lws-operator-fd8ccff4c-jcqbf\" (UID: \"ad22e01b-90f3-4031-86d1-5b8faca477ca\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-jcqbf"
Jul 09 18:29:56.724461 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:29:56.724330    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ad22e01b-90f3-4031-86d1-5b8faca477ca-tmp\") pod \"openshift-lws-operator-fd8ccff4c-jcqbf\" (UID: \"ad22e01b-90f3-4031-86d1-5b8faca477ca\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-jcqbf"
Jul 09 18:29:56.724696 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:29:56.724680    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ad22e01b-90f3-4031-86d1-5b8faca477ca-tmp\") pod \"openshift-lws-operator-fd8ccff4c-jcqbf\" (UID: \"ad22e01b-90f3-4031-86d1-5b8faca477ca\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-jcqbf"
Jul 09 18:29:56.732310 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:29:56.732283    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5l2zz\" (UniqueName: \"kubernetes.io/projected/ad22e01b-90f3-4031-86d1-5b8faca477ca-kube-api-access-5l2zz\") pod \"openshift-lws-operator-fd8ccff4c-jcqbf\" (UID: \"ad22e01b-90f3-4031-86d1-5b8faca477ca\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-jcqbf"
Jul 09 18:29:56.860675 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:29:56.860587    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-jcqbf"
Jul 09 18:29:56.996530 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:29:56.996495    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-jcqbf"]
Jul 09 18:29:57.000686 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:29:57.000658    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podad22e01b_90f3_4031_86d1_5b8faca477ca.slice/crio-d0b1f4b4a4998cd487b623c409e5ed01e2f6a6ff90ebba43539b20945b586889 WatchSource:0}: Error finding container d0b1f4b4a4998cd487b623c409e5ed01e2f6a6ff90ebba43539b20945b586889: Status 404 returned error can't find the container with id d0b1f4b4a4998cd487b623c409e5ed01e2f6a6ff90ebba43539b20945b586889
Jul 09 18:29:57.414942 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:29:57.414907    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-jcqbf" event={"ID":"ad22e01b-90f3-4031-86d1-5b8faca477ca","Type":"ContainerStarted","Data":"d0b1f4b4a4998cd487b623c409e5ed01e2f6a6ff90ebba43539b20945b586889"}
Jul 09 18:30:00.431504 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:30:00.431456    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-jcqbf" event={"ID":"ad22e01b-90f3-4031-86d1-5b8faca477ca","Type":"ContainerStarted","Data":"eaa8fcdc19bb811fe3da5bddd4f14352b7577b5e4f8e0213d09c3c865eb50d02"}
Jul 09 18:30:00.455634 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:30:00.454812    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-jcqbf" podStartSLOduration=1.569535844 podStartE2EDuration="4.454786336s" totalImagesPullingTime="2.885250492s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 18:29:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 18:30:00.453805999 +0000 UTC m=+269.693150626" watchObservedRunningTime="2026-07-09 18:30:00.454786336 +0000 UTC m=+269.694130968"
Jul 09 18:30:03.081047 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:30:03.081005    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afqdkld"]
Jul 09 18:30:03.084449 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:30:03.084432    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afqdkld"
Jul 09 18:30:03.087205 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:30:03.087185    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Jul 09 18:30:03.088127 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:30:03.088106    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-5rb4f\""
Jul 09 18:30:03.088236 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:30:03.088140    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Jul 09 18:30:03.100860 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:30:03.100831    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afqdkld"]
Jul 09 18:30:03.181979 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:30:03.181936    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e6774dff-d748-4497-86ce-fed27674e679-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afqdkld\" (UID: \"e6774dff-d748-4497-86ce-fed27674e679\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afqdkld"
Jul 09 18:30:03.182142 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:30:03.181991    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k5cd8\" (UniqueName: \"kubernetes.io/projected/e6774dff-d748-4497-86ce-fed27674e679-kube-api-access-k5cd8\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afqdkld\" (UID: \"e6774dff-d748-4497-86ce-fed27674e679\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afqdkld"
Jul 09 18:30:03.182142 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:30:03.182040    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e6774dff-d748-4497-86ce-fed27674e679-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afqdkld\" (UID: \"e6774dff-d748-4497-86ce-fed27674e679\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afqdkld"
Jul 09 18:30:03.283381 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:30:03.283349    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e6774dff-d748-4497-86ce-fed27674e679-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afqdkld\" (UID: \"e6774dff-d748-4497-86ce-fed27674e679\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afqdkld"
Jul 09 18:30:03.283576 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:30:03.283393    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k5cd8\" (UniqueName: \"kubernetes.io/projected/e6774dff-d748-4497-86ce-fed27674e679-kube-api-access-k5cd8\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afqdkld\" (UID: \"e6774dff-d748-4497-86ce-fed27674e679\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afqdkld"
Jul 09 18:30:03.283576 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:30:03.283416    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e6774dff-d748-4497-86ce-fed27674e679-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afqdkld\" (UID: \"e6774dff-d748-4497-86ce-fed27674e679\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afqdkld"
Jul 09 18:30:03.283765 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:30:03.283748    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e6774dff-d748-4497-86ce-fed27674e679-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afqdkld\" (UID: \"e6774dff-d748-4497-86ce-fed27674e679\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afqdkld"
Jul 09 18:30:03.283830 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:30:03.283810    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e6774dff-d748-4497-86ce-fed27674e679-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afqdkld\" (UID: \"e6774dff-d748-4497-86ce-fed27674e679\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afqdkld"
Jul 09 18:30:03.292407 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:30:03.292382    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k5cd8\" (UniqueName: \"kubernetes.io/projected/e6774dff-d748-4497-86ce-fed27674e679-kube-api-access-k5cd8\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afqdkld\" (UID: \"e6774dff-d748-4497-86ce-fed27674e679\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afqdkld"
Jul 09 18:30:03.394054 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:30:03.393969    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afqdkld"
Jul 09 18:30:03.536151 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:30:03.536127    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afqdkld"]
Jul 09 18:30:03.537737 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:30:03.537708    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode6774dff_d748_4497_86ce_fed27674e679.slice/crio-9c9b7b410f54db05803efae4dd2330cc07898ebd973b5b85de946ce53c05729c WatchSource:0}: Error finding container 9c9b7b410f54db05803efae4dd2330cc07898ebd973b5b85de946ce53c05729c: Status 404 returned error can't find the container with id 9c9b7b410f54db05803efae4dd2330cc07898ebd973b5b85de946ce53c05729c
Jul 09 18:30:04.448859 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:30:04.448825    2557 generic.go:356] "Generic (PLEG): container finished" podID="e6774dff-d748-4497-86ce-fed27674e679" containerID="5e403e452d50d8984683fdace04a81dcc2731026856ff3e121c6ac53682720ef" exitCode=0
Jul 09 18:30:04.449234 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:30:04.448895    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afqdkld" event={"ID":"e6774dff-d748-4497-86ce-fed27674e679","Type":"ContainerDied","Data":"5e403e452d50d8984683fdace04a81dcc2731026856ff3e121c6ac53682720ef"}
Jul 09 18:30:04.449234 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:30:04.448937    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afqdkld" event={"ID":"e6774dff-d748-4497-86ce-fed27674e679","Type":"ContainerStarted","Data":"9c9b7b410f54db05803efae4dd2330cc07898ebd973b5b85de946ce53c05729c"}
Jul 09 18:30:06.461353 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:30:06.461320    2557 generic.go:356] "Generic (PLEG): container finished" podID="e6774dff-d748-4497-86ce-fed27674e679" containerID="378b66884563223c76ca199d390fe5cb49bf9fc0a3dd01dd0113fb2bf7242a75" exitCode=0
Jul 09 18:30:06.461808 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:30:06.461407    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afqdkld" event={"ID":"e6774dff-d748-4497-86ce-fed27674e679","Type":"ContainerDied","Data":"378b66884563223c76ca199d390fe5cb49bf9fc0a3dd01dd0113fb2bf7242a75"}
Jul 09 18:30:07.467569 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:30:07.467532    2557 generic.go:356] "Generic (PLEG): container finished" podID="e6774dff-d748-4497-86ce-fed27674e679" containerID="8f244af72fe2e22d79aa1827cc437c3aae4a112d3d55c8647f0eb62a1eda690a" exitCode=0
Jul 09 18:30:07.467955 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:30:07.467620    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afqdkld" event={"ID":"e6774dff-d748-4497-86ce-fed27674e679","Type":"ContainerDied","Data":"8f244af72fe2e22d79aa1827cc437c3aae4a112d3d55c8647f0eb62a1eda690a"}
Jul 09 18:30:08.592905 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:30:08.592879    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afqdkld"
Jul 09 18:30:08.631236 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:30:08.631205    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e6774dff-d748-4497-86ce-fed27674e679-bundle\") pod \"e6774dff-d748-4497-86ce-fed27674e679\" (UID: \"e6774dff-d748-4497-86ce-fed27674e679\") "
Jul 09 18:30:08.631408 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:30:08.631311    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e6774dff-d748-4497-86ce-fed27674e679-util\") pod \"e6774dff-d748-4497-86ce-fed27674e679\" (UID: \"e6774dff-d748-4497-86ce-fed27674e679\") "
Jul 09 18:30:08.631408 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:30:08.631347    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-k5cd8\" (UniqueName: \"kubernetes.io/projected/e6774dff-d748-4497-86ce-fed27674e679-kube-api-access-k5cd8\") pod \"e6774dff-d748-4497-86ce-fed27674e679\" (UID: \"e6774dff-d748-4497-86ce-fed27674e679\") "
Jul 09 18:30:08.632005 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:30:08.631963    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e6774dff-d748-4497-86ce-fed27674e679-bundle" (OuterVolumeSpecName: "bundle") pod "e6774dff-d748-4497-86ce-fed27674e679" (UID: "e6774dff-d748-4497-86ce-fed27674e679"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 18:30:08.633409 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:30:08.633379    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e6774dff-d748-4497-86ce-fed27674e679-kube-api-access-k5cd8" (OuterVolumeSpecName: "kube-api-access-k5cd8") pod "e6774dff-d748-4497-86ce-fed27674e679" (UID: "e6774dff-d748-4497-86ce-fed27674e679"). InnerVolumeSpecName "kube-api-access-k5cd8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 18:30:08.697294 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:30:08.697249    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e6774dff-d748-4497-86ce-fed27674e679-util" (OuterVolumeSpecName: "util") pod "e6774dff-d748-4497-86ce-fed27674e679" (UID: "e6774dff-d748-4497-86ce-fed27674e679"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 18:30:08.732946 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:30:08.732868    2557 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e6774dff-d748-4497-86ce-fed27674e679-bundle\") on node \"ip-10-0-141-101.ec2.internal\" DevicePath \"\""
Jul 09 18:30:08.732946 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:30:08.732897    2557 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e6774dff-d748-4497-86ce-fed27674e679-util\") on node \"ip-10-0-141-101.ec2.internal\" DevicePath \"\""
Jul 09 18:30:08.732946 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:30:08.732907    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-k5cd8\" (UniqueName: \"kubernetes.io/projected/e6774dff-d748-4497-86ce-fed27674e679-kube-api-access-k5cd8\") on node \"ip-10-0-141-101.ec2.internal\" DevicePath \"\""
Jul 09 18:30:09.477504 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:30:09.477448    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afqdkld" event={"ID":"e6774dff-d748-4497-86ce-fed27674e679","Type":"ContainerDied","Data":"9c9b7b410f54db05803efae4dd2330cc07898ebd973b5b85de946ce53c05729c"}
Jul 09 18:30:09.477504 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:30:09.477493    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afqdkld"
Jul 09 18:30:09.477699 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:30:09.477518    2557 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="9c9b7b410f54db05803efae4dd2330cc07898ebd973b5b85de946ce53c05729c"
Jul 09 18:30:15.845973 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:30:15.845942    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-59f7885b79-nt2jx"]
Jul 09 18:30:15.846430 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:30:15.846302    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e6774dff-d748-4497-86ce-fed27674e679" containerName="util"
Jul 09 18:30:15.846430 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:30:15.846315    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="e6774dff-d748-4497-86ce-fed27674e679" containerName="util"
Jul 09 18:30:15.846430 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:30:15.846331    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e6774dff-d748-4497-86ce-fed27674e679" containerName="extract"
Jul 09 18:30:15.846430 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:30:15.846339    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="e6774dff-d748-4497-86ce-fed27674e679" containerName="extract"
Jul 09 18:30:15.846430 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:30:15.846367    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e6774dff-d748-4497-86ce-fed27674e679" containerName="pull"
Jul 09 18:30:15.846430 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:30:15.846377    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="e6774dff-d748-4497-86ce-fed27674e679" containerName="pull"
Jul 09 18:30:15.846630 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:30:15.846457    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="e6774dff-d748-4497-86ce-fed27674e679" containerName="extract"
Jul 09 18:30:15.850735 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:30:15.850716    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-59f7885b79-nt2jx"
Jul 09 18:30:15.853231 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:30:15.853206    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Jul 09 18:30:15.853417 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:30:15.853300    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Jul 09 18:30:15.853842 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:30:15.853817    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Jul 09 18:30:15.853970 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:30:15.853858    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Jul 09 18:30:15.853970 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:30:15.853819    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-fmrpn\""
Jul 09 18:30:15.868758 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:30:15.868728    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-59f7885b79-nt2jx"]
Jul 09 18:30:15.993452 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:30:15.993410    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/fc118cf6-f01e-4901-9e18-279277549dc5-webhook-cert\") pod \"opendatahub-operator-controller-manager-59f7885b79-nt2jx\" (UID: \"fc118cf6-f01e-4901-9e18-279277549dc5\") " pod="opendatahub/opendatahub-operator-controller-manager-59f7885b79-nt2jx"
Jul 09 18:30:15.993452 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:30:15.993457    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/fc118cf6-f01e-4901-9e18-279277549dc5-tmp\") pod \"opendatahub-operator-controller-manager-59f7885b79-nt2jx\" (UID: \"fc118cf6-f01e-4901-9e18-279277549dc5\") " pod="opendatahub/opendatahub-operator-controller-manager-59f7885b79-nt2jx"
Jul 09 18:30:15.993731 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:30:15.993504    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qdfl5\" (UniqueName: \"kubernetes.io/projected/fc118cf6-f01e-4901-9e18-279277549dc5-kube-api-access-qdfl5\") pod \"opendatahub-operator-controller-manager-59f7885b79-nt2jx\" (UID: \"fc118cf6-f01e-4901-9e18-279277549dc5\") " pod="opendatahub/opendatahub-operator-controller-manager-59f7885b79-nt2jx"
Jul 09 18:30:15.993731 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:30:15.993606    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/fc118cf6-f01e-4901-9e18-279277549dc5-apiservice-cert\") pod \"opendatahub-operator-controller-manager-59f7885b79-nt2jx\" (UID: \"fc118cf6-f01e-4901-9e18-279277549dc5\") " pod="opendatahub/opendatahub-operator-controller-manager-59f7885b79-nt2jx"
Jul 09 18:30:15.993731 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:30:15.993650    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/fc118cf6-f01e-4901-9e18-279277549dc5-manifests\") pod \"opendatahub-operator-controller-manager-59f7885b79-nt2jx\" (UID: \"fc118cf6-f01e-4901-9e18-279277549dc5\") " pod="opendatahub/opendatahub-operator-controller-manager-59f7885b79-nt2jx"
Jul 09 18:30:16.094110 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:30:16.094067    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/fc118cf6-f01e-4901-9e18-279277549dc5-tmp\") pod \"opendatahub-operator-controller-manager-59f7885b79-nt2jx\" (UID: \"fc118cf6-f01e-4901-9e18-279277549dc5\") " pod="opendatahub/opendatahub-operator-controller-manager-59f7885b79-nt2jx"
Jul 09 18:30:16.094110 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:30:16.094115    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qdfl5\" (UniqueName: \"kubernetes.io/projected/fc118cf6-f01e-4901-9e18-279277549dc5-kube-api-access-qdfl5\") pod \"opendatahub-operator-controller-manager-59f7885b79-nt2jx\" (UID: \"fc118cf6-f01e-4901-9e18-279277549dc5\") " pod="opendatahub/opendatahub-operator-controller-manager-59f7885b79-nt2jx"
Jul 09 18:30:16.094361 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:30:16.094242    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/fc118cf6-f01e-4901-9e18-279277549dc5-apiservice-cert\") pod \"opendatahub-operator-controller-manager-59f7885b79-nt2jx\" (UID: \"fc118cf6-f01e-4901-9e18-279277549dc5\") " pod="opendatahub/opendatahub-operator-controller-manager-59f7885b79-nt2jx"
Jul 09 18:30:16.094361 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:30:16.094296    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/fc118cf6-f01e-4901-9e18-279277549dc5-manifests\") pod \"opendatahub-operator-controller-manager-59f7885b79-nt2jx\" (UID: \"fc118cf6-f01e-4901-9e18-279277549dc5\") " pod="opendatahub/opendatahub-operator-controller-manager-59f7885b79-nt2jx"
Jul 09 18:30:16.094459 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:30:16.094382    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/fc118cf6-f01e-4901-9e18-279277549dc5-webhook-cert\") pod \"opendatahub-operator-controller-manager-59f7885b79-nt2jx\" (UID: \"fc118cf6-f01e-4901-9e18-279277549dc5\") " pod="opendatahub/opendatahub-operator-controller-manager-59f7885b79-nt2jx"
Jul 09 18:30:16.094672 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:30:16.094652    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/fc118cf6-f01e-4901-9e18-279277549dc5-manifests\") pod \"opendatahub-operator-controller-manager-59f7885b79-nt2jx\" (UID: \"fc118cf6-f01e-4901-9e18-279277549dc5\") " pod="opendatahub/opendatahub-operator-controller-manager-59f7885b79-nt2jx"
Jul 09 18:30:16.096525 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:30:16.096444    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/fc118cf6-f01e-4901-9e18-279277549dc5-tmp\") pod \"opendatahub-operator-controller-manager-59f7885b79-nt2jx\" (UID: \"fc118cf6-f01e-4901-9e18-279277549dc5\") " pod="opendatahub/opendatahub-operator-controller-manager-59f7885b79-nt2jx"
Jul 09 18:30:16.096692 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:30:16.096676    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/fc118cf6-f01e-4901-9e18-279277549dc5-apiservice-cert\") pod \"opendatahub-operator-controller-manager-59f7885b79-nt2jx\" (UID: \"fc118cf6-f01e-4901-9e18-279277549dc5\") " pod="opendatahub/opendatahub-operator-controller-manager-59f7885b79-nt2jx"
Jul 09 18:30:16.096757 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:30:16.096699    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/fc118cf6-f01e-4901-9e18-279277549dc5-webhook-cert\") pod \"opendatahub-operator-controller-manager-59f7885b79-nt2jx\" (UID: \"fc118cf6-f01e-4901-9e18-279277549dc5\") " pod="opendatahub/opendatahub-operator-controller-manager-59f7885b79-nt2jx"
Jul 09 18:30:16.106436 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:30:16.106404    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qdfl5\" (UniqueName: \"kubernetes.io/projected/fc118cf6-f01e-4901-9e18-279277549dc5-kube-api-access-qdfl5\") pod \"opendatahub-operator-controller-manager-59f7885b79-nt2jx\" (UID: \"fc118cf6-f01e-4901-9e18-279277549dc5\") " pod="opendatahub/opendatahub-operator-controller-manager-59f7885b79-nt2jx"
Jul 09 18:30:16.164336 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:30:16.164298    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-59f7885b79-nt2jx"
Jul 09 18:30:16.315882 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:30:16.315854    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-59f7885b79-nt2jx"]
Jul 09 18:30:16.317618 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:30:16.317595    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfc118cf6_f01e_4901_9e18_279277549dc5.slice/crio-0a8885c83844ff7236c76108c4dc9a26b2f384d21732fb3227797244af4dc88d WatchSource:0}: Error finding container 0a8885c83844ff7236c76108c4dc9a26b2f384d21732fb3227797244af4dc88d: Status 404 returned error can't find the container with id 0a8885c83844ff7236c76108c4dc9a26b2f384d21732fb3227797244af4dc88d
Jul 09 18:30:16.508658 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:30:16.508572    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-59f7885b79-nt2jx" event={"ID":"fc118cf6-f01e-4901-9e18-279277549dc5","Type":"ContainerStarted","Data":"0a8885c83844ff7236c76108c4dc9a26b2f384d21732fb3227797244af4dc88d"}
Jul 09 18:30:19.526264 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:30:19.526160    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-59f7885b79-nt2jx" event={"ID":"fc118cf6-f01e-4901-9e18-279277549dc5","Type":"ContainerStarted","Data":"a8e8fb3cf5665faa4bce95741ece9bc17bf7d47969474a5e1ebaf74b79135bde"}
Jul 09 18:30:20.532299 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:30:20.532264    2557 generic.go:356] "Generic (PLEG): container finished" podID="fc118cf6-f01e-4901-9e18-279277549dc5" containerID="a8e8fb3cf5665faa4bce95741ece9bc17bf7d47969474a5e1ebaf74b79135bde" exitCode=0
Jul 09 18:30:20.532692 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:30:20.532353    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-59f7885b79-nt2jx" event={"ID":"fc118cf6-f01e-4901-9e18-279277549dc5","Type":"ContainerDied","Data":"a8e8fb3cf5665faa4bce95741ece9bc17bf7d47969474a5e1ebaf74b79135bde"}
Jul 09 18:30:21.540626 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:30:21.540556    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-59f7885b79-nt2jx" event={"ID":"fc118cf6-f01e-4901-9e18-279277549dc5","Type":"ContainerStarted","Data":"1fcf85fd74d75c006fbd558683d112bf75acad54ce2b1e452ee45e82f30cc377"}
Jul 09 18:30:21.541114 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:30:21.540825    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-59f7885b79-nt2jx"
Jul 09 18:30:21.584917 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:30:21.584850    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-59f7885b79-nt2jx" podStartSLOduration=2.087017434 podStartE2EDuration="6.584821699s" totalImagesPullingTime="3.345768398s" totalInitContainerRuntime="1.152035867s" isStatefulPod=false podCreationTimestamp="2026-07-09 18:30:15 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 18:30:21.573437173 +0000 UTC m=+290.812781831" watchObservedRunningTime="2026-07-09 18:30:21.584821699 +0000 UTC m=+290.824166325"
Jul 09 18:30:31.093336 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:30:31.093304    2557 kubelet.go:1648] "Image garbage collection succeeded"
Jul 09 18:30:32.548074 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:30:32.548044    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-59f7885b79-nt2jx"
Jul 09 18:30:35.621035 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:30:35.620999    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-668f4b5f87-jmmtk"]
Jul 09 18:30:35.624402 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:30:35.624371    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-668f4b5f87-jmmtk"
Jul 09 18:30:35.629996 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:30:35.629968    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jul 09 18:30:35.630932 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:30:35.630911    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jul 09 18:30:35.631169 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:30:35.631152    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-x6tw9\""
Jul 09 18:30:35.631428 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:30:35.631409    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Jul 09 18:30:35.631667 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:30:35.631649    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
Jul 09 18:30:35.772870 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:30:35.772837    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e64bfe60-9c8b-4d07-8b1d-a4f4ad954f7f-tls-certs\") pod \"kube-auth-proxy-668f4b5f87-jmmtk\" (UID: \"e64bfe60-9c8b-4d07-8b1d-a4f4ad954f7f\") " pod="openshift-ingress/kube-auth-proxy-668f4b5f87-jmmtk"
Jul 09 18:30:35.772870 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:30:35.772871    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e64bfe60-9c8b-4d07-8b1d-a4f4ad954f7f-tmp\") pod \"kube-auth-proxy-668f4b5f87-jmmtk\" (UID: \"e64bfe60-9c8b-4d07-8b1d-a4f4ad954f7f\") " pod="openshift-ingress/kube-auth-proxy-668f4b5f87-jmmtk"
Jul 09 18:30:35.773088 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:30:35.772903    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pchl4\" (UniqueName: \"kubernetes.io/projected/e64bfe60-9c8b-4d07-8b1d-a4f4ad954f7f-kube-api-access-pchl4\") pod \"kube-auth-proxy-668f4b5f87-jmmtk\" (UID: \"e64bfe60-9c8b-4d07-8b1d-a4f4ad954f7f\") " pod="openshift-ingress/kube-auth-proxy-668f4b5f87-jmmtk"
Jul 09 18:30:35.804437 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:30:35.804398    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-668f4b5f87-jmmtk"]
Jul 09 18:30:35.873761 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:30:35.873667    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pchl4\" (UniqueName: \"kubernetes.io/projected/e64bfe60-9c8b-4d07-8b1d-a4f4ad954f7f-kube-api-access-pchl4\") pod \"kube-auth-proxy-668f4b5f87-jmmtk\" (UID: \"e64bfe60-9c8b-4d07-8b1d-a4f4ad954f7f\") " pod="openshift-ingress/kube-auth-proxy-668f4b5f87-jmmtk"
Jul 09 18:30:35.873938 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:30:35.873764    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e64bfe60-9c8b-4d07-8b1d-a4f4ad954f7f-tls-certs\") pod \"kube-auth-proxy-668f4b5f87-jmmtk\" (UID: \"e64bfe60-9c8b-4d07-8b1d-a4f4ad954f7f\") " pod="openshift-ingress/kube-auth-proxy-668f4b5f87-jmmtk"
Jul 09 18:30:35.873938 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:30:35.873784    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e64bfe60-9c8b-4d07-8b1d-a4f4ad954f7f-tmp\") pod \"kube-auth-proxy-668f4b5f87-jmmtk\" (UID: \"e64bfe60-9c8b-4d07-8b1d-a4f4ad954f7f\") " pod="openshift-ingress/kube-auth-proxy-668f4b5f87-jmmtk"
Jul 09 18:30:35.876065 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:30:35.876039    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e64bfe60-9c8b-4d07-8b1d-a4f4ad954f7f-tmp\") pod \"kube-auth-proxy-668f4b5f87-jmmtk\" (UID: \"e64bfe60-9c8b-4d07-8b1d-a4f4ad954f7f\") " pod="openshift-ingress/kube-auth-proxy-668f4b5f87-jmmtk"
Jul 09 18:30:35.876196 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:30:35.876177    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e64bfe60-9c8b-4d07-8b1d-a4f4ad954f7f-tls-certs\") pod \"kube-auth-proxy-668f4b5f87-jmmtk\" (UID: \"e64bfe60-9c8b-4d07-8b1d-a4f4ad954f7f\") " pod="openshift-ingress/kube-auth-proxy-668f4b5f87-jmmtk"
Jul 09 18:30:35.918775 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:30:35.918739    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pchl4\" (UniqueName: \"kubernetes.io/projected/e64bfe60-9c8b-4d07-8b1d-a4f4ad954f7f-kube-api-access-pchl4\") pod \"kube-auth-proxy-668f4b5f87-jmmtk\" (UID: \"e64bfe60-9c8b-4d07-8b1d-a4f4ad954f7f\") " pod="openshift-ingress/kube-auth-proxy-668f4b5f87-jmmtk"
Jul 09 18:30:35.935538 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:30:35.935501    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-668f4b5f87-jmmtk"
Jul 09 18:30:36.090002 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:30:36.089971    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode64bfe60_9c8b_4d07_8b1d_a4f4ad954f7f.slice/crio-586d557900a011e83dfac285a5e62fd8fbba44996910fc9ff0c3cf6be801350d WatchSource:0}: Error finding container 586d557900a011e83dfac285a5e62fd8fbba44996910fc9ff0c3cf6be801350d: Status 404 returned error can't find the container with id 586d557900a011e83dfac285a5e62fd8fbba44996910fc9ff0c3cf6be801350d
Jul 09 18:30:36.092363 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:30:36.092341    2557 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 09 18:30:36.093623 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:30:36.093602    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-668f4b5f87-jmmtk"]
Jul 09 18:30:36.611797 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:30:36.611763    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-668f4b5f87-jmmtk" event={"ID":"e64bfe60-9c8b-4d07-8b1d-a4f4ad954f7f","Type":"ContainerStarted","Data":"586d557900a011e83dfac285a5e62fd8fbba44996910fc9ff0c3cf6be801350d"}
Jul 09 18:30:37.630943 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:30:37.630901    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-4wffq"]
Jul 09 18:30:37.633235 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:30:37.633211    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-4wffq"
Jul 09 18:30:37.655010 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:30:37.654979    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\""
Jul 09 18:30:37.721606 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:30:37.721570    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-4wffq"]
Jul 09 18:30:37.790432 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:30:37.790392    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/238eb895-3741-4a66-b2b4-8c2a64516a11-tls-certs\") pod \"model-serving-api-54d89bd5fc-4wffq\" (UID: \"238eb895-3741-4a66-b2b4-8c2a64516a11\") " pod="opendatahub/model-serving-api-54d89bd5fc-4wffq"
Jul 09 18:30:37.790432 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:30:37.790453    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bx9jj\" (UniqueName: \"kubernetes.io/projected/238eb895-3741-4a66-b2b4-8c2a64516a11-kube-api-access-bx9jj\") pod \"model-serving-api-54d89bd5fc-4wffq\" (UID: \"238eb895-3741-4a66-b2b4-8c2a64516a11\") " pod="opendatahub/model-serving-api-54d89bd5fc-4wffq"
Jul 09 18:30:37.891127 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:30:37.891026    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bx9jj\" (UniqueName: \"kubernetes.io/projected/238eb895-3741-4a66-b2b4-8c2a64516a11-kube-api-access-bx9jj\") pod \"model-serving-api-54d89bd5fc-4wffq\" (UID: \"238eb895-3741-4a66-b2b4-8c2a64516a11\") " pod="opendatahub/model-serving-api-54d89bd5fc-4wffq"
Jul 09 18:30:37.891309 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:30:37.891181    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/238eb895-3741-4a66-b2b4-8c2a64516a11-tls-certs\") pod \"model-serving-api-54d89bd5fc-4wffq\" (UID: \"238eb895-3741-4a66-b2b4-8c2a64516a11\") " pod="opendatahub/model-serving-api-54d89bd5fc-4wffq"
Jul 09 18:30:37.894386 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:30:37.894357    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/238eb895-3741-4a66-b2b4-8c2a64516a11-tls-certs\") pod \"model-serving-api-54d89bd5fc-4wffq\" (UID: \"238eb895-3741-4a66-b2b4-8c2a64516a11\") " pod="opendatahub/model-serving-api-54d89bd5fc-4wffq"
Jul 09 18:30:37.902968 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:30:37.902920    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bx9jj\" (UniqueName: \"kubernetes.io/projected/238eb895-3741-4a66-b2b4-8c2a64516a11-kube-api-access-bx9jj\") pod \"model-serving-api-54d89bd5fc-4wffq\" (UID: \"238eb895-3741-4a66-b2b4-8c2a64516a11\") " pod="opendatahub/model-serving-api-54d89bd5fc-4wffq"
Jul 09 18:30:37.944950 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:30:37.944880    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-4wffq"
Jul 09 18:30:38.113672 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:30:38.113551    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-4wffq"]
Jul 09 18:30:38.116638 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:30:38.116603    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod238eb895_3741_4a66_b2b4_8c2a64516a11.slice/crio-9330490ac2651111f679b6ea5dde02fd2dfa6b06d0efbfe8b3b149bdff1a1229 WatchSource:0}: Error finding container 9330490ac2651111f679b6ea5dde02fd2dfa6b06d0efbfe8b3b149bdff1a1229: Status 404 returned error can't find the container with id 9330490ac2651111f679b6ea5dde02fd2dfa6b06d0efbfe8b3b149bdff1a1229
Jul 09 18:30:38.399587 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:30:38.399547    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-tk9mt"]
Jul 09 18:30:38.402348 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:30:38.402319    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-tk9mt"
Jul 09 18:30:38.416107 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:30:38.416084    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\""
Jul 09 18:30:38.416219 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:30:38.416129    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\""
Jul 09 18:30:38.416918 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:30:38.416903    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Jul 09 18:30:38.417169 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:30:38.417154    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\""
Jul 09 18:30:38.441363 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:30:38.441320    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-pqlc8\""
Jul 09 18:30:38.449908 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:30:38.449865    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-tk9mt"]
Jul 09 18:30:38.495370 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:30:38.495332    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/259045cf-8a5d-4dc9-818a-8f6d2007fd5c-istio-token\") pod \"istiod-openshift-gateway-7574459656-tk9mt\" (UID: \"259045cf-8a5d-4dc9-818a-8f6d2007fd5c\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-tk9mt"
Jul 09 18:30:38.495661 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:30:38.495380    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6pdxb\" (UniqueName: \"kubernetes.io/projected/259045cf-8a5d-4dc9-818a-8f6d2007fd5c-kube-api-access-6pdxb\") pod \"istiod-openshift-gateway-7574459656-tk9mt\" (UID: \"259045cf-8a5d-4dc9-818a-8f6d2007fd5c\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-tk9mt"
Jul 09 18:30:38.495661 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:30:38.495423    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/259045cf-8a5d-4dc9-818a-8f6d2007fd5c-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-tk9mt\" (UID: \"259045cf-8a5d-4dc9-818a-8f6d2007fd5c\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-tk9mt"
Jul 09 18:30:38.495661 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:30:38.495589    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/259045cf-8a5d-4dc9-818a-8f6d2007fd5c-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-tk9mt\" (UID: \"259045cf-8a5d-4dc9-818a-8f6d2007fd5c\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-tk9mt"
Jul 09 18:30:38.495661 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:30:38.495629    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/259045cf-8a5d-4dc9-818a-8f6d2007fd5c-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-tk9mt\" (UID: \"259045cf-8a5d-4dc9-818a-8f6d2007fd5c\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-tk9mt"
Jul 09 18:30:38.495895 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:30:38.495675    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/259045cf-8a5d-4dc9-818a-8f6d2007fd5c-cacerts\") pod \"istiod-openshift-gateway-7574459656-tk9mt\" (UID: \"259045cf-8a5d-4dc9-818a-8f6d2007fd5c\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-tk9mt"
Jul 09 18:30:38.495895 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:30:38.495718    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/259045cf-8a5d-4dc9-818a-8f6d2007fd5c-local-certs\") pod \"istiod-openshift-gateway-7574459656-tk9mt\" (UID: \"259045cf-8a5d-4dc9-818a-8f6d2007fd5c\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-tk9mt"
Jul 09 18:30:38.596238 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:30:38.596206    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/259045cf-8a5d-4dc9-818a-8f6d2007fd5c-istio-token\") pod \"istiod-openshift-gateway-7574459656-tk9mt\" (UID: \"259045cf-8a5d-4dc9-818a-8f6d2007fd5c\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-tk9mt"
Jul 09 18:30:38.596450 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:30:38.596248    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6pdxb\" (UniqueName: \"kubernetes.io/projected/259045cf-8a5d-4dc9-818a-8f6d2007fd5c-kube-api-access-6pdxb\") pod \"istiod-openshift-gateway-7574459656-tk9mt\" (UID: \"259045cf-8a5d-4dc9-818a-8f6d2007fd5c\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-tk9mt"
Jul 09 18:30:38.596450 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:30:38.596294    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/259045cf-8a5d-4dc9-818a-8f6d2007fd5c-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-tk9mt\" (UID: \"259045cf-8a5d-4dc9-818a-8f6d2007fd5c\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-tk9mt"
Jul 09 18:30:38.596450 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:30:38.596341    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/259045cf-8a5d-4dc9-818a-8f6d2007fd5c-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-tk9mt\" (UID: \"259045cf-8a5d-4dc9-818a-8f6d2007fd5c\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-tk9mt"
Jul 09 18:30:38.596450 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:30:38.596382    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/259045cf-8a5d-4dc9-818a-8f6d2007fd5c-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-tk9mt\" (UID: \"259045cf-8a5d-4dc9-818a-8f6d2007fd5c\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-tk9mt"
Jul 09 18:30:38.596450 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:30:38.596429    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/259045cf-8a5d-4dc9-818a-8f6d2007fd5c-cacerts\") pod \"istiod-openshift-gateway-7574459656-tk9mt\" (UID: \"259045cf-8a5d-4dc9-818a-8f6d2007fd5c\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-tk9mt"
Jul 09 18:30:38.596733 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:30:38.596456    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/259045cf-8a5d-4dc9-818a-8f6d2007fd5c-local-certs\") pod \"istiod-openshift-gateway-7574459656-tk9mt\" (UID: \"259045cf-8a5d-4dc9-818a-8f6d2007fd5c\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-tk9mt"
Jul 09 18:30:38.597079 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:30:38.597051    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/259045cf-8a5d-4dc9-818a-8f6d2007fd5c-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-tk9mt\" (UID: \"259045cf-8a5d-4dc9-818a-8f6d2007fd5c\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-tk9mt"
Jul 09 18:30:38.599177 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:30:38.599150    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/259045cf-8a5d-4dc9-818a-8f6d2007fd5c-local-certs\") pod \"istiod-openshift-gateway-7574459656-tk9mt\" (UID: \"259045cf-8a5d-4dc9-818a-8f6d2007fd5c\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-tk9mt"
Jul 09 18:30:38.599292 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:30:38.599215    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/259045cf-8a5d-4dc9-818a-8f6d2007fd5c-cacerts\") pod \"istiod-openshift-gateway-7574459656-tk9mt\" (UID: \"259045cf-8a5d-4dc9-818a-8f6d2007fd5c\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-tk9mt"
Jul 09 18:30:38.599397 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:30:38.599372    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/259045cf-8a5d-4dc9-818a-8f6d2007fd5c-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-tk9mt\" (UID: \"259045cf-8a5d-4dc9-818a-8f6d2007fd5c\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-tk9mt"
Jul 09 18:30:38.599455 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:30:38.599429    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/259045cf-8a5d-4dc9-818a-8f6d2007fd5c-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-tk9mt\" (UID: \"259045cf-8a5d-4dc9-818a-8f6d2007fd5c\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-tk9mt"
Jul 09 18:30:38.611294 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:30:38.611262    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6pdxb\" (UniqueName: \"kubernetes.io/projected/259045cf-8a5d-4dc9-818a-8f6d2007fd5c-kube-api-access-6pdxb\") pod \"istiod-openshift-gateway-7574459656-tk9mt\" (UID: \"259045cf-8a5d-4dc9-818a-8f6d2007fd5c\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-tk9mt"
Jul 09 18:30:38.611445 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:30:38.611426    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/259045cf-8a5d-4dc9-818a-8f6d2007fd5c-istio-token\") pod \"istiod-openshift-gateway-7574459656-tk9mt\" (UID: \"259045cf-8a5d-4dc9-818a-8f6d2007fd5c\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-tk9mt"
Jul 09 18:30:38.623659 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:30:38.623604    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-4wffq" event={"ID":"238eb895-3741-4a66-b2b4-8c2a64516a11","Type":"ContainerStarted","Data":"9330490ac2651111f679b6ea5dde02fd2dfa6b06d0efbfe8b3b149bdff1a1229"}
Jul 09 18:30:38.714215 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:30:38.714128    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-tk9mt"
Jul 09 18:30:39.378833 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:30:39.378786    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-tk9mt"]
Jul 09 18:30:39.381693 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:30:39.381662    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod259045cf_8a5d_4dc9_818a_8f6d2007fd5c.slice/crio-5161500ff14b5b7191efc66f96029de30aa6b684db820db7d1cb0b5618ad712b WatchSource:0}: Error finding container 5161500ff14b5b7191efc66f96029de30aa6b684db820db7d1cb0b5618ad712b: Status 404 returned error can't find the container with id 5161500ff14b5b7191efc66f96029de30aa6b684db820db7d1cb0b5618ad712b
Jul 09 18:30:39.630098 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:30:39.630059    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-tk9mt" event={"ID":"259045cf-8a5d-4dc9-818a-8f6d2007fd5c","Type":"ContainerStarted","Data":"5161500ff14b5b7191efc66f96029de30aa6b684db820db7d1cb0b5618ad712b"}
Jul 09 18:30:39.631629 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:30:39.631601    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-668f4b5f87-jmmtk" event={"ID":"e64bfe60-9c8b-4d07-8b1d-a4f4ad954f7f","Type":"ContainerStarted","Data":"c7d05b18c191e8cf1f02499bb50e73ca014dcb2164da2216c1ee8506f1112e4c"}
Jul 09 18:30:39.657918 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:30:39.657853    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-668f4b5f87-jmmtk" podStartSLOduration=1.501388817 podStartE2EDuration="4.657834606s" totalImagesPullingTime="3.156445789s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 18:30:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 18:30:39.656658363 +0000 UTC m=+308.896002992" watchObservedRunningTime="2026-07-09 18:30:39.657834606 +0000 UTC m=+308.897179236"
Jul 09 18:30:41.643114 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:30:41.643079    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-4wffq" event={"ID":"238eb895-3741-4a66-b2b4-8c2a64516a11","Type":"ContainerStarted","Data":"8473fc53ed5c43bf5542627572916b41a3d8dcf05a4d3728dd6ff85945a55906"}
Jul 09 18:30:41.643678 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:30:41.643140    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-54d89bd5fc-4wffq"
Jul 09 18:30:41.663083 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:30:41.663023    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/model-serving-api-54d89bd5fc-4wffq" podStartSLOduration=2.171550502 podStartE2EDuration="4.663002672s" totalImagesPullingTime="2.49145217s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 18:30:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 18:30:41.662161715 +0000 UTC m=+310.901506355" watchObservedRunningTime="2026-07-09 18:30:41.663002672 +0000 UTC m=+310.902347299"
Jul 09 18:30:43.701173 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:30:43.701124    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 09 18:30:43.701493 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:30:43.701217    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 09 18:30:44.660785 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:30:44.660748    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-tk9mt" event={"ID":"259045cf-8a5d-4dc9-818a-8f6d2007fd5c","Type":"ContainerStarted","Data":"ffc84f84b799ad12b3f6100157c8b902f40e07526688898dd23d8b6b35e90c9a"}
Jul 09 18:30:44.660966 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:30:44.660919    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-7574459656-tk9mt"
Jul 09 18:30:44.662528 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:30:44.662473    2557 patch_prober.go:28] interesting pod/istiod-openshift-gateway-7574459656-tk9mt container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 09 18:30:44.662667 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:30:44.662548    2557 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-7574459656-tk9mt" podUID="259045cf-8a5d-4dc9-818a-8f6d2007fd5c" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 09 18:30:44.707925 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:30:44.707851    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-7574459656-tk9mt" podStartSLOduration=2.391187752 podStartE2EDuration="6.707828484s" totalImagesPullingTime="4.316640732s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 18:30:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 18:30:44.702922092 +0000 UTC m=+313.942266743" watchObservedRunningTime="2026-07-09 18:30:44.707828484 +0000 UTC m=+313.947173111"
Jul 09 18:30:44.903126 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:30:44.903095    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4p2shw"]
Jul 09 18:30:44.906510 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:30:44.906469    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4p2shw"
Jul 09 18:30:44.909272 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:30:44.909253    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-lhtxk\""
Jul 09 18:30:44.923401 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:30:44.923369    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4p2shw"]
Jul 09 18:30:44.949430 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:30:44.949379    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c5871ddf-8389-4f6f-b9ee-16c0e02c0fbf-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4p2shw\" (UID: \"c5871ddf-8389-4f6f-b9ee-16c0e02c0fbf\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4p2shw"
Jul 09 18:30:44.949430 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:30:44.949426    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c5871ddf-8389-4f6f-b9ee-16c0e02c0fbf-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4p2shw\" (UID: \"c5871ddf-8389-4f6f-b9ee-16c0e02c0fbf\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4p2shw"
Jul 09 18:30:44.949660 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:30:44.949513    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dr5qp\" (UniqueName: \"kubernetes.io/projected/c5871ddf-8389-4f6f-b9ee-16c0e02c0fbf-kube-api-access-dr5qp\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4p2shw\" (UID: \"c5871ddf-8389-4f6f-b9ee-16c0e02c0fbf\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4p2shw"
Jul 09 18:30:44.949660 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:30:44.949554    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c5871ddf-8389-4f6f-b9ee-16c0e02c0fbf-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4p2shw\" (UID: \"c5871ddf-8389-4f6f-b9ee-16c0e02c0fbf\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4p2shw"
Jul 09 18:30:44.949660 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:30:44.949617    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c5871ddf-8389-4f6f-b9ee-16c0e02c0fbf-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4p2shw\" (UID: \"c5871ddf-8389-4f6f-b9ee-16c0e02c0fbf\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4p2shw"
Jul 09 18:30:44.949660 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:30:44.949653    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c5871ddf-8389-4f6f-b9ee-16c0e02c0fbf-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4p2shw\" (UID: \"c5871ddf-8389-4f6f-b9ee-16c0e02c0fbf\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4p2shw"
Jul 09 18:30:44.949810 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:30:44.949675    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c5871ddf-8389-4f6f-b9ee-16c0e02c0fbf-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4p2shw\" (UID: \"c5871ddf-8389-4f6f-b9ee-16c0e02c0fbf\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4p2shw"
Jul 09 18:30:44.949810 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:30:44.949713    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c5871ddf-8389-4f6f-b9ee-16c0e02c0fbf-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4p2shw\" (UID: \"c5871ddf-8389-4f6f-b9ee-16c0e02c0fbf\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4p2shw"
Jul 09 18:30:44.949810 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:30:44.949734    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c5871ddf-8389-4f6f-b9ee-16c0e02c0fbf-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4p2shw\" (UID: \"c5871ddf-8389-4f6f-b9ee-16c0e02c0fbf\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4p2shw"
Jul 09 18:30:45.050684 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:30:45.050653    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dr5qp\" (UniqueName: \"kubernetes.io/projected/c5871ddf-8389-4f6f-b9ee-16c0e02c0fbf-kube-api-access-dr5qp\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4p2shw\" (UID: \"c5871ddf-8389-4f6f-b9ee-16c0e02c0fbf\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4p2shw"
Jul 09 18:30:45.050847 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:30:45.050692    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c5871ddf-8389-4f6f-b9ee-16c0e02c0fbf-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4p2shw\" (UID: \"c5871ddf-8389-4f6f-b9ee-16c0e02c0fbf\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4p2shw"
Jul 09 18:30:45.050847 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:30:45.050736    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c5871ddf-8389-4f6f-b9ee-16c0e02c0fbf-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4p2shw\" (UID: \"c5871ddf-8389-4f6f-b9ee-16c0e02c0fbf\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4p2shw"
Jul 09 18:30:45.050847 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:30:45.050764    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c5871ddf-8389-4f6f-b9ee-16c0e02c0fbf-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4p2shw\" (UID: \"c5871ddf-8389-4f6f-b9ee-16c0e02c0fbf\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4p2shw"
Jul 09 18:30:45.050847 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:30:45.050786    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c5871ddf-8389-4f6f-b9ee-16c0e02c0fbf-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4p2shw\" (UID: \"c5871ddf-8389-4f6f-b9ee-16c0e02c0fbf\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4p2shw"
Jul 09 18:30:45.050847 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:30:45.050826    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c5871ddf-8389-4f6f-b9ee-16c0e02c0fbf-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4p2shw\" (UID: \"c5871ddf-8389-4f6f-b9ee-16c0e02c0fbf\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4p2shw"
Jul 09 18:30:45.050847 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:30:45.050846    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c5871ddf-8389-4f6f-b9ee-16c0e02c0fbf-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4p2shw\" (UID: \"c5871ddf-8389-4f6f-b9ee-16c0e02c0fbf\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4p2shw"
Jul 09 18:30:45.051161 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:30:45.050883    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c5871ddf-8389-4f6f-b9ee-16c0e02c0fbf-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4p2shw\" (UID: \"c5871ddf-8389-4f6f-b9ee-16c0e02c0fbf\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4p2shw"
Jul 09 18:30:45.051161 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:30:45.051000    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c5871ddf-8389-4f6f-b9ee-16c0e02c0fbf-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4p2shw\" (UID: \"c5871ddf-8389-4f6f-b9ee-16c0e02c0fbf\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4p2shw"
Jul 09 18:30:45.051761 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:30:45.051326    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c5871ddf-8389-4f6f-b9ee-16c0e02c0fbf-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4p2shw\" (UID: \"c5871ddf-8389-4f6f-b9ee-16c0e02c0fbf\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4p2shw"
Jul 09 18:30:45.051761 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:30:45.051346    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c5871ddf-8389-4f6f-b9ee-16c0e02c0fbf-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4p2shw\" (UID: \"c5871ddf-8389-4f6f-b9ee-16c0e02c0fbf\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4p2shw"
Jul 09 18:30:45.052117 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:30:45.051950    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c5871ddf-8389-4f6f-b9ee-16c0e02c0fbf-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4p2shw\" (UID: \"c5871ddf-8389-4f6f-b9ee-16c0e02c0fbf\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4p2shw"
Jul 09 18:30:45.052117 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:30:45.052083    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c5871ddf-8389-4f6f-b9ee-16c0e02c0fbf-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4p2shw\" (UID: \"c5871ddf-8389-4f6f-b9ee-16c0e02c0fbf\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4p2shw"
Jul 09 18:30:45.052424 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:30:45.052388    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c5871ddf-8389-4f6f-b9ee-16c0e02c0fbf-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4p2shw\" (UID: \"c5871ddf-8389-4f6f-b9ee-16c0e02c0fbf\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4p2shw"
Jul 09 18:30:45.053840 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:30:45.053820    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c5871ddf-8389-4f6f-b9ee-16c0e02c0fbf-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4p2shw\" (UID: \"c5871ddf-8389-4f6f-b9ee-16c0e02c0fbf\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4p2shw"
Jul 09 18:30:45.054072 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:30:45.054053    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c5871ddf-8389-4f6f-b9ee-16c0e02c0fbf-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4p2shw\" (UID: \"c5871ddf-8389-4f6f-b9ee-16c0e02c0fbf\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4p2shw"
Jul 09 18:30:45.059246 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:30:45.059224    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dr5qp\" (UniqueName: \"kubernetes.io/projected/c5871ddf-8389-4f6f-b9ee-16c0e02c0fbf-kube-api-access-dr5qp\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4p2shw\" (UID: \"c5871ddf-8389-4f6f-b9ee-16c0e02c0fbf\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4p2shw"
Jul 09 18:30:45.059790 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:30:45.059774    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c5871ddf-8389-4f6f-b9ee-16c0e02c0fbf-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4p2shw\" (UID: \"c5871ddf-8389-4f6f-b9ee-16c0e02c0fbf\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4p2shw"
Jul 09 18:30:45.217354 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:30:45.217273    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4p2shw"
Jul 09 18:30:45.378529 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:30:45.378498    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4p2shw"]
Jul 09 18:30:45.381774 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:30:45.381747    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc5871ddf_8389_4f6f_b9ee_16c0e02c0fbf.slice/crio-0dbf5e98e919cd81cf27aeccbe43a32736244fa9e6c3b76b3b97677ea75c81ec WatchSource:0}: Error finding container 0dbf5e98e919cd81cf27aeccbe43a32736244fa9e6c3b76b3b97677ea75c81ec: Status 404 returned error can't find the container with id 0dbf5e98e919cd81cf27aeccbe43a32736244fa9e6c3b76b3b97677ea75c81ec
Jul 09 18:30:45.667124 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:30:45.667084    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4p2shw" event={"ID":"c5871ddf-8389-4f6f-b9ee-16c0e02c0fbf","Type":"ContainerStarted","Data":"0dbf5e98e919cd81cf27aeccbe43a32736244fa9e6c3b76b3b97677ea75c81ec"}
Jul 09 18:30:45.668036 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:30:45.668017    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-7574459656-tk9mt"
Jul 09 18:30:47.524124 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:30:47.524086    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-rxlvf"]
Jul 09 18:30:47.531808 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:30:47.531775    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-rxlvf"
Jul 09 18:30:47.540028 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:30:47.539989    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-p9j76\""
Jul 09 18:30:47.546416 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:30:47.546392    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-rxlvf"]
Jul 09 18:30:47.559612 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:30:47.559571    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\""
Jul 09 18:30:47.561672 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:30:47.561588    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-jqjtj"]
Jul 09 18:30:47.565325 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:30:47.565305    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-jqjtj"
Jul 09 18:30:47.573553 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:30:47.573529    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-webhook-server-cert\""
Jul 09 18:30:47.573865 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:30:47.573847    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-controller-manager-dockercfg-wv7dg\""
Jul 09 18:30:47.575121 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:30:47.575098    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f8732a9f-c4ca-486b-bf37-8bf1f99ca897-cert\") pod \"kserve-controller-manager-d6f4b65b8-rxlvf\" (UID: \"f8732a9f-c4ca-486b-bf37-8bf1f99ca897\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-rxlvf"
Jul 09 18:30:47.575291 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:30:47.575225    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xv7nr\" (UniqueName: \"kubernetes.io/projected/f8732a9f-c4ca-486b-bf37-8bf1f99ca897-kube-api-access-xv7nr\") pod \"kserve-controller-manager-d6f4b65b8-rxlvf\" (UID: \"f8732a9f-c4ca-486b-bf37-8bf1f99ca897\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-rxlvf"
Jul 09 18:30:47.583584 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:30:47.583555    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-jqjtj"]
Jul 09 18:30:47.676083 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:30:47.676052    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bdbqp\" (UniqueName: \"kubernetes.io/projected/36545808-0daf-49b4-b2dc-76fea0005844-kube-api-access-bdbqp\") pod \"llmisvc-controller-manager-777c6bd7d5-jqjtj\" (UID: \"36545808-0daf-49b4-b2dc-76fea0005844\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-jqjtj"
Jul 09 18:30:47.676282 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:30:47.676109    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xv7nr\" (UniqueName: \"kubernetes.io/projected/f8732a9f-c4ca-486b-bf37-8bf1f99ca897-kube-api-access-xv7nr\") pod \"kserve-controller-manager-d6f4b65b8-rxlvf\" (UID: \"f8732a9f-c4ca-486b-bf37-8bf1f99ca897\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-rxlvf"
Jul 09 18:30:47.676282 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:30:47.676149    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f8732a9f-c4ca-486b-bf37-8bf1f99ca897-cert\") pod \"kserve-controller-manager-d6f4b65b8-rxlvf\" (UID: \"f8732a9f-c4ca-486b-bf37-8bf1f99ca897\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-rxlvf"
Jul 09 18:30:47.676282 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:30:47.676220    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/36545808-0daf-49b4-b2dc-76fea0005844-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-jqjtj\" (UID: \"36545808-0daf-49b4-b2dc-76fea0005844\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-jqjtj"
Jul 09 18:30:47.676447 ip-10-0-141-101 kubenswrapper[2557]: E0709 18:30:47.676313    2557 secret.go:189] Couldn't get secret opendatahub/kserve-webhook-server-cert: secret "kserve-webhook-server-cert" not found
Jul 09 18:30:47.676447 ip-10-0-141-101 kubenswrapper[2557]: E0709 18:30:47.676388    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f8732a9f-c4ca-486b-bf37-8bf1f99ca897-cert podName:f8732a9f-c4ca-486b-bf37-8bf1f99ca897 nodeName:}" failed. No retries permitted until 2026-07-09 18:30:48.176363613 +0000 UTC m=+317.415708231 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/f8732a9f-c4ca-486b-bf37-8bf1f99ca897-cert") pod "kserve-controller-manager-d6f4b65b8-rxlvf" (UID: "f8732a9f-c4ca-486b-bf37-8bf1f99ca897") : secret "kserve-webhook-server-cert" not found
Jul 09 18:30:47.686591 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:30:47.686565    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xv7nr\" (UniqueName: \"kubernetes.io/projected/f8732a9f-c4ca-486b-bf37-8bf1f99ca897-kube-api-access-xv7nr\") pod \"kserve-controller-manager-d6f4b65b8-rxlvf\" (UID: \"f8732a9f-c4ca-486b-bf37-8bf1f99ca897\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-rxlvf"
Jul 09 18:30:47.778119 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:30:47.776802    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/36545808-0daf-49b4-b2dc-76fea0005844-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-jqjtj\" (UID: \"36545808-0daf-49b4-b2dc-76fea0005844\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-jqjtj"
Jul 09 18:30:47.778119 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:30:47.776895    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bdbqp\" (UniqueName: \"kubernetes.io/projected/36545808-0daf-49b4-b2dc-76fea0005844-kube-api-access-bdbqp\") pod \"llmisvc-controller-manager-777c6bd7d5-jqjtj\" (UID: \"36545808-0daf-49b4-b2dc-76fea0005844\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-jqjtj"
Jul 09 18:30:47.780253 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:30:47.780197    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/36545808-0daf-49b4-b2dc-76fea0005844-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-jqjtj\" (UID: \"36545808-0daf-49b4-b2dc-76fea0005844\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-jqjtj"
Jul 09 18:30:47.787629 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:30:47.787601    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bdbqp\" (UniqueName: \"kubernetes.io/projected/36545808-0daf-49b4-b2dc-76fea0005844-kube-api-access-bdbqp\") pod \"llmisvc-controller-manager-777c6bd7d5-jqjtj\" (UID: \"36545808-0daf-49b4-b2dc-76fea0005844\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-jqjtj"
Jul 09 18:30:47.877528 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:30:47.877492    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-jqjtj"
Jul 09 18:30:47.942205 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:30:47.942169    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-tk9mt"]
Jul 09 18:30:47.942404 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:30:47.942358    2557 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/istiod-openshift-gateway-7574459656-tk9mt" podUID="259045cf-8a5d-4dc9-818a-8f6d2007fd5c" containerName="discovery" containerID="cri-o://ffc84f84b799ad12b3f6100157c8b902f40e07526688898dd23d8b6b35e90c9a" gracePeriod=30
Jul 09 18:30:47.971014 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:30:47.970970    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 09 18:30:47.971118 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:30:47.971069    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 09 18:30:47.971401 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:30:47.971124    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 09 18:30:48.056114 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:30:48.056082    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-jqjtj"]
Jul 09 18:30:48.058156 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:30:48.058134    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod36545808_0daf_49b4_b2dc_76fea0005844.slice/crio-885dda0a6fb288d039ee89ddda2d0c73b81b6bfc952a769392ed36a5069550d0 WatchSource:0}: Error finding container 885dda0a6fb288d039ee89ddda2d0c73b81b6bfc952a769392ed36a5069550d0: Status 404 returned error can't find the container with id 885dda0a6fb288d039ee89ddda2d0c73b81b6bfc952a769392ed36a5069550d0
Jul 09 18:30:48.180444 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:30:48.180411    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f8732a9f-c4ca-486b-bf37-8bf1f99ca897-cert\") pod \"kserve-controller-manager-d6f4b65b8-rxlvf\" (UID: \"f8732a9f-c4ca-486b-bf37-8bf1f99ca897\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-rxlvf"
Jul 09 18:30:48.182854 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:30:48.182831    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f8732a9f-c4ca-486b-bf37-8bf1f99ca897-cert\") pod \"kserve-controller-manager-d6f4b65b8-rxlvf\" (UID: \"f8732a9f-c4ca-486b-bf37-8bf1f99ca897\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-rxlvf"
Jul 09 18:30:48.183580 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:30:48.183562    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-tk9mt"
Jul 09 18:30:48.280894 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:30:48.280864    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/259045cf-8a5d-4dc9-818a-8f6d2007fd5c-istio-csr-dns-cert\") pod \"259045cf-8a5d-4dc9-818a-8f6d2007fd5c\" (UID: \"259045cf-8a5d-4dc9-818a-8f6d2007fd5c\") "
Jul 09 18:30:48.281103 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:30:48.280935    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6pdxb\" (UniqueName: \"kubernetes.io/projected/259045cf-8a5d-4dc9-818a-8f6d2007fd5c-kube-api-access-6pdxb\") pod \"259045cf-8a5d-4dc9-818a-8f6d2007fd5c\" (UID: \"259045cf-8a5d-4dc9-818a-8f6d2007fd5c\") "
Jul 09 18:30:48.281103 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:30:48.280980    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/259045cf-8a5d-4dc9-818a-8f6d2007fd5c-istio-token\") pod \"259045cf-8a5d-4dc9-818a-8f6d2007fd5c\" (UID: \"259045cf-8a5d-4dc9-818a-8f6d2007fd5c\") "
Jul 09 18:30:48.281103 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:30:48.281004    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/259045cf-8a5d-4dc9-818a-8f6d2007fd5c-istio-kubeconfig\") pod \"259045cf-8a5d-4dc9-818a-8f6d2007fd5c\" (UID: \"259045cf-8a5d-4dc9-818a-8f6d2007fd5c\") "
Jul 09 18:30:48.281103 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:30:48.281024    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/259045cf-8a5d-4dc9-818a-8f6d2007fd5c-istio-csr-ca-configmap\") pod \"259045cf-8a5d-4dc9-818a-8f6d2007fd5c\" (UID: \"259045cf-8a5d-4dc9-818a-8f6d2007fd5c\") "
Jul 09 18:30:48.281103 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:30:48.281064    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/259045cf-8a5d-4dc9-818a-8f6d2007fd5c-cacerts\") pod \"259045cf-8a5d-4dc9-818a-8f6d2007fd5c\" (UID: \"259045cf-8a5d-4dc9-818a-8f6d2007fd5c\") "
Jul 09 18:30:48.281470 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:30:48.281446    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/259045cf-8a5d-4dc9-818a-8f6d2007fd5c-local-certs\") pod \"259045cf-8a5d-4dc9-818a-8f6d2007fd5c\" (UID: \"259045cf-8a5d-4dc9-818a-8f6d2007fd5c\") "
Jul 09 18:30:48.281470 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:30:48.281454    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/259045cf-8a5d-4dc9-818a-8f6d2007fd5c-istio-csr-ca-configmap" (OuterVolumeSpecName: "istio-csr-ca-configmap") pod "259045cf-8a5d-4dc9-818a-8f6d2007fd5c" (UID: "259045cf-8a5d-4dc9-818a-8f6d2007fd5c"). InnerVolumeSpecName "istio-csr-ca-configmap". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 09 18:30:48.281873 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:30:48.281841    2557 reconciler_common.go:299] "Volume detached for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/259045cf-8a5d-4dc9-818a-8f6d2007fd5c-istio-csr-ca-configmap\") on node \"ip-10-0-141-101.ec2.internal\" DevicePath \"\""
Jul 09 18:30:48.283608 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:30:48.283577    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/259045cf-8a5d-4dc9-818a-8f6d2007fd5c-istio-csr-dns-cert" (OuterVolumeSpecName: "istio-csr-dns-cert") pod "259045cf-8a5d-4dc9-818a-8f6d2007fd5c" (UID: "259045cf-8a5d-4dc9-818a-8f6d2007fd5c"). InnerVolumeSpecName "istio-csr-dns-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 18:30:48.283720 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:30:48.283636    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/259045cf-8a5d-4dc9-818a-8f6d2007fd5c-istio-kubeconfig" (OuterVolumeSpecName: "istio-kubeconfig") pod "259045cf-8a5d-4dc9-818a-8f6d2007fd5c" (UID: "259045cf-8a5d-4dc9-818a-8f6d2007fd5c"). InnerVolumeSpecName "istio-kubeconfig". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 18:30:48.283786 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:30:48.283738    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/259045cf-8a5d-4dc9-818a-8f6d2007fd5c-istio-token" (OuterVolumeSpecName: "istio-token") pod "259045cf-8a5d-4dc9-818a-8f6d2007fd5c" (UID: "259045cf-8a5d-4dc9-818a-8f6d2007fd5c"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 18:30:48.283786 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:30:48.283745    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/259045cf-8a5d-4dc9-818a-8f6d2007fd5c-cacerts" (OuterVolumeSpecName: "cacerts") pod "259045cf-8a5d-4dc9-818a-8f6d2007fd5c" (UID: "259045cf-8a5d-4dc9-818a-8f6d2007fd5c"). InnerVolumeSpecName "cacerts". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 18:30:48.283786 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:30:48.283763    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/259045cf-8a5d-4dc9-818a-8f6d2007fd5c-local-certs" (OuterVolumeSpecName: "local-certs") pod "259045cf-8a5d-4dc9-818a-8f6d2007fd5c" (UID: "259045cf-8a5d-4dc9-818a-8f6d2007fd5c"). InnerVolumeSpecName "local-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 18:30:48.283895 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:30:48.283797    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/259045cf-8a5d-4dc9-818a-8f6d2007fd5c-kube-api-access-6pdxb" (OuterVolumeSpecName: "kube-api-access-6pdxb") pod "259045cf-8a5d-4dc9-818a-8f6d2007fd5c" (UID: "259045cf-8a5d-4dc9-818a-8f6d2007fd5c"). InnerVolumeSpecName "kube-api-access-6pdxb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 18:30:48.382989 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:30:48.382897    2557 reconciler_common.go:299] "Volume detached for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/259045cf-8a5d-4dc9-818a-8f6d2007fd5c-istio-kubeconfig\") on node \"ip-10-0-141-101.ec2.internal\" DevicePath \"\""
Jul 09 18:30:48.382989 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:30:48.382923    2557 reconciler_common.go:299] "Volume detached for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/259045cf-8a5d-4dc9-818a-8f6d2007fd5c-cacerts\") on node \"ip-10-0-141-101.ec2.internal\" DevicePath \"\""
Jul 09 18:30:48.382989 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:30:48.382934    2557 reconciler_common.go:299] "Volume detached for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/259045cf-8a5d-4dc9-818a-8f6d2007fd5c-local-certs\") on node \"ip-10-0-141-101.ec2.internal\" DevicePath \"\""
Jul 09 18:30:48.382989 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:30:48.382944    2557 reconciler_common.go:299] "Volume detached for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/259045cf-8a5d-4dc9-818a-8f6d2007fd5c-istio-csr-dns-cert\") on node \"ip-10-0-141-101.ec2.internal\" DevicePath \"\""
Jul 09 18:30:48.382989 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:30:48.382954    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6pdxb\" (UniqueName: \"kubernetes.io/projected/259045cf-8a5d-4dc9-818a-8f6d2007fd5c-kube-api-access-6pdxb\") on node \"ip-10-0-141-101.ec2.internal\" DevicePath \"\""
Jul 09 18:30:48.382989 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:30:48.382962    2557 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/259045cf-8a5d-4dc9-818a-8f6d2007fd5c-istio-token\") on node \"ip-10-0-141-101.ec2.internal\" DevicePath \"\""
Jul 09 18:30:48.445789 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:30:48.445752    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-rxlvf"
Jul 09 18:30:48.592306 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:30:48.592280    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-rxlvf"]
Jul 09 18:30:48.594779 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:30:48.594757    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf8732a9f_c4ca_486b_bf37_8bf1f99ca897.slice/crio-0c806cbd897c85c1628c1eceee01dab307fc179ae876037210d889b6a65163de WatchSource:0}: Error finding container 0c806cbd897c85c1628c1eceee01dab307fc179ae876037210d889b6a65163de: Status 404 returned error can't find the container with id 0c806cbd897c85c1628c1eceee01dab307fc179ae876037210d889b6a65163de
Jul 09 18:30:48.686217 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:30:48.686140    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-rxlvf" event={"ID":"f8732a9f-c4ca-486b-bf37-8bf1f99ca897","Type":"ContainerStarted","Data":"0c806cbd897c85c1628c1eceee01dab307fc179ae876037210d889b6a65163de"}
Jul 09 18:30:48.687785 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:30:48.687718    2557 generic.go:356] "Generic (PLEG): container finished" podID="259045cf-8a5d-4dc9-818a-8f6d2007fd5c" containerID="ffc84f84b799ad12b3f6100157c8b902f40e07526688898dd23d8b6b35e90c9a" exitCode=0
Jul 09 18:30:48.687785 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:30:48.687781    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-tk9mt"
Jul 09 18:30:48.688000 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:30:48.687803    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-tk9mt" event={"ID":"259045cf-8a5d-4dc9-818a-8f6d2007fd5c","Type":"ContainerDied","Data":"ffc84f84b799ad12b3f6100157c8b902f40e07526688898dd23d8b6b35e90c9a"}
Jul 09 18:30:48.688000 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:30:48.687852    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-tk9mt" event={"ID":"259045cf-8a5d-4dc9-818a-8f6d2007fd5c","Type":"ContainerDied","Data":"5161500ff14b5b7191efc66f96029de30aa6b684db820db7d1cb0b5618ad712b"}
Jul 09 18:30:48.688000 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:30:48.687883    2557 scope.go:117] "RemoveContainer" containerID="ffc84f84b799ad12b3f6100157c8b902f40e07526688898dd23d8b6b35e90c9a"
Jul 09 18:30:48.689257 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:30:48.689234    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-jqjtj" event={"ID":"36545808-0daf-49b4-b2dc-76fea0005844","Type":"ContainerStarted","Data":"885dda0a6fb288d039ee89ddda2d0c73b81b6bfc952a769392ed36a5069550d0"}
Jul 09 18:30:48.690953 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:30:48.690932    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4p2shw" event={"ID":"c5871ddf-8389-4f6f-b9ee-16c0e02c0fbf","Type":"ContainerStarted","Data":"0fe5e044d537c44379e8eea4fa66b5e2777e62085a65ee2396607f83869328f6"}
Jul 09 18:30:48.718826 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:30:48.718769    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4p2shw" podStartSLOduration=2.132042699 podStartE2EDuration="4.718748187s" totalImagesPullingTime="2.586705488s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 18:30:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 18:30:48.717305667 +0000 UTC m=+317.956650317" watchObservedRunningTime="2026-07-09 18:30:48.718748187 +0000 UTC m=+317.958092814"
Jul 09 18:30:48.741874 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:30:48.741841    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-tk9mt"]
Jul 09 18:30:48.751798 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:30:48.751765    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-tk9mt"]
Jul 09 18:30:48.752147 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:30:48.752131    2557 scope.go:117] "RemoveContainer" containerID="ffc84f84b799ad12b3f6100157c8b902f40e07526688898dd23d8b6b35e90c9a"
Jul 09 18:30:48.752513 ip-10-0-141-101 kubenswrapper[2557]: E0709 18:30:48.752474    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ffc84f84b799ad12b3f6100157c8b902f40e07526688898dd23d8b6b35e90c9a\": container with ID starting with ffc84f84b799ad12b3f6100157c8b902f40e07526688898dd23d8b6b35e90c9a not found: ID does not exist" containerID="ffc84f84b799ad12b3f6100157c8b902f40e07526688898dd23d8b6b35e90c9a"
Jul 09 18:30:48.752606 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:30:48.752524    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ffc84f84b799ad12b3f6100157c8b902f40e07526688898dd23d8b6b35e90c9a"} err="failed to get container status \"ffc84f84b799ad12b3f6100157c8b902f40e07526688898dd23d8b6b35e90c9a\": rpc error: code = NotFound desc = could not find container \"ffc84f84b799ad12b3f6100157c8b902f40e07526688898dd23d8b6b35e90c9a\": container with ID starting with ffc84f84b799ad12b3f6100157c8b902f40e07526688898dd23d8b6b35e90c9a not found: ID does not exist"
Jul 09 18:30:49.217529 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:30:49.217495    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4p2shw"
Jul 09 18:30:49.223772 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:30:49.223741    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4p2shw"
Jul 09 18:30:49.265136 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:30:49.265047    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="259045cf-8a5d-4dc9-818a-8f6d2007fd5c" path="/var/lib/kubelet/pods/259045cf-8a5d-4dc9-818a-8f6d2007fd5c/volumes"
Jul 09 18:30:49.697892 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:30:49.697855    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4p2shw"
Jul 09 18:30:49.698964 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:30:49.698937    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4p2shw"
Jul 09 18:30:52.653754 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:30:52.653722    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-54d89bd5fc-4wffq"
Jul 09 18:30:52.714676 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:30:52.714583    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-rxlvf" event={"ID":"f8732a9f-c4ca-486b-bf37-8bf1f99ca897","Type":"ContainerStarted","Data":"7077f64284d7d0d59faf30db69017fa490c016be8135abdc69e1d956054aa127"}
Jul 09 18:30:52.714871 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:30:52.714693    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-rxlvf"
Jul 09 18:30:52.716185 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:30:52.716151    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-jqjtj" event={"ID":"36545808-0daf-49b4-b2dc-76fea0005844","Type":"ContainerStarted","Data":"359cff795a1df55b92eff98cf5ef54f3283009e54e54df1cfa1e141b3c0ccdac"}
Jul 09 18:30:52.716308 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:30:52.716296    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-jqjtj"
Jul 09 18:30:52.736840 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:30:52.736788    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-d6f4b65b8-rxlvf" podStartSLOduration=2.688394745 podStartE2EDuration="5.736771727s" totalImagesPullingTime="3.048376982s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 18:30:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 18:30:52.73574358 +0000 UTC m=+321.975088228" watchObservedRunningTime="2026-07-09 18:30:52.736771727 +0000 UTC m=+321.976116636"
Jul 09 18:30:52.757176 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:30:52.757117    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-jqjtj" podStartSLOduration=2.169486923 podStartE2EDuration="5.757101687s" totalImagesPullingTime="3.587614764s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 18:30:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 18:30:52.754860411 +0000 UTC m=+321.994205055" watchObservedRunningTime="2026-07-09 18:30:52.757101687 +0000 UTC m=+321.996446312"
Jul 09 18:31:23.727700 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:31:23.727616    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-jqjtj"
Jul 09 18:31:23.730362 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:31:23.730338    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-rxlvf"
Jul 09 18:31:36.310260 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:31:36.310222    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-2vsdd"]
Jul 09 18:31:36.310770 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:31:36.310746    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="259045cf-8a5d-4dc9-818a-8f6d2007fd5c" containerName="discovery"
Jul 09 18:31:36.310770 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:31:36.310766    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="259045cf-8a5d-4dc9-818a-8f6d2007fd5c" containerName="discovery"
Jul 09 18:31:36.310870 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:31:36.310858    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="259045cf-8a5d-4dc9-818a-8f6d2007fd5c" containerName="discovery"
Jul 09 18:31:36.314219 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:31:36.314201    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-2vsdd"
Jul 09 18:31:36.316697 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:31:36.316665    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-catalog-dockercfg-8jkrg\""
Jul 09 18:31:36.317446 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:31:36.317423    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 09 18:31:36.317652 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:31:36.317426    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 09 18:31:36.331051 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:31:36.331024    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-2vsdd"]
Jul 09 18:31:36.393004 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:31:36.392970    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4ggc5\" (UniqueName: \"kubernetes.io/projected/8c621719-235c-459a-86b4-cb4ad7dbdbb5-kube-api-access-4ggc5\") pod \"kuadrant-operator-catalog-2vsdd\" (UID: \"8c621719-235c-459a-86b4-cb4ad7dbdbb5\") " pod="kuadrant-system/kuadrant-operator-catalog-2vsdd"
Jul 09 18:31:36.494295 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:31:36.494262    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4ggc5\" (UniqueName: \"kubernetes.io/projected/8c621719-235c-459a-86b4-cb4ad7dbdbb5-kube-api-access-4ggc5\") pod \"kuadrant-operator-catalog-2vsdd\" (UID: \"8c621719-235c-459a-86b4-cb4ad7dbdbb5\") " pod="kuadrant-system/kuadrant-operator-catalog-2vsdd"
Jul 09 18:31:36.502758 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:31:36.502731    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4ggc5\" (UniqueName: \"kubernetes.io/projected/8c621719-235c-459a-86b4-cb4ad7dbdbb5-kube-api-access-4ggc5\") pod \"kuadrant-operator-catalog-2vsdd\" (UID: \"8c621719-235c-459a-86b4-cb4ad7dbdbb5\") " pod="kuadrant-system/kuadrant-operator-catalog-2vsdd"
Jul 09 18:31:36.613623 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:31:36.613539    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-2vsdd"]
Jul 09 18:31:36.613846 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:31:36.613834    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-2vsdd"
Jul 09 18:31:36.757150 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:31:36.757122    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-2vsdd"]
Jul 09 18:31:36.759067 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:31:36.759024    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8c621719_235c_459a_86b4_cb4ad7dbdbb5.slice/crio-47811a2eac757f12666b2d9fcf4622a02eefced9390d49534996decb085399b7 WatchSource:0}: Error finding container 47811a2eac757f12666b2d9fcf4622a02eefced9390d49534996decb085399b7: Status 404 returned error can't find the container with id 47811a2eac757f12666b2d9fcf4622a02eefced9390d49534996decb085399b7
Jul 09 18:31:36.829090 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:31:36.829052    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-v47l9"]
Jul 09 18:31:36.831902 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:31:36.831882    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-v47l9"
Jul 09 18:31:36.842765 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:31:36.842721    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-v47l9"]
Jul 09 18:31:36.896703 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:31:36.896605    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t99lz\" (UniqueName: \"kubernetes.io/projected/5be2acbb-ba31-408f-b2ee-dcb60222b037-kube-api-access-t99lz\") pod \"kuadrant-operator-catalog-v47l9\" (UID: \"5be2acbb-ba31-408f-b2ee-dcb60222b037\") " pod="kuadrant-system/kuadrant-operator-catalog-v47l9"
Jul 09 18:31:36.925806 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:31:36.925773    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-2vsdd" event={"ID":"8c621719-235c-459a-86b4-cb4ad7dbdbb5","Type":"ContainerStarted","Data":"47811a2eac757f12666b2d9fcf4622a02eefced9390d49534996decb085399b7"}
Jul 09 18:31:36.997253 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:31:36.997212    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t99lz\" (UniqueName: \"kubernetes.io/projected/5be2acbb-ba31-408f-b2ee-dcb60222b037-kube-api-access-t99lz\") pod \"kuadrant-operator-catalog-v47l9\" (UID: \"5be2acbb-ba31-408f-b2ee-dcb60222b037\") " pod="kuadrant-system/kuadrant-operator-catalog-v47l9"
Jul 09 18:31:37.008127 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:31:37.008079    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t99lz\" (UniqueName: \"kubernetes.io/projected/5be2acbb-ba31-408f-b2ee-dcb60222b037-kube-api-access-t99lz\") pod \"kuadrant-operator-catalog-v47l9\" (UID: \"5be2acbb-ba31-408f-b2ee-dcb60222b037\") " pod="kuadrant-system/kuadrant-operator-catalog-v47l9"
Jul 09 18:31:37.142843 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:31:37.142803    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-v47l9"
Jul 09 18:31:37.287970 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:31:37.286460    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-v47l9"]
Jul 09 18:31:37.933679 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:31:37.933639    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-v47l9" event={"ID":"5be2acbb-ba31-408f-b2ee-dcb60222b037","Type":"ContainerStarted","Data":"43423d72c44d592a16b6cd623ad384171734ae6ea75d79d6abb308c1aeec0d41"}
Jul 09 18:31:39.943547 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:31:39.943507    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-v47l9" event={"ID":"5be2acbb-ba31-408f-b2ee-dcb60222b037","Type":"ContainerStarted","Data":"d72e43edfdb912fb188385564acdc5bb1c46d567b118a51157cb9eed41e41819"}
Jul 09 18:31:39.944987 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:31:39.944960    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-2vsdd" event={"ID":"8c621719-235c-459a-86b4-cb4ad7dbdbb5","Type":"ContainerStarted","Data":"5340b736fe431eaab4a575a5285904252c4fe892d6d6f497fa037495bfbc2754"}
Jul 09 18:31:39.945112 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:31:39.945003    2557 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-catalog-2vsdd" podUID="8c621719-235c-459a-86b4-cb4ad7dbdbb5" containerName="registry-server" containerID="cri-o://5340b736fe431eaab4a575a5285904252c4fe892d6d6f497fa037495bfbc2754" gracePeriod=2
Jul 09 18:31:39.961196 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:31:39.961149    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-v47l9" podStartSLOduration=2.343597792 podStartE2EDuration="3.96113098s" totalImagesPullingTime="1.617533188s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 18:31:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 18:31:39.95959258 +0000 UTC m=+369.198937227" watchObservedRunningTime="2026-07-09 18:31:39.96113098 +0000 UTC m=+369.200475605"
Jul 09 18:31:39.976663 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:31:39.976620    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-2vsdd" podStartSLOduration=1.829893809 podStartE2EDuration="3.976605169s" totalImagesPullingTime="2.14671136s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 18:31:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 18:31:39.975183878 +0000 UTC m=+369.214528503" watchObservedRunningTime="2026-07-09 18:31:39.976605169 +0000 UTC m=+369.215949832"
Jul 09 18:31:40.192954 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:31:40.192930    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-2vsdd"
Jul 09 18:31:40.220391 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:31:40.220316    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4ggc5\" (UniqueName: \"kubernetes.io/projected/8c621719-235c-459a-86b4-cb4ad7dbdbb5-kube-api-access-4ggc5\") pod \"8c621719-235c-459a-86b4-cb4ad7dbdbb5\" (UID: \"8c621719-235c-459a-86b4-cb4ad7dbdbb5\") "
Jul 09 18:31:40.222445 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:31:40.222418    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8c621719-235c-459a-86b4-cb4ad7dbdbb5-kube-api-access-4ggc5" (OuterVolumeSpecName: "kube-api-access-4ggc5") pod "8c621719-235c-459a-86b4-cb4ad7dbdbb5" (UID: "8c621719-235c-459a-86b4-cb4ad7dbdbb5"). InnerVolumeSpecName "kube-api-access-4ggc5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 18:31:40.321839 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:31:40.321805    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4ggc5\" (UniqueName: \"kubernetes.io/projected/8c621719-235c-459a-86b4-cb4ad7dbdbb5-kube-api-access-4ggc5\") on node \"ip-10-0-141-101.ec2.internal\" DevicePath \"\""
Jul 09 18:31:40.950609 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:31:40.950571    2557 generic.go:356] "Generic (PLEG): container finished" podID="8c621719-235c-459a-86b4-cb4ad7dbdbb5" containerID="5340b736fe431eaab4a575a5285904252c4fe892d6d6f497fa037495bfbc2754" exitCode=0
Jul 09 18:31:40.951055 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:31:40.950615    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-2vsdd"
Jul 09 18:31:40.951055 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:31:40.950660    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-2vsdd" event={"ID":"8c621719-235c-459a-86b4-cb4ad7dbdbb5","Type":"ContainerDied","Data":"5340b736fe431eaab4a575a5285904252c4fe892d6d6f497fa037495bfbc2754"}
Jul 09 18:31:40.951055 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:31:40.950704    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-2vsdd" event={"ID":"8c621719-235c-459a-86b4-cb4ad7dbdbb5","Type":"ContainerDied","Data":"47811a2eac757f12666b2d9fcf4622a02eefced9390d49534996decb085399b7"}
Jul 09 18:31:40.951055 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:31:40.950733    2557 scope.go:117] "RemoveContainer" containerID="5340b736fe431eaab4a575a5285904252c4fe892d6d6f497fa037495bfbc2754"
Jul 09 18:31:40.960626 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:31:40.960609    2557 scope.go:117] "RemoveContainer" containerID="5340b736fe431eaab4a575a5285904252c4fe892d6d6f497fa037495bfbc2754"
Jul 09 18:31:40.960880 ip-10-0-141-101 kubenswrapper[2557]: E0709 18:31:40.960861    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5340b736fe431eaab4a575a5285904252c4fe892d6d6f497fa037495bfbc2754\": container with ID starting with 5340b736fe431eaab4a575a5285904252c4fe892d6d6f497fa037495bfbc2754 not found: ID does not exist" containerID="5340b736fe431eaab4a575a5285904252c4fe892d6d6f497fa037495bfbc2754"
Jul 09 18:31:40.960940 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:31:40.960890    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5340b736fe431eaab4a575a5285904252c4fe892d6d6f497fa037495bfbc2754"} err="failed to get container status \"5340b736fe431eaab4a575a5285904252c4fe892d6d6f497fa037495bfbc2754\": rpc error: code = NotFound desc = could not find container \"5340b736fe431eaab4a575a5285904252c4fe892d6d6f497fa037495bfbc2754\": container with ID starting with 5340b736fe431eaab4a575a5285904252c4fe892d6d6f497fa037495bfbc2754 not found: ID does not exist"
Jul 09 18:31:40.971869 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:31:40.971843    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-2vsdd"]
Jul 09 18:31:40.978278 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:31:40.978255    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-2vsdd"]
Jul 09 18:31:41.261991 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:31:41.261912    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8c621719-235c-459a-86b4-cb4ad7dbdbb5" path="/var/lib/kubelet/pods/8c621719-235c-459a-86b4-cb4ad7dbdbb5/volumes"
Jul 09 18:31:47.143858 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:31:47.143805    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-catalog-v47l9"
Jul 09 18:31:47.144507 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:31:47.143894    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kuadrant-system/kuadrant-operator-catalog-v47l9"
Jul 09 18:31:47.166523 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:31:47.166496    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kuadrant-system/kuadrant-operator-catalog-v47l9"
Jul 09 18:31:48.008539 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:31:48.008511    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-catalog-v47l9"
Jul 09 18:31:52.331412 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:31:52.331375    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06pfk9"]
Jul 09 18:31:52.331893 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:31:52.331743    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8c621719-235c-459a-86b4-cb4ad7dbdbb5" containerName="registry-server"
Jul 09 18:31:52.331893 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:31:52.331754    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="8c621719-235c-459a-86b4-cb4ad7dbdbb5" containerName="registry-server"
Jul 09 18:31:52.331893 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:31:52.331807    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="8c621719-235c-459a-86b4-cb4ad7dbdbb5" containerName="registry-server"
Jul 09 18:31:52.336414 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:31:52.336392    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06pfk9"
Jul 09 18:31:52.340941 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:31:52.340923    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-68mcm\""
Jul 09 18:31:52.356343 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:31:52.356316    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06pfk9"]
Jul 09 18:31:52.432742 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:31:52.432707    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9fcd5829-c13b-433d-b6dd-2231cf459986-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06pfk9\" (UID: \"9fcd5829-c13b-433d-b6dd-2231cf459986\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06pfk9"
Jul 09 18:31:52.432931 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:31:52.432762    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-56bx8\" (UniqueName: \"kubernetes.io/projected/9fcd5829-c13b-433d-b6dd-2231cf459986-kube-api-access-56bx8\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06pfk9\" (UID: \"9fcd5829-c13b-433d-b6dd-2231cf459986\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06pfk9"
Jul 09 18:31:52.432931 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:31:52.432787    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9fcd5829-c13b-433d-b6dd-2231cf459986-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06pfk9\" (UID: \"9fcd5829-c13b-433d-b6dd-2231cf459986\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06pfk9"
Jul 09 18:31:52.533294 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:31:52.533255    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9fcd5829-c13b-433d-b6dd-2231cf459986-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06pfk9\" (UID: \"9fcd5829-c13b-433d-b6dd-2231cf459986\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06pfk9"
Jul 09 18:31:52.533522 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:31:52.533321    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-56bx8\" (UniqueName: \"kubernetes.io/projected/9fcd5829-c13b-433d-b6dd-2231cf459986-kube-api-access-56bx8\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06pfk9\" (UID: \"9fcd5829-c13b-433d-b6dd-2231cf459986\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06pfk9"
Jul 09 18:31:52.533522 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:31:52.533356    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9fcd5829-c13b-433d-b6dd-2231cf459986-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06pfk9\" (UID: \"9fcd5829-c13b-433d-b6dd-2231cf459986\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06pfk9"
Jul 09 18:31:52.533789 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:31:52.533764    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9fcd5829-c13b-433d-b6dd-2231cf459986-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06pfk9\" (UID: \"9fcd5829-c13b-433d-b6dd-2231cf459986\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06pfk9"
Jul 09 18:31:52.533852 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:31:52.533775    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9fcd5829-c13b-433d-b6dd-2231cf459986-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06pfk9\" (UID: \"9fcd5829-c13b-433d-b6dd-2231cf459986\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06pfk9"
Jul 09 18:31:52.543087 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:31:52.543053    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-56bx8\" (UniqueName: \"kubernetes.io/projected/9fcd5829-c13b-433d-b6dd-2231cf459986-kube-api-access-56bx8\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06pfk9\" (UID: \"9fcd5829-c13b-433d-b6dd-2231cf459986\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06pfk9"
Jul 09 18:31:52.645636 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:31:52.645543    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06pfk9"
Jul 09 18:31:52.806863 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:31:52.806711    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06pfk9"]
Jul 09 18:31:52.809846 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:31:52.809817    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9fcd5829_c13b_433d_b6dd_2231cf459986.slice/crio-f28d3856a815c692bf5a2d5561844c13a159063691c27310a87d6ca28c55f48c WatchSource:0}: Error finding container f28d3856a815c692bf5a2d5561844c13a159063691c27310a87d6ca28c55f48c: Status 404 returned error can't find the container with id f28d3856a815c692bf5a2d5561844c13a159063691c27310a87d6ca28c55f48c
Jul 09 18:31:53.009112 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:31:53.009076    2557 generic.go:356] "Generic (PLEG): container finished" podID="9fcd5829-c13b-433d-b6dd-2231cf459986" containerID="b44abb58a659c159bc8b0c899c3826ec1fc71a7d9b237ed09743a8db38c1aeae" exitCode=0
Jul 09 18:31:53.009308 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:31:53.009120    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06pfk9" event={"ID":"9fcd5829-c13b-433d-b6dd-2231cf459986","Type":"ContainerDied","Data":"b44abb58a659c159bc8b0c899c3826ec1fc71a7d9b237ed09743a8db38c1aeae"}
Jul 09 18:31:53.009308 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:31:53.009159    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06pfk9" event={"ID":"9fcd5829-c13b-433d-b6dd-2231cf459986","Type":"ContainerStarted","Data":"f28d3856a815c692bf5a2d5561844c13a159063691c27310a87d6ca28c55f48c"}
Jul 09 18:31:53.089033 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:31:53.089000    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef157pns"]
Jul 09 18:31:53.092942 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:31:53.092924    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef157pns"
Jul 09 18:31:53.103675 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:31:53.103648    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef157pns"]
Jul 09 18:31:53.138739 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:31:53.138708    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ba169fcd-c12d-49ff-a78a-061890b87071-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef157pns\" (UID: \"ba169fcd-c12d-49ff-a78a-061890b87071\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef157pns"
Jul 09 18:31:53.138739 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:31:53.138742    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fc6tl\" (UniqueName: \"kubernetes.io/projected/ba169fcd-c12d-49ff-a78a-061890b87071-kube-api-access-fc6tl\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef157pns\" (UID: \"ba169fcd-c12d-49ff-a78a-061890b87071\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef157pns"
Jul 09 18:31:53.138951 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:31:53.138830    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ba169fcd-c12d-49ff-a78a-061890b87071-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef157pns\" (UID: \"ba169fcd-c12d-49ff-a78a-061890b87071\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef157pns"
Jul 09 18:31:53.240297 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:31:53.240203    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ba169fcd-c12d-49ff-a78a-061890b87071-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef157pns\" (UID: \"ba169fcd-c12d-49ff-a78a-061890b87071\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef157pns"
Jul 09 18:31:53.240297 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:31:53.240248    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fc6tl\" (UniqueName: \"kubernetes.io/projected/ba169fcd-c12d-49ff-a78a-061890b87071-kube-api-access-fc6tl\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef157pns\" (UID: \"ba169fcd-c12d-49ff-a78a-061890b87071\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef157pns"
Jul 09 18:31:53.240297 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:31:53.240284    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ba169fcd-c12d-49ff-a78a-061890b87071-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef157pns\" (UID: \"ba169fcd-c12d-49ff-a78a-061890b87071\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef157pns"
Jul 09 18:31:53.240729 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:31:53.240708    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ba169fcd-c12d-49ff-a78a-061890b87071-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef157pns\" (UID: \"ba169fcd-c12d-49ff-a78a-061890b87071\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef157pns"
Jul 09 18:31:53.240768 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:31:53.240714    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ba169fcd-c12d-49ff-a78a-061890b87071-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef157pns\" (UID: \"ba169fcd-c12d-49ff-a78a-061890b87071\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef157pns"
Jul 09 18:31:53.248976 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:31:53.248949    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fc6tl\" (UniqueName: \"kubernetes.io/projected/ba169fcd-c12d-49ff-a78a-061890b87071-kube-api-access-fc6tl\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef157pns\" (UID: \"ba169fcd-c12d-49ff-a78a-061890b87071\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef157pns"
Jul 09 18:31:53.402670 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:31:53.402636    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef157pns"
Jul 09 18:31:53.541955 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:31:53.541883    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef157pns"]
Jul 09 18:31:53.544223 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:31:53.544192    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podba169fcd_c12d_49ff_a78a_061890b87071.slice/crio-0106ef4c71aa829558c2ab723e1a728d2f3f93ab76ff2edc0aa7f2fde2e9de9b WatchSource:0}: Error finding container 0106ef4c71aa829558c2ab723e1a728d2f3f93ab76ff2edc0aa7f2fde2e9de9b: Status 404 returned error can't find the container with id 0106ef4c71aa829558c2ab723e1a728d2f3f93ab76ff2edc0aa7f2fde2e9de9b
Jul 09 18:31:53.681928 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:31:53.681894    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759z59mf"]
Jul 09 18:31:53.685569 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:31:53.685546    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759z59mf"
Jul 09 18:31:53.696389 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:31:53.696359    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759z59mf"]
Jul 09 18:31:53.744402 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:31:53.744365    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xslz4\" (UniqueName: \"kubernetes.io/projected/bb7936c5-2d07-45fb-9218-0f02762821a9-kube-api-access-xslz4\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759z59mf\" (UID: \"bb7936c5-2d07-45fb-9218-0f02762821a9\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759z59mf"
Jul 09 18:31:53.744603 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:31:53.744427    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/bb7936c5-2d07-45fb-9218-0f02762821a9-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759z59mf\" (UID: \"bb7936c5-2d07-45fb-9218-0f02762821a9\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759z59mf"
Jul 09 18:31:53.744603 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:31:53.744551    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/bb7936c5-2d07-45fb-9218-0f02762821a9-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759z59mf\" (UID: \"bb7936c5-2d07-45fb-9218-0f02762821a9\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759z59mf"
Jul 09 18:31:53.845952 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:31:53.845867    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/bb7936c5-2d07-45fb-9218-0f02762821a9-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759z59mf\" (UID: \"bb7936c5-2d07-45fb-9218-0f02762821a9\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759z59mf"
Jul 09 18:31:53.845952 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:31:53.845921    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xslz4\" (UniqueName: \"kubernetes.io/projected/bb7936c5-2d07-45fb-9218-0f02762821a9-kube-api-access-xslz4\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759z59mf\" (UID: \"bb7936c5-2d07-45fb-9218-0f02762821a9\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759z59mf"
Jul 09 18:31:53.846141 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:31:53.845972    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/bb7936c5-2d07-45fb-9218-0f02762821a9-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759z59mf\" (UID: \"bb7936c5-2d07-45fb-9218-0f02762821a9\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759z59mf"
Jul 09 18:31:53.846275 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:31:53.846254    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/bb7936c5-2d07-45fb-9218-0f02762821a9-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759z59mf\" (UID: \"bb7936c5-2d07-45fb-9218-0f02762821a9\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759z59mf"
Jul 09 18:31:53.846314 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:31:53.846280    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/bb7936c5-2d07-45fb-9218-0f02762821a9-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759z59mf\" (UID: \"bb7936c5-2d07-45fb-9218-0f02762821a9\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759z59mf"
Jul 09 18:31:53.862069 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:31:53.862041    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xslz4\" (UniqueName: \"kubernetes.io/projected/bb7936c5-2d07-45fb-9218-0f02762821a9-kube-api-access-xslz4\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759z59mf\" (UID: \"bb7936c5-2d07-45fb-9218-0f02762821a9\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759z59mf"
Jul 09 18:31:54.015391 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:31:54.015358    2557 generic.go:356] "Generic (PLEG): container finished" podID="ba169fcd-c12d-49ff-a78a-061890b87071" containerID="7acd5299fec64a4c269a161bb2b30cbd284ea7918e6b98000a2296e3f97419c6" exitCode=0
Jul 09 18:31:54.015596 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:31:54.015449    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef157pns" event={"ID":"ba169fcd-c12d-49ff-a78a-061890b87071","Type":"ContainerDied","Data":"7acd5299fec64a4c269a161bb2b30cbd284ea7918e6b98000a2296e3f97419c6"}
Jul 09 18:31:54.015596 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:31:54.015520    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef157pns" event={"ID":"ba169fcd-c12d-49ff-a78a-061890b87071","Type":"ContainerStarted","Data":"0106ef4c71aa829558c2ab723e1a728d2f3f93ab76ff2edc0aa7f2fde2e9de9b"}
Jul 09 18:31:54.020445 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:31:54.020427    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759z59mf"
Jul 09 18:31:54.123830 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:31:54.123804    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73jwjph"]
Jul 09 18:31:54.128502 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:31:54.128459    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73jwjph"
Jul 09 18:31:54.144621 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:31:54.144594    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73jwjph"]
Jul 09 18:31:54.193703 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:31:54.193675    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759z59mf"]
Jul 09 18:31:54.214551 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:31:54.214511    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbb7936c5_2d07_45fb_9218_0f02762821a9.slice/crio-6036df00a7eb070fd91721d36e828f90b26db7f4f291146cad7de2c16966cc07 WatchSource:0}: Error finding container 6036df00a7eb070fd91721d36e828f90b26db7f4f291146cad7de2c16966cc07: Status 404 returned error can't find the container with id 6036df00a7eb070fd91721d36e828f90b26db7f4f291146cad7de2c16966cc07
Jul 09 18:31:54.249738 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:31:54.249702    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ql8nq\" (UniqueName: \"kubernetes.io/projected/b2d1d39a-f96f-4def-b6c7-5907c96db401-kube-api-access-ql8nq\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73jwjph\" (UID: \"b2d1d39a-f96f-4def-b6c7-5907c96db401\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73jwjph"
Jul 09 18:31:54.249919 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:31:54.249798    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b2d1d39a-f96f-4def-b6c7-5907c96db401-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73jwjph\" (UID: \"b2d1d39a-f96f-4def-b6c7-5907c96db401\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73jwjph"
Jul 09 18:31:54.249919 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:31:54.249835    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b2d1d39a-f96f-4def-b6c7-5907c96db401-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73jwjph\" (UID: \"b2d1d39a-f96f-4def-b6c7-5907c96db401\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73jwjph"
Jul 09 18:31:54.350772 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:31:54.350740    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ql8nq\" (UniqueName: \"kubernetes.io/projected/b2d1d39a-f96f-4def-b6c7-5907c96db401-kube-api-access-ql8nq\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73jwjph\" (UID: \"b2d1d39a-f96f-4def-b6c7-5907c96db401\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73jwjph"
Jul 09 18:31:54.350962 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:31:54.350791    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b2d1d39a-f96f-4def-b6c7-5907c96db401-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73jwjph\" (UID: \"b2d1d39a-f96f-4def-b6c7-5907c96db401\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73jwjph"
Jul 09 18:31:54.350962 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:31:54.350908    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b2d1d39a-f96f-4def-b6c7-5907c96db401-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73jwjph\" (UID: \"b2d1d39a-f96f-4def-b6c7-5907c96db401\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73jwjph"
Jul 09 18:31:54.351217 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:31:54.351195    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b2d1d39a-f96f-4def-b6c7-5907c96db401-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73jwjph\" (UID: \"b2d1d39a-f96f-4def-b6c7-5907c96db401\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73jwjph"
Jul 09 18:31:54.351267 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:31:54.351218    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b2d1d39a-f96f-4def-b6c7-5907c96db401-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73jwjph\" (UID: \"b2d1d39a-f96f-4def-b6c7-5907c96db401\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73jwjph"
Jul 09 18:31:54.360879 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:31:54.360811    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ql8nq\" (UniqueName: \"kubernetes.io/projected/b2d1d39a-f96f-4def-b6c7-5907c96db401-kube-api-access-ql8nq\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73jwjph\" (UID: \"b2d1d39a-f96f-4def-b6c7-5907c96db401\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73jwjph"
Jul 09 18:31:54.442677 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:31:54.442639    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73jwjph"
Jul 09 18:31:54.584049 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:31:54.584025    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73jwjph"]
Jul 09 18:31:54.586231 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:31:54.586202    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb2d1d39a_f96f_4def_b6c7_5907c96db401.slice/crio-8259b20b695d83c6163be1d62fc511e2b5838fd6c2b45ab4738ba50a5a80d593 WatchSource:0}: Error finding container 8259b20b695d83c6163be1d62fc511e2b5838fd6c2b45ab4738ba50a5a80d593: Status 404 returned error can't find the container with id 8259b20b695d83c6163be1d62fc511e2b5838fd6c2b45ab4738ba50a5a80d593
Jul 09 18:31:55.024066 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:31:55.024030    2557 generic.go:356] "Generic (PLEG): container finished" podID="ba169fcd-c12d-49ff-a78a-061890b87071" containerID="adbd6c41a51b6761f5132dffa5c1f16cc8652b099de03f457627a2619c849dba" exitCode=0
Jul 09 18:31:55.024255 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:31:55.024117    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef157pns" event={"ID":"ba169fcd-c12d-49ff-a78a-061890b87071","Type":"ContainerDied","Data":"adbd6c41a51b6761f5132dffa5c1f16cc8652b099de03f457627a2619c849dba"}
Jul 09 18:31:55.025861 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:31:55.025754    2557 generic.go:356] "Generic (PLEG): container finished" podID="b2d1d39a-f96f-4def-b6c7-5907c96db401" containerID="2cc8359c62160cdbbc5fe292db59a2beca5d8c007aca09d1bf6d617b2f3f18cb" exitCode=0
Jul 09 18:31:55.025948 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:31:55.025865    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73jwjph" event={"ID":"b2d1d39a-f96f-4def-b6c7-5907c96db401","Type":"ContainerDied","Data":"2cc8359c62160cdbbc5fe292db59a2beca5d8c007aca09d1bf6d617b2f3f18cb"}
Jul 09 18:31:55.025948 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:31:55.025914    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73jwjph" event={"ID":"b2d1d39a-f96f-4def-b6c7-5907c96db401","Type":"ContainerStarted","Data":"8259b20b695d83c6163be1d62fc511e2b5838fd6c2b45ab4738ba50a5a80d593"}
Jul 09 18:31:55.027944 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:31:55.027921    2557 generic.go:356] "Generic (PLEG): container finished" podID="9fcd5829-c13b-433d-b6dd-2231cf459986" containerID="20efa006931162198a147effdeafe5910fe02e2eb738e1fedc38d15382c62f61" exitCode=0
Jul 09 18:31:55.028042 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:31:55.027994    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06pfk9" event={"ID":"9fcd5829-c13b-433d-b6dd-2231cf459986","Type":"ContainerDied","Data":"20efa006931162198a147effdeafe5910fe02e2eb738e1fedc38d15382c62f61"}
Jul 09 18:31:55.029722 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:31:55.029699    2557 generic.go:356] "Generic (PLEG): container finished" podID="bb7936c5-2d07-45fb-9218-0f02762821a9" containerID="4a05468a23706393d9da00300fef35c7228c20a8b81106ecb08fe5e0c9be1aed" exitCode=0
Jul 09 18:31:55.029808 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:31:55.029731    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759z59mf" event={"ID":"bb7936c5-2d07-45fb-9218-0f02762821a9","Type":"ContainerDied","Data":"4a05468a23706393d9da00300fef35c7228c20a8b81106ecb08fe5e0c9be1aed"}
Jul 09 18:31:55.029808 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:31:55.029766    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759z59mf" event={"ID":"bb7936c5-2d07-45fb-9218-0f02762821a9","Type":"ContainerStarted","Data":"6036df00a7eb070fd91721d36e828f90b26db7f4f291146cad7de2c16966cc07"}
Jul 09 18:31:56.037410 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:31:56.037371    2557 generic.go:356] "Generic (PLEG): container finished" podID="ba169fcd-c12d-49ff-a78a-061890b87071" containerID="97f1132ed245eb3fe107eb33f19da38420125c4df8d0f5608b3c94be596d083f" exitCode=0
Jul 09 18:31:56.037809 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:31:56.037458    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef157pns" event={"ID":"ba169fcd-c12d-49ff-a78a-061890b87071","Type":"ContainerDied","Data":"97f1132ed245eb3fe107eb33f19da38420125c4df8d0f5608b3c94be596d083f"}
Jul 09 18:31:56.039613 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:31:56.039586    2557 generic.go:356] "Generic (PLEG): container finished" podID="9fcd5829-c13b-433d-b6dd-2231cf459986" containerID="7d7e4ec8c9288c7f4fd2be9bcf836a0e9ce146874b4626e02d87f590140c78f9" exitCode=0
Jul 09 18:31:56.039720 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:31:56.039672    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06pfk9" event={"ID":"9fcd5829-c13b-433d-b6dd-2231cf459986","Type":"ContainerDied","Data":"7d7e4ec8c9288c7f4fd2be9bcf836a0e9ce146874b4626e02d87f590140c78f9"}
Jul 09 18:31:56.041457 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:31:56.041434    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759z59mf" event={"ID":"bb7936c5-2d07-45fb-9218-0f02762821a9","Type":"ContainerStarted","Data":"db083efcab11ee3777bfdc0297dda5a7e65fbefc15a73a562d56aef073bfda53"}
Jul 09 18:31:57.048025 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:31:57.047989    2557 generic.go:356] "Generic (PLEG): container finished" podID="bb7936c5-2d07-45fb-9218-0f02762821a9" containerID="db083efcab11ee3777bfdc0297dda5a7e65fbefc15a73a562d56aef073bfda53" exitCode=0
Jul 09 18:31:57.048427 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:31:57.048051    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759z59mf" event={"ID":"bb7936c5-2d07-45fb-9218-0f02762821a9","Type":"ContainerDied","Data":"db083efcab11ee3777bfdc0297dda5a7e65fbefc15a73a562d56aef073bfda53"}
Jul 09 18:31:57.050046 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:31:57.050024    2557 generic.go:356] "Generic (PLEG): container finished" podID="b2d1d39a-f96f-4def-b6c7-5907c96db401" containerID="100b7189913ed0ddbe457f822075ec6d3e3d47cc40837bec75674e509767a833" exitCode=0
Jul 09 18:31:57.050148 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:31:57.050109    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73jwjph" event={"ID":"b2d1d39a-f96f-4def-b6c7-5907c96db401","Type":"ContainerDied","Data":"100b7189913ed0ddbe457f822075ec6d3e3d47cc40837bec75674e509767a833"}
Jul 09 18:31:57.212661 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:31:57.211940    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06pfk9"
Jul 09 18:31:57.239370 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:31:57.239345    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef157pns"
Jul 09 18:31:57.280871 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:31:57.280836    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-56bx8\" (UniqueName: \"kubernetes.io/projected/9fcd5829-c13b-433d-b6dd-2231cf459986-kube-api-access-56bx8\") pod \"9fcd5829-c13b-433d-b6dd-2231cf459986\" (UID: \"9fcd5829-c13b-433d-b6dd-2231cf459986\") "
Jul 09 18:31:57.281038 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:31:57.280904    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ba169fcd-c12d-49ff-a78a-061890b87071-bundle\") pod \"ba169fcd-c12d-49ff-a78a-061890b87071\" (UID: \"ba169fcd-c12d-49ff-a78a-061890b87071\") "
Jul 09 18:31:57.281038 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:31:57.280958    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fc6tl\" (UniqueName: \"kubernetes.io/projected/ba169fcd-c12d-49ff-a78a-061890b87071-kube-api-access-fc6tl\") pod \"ba169fcd-c12d-49ff-a78a-061890b87071\" (UID: \"ba169fcd-c12d-49ff-a78a-061890b87071\") "
Jul 09 18:31:57.281038 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:31:57.281014    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9fcd5829-c13b-433d-b6dd-2231cf459986-util\") pod \"9fcd5829-c13b-433d-b6dd-2231cf459986\" (UID: \"9fcd5829-c13b-433d-b6dd-2231cf459986\") "
Jul 09 18:31:57.281203 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:31:57.281068    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9fcd5829-c13b-433d-b6dd-2231cf459986-bundle\") pod \"9fcd5829-c13b-433d-b6dd-2231cf459986\" (UID: \"9fcd5829-c13b-433d-b6dd-2231cf459986\") "
Jul 09 18:31:57.281203 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:31:57.281095    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ba169fcd-c12d-49ff-a78a-061890b87071-util\") pod \"ba169fcd-c12d-49ff-a78a-061890b87071\" (UID: \"ba169fcd-c12d-49ff-a78a-061890b87071\") "
Jul 09 18:31:57.281771 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:31:57.281732    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9fcd5829-c13b-433d-b6dd-2231cf459986-bundle" (OuterVolumeSpecName: "bundle") pod "9fcd5829-c13b-433d-b6dd-2231cf459986" (UID: "9fcd5829-c13b-433d-b6dd-2231cf459986"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 18:31:57.282020 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:31:57.281996    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ba169fcd-c12d-49ff-a78a-061890b87071-bundle" (OuterVolumeSpecName: "bundle") pod "ba169fcd-c12d-49ff-a78a-061890b87071" (UID: "ba169fcd-c12d-49ff-a78a-061890b87071"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 18:31:57.283092 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:31:57.283070    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ba169fcd-c12d-49ff-a78a-061890b87071-kube-api-access-fc6tl" (OuterVolumeSpecName: "kube-api-access-fc6tl") pod "ba169fcd-c12d-49ff-a78a-061890b87071" (UID: "ba169fcd-c12d-49ff-a78a-061890b87071"). InnerVolumeSpecName "kube-api-access-fc6tl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 18:31:57.283360 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:31:57.283343    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9fcd5829-c13b-433d-b6dd-2231cf459986-kube-api-access-56bx8" (OuterVolumeSpecName: "kube-api-access-56bx8") pod "9fcd5829-c13b-433d-b6dd-2231cf459986" (UID: "9fcd5829-c13b-433d-b6dd-2231cf459986"). InnerVolumeSpecName "kube-api-access-56bx8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 18:31:57.287078 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:31:57.287039    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9fcd5829-c13b-433d-b6dd-2231cf459986-util" (OuterVolumeSpecName: "util") pod "9fcd5829-c13b-433d-b6dd-2231cf459986" (UID: "9fcd5829-c13b-433d-b6dd-2231cf459986"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 18:31:57.287747 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:31:57.287707    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ba169fcd-c12d-49ff-a78a-061890b87071-util" (OuterVolumeSpecName: "util") pod "ba169fcd-c12d-49ff-a78a-061890b87071" (UID: "ba169fcd-c12d-49ff-a78a-061890b87071"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 18:31:57.382120 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:31:57.382081    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-56bx8\" (UniqueName: \"kubernetes.io/projected/9fcd5829-c13b-433d-b6dd-2231cf459986-kube-api-access-56bx8\") on node \"ip-10-0-141-101.ec2.internal\" DevicePath \"\""
Jul 09 18:31:57.382120 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:31:57.382115    2557 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ba169fcd-c12d-49ff-a78a-061890b87071-bundle\") on node \"ip-10-0-141-101.ec2.internal\" DevicePath \"\""
Jul 09 18:31:57.382120 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:31:57.382126    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fc6tl\" (UniqueName: \"kubernetes.io/projected/ba169fcd-c12d-49ff-a78a-061890b87071-kube-api-access-fc6tl\") on node \"ip-10-0-141-101.ec2.internal\" DevicePath \"\""
Jul 09 18:31:57.382356 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:31:57.382135    2557 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9fcd5829-c13b-433d-b6dd-2231cf459986-util\") on node \"ip-10-0-141-101.ec2.internal\" DevicePath \"\""
Jul 09 18:31:57.382356 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:31:57.382144    2557 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9fcd5829-c13b-433d-b6dd-2231cf459986-bundle\") on node \"ip-10-0-141-101.ec2.internal\" DevicePath \"\""
Jul 09 18:31:57.382356 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:31:57.382151    2557 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ba169fcd-c12d-49ff-a78a-061890b87071-util\") on node \"ip-10-0-141-101.ec2.internal\" DevicePath \"\""
Jul 09 18:31:58.056370 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:31:58.056347    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06pfk9"
Jul 09 18:31:58.056769 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:31:58.056346    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06pfk9" event={"ID":"9fcd5829-c13b-433d-b6dd-2231cf459986","Type":"ContainerDied","Data":"f28d3856a815c692bf5a2d5561844c13a159063691c27310a87d6ca28c55f48c"}
Jul 09 18:31:58.056769 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:31:58.056500    2557 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="f28d3856a815c692bf5a2d5561844c13a159063691c27310a87d6ca28c55f48c"
Jul 09 18:31:58.058566 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:31:58.058540    2557 generic.go:356] "Generic (PLEG): container finished" podID="bb7936c5-2d07-45fb-9218-0f02762821a9" containerID="ed92e88c36ecb0f37c481d54eda629deffa0d44df2b5d904a9340422564b234e" exitCode=0
Jul 09 18:31:58.058678 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:31:58.058619    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759z59mf" event={"ID":"bb7936c5-2d07-45fb-9218-0f02762821a9","Type":"ContainerDied","Data":"ed92e88c36ecb0f37c481d54eda629deffa0d44df2b5d904a9340422564b234e"}
Jul 09 18:31:58.060711 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:31:58.060695    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef157pns"
Jul 09 18:31:58.060826 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:31:58.060694    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef157pns" event={"ID":"ba169fcd-c12d-49ff-a78a-061890b87071","Type":"ContainerDied","Data":"0106ef4c71aa829558c2ab723e1a728d2f3f93ab76ff2edc0aa7f2fde2e9de9b"}
Jul 09 18:31:58.060826 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:31:58.060820    2557 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="0106ef4c71aa829558c2ab723e1a728d2f3f93ab76ff2edc0aa7f2fde2e9de9b"
Jul 09 18:31:58.062938 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:31:58.062917    2557 generic.go:356] "Generic (PLEG): container finished" podID="b2d1d39a-f96f-4def-b6c7-5907c96db401" containerID="32d5993c8075f03a1883ef35b549ab85b06c266d4b4dab8cab743fd948661aea" exitCode=0
Jul 09 18:31:58.063048 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:31:58.062989    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73jwjph" event={"ID":"b2d1d39a-f96f-4def-b6c7-5907c96db401","Type":"ContainerDied","Data":"32d5993c8075f03a1883ef35b549ab85b06c266d4b4dab8cab743fd948661aea"}
Jul 09 18:31:59.204824 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:31:59.204798    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73jwjph"
Jul 09 18:31:59.240416 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:31:59.240392    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759z59mf"
Jul 09 18:31:59.298754 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:31:59.298725    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/bb7936c5-2d07-45fb-9218-0f02762821a9-bundle\") pod \"bb7936c5-2d07-45fb-9218-0f02762821a9\" (UID: \"bb7936c5-2d07-45fb-9218-0f02762821a9\") "
Jul 09 18:31:59.298995 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:31:59.298769    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xslz4\" (UniqueName: \"kubernetes.io/projected/bb7936c5-2d07-45fb-9218-0f02762821a9-kube-api-access-xslz4\") pod \"bb7936c5-2d07-45fb-9218-0f02762821a9\" (UID: \"bb7936c5-2d07-45fb-9218-0f02762821a9\") "
Jul 09 18:31:59.298995 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:31:59.298788    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ql8nq\" (UniqueName: \"kubernetes.io/projected/b2d1d39a-f96f-4def-b6c7-5907c96db401-kube-api-access-ql8nq\") pod \"b2d1d39a-f96f-4def-b6c7-5907c96db401\" (UID: \"b2d1d39a-f96f-4def-b6c7-5907c96db401\") "
Jul 09 18:31:59.298995 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:31:59.298806    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b2d1d39a-f96f-4def-b6c7-5907c96db401-bundle\") pod \"b2d1d39a-f96f-4def-b6c7-5907c96db401\" (UID: \"b2d1d39a-f96f-4def-b6c7-5907c96db401\") "
Jul 09 18:31:59.298995 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:31:59.298821    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b2d1d39a-f96f-4def-b6c7-5907c96db401-util\") pod \"b2d1d39a-f96f-4def-b6c7-5907c96db401\" (UID: \"b2d1d39a-f96f-4def-b6c7-5907c96db401\") "
Jul 09 18:31:59.298995 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:31:59.298961    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/bb7936c5-2d07-45fb-9218-0f02762821a9-util\") pod \"bb7936c5-2d07-45fb-9218-0f02762821a9\" (UID: \"bb7936c5-2d07-45fb-9218-0f02762821a9\") "
Jul 09 18:31:59.299447 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:31:59.299281    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bb7936c5-2d07-45fb-9218-0f02762821a9-bundle" (OuterVolumeSpecName: "bundle") pod "bb7936c5-2d07-45fb-9218-0f02762821a9" (UID: "bb7936c5-2d07-45fb-9218-0f02762821a9"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 18:31:59.299447 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:31:59.299438    2557 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/bb7936c5-2d07-45fb-9218-0f02762821a9-bundle\") on node \"ip-10-0-141-101.ec2.internal\" DevicePath \"\""
Jul 09 18:31:59.299631 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:31:59.299608    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b2d1d39a-f96f-4def-b6c7-5907c96db401-bundle" (OuterVolumeSpecName: "bundle") pod "b2d1d39a-f96f-4def-b6c7-5907c96db401" (UID: "b2d1d39a-f96f-4def-b6c7-5907c96db401"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 18:31:59.301081 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:31:59.301056    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bb7936c5-2d07-45fb-9218-0f02762821a9-kube-api-access-xslz4" (OuterVolumeSpecName: "kube-api-access-xslz4") pod "bb7936c5-2d07-45fb-9218-0f02762821a9" (UID: "bb7936c5-2d07-45fb-9218-0f02762821a9"). InnerVolumeSpecName "kube-api-access-xslz4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 18:31:59.301162 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:31:59.301133    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b2d1d39a-f96f-4def-b6c7-5907c96db401-kube-api-access-ql8nq" (OuterVolumeSpecName: "kube-api-access-ql8nq") pod "b2d1d39a-f96f-4def-b6c7-5907c96db401" (UID: "b2d1d39a-f96f-4def-b6c7-5907c96db401"). InnerVolumeSpecName "kube-api-access-ql8nq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 18:31:59.308075 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:31:59.308048    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b2d1d39a-f96f-4def-b6c7-5907c96db401-util" (OuterVolumeSpecName: "util") pod "b2d1d39a-f96f-4def-b6c7-5907c96db401" (UID: "b2d1d39a-f96f-4def-b6c7-5907c96db401"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 18:31:59.308342 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:31:59.308325    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bb7936c5-2d07-45fb-9218-0f02762821a9-util" (OuterVolumeSpecName: "util") pod "bb7936c5-2d07-45fb-9218-0f02762821a9" (UID: "bb7936c5-2d07-45fb-9218-0f02762821a9"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 18:31:59.400639 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:31:59.400551    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xslz4\" (UniqueName: \"kubernetes.io/projected/bb7936c5-2d07-45fb-9218-0f02762821a9-kube-api-access-xslz4\") on node \"ip-10-0-141-101.ec2.internal\" DevicePath \"\""
Jul 09 18:31:59.400639 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:31:59.400583    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ql8nq\" (UniqueName: \"kubernetes.io/projected/b2d1d39a-f96f-4def-b6c7-5907c96db401-kube-api-access-ql8nq\") on node \"ip-10-0-141-101.ec2.internal\" DevicePath \"\""
Jul 09 18:31:59.400639 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:31:59.400593    2557 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b2d1d39a-f96f-4def-b6c7-5907c96db401-bundle\") on node \"ip-10-0-141-101.ec2.internal\" DevicePath \"\""
Jul 09 18:31:59.400639 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:31:59.400601    2557 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b2d1d39a-f96f-4def-b6c7-5907c96db401-util\") on node \"ip-10-0-141-101.ec2.internal\" DevicePath \"\""
Jul 09 18:31:59.400639 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:31:59.400609    2557 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/bb7936c5-2d07-45fb-9218-0f02762821a9-util\") on node \"ip-10-0-141-101.ec2.internal\" DevicePath \"\""
Jul 09 18:32:00.075200 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:32:00.075170    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73jwjph"
Jul 09 18:32:00.075378 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:32:00.075199    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73jwjph" event={"ID":"b2d1d39a-f96f-4def-b6c7-5907c96db401","Type":"ContainerDied","Data":"8259b20b695d83c6163be1d62fc511e2b5838fd6c2b45ab4738ba50a5a80d593"}
Jul 09 18:32:00.075378 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:32:00.075274    2557 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="8259b20b695d83c6163be1d62fc511e2b5838fd6c2b45ab4738ba50a5a80d593"
Jul 09 18:32:00.077160 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:32:00.077137    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759z59mf" event={"ID":"bb7936c5-2d07-45fb-9218-0f02762821a9","Type":"ContainerDied","Data":"6036df00a7eb070fd91721d36e828f90b26db7f4f291146cad7de2c16966cc07"}
Jul 09 18:32:00.077258 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:32:00.077174    2557 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="6036df00a7eb070fd91721d36e828f90b26db7f4f291146cad7de2c16966cc07"
Jul 09 18:32:00.077258 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:32:00.077178    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759z59mf"
Jul 09 18:32:09.914138 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:32:09.914096    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-nkdv8"]
Jul 09 18:32:09.914799 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:32:09.914771    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bb7936c5-2d07-45fb-9218-0f02762821a9" containerName="extract"
Jul 09 18:32:09.914799 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:32:09.914795    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="bb7936c5-2d07-45fb-9218-0f02762821a9" containerName="extract"
Jul 09 18:32:09.914960 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:32:09.914820    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bb7936c5-2d07-45fb-9218-0f02762821a9" containerName="pull"
Jul 09 18:32:09.914960 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:32:09.914830    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="bb7936c5-2d07-45fb-9218-0f02762821a9" containerName="pull"
Jul 09 18:32:09.914960 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:32:09.914840    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b2d1d39a-f96f-4def-b6c7-5907c96db401" containerName="pull"
Jul 09 18:32:09.914960 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:32:09.914848    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="b2d1d39a-f96f-4def-b6c7-5907c96db401" containerName="pull"
Jul 09 18:32:09.914960 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:32:09.914859    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b2d1d39a-f96f-4def-b6c7-5907c96db401" containerName="extract"
Jul 09 18:32:09.914960 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:32:09.914868    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="b2d1d39a-f96f-4def-b6c7-5907c96db401" containerName="extract"
Jul 09 18:32:09.914960 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:32:09.914880    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9fcd5829-c13b-433d-b6dd-2231cf459986" containerName="extract"
Jul 09 18:32:09.914960 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:32:09.914888    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="9fcd5829-c13b-433d-b6dd-2231cf459986" containerName="extract"
Jul 09 18:32:09.914960 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:32:09.914903    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ba169fcd-c12d-49ff-a78a-061890b87071" containerName="util"
Jul 09 18:32:09.914960 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:32:09.914910    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="ba169fcd-c12d-49ff-a78a-061890b87071" containerName="util"
Jul 09 18:32:09.914960 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:32:09.914920    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9fcd5829-c13b-433d-b6dd-2231cf459986" containerName="util"
Jul 09 18:32:09.914960 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:32:09.914929    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="9fcd5829-c13b-433d-b6dd-2231cf459986" containerName="util"
Jul 09 18:32:09.914960 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:32:09.914939    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9fcd5829-c13b-433d-b6dd-2231cf459986" containerName="pull"
Jul 09 18:32:09.914960 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:32:09.914946    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="9fcd5829-c13b-433d-b6dd-2231cf459986" containerName="pull"
Jul 09 18:32:09.914960 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:32:09.914955    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b2d1d39a-f96f-4def-b6c7-5907c96db401" containerName="util"
Jul 09 18:32:09.914960 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:32:09.914962    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="b2d1d39a-f96f-4def-b6c7-5907c96db401" containerName="util"
Jul 09 18:32:09.915425 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:32:09.914987    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bb7936c5-2d07-45fb-9218-0f02762821a9" containerName="util"
Jul 09 18:32:09.915425 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:32:09.914994    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="bb7936c5-2d07-45fb-9218-0f02762821a9" containerName="util"
Jul 09 18:32:09.915425 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:32:09.915003    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ba169fcd-c12d-49ff-a78a-061890b87071" containerName="pull"
Jul 09 18:32:09.915425 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:32:09.915010    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="ba169fcd-c12d-49ff-a78a-061890b87071" containerName="pull"
Jul 09 18:32:09.915425 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:32:09.915019    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ba169fcd-c12d-49ff-a78a-061890b87071" containerName="extract"
Jul 09 18:32:09.915425 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:32:09.915027    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="ba169fcd-c12d-49ff-a78a-061890b87071" containerName="extract"
Jul 09 18:32:09.915425 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:32:09.915163    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="bb7936c5-2d07-45fb-9218-0f02762821a9" containerName="extract"
Jul 09 18:32:09.915425 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:32:09.915180    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="ba169fcd-c12d-49ff-a78a-061890b87071" containerName="extract"
Jul 09 18:32:09.915425 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:32:09.915189    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="b2d1d39a-f96f-4def-b6c7-5907c96db401" containerName="extract"
Jul 09 18:32:09.915425 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:32:09.915204    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="9fcd5829-c13b-433d-b6dd-2231cf459986" containerName="extract"
Jul 09 18:32:09.919586 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:32:09.919564    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-nkdv8"
Jul 09 18:32:09.922975 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:32:09.922944    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-zbn24\""
Jul 09 18:32:09.930718 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:32:09.930677    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-nkdv8"]
Jul 09 18:32:09.996005 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:32:09.995937    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s5kgn\" (UniqueName: \"kubernetes.io/projected/ba99975f-66eb-4352-8d60-9ceace209739-kube-api-access-s5kgn\") pod \"authorino-operator-75cc8d5cb7-nkdv8\" (UID: \"ba99975f-66eb-4352-8d60-9ceace209739\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-nkdv8"
Jul 09 18:32:10.096836 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:32:10.096798    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s5kgn\" (UniqueName: \"kubernetes.io/projected/ba99975f-66eb-4352-8d60-9ceace209739-kube-api-access-s5kgn\") pod \"authorino-operator-75cc8d5cb7-nkdv8\" (UID: \"ba99975f-66eb-4352-8d60-9ceace209739\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-nkdv8"
Jul 09 18:32:10.106527 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:32:10.106501    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s5kgn\" (UniqueName: \"kubernetes.io/projected/ba99975f-66eb-4352-8d60-9ceace209739-kube-api-access-s5kgn\") pod \"authorino-operator-75cc8d5cb7-nkdv8\" (UID: \"ba99975f-66eb-4352-8d60-9ceace209739\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-nkdv8"
Jul 09 18:32:10.231417 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:32:10.231326    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-nkdv8"
Jul 09 18:32:10.372609 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:32:10.372585    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-nkdv8"]
Jul 09 18:32:10.374367 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:32:10.374339    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podba99975f_66eb_4352_8d60_9ceace209739.slice/crio-13d18b30791c8aaba3eec518243f59aab2ffaf8bcd1beca62eba6fa2bdbc8bb5 WatchSource:0}: Error finding container 13d18b30791c8aaba3eec518243f59aab2ffaf8bcd1beca62eba6fa2bdbc8bb5: Status 404 returned error can't find the container with id 13d18b30791c8aaba3eec518243f59aab2ffaf8bcd1beca62eba6fa2bdbc8bb5
Jul 09 18:32:11.141641 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:32:11.141610    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-nkdv8" event={"ID":"ba99975f-66eb-4352-8d60-9ceace209739","Type":"ContainerStarted","Data":"13d18b30791c8aaba3eec518243f59aab2ffaf8bcd1beca62eba6fa2bdbc8bb5"}
Jul 09 18:32:13.156152 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:32:13.156051    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-nkdv8" event={"ID":"ba99975f-66eb-4352-8d60-9ceace209739","Type":"ContainerStarted","Data":"039da10c739d49a4a8b5b8d5184181c6c374395f3d5a28f9dc6afc7ad937b821"}
Jul 09 18:32:13.156152 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:32:13.156134    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-nkdv8"
Jul 09 18:32:13.203808 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:32:13.203743    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-75cc8d5cb7-nkdv8" podStartSLOduration=1.757626929 podStartE2EDuration="4.203719956s" totalImagesPullingTime="2.446093027s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 18:32:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 18:32:13.202589457 +0000 UTC m=+402.441934106" watchObservedRunningTime="2026-07-09 18:32:13.203719956 +0000 UTC m=+402.443064583"
Jul 09 18:32:13.231077 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:32:13.228137    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-8lslg"]
Jul 09 18:32:13.233679 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:32:13.233643    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-8lslg"
Jul 09 18:32:13.238690 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:32:13.238664    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-5s5h7\""
Jul 09 18:32:13.329497 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:32:13.329451    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mh74f\" (UniqueName: \"kubernetes.io/projected/046e12a1-3de8-4667-b2e1-b69dd6771c79-kube-api-access-mh74f\") pod \"limitador-operator-controller-manager-859d7b78bd-8lslg\" (UID: \"046e12a1-3de8-4667-b2e1-b69dd6771c79\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-8lslg"
Jul 09 18:32:13.342219 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:32:13.342182    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-8lslg"]
Jul 09 18:32:13.429994 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:32:13.429956    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mh74f\" (UniqueName: \"kubernetes.io/projected/046e12a1-3de8-4667-b2e1-b69dd6771c79-kube-api-access-mh74f\") pod \"limitador-operator-controller-manager-859d7b78bd-8lslg\" (UID: \"046e12a1-3de8-4667-b2e1-b69dd6771c79\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-8lslg"
Jul 09 18:32:13.445649 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:32:13.445609    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mh74f\" (UniqueName: \"kubernetes.io/projected/046e12a1-3de8-4667-b2e1-b69dd6771c79-kube-api-access-mh74f\") pod \"limitador-operator-controller-manager-859d7b78bd-8lslg\" (UID: \"046e12a1-3de8-4667-b2e1-b69dd6771c79\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-8lslg"
Jul 09 18:32:13.544425 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:32:13.544383    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-8lslg"
Jul 09 18:32:13.707770 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:32:13.707745    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-8lslg"]
Jul 09 18:32:13.710238 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:32:13.710211    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod046e12a1_3de8_4667_b2e1_b69dd6771c79.slice/crio-1cc2dd9e976347e35dc8408ba973ff226da0963e115484e01144a2748e3d4d61 WatchSource:0}: Error finding container 1cc2dd9e976347e35dc8408ba973ff226da0963e115484e01144a2748e3d4d61: Status 404 returned error can't find the container with id 1cc2dd9e976347e35dc8408ba973ff226da0963e115484e01144a2748e3d4d61
Jul 09 18:32:14.162251 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:32:14.162217    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-8lslg" event={"ID":"046e12a1-3de8-4667-b2e1-b69dd6771c79","Type":"ContainerStarted","Data":"1cc2dd9e976347e35dc8408ba973ff226da0963e115484e01144a2748e3d4d61"}
Jul 09 18:32:16.175122 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:32:16.175083    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-8lslg" event={"ID":"046e12a1-3de8-4667-b2e1-b69dd6771c79","Type":"ContainerStarted","Data":"ea5228ae0c198c49d0aed6ee465abd7feae04840898ca96c0af29c2dca114f94"}
Jul 09 18:32:16.175561 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:32:16.175189    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-8lslg"
Jul 09 18:32:16.279207 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:32:16.279083    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-8lslg" podStartSLOduration=1.049935416 podStartE2EDuration="3.279066619s" totalImagesPullingTime="2.229131203s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 18:32:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 18:32:16.275935795 +0000 UTC m=+405.515280421" watchObservedRunningTime="2026-07-09 18:32:16.279066619 +0000 UTC m=+405.518411244"
Jul 09 18:32:20.572435 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:32:20.572405    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-8jl6k"]
Jul 09 18:32:20.577122 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:32:20.577086    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-8jl6k"
Jul 09 18:32:20.581195 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:32:20.581170    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\""
Jul 09 18:32:20.581195 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:32:20.581176    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-n8rvh\""
Jul 09 18:32:20.601004 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:32:20.600965    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-8jl6k"]
Jul 09 18:32:20.697140 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:32:20.697100    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fcwzq\" (UniqueName: \"kubernetes.io/projected/c3e44384-6d57-4713-89d1-2d41653cc414-kube-api-access-fcwzq\") pod \"dns-operator-controller-manager-864dd78c4c-8jl6k\" (UID: \"c3e44384-6d57-4713-89d1-2d41653cc414\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-8jl6k"
Jul 09 18:32:20.797852 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:32:20.797813    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fcwzq\" (UniqueName: \"kubernetes.io/projected/c3e44384-6d57-4713-89d1-2d41653cc414-kube-api-access-fcwzq\") pod \"dns-operator-controller-manager-864dd78c4c-8jl6k\" (UID: \"c3e44384-6d57-4713-89d1-2d41653cc414\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-8jl6k"
Jul 09 18:32:20.820420 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:32:20.820382    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fcwzq\" (UniqueName: \"kubernetes.io/projected/c3e44384-6d57-4713-89d1-2d41653cc414-kube-api-access-fcwzq\") pod \"dns-operator-controller-manager-864dd78c4c-8jl6k\" (UID: \"c3e44384-6d57-4713-89d1-2d41653cc414\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-8jl6k"
Jul 09 18:32:20.889876 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:32:20.889789    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-8jl6k"
Jul 09 18:32:21.040936 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:32:21.040913    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-8jl6k"]
Jul 09 18:32:21.042553 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:32:21.042522    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc3e44384_6d57_4713_89d1_2d41653cc414.slice/crio-0a83d5337d572b3016f7670f587725351b82012b349ccc8b75a6a692642984aa WatchSource:0}: Error finding container 0a83d5337d572b3016f7670f587725351b82012b349ccc8b75a6a692642984aa: Status 404 returned error can't find the container with id 0a83d5337d572b3016f7670f587725351b82012b349ccc8b75a6a692642984aa
Jul 09 18:32:21.201463 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:32:21.201377    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-8jl6k" event={"ID":"c3e44384-6d57-4713-89d1-2d41653cc414","Type":"ContainerStarted","Data":"0a83d5337d572b3016f7670f587725351b82012b349ccc8b75a6a692642984aa"}
Jul 09 18:32:23.217800 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:32:23.217751    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-8jl6k" event={"ID":"c3e44384-6d57-4713-89d1-2d41653cc414","Type":"ContainerStarted","Data":"b5215353f9902e35f8fc6a7e44c19ab3abe7fc4e6d563639faa2f8784d8b4180"}
Jul 09 18:32:23.218272 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:32:23.217827    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-8jl6k"
Jul 09 18:32:23.249309 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:32:23.249235    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-8jl6k" podStartSLOduration=1.275724088 podStartE2EDuration="3.249217227s" totalImagesPullingTime="1.973493139s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 18:32:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 18:32:23.248021106 +0000 UTC m=+412.487365736" watchObservedRunningTime="2026-07-09 18:32:23.249217227 +0000 UTC m=+412.488561853"
Jul 09 18:32:24.164620 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:32:24.164591    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-nkdv8"
Jul 09 18:32:27.086667 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:32:27.086628    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-7c5cbb5cf8-g8cbv"]
Jul 09 18:32:27.090382 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:32:27.090354    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7c5cbb5cf8-g8cbv"
Jul 09 18:32:27.100982 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:32:27.100954    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7c5cbb5cf8-g8cbv"]
Jul 09 18:32:27.182227 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:32:27.182198    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-8lslg"
Jul 09 18:32:27.255388 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:32:27.255345    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/93607a99-1497-4335-8424-60a3df172946-console-oauth-config\") pod \"console-7c5cbb5cf8-g8cbv\" (UID: \"93607a99-1497-4335-8424-60a3df172946\") " pod="openshift-console/console-7c5cbb5cf8-g8cbv"
Jul 09 18:32:27.255388 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:32:27.255391    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/93607a99-1497-4335-8424-60a3df172946-service-ca\") pod \"console-7c5cbb5cf8-g8cbv\" (UID: \"93607a99-1497-4335-8424-60a3df172946\") " pod="openshift-console/console-7c5cbb5cf8-g8cbv"
Jul 09 18:32:27.255649 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:32:27.255422    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/93607a99-1497-4335-8424-60a3df172946-console-config\") pod \"console-7c5cbb5cf8-g8cbv\" (UID: \"93607a99-1497-4335-8424-60a3df172946\") " pod="openshift-console/console-7c5cbb5cf8-g8cbv"
Jul 09 18:32:27.255649 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:32:27.255519    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/93607a99-1497-4335-8424-60a3df172946-oauth-serving-cert\") pod \"console-7c5cbb5cf8-g8cbv\" (UID: \"93607a99-1497-4335-8424-60a3df172946\") " pod="openshift-console/console-7c5cbb5cf8-g8cbv"
Jul 09 18:32:27.255649 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:32:27.255572    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/93607a99-1497-4335-8424-60a3df172946-console-serving-cert\") pod \"console-7c5cbb5cf8-g8cbv\" (UID: \"93607a99-1497-4335-8424-60a3df172946\") " pod="openshift-console/console-7c5cbb5cf8-g8cbv"
Jul 09 18:32:27.255649 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:32:27.255621    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4qk55\" (UniqueName: \"kubernetes.io/projected/93607a99-1497-4335-8424-60a3df172946-kube-api-access-4qk55\") pod \"console-7c5cbb5cf8-g8cbv\" (UID: \"93607a99-1497-4335-8424-60a3df172946\") " pod="openshift-console/console-7c5cbb5cf8-g8cbv"
Jul 09 18:32:27.255865 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:32:27.255682    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/93607a99-1497-4335-8424-60a3df172946-trusted-ca-bundle\") pod \"console-7c5cbb5cf8-g8cbv\" (UID: \"93607a99-1497-4335-8424-60a3df172946\") " pod="openshift-console/console-7c5cbb5cf8-g8cbv"
Jul 09 18:32:27.357063 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:32:27.356969    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/93607a99-1497-4335-8424-60a3df172946-console-oauth-config\") pod \"console-7c5cbb5cf8-g8cbv\" (UID: \"93607a99-1497-4335-8424-60a3df172946\") " pod="openshift-console/console-7c5cbb5cf8-g8cbv"
Jul 09 18:32:27.357063 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:32:27.357009    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/93607a99-1497-4335-8424-60a3df172946-service-ca\") pod \"console-7c5cbb5cf8-g8cbv\" (UID: \"93607a99-1497-4335-8424-60a3df172946\") " pod="openshift-console/console-7c5cbb5cf8-g8cbv"
Jul 09 18:32:27.357063 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:32:27.357030    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/93607a99-1497-4335-8424-60a3df172946-console-config\") pod \"console-7c5cbb5cf8-g8cbv\" (UID: \"93607a99-1497-4335-8424-60a3df172946\") " pod="openshift-console/console-7c5cbb5cf8-g8cbv"
Jul 09 18:32:27.357282 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:32:27.357214    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/93607a99-1497-4335-8424-60a3df172946-oauth-serving-cert\") pod \"console-7c5cbb5cf8-g8cbv\" (UID: \"93607a99-1497-4335-8424-60a3df172946\") " pod="openshift-console/console-7c5cbb5cf8-g8cbv"
Jul 09 18:32:27.357282 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:32:27.357269    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/93607a99-1497-4335-8424-60a3df172946-console-serving-cert\") pod \"console-7c5cbb5cf8-g8cbv\" (UID: \"93607a99-1497-4335-8424-60a3df172946\") " pod="openshift-console/console-7c5cbb5cf8-g8cbv"
Jul 09 18:32:27.357379 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:32:27.357297    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4qk55\" (UniqueName: \"kubernetes.io/projected/93607a99-1497-4335-8424-60a3df172946-kube-api-access-4qk55\") pod \"console-7c5cbb5cf8-g8cbv\" (UID: \"93607a99-1497-4335-8424-60a3df172946\") " pod="openshift-console/console-7c5cbb5cf8-g8cbv"
Jul 09 18:32:27.357379 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:32:27.357365    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/93607a99-1497-4335-8424-60a3df172946-trusted-ca-bundle\") pod \"console-7c5cbb5cf8-g8cbv\" (UID: \"93607a99-1497-4335-8424-60a3df172946\") " pod="openshift-console/console-7c5cbb5cf8-g8cbv"
Jul 09 18:32:27.357837 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:32:27.357808    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/93607a99-1497-4335-8424-60a3df172946-console-config\") pod \"console-7c5cbb5cf8-g8cbv\" (UID: \"93607a99-1497-4335-8424-60a3df172946\") " pod="openshift-console/console-7c5cbb5cf8-g8cbv"
Jul 09 18:32:27.357992 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:32:27.357967    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/93607a99-1497-4335-8424-60a3df172946-service-ca\") pod \"console-7c5cbb5cf8-g8cbv\" (UID: \"93607a99-1497-4335-8424-60a3df172946\") " pod="openshift-console/console-7c5cbb5cf8-g8cbv"
Jul 09 18:32:27.358122 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:32:27.358103    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/93607a99-1497-4335-8424-60a3df172946-oauth-serving-cert\") pod \"console-7c5cbb5cf8-g8cbv\" (UID: \"93607a99-1497-4335-8424-60a3df172946\") " pod="openshift-console/console-7c5cbb5cf8-g8cbv"
Jul 09 18:32:27.358201 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:32:27.358181    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/93607a99-1497-4335-8424-60a3df172946-trusted-ca-bundle\") pod \"console-7c5cbb5cf8-g8cbv\" (UID: \"93607a99-1497-4335-8424-60a3df172946\") " pod="openshift-console/console-7c5cbb5cf8-g8cbv"
Jul 09 18:32:27.359523 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:32:27.359503    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/93607a99-1497-4335-8424-60a3df172946-console-oauth-config\") pod \"console-7c5cbb5cf8-g8cbv\" (UID: \"93607a99-1497-4335-8424-60a3df172946\") " pod="openshift-console/console-7c5cbb5cf8-g8cbv"
Jul 09 18:32:27.359789 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:32:27.359771    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/93607a99-1497-4335-8424-60a3df172946-console-serving-cert\") pod \"console-7c5cbb5cf8-g8cbv\" (UID: \"93607a99-1497-4335-8424-60a3df172946\") " pod="openshift-console/console-7c5cbb5cf8-g8cbv"
Jul 09 18:32:27.369438 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:32:27.369413    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4qk55\" (UniqueName: \"kubernetes.io/projected/93607a99-1497-4335-8424-60a3df172946-kube-api-access-4qk55\") pod \"console-7c5cbb5cf8-g8cbv\" (UID: \"93607a99-1497-4335-8424-60a3df172946\") " pod="openshift-console/console-7c5cbb5cf8-g8cbv"
Jul 09 18:32:27.400387 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:32:27.400343    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7c5cbb5cf8-g8cbv"
Jul 09 18:32:27.544716 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:32:27.544678    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7c5cbb5cf8-g8cbv"]
Jul 09 18:32:27.550536 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:32:27.550507    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod93607a99_1497_4335_8424_60a3df172946.slice/crio-87c5067e2cffa0a2e95b87c4913b25257643b1c74e0537b11a84d34b5158732a WatchSource:0}: Error finding container 87c5067e2cffa0a2e95b87c4913b25257643b1c74e0537b11a84d34b5158732a: Status 404 returned error can't find the container with id 87c5067e2cffa0a2e95b87c4913b25257643b1c74e0537b11a84d34b5158732a
Jul 09 18:32:28.247363 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:32:28.247325    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7c5cbb5cf8-g8cbv" event={"ID":"93607a99-1497-4335-8424-60a3df172946","Type":"ContainerStarted","Data":"5159cc0c2494e00702fb6e2d782f13ff4ae7a5b6ceb297b5238dd557cf666243"}
Jul 09 18:32:28.247783 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:32:28.247375    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7c5cbb5cf8-g8cbv" event={"ID":"93607a99-1497-4335-8424-60a3df172946","Type":"ContainerStarted","Data":"87c5067e2cffa0a2e95b87c4913b25257643b1c74e0537b11a84d34b5158732a"}
Jul 09 18:32:28.277150 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:32:28.277088    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-7c5cbb5cf8-g8cbv" podStartSLOduration=1.277072868 podStartE2EDuration="1.277072868s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 18:32:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 18:32:28.276663732 +0000 UTC m=+417.516008359" watchObservedRunningTime="2026-07-09 18:32:28.277072868 +0000 UTC m=+417.516417493"
Jul 09 18:32:30.149540 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:32:30.149500    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-sngwl"]
Jul 09 18:32:30.154624 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:32:30.154598    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-sngwl"
Jul 09 18:32:30.162862 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:32:30.162832    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"plugin-serving-cert\""
Jul 09 18:32:30.163037 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:32:30.162841    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kuadrant-console-nginx-conf\""
Jul 09 18:32:30.163123 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:32:30.163104    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-68mcm\""
Jul 09 18:32:30.183971 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:32:30.183937    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gmqkg\" (UniqueName: \"kubernetes.io/projected/8c39c462-bc63-45ae-945f-a13f8125dca1-kube-api-access-gmqkg\") pod \"kuadrant-console-plugin-66b5774985-sngwl\" (UID: \"8c39c462-bc63-45ae-945f-a13f8125dca1\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-sngwl"
Jul 09 18:32:30.184101 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:32:30.183976    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/8c39c462-bc63-45ae-945f-a13f8125dca1-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-sngwl\" (UID: \"8c39c462-bc63-45ae-945f-a13f8125dca1\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-sngwl"
Jul 09 18:32:30.184101 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:32:30.184050    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/8c39c462-bc63-45ae-945f-a13f8125dca1-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-sngwl\" (UID: \"8c39c462-bc63-45ae-945f-a13f8125dca1\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-sngwl"
Jul 09 18:32:30.186743 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:32:30.186719    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-sngwl"]
Jul 09 18:32:30.284938 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:32:30.284890    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gmqkg\" (UniqueName: \"kubernetes.io/projected/8c39c462-bc63-45ae-945f-a13f8125dca1-kube-api-access-gmqkg\") pod \"kuadrant-console-plugin-66b5774985-sngwl\" (UID: \"8c39c462-bc63-45ae-945f-a13f8125dca1\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-sngwl"
Jul 09 18:32:30.284938 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:32:30.284943    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/8c39c462-bc63-45ae-945f-a13f8125dca1-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-sngwl\" (UID: \"8c39c462-bc63-45ae-945f-a13f8125dca1\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-sngwl"
Jul 09 18:32:30.285202 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:32:30.284994    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/8c39c462-bc63-45ae-945f-a13f8125dca1-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-sngwl\" (UID: \"8c39c462-bc63-45ae-945f-a13f8125dca1\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-sngwl"
Jul 09 18:32:30.285806 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:32:30.285779    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/8c39c462-bc63-45ae-945f-a13f8125dca1-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-sngwl\" (UID: \"8c39c462-bc63-45ae-945f-a13f8125dca1\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-sngwl"
Jul 09 18:32:30.287487 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:32:30.287460    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/8c39c462-bc63-45ae-945f-a13f8125dca1-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-sngwl\" (UID: \"8c39c462-bc63-45ae-945f-a13f8125dca1\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-sngwl"
Jul 09 18:32:30.293836 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:32:30.293806    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gmqkg\" (UniqueName: \"kubernetes.io/projected/8c39c462-bc63-45ae-945f-a13f8125dca1-kube-api-access-gmqkg\") pod \"kuadrant-console-plugin-66b5774985-sngwl\" (UID: \"8c39c462-bc63-45ae-945f-a13f8125dca1\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-sngwl"
Jul 09 18:32:30.472012 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:32:30.471922    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-sngwl"
Jul 09 18:32:30.632331 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:32:30.632299    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-sngwl"]
Jul 09 18:32:30.633911 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:32:30.633882    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod8c39c462_bc63_45ae_945f_a13f8125dca1.slice/crio-f6a1b7acda59ddc32953f84121c66343f288a9d185f21a2aefe3fb22be66b851 WatchSource:0}: Error finding container f6a1b7acda59ddc32953f84121c66343f288a9d185f21a2aefe3fb22be66b851: Status 404 returned error can't find the container with id f6a1b7acda59ddc32953f84121c66343f288a9d185f21a2aefe3fb22be66b851
Jul 09 18:32:31.267145 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:32:31.267107    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-sngwl" event={"ID":"8c39c462-bc63-45ae-945f-a13f8125dca1","Type":"ContainerStarted","Data":"f6a1b7acda59ddc32953f84121c66343f288a9d185f21a2aefe3fb22be66b851"}
Jul 09 18:32:34.226981 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:32:34.226942    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-8jl6k"
Jul 09 18:32:37.400743 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:32:37.400702    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-7c5cbb5cf8-g8cbv"
Jul 09 18:32:37.401157 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:32:37.400764    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-7c5cbb5cf8-g8cbv"
Jul 09 18:32:37.405763 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:32:37.405739    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-7c5cbb5cf8-g8cbv"
Jul 09 18:32:38.318429 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:32:38.318401    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-7c5cbb5cf8-g8cbv"
Jul 09 18:32:38.376724 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:32:38.375942    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5564d575bf-vsck4"]
Jul 09 18:32:40.555056 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:32:40.555017    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-wwnn9"]
Jul 09 18:32:40.561785 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:32:40.561761    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-wwnn9"
Jul 09 18:32:40.566172 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:32:40.566150    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-r6xjq\""
Jul 09 18:32:40.580189 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:32:40.580162    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-wwnn9"]
Jul 09 18:32:40.673732 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:32:40.673690    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-wwnn9"]
Jul 09 18:32:40.674076 ip-10-0-141-101 kubenswrapper[2557]: E0709 18:32:40.674043    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[extensions-socket-volume kube-api-access-d6jr6], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-wwnn9" podUID="b8a9f826-027f-4b77-a19f-3e7b929b18fe"
Jul 09 18:32:40.686426 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:32:40.686387    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d6jr6\" (UniqueName: \"kubernetes.io/projected/b8a9f826-027f-4b77-a19f-3e7b929b18fe-kube-api-access-d6jr6\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-wwnn9\" (UID: \"b8a9f826-027f-4b77-a19f-3e7b929b18fe\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-wwnn9"
Jul 09 18:32:40.686607 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:32:40.686502    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/b8a9f826-027f-4b77-a19f-3e7b929b18fe-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-wwnn9\" (UID: \"b8a9f826-027f-4b77-a19f-3e7b929b18fe\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-wwnn9"
Jul 09 18:32:40.787540 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:32:40.787467    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d6jr6\" (UniqueName: \"kubernetes.io/projected/b8a9f826-027f-4b77-a19f-3e7b929b18fe-kube-api-access-d6jr6\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-wwnn9\" (UID: \"b8a9f826-027f-4b77-a19f-3e7b929b18fe\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-wwnn9"
Jul 09 18:32:40.787725 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:32:40.787629    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/b8a9f826-027f-4b77-a19f-3e7b929b18fe-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-wwnn9\" (UID: \"b8a9f826-027f-4b77-a19f-3e7b929b18fe\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-wwnn9"
Jul 09 18:32:40.788100 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:32:40.788062    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/b8a9f826-027f-4b77-a19f-3e7b929b18fe-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-wwnn9\" (UID: \"b8a9f826-027f-4b77-a19f-3e7b929b18fe\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-wwnn9"
Jul 09 18:32:40.801405 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:32:40.801371    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d6jr6\" (UniqueName: \"kubernetes.io/projected/b8a9f826-027f-4b77-a19f-3e7b929b18fe-kube-api-access-d6jr6\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-wwnn9\" (UID: \"b8a9f826-027f-4b77-a19f-3e7b929b18fe\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-wwnn9"
Jul 09 18:32:41.164649 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:32:41.164608    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-wwnn9"]
Jul 09 18:32:41.175516 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:32:41.175473    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-wwnn9"]
Jul 09 18:32:41.219999 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:32:41.219964    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-8lslg"]
Jul 09 18:32:41.220225 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:32:41.220199    2557 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-8lslg" podUID="046e12a1-3de8-4667-b2e1-b69dd6771c79" containerName="manager" containerID="cri-o://ea5228ae0c198c49d0aed6ee465abd7feae04840898ca96c0af29c2dca114f94" gracePeriod=2
Jul 09 18:32:41.238028 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:32:41.237996    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-8lslg"]
Jul 09 18:32:41.243813 ip-10-0-141-101 kubenswrapper[2557]: E0709 18:32:41.243775    2557 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"046e12a1-3de8-4667-b2e1-b69dd6771c79\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Initialized\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Ready\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"ContainersReady\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodScheduled\\\"}],\\\"observedGeneration\\\":2}}\" for pod \"kuadrant-system\"/\"limitador-operator-controller-manager-859d7b78bd-8lslg\": pods \"limitador-operator-controller-manager-859d7b78bd-8lslg\" not found" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-8lslg"
Jul 09 18:32:41.251820 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:32:41.251793    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-62lzk"]
Jul 09 18:32:41.252531 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:32:41.252501    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="046e12a1-3de8-4667-b2e1-b69dd6771c79" containerName="manager"
Jul 09 18:32:41.252531 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:32:41.252523    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="046e12a1-3de8-4667-b2e1-b69dd6771c79" containerName="manager"
Jul 09 18:32:41.252706 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:32:41.252618    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="046e12a1-3de8-4667-b2e1-b69dd6771c79" containerName="manager"
Jul 09 18:32:41.259370 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:32:41.259333    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-62lzk"
Jul 09 18:32:41.262151 ip-10-0-141-101 kubenswrapper[2557]: E0709 18:32:41.261639    2557 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-8lslg\" is forbidden: User \"system:node:ip-10-0-141-101.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-101.ec2.internal' and this object" podUID="046e12a1-3de8-4667-b2e1-b69dd6771c79" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-8lslg"
Jul 09 18:32:41.264431 ip-10-0-141-101 kubenswrapper[2557]: E0709 18:32:41.264396    2557 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-8lslg\" is forbidden: User \"system:node:ip-10-0-141-101.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-101.ec2.internal' and this object" podUID="046e12a1-3de8-4667-b2e1-b69dd6771c79" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-8lslg"
Jul 09 18:32:41.272252 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:32:41.272226    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-62lzk"]
Jul 09 18:32:41.291957 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:32:41.291927    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6mk99\" (UniqueName: \"kubernetes.io/projected/bf1fe616-28b5-4d2d-8a60-12edebb94e20-kube-api-access-6mk99\") pod \"limitador-operator-controller-manager-859d7b78bd-62lzk\" (UID: \"bf1fe616-28b5-4d2d-8a60-12edebb94e20\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-62lzk"
Jul 09 18:32:41.334674 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:32:41.334645    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-wwnn9"
Jul 09 18:32:41.342522 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:32:41.342496    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-wwnn9"
Jul 09 18:32:41.345731 ip-10-0-141-101 kubenswrapper[2557]: E0709 18:32:41.345689    2557 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-wwnn9\" is forbidden: User \"system:node:ip-10-0-141-101.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-101.ec2.internal' and this object" podUID="b8a9f826-027f-4b77-a19f-3e7b929b18fe" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-wwnn9"
Jul 09 18:32:41.393030 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:32:41.392988    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/b8a9f826-027f-4b77-a19f-3e7b929b18fe-extensions-socket-volume\") pod \"b8a9f826-027f-4b77-a19f-3e7b929b18fe\" (UID: \"b8a9f826-027f-4b77-a19f-3e7b929b18fe\") "
Jul 09 18:32:41.393214 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:32:41.393076    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-d6jr6\" (UniqueName: \"kubernetes.io/projected/b8a9f826-027f-4b77-a19f-3e7b929b18fe-kube-api-access-d6jr6\") pod \"b8a9f826-027f-4b77-a19f-3e7b929b18fe\" (UID: \"b8a9f826-027f-4b77-a19f-3e7b929b18fe\") "
Jul 09 18:32:41.393282 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:32:41.393253    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6mk99\" (UniqueName: \"kubernetes.io/projected/bf1fe616-28b5-4d2d-8a60-12edebb94e20-kube-api-access-6mk99\") pod \"limitador-operator-controller-manager-859d7b78bd-62lzk\" (UID: \"bf1fe616-28b5-4d2d-8a60-12edebb94e20\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-62lzk"
Jul 09 18:32:41.393338 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:32:41.393276    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b8a9f826-027f-4b77-a19f-3e7b929b18fe-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "b8a9f826-027f-4b77-a19f-3e7b929b18fe" (UID: "b8a9f826-027f-4b77-a19f-3e7b929b18fe"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 18:32:41.393525 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:32:41.393499    2557 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/b8a9f826-027f-4b77-a19f-3e7b929b18fe-extensions-socket-volume\") on node \"ip-10-0-141-101.ec2.internal\" DevicePath \"\""
Jul 09 18:32:41.395457 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:32:41.395431    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b8a9f826-027f-4b77-a19f-3e7b929b18fe-kube-api-access-d6jr6" (OuterVolumeSpecName: "kube-api-access-d6jr6") pod "b8a9f826-027f-4b77-a19f-3e7b929b18fe" (UID: "b8a9f826-027f-4b77-a19f-3e7b929b18fe"). InnerVolumeSpecName "kube-api-access-d6jr6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 18:32:41.403573 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:32:41.403537    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6mk99\" (UniqueName: \"kubernetes.io/projected/bf1fe616-28b5-4d2d-8a60-12edebb94e20-kube-api-access-6mk99\") pod \"limitador-operator-controller-manager-859d7b78bd-62lzk\" (UID: \"bf1fe616-28b5-4d2d-8a60-12edebb94e20\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-62lzk"
Jul 09 18:32:41.494308 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:32:41.494220    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-d6jr6\" (UniqueName: \"kubernetes.io/projected/b8a9f826-027f-4b77-a19f-3e7b929b18fe-kube-api-access-d6jr6\") on node \"ip-10-0-141-101.ec2.internal\" DevicePath \"\""
Jul 09 18:32:41.594270 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:32:41.594232    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-62lzk"
Jul 09 18:32:42.341218 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:32:42.341182    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-wwnn9"
Jul 09 18:32:42.343659 ip-10-0-141-101 kubenswrapper[2557]: E0709 18:32:42.343619    2557 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-wwnn9\" is forbidden: User \"system:node:ip-10-0-141-101.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-101.ec2.internal' and this object" podUID="b8a9f826-027f-4b77-a19f-3e7b929b18fe" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-wwnn9"
Jul 09 18:32:42.351524 ip-10-0-141-101 kubenswrapper[2557]: E0709 18:32:42.351471    2557 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-wwnn9\" is forbidden: User \"system:node:ip-10-0-141-101.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-101.ec2.internal' and this object" podUID="b8a9f826-027f-4b77-a19f-3e7b929b18fe" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-wwnn9"
Jul 09 18:32:43.264494 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:32:43.264452    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b8a9f826-027f-4b77-a19f-3e7b929b18fe" path="/var/lib/kubelet/pods/b8a9f826-027f-4b77-a19f-3e7b929b18fe/volumes"
Jul 09 18:32:55.029935 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:32:55.029905    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-8lslg"
Jul 09 18:32:55.032442 ip-10-0-141-101 kubenswrapper[2557]: E0709 18:32:55.032404    2557 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-8lslg\" is forbidden: User \"system:node:ip-10-0-141-101.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-101.ec2.internal' and this object" podUID="046e12a1-3de8-4667-b2e1-b69dd6771c79" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-8lslg"
Jul 09 18:32:55.057108 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:32:55.057077    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-62lzk"]
Jul 09 18:32:55.058963 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:32:55.058929    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbf1fe616_28b5_4d2d_8a60_12edebb94e20.slice/crio-0800dd9892331876dfb27c6970b76d51ff862e8a8acafb54bf93e549eb2bdaf8 WatchSource:0}: Error finding container 0800dd9892331876dfb27c6970b76d51ff862e8a8acafb54bf93e549eb2bdaf8: Status 404 returned error can't find the container with id 0800dd9892331876dfb27c6970b76d51ff862e8a8acafb54bf93e549eb2bdaf8
Jul 09 18:32:55.131730 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:32:55.131661    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mh74f\" (UniqueName: \"kubernetes.io/projected/046e12a1-3de8-4667-b2e1-b69dd6771c79-kube-api-access-mh74f\") pod \"046e12a1-3de8-4667-b2e1-b69dd6771c79\" (UID: \"046e12a1-3de8-4667-b2e1-b69dd6771c79\") "
Jul 09 18:32:55.133622 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:32:55.133593    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/046e12a1-3de8-4667-b2e1-b69dd6771c79-kube-api-access-mh74f" (OuterVolumeSpecName: "kube-api-access-mh74f") pod "046e12a1-3de8-4667-b2e1-b69dd6771c79" (UID: "046e12a1-3de8-4667-b2e1-b69dd6771c79"). InnerVolumeSpecName "kube-api-access-mh74f". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 18:32:55.233223 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:32:55.233189    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mh74f\" (UniqueName: \"kubernetes.io/projected/046e12a1-3de8-4667-b2e1-b69dd6771c79-kube-api-access-mh74f\") on node \"ip-10-0-141-101.ec2.internal\" DevicePath \"\""
Jul 09 18:32:55.262458 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:32:55.262427    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="046e12a1-3de8-4667-b2e1-b69dd6771c79" path="/var/lib/kubelet/pods/046e12a1-3de8-4667-b2e1-b69dd6771c79/volumes"
Jul 09 18:32:55.420698 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:32:55.420595    2557 generic.go:356] "Generic (PLEG): container finished" podID="046e12a1-3de8-4667-b2e1-b69dd6771c79" containerID="ea5228ae0c198c49d0aed6ee465abd7feae04840898ca96c0af29c2dca114f94" exitCode=0
Jul 09 18:32:55.420698 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:32:55.420651    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-8lslg"
Jul 09 18:32:55.420698 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:32:55.420674    2557 scope.go:117] "RemoveContainer" containerID="ea5228ae0c198c49d0aed6ee465abd7feae04840898ca96c0af29c2dca114f94"
Jul 09 18:32:55.422586 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:32:55.422448    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-sngwl" event={"ID":"8c39c462-bc63-45ae-945f-a13f8125dca1","Type":"ContainerStarted","Data":"cc612d4bd214cb4c730f2c7020cf01d971e0eb1b372b684373f587e51d75de81"}
Jul 09 18:32:55.424040 ip-10-0-141-101 kubenswrapper[2557]: E0709 18:32:55.424010    2557 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-8lslg\" is forbidden: User \"system:node:ip-10-0-141-101.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-101.ec2.internal' and this object" podUID="046e12a1-3de8-4667-b2e1-b69dd6771c79" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-8lslg"
Jul 09 18:32:55.424390 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:32:55.424368    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-62lzk" event={"ID":"bf1fe616-28b5-4d2d-8a60-12edebb94e20","Type":"ContainerStarted","Data":"faafe79835a6651b35b84786d4e3b549e86bf093015ac8e9b5c966efea4a56d2"}
Jul 09 18:32:55.424505 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:32:55.424408    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-62lzk" event={"ID":"bf1fe616-28b5-4d2d-8a60-12edebb94e20","Type":"ContainerStarted","Data":"0800dd9892331876dfb27c6970b76d51ff862e8a8acafb54bf93e549eb2bdaf8"}
Jul 09 18:32:55.424505 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:32:55.424444    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-62lzk"
Jul 09 18:32:55.426809 ip-10-0-141-101 kubenswrapper[2557]: E0709 18:32:55.426784    2557 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-8lslg\" is forbidden: User \"system:node:ip-10-0-141-101.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-101.ec2.internal' and this object" podUID="046e12a1-3de8-4667-b2e1-b69dd6771c79" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-8lslg"
Jul 09 18:32:55.430299 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:32:55.430257    2557 scope.go:117] "RemoveContainer" containerID="ea5228ae0c198c49d0aed6ee465abd7feae04840898ca96c0af29c2dca114f94"
Jul 09 18:32:55.430651 ip-10-0-141-101 kubenswrapper[2557]: E0709 18:32:55.430618    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ea5228ae0c198c49d0aed6ee465abd7feae04840898ca96c0af29c2dca114f94\": container with ID starting with ea5228ae0c198c49d0aed6ee465abd7feae04840898ca96c0af29c2dca114f94 not found: ID does not exist" containerID="ea5228ae0c198c49d0aed6ee465abd7feae04840898ca96c0af29c2dca114f94"
Jul 09 18:32:55.430747 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:32:55.430663    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ea5228ae0c198c49d0aed6ee465abd7feae04840898ca96c0af29c2dca114f94"} err="failed to get container status \"ea5228ae0c198c49d0aed6ee465abd7feae04840898ca96c0af29c2dca114f94\": rpc error: code = NotFound desc = could not find container \"ea5228ae0c198c49d0aed6ee465abd7feae04840898ca96c0af29c2dca114f94\": container with ID starting with ea5228ae0c198c49d0aed6ee465abd7feae04840898ca96c0af29c2dca114f94 not found: ID does not exist"
Jul 09 18:32:55.443773 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:32:55.443720    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-sngwl" podStartSLOduration=1.136829728 podStartE2EDuration="25.443706047s" totalImagesPullingTime="24.306876319s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 18:32:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 18:32:55.441905128 +0000 UTC m=+444.681249755" watchObservedRunningTime="2026-07-09 18:32:55.443706047 +0000 UTC m=+444.683050651"
Jul 09 18:32:55.460563 ip-10-0-141-101 kubenswrapper[2557]: E0709 18:32:55.460520    2557 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-8lslg\" is forbidden: User \"system:node:ip-10-0-141-101.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-101.ec2.internal' and this object" podUID="046e12a1-3de8-4667-b2e1-b69dd6771c79" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-8lslg"
Jul 09 18:32:55.460695 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:32:55.460645    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-62lzk" podStartSLOduration=14.460632269 podStartE2EDuration="14.460632269s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 18:32:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 18:32:55.458118492 +0000 UTC m=+444.697463119" watchObservedRunningTime="2026-07-09 18:32:55.460632269 +0000 UTC m=+444.699976896"
Jul 09 18:32:58.535154 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:32:58.535119    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-w5bqz"]
Jul 09 18:32:58.538430 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:32:58.538415    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-w5bqz"
Jul 09 18:32:58.540744 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:32:58.540726    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-r6xjq\""
Jul 09 18:32:58.549708 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:32:58.549684    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-w5bqz"]
Jul 09 18:32:58.663172 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:32:58.663130    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/a2995542-3721-4788-912a-42cdd0134a2e-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-w5bqz\" (UID: \"a2995542-3721-4788-912a-42cdd0134a2e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-w5bqz"
Jul 09 18:32:58.663366 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:32:58.663243    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tpfph\" (UniqueName: \"kubernetes.io/projected/a2995542-3721-4788-912a-42cdd0134a2e-kube-api-access-tpfph\") pod \"kuadrant-operator-controller-manager-86878c769f-w5bqz\" (UID: \"a2995542-3721-4788-912a-42cdd0134a2e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-w5bqz"
Jul 09 18:32:58.764626 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:32:58.764585    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/a2995542-3721-4788-912a-42cdd0134a2e-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-w5bqz\" (UID: \"a2995542-3721-4788-912a-42cdd0134a2e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-w5bqz"
Jul 09 18:32:58.764812 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:32:58.764654    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tpfph\" (UniqueName: \"kubernetes.io/projected/a2995542-3721-4788-912a-42cdd0134a2e-kube-api-access-tpfph\") pod \"kuadrant-operator-controller-manager-86878c769f-w5bqz\" (UID: \"a2995542-3721-4788-912a-42cdd0134a2e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-w5bqz"
Jul 09 18:32:58.765016 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:32:58.764990    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/a2995542-3721-4788-912a-42cdd0134a2e-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-w5bqz\" (UID: \"a2995542-3721-4788-912a-42cdd0134a2e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-w5bqz"
Jul 09 18:32:58.773724 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:32:58.773697    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tpfph\" (UniqueName: \"kubernetes.io/projected/a2995542-3721-4788-912a-42cdd0134a2e-kube-api-access-tpfph\") pod \"kuadrant-operator-controller-manager-86878c769f-w5bqz\" (UID: \"a2995542-3721-4788-912a-42cdd0134a2e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-w5bqz"
Jul 09 18:32:58.848545 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:32:58.848506    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-w5bqz"
Jul 09 18:32:58.997625 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:32:58.997590    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-w5bqz"]
Jul 09 18:32:59.001954 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:32:59.001925    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda2995542_3721_4788_912a_42cdd0134a2e.slice/crio-116ddddab9f9603a167860d5ac455d402101bbcefcd39b7af61b421f25b6c856 WatchSource:0}: Error finding container 116ddddab9f9603a167860d5ac455d402101bbcefcd39b7af61b421f25b6c856: Status 404 returned error can't find the container with id 116ddddab9f9603a167860d5ac455d402101bbcefcd39b7af61b421f25b6c856
Jul 09 18:32:59.448951 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:32:59.448910    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-w5bqz" event={"ID":"a2995542-3721-4788-912a-42cdd0134a2e","Type":"ContainerStarted","Data":"116ddddab9f9603a167860d5ac455d402101bbcefcd39b7af61b421f25b6c856"}
Jul 09 18:33:03.405913 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:33:03.405865    2557 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-5564d575bf-vsck4" podUID="6fad3f7e-c1f8-4509-b143-042254135cfa" containerName="console" containerID="cri-o://3dc3ee9ad1c485baf1c85d9eae248362ca17e3a1710193ffaaae8df415d0ad2b" gracePeriod=15
Jul 09 18:33:03.680400 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:33:03.680371    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5564d575bf-vsck4"
Jul 09 18:33:03.814909 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:33:03.814874    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6fad3f7e-c1f8-4509-b143-042254135cfa-trusted-ca-bundle\") pod \"6fad3f7e-c1f8-4509-b143-042254135cfa\" (UID: \"6fad3f7e-c1f8-4509-b143-042254135cfa\") "
Jul 09 18:33:03.814909 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:33:03.814911    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/6fad3f7e-c1f8-4509-b143-042254135cfa-service-ca\") pod \"6fad3f7e-c1f8-4509-b143-042254135cfa\" (UID: \"6fad3f7e-c1f8-4509-b143-042254135cfa\") "
Jul 09 18:33:03.815160 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:33:03.814944    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/6fad3f7e-c1f8-4509-b143-042254135cfa-oauth-serving-cert\") pod \"6fad3f7e-c1f8-4509-b143-042254135cfa\" (UID: \"6fad3f7e-c1f8-4509-b143-042254135cfa\") "
Jul 09 18:33:03.815160 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:33:03.814977    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mpxnz\" (UniqueName: \"kubernetes.io/projected/6fad3f7e-c1f8-4509-b143-042254135cfa-kube-api-access-mpxnz\") pod \"6fad3f7e-c1f8-4509-b143-042254135cfa\" (UID: \"6fad3f7e-c1f8-4509-b143-042254135cfa\") "
Jul 09 18:33:03.815160 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:33:03.815036    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/6fad3f7e-c1f8-4509-b143-042254135cfa-console-config\") pod \"6fad3f7e-c1f8-4509-b143-042254135cfa\" (UID: \"6fad3f7e-c1f8-4509-b143-042254135cfa\") "
Jul 09 18:33:03.815160 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:33:03.815134    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/6fad3f7e-c1f8-4509-b143-042254135cfa-console-oauth-config\") pod \"6fad3f7e-c1f8-4509-b143-042254135cfa\" (UID: \"6fad3f7e-c1f8-4509-b143-042254135cfa\") "
Jul 09 18:33:03.815160 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:33:03.815161    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/6fad3f7e-c1f8-4509-b143-042254135cfa-console-serving-cert\") pod \"6fad3f7e-c1f8-4509-b143-042254135cfa\" (UID: \"6fad3f7e-c1f8-4509-b143-042254135cfa\") "
Jul 09 18:33:03.815451 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:33:03.815411    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6fad3f7e-c1f8-4509-b143-042254135cfa-service-ca" (OuterVolumeSpecName: "service-ca") pod "6fad3f7e-c1f8-4509-b143-042254135cfa" (UID: "6fad3f7e-c1f8-4509-b143-042254135cfa"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 09 18:33:03.815553 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:33:03.815457    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6fad3f7e-c1f8-4509-b143-042254135cfa-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "6fad3f7e-c1f8-4509-b143-042254135cfa" (UID: "6fad3f7e-c1f8-4509-b143-042254135cfa"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 09 18:33:03.815553 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:33:03.815536    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6fad3f7e-c1f8-4509-b143-042254135cfa-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "6fad3f7e-c1f8-4509-b143-042254135cfa" (UID: "6fad3f7e-c1f8-4509-b143-042254135cfa"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 09 18:33:03.815657 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:33:03.815553    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6fad3f7e-c1f8-4509-b143-042254135cfa-console-config" (OuterVolumeSpecName: "console-config") pod "6fad3f7e-c1f8-4509-b143-042254135cfa" (UID: "6fad3f7e-c1f8-4509-b143-042254135cfa"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 09 18:33:03.817284 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:33:03.817264    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6fad3f7e-c1f8-4509-b143-042254135cfa-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "6fad3f7e-c1f8-4509-b143-042254135cfa" (UID: "6fad3f7e-c1f8-4509-b143-042254135cfa"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 18:33:03.817284 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:33:03.817271    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6fad3f7e-c1f8-4509-b143-042254135cfa-kube-api-access-mpxnz" (OuterVolumeSpecName: "kube-api-access-mpxnz") pod "6fad3f7e-c1f8-4509-b143-042254135cfa" (UID: "6fad3f7e-c1f8-4509-b143-042254135cfa"). InnerVolumeSpecName "kube-api-access-mpxnz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 18:33:03.817407 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:33:03.817333    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6fad3f7e-c1f8-4509-b143-042254135cfa-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "6fad3f7e-c1f8-4509-b143-042254135cfa" (UID: "6fad3f7e-c1f8-4509-b143-042254135cfa"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 18:33:03.916432 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:33:03.916345    2557 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/6fad3f7e-c1f8-4509-b143-042254135cfa-console-config\") on node \"ip-10-0-141-101.ec2.internal\" DevicePath \"\""
Jul 09 18:33:03.916432 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:33:03.916386    2557 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/6fad3f7e-c1f8-4509-b143-042254135cfa-console-oauth-config\") on node \"ip-10-0-141-101.ec2.internal\" DevicePath \"\""
Jul 09 18:33:03.916432 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:33:03.916405    2557 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/6fad3f7e-c1f8-4509-b143-042254135cfa-console-serving-cert\") on node \"ip-10-0-141-101.ec2.internal\" DevicePath \"\""
Jul 09 18:33:03.916432 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:33:03.916420    2557 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6fad3f7e-c1f8-4509-b143-042254135cfa-trusted-ca-bundle\") on node \"ip-10-0-141-101.ec2.internal\" DevicePath \"\""
Jul 09 18:33:03.916432 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:33:03.916434    2557 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/6fad3f7e-c1f8-4509-b143-042254135cfa-service-ca\") on node \"ip-10-0-141-101.ec2.internal\" DevicePath \"\""
Jul 09 18:33:03.916758 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:33:03.916448    2557 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/6fad3f7e-c1f8-4509-b143-042254135cfa-oauth-serving-cert\") on node \"ip-10-0-141-101.ec2.internal\" DevicePath \"\""
Jul 09 18:33:03.916758 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:33:03.916463    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mpxnz\" (UniqueName: \"kubernetes.io/projected/6fad3f7e-c1f8-4509-b143-042254135cfa-kube-api-access-mpxnz\") on node \"ip-10-0-141-101.ec2.internal\" DevicePath \"\""
Jul 09 18:33:04.479846 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:33:04.479812    2557 generic.go:356] "Generic (PLEG): container finished" podID="6fad3f7e-c1f8-4509-b143-042254135cfa" containerID="3dc3ee9ad1c485baf1c85d9eae248362ca17e3a1710193ffaaae8df415d0ad2b" exitCode=0
Jul 09 18:33:04.480312 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:33:04.479858    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5564d575bf-vsck4" event={"ID":"6fad3f7e-c1f8-4509-b143-042254135cfa","Type":"ContainerDied","Data":"3dc3ee9ad1c485baf1c85d9eae248362ca17e3a1710193ffaaae8df415d0ad2b"}
Jul 09 18:33:04.480312 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:33:04.479872    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5564d575bf-vsck4"
Jul 09 18:33:04.480312 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:33:04.479910    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5564d575bf-vsck4" event={"ID":"6fad3f7e-c1f8-4509-b143-042254135cfa","Type":"ContainerDied","Data":"c967326fd9925005cc6f3cda44949ff6d175b9530ff08c3f9b2dbdcd5fd79615"}
Jul 09 18:33:04.480312 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:33:04.479936    2557 scope.go:117] "RemoveContainer" containerID="3dc3ee9ad1c485baf1c85d9eae248362ca17e3a1710193ffaaae8df415d0ad2b"
Jul 09 18:33:04.528135 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:33:04.528096    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5564d575bf-vsck4"]
Jul 09 18:33:04.550883 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:33:04.550847    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-5564d575bf-vsck4"]
Jul 09 18:33:05.010557 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:33:05.010454    2557 scope.go:117] "RemoveContainer" containerID="3dc3ee9ad1c485baf1c85d9eae248362ca17e3a1710193ffaaae8df415d0ad2b"
Jul 09 18:33:05.010889 ip-10-0-141-101 kubenswrapper[2557]: E0709 18:33:05.010868    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3dc3ee9ad1c485baf1c85d9eae248362ca17e3a1710193ffaaae8df415d0ad2b\": container with ID starting with 3dc3ee9ad1c485baf1c85d9eae248362ca17e3a1710193ffaaae8df415d0ad2b not found: ID does not exist" containerID="3dc3ee9ad1c485baf1c85d9eae248362ca17e3a1710193ffaaae8df415d0ad2b"
Jul 09 18:33:05.010961 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:33:05.010902    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3dc3ee9ad1c485baf1c85d9eae248362ca17e3a1710193ffaaae8df415d0ad2b"} err="failed to get container status \"3dc3ee9ad1c485baf1c85d9eae248362ca17e3a1710193ffaaae8df415d0ad2b\": rpc error: code = NotFound desc = could not find container \"3dc3ee9ad1c485baf1c85d9eae248362ca17e3a1710193ffaaae8df415d0ad2b\": container with ID starting with 3dc3ee9ad1c485baf1c85d9eae248362ca17e3a1710193ffaaae8df415d0ad2b not found: ID does not exist"
Jul 09 18:33:05.263413 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:33:05.263336    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6fad3f7e-c1f8-4509-b143-042254135cfa" path="/var/lib/kubelet/pods/6fad3f7e-c1f8-4509-b143-042254135cfa/volumes"
Jul 09 18:33:05.488029 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:33:05.487982    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-w5bqz" event={"ID":"a2995542-3721-4788-912a-42cdd0134a2e","Type":"ContainerStarted","Data":"67f11019b46067e08d8dc392f23e217869059a9346a0aa885808f4a9c022a511"}
Jul 09 18:33:05.488513 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:33:05.488054    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-w5bqz"
Jul 09 18:33:05.508097 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:33:05.508042    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-w5bqz" podStartSLOduration=1.467998209 podStartE2EDuration="7.50802581s" totalImagesPullingTime="6.040027601s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 18:32:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 18:33:05.506654952 +0000 UTC m=+454.745999578" watchObservedRunningTime="2026-07-09 18:33:05.50802581 +0000 UTC m=+454.747370435"
Jul 09 18:33:06.433373 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:33:06.433340    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-62lzk"
Jul 09 18:33:16.498471 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:33:16.498433    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-w5bqz"
Jul 09 18:35:07.541714 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:35:07.541675    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-7964457696-hkf65"]
Jul 09 18:35:07.542249 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:35:07.542128    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6fad3f7e-c1f8-4509-b143-042254135cfa" containerName="console"
Jul 09 18:35:07.542249 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:35:07.542143    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="6fad3f7e-c1f8-4509-b143-042254135cfa" containerName="console"
Jul 09 18:35:07.542249 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:35:07.542212    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="6fad3f7e-c1f8-4509-b143-042254135cfa" containerName="console"
Jul 09 18:35:07.545392 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:35:07.545374    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-7964457696-hkf65"
Jul 09 18:35:07.547801 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:35:07.547770    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-p6tbr\""
Jul 09 18:35:07.547899 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:35:07.547823    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\""
Jul 09 18:35:07.556099 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:35:07.556078    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-7964457696-hkf65"]
Jul 09 18:35:07.612398 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:35:07.612363    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/bfbc8e56-1bdb-4b9b-922e-21cb55f09548-plugins-config-volume\") pod \"payload-pre-processing-7964457696-hkf65\" (UID: \"bfbc8e56-1bdb-4b9b-922e-21cb55f09548\") " pod="openshift-ingress/payload-pre-processing-7964457696-hkf65"
Jul 09 18:35:07.612603 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:35:07.612426    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rlnrw\" (UniqueName: \"kubernetes.io/projected/bfbc8e56-1bdb-4b9b-922e-21cb55f09548-kube-api-access-rlnrw\") pod \"payload-pre-processing-7964457696-hkf65\" (UID: \"bfbc8e56-1bdb-4b9b-922e-21cb55f09548\") " pod="openshift-ingress/payload-pre-processing-7964457696-hkf65"
Jul 09 18:35:07.713985 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:35:07.713944    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/bfbc8e56-1bdb-4b9b-922e-21cb55f09548-plugins-config-volume\") pod \"payload-pre-processing-7964457696-hkf65\" (UID: \"bfbc8e56-1bdb-4b9b-922e-21cb55f09548\") " pod="openshift-ingress/payload-pre-processing-7964457696-hkf65"
Jul 09 18:35:07.714157 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:35:07.713996    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rlnrw\" (UniqueName: \"kubernetes.io/projected/bfbc8e56-1bdb-4b9b-922e-21cb55f09548-kube-api-access-rlnrw\") pod \"payload-pre-processing-7964457696-hkf65\" (UID: \"bfbc8e56-1bdb-4b9b-922e-21cb55f09548\") " pod="openshift-ingress/payload-pre-processing-7964457696-hkf65"
Jul 09 18:35:07.714715 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:35:07.714696    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/bfbc8e56-1bdb-4b9b-922e-21cb55f09548-plugins-config-volume\") pod \"payload-pre-processing-7964457696-hkf65\" (UID: \"bfbc8e56-1bdb-4b9b-922e-21cb55f09548\") " pod="openshift-ingress/payload-pre-processing-7964457696-hkf65"
Jul 09 18:35:07.722638 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:35:07.722606    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rlnrw\" (UniqueName: \"kubernetes.io/projected/bfbc8e56-1bdb-4b9b-922e-21cb55f09548-kube-api-access-rlnrw\") pod \"payload-pre-processing-7964457696-hkf65\" (UID: \"bfbc8e56-1bdb-4b9b-922e-21cb55f09548\") " pod="openshift-ingress/payload-pre-processing-7964457696-hkf65"
Jul 09 18:35:07.856817 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:35:07.856712    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-7964457696-hkf65"
Jul 09 18:35:07.997443 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:35:07.997416    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-7964457696-hkf65"]
Jul 09 18:35:07.999915 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:35:07.999885    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbfbc8e56_1bdb_4b9b_922e_21cb55f09548.slice/crio-7dfb3d3d2477452370c060ad5610270d7ae81cff3e879d247b565fccbe4959f1 WatchSource:0}: Error finding container 7dfb3d3d2477452370c060ad5610270d7ae81cff3e879d247b565fccbe4959f1: Status 404 returned error can't find the container with id 7dfb3d3d2477452370c060ad5610270d7ae81cff3e879d247b565fccbe4959f1
Jul 09 18:35:08.145723 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:35:08.145626    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-7964457696-hkf65" event={"ID":"bfbc8e56-1bdb-4b9b-922e-21cb55f09548","Type":"ContainerStarted","Data":"7dfb3d3d2477452370c060ad5610270d7ae81cff3e879d247b565fccbe4959f1"}
Jul 09 18:35:10.159131 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:35:10.159090    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-7964457696-hkf65" event={"ID":"bfbc8e56-1bdb-4b9b-922e-21cb55f09548","Type":"ContainerStarted","Data":"34dfc8947b40ca557953f86944ff1bba5c5fe3e90c6a67514d43c8965dcb56e2"}
Jul 09 18:35:10.159591 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:35:10.159219    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-7964457696-hkf65"
Jul 09 18:35:10.176324 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:35:10.176267    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-7964457696-hkf65" podStartSLOduration=1.524804101 podStartE2EDuration="3.176246488s" totalImagesPullingTime="1.651442387s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 18:35:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 18:35:10.175672472 +0000 UTC m=+579.415017091" watchObservedRunningTime="2026-07-09 18:35:10.176246488 +0000 UTC m=+579.415591117"
Jul 09 18:35:21.166903 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:35:21.166871    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-7964457696-hkf65"
Jul 09 18:35:32.799671 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:35:32.799633    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-h2fr9"]
Jul 09 18:35:32.803054 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:35:32.803034    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-h2fr9"
Jul 09 18:35:32.808247 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:35:32.808223    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Jul 09 18:35:32.808385 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:35:32.808302    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-m2k7l\""
Jul 09 18:35:32.809174 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:35:32.809153    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\""
Jul 09 18:35:32.809299 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:35:32.809201    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Jul 09 18:35:32.821175 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:35:32.821151    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-h2fr9"]
Jul 09 18:35:32.942646 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:35:32.942612    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4e83f83f-9b92-412b-883d-2c0e02eb3887-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-h2fr9\" (UID: \"4e83f83f-9b92-412b-883d-2c0e02eb3887\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-h2fr9"
Jul 09 18:35:32.942646 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:35:32.942647    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4e83f83f-9b92-412b-883d-2c0e02eb3887-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-h2fr9\" (UID: \"4e83f83f-9b92-412b-883d-2c0e02eb3887\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-h2fr9"
Jul 09 18:35:32.942863 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:35:32.942740    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gf9wm\" (UniqueName: \"kubernetes.io/projected/4e83f83f-9b92-412b-883d-2c0e02eb3887-kube-api-access-gf9wm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-h2fr9\" (UID: \"4e83f83f-9b92-412b-883d-2c0e02eb3887\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-h2fr9"
Jul 09 18:35:32.942863 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:35:32.942777    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4e83f83f-9b92-412b-883d-2c0e02eb3887-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-h2fr9\" (UID: \"4e83f83f-9b92-412b-883d-2c0e02eb3887\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-h2fr9"
Jul 09 18:35:32.942863 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:35:32.942810    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4e83f83f-9b92-412b-883d-2c0e02eb3887-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-h2fr9\" (UID: \"4e83f83f-9b92-412b-883d-2c0e02eb3887\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-h2fr9"
Jul 09 18:35:32.942863 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:35:32.942851    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4e83f83f-9b92-412b-883d-2c0e02eb3887-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-h2fr9\" (UID: \"4e83f83f-9b92-412b-883d-2c0e02eb3887\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-h2fr9"
Jul 09 18:35:33.043559 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:35:33.043506    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4e83f83f-9b92-412b-883d-2c0e02eb3887-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-h2fr9\" (UID: \"4e83f83f-9b92-412b-883d-2c0e02eb3887\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-h2fr9"
Jul 09 18:35:33.043766 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:35:33.043578    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4e83f83f-9b92-412b-883d-2c0e02eb3887-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-h2fr9\" (UID: \"4e83f83f-9b92-412b-883d-2c0e02eb3887\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-h2fr9"
Jul 09 18:35:33.043766 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:35:33.043627    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4e83f83f-9b92-412b-883d-2c0e02eb3887-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-h2fr9\" (UID: \"4e83f83f-9b92-412b-883d-2c0e02eb3887\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-h2fr9"
Jul 09 18:35:33.043766 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:35:33.043672    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4e83f83f-9b92-412b-883d-2c0e02eb3887-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-h2fr9\" (UID: \"4e83f83f-9b92-412b-883d-2c0e02eb3887\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-h2fr9"
Jul 09 18:35:33.043766 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:35:33.043699    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4e83f83f-9b92-412b-883d-2c0e02eb3887-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-h2fr9\" (UID: \"4e83f83f-9b92-412b-883d-2c0e02eb3887\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-h2fr9"
Jul 09 18:35:33.043980 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:35:33.043772    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gf9wm\" (UniqueName: \"kubernetes.io/projected/4e83f83f-9b92-412b-883d-2c0e02eb3887-kube-api-access-gf9wm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-h2fr9\" (UID: \"4e83f83f-9b92-412b-883d-2c0e02eb3887\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-h2fr9"
Jul 09 18:35:33.043980 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:35:33.043905    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4e83f83f-9b92-412b-883d-2c0e02eb3887-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-h2fr9\" (UID: \"4e83f83f-9b92-412b-883d-2c0e02eb3887\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-h2fr9"
Jul 09 18:35:33.044085 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:35:33.044018    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4e83f83f-9b92-412b-883d-2c0e02eb3887-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-h2fr9\" (UID: \"4e83f83f-9b92-412b-883d-2c0e02eb3887\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-h2fr9"
Jul 09 18:35:33.044141 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:35:33.044079    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4e83f83f-9b92-412b-883d-2c0e02eb3887-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-h2fr9\" (UID: \"4e83f83f-9b92-412b-883d-2c0e02eb3887\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-h2fr9"
Jul 09 18:35:33.045975 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:35:33.045951    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4e83f83f-9b92-412b-883d-2c0e02eb3887-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-h2fr9\" (UID: \"4e83f83f-9b92-412b-883d-2c0e02eb3887\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-h2fr9"
Jul 09 18:35:33.046262 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:35:33.046239    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4e83f83f-9b92-412b-883d-2c0e02eb3887-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-h2fr9\" (UID: \"4e83f83f-9b92-412b-883d-2c0e02eb3887\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-h2fr9"
Jul 09 18:35:33.060120 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:35:33.060046    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gf9wm\" (UniqueName: \"kubernetes.io/projected/4e83f83f-9b92-412b-883d-2c0e02eb3887-kube-api-access-gf9wm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-h2fr9\" (UID: \"4e83f83f-9b92-412b-883d-2c0e02eb3887\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-h2fr9"
Jul 09 18:35:33.113406 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:35:33.113361    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-h2fr9"
Jul 09 18:35:33.264874 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:35:33.264849    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-h2fr9"]
Jul 09 18:35:33.267259 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:35:33.267235    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4e83f83f_9b92_412b_883d_2c0e02eb3887.slice/crio-6acf91f9385e51566ba4141ee8a5202f54668afce009dc3fceb09b9b18150d92 WatchSource:0}: Error finding container 6acf91f9385e51566ba4141ee8a5202f54668afce009dc3fceb09b9b18150d92: Status 404 returned error can't find the container with id 6acf91f9385e51566ba4141ee8a5202f54668afce009dc3fceb09b9b18150d92
Jul 09 18:35:33.293764 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:35:33.293734    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-h2fr9" event={"ID":"4e83f83f-9b92-412b-883d-2c0e02eb3887","Type":"ContainerStarted","Data":"6acf91f9385e51566ba4141ee8a5202f54668afce009dc3fceb09b9b18150d92"}
Jul 09 18:35:35.309382 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:35:35.309339    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-h2fr9" event={"ID":"4e83f83f-9b92-412b-883d-2c0e02eb3887","Type":"ContainerStarted","Data":"d50d8718bd0c5db7f14f0e848a874c006da00b6a2ff9d69e32e452c752a4d09b"}
Jul 09 18:35:35.330709 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:35:35.330639    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-h2fr9" podStartSLOduration=2.1807419120000002 podStartE2EDuration="3.33061564s" totalImagesPullingTime="1.149873728s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 18:35:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 18:35:35.328911527 +0000 UTC m=+604.568256153" watchObservedRunningTime="2026-07-09 18:35:35.33061564 +0000 UTC m=+604.569960268"
Jul 09 18:35:43.114403 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:35:43.114360    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-h2fr9"
Jul 09 18:35:43.115053 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:35:43.114499    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-h2fr9"
Jul 09 18:35:43.129693 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:35:43.129667    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-h2fr9"
Jul 09 18:35:43.368260 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:35:43.368169    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-h2fr9"
Jul 09 18:35:55.321285 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:35:55.321202    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-x2d25"]
Jul 09 18:35:55.324709 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:35:55.324689    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-x2d25"
Jul 09 18:35:55.328538 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:35:55.328491    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\""
Jul 09 18:35:55.333628 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:35:55.333597    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/08babfa7-558f-4f57-8350-abb1351525a9-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-x2d25\" (UID: \"08babfa7-558f-4f57-8350-abb1351525a9\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-x2d25"
Jul 09 18:35:55.333730 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:35:55.333646    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/08babfa7-558f-4f57-8350-abb1351525a9-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-x2d25\" (UID: \"08babfa7-558f-4f57-8350-abb1351525a9\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-x2d25"
Jul 09 18:35:55.333780 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:35:55.333718    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/08babfa7-558f-4f57-8350-abb1351525a9-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-x2d25\" (UID: \"08babfa7-558f-4f57-8350-abb1351525a9\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-x2d25"
Jul 09 18:35:55.333780 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:35:55.333762    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/08babfa7-558f-4f57-8350-abb1351525a9-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-x2d25\" (UID: \"08babfa7-558f-4f57-8350-abb1351525a9\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-x2d25"
Jul 09 18:35:55.333890 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:35:55.333872    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9v44k\" (UniqueName: \"kubernetes.io/projected/08babfa7-558f-4f57-8350-abb1351525a9-kube-api-access-9v44k\") pod \"e2e-distinct-simulated-kserve-59975d69f9-x2d25\" (UID: \"08babfa7-558f-4f57-8350-abb1351525a9\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-x2d25"
Jul 09 18:35:55.333955 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:35:55.333937    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/08babfa7-558f-4f57-8350-abb1351525a9-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-x2d25\" (UID: \"08babfa7-558f-4f57-8350-abb1351525a9\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-x2d25"
Jul 09 18:35:55.340217 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:35:55.340196    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-x2d25"]
Jul 09 18:35:55.435417 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:35:55.435380    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/08babfa7-558f-4f57-8350-abb1351525a9-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-x2d25\" (UID: \"08babfa7-558f-4f57-8350-abb1351525a9\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-x2d25"
Jul 09 18:35:55.435638 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:35:55.435425    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/08babfa7-558f-4f57-8350-abb1351525a9-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-x2d25\" (UID: \"08babfa7-558f-4f57-8350-abb1351525a9\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-x2d25"
Jul 09 18:35:55.435638 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:35:55.435450    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/08babfa7-558f-4f57-8350-abb1351525a9-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-x2d25\" (UID: \"08babfa7-558f-4f57-8350-abb1351525a9\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-x2d25"
Jul 09 18:35:55.435638 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:35:55.435546    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9v44k\" (UniqueName: \"kubernetes.io/projected/08babfa7-558f-4f57-8350-abb1351525a9-kube-api-access-9v44k\") pod \"e2e-distinct-simulated-kserve-59975d69f9-x2d25\" (UID: \"08babfa7-558f-4f57-8350-abb1351525a9\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-x2d25"
Jul 09 18:35:55.435638 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:35:55.435580    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/08babfa7-558f-4f57-8350-abb1351525a9-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-x2d25\" (UID: \"08babfa7-558f-4f57-8350-abb1351525a9\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-x2d25"
Jul 09 18:35:55.435866 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:35:55.435655    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/08babfa7-558f-4f57-8350-abb1351525a9-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-x2d25\" (UID: \"08babfa7-558f-4f57-8350-abb1351525a9\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-x2d25"
Jul 09 18:35:55.435996 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:35:55.435967    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/08babfa7-558f-4f57-8350-abb1351525a9-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-x2d25\" (UID: \"08babfa7-558f-4f57-8350-abb1351525a9\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-x2d25"
Jul 09 18:35:55.436193 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:35:55.435991    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/08babfa7-558f-4f57-8350-abb1351525a9-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-x2d25\" (UID: \"08babfa7-558f-4f57-8350-abb1351525a9\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-x2d25"
Jul 09 18:35:55.436324 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:35:55.436301    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/08babfa7-558f-4f57-8350-abb1351525a9-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-x2d25\" (UID: \"08babfa7-558f-4f57-8350-abb1351525a9\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-x2d25"
Jul 09 18:35:55.437844 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:35:55.437824    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/08babfa7-558f-4f57-8350-abb1351525a9-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-x2d25\" (UID: \"08babfa7-558f-4f57-8350-abb1351525a9\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-x2d25"
Jul 09 18:35:55.438402 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:35:55.438378    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/08babfa7-558f-4f57-8350-abb1351525a9-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-x2d25\" (UID: \"08babfa7-558f-4f57-8350-abb1351525a9\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-x2d25"
Jul 09 18:35:55.445792 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:35:55.445771    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9v44k\" (UniqueName: \"kubernetes.io/projected/08babfa7-558f-4f57-8350-abb1351525a9-kube-api-access-9v44k\") pod \"e2e-distinct-simulated-kserve-59975d69f9-x2d25\" (UID: \"08babfa7-558f-4f57-8350-abb1351525a9\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-x2d25"
Jul 09 18:35:55.635329 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:35:55.635237    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-x2d25"
Jul 09 18:35:55.783289 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:35:55.783263    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-x2d25"]
Jul 09 18:35:55.785423 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:35:55.785393    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod08babfa7_558f_4f57_8350_abb1351525a9.slice/crio-e6d8dae4786075d8b64f69904fbca493b74e355a8cfdf29d05de1dac412ab180 WatchSource:0}: Error finding container e6d8dae4786075d8b64f69904fbca493b74e355a8cfdf29d05de1dac412ab180: Status 404 returned error can't find the container with id e6d8dae4786075d8b64f69904fbca493b74e355a8cfdf29d05de1dac412ab180
Jul 09 18:35:55.787037 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:35:55.787004    2557 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 09 18:35:56.431624 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:35:56.431579    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-x2d25" event={"ID":"08babfa7-558f-4f57-8350-abb1351525a9","Type":"ContainerStarted","Data":"cc3154111c82a815ca56a422cd71b5c58bab2720418cef9a707336b03fccca91"}
Jul 09 18:35:56.432051 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:35:56.431650    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-x2d25" event={"ID":"08babfa7-558f-4f57-8350-abb1351525a9","Type":"ContainerStarted","Data":"e6d8dae4786075d8b64f69904fbca493b74e355a8cfdf29d05de1dac412ab180"}
Jul 09 18:35:56.476774 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:35:56.476716    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-x2d25" podStartSLOduration=1.299152446 podStartE2EDuration="1.476695722s" totalImagesPullingTime="177.543276ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 18:35:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 18:35:56.472709756 +0000 UTC m=+625.712054398" watchObservedRunningTime="2026-07-09 18:35:56.476695722 +0000 UTC m=+625.716040349"
Jul 09 18:36:05.636463 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:36:05.636419    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-x2d25"
Jul 09 18:36:05.636984 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:36:05.636526    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-x2d25"
Jul 09 18:36:05.649445 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:36:05.649419    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-x2d25"
Jul 09 18:36:06.499673 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:36:06.499640    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-x2d25"
Jul 09 18:43:38.019845 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:43:38.019766    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-w5bqz"]
Jul 09 18:43:38.022259 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:43:38.020020    2557 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-w5bqz" podUID="a2995542-3721-4788-912a-42cdd0134a2e" containerName="manager" containerID="cri-o://67f11019b46067e08d8dc392f23e217869059a9346a0aa885808f4a9c022a511" gracePeriod=10
Jul 09 18:43:41.670191 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:43:41.670168    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-w5bqz"
Jul 09 18:43:41.776755 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:43:41.776718    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tpfph\" (UniqueName: \"kubernetes.io/projected/a2995542-3721-4788-912a-42cdd0134a2e-kube-api-access-tpfph\") pod \"a2995542-3721-4788-912a-42cdd0134a2e\" (UID: \"a2995542-3721-4788-912a-42cdd0134a2e\") "
Jul 09 18:43:41.776755 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:43:41.776761    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/a2995542-3721-4788-912a-42cdd0134a2e-extensions-socket-volume\") pod \"a2995542-3721-4788-912a-42cdd0134a2e\" (UID: \"a2995542-3721-4788-912a-42cdd0134a2e\") "
Jul 09 18:43:41.777220 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:43:41.777199    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a2995542-3721-4788-912a-42cdd0134a2e-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "a2995542-3721-4788-912a-42cdd0134a2e" (UID: "a2995542-3721-4788-912a-42cdd0134a2e"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 18:43:41.778818 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:43:41.778793    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a2995542-3721-4788-912a-42cdd0134a2e-kube-api-access-tpfph" (OuterVolumeSpecName: "kube-api-access-tpfph") pod "a2995542-3721-4788-912a-42cdd0134a2e" (UID: "a2995542-3721-4788-912a-42cdd0134a2e"). InnerVolumeSpecName "kube-api-access-tpfph". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 18:43:41.878420 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:43:41.878381    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tpfph\" (UniqueName: \"kubernetes.io/projected/a2995542-3721-4788-912a-42cdd0134a2e-kube-api-access-tpfph\") on node \"ip-10-0-141-101.ec2.internal\" DevicePath \"\""
Jul 09 18:43:41.878420 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:43:41.878416    2557 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/a2995542-3721-4788-912a-42cdd0134a2e-extensions-socket-volume\") on node \"ip-10-0-141-101.ec2.internal\" DevicePath \"\""
Jul 09 18:43:42.031631 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:43:42.031592    2557 generic.go:356] "Generic (PLEG): container finished" podID="a2995542-3721-4788-912a-42cdd0134a2e" containerID="67f11019b46067e08d8dc392f23e217869059a9346a0aa885808f4a9c022a511" exitCode=0
Jul 09 18:43:42.031835 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:43:42.031640    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-w5bqz"
Jul 09 18:43:42.031835 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:43:42.031683    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-w5bqz" event={"ID":"a2995542-3721-4788-912a-42cdd0134a2e","Type":"ContainerDied","Data":"67f11019b46067e08d8dc392f23e217869059a9346a0aa885808f4a9c022a511"}
Jul 09 18:43:42.031835 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:43:42.031741    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-w5bqz" event={"ID":"a2995542-3721-4788-912a-42cdd0134a2e","Type":"ContainerDied","Data":"116ddddab9f9603a167860d5ac455d402101bbcefcd39b7af61b421f25b6c856"}
Jul 09 18:43:42.031835 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:43:42.031767    2557 scope.go:117] "RemoveContainer" containerID="67f11019b46067e08d8dc392f23e217869059a9346a0aa885808f4a9c022a511"
Jul 09 18:43:42.041940 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:43:42.041921    2557 scope.go:117] "RemoveContainer" containerID="67f11019b46067e08d8dc392f23e217869059a9346a0aa885808f4a9c022a511"
Jul 09 18:43:42.042252 ip-10-0-141-101 kubenswrapper[2557]: E0709 18:43:42.042230    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"67f11019b46067e08d8dc392f23e217869059a9346a0aa885808f4a9c022a511\": container with ID starting with 67f11019b46067e08d8dc392f23e217869059a9346a0aa885808f4a9c022a511 not found: ID does not exist" containerID="67f11019b46067e08d8dc392f23e217869059a9346a0aa885808f4a9c022a511"
Jul 09 18:43:42.042304 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:43:42.042263    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"67f11019b46067e08d8dc392f23e217869059a9346a0aa885808f4a9c022a511"} err="failed to get container status \"67f11019b46067e08d8dc392f23e217869059a9346a0aa885808f4a9c022a511\": rpc error: code = NotFound desc = could not find container \"67f11019b46067e08d8dc392f23e217869059a9346a0aa885808f4a9c022a511\": container with ID starting with 67f11019b46067e08d8dc392f23e217869059a9346a0aa885808f4a9c022a511 not found: ID does not exist"
Jul 09 18:43:42.067213 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:43:42.067176    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-w5bqz"]
Jul 09 18:43:42.071663 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:43:42.071635    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-w5bqz"]
Jul 09 18:43:43.263319 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:43:43.263280    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a2995542-3721-4788-912a-42cdd0134a2e" path="/var/lib/kubelet/pods/a2995542-3721-4788-912a-42cdd0134a2e/volumes"
Jul 09 18:44:39.168379 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:44:39.168344    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-dd6g2"]
Jul 09 18:44:39.168807 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:44:39.168767    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a2995542-3721-4788-912a-42cdd0134a2e" containerName="manager"
Jul 09 18:44:39.168807 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:44:39.168779    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="a2995542-3721-4788-912a-42cdd0134a2e" containerName="manager"
Jul 09 18:44:39.168883 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:44:39.168842    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="a2995542-3721-4788-912a-42cdd0134a2e" containerName="manager"
Jul 09 18:44:39.173274 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:44:39.173257    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-dd6g2"
Jul 09 18:44:39.175794 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:44:39.175773    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-r6xjq\""
Jul 09 18:44:39.183636 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:44:39.183613    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-dd6g2"]
Jul 09 18:44:39.307823 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:44:39.307786    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7g2j8\" (UniqueName: \"kubernetes.io/projected/1c4ee6ca-bfef-4241-b88c-3dd36fe5a9b9-kube-api-access-7g2j8\") pod \"kuadrant-operator-controller-manager-86878c769f-dd6g2\" (UID: \"1c4ee6ca-bfef-4241-b88c-3dd36fe5a9b9\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-dd6g2"
Jul 09 18:44:39.307997 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:44:39.307845    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/1c4ee6ca-bfef-4241-b88c-3dd36fe5a9b9-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-dd6g2\" (UID: \"1c4ee6ca-bfef-4241-b88c-3dd36fe5a9b9\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-dd6g2"
Jul 09 18:44:39.408684 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:44:39.408651    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/1c4ee6ca-bfef-4241-b88c-3dd36fe5a9b9-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-dd6g2\" (UID: \"1c4ee6ca-bfef-4241-b88c-3dd36fe5a9b9\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-dd6g2"
Jul 09 18:44:39.408871 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:44:39.408749    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7g2j8\" (UniqueName: \"kubernetes.io/projected/1c4ee6ca-bfef-4241-b88c-3dd36fe5a9b9-kube-api-access-7g2j8\") pod \"kuadrant-operator-controller-manager-86878c769f-dd6g2\" (UID: \"1c4ee6ca-bfef-4241-b88c-3dd36fe5a9b9\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-dd6g2"
Jul 09 18:44:39.409073 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:44:39.409052    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/1c4ee6ca-bfef-4241-b88c-3dd36fe5a9b9-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-dd6g2\" (UID: \"1c4ee6ca-bfef-4241-b88c-3dd36fe5a9b9\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-dd6g2"
Jul 09 18:44:39.420232 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:44:39.420161    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7g2j8\" (UniqueName: \"kubernetes.io/projected/1c4ee6ca-bfef-4241-b88c-3dd36fe5a9b9-kube-api-access-7g2j8\") pod \"kuadrant-operator-controller-manager-86878c769f-dd6g2\" (UID: \"1c4ee6ca-bfef-4241-b88c-3dd36fe5a9b9\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-dd6g2"
Jul 09 18:44:39.484604 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:44:39.484575    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-dd6g2"
Jul 09 18:44:39.627669 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:44:39.627645    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-dd6g2"]
Jul 09 18:44:39.630105 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:44:39.630074    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1c4ee6ca_bfef_4241_b88c_3dd36fe5a9b9.slice/crio-7ddc8e9567eb8f332397be46a314663d38ad355bd5d398abced86f037c099cab WatchSource:0}: Error finding container 7ddc8e9567eb8f332397be46a314663d38ad355bd5d398abced86f037c099cab: Status 404 returned error can't find the container with id 7ddc8e9567eb8f332397be46a314663d38ad355bd5d398abced86f037c099cab
Jul 09 18:44:40.358059 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:44:40.358022    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-dd6g2" event={"ID":"1c4ee6ca-bfef-4241-b88c-3dd36fe5a9b9","Type":"ContainerStarted","Data":"e298fa83c1559069e12848ca55f5bd9576c992d508cae77935f4a561cd5fc61c"}
Jul 09 18:44:40.358594 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:44:40.358075    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-dd6g2" event={"ID":"1c4ee6ca-bfef-4241-b88c-3dd36fe5a9b9","Type":"ContainerStarted","Data":"7ddc8e9567eb8f332397be46a314663d38ad355bd5d398abced86f037c099cab"}
Jul 09 18:44:40.358594 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:44:40.358149    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-dd6g2"
Jul 09 18:44:40.388497 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:44:40.387426    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-dd6g2" podStartSLOduration=1.38740758 podStartE2EDuration="1.38740758s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 18:44:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 18:44:40.381821148 +0000 UTC m=+1149.621165774" watchObservedRunningTime="2026-07-09 18:44:40.38740758 +0000 UTC m=+1149.626752206"
Jul 09 18:44:51.366317 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:44:51.366282    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-dd6g2"
Jul 09 18:45:00.149223 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:45:00.149126    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29727045-mw29r"]
Jul 09 18:45:00.152851 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:45:00.152827    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29727045-mw29r"
Jul 09 18:45:00.155650 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:45:00.155622    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 09 18:45:00.156381 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:45:00.156362    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-4zbc4\""
Jul 09 18:45:00.156541 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:45:00.156364    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 09 18:45:00.161405 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:45:00.161379    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29727045-mw29r"]
Jul 09 18:45:00.312293 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:45:00.312251    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pwfdp\" (UniqueName: \"kubernetes.io/projected/bc216ff8-dd75-45f6-9280-afab2f33f20f-kube-api-access-pwfdp\") pod \"maas-api-key-cleanup-29727045-mw29r\" (UID: \"bc216ff8-dd75-45f6-9280-afab2f33f20f\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-29727045-mw29r"
Jul 09 18:45:00.413203 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:45:00.413101    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pwfdp\" (UniqueName: \"kubernetes.io/projected/bc216ff8-dd75-45f6-9280-afab2f33f20f-kube-api-access-pwfdp\") pod \"maas-api-key-cleanup-29727045-mw29r\" (UID: \"bc216ff8-dd75-45f6-9280-afab2f33f20f\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-29727045-mw29r"
Jul 09 18:45:00.428759 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:45:00.428719    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pwfdp\" (UniqueName: \"kubernetes.io/projected/bc216ff8-dd75-45f6-9280-afab2f33f20f-kube-api-access-pwfdp\") pod \"maas-api-key-cleanup-29727045-mw29r\" (UID: \"bc216ff8-dd75-45f6-9280-afab2f33f20f\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-29727045-mw29r"
Jul 09 18:45:00.465188 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:45:00.465154    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29727045-mw29r"
Jul 09 18:45:00.610828 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:45:00.610800    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29727045-mw29r"]
Jul 09 18:45:00.612911 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:45:00.612873    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbc216ff8_dd75_45f6_9280_afab2f33f20f.slice/crio-1ef7476eda80e124c215a77e0a1757f41cc4d88f92c3e65e23a726e740380dc5 WatchSource:0}: Error finding container 1ef7476eda80e124c215a77e0a1757f41cc4d88f92c3e65e23a726e740380dc5: Status 404 returned error can't find the container with id 1ef7476eda80e124c215a77e0a1757f41cc4d88f92c3e65e23a726e740380dc5
Jul 09 18:45:00.614875 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:45:00.614852    2557 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 09 18:45:01.479503 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:45:01.479445    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29727045-mw29r" event={"ID":"bc216ff8-dd75-45f6-9280-afab2f33f20f","Type":"ContainerStarted","Data":"1ef7476eda80e124c215a77e0a1757f41cc4d88f92c3e65e23a726e740380dc5"}
Jul 09 18:45:04.500226 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:45:04.500133    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29727045-mw29r" event={"ID":"bc216ff8-dd75-45f6-9280-afab2f33f20f","Type":"ContainerStarted","Data":"3044fecc18585056caf429fe22501b49990f8136c30ac314f99eaae6d85465a5"}
Jul 09 18:45:04.518098 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:45:04.518046    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29727045-mw29r" podStartSLOduration=1.301435852 podStartE2EDuration="4.518029052s" totalImagesPullingTime="3.2165932s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 18:45:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 18:45:04.516238835 +0000 UTC m=+1173.755583493" watchObservedRunningTime="2026-07-09 18:45:04.518029052 +0000 UTC m=+1173.757373707"
Jul 09 18:46:00.012588 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:46:00.012538    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29727045-mw29r"]
Jul 09 18:46:00.013153 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:46:00.012842    2557 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29727045-mw29r" podUID="bc216ff8-dd75-45f6-9280-afab2f33f20f" containerName="cleanup" containerID="cri-o://3044fecc18585056caf429fe22501b49990f8136c30ac314f99eaae6d85465a5" gracePeriod=30
Jul 09 18:46:30.191913 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:46:30.191885    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29727045-mw29r"
Jul 09 18:46:30.318689 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:46:30.318635    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pwfdp\" (UniqueName: \"kubernetes.io/projected/bc216ff8-dd75-45f6-9280-afab2f33f20f-kube-api-access-pwfdp\") pod \"bc216ff8-dd75-45f6-9280-afab2f33f20f\" (UID: \"bc216ff8-dd75-45f6-9280-afab2f33f20f\") "
Jul 09 18:46:30.320847 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:46:30.320817    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bc216ff8-dd75-45f6-9280-afab2f33f20f-kube-api-access-pwfdp" (OuterVolumeSpecName: "kube-api-access-pwfdp") pod "bc216ff8-dd75-45f6-9280-afab2f33f20f" (UID: "bc216ff8-dd75-45f6-9280-afab2f33f20f"). InnerVolumeSpecName "kube-api-access-pwfdp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 18:46:30.419971 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:46:30.419919    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pwfdp\" (UniqueName: \"kubernetes.io/projected/bc216ff8-dd75-45f6-9280-afab2f33f20f-kube-api-access-pwfdp\") on node \"ip-10-0-141-101.ec2.internal\" DevicePath \"\""
Jul 09 18:46:30.978388 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:46:30.978355    2557 generic.go:356] "Generic (PLEG): container finished" podID="bc216ff8-dd75-45f6-9280-afab2f33f20f" containerID="3044fecc18585056caf429fe22501b49990f8136c30ac314f99eaae6d85465a5" exitCode=137
Jul 09 18:46:30.978611 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:46:30.978398    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29727045-mw29r"
Jul 09 18:46:30.978611 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:46:30.978436    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29727045-mw29r" event={"ID":"bc216ff8-dd75-45f6-9280-afab2f33f20f","Type":"ContainerDied","Data":"3044fecc18585056caf429fe22501b49990f8136c30ac314f99eaae6d85465a5"}
Jul 09 18:46:30.978611 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:46:30.978508    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29727045-mw29r" event={"ID":"bc216ff8-dd75-45f6-9280-afab2f33f20f","Type":"ContainerDied","Data":"1ef7476eda80e124c215a77e0a1757f41cc4d88f92c3e65e23a726e740380dc5"}
Jul 09 18:46:30.978611 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:46:30.978532    2557 scope.go:117] "RemoveContainer" containerID="3044fecc18585056caf429fe22501b49990f8136c30ac314f99eaae6d85465a5"
Jul 09 18:46:30.988069 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:46:30.988049    2557 scope.go:117] "RemoveContainer" containerID="3044fecc18585056caf429fe22501b49990f8136c30ac314f99eaae6d85465a5"
Jul 09 18:46:30.988333 ip-10-0-141-101 kubenswrapper[2557]: E0709 18:46:30.988315    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3044fecc18585056caf429fe22501b49990f8136c30ac314f99eaae6d85465a5\": container with ID starting with 3044fecc18585056caf429fe22501b49990f8136c30ac314f99eaae6d85465a5 not found: ID does not exist" containerID="3044fecc18585056caf429fe22501b49990f8136c30ac314f99eaae6d85465a5"
Jul 09 18:46:30.988380 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:46:30.988342    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3044fecc18585056caf429fe22501b49990f8136c30ac314f99eaae6d85465a5"} err="failed to get container status \"3044fecc18585056caf429fe22501b49990f8136c30ac314f99eaae6d85465a5\": rpc error: code = NotFound desc = could not find container \"3044fecc18585056caf429fe22501b49990f8136c30ac314f99eaae6d85465a5\": container with ID starting with 3044fecc18585056caf429fe22501b49990f8136c30ac314f99eaae6d85465a5 not found: ID does not exist"
Jul 09 18:46:31.006379 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:46:31.006350    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29727045-mw29r"]
Jul 09 18:46:31.009354 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:46:31.009331    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29727045-mw29r"]
Jul 09 18:46:31.262197 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:46:31.262162    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bc216ff8-dd75-45f6-9280-afab2f33f20f" path="/var/lib/kubelet/pods/bc216ff8-dd75-45f6-9280-afab2f33f20f/volumes"
Jul 09 18:50:56.693915 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:50:56.693834    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-037ceac9-openshift-default-7667d68c7c-cwqns"]
Jul 09 18:50:56.695973 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:50:56.694295    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bc216ff8-dd75-45f6-9280-afab2f33f20f" containerName="cleanup"
Jul 09 18:50:56.695973 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:50:56.694308    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="bc216ff8-dd75-45f6-9280-afab2f33f20f" containerName="cleanup"
Jul 09 18:50:56.695973 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:50:56.694368    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="bc216ff8-dd75-45f6-9280-afab2f33f20f" containerName="cleanup"
Jul 09 18:50:56.697427 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:50:56.697408    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-037ceac9-openshift-default-7667d68c7c-cwqns"
Jul 09 18:50:56.700724 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:50:56.700691    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-037ceac9-openshift-default-dockercfg-b2qnv\""
Jul 09 18:50:56.725551 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:50:56.725513    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-037ceac9-openshift-default-7667d68c7c-cwqns"]
Jul 09 18:50:56.788632 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:50:56.788586    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/49baeee9-6dfc-4820-8037-f5828c84cb44-workload-socket\") pod \"e2e-ait-037ceac9-openshift-default-7667d68c7c-cwqns\" (UID: \"49baeee9-6dfc-4820-8037-f5828c84cb44\") " pod="openshift-ingress/e2e-ait-037ceac9-openshift-default-7667d68c7c-cwqns"
Jul 09 18:50:56.788632 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:50:56.788631    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/49baeee9-6dfc-4820-8037-f5828c84cb44-credential-socket\") pod \"e2e-ait-037ceac9-openshift-default-7667d68c7c-cwqns\" (UID: \"49baeee9-6dfc-4820-8037-f5828c84cb44\") " pod="openshift-ingress/e2e-ait-037ceac9-openshift-default-7667d68c7c-cwqns"
Jul 09 18:50:56.788846 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:50:56.788649    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/49baeee9-6dfc-4820-8037-f5828c84cb44-workload-certs\") pod \"e2e-ait-037ceac9-openshift-default-7667d68c7c-cwqns\" (UID: \"49baeee9-6dfc-4820-8037-f5828c84cb44\") " pod="openshift-ingress/e2e-ait-037ceac9-openshift-default-7667d68c7c-cwqns"
Jul 09 18:50:56.788846 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:50:56.788674    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/49baeee9-6dfc-4820-8037-f5828c84cb44-istio-podinfo\") pod \"e2e-ait-037ceac9-openshift-default-7667d68c7c-cwqns\" (UID: \"49baeee9-6dfc-4820-8037-f5828c84cb44\") " pod="openshift-ingress/e2e-ait-037ceac9-openshift-default-7667d68c7c-cwqns"
Jul 09 18:50:56.788846 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:50:56.788727    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/49baeee9-6dfc-4820-8037-f5828c84cb44-istio-token\") pod \"e2e-ait-037ceac9-openshift-default-7667d68c7c-cwqns\" (UID: \"49baeee9-6dfc-4820-8037-f5828c84cb44\") " pod="openshift-ingress/e2e-ait-037ceac9-openshift-default-7667d68c7c-cwqns"
Jul 09 18:50:56.788846 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:50:56.788745    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/49baeee9-6dfc-4820-8037-f5828c84cb44-istiod-ca-cert\") pod \"e2e-ait-037ceac9-openshift-default-7667d68c7c-cwqns\" (UID: \"49baeee9-6dfc-4820-8037-f5828c84cb44\") " pod="openshift-ingress/e2e-ait-037ceac9-openshift-default-7667d68c7c-cwqns"
Jul 09 18:50:56.788846 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:50:56.788794    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-54v9p\" (UniqueName: \"kubernetes.io/projected/49baeee9-6dfc-4820-8037-f5828c84cb44-kube-api-access-54v9p\") pod \"e2e-ait-037ceac9-openshift-default-7667d68c7c-cwqns\" (UID: \"49baeee9-6dfc-4820-8037-f5828c84cb44\") " pod="openshift-ingress/e2e-ait-037ceac9-openshift-default-7667d68c7c-cwqns"
Jul 09 18:50:56.788846 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:50:56.788818    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/49baeee9-6dfc-4820-8037-f5828c84cb44-istio-envoy\") pod \"e2e-ait-037ceac9-openshift-default-7667d68c7c-cwqns\" (UID: \"49baeee9-6dfc-4820-8037-f5828c84cb44\") " pod="openshift-ingress/e2e-ait-037ceac9-openshift-default-7667d68c7c-cwqns"
Jul 09 18:50:56.789050 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:50:56.788854    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/49baeee9-6dfc-4820-8037-f5828c84cb44-istio-data\") pod \"e2e-ait-037ceac9-openshift-default-7667d68c7c-cwqns\" (UID: \"49baeee9-6dfc-4820-8037-f5828c84cb44\") " pod="openshift-ingress/e2e-ait-037ceac9-openshift-default-7667d68c7c-cwqns"
Jul 09 18:50:56.889707 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:50:56.889673    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/49baeee9-6dfc-4820-8037-f5828c84cb44-credential-socket\") pod \"e2e-ait-037ceac9-openshift-default-7667d68c7c-cwqns\" (UID: \"49baeee9-6dfc-4820-8037-f5828c84cb44\") " pod="openshift-ingress/e2e-ait-037ceac9-openshift-default-7667d68c7c-cwqns"
Jul 09 18:50:56.889707 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:50:56.889707    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/49baeee9-6dfc-4820-8037-f5828c84cb44-workload-certs\") pod \"e2e-ait-037ceac9-openshift-default-7667d68c7c-cwqns\" (UID: \"49baeee9-6dfc-4820-8037-f5828c84cb44\") " pod="openshift-ingress/e2e-ait-037ceac9-openshift-default-7667d68c7c-cwqns"
Jul 09 18:50:56.889927 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:50:56.889723    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/49baeee9-6dfc-4820-8037-f5828c84cb44-istio-podinfo\") pod \"e2e-ait-037ceac9-openshift-default-7667d68c7c-cwqns\" (UID: \"49baeee9-6dfc-4820-8037-f5828c84cb44\") " pod="openshift-ingress/e2e-ait-037ceac9-openshift-default-7667d68c7c-cwqns"
Jul 09 18:50:56.889927 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:50:56.889791    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/49baeee9-6dfc-4820-8037-f5828c84cb44-istio-token\") pod \"e2e-ait-037ceac9-openshift-default-7667d68c7c-cwqns\" (UID: \"49baeee9-6dfc-4820-8037-f5828c84cb44\") " pod="openshift-ingress/e2e-ait-037ceac9-openshift-default-7667d68c7c-cwqns"
Jul 09 18:50:56.889927 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:50:56.889818    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/49baeee9-6dfc-4820-8037-f5828c84cb44-istiod-ca-cert\") pod \"e2e-ait-037ceac9-openshift-default-7667d68c7c-cwqns\" (UID: \"49baeee9-6dfc-4820-8037-f5828c84cb44\") " pod="openshift-ingress/e2e-ait-037ceac9-openshift-default-7667d68c7c-cwqns"
Jul 09 18:50:56.890084 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:50:56.889973    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-54v9p\" (UniqueName: \"kubernetes.io/projected/49baeee9-6dfc-4820-8037-f5828c84cb44-kube-api-access-54v9p\") pod \"e2e-ait-037ceac9-openshift-default-7667d68c7c-cwqns\" (UID: \"49baeee9-6dfc-4820-8037-f5828c84cb44\") " pod="openshift-ingress/e2e-ait-037ceac9-openshift-default-7667d68c7c-cwqns"
Jul 09 18:50:56.890084 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:50:56.890035    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/49baeee9-6dfc-4820-8037-f5828c84cb44-istio-envoy\") pod \"e2e-ait-037ceac9-openshift-default-7667d68c7c-cwqns\" (UID: \"49baeee9-6dfc-4820-8037-f5828c84cb44\") " pod="openshift-ingress/e2e-ait-037ceac9-openshift-default-7667d68c7c-cwqns"
Jul 09 18:50:56.890192 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:50:56.890121    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/49baeee9-6dfc-4820-8037-f5828c84cb44-istio-data\") pod \"e2e-ait-037ceac9-openshift-default-7667d68c7c-cwqns\" (UID: \"49baeee9-6dfc-4820-8037-f5828c84cb44\") " pod="openshift-ingress/e2e-ait-037ceac9-openshift-default-7667d68c7c-cwqns"
Jul 09 18:50:56.890192 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:50:56.890130    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/49baeee9-6dfc-4820-8037-f5828c84cb44-credential-socket\") pod \"e2e-ait-037ceac9-openshift-default-7667d68c7c-cwqns\" (UID: \"49baeee9-6dfc-4820-8037-f5828c84cb44\") " pod="openshift-ingress/e2e-ait-037ceac9-openshift-default-7667d68c7c-cwqns"
Jul 09 18:50:56.890192 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:50:56.890168    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/49baeee9-6dfc-4820-8037-f5828c84cb44-workload-certs\") pod \"e2e-ait-037ceac9-openshift-default-7667d68c7c-cwqns\" (UID: \"49baeee9-6dfc-4820-8037-f5828c84cb44\") " pod="openshift-ingress/e2e-ait-037ceac9-openshift-default-7667d68c7c-cwqns"
Jul 09 18:50:56.890352 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:50:56.890195    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/49baeee9-6dfc-4820-8037-f5828c84cb44-workload-socket\") pod \"e2e-ait-037ceac9-openshift-default-7667d68c7c-cwqns\" (UID: \"49baeee9-6dfc-4820-8037-f5828c84cb44\") " pod="openshift-ingress/e2e-ait-037ceac9-openshift-default-7667d68c7c-cwqns"
Jul 09 18:50:56.890526 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:50:56.890509    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/49baeee9-6dfc-4820-8037-f5828c84cb44-istio-data\") pod \"e2e-ait-037ceac9-openshift-default-7667d68c7c-cwqns\" (UID: \"49baeee9-6dfc-4820-8037-f5828c84cb44\") " pod="openshift-ingress/e2e-ait-037ceac9-openshift-default-7667d68c7c-cwqns"
Jul 09 18:50:56.890608 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:50:56.890527    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/49baeee9-6dfc-4820-8037-f5828c84cb44-istiod-ca-cert\") pod \"e2e-ait-037ceac9-openshift-default-7667d68c7c-cwqns\" (UID: \"49baeee9-6dfc-4820-8037-f5828c84cb44\") " pod="openshift-ingress/e2e-ait-037ceac9-openshift-default-7667d68c7c-cwqns"
Jul 09 18:50:56.890608 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:50:56.890588    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/49baeee9-6dfc-4820-8037-f5828c84cb44-workload-socket\") pod \"e2e-ait-037ceac9-openshift-default-7667d68c7c-cwqns\" (UID: \"49baeee9-6dfc-4820-8037-f5828c84cb44\") " pod="openshift-ingress/e2e-ait-037ceac9-openshift-default-7667d68c7c-cwqns"
Jul 09 18:50:56.892214 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:50:56.892196    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/49baeee9-6dfc-4820-8037-f5828c84cb44-istio-podinfo\") pod \"e2e-ait-037ceac9-openshift-default-7667d68c7c-cwqns\" (UID: \"49baeee9-6dfc-4820-8037-f5828c84cb44\") " pod="openshift-ingress/e2e-ait-037ceac9-openshift-default-7667d68c7c-cwqns"
Jul 09 18:50:56.892307 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:50:56.892232    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/49baeee9-6dfc-4820-8037-f5828c84cb44-istio-envoy\") pod \"e2e-ait-037ceac9-openshift-default-7667d68c7c-cwqns\" (UID: \"49baeee9-6dfc-4820-8037-f5828c84cb44\") " pod="openshift-ingress/e2e-ait-037ceac9-openshift-default-7667d68c7c-cwqns"
Jul 09 18:50:56.899372 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:50:56.899347    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/49baeee9-6dfc-4820-8037-f5828c84cb44-istio-token\") pod \"e2e-ait-037ceac9-openshift-default-7667d68c7c-cwqns\" (UID: \"49baeee9-6dfc-4820-8037-f5828c84cb44\") " pod="openshift-ingress/e2e-ait-037ceac9-openshift-default-7667d68c7c-cwqns"
Jul 09 18:50:56.899553 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:50:56.899532    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-54v9p\" (UniqueName: \"kubernetes.io/projected/49baeee9-6dfc-4820-8037-f5828c84cb44-kube-api-access-54v9p\") pod \"e2e-ait-037ceac9-openshift-default-7667d68c7c-cwqns\" (UID: \"49baeee9-6dfc-4820-8037-f5828c84cb44\") " pod="openshift-ingress/e2e-ait-037ceac9-openshift-default-7667d68c7c-cwqns"
Jul 09 18:50:57.008768 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:50:57.008675    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-037ceac9-openshift-default-7667d68c7c-cwqns"
Jul 09 18:50:57.157454 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:50:57.157424    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-037ceac9-openshift-default-7667d68c7c-cwqns"]
Jul 09 18:50:57.158601 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:50:57.158560    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod49baeee9_6dfc_4820_8037_f5828c84cb44.slice/crio-a1981664b3fef61e5c1118d379a13031c15b86baf122c0ae7e34729cbc044251 WatchSource:0}: Error finding container a1981664b3fef61e5c1118d379a13031c15b86baf122c0ae7e34729cbc044251: Status 404 returned error can't find the container with id a1981664b3fef61e5c1118d379a13031c15b86baf122c0ae7e34729cbc044251
Jul 09 18:50:57.160695 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:50:57.160661    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 09 18:50:57.160769 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:50:57.160735    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 09 18:50:57.160769 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:50:57.160764    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 09 18:50:57.475351 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:50:57.475314    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-037ceac9-openshift-default-7667d68c7c-cwqns" event={"ID":"49baeee9-6dfc-4820-8037-f5828c84cb44","Type":"ContainerStarted","Data":"828b13335344fb703432820511f63cefc127b47586d613f075bb88b331253a9b"}
Jul 09 18:50:57.475559 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:50:57.475370    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-037ceac9-openshift-default-7667d68c7c-cwqns" event={"ID":"49baeee9-6dfc-4820-8037-f5828c84cb44","Type":"ContainerStarted","Data":"a1981664b3fef61e5c1118d379a13031c15b86baf122c0ae7e34729cbc044251"}
Jul 09 18:50:57.506776 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:50:57.506717    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-037ceac9-openshift-default-7667d68c7c-cwqns" podStartSLOduration=1.5066964870000001 podStartE2EDuration="1.506696487s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 18:50:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 18:50:57.505535126 +0000 UTC m=+1526.744879751" watchObservedRunningTime="2026-07-09 18:50:57.506696487 +0000 UTC m=+1526.746041116"
Jul 09 18:50:58.009004 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:50:58.008969    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-037ceac9-openshift-default-7667d68c7c-cwqns"
Jul 09 18:50:58.013634 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:50:58.013612    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-037ceac9-openshift-default-7667d68c7c-cwqns"
Jul 09 18:50:58.481539 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:50:58.481513    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-037ceac9-openshift-default-7667d68c7c-cwqns"
Jul 09 18:50:58.482474 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:50:58.482456    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-037ceac9-openshift-default-7667d68c7c-cwqns"
Jul 09 18:51:03.071403 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:51:03.071365    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-037ceac9-openshift-default-7667d68c7c-cwqns"]
Jul 09 18:51:03.071876 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:51:03.071555    2557 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-037ceac9-openshift-default-7667d68c7c-cwqns" podUID="49baeee9-6dfc-4820-8037-f5828c84cb44" containerName="istio-proxy" containerID="cri-o://828b13335344fb703432820511f63cefc127b47586d613f075bb88b331253a9b" gracePeriod=30
Jul 09 18:51:08.340589 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:51:08.340521    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-037ceac9-openshift-default-7667d68c7c-cwqns"
Jul 09 18:51:08.401930 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:51:08.401898    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/49baeee9-6dfc-4820-8037-f5828c84cb44-istio-token\") pod \"49baeee9-6dfc-4820-8037-f5828c84cb44\" (UID: \"49baeee9-6dfc-4820-8037-f5828c84cb44\") "
Jul 09 18:51:08.402081 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:51:08.401962    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/49baeee9-6dfc-4820-8037-f5828c84cb44-workload-certs\") pod \"49baeee9-6dfc-4820-8037-f5828c84cb44\" (UID: \"49baeee9-6dfc-4820-8037-f5828c84cb44\") "
Jul 09 18:51:08.402081 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:51:08.401978    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/49baeee9-6dfc-4820-8037-f5828c84cb44-istiod-ca-cert\") pod \"49baeee9-6dfc-4820-8037-f5828c84cb44\" (UID: \"49baeee9-6dfc-4820-8037-f5828c84cb44\") "
Jul 09 18:51:08.402081 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:51:08.402003    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/49baeee9-6dfc-4820-8037-f5828c84cb44-istio-data\") pod \"49baeee9-6dfc-4820-8037-f5828c84cb44\" (UID: \"49baeee9-6dfc-4820-8037-f5828c84cb44\") "
Jul 09 18:51:08.402081 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:51:08.402023    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-54v9p\" (UniqueName: \"kubernetes.io/projected/49baeee9-6dfc-4820-8037-f5828c84cb44-kube-api-access-54v9p\") pod \"49baeee9-6dfc-4820-8037-f5828c84cb44\" (UID: \"49baeee9-6dfc-4820-8037-f5828c84cb44\") "
Jul 09 18:51:08.402081 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:51:08.402050    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/49baeee9-6dfc-4820-8037-f5828c84cb44-istio-podinfo\") pod \"49baeee9-6dfc-4820-8037-f5828c84cb44\" (UID: \"49baeee9-6dfc-4820-8037-f5828c84cb44\") "
Jul 09 18:51:08.402081 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:51:08.402064    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/49baeee9-6dfc-4820-8037-f5828c84cb44-istio-envoy\") pod \"49baeee9-6dfc-4820-8037-f5828c84cb44\" (UID: \"49baeee9-6dfc-4820-8037-f5828c84cb44\") "
Jul 09 18:51:08.402408 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:51:08.402135    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/49baeee9-6dfc-4820-8037-f5828c84cb44-workload-socket\") pod \"49baeee9-6dfc-4820-8037-f5828c84cb44\" (UID: \"49baeee9-6dfc-4820-8037-f5828c84cb44\") "
Jul 09 18:51:08.402408 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:51:08.402164    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/49baeee9-6dfc-4820-8037-f5828c84cb44-credential-socket\") pod \"49baeee9-6dfc-4820-8037-f5828c84cb44\" (UID: \"49baeee9-6dfc-4820-8037-f5828c84cb44\") "
Jul 09 18:51:08.402408 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:51:08.402293    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/49baeee9-6dfc-4820-8037-f5828c84cb44-istio-data" (OuterVolumeSpecName: "istio-data") pod "49baeee9-6dfc-4820-8037-f5828c84cb44" (UID: "49baeee9-6dfc-4820-8037-f5828c84cb44"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 18:51:08.402408 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:51:08.402301    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/49baeee9-6dfc-4820-8037-f5828c84cb44-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "49baeee9-6dfc-4820-8037-f5828c84cb44" (UID: "49baeee9-6dfc-4820-8037-f5828c84cb44"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 18:51:08.402647 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:51:08.402527    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/49baeee9-6dfc-4820-8037-f5828c84cb44-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "49baeee9-6dfc-4820-8037-f5828c84cb44" (UID: "49baeee9-6dfc-4820-8037-f5828c84cb44"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 18:51:08.402647 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:51:08.402568    2557 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/49baeee9-6dfc-4820-8037-f5828c84cb44-workload-certs\") on node \"ip-10-0-141-101.ec2.internal\" DevicePath \"\""
Jul 09 18:51:08.402647 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:51:08.402585    2557 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/49baeee9-6dfc-4820-8037-f5828c84cb44-istio-data\") on node \"ip-10-0-141-101.ec2.internal\" DevicePath \"\""
Jul 09 18:51:08.402647 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:51:08.402607    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/49baeee9-6dfc-4820-8037-f5828c84cb44-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "49baeee9-6dfc-4820-8037-f5828c84cb44" (UID: "49baeee9-6dfc-4820-8037-f5828c84cb44"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 09 18:51:08.402647 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:51:08.402615    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/49baeee9-6dfc-4820-8037-f5828c84cb44-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "49baeee9-6dfc-4820-8037-f5828c84cb44" (UID: "49baeee9-6dfc-4820-8037-f5828c84cb44"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 18:51:08.404206 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:51:08.404173    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/49baeee9-6dfc-4820-8037-f5828c84cb44-istio-token" (OuterVolumeSpecName: "istio-token") pod "49baeee9-6dfc-4820-8037-f5828c84cb44" (UID: "49baeee9-6dfc-4820-8037-f5828c84cb44"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 18:51:08.404344 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:51:08.404215    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/49baeee9-6dfc-4820-8037-f5828c84cb44-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "49baeee9-6dfc-4820-8037-f5828c84cb44" (UID: "49baeee9-6dfc-4820-8037-f5828c84cb44"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 09 18:51:08.404536 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:51:08.404519    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/49baeee9-6dfc-4820-8037-f5828c84cb44-kube-api-access-54v9p" (OuterVolumeSpecName: "kube-api-access-54v9p") pod "49baeee9-6dfc-4820-8037-f5828c84cb44" (UID: "49baeee9-6dfc-4820-8037-f5828c84cb44"). InnerVolumeSpecName "kube-api-access-54v9p". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 18:51:08.404611 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:51:08.404592    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/49baeee9-6dfc-4820-8037-f5828c84cb44-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "49baeee9-6dfc-4820-8037-f5828c84cb44" (UID: "49baeee9-6dfc-4820-8037-f5828c84cb44"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 18:51:08.503029 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:51:08.502989    2557 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/49baeee9-6dfc-4820-8037-f5828c84cb44-istiod-ca-cert\") on node \"ip-10-0-141-101.ec2.internal\" DevicePath \"\""
Jul 09 18:51:08.503029 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:51:08.503025    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-54v9p\" (UniqueName: \"kubernetes.io/projected/49baeee9-6dfc-4820-8037-f5828c84cb44-kube-api-access-54v9p\") on node \"ip-10-0-141-101.ec2.internal\" DevicePath \"\""
Jul 09 18:51:08.503029 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:51:08.503035    2557 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/49baeee9-6dfc-4820-8037-f5828c84cb44-istio-podinfo\") on node \"ip-10-0-141-101.ec2.internal\" DevicePath \"\""
Jul 09 18:51:08.503269 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:51:08.503043    2557 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/49baeee9-6dfc-4820-8037-f5828c84cb44-istio-envoy\") on node \"ip-10-0-141-101.ec2.internal\" DevicePath \"\""
Jul 09 18:51:08.503269 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:51:08.503052    2557 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/49baeee9-6dfc-4820-8037-f5828c84cb44-workload-socket\") on node \"ip-10-0-141-101.ec2.internal\" DevicePath \"\""
Jul 09 18:51:08.503269 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:51:08.503060    2557 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/49baeee9-6dfc-4820-8037-f5828c84cb44-credential-socket\") on node \"ip-10-0-141-101.ec2.internal\" DevicePath \"\""
Jul 09 18:51:08.503269 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:51:08.503068    2557 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/49baeee9-6dfc-4820-8037-f5828c84cb44-istio-token\") on node \"ip-10-0-141-101.ec2.internal\" DevicePath \"\""
Jul 09 18:51:08.539638 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:51:08.539604    2557 generic.go:356] "Generic (PLEG): container finished" podID="49baeee9-6dfc-4820-8037-f5828c84cb44" containerID="828b13335344fb703432820511f63cefc127b47586d613f075bb88b331253a9b" exitCode=0
Jul 09 18:51:08.539806 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:51:08.539663    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-037ceac9-openshift-default-7667d68c7c-cwqns"
Jul 09 18:51:08.539806 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:51:08.539685    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-037ceac9-openshift-default-7667d68c7c-cwqns" event={"ID":"49baeee9-6dfc-4820-8037-f5828c84cb44","Type":"ContainerDied","Data":"828b13335344fb703432820511f63cefc127b47586d613f075bb88b331253a9b"}
Jul 09 18:51:08.539806 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:51:08.539747    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-037ceac9-openshift-default-7667d68c7c-cwqns" event={"ID":"49baeee9-6dfc-4820-8037-f5828c84cb44","Type":"ContainerDied","Data":"a1981664b3fef61e5c1118d379a13031c15b86baf122c0ae7e34729cbc044251"}
Jul 09 18:51:08.539806 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:51:08.539778    2557 scope.go:117] "RemoveContainer" containerID="828b13335344fb703432820511f63cefc127b47586d613f075bb88b331253a9b"
Jul 09 18:51:08.550295 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:51:08.550278    2557 scope.go:117] "RemoveContainer" containerID="828b13335344fb703432820511f63cefc127b47586d613f075bb88b331253a9b"
Jul 09 18:51:08.550608 ip-10-0-141-101 kubenswrapper[2557]: E0709 18:51:08.550587    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"828b13335344fb703432820511f63cefc127b47586d613f075bb88b331253a9b\": container with ID starting with 828b13335344fb703432820511f63cefc127b47586d613f075bb88b331253a9b not found: ID does not exist" containerID="828b13335344fb703432820511f63cefc127b47586d613f075bb88b331253a9b"
Jul 09 18:51:08.550679 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:51:08.550616    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"828b13335344fb703432820511f63cefc127b47586d613f075bb88b331253a9b"} err="failed to get container status \"828b13335344fb703432820511f63cefc127b47586d613f075bb88b331253a9b\": rpc error: code = NotFound desc = could not find container \"828b13335344fb703432820511f63cefc127b47586d613f075bb88b331253a9b\": container with ID starting with 828b13335344fb703432820511f63cefc127b47586d613f075bb88b331253a9b not found: ID does not exist"
Jul 09 18:51:08.566236 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:51:08.566202    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-037ceac9-openshift-default-7667d68c7c-cwqns"]
Jul 09 18:51:08.570564 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:51:08.570541    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-037ceac9-openshift-default-7667d68c7c-cwqns"]
Jul 09 18:51:09.263066 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:51:09.263034    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="49baeee9-6dfc-4820-8037-f5828c84cb44" path="/var/lib/kubelet/pods/49baeee9-6dfc-4820-8037-f5828c84cb44/volumes"
Jul 09 18:51:11.575175 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:51:11.575137    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-d8a1de1a-84fbb87559-gqt47"]
Jul 09 18:51:11.575813 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:51:11.575792    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="49baeee9-6dfc-4820-8037-f5828c84cb44" containerName="istio-proxy"
Jul 09 18:51:11.575901 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:51:11.575817    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="49baeee9-6dfc-4820-8037-f5828c84cb44" containerName="istio-proxy"
Jul 09 18:51:11.575964 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:51:11.575914    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="49baeee9-6dfc-4820-8037-f5828c84cb44" containerName="istio-proxy"
Jul 09 18:51:11.581096 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:51:11.581074    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-d8a1de1a-84fbb87559-gqt47"
Jul 09 18:51:11.584893 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:51:11.584872    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-migrate-d8a1de1a-serving-cert\""
Jul 09 18:51:11.585204 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:51:11.585185    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 09 18:51:11.585452 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:51:11.585435    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-4zbc4\""
Jul 09 18:51:11.586500 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:51:11.585923    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 09 18:51:11.602936 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:51:11.602001    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-d8a1de1a-84fbb87559-gqt47"]
Jul 09 18:51:11.629120 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:51:11.629088    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/93c42b66-d711-4cb2-9795-29720121fd3f-maas-api-tls\") pod \"maas-api-e2e-migrate-d8a1de1a-84fbb87559-gqt47\" (UID: \"93c42b66-d711-4cb2-9795-29720121fd3f\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-d8a1de1a-84fbb87559-gqt47"
Jul 09 18:51:11.629313 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:51:11.629152    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c9k56\" (UniqueName: \"kubernetes.io/projected/93c42b66-d711-4cb2-9795-29720121fd3f-kube-api-access-c9k56\") pod \"maas-api-e2e-migrate-d8a1de1a-84fbb87559-gqt47\" (UID: \"93c42b66-d711-4cb2-9795-29720121fd3f\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-d8a1de1a-84fbb87559-gqt47"
Jul 09 18:51:11.629313 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:51:11.629210    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/93c42b66-d711-4cb2-9795-29720121fd3f-openshift-service-ca\") pod \"maas-api-e2e-migrate-d8a1de1a-84fbb87559-gqt47\" (UID: \"93c42b66-d711-4cb2-9795-29720121fd3f\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-d8a1de1a-84fbb87559-gqt47"
Jul 09 18:51:11.730432 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:51:11.730384    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/93c42b66-d711-4cb2-9795-29720121fd3f-maas-api-tls\") pod \"maas-api-e2e-migrate-d8a1de1a-84fbb87559-gqt47\" (UID: \"93c42b66-d711-4cb2-9795-29720121fd3f\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-d8a1de1a-84fbb87559-gqt47"
Jul 09 18:51:11.730655 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:51:11.730469    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c9k56\" (UniqueName: \"kubernetes.io/projected/93c42b66-d711-4cb2-9795-29720121fd3f-kube-api-access-c9k56\") pod \"maas-api-e2e-migrate-d8a1de1a-84fbb87559-gqt47\" (UID: \"93c42b66-d711-4cb2-9795-29720121fd3f\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-d8a1de1a-84fbb87559-gqt47"
Jul 09 18:51:11.730655 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:51:11.730566    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/93c42b66-d711-4cb2-9795-29720121fd3f-openshift-service-ca\") pod \"maas-api-e2e-migrate-d8a1de1a-84fbb87559-gqt47\" (UID: \"93c42b66-d711-4cb2-9795-29720121fd3f\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-d8a1de1a-84fbb87559-gqt47"
Jul 09 18:51:11.731326 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:51:11.731301    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/93c42b66-d711-4cb2-9795-29720121fd3f-openshift-service-ca\") pod \"maas-api-e2e-migrate-d8a1de1a-84fbb87559-gqt47\" (UID: \"93c42b66-d711-4cb2-9795-29720121fd3f\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-d8a1de1a-84fbb87559-gqt47"
Jul 09 18:51:11.733075 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:51:11.733051    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/93c42b66-d711-4cb2-9795-29720121fd3f-maas-api-tls\") pod \"maas-api-e2e-migrate-d8a1de1a-84fbb87559-gqt47\" (UID: \"93c42b66-d711-4cb2-9795-29720121fd3f\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-d8a1de1a-84fbb87559-gqt47"
Jul 09 18:51:11.746340 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:51:11.746314    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c9k56\" (UniqueName: \"kubernetes.io/projected/93c42b66-d711-4cb2-9795-29720121fd3f-kube-api-access-c9k56\") pod \"maas-api-e2e-migrate-d8a1de1a-84fbb87559-gqt47\" (UID: \"93c42b66-d711-4cb2-9795-29720121fd3f\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-d8a1de1a-84fbb87559-gqt47"
Jul 09 18:51:11.900399 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:51:11.900307    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-d8a1de1a-84fbb87559-gqt47"
Jul 09 18:51:12.085018 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:51:12.084963    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-d8a1de1a-84fbb87559-gqt47"]
Jul 09 18:51:12.088116 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:51:12.088078    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod93c42b66_d711_4cb2_9795_29720121fd3f.slice/crio-060a477edc890e65d01dbaac91c5c6205632986fffcbd32c08e127a685b70112 WatchSource:0}: Error finding container 060a477edc890e65d01dbaac91c5c6205632986fffcbd32c08e127a685b70112: Status 404 returned error can't find the container with id 060a477edc890e65d01dbaac91c5c6205632986fffcbd32c08e127a685b70112
Jul 09 18:51:12.089538 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:51:12.089517    2557 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 09 18:51:12.564960 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:51:12.564924    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-d8a1de1a-84fbb87559-gqt47" event={"ID":"93c42b66-d711-4cb2-9795-29720121fd3f","Type":"ContainerStarted","Data":"060a477edc890e65d01dbaac91c5c6205632986fffcbd32c08e127a685b70112"}
Jul 09 18:51:14.580131 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:51:14.580094    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-d8a1de1a-84fbb87559-gqt47" event={"ID":"93c42b66-d711-4cb2-9795-29720121fd3f","Type":"ContainerStarted","Data":"b48fc8fc8ee920a330c1b8df3e7a5228a39feff6cb794d3c2716343c5fd71479"}
Jul 09 18:51:14.580515 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:51:14.580163    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-d8a1de1a-84fbb87559-gqt47"
Jul 09 18:51:14.601915 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:51:14.601871    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-d8a1de1a-84fbb87559-gqt47" podStartSLOduration=1.926972268 podStartE2EDuration="3.601857952s" totalImagesPullingTime="1.674885684s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 18:51:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 18:51:14.600613372 +0000 UTC m=+1543.839958024" watchObservedRunningTime="2026-07-09 18:51:14.601857952 +0000 UTC m=+1543.841202577"
Jul 09 18:51:16.234658 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:51:16.234626    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-d8a1de1a-84fbb87559-gqt47"]
Jul 09 18:51:16.594275 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:51:16.594212    2557 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-d8a1de1a-84fbb87559-gqt47" podUID="93c42b66-d711-4cb2-9795-29720121fd3f" containerName="maas-api" containerID="cri-o://b48fc8fc8ee920a330c1b8df3e7a5228a39feff6cb794d3c2716343c5fd71479" gracePeriod=30
Jul 09 18:51:16.856114 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:51:16.856054    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-d8a1de1a-84fbb87559-gqt47"
Jul 09 18:51:16.876552 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:51:16.876527    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-c9k56\" (UniqueName: \"kubernetes.io/projected/93c42b66-d711-4cb2-9795-29720121fd3f-kube-api-access-c9k56\") pod \"93c42b66-d711-4cb2-9795-29720121fd3f\" (UID: \"93c42b66-d711-4cb2-9795-29720121fd3f\") "
Jul 09 18:51:16.876718 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:51:16.876596    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/93c42b66-d711-4cb2-9795-29720121fd3f-maas-api-tls\") pod \"93c42b66-d711-4cb2-9795-29720121fd3f\" (UID: \"93c42b66-d711-4cb2-9795-29720121fd3f\") "
Jul 09 18:51:16.876718 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:51:16.876628    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/93c42b66-d711-4cb2-9795-29720121fd3f-openshift-service-ca\") pod \"93c42b66-d711-4cb2-9795-29720121fd3f\" (UID: \"93c42b66-d711-4cb2-9795-29720121fd3f\") "
Jul 09 18:51:16.877065 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:51:16.877035    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/93c42b66-d711-4cb2-9795-29720121fd3f-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "93c42b66-d711-4cb2-9795-29720121fd3f" (UID: "93c42b66-d711-4cb2-9795-29720121fd3f"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 09 18:51:16.878812 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:51:16.878778    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/93c42b66-d711-4cb2-9795-29720121fd3f-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "93c42b66-d711-4cb2-9795-29720121fd3f" (UID: "93c42b66-d711-4cb2-9795-29720121fd3f"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 18:51:16.878912 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:51:16.878844    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/93c42b66-d711-4cb2-9795-29720121fd3f-kube-api-access-c9k56" (OuterVolumeSpecName: "kube-api-access-c9k56") pod "93c42b66-d711-4cb2-9795-29720121fd3f" (UID: "93c42b66-d711-4cb2-9795-29720121fd3f"). InnerVolumeSpecName "kube-api-access-c9k56". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 18:51:16.977891 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:51:16.977854    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-c9k56\" (UniqueName: \"kubernetes.io/projected/93c42b66-d711-4cb2-9795-29720121fd3f-kube-api-access-c9k56\") on node \"ip-10-0-141-101.ec2.internal\" DevicePath \"\""
Jul 09 18:51:16.977891 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:51:16.977885    2557 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/93c42b66-d711-4cb2-9795-29720121fd3f-maas-api-tls\") on node \"ip-10-0-141-101.ec2.internal\" DevicePath \"\""
Jul 09 18:51:16.977891 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:51:16.977894    2557 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/93c42b66-d711-4cb2-9795-29720121fd3f-openshift-service-ca\") on node \"ip-10-0-141-101.ec2.internal\" DevicePath \"\""
Jul 09 18:51:17.600721 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:51:17.600684    2557 generic.go:356] "Generic (PLEG): container finished" podID="93c42b66-d711-4cb2-9795-29720121fd3f" containerID="b48fc8fc8ee920a330c1b8df3e7a5228a39feff6cb794d3c2716343c5fd71479" exitCode=0
Jul 09 18:51:17.601206 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:51:17.600726    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-d8a1de1a-84fbb87559-gqt47"
Jul 09 18:51:17.601206 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:51:17.600763    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-d8a1de1a-84fbb87559-gqt47" event={"ID":"93c42b66-d711-4cb2-9795-29720121fd3f","Type":"ContainerDied","Data":"b48fc8fc8ee920a330c1b8df3e7a5228a39feff6cb794d3c2716343c5fd71479"}
Jul 09 18:51:17.601206 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:51:17.600811    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-d8a1de1a-84fbb87559-gqt47" event={"ID":"93c42b66-d711-4cb2-9795-29720121fd3f","Type":"ContainerDied","Data":"060a477edc890e65d01dbaac91c5c6205632986fffcbd32c08e127a685b70112"}
Jul 09 18:51:17.601206 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:51:17.600832    2557 scope.go:117] "RemoveContainer" containerID="b48fc8fc8ee920a330c1b8df3e7a5228a39feff6cb794d3c2716343c5fd71479"
Jul 09 18:51:17.609689 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:51:17.609663    2557 scope.go:117] "RemoveContainer" containerID="b48fc8fc8ee920a330c1b8df3e7a5228a39feff6cb794d3c2716343c5fd71479"
Jul 09 18:51:17.609957 ip-10-0-141-101 kubenswrapper[2557]: E0709 18:51:17.609939    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b48fc8fc8ee920a330c1b8df3e7a5228a39feff6cb794d3c2716343c5fd71479\": container with ID starting with b48fc8fc8ee920a330c1b8df3e7a5228a39feff6cb794d3c2716343c5fd71479 not found: ID does not exist" containerID="b48fc8fc8ee920a330c1b8df3e7a5228a39feff6cb794d3c2716343c5fd71479"
Jul 09 18:51:17.610017 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:51:17.609972    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b48fc8fc8ee920a330c1b8df3e7a5228a39feff6cb794d3c2716343c5fd71479"} err="failed to get container status \"b48fc8fc8ee920a330c1b8df3e7a5228a39feff6cb794d3c2716343c5fd71479\": rpc error: code = NotFound desc = could not find container \"b48fc8fc8ee920a330c1b8df3e7a5228a39feff6cb794d3c2716343c5fd71479\": container with ID starting with b48fc8fc8ee920a330c1b8df3e7a5228a39feff6cb794d3c2716343c5fd71479 not found: ID does not exist"
Jul 09 18:51:17.619206 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:51:17.619175    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-d8a1de1a-84fbb87559-gqt47"]
Jul 09 18:51:17.623137 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:51:17.623118    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-d8a1de1a-84fbb87559-gqt47"]
Jul 09 18:51:19.262663 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:51:19.262628    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="93c42b66-d711-4cb2-9795-29720121fd3f" path="/var/lib/kubelet/pods/93c42b66-d711-4cb2-9795-29720121fd3f/volumes"
Jul 09 18:51:22.898777 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:51:22.898741    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-ca76790c-openshift-default-58d84cd75f-9kgm4"]
Jul 09 18:51:22.899250 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:51:22.899177    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="93c42b66-d711-4cb2-9795-29720121fd3f" containerName="maas-api"
Jul 09 18:51:22.899250 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:51:22.899189    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="93c42b66-d711-4cb2-9795-29720121fd3f" containerName="maas-api"
Jul 09 18:51:22.899329 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:51:22.899273    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="93c42b66-d711-4cb2-9795-29720121fd3f" containerName="maas-api"
Jul 09 18:51:22.903742 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:51:22.903721    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-ca76790c-openshift-default-58d84cd75f-9kgm4"
Jul 09 18:51:22.906816 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:51:22.906788    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-ca76790c-openshift-default-dockercfg-g94sp\""
Jul 09 18:51:22.916085 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:51:22.916057    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-ca76790c-openshift-default-58d84cd75f-9kgm4"]
Jul 09 18:51:22.934097 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:51:22.934060    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gntz9\" (UniqueName: \"kubernetes.io/projected/beda4125-9e6a-40be-842c-15bb410b19f1-kube-api-access-gntz9\") pod \"e2e-ait-ca76790c-openshift-default-58d84cd75f-9kgm4\" (UID: \"beda4125-9e6a-40be-842c-15bb410b19f1\") " pod="openshift-ingress/e2e-ait-ca76790c-openshift-default-58d84cd75f-9kgm4"
Jul 09 18:51:22.934258 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:51:22.934103    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/beda4125-9e6a-40be-842c-15bb410b19f1-istio-podinfo\") pod \"e2e-ait-ca76790c-openshift-default-58d84cd75f-9kgm4\" (UID: \"beda4125-9e6a-40be-842c-15bb410b19f1\") " pod="openshift-ingress/e2e-ait-ca76790c-openshift-default-58d84cd75f-9kgm4"
Jul 09 18:51:22.934258 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:51:22.934232    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/beda4125-9e6a-40be-842c-15bb410b19f1-workload-socket\") pod \"e2e-ait-ca76790c-openshift-default-58d84cd75f-9kgm4\" (UID: \"beda4125-9e6a-40be-842c-15bb410b19f1\") " pod="openshift-ingress/e2e-ait-ca76790c-openshift-default-58d84cd75f-9kgm4"
Jul 09 18:51:22.934378 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:51:22.934269    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/beda4125-9e6a-40be-842c-15bb410b19f1-istiod-ca-cert\") pod \"e2e-ait-ca76790c-openshift-default-58d84cd75f-9kgm4\" (UID: \"beda4125-9e6a-40be-842c-15bb410b19f1\") " pod="openshift-ingress/e2e-ait-ca76790c-openshift-default-58d84cd75f-9kgm4"
Jul 09 18:51:22.934378 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:51:22.934305    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/beda4125-9e6a-40be-842c-15bb410b19f1-credential-socket\") pod \"e2e-ait-ca76790c-openshift-default-58d84cd75f-9kgm4\" (UID: \"beda4125-9e6a-40be-842c-15bb410b19f1\") " pod="openshift-ingress/e2e-ait-ca76790c-openshift-default-58d84cd75f-9kgm4"
Jul 09 18:51:22.934378 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:51:22.934351    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/beda4125-9e6a-40be-842c-15bb410b19f1-workload-certs\") pod \"e2e-ait-ca76790c-openshift-default-58d84cd75f-9kgm4\" (UID: \"beda4125-9e6a-40be-842c-15bb410b19f1\") " pod="openshift-ingress/e2e-ait-ca76790c-openshift-default-58d84cd75f-9kgm4"
Jul 09 18:51:22.934575 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:51:22.934393    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/beda4125-9e6a-40be-842c-15bb410b19f1-istio-envoy\") pod \"e2e-ait-ca76790c-openshift-default-58d84cd75f-9kgm4\" (UID: \"beda4125-9e6a-40be-842c-15bb410b19f1\") " pod="openshift-ingress/e2e-ait-ca76790c-openshift-default-58d84cd75f-9kgm4"
Jul 09 18:51:22.934575 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:51:22.934423    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/beda4125-9e6a-40be-842c-15bb410b19f1-istio-data\") pod \"e2e-ait-ca76790c-openshift-default-58d84cd75f-9kgm4\" (UID: \"beda4125-9e6a-40be-842c-15bb410b19f1\") " pod="openshift-ingress/e2e-ait-ca76790c-openshift-default-58d84cd75f-9kgm4"
Jul 09 18:51:22.934575 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:51:22.934446    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/beda4125-9e6a-40be-842c-15bb410b19f1-istio-token\") pod \"e2e-ait-ca76790c-openshift-default-58d84cd75f-9kgm4\" (UID: \"beda4125-9e6a-40be-842c-15bb410b19f1\") " pod="openshift-ingress/e2e-ait-ca76790c-openshift-default-58d84cd75f-9kgm4"
Jul 09 18:51:23.035079 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:51:23.035043    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gntz9\" (UniqueName: \"kubernetes.io/projected/beda4125-9e6a-40be-842c-15bb410b19f1-kube-api-access-gntz9\") pod \"e2e-ait-ca76790c-openshift-default-58d84cd75f-9kgm4\" (UID: \"beda4125-9e6a-40be-842c-15bb410b19f1\") " pod="openshift-ingress/e2e-ait-ca76790c-openshift-default-58d84cd75f-9kgm4"
Jul 09 18:51:23.035079 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:51:23.035085    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/beda4125-9e6a-40be-842c-15bb410b19f1-istio-podinfo\") pod \"e2e-ait-ca76790c-openshift-default-58d84cd75f-9kgm4\" (UID: \"beda4125-9e6a-40be-842c-15bb410b19f1\") " pod="openshift-ingress/e2e-ait-ca76790c-openshift-default-58d84cd75f-9kgm4"
Jul 09 18:51:23.035400 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:51:23.035131    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/beda4125-9e6a-40be-842c-15bb410b19f1-workload-socket\") pod \"e2e-ait-ca76790c-openshift-default-58d84cd75f-9kgm4\" (UID: \"beda4125-9e6a-40be-842c-15bb410b19f1\") " pod="openshift-ingress/e2e-ait-ca76790c-openshift-default-58d84cd75f-9kgm4"
Jul 09 18:51:23.035400 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:51:23.035147    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/beda4125-9e6a-40be-842c-15bb410b19f1-istiod-ca-cert\") pod \"e2e-ait-ca76790c-openshift-default-58d84cd75f-9kgm4\" (UID: \"beda4125-9e6a-40be-842c-15bb410b19f1\") " pod="openshift-ingress/e2e-ait-ca76790c-openshift-default-58d84cd75f-9kgm4"
Jul 09 18:51:23.035400 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:51:23.035169    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/beda4125-9e6a-40be-842c-15bb410b19f1-credential-socket\") pod \"e2e-ait-ca76790c-openshift-default-58d84cd75f-9kgm4\" (UID: \"beda4125-9e6a-40be-842c-15bb410b19f1\") " pod="openshift-ingress/e2e-ait-ca76790c-openshift-default-58d84cd75f-9kgm4"
Jul 09 18:51:23.035400 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:51:23.035356    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/beda4125-9e6a-40be-842c-15bb410b19f1-workload-certs\") pod \"e2e-ait-ca76790c-openshift-default-58d84cd75f-9kgm4\" (UID: \"beda4125-9e6a-40be-842c-15bb410b19f1\") " pod="openshift-ingress/e2e-ait-ca76790c-openshift-default-58d84cd75f-9kgm4"
Jul 09 18:51:23.035689 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:51:23.035436    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/beda4125-9e6a-40be-842c-15bb410b19f1-istio-envoy\") pod \"e2e-ait-ca76790c-openshift-default-58d84cd75f-9kgm4\" (UID: \"beda4125-9e6a-40be-842c-15bb410b19f1\") " pod="openshift-ingress/e2e-ait-ca76790c-openshift-default-58d84cd75f-9kgm4"
Jul 09 18:51:23.035689 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:51:23.035470    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/beda4125-9e6a-40be-842c-15bb410b19f1-istio-data\") pod \"e2e-ait-ca76790c-openshift-default-58d84cd75f-9kgm4\" (UID: \"beda4125-9e6a-40be-842c-15bb410b19f1\") " pod="openshift-ingress/e2e-ait-ca76790c-openshift-default-58d84cd75f-9kgm4"
Jul 09 18:51:23.035689 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:51:23.035510    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/beda4125-9e6a-40be-842c-15bb410b19f1-istio-token\") pod \"e2e-ait-ca76790c-openshift-default-58d84cd75f-9kgm4\" (UID: \"beda4125-9e6a-40be-842c-15bb410b19f1\") " pod="openshift-ingress/e2e-ait-ca76790c-openshift-default-58d84cd75f-9kgm4"
Jul 09 18:51:23.035689 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:51:23.035630    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/beda4125-9e6a-40be-842c-15bb410b19f1-credential-socket\") pod \"e2e-ait-ca76790c-openshift-default-58d84cd75f-9kgm4\" (UID: \"beda4125-9e6a-40be-842c-15bb410b19f1\") " pod="openshift-ingress/e2e-ait-ca76790c-openshift-default-58d84cd75f-9kgm4"
Jul 09 18:51:23.035907 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:51:23.035750    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/beda4125-9e6a-40be-842c-15bb410b19f1-workload-socket\") pod \"e2e-ait-ca76790c-openshift-default-58d84cd75f-9kgm4\" (UID: \"beda4125-9e6a-40be-842c-15bb410b19f1\") " pod="openshift-ingress/e2e-ait-ca76790c-openshift-default-58d84cd75f-9kgm4"
Jul 09 18:51:23.035961 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:51:23.035906    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/beda4125-9e6a-40be-842c-15bb410b19f1-workload-certs\") pod \"e2e-ait-ca76790c-openshift-default-58d84cd75f-9kgm4\" (UID: \"beda4125-9e6a-40be-842c-15bb410b19f1\") " pod="openshift-ingress/e2e-ait-ca76790c-openshift-default-58d84cd75f-9kgm4"
Jul 09 18:51:23.035961 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:51:23.035906    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/beda4125-9e6a-40be-842c-15bb410b19f1-istio-data\") pod \"e2e-ait-ca76790c-openshift-default-58d84cd75f-9kgm4\" (UID: \"beda4125-9e6a-40be-842c-15bb410b19f1\") " pod="openshift-ingress/e2e-ait-ca76790c-openshift-default-58d84cd75f-9kgm4"
Jul 09 18:51:23.036244 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:51:23.036222    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/beda4125-9e6a-40be-842c-15bb410b19f1-istiod-ca-cert\") pod \"e2e-ait-ca76790c-openshift-default-58d84cd75f-9kgm4\" (UID: \"beda4125-9e6a-40be-842c-15bb410b19f1\") " pod="openshift-ingress/e2e-ait-ca76790c-openshift-default-58d84cd75f-9kgm4"
Jul 09 18:51:23.037803 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:51:23.037781    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/beda4125-9e6a-40be-842c-15bb410b19f1-istio-envoy\") pod \"e2e-ait-ca76790c-openshift-default-58d84cd75f-9kgm4\" (UID: \"beda4125-9e6a-40be-842c-15bb410b19f1\") " pod="openshift-ingress/e2e-ait-ca76790c-openshift-default-58d84cd75f-9kgm4"
Jul 09 18:51:23.037953 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:51:23.037932    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/beda4125-9e6a-40be-842c-15bb410b19f1-istio-podinfo\") pod \"e2e-ait-ca76790c-openshift-default-58d84cd75f-9kgm4\" (UID: \"beda4125-9e6a-40be-842c-15bb410b19f1\") " pod="openshift-ingress/e2e-ait-ca76790c-openshift-default-58d84cd75f-9kgm4"
Jul 09 18:51:23.043644 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:51:23.043617    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/beda4125-9e6a-40be-842c-15bb410b19f1-istio-token\") pod \"e2e-ait-ca76790c-openshift-default-58d84cd75f-9kgm4\" (UID: \"beda4125-9e6a-40be-842c-15bb410b19f1\") " pod="openshift-ingress/e2e-ait-ca76790c-openshift-default-58d84cd75f-9kgm4"
Jul 09 18:51:23.043712 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:51:23.043679    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gntz9\" (UniqueName: \"kubernetes.io/projected/beda4125-9e6a-40be-842c-15bb410b19f1-kube-api-access-gntz9\") pod \"e2e-ait-ca76790c-openshift-default-58d84cd75f-9kgm4\" (UID: \"beda4125-9e6a-40be-842c-15bb410b19f1\") " pod="openshift-ingress/e2e-ait-ca76790c-openshift-default-58d84cd75f-9kgm4"
Jul 09 18:51:23.217703 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:51:23.217615    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-ca76790c-openshift-default-58d84cd75f-9kgm4"
Jul 09 18:51:23.369694 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:51:23.369664    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-ca76790c-openshift-default-58d84cd75f-9kgm4"]
Jul 09 18:51:23.370863 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:51:23.370830    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbeda4125_9e6a_40be_842c_15bb410b19f1.slice/crio-836b3dc88d64ea2b01c063297d37a5105750eae71fc7b4f49e7a670c43d894c9 WatchSource:0}: Error finding container 836b3dc88d64ea2b01c063297d37a5105750eae71fc7b4f49e7a670c43d894c9: Status 404 returned error can't find the container with id 836b3dc88d64ea2b01c063297d37a5105750eae71fc7b4f49e7a670c43d894c9
Jul 09 18:51:23.373186 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:51:23.373147    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 09 18:51:23.373283 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:51:23.373216    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 09 18:51:23.373283 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:51:23.373249    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 09 18:51:23.639622 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:51:23.639579    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-ca76790c-openshift-default-58d84cd75f-9kgm4" event={"ID":"beda4125-9e6a-40be-842c-15bb410b19f1","Type":"ContainerStarted","Data":"a9625be6fc51f611e650b36c5e230d6120e5ddd073d1c41b4517efb800222385"}
Jul 09 18:51:23.639778 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:51:23.639651    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-ca76790c-openshift-default-58d84cd75f-9kgm4" event={"ID":"beda4125-9e6a-40be-842c-15bb410b19f1","Type":"ContainerStarted","Data":"836b3dc88d64ea2b01c063297d37a5105750eae71fc7b4f49e7a670c43d894c9"}
Jul 09 18:51:23.663743 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:51:23.663693    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-ca76790c-openshift-default-58d84cd75f-9kgm4" podStartSLOduration=1.6636756780000002 podStartE2EDuration="1.663675678s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 18:51:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 18:51:23.661805004 +0000 UTC m=+1552.901149632" watchObservedRunningTime="2026-07-09 18:51:23.663675678 +0000 UTC m=+1552.903020303"
Jul 09 18:51:24.218728 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:51:24.218688    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-ca76790c-openshift-default-58d84cd75f-9kgm4"
Jul 09 18:51:24.223999 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:51:24.223971    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-ca76790c-openshift-default-58d84cd75f-9kgm4"
Jul 09 18:51:24.645365 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:51:24.645335    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-ca76790c-openshift-default-58d84cd75f-9kgm4"
Jul 09 18:51:24.646267 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:51:24.646245    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-ca76790c-openshift-default-58d84cd75f-9kgm4"
Jul 09 18:51:35.305865 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:51:35.305826    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-ca76790c-openshift-default-58d84cd75f-9kgm4"]
Jul 09 18:51:35.306378 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:51:35.306098    2557 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-ca76790c-openshift-default-58d84cd75f-9kgm4" podUID="beda4125-9e6a-40be-842c-15bb410b19f1" containerName="istio-proxy" containerID="cri-o://a9625be6fc51f611e650b36c5e230d6120e5ddd073d1c41b4517efb800222385" gracePeriod=30
Jul 09 18:51:35.670145 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:51:35.670114    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-ca76790c-openshift-default-58d84cd75f-9kgm4"
Jul 09 18:51:35.722440 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:51:35.722405    2557 generic.go:356] "Generic (PLEG): container finished" podID="beda4125-9e6a-40be-842c-15bb410b19f1" containerID="a9625be6fc51f611e650b36c5e230d6120e5ddd073d1c41b4517efb800222385" exitCode=0
Jul 09 18:51:35.722440 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:51:35.722448    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-ca76790c-openshift-default-58d84cd75f-9kgm4"
Jul 09 18:51:35.722734 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:51:35.722466    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-ca76790c-openshift-default-58d84cd75f-9kgm4" event={"ID":"beda4125-9e6a-40be-842c-15bb410b19f1","Type":"ContainerDied","Data":"a9625be6fc51f611e650b36c5e230d6120e5ddd073d1c41b4517efb800222385"}
Jul 09 18:51:35.722734 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:51:35.722610    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-ca76790c-openshift-default-58d84cd75f-9kgm4" event={"ID":"beda4125-9e6a-40be-842c-15bb410b19f1","Type":"ContainerDied","Data":"836b3dc88d64ea2b01c063297d37a5105750eae71fc7b4f49e7a670c43d894c9"}
Jul 09 18:51:35.722734 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:51:35.722646    2557 scope.go:117] "RemoveContainer" containerID="a9625be6fc51f611e650b36c5e230d6120e5ddd073d1c41b4517efb800222385"
Jul 09 18:51:35.734269 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:51:35.734243    2557 scope.go:117] "RemoveContainer" containerID="a9625be6fc51f611e650b36c5e230d6120e5ddd073d1c41b4517efb800222385"
Jul 09 18:51:35.734675 ip-10-0-141-101 kubenswrapper[2557]: E0709 18:51:35.734647    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a9625be6fc51f611e650b36c5e230d6120e5ddd073d1c41b4517efb800222385\": container with ID starting with a9625be6fc51f611e650b36c5e230d6120e5ddd073d1c41b4517efb800222385 not found: ID does not exist" containerID="a9625be6fc51f611e650b36c5e230d6120e5ddd073d1c41b4517efb800222385"
Jul 09 18:51:35.734795 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:51:35.734685    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a9625be6fc51f611e650b36c5e230d6120e5ddd073d1c41b4517efb800222385"} err="failed to get container status \"a9625be6fc51f611e650b36c5e230d6120e5ddd073d1c41b4517efb800222385\": rpc error: code = NotFound desc = could not find container \"a9625be6fc51f611e650b36c5e230d6120e5ddd073d1c41b4517efb800222385\": container with ID starting with a9625be6fc51f611e650b36c5e230d6120e5ddd073d1c41b4517efb800222385 not found: ID does not exist"
Jul 09 18:51:35.760095 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:51:35.760063    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/beda4125-9e6a-40be-842c-15bb410b19f1-istio-data\") pod \"beda4125-9e6a-40be-842c-15bb410b19f1\" (UID: \"beda4125-9e6a-40be-842c-15bb410b19f1\") "
Jul 09 18:51:35.760273 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:51:35.760109    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/beda4125-9e6a-40be-842c-15bb410b19f1-istio-podinfo\") pod \"beda4125-9e6a-40be-842c-15bb410b19f1\" (UID: \"beda4125-9e6a-40be-842c-15bb410b19f1\") "
Jul 09 18:51:35.760273 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:51:35.760126    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/beda4125-9e6a-40be-842c-15bb410b19f1-istiod-ca-cert\") pod \"beda4125-9e6a-40be-842c-15bb410b19f1\" (UID: \"beda4125-9e6a-40be-842c-15bb410b19f1\") "
Jul 09 18:51:35.760273 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:51:35.760165    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/beda4125-9e6a-40be-842c-15bb410b19f1-workload-certs\") pod \"beda4125-9e6a-40be-842c-15bb410b19f1\" (UID: \"beda4125-9e6a-40be-842c-15bb410b19f1\") "
Jul 09 18:51:35.760273 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:51:35.760212    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/beda4125-9e6a-40be-842c-15bb410b19f1-istio-envoy\") pod \"beda4125-9e6a-40be-842c-15bb410b19f1\" (UID: \"beda4125-9e6a-40be-842c-15bb410b19f1\") "
Jul 09 18:51:35.760273 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:51:35.760259    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/beda4125-9e6a-40be-842c-15bb410b19f1-workload-socket\") pod \"beda4125-9e6a-40be-842c-15bb410b19f1\" (UID: \"beda4125-9e6a-40be-842c-15bb410b19f1\") "
Jul 09 18:51:35.760585 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:51:35.760320    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gntz9\" (UniqueName: \"kubernetes.io/projected/beda4125-9e6a-40be-842c-15bb410b19f1-kube-api-access-gntz9\") pod \"beda4125-9e6a-40be-842c-15bb410b19f1\" (UID: \"beda4125-9e6a-40be-842c-15bb410b19f1\") "
Jul 09 18:51:35.760585 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:51:35.760347    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/beda4125-9e6a-40be-842c-15bb410b19f1-istio-token\") pod \"beda4125-9e6a-40be-842c-15bb410b19f1\" (UID: \"beda4125-9e6a-40be-842c-15bb410b19f1\") "
Jul 09 18:51:35.760585 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:51:35.760405    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/beda4125-9e6a-40be-842c-15bb410b19f1-credential-socket\") pod \"beda4125-9e6a-40be-842c-15bb410b19f1\" (UID: \"beda4125-9e6a-40be-842c-15bb410b19f1\") "
Jul 09 18:51:35.760585 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:51:35.760507    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/beda4125-9e6a-40be-842c-15bb410b19f1-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "beda4125-9e6a-40be-842c-15bb410b19f1" (UID: "beda4125-9e6a-40be-842c-15bb410b19f1"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 18:51:35.760786 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:51:35.760578    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/beda4125-9e6a-40be-842c-15bb410b19f1-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "beda4125-9e6a-40be-842c-15bb410b19f1" (UID: "beda4125-9e6a-40be-842c-15bb410b19f1"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 09 18:51:35.760841 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:51:35.760792    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/beda4125-9e6a-40be-842c-15bb410b19f1-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "beda4125-9e6a-40be-842c-15bb410b19f1" (UID: "beda4125-9e6a-40be-842c-15bb410b19f1"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 18:51:35.760931 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:51:35.760908    2557 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/beda4125-9e6a-40be-842c-15bb410b19f1-istiod-ca-cert\") on node \"ip-10-0-141-101.ec2.internal\" DevicePath \"\""
Jul 09 18:51:35.761005 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:51:35.760941    2557 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/beda4125-9e6a-40be-842c-15bb410b19f1-workload-certs\") on node \"ip-10-0-141-101.ec2.internal\" DevicePath \"\""
Jul 09 18:51:35.761005 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:51:35.760957    2557 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/beda4125-9e6a-40be-842c-15bb410b19f1-credential-socket\") on node \"ip-10-0-141-101.ec2.internal\" DevicePath \"\""
Jul 09 18:51:35.761077 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:51:35.760965    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/beda4125-9e6a-40be-842c-15bb410b19f1-istio-data" (OuterVolumeSpecName: "istio-data") pod "beda4125-9e6a-40be-842c-15bb410b19f1" (UID: "beda4125-9e6a-40be-842c-15bb410b19f1"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 18:51:35.761077 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:51:35.761043    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/beda4125-9e6a-40be-842c-15bb410b19f1-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "beda4125-9e6a-40be-842c-15bb410b19f1" (UID: "beda4125-9e6a-40be-842c-15bb410b19f1"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 18:51:35.762806 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:51:35.762778    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/beda4125-9e6a-40be-842c-15bb410b19f1-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "beda4125-9e6a-40be-842c-15bb410b19f1" (UID: "beda4125-9e6a-40be-842c-15bb410b19f1"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 18:51:35.763046 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:51:35.763020    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/beda4125-9e6a-40be-842c-15bb410b19f1-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "beda4125-9e6a-40be-842c-15bb410b19f1" (UID: "beda4125-9e6a-40be-842c-15bb410b19f1"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 09 18:51:35.763141 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:51:35.763055    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/beda4125-9e6a-40be-842c-15bb410b19f1-kube-api-access-gntz9" (OuterVolumeSpecName: "kube-api-access-gntz9") pod "beda4125-9e6a-40be-842c-15bb410b19f1" (UID: "beda4125-9e6a-40be-842c-15bb410b19f1"). InnerVolumeSpecName "kube-api-access-gntz9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 18:51:35.763141 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:51:35.763081    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/beda4125-9e6a-40be-842c-15bb410b19f1-istio-token" (OuterVolumeSpecName: "istio-token") pod "beda4125-9e6a-40be-842c-15bb410b19f1" (UID: "beda4125-9e6a-40be-842c-15bb410b19f1"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 18:51:35.861664 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:51:35.861570    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gntz9\" (UniqueName: \"kubernetes.io/projected/beda4125-9e6a-40be-842c-15bb410b19f1-kube-api-access-gntz9\") on node \"ip-10-0-141-101.ec2.internal\" DevicePath \"\""
Jul 09 18:51:35.861664 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:51:35.861602    2557 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/beda4125-9e6a-40be-842c-15bb410b19f1-istio-token\") on node \"ip-10-0-141-101.ec2.internal\" DevicePath \"\""
Jul 09 18:51:35.861664 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:51:35.861611    2557 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/beda4125-9e6a-40be-842c-15bb410b19f1-istio-data\") on node \"ip-10-0-141-101.ec2.internal\" DevicePath \"\""
Jul 09 18:51:35.861664 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:51:35.861620    2557 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/beda4125-9e6a-40be-842c-15bb410b19f1-istio-podinfo\") on node \"ip-10-0-141-101.ec2.internal\" DevicePath \"\""
Jul 09 18:51:35.861664 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:51:35.861628    2557 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/beda4125-9e6a-40be-842c-15bb410b19f1-istio-envoy\") on node \"ip-10-0-141-101.ec2.internal\" DevicePath \"\""
Jul 09 18:51:35.861664 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:51:35.861637    2557 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/beda4125-9e6a-40be-842c-15bb410b19f1-workload-socket\") on node \"ip-10-0-141-101.ec2.internal\" DevicePath \"\""
Jul 09 18:51:36.051914 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:51:36.051873    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-ca76790c-openshift-default-58d84cd75f-9kgm4"]
Jul 09 18:51:36.055415 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:51:36.055387    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-ca76790c-openshift-default-58d84cd75f-9kgm4"]
Jul 09 18:51:37.263380 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:51:37.263343    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="beda4125-9e6a-40be-842c-15bb410b19f1" path="/var/lib/kubelet/pods/beda4125-9e6a-40be-842c-15bb410b19f1/volumes"
Jul 09 18:51:43.104106 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:51:43.104070    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-derive-1536c57b-openshift-default-655bdbfdbc-d79jq"]
Jul 09 18:51:43.104555 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:51:43.104541    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="beda4125-9e6a-40be-842c-15bb410b19f1" containerName="istio-proxy"
Jul 09 18:51:43.104616 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:51:43.104557    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="beda4125-9e6a-40be-842c-15bb410b19f1" containerName="istio-proxy"
Jul 09 18:51:43.104652 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:51:43.104639    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="beda4125-9e6a-40be-842c-15bb410b19f1" containerName="istio-proxy"
Jul 09 18:51:43.110424 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:51:43.110403    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-1536c57b-openshift-default-655bdbfdbc-d79jq"
Jul 09 18:51:43.120897 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:51:43.120871    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-derive-1536c57b-openshift-default-dockercfg-2ldzj\""
Jul 09 18:51:43.146403 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:51:43.146370    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-1536c57b-openshift-default-655bdbfdbc-d79jq"]
Jul 09 18:51:43.232902 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:51:43.232871    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ba84f484-1995-46c1-9172-0961821d2941-workload-socket\") pod \"e2e-derive-1536c57b-openshift-default-655bdbfdbc-d79jq\" (UID: \"ba84f484-1995-46c1-9172-0961821d2941\") " pod="openshift-ingress/e2e-derive-1536c57b-openshift-default-655bdbfdbc-d79jq"
Jul 09 18:51:43.232902 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:51:43.232902    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ba84f484-1995-46c1-9172-0961821d2941-istio-podinfo\") pod \"e2e-derive-1536c57b-openshift-default-655bdbfdbc-d79jq\" (UID: \"ba84f484-1995-46c1-9172-0961821d2941\") " pod="openshift-ingress/e2e-derive-1536c57b-openshift-default-655bdbfdbc-d79jq"
Jul 09 18:51:43.233167 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:51:43.232951    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c9kp2\" (UniqueName: \"kubernetes.io/projected/ba84f484-1995-46c1-9172-0961821d2941-kube-api-access-c9kp2\") pod \"e2e-derive-1536c57b-openshift-default-655bdbfdbc-d79jq\" (UID: \"ba84f484-1995-46c1-9172-0961821d2941\") " pod="openshift-ingress/e2e-derive-1536c57b-openshift-default-655bdbfdbc-d79jq"
Jul 09 18:51:43.233167 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:51:43.233048    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ba84f484-1995-46c1-9172-0961821d2941-credential-socket\") pod \"e2e-derive-1536c57b-openshift-default-655bdbfdbc-d79jq\" (UID: \"ba84f484-1995-46c1-9172-0961821d2941\") " pod="openshift-ingress/e2e-derive-1536c57b-openshift-default-655bdbfdbc-d79jq"
Jul 09 18:51:43.233167 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:51:43.233129    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ba84f484-1995-46c1-9172-0961821d2941-istio-envoy\") pod \"e2e-derive-1536c57b-openshift-default-655bdbfdbc-d79jq\" (UID: \"ba84f484-1995-46c1-9172-0961821d2941\") " pod="openshift-ingress/e2e-derive-1536c57b-openshift-default-655bdbfdbc-d79jq"
Jul 09 18:51:43.233167 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:51:43.233154    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ba84f484-1995-46c1-9172-0961821d2941-istiod-ca-cert\") pod \"e2e-derive-1536c57b-openshift-default-655bdbfdbc-d79jq\" (UID: \"ba84f484-1995-46c1-9172-0961821d2941\") " pod="openshift-ingress/e2e-derive-1536c57b-openshift-default-655bdbfdbc-d79jq"
Jul 09 18:51:43.233314 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:51:43.233216    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ba84f484-1995-46c1-9172-0961821d2941-workload-certs\") pod \"e2e-derive-1536c57b-openshift-default-655bdbfdbc-d79jq\" (UID: \"ba84f484-1995-46c1-9172-0961821d2941\") " pod="openshift-ingress/e2e-derive-1536c57b-openshift-default-655bdbfdbc-d79jq"
Jul 09 18:51:43.233314 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:51:43.233259    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ba84f484-1995-46c1-9172-0961821d2941-istio-token\") pod \"e2e-derive-1536c57b-openshift-default-655bdbfdbc-d79jq\" (UID: \"ba84f484-1995-46c1-9172-0961821d2941\") " pod="openshift-ingress/e2e-derive-1536c57b-openshift-default-655bdbfdbc-d79jq"
Jul 09 18:51:43.233314 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:51:43.233280    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ba84f484-1995-46c1-9172-0961821d2941-istio-data\") pod \"e2e-derive-1536c57b-openshift-default-655bdbfdbc-d79jq\" (UID: \"ba84f484-1995-46c1-9172-0961821d2941\") " pod="openshift-ingress/e2e-derive-1536c57b-openshift-default-655bdbfdbc-d79jq"
Jul 09 18:51:43.334399 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:51:43.334308    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c9kp2\" (UniqueName: \"kubernetes.io/projected/ba84f484-1995-46c1-9172-0961821d2941-kube-api-access-c9kp2\") pod \"e2e-derive-1536c57b-openshift-default-655bdbfdbc-d79jq\" (UID: \"ba84f484-1995-46c1-9172-0961821d2941\") " pod="openshift-ingress/e2e-derive-1536c57b-openshift-default-655bdbfdbc-d79jq"
Jul 09 18:51:43.334399 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:51:43.334352    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ba84f484-1995-46c1-9172-0961821d2941-credential-socket\") pod \"e2e-derive-1536c57b-openshift-default-655bdbfdbc-d79jq\" (UID: \"ba84f484-1995-46c1-9172-0961821d2941\") " pod="openshift-ingress/e2e-derive-1536c57b-openshift-default-655bdbfdbc-d79jq"
Jul 09 18:51:43.334681 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:51:43.334459    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ba84f484-1995-46c1-9172-0961821d2941-istio-envoy\") pod \"e2e-derive-1536c57b-openshift-default-655bdbfdbc-d79jq\" (UID: \"ba84f484-1995-46c1-9172-0961821d2941\") " pod="openshift-ingress/e2e-derive-1536c57b-openshift-default-655bdbfdbc-d79jq"
Jul 09 18:51:43.334681 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:51:43.334511    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ba84f484-1995-46c1-9172-0961821d2941-istiod-ca-cert\") pod \"e2e-derive-1536c57b-openshift-default-655bdbfdbc-d79jq\" (UID: \"ba84f484-1995-46c1-9172-0961821d2941\") " pod="openshift-ingress/e2e-derive-1536c57b-openshift-default-655bdbfdbc-d79jq"
Jul 09 18:51:43.334681 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:51:43.334579    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ba84f484-1995-46c1-9172-0961821d2941-workload-certs\") pod \"e2e-derive-1536c57b-openshift-default-655bdbfdbc-d79jq\" (UID: \"ba84f484-1995-46c1-9172-0961821d2941\") " pod="openshift-ingress/e2e-derive-1536c57b-openshift-default-655bdbfdbc-d79jq"
Jul 09 18:51:43.334681 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:51:43.334648    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ba84f484-1995-46c1-9172-0961821d2941-istio-token\") pod \"e2e-derive-1536c57b-openshift-default-655bdbfdbc-d79jq\" (UID: \"ba84f484-1995-46c1-9172-0961821d2941\") " pod="openshift-ingress/e2e-derive-1536c57b-openshift-default-655bdbfdbc-d79jq"
Jul 09 18:51:43.334916 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:51:43.334717    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ba84f484-1995-46c1-9172-0961821d2941-istio-data\") pod \"e2e-derive-1536c57b-openshift-default-655bdbfdbc-d79jq\" (UID: \"ba84f484-1995-46c1-9172-0961821d2941\") " pod="openshift-ingress/e2e-derive-1536c57b-openshift-default-655bdbfdbc-d79jq"
Jul 09 18:51:43.334916 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:51:43.334762    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ba84f484-1995-46c1-9172-0961821d2941-workload-socket\") pod \"e2e-derive-1536c57b-openshift-default-655bdbfdbc-d79jq\" (UID: \"ba84f484-1995-46c1-9172-0961821d2941\") " pod="openshift-ingress/e2e-derive-1536c57b-openshift-default-655bdbfdbc-d79jq"
Jul 09 18:51:43.334916 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:51:43.334792    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ba84f484-1995-46c1-9172-0961821d2941-istio-podinfo\") pod \"e2e-derive-1536c57b-openshift-default-655bdbfdbc-d79jq\" (UID: \"ba84f484-1995-46c1-9172-0961821d2941\") " pod="openshift-ingress/e2e-derive-1536c57b-openshift-default-655bdbfdbc-d79jq"
Jul 09 18:51:43.334916 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:51:43.334798    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ba84f484-1995-46c1-9172-0961821d2941-credential-socket\") pod \"e2e-derive-1536c57b-openshift-default-655bdbfdbc-d79jq\" (UID: \"ba84f484-1995-46c1-9172-0961821d2941\") " pod="openshift-ingress/e2e-derive-1536c57b-openshift-default-655bdbfdbc-d79jq"
Jul 09 18:51:43.335135 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:51:43.334956    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ba84f484-1995-46c1-9172-0961821d2941-workload-certs\") pod \"e2e-derive-1536c57b-openshift-default-655bdbfdbc-d79jq\" (UID: \"ba84f484-1995-46c1-9172-0961821d2941\") " pod="openshift-ingress/e2e-derive-1536c57b-openshift-default-655bdbfdbc-d79jq"
Jul 09 18:51:43.335241 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:51:43.335180    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ba84f484-1995-46c1-9172-0961821d2941-workload-socket\") pod \"e2e-derive-1536c57b-openshift-default-655bdbfdbc-d79jq\" (UID: \"ba84f484-1995-46c1-9172-0961821d2941\") " pod="openshift-ingress/e2e-derive-1536c57b-openshift-default-655bdbfdbc-d79jq"
Jul 09 18:51:43.335436 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:51:43.335416    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ba84f484-1995-46c1-9172-0961821d2941-istio-data\") pod \"e2e-derive-1536c57b-openshift-default-655bdbfdbc-d79jq\" (UID: \"ba84f484-1995-46c1-9172-0961821d2941\") " pod="openshift-ingress/e2e-derive-1536c57b-openshift-default-655bdbfdbc-d79jq"
Jul 09 18:51:43.335606 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:51:43.335586    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ba84f484-1995-46c1-9172-0961821d2941-istiod-ca-cert\") pod \"e2e-derive-1536c57b-openshift-default-655bdbfdbc-d79jq\" (UID: \"ba84f484-1995-46c1-9172-0961821d2941\") " pod="openshift-ingress/e2e-derive-1536c57b-openshift-default-655bdbfdbc-d79jq"
Jul 09 18:51:43.337162 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:51:43.337137    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ba84f484-1995-46c1-9172-0961821d2941-istio-envoy\") pod \"e2e-derive-1536c57b-openshift-default-655bdbfdbc-d79jq\" (UID: \"ba84f484-1995-46c1-9172-0961821d2941\") " pod="openshift-ingress/e2e-derive-1536c57b-openshift-default-655bdbfdbc-d79jq"
Jul 09 18:51:43.337271 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:51:43.337216    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ba84f484-1995-46c1-9172-0961821d2941-istio-podinfo\") pod \"e2e-derive-1536c57b-openshift-default-655bdbfdbc-d79jq\" (UID: \"ba84f484-1995-46c1-9172-0961821d2941\") " pod="openshift-ingress/e2e-derive-1536c57b-openshift-default-655bdbfdbc-d79jq"
Jul 09 18:51:43.379101 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:51:43.379060    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ba84f484-1995-46c1-9172-0961821d2941-istio-token\") pod \"e2e-derive-1536c57b-openshift-default-655bdbfdbc-d79jq\" (UID: \"ba84f484-1995-46c1-9172-0961821d2941\") " pod="openshift-ingress/e2e-derive-1536c57b-openshift-default-655bdbfdbc-d79jq"
Jul 09 18:51:43.379287 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:51:43.379241    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c9kp2\" (UniqueName: \"kubernetes.io/projected/ba84f484-1995-46c1-9172-0961821d2941-kube-api-access-c9kp2\") pod \"e2e-derive-1536c57b-openshift-default-655bdbfdbc-d79jq\" (UID: \"ba84f484-1995-46c1-9172-0961821d2941\") " pod="openshift-ingress/e2e-derive-1536c57b-openshift-default-655bdbfdbc-d79jq"
Jul 09 18:51:43.421978 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:51:43.421941    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-1536c57b-openshift-default-655bdbfdbc-d79jq"
Jul 09 18:51:43.587147 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:51:43.587053    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-1536c57b-openshift-default-655bdbfdbc-d79jq"]
Jul 09 18:51:43.590667 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:51:43.590640    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podba84f484_1995_46c1_9172_0961821d2941.slice/crio-a74036b7cc2dc04b6cceeef0d6cc78e2a1ece6099eada6388fd80d1788b9a7f1 WatchSource:0}: Error finding container a74036b7cc2dc04b6cceeef0d6cc78e2a1ece6099eada6388fd80d1788b9a7f1: Status 404 returned error can't find the container with id a74036b7cc2dc04b6cceeef0d6cc78e2a1ece6099eada6388fd80d1788b9a7f1
Jul 09 18:51:43.592728 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:51:43.592692    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 09 18:51:43.592830 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:51:43.592772    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 09 18:51:43.592830 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:51:43.592813    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 09 18:51:43.771435 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:51:43.771397    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-1536c57b-openshift-default-655bdbfdbc-d79jq" event={"ID":"ba84f484-1995-46c1-9172-0961821d2941","Type":"ContainerStarted","Data":"93041bdc8af58a2e5f87cdc79cc7d21964a6353c6e6705a73a0c13474a878d01"}
Jul 09 18:51:43.771652 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:51:43.771459    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-1536c57b-openshift-default-655bdbfdbc-d79jq" event={"ID":"ba84f484-1995-46c1-9172-0961821d2941","Type":"ContainerStarted","Data":"a74036b7cc2dc04b6cceeef0d6cc78e2a1ece6099eada6388fd80d1788b9a7f1"}
Jul 09 18:51:43.798439 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:51:43.798382    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-derive-1536c57b-openshift-default-655bdbfdbc-d79jq" podStartSLOduration=0.798363509 podStartE2EDuration="798.363509ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 18:51:43 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 18:51:43.795998831 +0000 UTC m=+1573.035343474" watchObservedRunningTime="2026-07-09 18:51:43.798363509 +0000 UTC m=+1573.037708134"
Jul 09 18:51:44.423029 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:51:44.422988    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-1536c57b-openshift-default-655bdbfdbc-d79jq"
Jul 09 18:51:44.428387 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:51:44.428355    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-1536c57b-openshift-default-655bdbfdbc-d79jq"
Jul 09 18:51:44.776784 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:51:44.776694    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-1536c57b-openshift-default-655bdbfdbc-d79jq"
Jul 09 18:51:44.777816 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:51:44.777796    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-1536c57b-openshift-default-655bdbfdbc-d79jq"
Jul 09 18:51:48.872293 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:51:48.872258    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-1536c57b-openshift-default-655bdbfdbc-d79jq"]
Jul 09 18:51:48.872933 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:51:48.872897    2557 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-derive-1536c57b-openshift-default-655bdbfdbc-d79jq" podUID="ba84f484-1995-46c1-9172-0961821d2941" containerName="istio-proxy" containerID="cri-o://93041bdc8af58a2e5f87cdc79cc7d21964a6353c6e6705a73a0c13474a878d01" gracePeriod=30
Jul 09 18:51:56.130312 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:51:56.130259    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-1536c57b-openshift-default-655bdbfdbc-d79jq"
Jul 09 18:51:56.174669 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:51:56.174638    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ba84f484-1995-46c1-9172-0961821d2941-istio-token\") pod \"ba84f484-1995-46c1-9172-0961821d2941\" (UID: \"ba84f484-1995-46c1-9172-0961821d2941\") "
Jul 09 18:51:56.174867 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:51:56.174706    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ba84f484-1995-46c1-9172-0961821d2941-istio-envoy\") pod \"ba84f484-1995-46c1-9172-0961821d2941\" (UID: \"ba84f484-1995-46c1-9172-0961821d2941\") "
Jul 09 18:51:56.174867 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:51:56.174734    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ba84f484-1995-46c1-9172-0961821d2941-istio-data\") pod \"ba84f484-1995-46c1-9172-0961821d2941\" (UID: \"ba84f484-1995-46c1-9172-0961821d2941\") "
Jul 09 18:51:56.174867 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:51:56.174750    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ba84f484-1995-46c1-9172-0961821d2941-workload-socket\") pod \"ba84f484-1995-46c1-9172-0961821d2941\" (UID: \"ba84f484-1995-46c1-9172-0961821d2941\") "
Jul 09 18:51:56.174867 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:51:56.174794    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ba84f484-1995-46c1-9172-0961821d2941-workload-certs\") pod \"ba84f484-1995-46c1-9172-0961821d2941\" (UID: \"ba84f484-1995-46c1-9172-0961821d2941\") "
Jul 09 18:51:56.174867 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:51:56.174835    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ba84f484-1995-46c1-9172-0961821d2941-credential-socket\") pod \"ba84f484-1995-46c1-9172-0961821d2941\" (UID: \"ba84f484-1995-46c1-9172-0961821d2941\") "
Jul 09 18:51:56.174867 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:51:56.174867    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ba84f484-1995-46c1-9172-0961821d2941-istiod-ca-cert\") pod \"ba84f484-1995-46c1-9172-0961821d2941\" (UID: \"ba84f484-1995-46c1-9172-0961821d2941\") "
Jul 09 18:51:56.175552 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:51:56.174915    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ba84f484-1995-46c1-9172-0961821d2941-istio-podinfo\") pod \"ba84f484-1995-46c1-9172-0961821d2941\" (UID: \"ba84f484-1995-46c1-9172-0961821d2941\") "
Jul 09 18:51:56.175552 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:51:56.174942    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-c9kp2\" (UniqueName: \"kubernetes.io/projected/ba84f484-1995-46c1-9172-0961821d2941-kube-api-access-c9kp2\") pod \"ba84f484-1995-46c1-9172-0961821d2941\" (UID: \"ba84f484-1995-46c1-9172-0961821d2941\") "
Jul 09 18:51:56.175911 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:51:56.175875    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ba84f484-1995-46c1-9172-0961821d2941-istio-data" (OuterVolumeSpecName: "istio-data") pod "ba84f484-1995-46c1-9172-0961821d2941" (UID: "ba84f484-1995-46c1-9172-0961821d2941"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 18:51:56.175911 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:51:56.175893    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ba84f484-1995-46c1-9172-0961821d2941-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "ba84f484-1995-46c1-9172-0961821d2941" (UID: "ba84f484-1995-46c1-9172-0961821d2941"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 09 18:51:56.176242 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:51:56.176203    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ba84f484-1995-46c1-9172-0961821d2941-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "ba84f484-1995-46c1-9172-0961821d2941" (UID: "ba84f484-1995-46c1-9172-0961821d2941"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 18:51:56.176429 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:51:56.176234    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ba84f484-1995-46c1-9172-0961821d2941-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "ba84f484-1995-46c1-9172-0961821d2941" (UID: "ba84f484-1995-46c1-9172-0961821d2941"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 18:51:56.176429 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:51:56.176281    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ba84f484-1995-46c1-9172-0961821d2941-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "ba84f484-1995-46c1-9172-0961821d2941" (UID: "ba84f484-1995-46c1-9172-0961821d2941"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 18:51:56.177457 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:51:56.177424    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ba84f484-1995-46c1-9172-0961821d2941-istio-token" (OuterVolumeSpecName: "istio-token") pod "ba84f484-1995-46c1-9172-0961821d2941" (UID: "ba84f484-1995-46c1-9172-0961821d2941"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 18:51:56.177637 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:51:56.177462    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ba84f484-1995-46c1-9172-0961821d2941-kube-api-access-c9kp2" (OuterVolumeSpecName: "kube-api-access-c9kp2") pod "ba84f484-1995-46c1-9172-0961821d2941" (UID: "ba84f484-1995-46c1-9172-0961821d2941"). InnerVolumeSpecName "kube-api-access-c9kp2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 18:51:56.177637 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:51:56.177531    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ba84f484-1995-46c1-9172-0961821d2941-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "ba84f484-1995-46c1-9172-0961821d2941" (UID: "ba84f484-1995-46c1-9172-0961821d2941"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 18:51:56.177917 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:51:56.177899    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/ba84f484-1995-46c1-9172-0961821d2941-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "ba84f484-1995-46c1-9172-0961821d2941" (UID: "ba84f484-1995-46c1-9172-0961821d2941"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 09 18:51:56.276055 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:51:56.275965    2557 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ba84f484-1995-46c1-9172-0961821d2941-credential-socket\") on node \"ip-10-0-141-101.ec2.internal\" DevicePath \"\""
Jul 09 18:51:56.276055 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:51:56.275997    2557 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ba84f484-1995-46c1-9172-0961821d2941-istiod-ca-cert\") on node \"ip-10-0-141-101.ec2.internal\" DevicePath \"\""
Jul 09 18:51:56.276055 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:51:56.276008    2557 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ba84f484-1995-46c1-9172-0961821d2941-istio-podinfo\") on node \"ip-10-0-141-101.ec2.internal\" DevicePath \"\""
Jul 09 18:51:56.276055 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:51:56.276016    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-c9kp2\" (UniqueName: \"kubernetes.io/projected/ba84f484-1995-46c1-9172-0961821d2941-kube-api-access-c9kp2\") on node \"ip-10-0-141-101.ec2.internal\" DevicePath \"\""
Jul 09 18:51:56.276055 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:51:56.276027    2557 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ba84f484-1995-46c1-9172-0961821d2941-istio-token\") on node \"ip-10-0-141-101.ec2.internal\" DevicePath \"\""
Jul 09 18:51:56.276055 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:51:56.276036    2557 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ba84f484-1995-46c1-9172-0961821d2941-istio-envoy\") on node \"ip-10-0-141-101.ec2.internal\" DevicePath \"\""
Jul 09 18:51:56.276055 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:51:56.276044    2557 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ba84f484-1995-46c1-9172-0961821d2941-istio-data\") on node \"ip-10-0-141-101.ec2.internal\" DevicePath \"\""
Jul 09 18:51:56.276055 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:51:56.276051    2557 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ba84f484-1995-46c1-9172-0961821d2941-workload-socket\") on node \"ip-10-0-141-101.ec2.internal\" DevicePath \"\""
Jul 09 18:51:56.276055 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:51:56.276061    2557 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ba84f484-1995-46c1-9172-0961821d2941-workload-certs\") on node \"ip-10-0-141-101.ec2.internal\" DevicePath \"\""
Jul 09 18:51:56.869945 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:51:56.869912    2557 generic.go:356] "Generic (PLEG): container finished" podID="ba84f484-1995-46c1-9172-0961821d2941" containerID="93041bdc8af58a2e5f87cdc79cc7d21964a6353c6e6705a73a0c13474a878d01" exitCode=0
Jul 09 18:51:56.870126 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:51:56.869964    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-1536c57b-openshift-default-655bdbfdbc-d79jq"
Jul 09 18:51:56.870126 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:51:56.869993    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-1536c57b-openshift-default-655bdbfdbc-d79jq" event={"ID":"ba84f484-1995-46c1-9172-0961821d2941","Type":"ContainerDied","Data":"93041bdc8af58a2e5f87cdc79cc7d21964a6353c6e6705a73a0c13474a878d01"}
Jul 09 18:51:56.870126 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:51:56.870046    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-1536c57b-openshift-default-655bdbfdbc-d79jq" event={"ID":"ba84f484-1995-46c1-9172-0961821d2941","Type":"ContainerDied","Data":"a74036b7cc2dc04b6cceeef0d6cc78e2a1ece6099eada6388fd80d1788b9a7f1"}
Jul 09 18:51:56.870126 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:51:56.870070    2557 scope.go:117] "RemoveContainer" containerID="93041bdc8af58a2e5f87cdc79cc7d21964a6353c6e6705a73a0c13474a878d01"
Jul 09 18:51:56.879758 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:51:56.879740    2557 scope.go:117] "RemoveContainer" containerID="93041bdc8af58a2e5f87cdc79cc7d21964a6353c6e6705a73a0c13474a878d01"
Jul 09 18:51:56.880020 ip-10-0-141-101 kubenswrapper[2557]: E0709 18:51:56.880004    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"93041bdc8af58a2e5f87cdc79cc7d21964a6353c6e6705a73a0c13474a878d01\": container with ID starting with 93041bdc8af58a2e5f87cdc79cc7d21964a6353c6e6705a73a0c13474a878d01 not found: ID does not exist" containerID="93041bdc8af58a2e5f87cdc79cc7d21964a6353c6e6705a73a0c13474a878d01"
Jul 09 18:51:56.880068 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:51:56.880029    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"93041bdc8af58a2e5f87cdc79cc7d21964a6353c6e6705a73a0c13474a878d01"} err="failed to get container status \"93041bdc8af58a2e5f87cdc79cc7d21964a6353c6e6705a73a0c13474a878d01\": rpc error: code = NotFound desc = could not find container \"93041bdc8af58a2e5f87cdc79cc7d21964a6353c6e6705a73a0c13474a878d01\": container with ID starting with 93041bdc8af58a2e5f87cdc79cc7d21964a6353c6e6705a73a0c13474a878d01 not found: ID does not exist"
Jul 09 18:51:56.896325 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:51:56.896294    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-1536c57b-openshift-default-655bdbfdbc-d79jq"]
Jul 09 18:51:56.902339 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:51:56.902312    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-derive-1536c57b-openshift-default-655bdbfdbc-d79jq"]
Jul 09 18:51:57.262469 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:51:57.262382    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ba84f484-1995-46c1-9172-0961821d2941" path="/var/lib/kubelet/pods/ba84f484-1995-46c1-9172-0961821d2941/volumes"
Jul 09 18:53:39.357473 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:53:39.357440    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-7edc7c10-76967fbf76-rt2l4"]
Jul 09 18:53:39.358038 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:53:39.357959    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ba84f484-1995-46c1-9172-0961821d2941" containerName="istio-proxy"
Jul 09 18:53:39.358038 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:53:39.357975    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="ba84f484-1995-46c1-9172-0961821d2941" containerName="istio-proxy"
Jul 09 18:53:39.358174 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:53:39.358046    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="ba84f484-1995-46c1-9172-0961821d2941" containerName="istio-proxy"
Jul 09 18:53:39.361253 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:53:39.361233    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-7edc7c10-76967fbf76-rt2l4"
Jul 09 18:53:39.364176 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:53:39.364145    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-mt-7edc7c10-serving-cert\""
Jul 09 18:53:39.364176 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:53:39.364165    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 09 18:53:39.364582 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:53:39.364566    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-4zbc4\""
Jul 09 18:53:39.365122 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:53:39.365107    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 09 18:53:39.382833 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:53:39.382806    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-7edc7c10-76967fbf76-rt2l4"]
Jul 09 18:53:39.456449 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:53:39.456414    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/29fb7d10-7401-4846-926d-b18b940538d1-openshift-service-ca\") pod \"maas-api-e2e-mt-7edc7c10-76967fbf76-rt2l4\" (UID: \"29fb7d10-7401-4846-926d-b18b940538d1\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-7edc7c10-76967fbf76-rt2l4"
Jul 09 18:53:39.456649 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:53:39.456511    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4sbmr\" (UniqueName: \"kubernetes.io/projected/29fb7d10-7401-4846-926d-b18b940538d1-kube-api-access-4sbmr\") pod \"maas-api-e2e-mt-7edc7c10-76967fbf76-rt2l4\" (UID: \"29fb7d10-7401-4846-926d-b18b940538d1\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-7edc7c10-76967fbf76-rt2l4"
Jul 09 18:53:39.456649 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:53:39.456608    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/29fb7d10-7401-4846-926d-b18b940538d1-maas-api-tls\") pod \"maas-api-e2e-mt-7edc7c10-76967fbf76-rt2l4\" (UID: \"29fb7d10-7401-4846-926d-b18b940538d1\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-7edc7c10-76967fbf76-rt2l4"
Jul 09 18:53:39.557458 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:53:39.557421    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/29fb7d10-7401-4846-926d-b18b940538d1-maas-api-tls\") pod \"maas-api-e2e-mt-7edc7c10-76967fbf76-rt2l4\" (UID: \"29fb7d10-7401-4846-926d-b18b940538d1\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-7edc7c10-76967fbf76-rt2l4"
Jul 09 18:53:39.557660 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:53:39.557506    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/29fb7d10-7401-4846-926d-b18b940538d1-openshift-service-ca\") pod \"maas-api-e2e-mt-7edc7c10-76967fbf76-rt2l4\" (UID: \"29fb7d10-7401-4846-926d-b18b940538d1\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-7edc7c10-76967fbf76-rt2l4"
Jul 09 18:53:39.557660 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:53:39.557576    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4sbmr\" (UniqueName: \"kubernetes.io/projected/29fb7d10-7401-4846-926d-b18b940538d1-kube-api-access-4sbmr\") pod \"maas-api-e2e-mt-7edc7c10-76967fbf76-rt2l4\" (UID: \"29fb7d10-7401-4846-926d-b18b940538d1\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-7edc7c10-76967fbf76-rt2l4"
Jul 09 18:53:39.557660 ip-10-0-141-101 kubenswrapper[2557]: E0709 18:53:39.557628    2557 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-mt-7edc7c10-serving-cert: secret "maas-api-e2e-mt-7edc7c10-serving-cert" not found
Jul 09 18:53:39.557803 ip-10-0-141-101 kubenswrapper[2557]: E0709 18:53:39.557717    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/29fb7d10-7401-4846-926d-b18b940538d1-maas-api-tls podName:29fb7d10-7401-4846-926d-b18b940538d1 nodeName:}" failed. No retries permitted until 2026-07-09 18:53:40.057694784 +0000 UTC m=+1689.297039421 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/29fb7d10-7401-4846-926d-b18b940538d1-maas-api-tls") pod "maas-api-e2e-mt-7edc7c10-76967fbf76-rt2l4" (UID: "29fb7d10-7401-4846-926d-b18b940538d1") : secret "maas-api-e2e-mt-7edc7c10-serving-cert" not found
Jul 09 18:53:39.558191 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:53:39.558171    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/29fb7d10-7401-4846-926d-b18b940538d1-openshift-service-ca\") pod \"maas-api-e2e-mt-7edc7c10-76967fbf76-rt2l4\" (UID: \"29fb7d10-7401-4846-926d-b18b940538d1\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-7edc7c10-76967fbf76-rt2l4"
Jul 09 18:53:39.569588 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:53:39.569556    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4sbmr\" (UniqueName: \"kubernetes.io/projected/29fb7d10-7401-4846-926d-b18b940538d1-kube-api-access-4sbmr\") pod \"maas-api-e2e-mt-7edc7c10-76967fbf76-rt2l4\" (UID: \"29fb7d10-7401-4846-926d-b18b940538d1\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-7edc7c10-76967fbf76-rt2l4"
Jul 09 18:53:40.062284 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:53:40.062249    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/29fb7d10-7401-4846-926d-b18b940538d1-maas-api-tls\") pod \"maas-api-e2e-mt-7edc7c10-76967fbf76-rt2l4\" (UID: \"29fb7d10-7401-4846-926d-b18b940538d1\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-7edc7c10-76967fbf76-rt2l4"
Jul 09 18:53:40.064717 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:53:40.064697    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/29fb7d10-7401-4846-926d-b18b940538d1-maas-api-tls\") pod \"maas-api-e2e-mt-7edc7c10-76967fbf76-rt2l4\" (UID: \"29fb7d10-7401-4846-926d-b18b940538d1\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-7edc7c10-76967fbf76-rt2l4"
Jul 09 18:53:40.274956 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:53:40.274920    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-7edc7c10-76967fbf76-rt2l4"
Jul 09 18:53:40.422377 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:53:40.422350    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-7edc7c10-76967fbf76-rt2l4"]
Jul 09 18:53:40.425098 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:53:40.425064    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod29fb7d10_7401_4846_926d_b18b940538d1.slice/crio-2050c8be61b92ff56d1985b5756caf2f64a8648800250e4a34065019eb10fde6 WatchSource:0}: Error finding container 2050c8be61b92ff56d1985b5756caf2f64a8648800250e4a34065019eb10fde6: Status 404 returned error can't find the container with id 2050c8be61b92ff56d1985b5756caf2f64a8648800250e4a34065019eb10fde6
Jul 09 18:53:40.446020 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:53:40.445987    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-7edc7c10-76967fbf76-rt2l4" event={"ID":"29fb7d10-7401-4846-926d-b18b940538d1","Type":"ContainerStarted","Data":"2050c8be61b92ff56d1985b5756caf2f64a8648800250e4a34065019eb10fde6"}
Jul 09 18:53:41.452854 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:53:41.452820    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-7edc7c10-76967fbf76-rt2l4" event={"ID":"29fb7d10-7401-4846-926d-b18b940538d1","Type":"ContainerStarted","Data":"4bd37751a01d84f48220901151638428fbf970a289ec36fe534c8d9408da83d4"}
Jul 09 18:53:41.453268 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:53:41.452994    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-7edc7c10-76967fbf76-rt2l4"
Jul 09 18:53:47.465194 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:53:47.465163    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-7edc7c10-76967fbf76-rt2l4"
Jul 09 18:53:47.492419 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:53:47.492342    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-mt-7edc7c10-76967fbf76-rt2l4" podStartSLOduration=7.920523242 podStartE2EDuration="8.492321364s" totalImagesPullingTime="571.798122ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 18:53:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 18:53:41.506011448 +0000 UTC m=+1690.745356072" watchObservedRunningTime="2026-07-09 18:53:47.492321364 +0000 UTC m=+1696.731665989"
Jul 09 18:53:52.466975 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:53:52.466941    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-7edc7c10-76967fbf76-rt2l4"]
Jul 09 18:53:52.467442 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:53:52.467229    2557 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-mt-7edc7c10-76967fbf76-rt2l4" podUID="29fb7d10-7401-4846-926d-b18b940538d1" containerName="maas-api" containerID="cri-o://4bd37751a01d84f48220901151638428fbf970a289ec36fe534c8d9408da83d4" gracePeriod=30
Jul 09 18:53:52.721194 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:53:52.721128    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-7edc7c10-76967fbf76-rt2l4"
Jul 09 18:53:52.886226 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:53:52.886132    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/29fb7d10-7401-4846-926d-b18b940538d1-maas-api-tls\") pod \"29fb7d10-7401-4846-926d-b18b940538d1\" (UID: \"29fb7d10-7401-4846-926d-b18b940538d1\") "
Jul 09 18:53:52.886401 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:53:52.886246    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/29fb7d10-7401-4846-926d-b18b940538d1-openshift-service-ca\") pod \"29fb7d10-7401-4846-926d-b18b940538d1\" (UID: \"29fb7d10-7401-4846-926d-b18b940538d1\") "
Jul 09 18:53:52.886401 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:53:52.886285    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4sbmr\" (UniqueName: \"kubernetes.io/projected/29fb7d10-7401-4846-926d-b18b940538d1-kube-api-access-4sbmr\") pod \"29fb7d10-7401-4846-926d-b18b940538d1\" (UID: \"29fb7d10-7401-4846-926d-b18b940538d1\") "
Jul 09 18:53:52.886675 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:53:52.886648    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/29fb7d10-7401-4846-926d-b18b940538d1-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "29fb7d10-7401-4846-926d-b18b940538d1" (UID: "29fb7d10-7401-4846-926d-b18b940538d1"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 09 18:53:52.888418 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:53:52.888392    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/29fb7d10-7401-4846-926d-b18b940538d1-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "29fb7d10-7401-4846-926d-b18b940538d1" (UID: "29fb7d10-7401-4846-926d-b18b940538d1"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 18:53:52.888520 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:53:52.888442    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/29fb7d10-7401-4846-926d-b18b940538d1-kube-api-access-4sbmr" (OuterVolumeSpecName: "kube-api-access-4sbmr") pod "29fb7d10-7401-4846-926d-b18b940538d1" (UID: "29fb7d10-7401-4846-926d-b18b940538d1"). InnerVolumeSpecName "kube-api-access-4sbmr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 18:53:52.987220 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:53:52.987131    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4sbmr\" (UniqueName: \"kubernetes.io/projected/29fb7d10-7401-4846-926d-b18b940538d1-kube-api-access-4sbmr\") on node \"ip-10-0-141-101.ec2.internal\" DevicePath \"\""
Jul 09 18:53:52.987220 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:53:52.987165    2557 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/29fb7d10-7401-4846-926d-b18b940538d1-maas-api-tls\") on node \"ip-10-0-141-101.ec2.internal\" DevicePath \"\""
Jul 09 18:53:52.987220 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:53:52.987174    2557 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/29fb7d10-7401-4846-926d-b18b940538d1-openshift-service-ca\") on node \"ip-10-0-141-101.ec2.internal\" DevicePath \"\""
Jul 09 18:53:53.526400 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:53:53.526295    2557 generic.go:356] "Generic (PLEG): container finished" podID="29fb7d10-7401-4846-926d-b18b940538d1" containerID="4bd37751a01d84f48220901151638428fbf970a289ec36fe534c8d9408da83d4" exitCode=0
Jul 09 18:53:53.526400 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:53:53.526364    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-7edc7c10-76967fbf76-rt2l4"
Jul 09 18:53:53.526400 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:53:53.526380    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-7edc7c10-76967fbf76-rt2l4" event={"ID":"29fb7d10-7401-4846-926d-b18b940538d1","Type":"ContainerDied","Data":"4bd37751a01d84f48220901151638428fbf970a289ec36fe534c8d9408da83d4"}
Jul 09 18:53:53.526947 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:53:53.526450    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-7edc7c10-76967fbf76-rt2l4" event={"ID":"29fb7d10-7401-4846-926d-b18b940538d1","Type":"ContainerDied","Data":"2050c8be61b92ff56d1985b5756caf2f64a8648800250e4a34065019eb10fde6"}
Jul 09 18:53:53.526947 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:53:53.526498    2557 scope.go:117] "RemoveContainer" containerID="4bd37751a01d84f48220901151638428fbf970a289ec36fe534c8d9408da83d4"
Jul 09 18:53:53.535893 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:53:53.535873    2557 scope.go:117] "RemoveContainer" containerID="4bd37751a01d84f48220901151638428fbf970a289ec36fe534c8d9408da83d4"
Jul 09 18:53:53.536165 ip-10-0-141-101 kubenswrapper[2557]: E0709 18:53:53.536147    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4bd37751a01d84f48220901151638428fbf970a289ec36fe534c8d9408da83d4\": container with ID starting with 4bd37751a01d84f48220901151638428fbf970a289ec36fe534c8d9408da83d4 not found: ID does not exist" containerID="4bd37751a01d84f48220901151638428fbf970a289ec36fe534c8d9408da83d4"
Jul 09 18:53:53.536229 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:53:53.536178    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4bd37751a01d84f48220901151638428fbf970a289ec36fe534c8d9408da83d4"} err="failed to get container status \"4bd37751a01d84f48220901151638428fbf970a289ec36fe534c8d9408da83d4\": rpc error: code = NotFound desc = could not find container \"4bd37751a01d84f48220901151638428fbf970a289ec36fe534c8d9408da83d4\": container with ID starting with 4bd37751a01d84f48220901151638428fbf970a289ec36fe534c8d9408da83d4 not found: ID does not exist"
Jul 09 18:53:53.547210 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:53:53.547183    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-7edc7c10-76967fbf76-rt2l4"]
Jul 09 18:53:53.550761 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:53:53.550740    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-7edc7c10-76967fbf76-rt2l4"]
Jul 09 18:53:55.262083 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:53:55.262053    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="29fb7d10-7401-4846-926d-b18b940538d1" path="/var/lib/kubelet/pods/29fb7d10-7401-4846-926d-b18b940538d1/volumes"
Jul 09 18:54:23.554419 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:54:23.554385    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-8a4ed68f-649dc76558-hd28n"]
Jul 09 18:54:23.554910 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:54:23.554826    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="29fb7d10-7401-4846-926d-b18b940538d1" containerName="maas-api"
Jul 09 18:54:23.554910 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:54:23.554838    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="29fb7d10-7401-4846-926d-b18b940538d1" containerName="maas-api"
Jul 09 18:54:23.554983 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:54:23.554915    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="29fb7d10-7401-4846-926d-b18b940538d1" containerName="maas-api"
Jul 09 18:54:23.558022 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:54:23.558006    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-8a4ed68f-649dc76558-hd28n"
Jul 09 18:54:23.561392 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:54:23.561359    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-mt-8a4ed68f-serving-cert\""
Jul 09 18:54:23.561570 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:54:23.561546    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 09 18:54:23.562064 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:54:23.562050    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-4zbc4\""
Jul 09 18:54:23.562112 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:54:23.562073    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 09 18:54:23.573372 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:54:23.573344    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-8a4ed68f-649dc76558-hd28n"]
Jul 09 18:54:23.661836 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:54:23.661797    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/64dcfd1f-389a-4d08-ae2c-081164971efc-openshift-service-ca\") pod \"maas-api-e2e-mt-8a4ed68f-649dc76558-hd28n\" (UID: \"64dcfd1f-389a-4d08-ae2c-081164971efc\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-8a4ed68f-649dc76558-hd28n"
Jul 09 18:54:23.662013 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:54:23.661848    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wvvpg\" (UniqueName: \"kubernetes.io/projected/64dcfd1f-389a-4d08-ae2c-081164971efc-kube-api-access-wvvpg\") pod \"maas-api-e2e-mt-8a4ed68f-649dc76558-hd28n\" (UID: \"64dcfd1f-389a-4d08-ae2c-081164971efc\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-8a4ed68f-649dc76558-hd28n"
Jul 09 18:54:23.662013 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:54:23.661921    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/64dcfd1f-389a-4d08-ae2c-081164971efc-maas-api-tls\") pod \"maas-api-e2e-mt-8a4ed68f-649dc76558-hd28n\" (UID: \"64dcfd1f-389a-4d08-ae2c-081164971efc\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-8a4ed68f-649dc76558-hd28n"
Jul 09 18:54:23.762971 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:54:23.762927    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/64dcfd1f-389a-4d08-ae2c-081164971efc-openshift-service-ca\") pod \"maas-api-e2e-mt-8a4ed68f-649dc76558-hd28n\" (UID: \"64dcfd1f-389a-4d08-ae2c-081164971efc\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-8a4ed68f-649dc76558-hd28n"
Jul 09 18:54:23.762971 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:54:23.762976    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wvvpg\" (UniqueName: \"kubernetes.io/projected/64dcfd1f-389a-4d08-ae2c-081164971efc-kube-api-access-wvvpg\") pod \"maas-api-e2e-mt-8a4ed68f-649dc76558-hd28n\" (UID: \"64dcfd1f-389a-4d08-ae2c-081164971efc\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-8a4ed68f-649dc76558-hd28n"
Jul 09 18:54:23.763255 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:54:23.763008    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/64dcfd1f-389a-4d08-ae2c-081164971efc-maas-api-tls\") pod \"maas-api-e2e-mt-8a4ed68f-649dc76558-hd28n\" (UID: \"64dcfd1f-389a-4d08-ae2c-081164971efc\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-8a4ed68f-649dc76558-hd28n"
Jul 09 18:54:23.763696 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:54:23.763670    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/64dcfd1f-389a-4d08-ae2c-081164971efc-openshift-service-ca\") pod \"maas-api-e2e-mt-8a4ed68f-649dc76558-hd28n\" (UID: \"64dcfd1f-389a-4d08-ae2c-081164971efc\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-8a4ed68f-649dc76558-hd28n"
Jul 09 18:54:23.765448 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:54:23.765429    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/64dcfd1f-389a-4d08-ae2c-081164971efc-maas-api-tls\") pod \"maas-api-e2e-mt-8a4ed68f-649dc76558-hd28n\" (UID: \"64dcfd1f-389a-4d08-ae2c-081164971efc\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-8a4ed68f-649dc76558-hd28n"
Jul 09 18:54:23.780157 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:54:23.780126    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wvvpg\" (UniqueName: \"kubernetes.io/projected/64dcfd1f-389a-4d08-ae2c-081164971efc-kube-api-access-wvvpg\") pod \"maas-api-e2e-mt-8a4ed68f-649dc76558-hd28n\" (UID: \"64dcfd1f-389a-4d08-ae2c-081164971efc\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-8a4ed68f-649dc76558-hd28n"
Jul 09 18:54:23.869185 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:54:23.869097    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-8a4ed68f-649dc76558-hd28n"
Jul 09 18:54:24.022824 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:54:24.022644    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-8a4ed68f-649dc76558-hd28n"]
Jul 09 18:54:24.026791 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:54:24.026758    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod64dcfd1f_389a_4d08_ae2c_081164971efc.slice/crio-7540cea8cac2b98f6f7a7080c74df3e605a3a14f0ede5695119cbc38410f9fd6 WatchSource:0}: Error finding container 7540cea8cac2b98f6f7a7080c74df3e605a3a14f0ede5695119cbc38410f9fd6: Status 404 returned error can't find the container with id 7540cea8cac2b98f6f7a7080c74df3e605a3a14f0ede5695119cbc38410f9fd6
Jul 09 18:54:24.697845 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:54:24.697751    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-8a4ed68f-649dc76558-hd28n" event={"ID":"64dcfd1f-389a-4d08-ae2c-081164971efc","Type":"ContainerStarted","Data":"697c4d1c8d64a3aa1822addc3c7655f29cfa32504af1e7eee0599b11197d1b5b"}
Jul 09 18:54:24.697845 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:54:24.697807    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-8a4ed68f-649dc76558-hd28n" event={"ID":"64dcfd1f-389a-4d08-ae2c-081164971efc","Type":"ContainerStarted","Data":"7540cea8cac2b98f6f7a7080c74df3e605a3a14f0ede5695119cbc38410f9fd6"}
Jul 09 18:54:24.697845 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:54:24.697828    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-8a4ed68f-649dc76558-hd28n"
Jul 09 18:54:24.735500 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:54:24.735412    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-mt-8a4ed68f-649dc76558-hd28n" podStartSLOduration=1.369881807 podStartE2EDuration="1.735390052s" totalImagesPullingTime="365.508245ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 18:54:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 18:54:24.733336335 +0000 UTC m=+1733.972680957" watchObservedRunningTime="2026-07-09 18:54:24.735390052 +0000 UTC m=+1733.974734679"
Jul 09 18:54:30.711223 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:54:30.711191    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-8a4ed68f-649dc76558-hd28n"
Jul 09 18:55:21.723787 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:55:21.723743    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-8a4ed68f-649dc76558-hd28n"]
Jul 09 18:55:21.724410 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:55:21.724022    2557 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-mt-8a4ed68f-649dc76558-hd28n" podUID="64dcfd1f-389a-4d08-ae2c-081164971efc" containerName="maas-api" containerID="cri-o://697c4d1c8d64a3aa1822addc3c7655f29cfa32504af1e7eee0599b11197d1b5b" gracePeriod=30
Jul 09 18:55:21.986327 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:55:21.986260    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-8a4ed68f-649dc76558-hd28n"
Jul 09 18:55:22.029233 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:55:22.029191    2557 generic.go:356] "Generic (PLEG): container finished" podID="64dcfd1f-389a-4d08-ae2c-081164971efc" containerID="697c4d1c8d64a3aa1822addc3c7655f29cfa32504af1e7eee0599b11197d1b5b" exitCode=0
Jul 09 18:55:22.029233 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:55:22.029237    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-8a4ed68f-649dc76558-hd28n"
Jul 09 18:55:22.029575 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:55:22.029230    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-8a4ed68f-649dc76558-hd28n" event={"ID":"64dcfd1f-389a-4d08-ae2c-081164971efc","Type":"ContainerDied","Data":"697c4d1c8d64a3aa1822addc3c7655f29cfa32504af1e7eee0599b11197d1b5b"}
Jul 09 18:55:22.029575 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:55:22.029364    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-8a4ed68f-649dc76558-hd28n" event={"ID":"64dcfd1f-389a-4d08-ae2c-081164971efc","Type":"ContainerDied","Data":"7540cea8cac2b98f6f7a7080c74df3e605a3a14f0ede5695119cbc38410f9fd6"}
Jul 09 18:55:22.029575 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:55:22.029387    2557 scope.go:117] "RemoveContainer" containerID="697c4d1c8d64a3aa1822addc3c7655f29cfa32504af1e7eee0599b11197d1b5b"
Jul 09 18:55:22.039572 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:55:22.039541    2557 scope.go:117] "RemoveContainer" containerID="697c4d1c8d64a3aa1822addc3c7655f29cfa32504af1e7eee0599b11197d1b5b"
Jul 09 18:55:22.039943 ip-10-0-141-101 kubenswrapper[2557]: E0709 18:55:22.039920    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"697c4d1c8d64a3aa1822addc3c7655f29cfa32504af1e7eee0599b11197d1b5b\": container with ID starting with 697c4d1c8d64a3aa1822addc3c7655f29cfa32504af1e7eee0599b11197d1b5b not found: ID does not exist" containerID="697c4d1c8d64a3aa1822addc3c7655f29cfa32504af1e7eee0599b11197d1b5b"
Jul 09 18:55:22.040013 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:55:22.039957    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"697c4d1c8d64a3aa1822addc3c7655f29cfa32504af1e7eee0599b11197d1b5b"} err="failed to get container status \"697c4d1c8d64a3aa1822addc3c7655f29cfa32504af1e7eee0599b11197d1b5b\": rpc error: code = NotFound desc = could not find container \"697c4d1c8d64a3aa1822addc3c7655f29cfa32504af1e7eee0599b11197d1b5b\": container with ID starting with 697c4d1c8d64a3aa1822addc3c7655f29cfa32504af1e7eee0599b11197d1b5b not found: ID does not exist"
Jul 09 18:55:22.130272 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:55:22.130230    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/64dcfd1f-389a-4d08-ae2c-081164971efc-maas-api-tls\") pod \"64dcfd1f-389a-4d08-ae2c-081164971efc\" (UID: \"64dcfd1f-389a-4d08-ae2c-081164971efc\") "
Jul 09 18:55:22.130441 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:55:22.130339    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wvvpg\" (UniqueName: \"kubernetes.io/projected/64dcfd1f-389a-4d08-ae2c-081164971efc-kube-api-access-wvvpg\") pod \"64dcfd1f-389a-4d08-ae2c-081164971efc\" (UID: \"64dcfd1f-389a-4d08-ae2c-081164971efc\") "
Jul 09 18:55:22.130441 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:55:22.130367    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/64dcfd1f-389a-4d08-ae2c-081164971efc-openshift-service-ca\") pod \"64dcfd1f-389a-4d08-ae2c-081164971efc\" (UID: \"64dcfd1f-389a-4d08-ae2c-081164971efc\") "
Jul 09 18:55:22.130802 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:55:22.130777    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/64dcfd1f-389a-4d08-ae2c-081164971efc-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "64dcfd1f-389a-4d08-ae2c-081164971efc" (UID: "64dcfd1f-389a-4d08-ae2c-081164971efc"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 09 18:55:22.132422 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:55:22.132382    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/64dcfd1f-389a-4d08-ae2c-081164971efc-kube-api-access-wvvpg" (OuterVolumeSpecName: "kube-api-access-wvvpg") pod "64dcfd1f-389a-4d08-ae2c-081164971efc" (UID: "64dcfd1f-389a-4d08-ae2c-081164971efc"). InnerVolumeSpecName "kube-api-access-wvvpg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 18:55:22.132556 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:55:22.132442    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/64dcfd1f-389a-4d08-ae2c-081164971efc-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "64dcfd1f-389a-4d08-ae2c-081164971efc" (UID: "64dcfd1f-389a-4d08-ae2c-081164971efc"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 18:55:22.231374 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:55:22.231329    2557 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/64dcfd1f-389a-4d08-ae2c-081164971efc-maas-api-tls\") on node \"ip-10-0-141-101.ec2.internal\" DevicePath \"\""
Jul 09 18:55:22.231374 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:55:22.231373    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wvvpg\" (UniqueName: \"kubernetes.io/projected/64dcfd1f-389a-4d08-ae2c-081164971efc-kube-api-access-wvvpg\") on node \"ip-10-0-141-101.ec2.internal\" DevicePath \"\""
Jul 09 18:55:22.231592 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:55:22.231388    2557 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/64dcfd1f-389a-4d08-ae2c-081164971efc-openshift-service-ca\") on node \"ip-10-0-141-101.ec2.internal\" DevicePath \"\""
Jul 09 18:55:22.373071 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:55:22.373030    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-8a4ed68f-649dc76558-hd28n"]
Jul 09 18:55:22.375735 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:55:22.375707    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-8a4ed68f-649dc76558-hd28n"]
Jul 09 18:55:23.262811 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:55:23.262712    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="64dcfd1f-389a-4d08-ae2c-081164971efc" path="/var/lib/kubelet/pods/64dcfd1f-389a-4d08-ae2c-081164971efc/volumes"
Jul 09 18:57:15.055100 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:57:15.055063    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-a-15a9af-openshift-default-569766755-t47d9"]
Jul 09 18:57:15.057622 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:57:15.055599    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="64dcfd1f-389a-4d08-ae2c-081164971efc" containerName="maas-api"
Jul 09 18:57:15.057622 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:57:15.055614    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="64dcfd1f-389a-4d08-ae2c-081164971efc" containerName="maas-api"
Jul 09 18:57:15.057622 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:57:15.055692    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="64dcfd1f-389a-4d08-ae2c-081164971efc" containerName="maas-api"
Jul 09 18:57:15.058717 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:57:15.058701    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-15a9af-openshift-default-569766755-t47d9"
Jul 09 18:57:15.062116 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:57:15.062095    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-a-15a9af-openshift-default-dockercfg-8p6x9\""
Jul 09 18:57:15.071746 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:57:15.071717    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-15a9af-openshift-default-569766755-t47d9"]
Jul 09 18:57:15.098435 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:57:15.098405    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/edda0506-ddb2-4324-a920-ab633bc718f6-workload-socket\") pod \"e2e-inf-a-15a9af-openshift-default-569766755-t47d9\" (UID: \"edda0506-ddb2-4324-a920-ab633bc718f6\") " pod="openshift-ingress/e2e-inf-a-15a9af-openshift-default-569766755-t47d9"
Jul 09 18:57:15.098607 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:57:15.098438    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/edda0506-ddb2-4324-a920-ab633bc718f6-credential-socket\") pod \"e2e-inf-a-15a9af-openshift-default-569766755-t47d9\" (UID: \"edda0506-ddb2-4324-a920-ab633bc718f6\") " pod="openshift-ingress/e2e-inf-a-15a9af-openshift-default-569766755-t47d9"
Jul 09 18:57:15.098607 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:57:15.098463    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/edda0506-ddb2-4324-a920-ab633bc718f6-istiod-ca-cert\") pod \"e2e-inf-a-15a9af-openshift-default-569766755-t47d9\" (UID: \"edda0506-ddb2-4324-a920-ab633bc718f6\") " pod="openshift-ingress/e2e-inf-a-15a9af-openshift-default-569766755-t47d9"
Jul 09 18:57:15.098607 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:57:15.098535    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hsgd4\" (UniqueName: \"kubernetes.io/projected/edda0506-ddb2-4324-a920-ab633bc718f6-kube-api-access-hsgd4\") pod \"e2e-inf-a-15a9af-openshift-default-569766755-t47d9\" (UID: \"edda0506-ddb2-4324-a920-ab633bc718f6\") " pod="openshift-ingress/e2e-inf-a-15a9af-openshift-default-569766755-t47d9"
Jul 09 18:57:15.098607 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:57:15.098566    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/edda0506-ddb2-4324-a920-ab633bc718f6-istio-token\") pod \"e2e-inf-a-15a9af-openshift-default-569766755-t47d9\" (UID: \"edda0506-ddb2-4324-a920-ab633bc718f6\") " pod="openshift-ingress/e2e-inf-a-15a9af-openshift-default-569766755-t47d9"
Jul 09 18:57:15.098749 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:57:15.098629    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/edda0506-ddb2-4324-a920-ab633bc718f6-istio-envoy\") pod \"e2e-inf-a-15a9af-openshift-default-569766755-t47d9\" (UID: \"edda0506-ddb2-4324-a920-ab633bc718f6\") " pod="openshift-ingress/e2e-inf-a-15a9af-openshift-default-569766755-t47d9"
Jul 09 18:57:15.098749 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:57:15.098705    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/edda0506-ddb2-4324-a920-ab633bc718f6-workload-certs\") pod \"e2e-inf-a-15a9af-openshift-default-569766755-t47d9\" (UID: \"edda0506-ddb2-4324-a920-ab633bc718f6\") " pod="openshift-ingress/e2e-inf-a-15a9af-openshift-default-569766755-t47d9"
Jul 09 18:57:15.098749 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:57:15.098736    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/edda0506-ddb2-4324-a920-ab633bc718f6-istio-podinfo\") pod \"e2e-inf-a-15a9af-openshift-default-569766755-t47d9\" (UID: \"edda0506-ddb2-4324-a920-ab633bc718f6\") " pod="openshift-ingress/e2e-inf-a-15a9af-openshift-default-569766755-t47d9"
Jul 09 18:57:15.098849 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:57:15.098765    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/edda0506-ddb2-4324-a920-ab633bc718f6-istio-data\") pod \"e2e-inf-a-15a9af-openshift-default-569766755-t47d9\" (UID: \"edda0506-ddb2-4324-a920-ab633bc718f6\") " pod="openshift-ingress/e2e-inf-a-15a9af-openshift-default-569766755-t47d9"
Jul 09 18:57:15.199926 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:57:15.199882    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/edda0506-ddb2-4324-a920-ab633bc718f6-istio-envoy\") pod \"e2e-inf-a-15a9af-openshift-default-569766755-t47d9\" (UID: \"edda0506-ddb2-4324-a920-ab633bc718f6\") " pod="openshift-ingress/e2e-inf-a-15a9af-openshift-default-569766755-t47d9"
Jul 09 18:57:15.200134 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:57:15.199944    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/edda0506-ddb2-4324-a920-ab633bc718f6-workload-certs\") pod \"e2e-inf-a-15a9af-openshift-default-569766755-t47d9\" (UID: \"edda0506-ddb2-4324-a920-ab633bc718f6\") " pod="openshift-ingress/e2e-inf-a-15a9af-openshift-default-569766755-t47d9"
Jul 09 18:57:15.200134 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:57:15.199972    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/edda0506-ddb2-4324-a920-ab633bc718f6-istio-podinfo\") pod \"e2e-inf-a-15a9af-openshift-default-569766755-t47d9\" (UID: \"edda0506-ddb2-4324-a920-ab633bc718f6\") " pod="openshift-ingress/e2e-inf-a-15a9af-openshift-default-569766755-t47d9"
Jul 09 18:57:15.200134 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:57:15.199993    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/edda0506-ddb2-4324-a920-ab633bc718f6-istio-data\") pod \"e2e-inf-a-15a9af-openshift-default-569766755-t47d9\" (UID: \"edda0506-ddb2-4324-a920-ab633bc718f6\") " pod="openshift-ingress/e2e-inf-a-15a9af-openshift-default-569766755-t47d9"
Jul 09 18:57:15.200134 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:57:15.200021    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/edda0506-ddb2-4324-a920-ab633bc718f6-workload-socket\") pod \"e2e-inf-a-15a9af-openshift-default-569766755-t47d9\" (UID: \"edda0506-ddb2-4324-a920-ab633bc718f6\") " pod="openshift-ingress/e2e-inf-a-15a9af-openshift-default-569766755-t47d9"
Jul 09 18:57:15.200134 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:57:15.200061    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/edda0506-ddb2-4324-a920-ab633bc718f6-credential-socket\") pod \"e2e-inf-a-15a9af-openshift-default-569766755-t47d9\" (UID: \"edda0506-ddb2-4324-a920-ab633bc718f6\") " pod="openshift-ingress/e2e-inf-a-15a9af-openshift-default-569766755-t47d9"
Jul 09 18:57:15.200500 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:57:15.200458    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/edda0506-ddb2-4324-a920-ab633bc718f6-workload-certs\") pod \"e2e-inf-a-15a9af-openshift-default-569766755-t47d9\" (UID: \"edda0506-ddb2-4324-a920-ab633bc718f6\") " pod="openshift-ingress/e2e-inf-a-15a9af-openshift-default-569766755-t47d9"
Jul 09 18:57:15.200693 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:57:15.200500    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/edda0506-ddb2-4324-a920-ab633bc718f6-credential-socket\") pod \"e2e-inf-a-15a9af-openshift-default-569766755-t47d9\" (UID: \"edda0506-ddb2-4324-a920-ab633bc718f6\") " pod="openshift-ingress/e2e-inf-a-15a9af-openshift-default-569766755-t47d9"
Jul 09 18:57:15.200693 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:57:15.200499    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/edda0506-ddb2-4324-a920-ab633bc718f6-istiod-ca-cert\") pod \"e2e-inf-a-15a9af-openshift-default-569766755-t47d9\" (UID: \"edda0506-ddb2-4324-a920-ab633bc718f6\") " pod="openshift-ingress/e2e-inf-a-15a9af-openshift-default-569766755-t47d9"
Jul 09 18:57:15.200880 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:57:15.200743    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hsgd4\" (UniqueName: \"kubernetes.io/projected/edda0506-ddb2-4324-a920-ab633bc718f6-kube-api-access-hsgd4\") pod \"e2e-inf-a-15a9af-openshift-default-569766755-t47d9\" (UID: \"edda0506-ddb2-4324-a920-ab633bc718f6\") " pod="openshift-ingress/e2e-inf-a-15a9af-openshift-default-569766755-t47d9"
Jul 09 18:57:15.200880 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:57:15.200544    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/edda0506-ddb2-4324-a920-ab633bc718f6-istio-data\") pod \"e2e-inf-a-15a9af-openshift-default-569766755-t47d9\" (UID: \"edda0506-ddb2-4324-a920-ab633bc718f6\") " pod="openshift-ingress/e2e-inf-a-15a9af-openshift-default-569766755-t47d9"
Jul 09 18:57:15.200880 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:57:15.200794    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/edda0506-ddb2-4324-a920-ab633bc718f6-istio-token\") pod \"e2e-inf-a-15a9af-openshift-default-569766755-t47d9\" (UID: \"edda0506-ddb2-4324-a920-ab633bc718f6\") " pod="openshift-ingress/e2e-inf-a-15a9af-openshift-default-569766755-t47d9"
Jul 09 18:57:15.200880 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:57:15.200582    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/edda0506-ddb2-4324-a920-ab633bc718f6-workload-socket\") pod \"e2e-inf-a-15a9af-openshift-default-569766755-t47d9\" (UID: \"edda0506-ddb2-4324-a920-ab633bc718f6\") " pod="openshift-ingress/e2e-inf-a-15a9af-openshift-default-569766755-t47d9"
Jul 09 18:57:15.201124 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:57:15.201086    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/edda0506-ddb2-4324-a920-ab633bc718f6-istiod-ca-cert\") pod \"e2e-inf-a-15a9af-openshift-default-569766755-t47d9\" (UID: \"edda0506-ddb2-4324-a920-ab633bc718f6\") " pod="openshift-ingress/e2e-inf-a-15a9af-openshift-default-569766755-t47d9"
Jul 09 18:57:15.202446 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:57:15.202421    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/edda0506-ddb2-4324-a920-ab633bc718f6-istio-envoy\") pod \"e2e-inf-a-15a9af-openshift-default-569766755-t47d9\" (UID: \"edda0506-ddb2-4324-a920-ab633bc718f6\") " pod="openshift-ingress/e2e-inf-a-15a9af-openshift-default-569766755-t47d9"
Jul 09 18:57:15.202673 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:57:15.202656    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/edda0506-ddb2-4324-a920-ab633bc718f6-istio-podinfo\") pod \"e2e-inf-a-15a9af-openshift-default-569766755-t47d9\" (UID: \"edda0506-ddb2-4324-a920-ab633bc718f6\") " pod="openshift-ingress/e2e-inf-a-15a9af-openshift-default-569766755-t47d9"
Jul 09 18:57:15.213831 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:57:15.213803    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hsgd4\" (UniqueName: \"kubernetes.io/projected/edda0506-ddb2-4324-a920-ab633bc718f6-kube-api-access-hsgd4\") pod \"e2e-inf-a-15a9af-openshift-default-569766755-t47d9\" (UID: \"edda0506-ddb2-4324-a920-ab633bc718f6\") " pod="openshift-ingress/e2e-inf-a-15a9af-openshift-default-569766755-t47d9"
Jul 09 18:57:15.214602 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:57:15.214584    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/edda0506-ddb2-4324-a920-ab633bc718f6-istio-token\") pod \"e2e-inf-a-15a9af-openshift-default-569766755-t47d9\" (UID: \"edda0506-ddb2-4324-a920-ab633bc718f6\") " pod="openshift-ingress/e2e-inf-a-15a9af-openshift-default-569766755-t47d9"
Jul 09 18:57:15.369763 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:57:15.369665    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-15a9af-openshift-default-569766755-t47d9"
Jul 09 18:57:15.522147 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:57:15.522116    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-15a9af-openshift-default-569766755-t47d9"]
Jul 09 18:57:15.523690 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:57:15.523661    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podedda0506_ddb2_4324_a920_ab633bc718f6.slice/crio-c1fba2b652f0326a129c4ca11a6f9b30ad6acbd122d1f0fceec31b8385d1953e WatchSource:0}: Error finding container c1fba2b652f0326a129c4ca11a6f9b30ad6acbd122d1f0fceec31b8385d1953e: Status 404 returned error can't find the container with id c1fba2b652f0326a129c4ca11a6f9b30ad6acbd122d1f0fceec31b8385d1953e
Jul 09 18:57:15.526253 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:57:15.526220    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 09 18:57:15.526342 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:57:15.526283    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 09 18:57:15.526342 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:57:15.526311    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 09 18:57:15.695397 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:57:15.695298    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-15a9af-openshift-default-569766755-t47d9" event={"ID":"edda0506-ddb2-4324-a920-ab633bc718f6","Type":"ContainerStarted","Data":"516f98e4307148c7cba143a5f9cfb0d944e1f64b45d4bc5deea054a4f2fca724"}
Jul 09 18:57:15.695397 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:57:15.695367    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-15a9af-openshift-default-569766755-t47d9" event={"ID":"edda0506-ddb2-4324-a920-ab633bc718f6","Type":"ContainerStarted","Data":"c1fba2b652f0326a129c4ca11a6f9b30ad6acbd122d1f0fceec31b8385d1953e"}
Jul 09 18:57:15.717301 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:57:15.717244    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-a-15a9af-openshift-default-569766755-t47d9" podStartSLOduration=0.71722674 podStartE2EDuration="717.22674ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 18:57:15 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 18:57:15.716244987 +0000 UTC m=+1904.955589662" watchObservedRunningTime="2026-07-09 18:57:15.71722674 +0000 UTC m=+1904.956571366"
Jul 09 18:57:16.370545 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:57:16.370510    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-15a9af-openshift-default-569766755-t47d9"
Jul 09 18:57:16.375622 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:57:16.375598    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-15a9af-openshift-default-569766755-t47d9"
Jul 09 18:57:16.702548 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:57:16.702434    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-15a9af-openshift-default-569766755-t47d9"
Jul 09 18:57:16.703466 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:57:16.703445    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-15a9af-openshift-default-569766755-t47d9"
Jul 09 18:57:22.903820 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:57:22.903771    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-b-86d225-openshift-default-8f6bb8745-dl9c7"]
Jul 09 18:57:22.908183 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:57:22.908160    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-86d225-openshift-default-8f6bb8745-dl9c7"
Jul 09 18:57:22.910645 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:57:22.910625    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-b-86d225-openshift-default-dockercfg-4qskd\""
Jul 09 18:57:22.922002 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:57:22.921978    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-86d225-openshift-default-8f6bb8745-dl9c7"]
Jul 09 18:57:22.980852 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:57:22.980818    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/267ef97a-b1e4-423c-8536-004fae9cac46-istio-token\") pod \"e2e-inf-b-86d225-openshift-default-8f6bb8745-dl9c7\" (UID: \"267ef97a-b1e4-423c-8536-004fae9cac46\") " pod="openshift-ingress/e2e-inf-b-86d225-openshift-default-8f6bb8745-dl9c7"
Jul 09 18:57:22.980852 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:57:22.980854    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/267ef97a-b1e4-423c-8536-004fae9cac46-istio-data\") pod \"e2e-inf-b-86d225-openshift-default-8f6bb8745-dl9c7\" (UID: \"267ef97a-b1e4-423c-8536-004fae9cac46\") " pod="openshift-ingress/e2e-inf-b-86d225-openshift-default-8f6bb8745-dl9c7"
Jul 09 18:57:22.981147 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:57:22.980998    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/267ef97a-b1e4-423c-8536-004fae9cac46-istio-podinfo\") pod \"e2e-inf-b-86d225-openshift-default-8f6bb8745-dl9c7\" (UID: \"267ef97a-b1e4-423c-8536-004fae9cac46\") " pod="openshift-ingress/e2e-inf-b-86d225-openshift-default-8f6bb8745-dl9c7"
Jul 09 18:57:22.981147 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:57:22.981055    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/267ef97a-b1e4-423c-8536-004fae9cac46-istio-envoy\") pod \"e2e-inf-b-86d225-openshift-default-8f6bb8745-dl9c7\" (UID: \"267ef97a-b1e4-423c-8536-004fae9cac46\") " pod="openshift-ingress/e2e-inf-b-86d225-openshift-default-8f6bb8745-dl9c7"
Jul 09 18:57:22.981147 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:57:22.981091    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tnn4z\" (UniqueName: \"kubernetes.io/projected/267ef97a-b1e4-423c-8536-004fae9cac46-kube-api-access-tnn4z\") pod \"e2e-inf-b-86d225-openshift-default-8f6bb8745-dl9c7\" (UID: \"267ef97a-b1e4-423c-8536-004fae9cac46\") " pod="openshift-ingress/e2e-inf-b-86d225-openshift-default-8f6bb8745-dl9c7"
Jul 09 18:57:22.981147 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:57:22.981127    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/267ef97a-b1e4-423c-8536-004fae9cac46-workload-certs\") pod \"e2e-inf-b-86d225-openshift-default-8f6bb8745-dl9c7\" (UID: \"267ef97a-b1e4-423c-8536-004fae9cac46\") " pod="openshift-ingress/e2e-inf-b-86d225-openshift-default-8f6bb8745-dl9c7"
Jul 09 18:57:22.981367 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:57:22.981187    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/267ef97a-b1e4-423c-8536-004fae9cac46-workload-socket\") pod \"e2e-inf-b-86d225-openshift-default-8f6bb8745-dl9c7\" (UID: \"267ef97a-b1e4-423c-8536-004fae9cac46\") " pod="openshift-ingress/e2e-inf-b-86d225-openshift-default-8f6bb8745-dl9c7"
Jul 09 18:57:22.981367 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:57:22.981238    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/267ef97a-b1e4-423c-8536-004fae9cac46-credential-socket\") pod \"e2e-inf-b-86d225-openshift-default-8f6bb8745-dl9c7\" (UID: \"267ef97a-b1e4-423c-8536-004fae9cac46\") " pod="openshift-ingress/e2e-inf-b-86d225-openshift-default-8f6bb8745-dl9c7"
Jul 09 18:57:22.981367 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:57:22.981294    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/267ef97a-b1e4-423c-8536-004fae9cac46-istiod-ca-cert\") pod \"e2e-inf-b-86d225-openshift-default-8f6bb8745-dl9c7\" (UID: \"267ef97a-b1e4-423c-8536-004fae9cac46\") " pod="openshift-ingress/e2e-inf-b-86d225-openshift-default-8f6bb8745-dl9c7"
Jul 09 18:57:23.082468 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:57:23.082428    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/267ef97a-b1e4-423c-8536-004fae9cac46-istiod-ca-cert\") pod \"e2e-inf-b-86d225-openshift-default-8f6bb8745-dl9c7\" (UID: \"267ef97a-b1e4-423c-8536-004fae9cac46\") " pod="openshift-ingress/e2e-inf-b-86d225-openshift-default-8f6bb8745-dl9c7"
Jul 09 18:57:23.082703 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:57:23.082545    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/267ef97a-b1e4-423c-8536-004fae9cac46-istio-token\") pod \"e2e-inf-b-86d225-openshift-default-8f6bb8745-dl9c7\" (UID: \"267ef97a-b1e4-423c-8536-004fae9cac46\") " pod="openshift-ingress/e2e-inf-b-86d225-openshift-default-8f6bb8745-dl9c7"
Jul 09 18:57:23.082703 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:57:23.082585    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/267ef97a-b1e4-423c-8536-004fae9cac46-istio-data\") pod \"e2e-inf-b-86d225-openshift-default-8f6bb8745-dl9c7\" (UID: \"267ef97a-b1e4-423c-8536-004fae9cac46\") " pod="openshift-ingress/e2e-inf-b-86d225-openshift-default-8f6bb8745-dl9c7"
Jul 09 18:57:23.082703 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:57:23.082635    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/267ef97a-b1e4-423c-8536-004fae9cac46-istio-podinfo\") pod \"e2e-inf-b-86d225-openshift-default-8f6bb8745-dl9c7\" (UID: \"267ef97a-b1e4-423c-8536-004fae9cac46\") " pod="openshift-ingress/e2e-inf-b-86d225-openshift-default-8f6bb8745-dl9c7"
Jul 09 18:57:23.082703 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:57:23.082658    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/267ef97a-b1e4-423c-8536-004fae9cac46-istio-envoy\") pod \"e2e-inf-b-86d225-openshift-default-8f6bb8745-dl9c7\" (UID: \"267ef97a-b1e4-423c-8536-004fae9cac46\") " pod="openshift-ingress/e2e-inf-b-86d225-openshift-default-8f6bb8745-dl9c7"
Jul 09 18:57:23.082703 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:57:23.082680    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tnn4z\" (UniqueName: \"kubernetes.io/projected/267ef97a-b1e4-423c-8536-004fae9cac46-kube-api-access-tnn4z\") pod \"e2e-inf-b-86d225-openshift-default-8f6bb8745-dl9c7\" (UID: \"267ef97a-b1e4-423c-8536-004fae9cac46\") " pod="openshift-ingress/e2e-inf-b-86d225-openshift-default-8f6bb8745-dl9c7"
Jul 09 18:57:23.082982 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:57:23.082707    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/267ef97a-b1e4-423c-8536-004fae9cac46-workload-certs\") pod \"e2e-inf-b-86d225-openshift-default-8f6bb8745-dl9c7\" (UID: \"267ef97a-b1e4-423c-8536-004fae9cac46\") " pod="openshift-ingress/e2e-inf-b-86d225-openshift-default-8f6bb8745-dl9c7"
Jul 09 18:57:23.082982 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:57:23.082743    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/267ef97a-b1e4-423c-8536-004fae9cac46-workload-socket\") pod \"e2e-inf-b-86d225-openshift-default-8f6bb8745-dl9c7\" (UID: \"267ef97a-b1e4-423c-8536-004fae9cac46\") " pod="openshift-ingress/e2e-inf-b-86d225-openshift-default-8f6bb8745-dl9c7"
Jul 09 18:57:23.082982 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:57:23.082774    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/267ef97a-b1e4-423c-8536-004fae9cac46-credential-socket\") pod \"e2e-inf-b-86d225-openshift-default-8f6bb8745-dl9c7\" (UID: \"267ef97a-b1e4-423c-8536-004fae9cac46\") " pod="openshift-ingress/e2e-inf-b-86d225-openshift-default-8f6bb8745-dl9c7"
Jul 09 18:57:23.083147 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:57:23.083107    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/267ef97a-b1e4-423c-8536-004fae9cac46-istio-data\") pod \"e2e-inf-b-86d225-openshift-default-8f6bb8745-dl9c7\" (UID: \"267ef97a-b1e4-423c-8536-004fae9cac46\") " pod="openshift-ingress/e2e-inf-b-86d225-openshift-default-8f6bb8745-dl9c7"
Jul 09 18:57:23.083286 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:57:23.083257    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/267ef97a-b1e4-423c-8536-004fae9cac46-credential-socket\") pod \"e2e-inf-b-86d225-openshift-default-8f6bb8745-dl9c7\" (UID: \"267ef97a-b1e4-423c-8536-004fae9cac46\") " pod="openshift-ingress/e2e-inf-b-86d225-openshift-default-8f6bb8745-dl9c7"
Jul 09 18:57:23.083415 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:57:23.083294    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/267ef97a-b1e4-423c-8536-004fae9cac46-workload-socket\") pod \"e2e-inf-b-86d225-openshift-default-8f6bb8745-dl9c7\" (UID: \"267ef97a-b1e4-423c-8536-004fae9cac46\") " pod="openshift-ingress/e2e-inf-b-86d225-openshift-default-8f6bb8745-dl9c7"
Jul 09 18:57:23.083415 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:57:23.083348    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/267ef97a-b1e4-423c-8536-004fae9cac46-istiod-ca-cert\") pod \"e2e-inf-b-86d225-openshift-default-8f6bb8745-dl9c7\" (UID: \"267ef97a-b1e4-423c-8536-004fae9cac46\") " pod="openshift-ingress/e2e-inf-b-86d225-openshift-default-8f6bb8745-dl9c7"
Jul 09 18:57:23.083578 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:57:23.083513    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/267ef97a-b1e4-423c-8536-004fae9cac46-workload-certs\") pod \"e2e-inf-b-86d225-openshift-default-8f6bb8745-dl9c7\" (UID: \"267ef97a-b1e4-423c-8536-004fae9cac46\") " pod="openshift-ingress/e2e-inf-b-86d225-openshift-default-8f6bb8745-dl9c7"
Jul 09 18:57:23.085146 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:57:23.085120    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/267ef97a-b1e4-423c-8536-004fae9cac46-istio-envoy\") pod \"e2e-inf-b-86d225-openshift-default-8f6bb8745-dl9c7\" (UID: \"267ef97a-b1e4-423c-8536-004fae9cac46\") " pod="openshift-ingress/e2e-inf-b-86d225-openshift-default-8f6bb8745-dl9c7"
Jul 09 18:57:23.085427 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:57:23.085410    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/267ef97a-b1e4-423c-8536-004fae9cac46-istio-podinfo\") pod \"e2e-inf-b-86d225-openshift-default-8f6bb8745-dl9c7\" (UID: \"267ef97a-b1e4-423c-8536-004fae9cac46\") " pod="openshift-ingress/e2e-inf-b-86d225-openshift-default-8f6bb8745-dl9c7"
Jul 09 18:57:23.091855 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:57:23.091836    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/267ef97a-b1e4-423c-8536-004fae9cac46-istio-token\") pod \"e2e-inf-b-86d225-openshift-default-8f6bb8745-dl9c7\" (UID: \"267ef97a-b1e4-423c-8536-004fae9cac46\") " pod="openshift-ingress/e2e-inf-b-86d225-openshift-default-8f6bb8745-dl9c7"
Jul 09 18:57:23.097499 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:57:23.095179    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tnn4z\" (UniqueName: \"kubernetes.io/projected/267ef97a-b1e4-423c-8536-004fae9cac46-kube-api-access-tnn4z\") pod \"e2e-inf-b-86d225-openshift-default-8f6bb8745-dl9c7\" (UID: \"267ef97a-b1e4-423c-8536-004fae9cac46\") " pod="openshift-ingress/e2e-inf-b-86d225-openshift-default-8f6bb8745-dl9c7"
Jul 09 18:57:23.219510 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:57:23.219392    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-86d225-openshift-default-8f6bb8745-dl9c7"
Jul 09 18:57:23.381674 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:57:23.381646    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-86d225-openshift-default-8f6bb8745-dl9c7"]
Jul 09 18:57:23.382977 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:57:23.382954    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod267ef97a_b1e4_423c_8536_004fae9cac46.slice/crio-ed8cf01ec8e642b668bf4f3391988571bf1710bded88d30ff54798501898a94e WatchSource:0}: Error finding container ed8cf01ec8e642b668bf4f3391988571bf1710bded88d30ff54798501898a94e: Status 404 returned error can't find the container with id ed8cf01ec8e642b668bf4f3391988571bf1710bded88d30ff54798501898a94e
Jul 09 18:57:23.385142 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:57:23.385104    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 09 18:57:23.385210 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:57:23.385173    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 09 18:57:23.385247 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:57:23.385217    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 09 18:57:23.745214 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:57:23.745175    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-86d225-openshift-default-8f6bb8745-dl9c7" event={"ID":"267ef97a-b1e4-423c-8536-004fae9cac46","Type":"ContainerStarted","Data":"fb65f4d7f161ff5f6951f08b0ae21e2e227059bb491919d99092004d31828c4c"}
Jul 09 18:57:23.745423 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:57:23.745231    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-86d225-openshift-default-8f6bb8745-dl9c7" event={"ID":"267ef97a-b1e4-423c-8536-004fae9cac46","Type":"ContainerStarted","Data":"ed8cf01ec8e642b668bf4f3391988571bf1710bded88d30ff54798501898a94e"}
Jul 09 18:57:23.770016 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:57:23.769967    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-b-86d225-openshift-default-8f6bb8745-dl9c7" podStartSLOduration=1.769947269 podStartE2EDuration="1.769947269s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 18:57:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 18:57:23.768638267 +0000 UTC m=+1913.007982922" watchObservedRunningTime="2026-07-09 18:57:23.769947269 +0000 UTC m=+1913.009291897"
Jul 09 18:57:24.219574 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:57:24.219536    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-86d225-openshift-default-8f6bb8745-dl9c7"
Jul 09 18:57:24.225093 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:57:24.225063    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-86d225-openshift-default-8f6bb8745-dl9c7"
Jul 09 18:57:24.750869 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:57:24.750836    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-86d225-openshift-default-8f6bb8745-dl9c7"
Jul 09 18:57:24.751927 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:57:24.751908    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-86d225-openshift-default-8f6bb8745-dl9c7"
Jul 09 18:57:32.743712 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:57:32.743652    2557 patch_prober.go:28] interesting pod/e2e-inf-a-15a9af-openshift-default-569766755-t47d9 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.60:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Jul 09 18:57:32.744310 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:57:32.743743    2557 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-a-15a9af-openshift-default-569766755-t47d9" podUID="edda0506-ddb2-4324-a920-ab633bc718f6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.60:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Jul 09 18:57:33.805211 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:57:33.805175    2557 generic.go:356] "Generic (PLEG): container finished" podID="edda0506-ddb2-4324-a920-ab633bc718f6" containerID="516f98e4307148c7cba143a5f9cfb0d944e1f64b45d4bc5deea054a4f2fca724" exitCode=0
Jul 09 18:57:33.805640 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:57:33.805220    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-15a9af-openshift-default-569766755-t47d9" event={"ID":"edda0506-ddb2-4324-a920-ab633bc718f6","Type":"ContainerDied","Data":"516f98e4307148c7cba143a5f9cfb0d944e1f64b45d4bc5deea054a4f2fca724"}
Jul 09 18:57:33.805707 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:57:33.805642    2557 scope.go:117] "RemoveContainer" containerID="516f98e4307148c7cba143a5f9cfb0d944e1f64b45d4bc5deea054a4f2fca724"
Jul 09 18:57:33.806683 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:57:33.806650    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 09 18:57:33.806796 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:57:33.806716    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 09 18:57:33.806796 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:57:33.806749    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 09 18:57:34.813344 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:57:34.813306    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-15a9af-openshift-default-569766755-t47d9" event={"ID":"edda0506-ddb2-4324-a920-ab633bc718f6","Type":"ContainerStarted","Data":"7091775af38fa6ccad4f071b237a6c005104a69b0222c5f0aacb25d3db7cd590"}
Jul 09 18:57:35.370918 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:57:35.370872    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-15a9af-openshift-default-569766755-t47d9"
Jul 09 18:57:35.371533 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:57:35.371171    2557 patch_prober.go:28] interesting pod/e2e-inf-a-15a9af-openshift-default-569766755-t47d9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.60:15021/healthz/ready\": dial tcp 10.133.0.60:15021: connect: connection refused" start-of-body=
Jul 09 18:57:35.371533 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:57:35.371227    2557 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-15a9af-openshift-default-569766755-t47d9" podUID="edda0506-ddb2-4324-a920-ab633bc718f6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.60:15021/healthz/ready\": dial tcp 10.133.0.60:15021: connect: connection refused"
Jul 09 18:57:36.370764 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:57:36.370728    2557 patch_prober.go:28] interesting pod/e2e-inf-a-15a9af-openshift-default-569766755-t47d9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.60:15021/healthz/ready\": dial tcp 10.133.0.60:15021: connect: connection refused" start-of-body=
Jul 09 18:57:36.371350 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:57:36.371320    2557 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-15a9af-openshift-default-569766755-t47d9" podUID="edda0506-ddb2-4324-a920-ab633bc718f6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.60:15021/healthz/ready\": dial tcp 10.133.0.60:15021: connect: connection refused"
Jul 09 18:57:37.371076 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:57:37.371019    2557 patch_prober.go:28] interesting pod/e2e-inf-a-15a9af-openshift-default-569766755-t47d9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.60:15021/healthz/ready\": dial tcp 10.133.0.60:15021: connect: connection refused" start-of-body=
Jul 09 18:57:37.371619 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:57:37.371103    2557 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-15a9af-openshift-default-569766755-t47d9" podUID="edda0506-ddb2-4324-a920-ab633bc718f6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.60:15021/healthz/ready\": dial tcp 10.133.0.60:15021: connect: connection refused"
Jul 09 18:57:38.370682 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:57:38.370641    2557 patch_prober.go:28] interesting pod/e2e-inf-a-15a9af-openshift-default-569766755-t47d9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.60:15021/healthz/ready\": dial tcp 10.133.0.60:15021: connect: connection refused" start-of-body=
Jul 09 18:57:38.371022 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:57:38.370991    2557 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-15a9af-openshift-default-569766755-t47d9" podUID="edda0506-ddb2-4324-a920-ab633bc718f6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.60:15021/healthz/ready\": dial tcp 10.133.0.60:15021: connect: connection refused"
Jul 09 18:57:39.374508 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:57:39.374455    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-15a9af-openshift-default-569766755-t47d9"
Jul 09 18:57:39.375045 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:57:39.375030    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-15a9af-openshift-default-569766755-t47d9"
Jul 09 18:57:39.375817 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:57:39.375792    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-15a9af-openshift-default-569766755-t47d9"
Jul 09 18:57:40.792649 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:57:40.792607    2557 patch_prober.go:28] interesting pod/e2e-inf-b-86d225-openshift-default-8f6bb8745-dl9c7 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.61:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Jul 09 18:57:40.793062 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:57:40.792683    2557 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-b-86d225-openshift-default-8f6bb8745-dl9c7" podUID="267ef97a-b1e4-423c-8536-004fae9cac46" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.61:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Jul 09 18:57:42.874836 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:57:42.874800    2557 generic.go:356] "Generic (PLEG): container finished" podID="267ef97a-b1e4-423c-8536-004fae9cac46" containerID="fb65f4d7f161ff5f6951f08b0ae21e2e227059bb491919d99092004d31828c4c" exitCode=0
Jul 09 18:57:42.875284 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:57:42.874880    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-86d225-openshift-default-8f6bb8745-dl9c7" event={"ID":"267ef97a-b1e4-423c-8536-004fae9cac46","Type":"ContainerDied","Data":"fb65f4d7f161ff5f6951f08b0ae21e2e227059bb491919d99092004d31828c4c"}
Jul 09 18:57:42.875352 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:57:42.875337    2557 scope.go:117] "RemoveContainer" containerID="fb65f4d7f161ff5f6951f08b0ae21e2e227059bb491919d99092004d31828c4c"
Jul 09 18:57:42.876458 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:57:42.876429    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 09 18:57:42.876561 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:57:42.876543    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 09 18:57:42.876602 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:57:42.876588    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 09 18:57:43.882707 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:57:43.882671    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-86d225-openshift-default-8f6bb8745-dl9c7" event={"ID":"267ef97a-b1e4-423c-8536-004fae9cac46","Type":"ContainerStarted","Data":"89d55c5786c2fd606319c66ababeb2744f06df749c741a6207261df82281febd"}
Jul 09 18:57:44.220357 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:57:44.220265    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-86d225-openshift-default-8f6bb8745-dl9c7"
Jul 09 18:57:44.220553 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:57:44.220529    2557 patch_prober.go:28] interesting pod/e2e-inf-b-86d225-openshift-default-8f6bb8745-dl9c7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.61:15021/healthz/ready\": dial tcp 10.133.0.61:15021: connect: connection refused" start-of-body=
Jul 09 18:57:44.220627 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:57:44.220608    2557 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-86d225-openshift-default-8f6bb8745-dl9c7" podUID="267ef97a-b1e4-423c-8536-004fae9cac46" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.61:15021/healthz/ready\": dial tcp 10.133.0.61:15021: connect: connection refused"
Jul 09 18:57:45.220665 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:57:45.220629    2557 patch_prober.go:28] interesting pod/e2e-inf-b-86d225-openshift-default-8f6bb8745-dl9c7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.61:15021/healthz/ready\": dial tcp 10.133.0.61:15021: connect: connection refused" start-of-body=
Jul 09 18:57:45.221097 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:57:45.220690    2557 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-86d225-openshift-default-8f6bb8745-dl9c7" podUID="267ef97a-b1e4-423c-8536-004fae9cac46" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.61:15021/healthz/ready\": dial tcp 10.133.0.61:15021: connect: connection refused"
Jul 09 18:57:46.220162 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:57:46.220125    2557 patch_prober.go:28] interesting pod/e2e-inf-b-86d225-openshift-default-8f6bb8745-dl9c7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.61:15021/healthz/ready\": dial tcp 10.133.0.61:15021: connect: connection refused" start-of-body=
Jul 09 18:57:46.220346 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:57:46.220181    2557 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-86d225-openshift-default-8f6bb8745-dl9c7" podUID="267ef97a-b1e4-423c-8536-004fae9cac46" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.61:15021/healthz/ready\": dial tcp 10.133.0.61:15021: connect: connection refused"
Jul 09 18:57:47.220672 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:57:47.220635    2557 patch_prober.go:28] interesting pod/e2e-inf-b-86d225-openshift-default-8f6bb8745-dl9c7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.61:15021/healthz/ready\": dial tcp 10.133.0.61:15021: connect: connection refused" start-of-body=
Jul 09 18:57:47.221099 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:57:47.220690    2557 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-86d225-openshift-default-8f6bb8745-dl9c7" podUID="267ef97a-b1e4-423c-8536-004fae9cac46" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.61:15021/healthz/ready\": dial tcp 10.133.0.61:15021: connect: connection refused"
Jul 09 18:57:48.224201 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:57:48.224168    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-86d225-openshift-default-8f6bb8745-dl9c7"
Jul 09 18:57:48.224679 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:57:48.224501    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-86d225-openshift-default-8f6bb8745-dl9c7"
Jul 09 18:57:48.225205 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:57:48.225185    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-86d225-openshift-default-8f6bb8745-dl9c7"
Jul 09 18:59:23.892537 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:59:23.892494    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-15a9af-openshift-default-569766755-t47d9"]
Jul 09 18:59:23.893051 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:59:23.892734    2557 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-a-15a9af-openshift-default-569766755-t47d9" podUID="edda0506-ddb2-4324-a920-ab633bc718f6" containerName="istio-proxy" containerID="cri-o://7091775af38fa6ccad4f071b237a6c005104a69b0222c5f0aacb25d3db7cd590" gracePeriod=30
Jul 09 18:59:24.377493 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:59:24.377438    2557 patch_prober.go:28] interesting pod/e2e-inf-a-15a9af-openshift-default-569766755-t47d9 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 09 18:59:24.377663 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:59:24.377544    2557 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-a-15a9af-openshift-default-569766755-t47d9" podUID="edda0506-ddb2-4324-a920-ab633bc718f6" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 09 18:59:29.156820 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:59:29.156751    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-15a9af-openshift-default-569766755-t47d9"
Jul 09 18:59:29.230347 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:59:29.230314    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/edda0506-ddb2-4324-a920-ab633bc718f6-workload-socket\") pod \"edda0506-ddb2-4324-a920-ab633bc718f6\" (UID: \"edda0506-ddb2-4324-a920-ab633bc718f6\") "
Jul 09 18:59:29.230529 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:59:29.230358    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hsgd4\" (UniqueName: \"kubernetes.io/projected/edda0506-ddb2-4324-a920-ab633bc718f6-kube-api-access-hsgd4\") pod \"edda0506-ddb2-4324-a920-ab633bc718f6\" (UID: \"edda0506-ddb2-4324-a920-ab633bc718f6\") "
Jul 09 18:59:29.230529 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:59:29.230376    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/edda0506-ddb2-4324-a920-ab633bc718f6-istio-envoy\") pod \"edda0506-ddb2-4324-a920-ab633bc718f6\" (UID: \"edda0506-ddb2-4324-a920-ab633bc718f6\") "
Jul 09 18:59:29.230529 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:59:29.230415    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/edda0506-ddb2-4324-a920-ab633bc718f6-istio-data\") pod \"edda0506-ddb2-4324-a920-ab633bc718f6\" (UID: \"edda0506-ddb2-4324-a920-ab633bc718f6\") "
Jul 09 18:59:29.230529 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:59:29.230437    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/edda0506-ddb2-4324-a920-ab633bc718f6-istio-podinfo\") pod \"edda0506-ddb2-4324-a920-ab633bc718f6\" (UID: \"edda0506-ddb2-4324-a920-ab633bc718f6\") "
Jul 09 18:59:29.230529 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:59:29.230518    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/edda0506-ddb2-4324-a920-ab633bc718f6-credential-socket\") pod \"edda0506-ddb2-4324-a920-ab633bc718f6\" (UID: \"edda0506-ddb2-4324-a920-ab633bc718f6\") "
Jul 09 18:59:29.230784 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:59:29.230552    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/edda0506-ddb2-4324-a920-ab633bc718f6-istiod-ca-cert\") pod \"edda0506-ddb2-4324-a920-ab633bc718f6\" (UID: \"edda0506-ddb2-4324-a920-ab633bc718f6\") "
Jul 09 18:59:29.230784 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:59:29.230572    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/edda0506-ddb2-4324-a920-ab633bc718f6-workload-certs\") pod \"edda0506-ddb2-4324-a920-ab633bc718f6\" (UID: \"edda0506-ddb2-4324-a920-ab633bc718f6\") "
Jul 09 18:59:29.230784 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:59:29.230624    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/edda0506-ddb2-4324-a920-ab633bc718f6-istio-token\") pod \"edda0506-ddb2-4324-a920-ab633bc718f6\" (UID: \"edda0506-ddb2-4324-a920-ab633bc718f6\") "
Jul 09 18:59:29.230784 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:59:29.230663    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/edda0506-ddb2-4324-a920-ab633bc718f6-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "edda0506-ddb2-4324-a920-ab633bc718f6" (UID: "edda0506-ddb2-4324-a920-ab633bc718f6"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 18:59:29.231050 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:59:29.230819    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/edda0506-ddb2-4324-a920-ab633bc718f6-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "edda0506-ddb2-4324-a920-ab633bc718f6" (UID: "edda0506-ddb2-4324-a920-ab633bc718f6"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 18:59:29.231050 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:59:29.230913    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/edda0506-ddb2-4324-a920-ab633bc718f6-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "edda0506-ddb2-4324-a920-ab633bc718f6" (UID: "edda0506-ddb2-4324-a920-ab633bc718f6"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 18:59:29.231050 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:59:29.231001    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/edda0506-ddb2-4324-a920-ab633bc718f6-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "edda0506-ddb2-4324-a920-ab633bc718f6" (UID: "edda0506-ddb2-4324-a920-ab633bc718f6"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 09 18:59:29.231050 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:59:29.231021    2557 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/edda0506-ddb2-4324-a920-ab633bc718f6-credential-socket\") on node \"ip-10-0-141-101.ec2.internal\" DevicePath \"\""
Jul 09 18:59:29.231050 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:59:29.231041    2557 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/edda0506-ddb2-4324-a920-ab633bc718f6-workload-certs\") on node \"ip-10-0-141-101.ec2.internal\" DevicePath \"\""
Jul 09 18:59:29.231321 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:59:29.231055    2557 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/edda0506-ddb2-4324-a920-ab633bc718f6-workload-socket\") on node \"ip-10-0-141-101.ec2.internal\" DevicePath \"\""
Jul 09 18:59:29.231814 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:59:29.231783    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/edda0506-ddb2-4324-a920-ab633bc718f6-istio-data" (OuterVolumeSpecName: "istio-data") pod "edda0506-ddb2-4324-a920-ab633bc718f6" (UID: "edda0506-ddb2-4324-a920-ab633bc718f6"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 18:59:29.232724 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:59:29.232697    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/edda0506-ddb2-4324-a920-ab633bc718f6-istio-token" (OuterVolumeSpecName: "istio-token") pod "edda0506-ddb2-4324-a920-ab633bc718f6" (UID: "edda0506-ddb2-4324-a920-ab633bc718f6"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 18:59:29.232818 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:59:29.232769    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/edda0506-ddb2-4324-a920-ab633bc718f6-kube-api-access-hsgd4" (OuterVolumeSpecName: "kube-api-access-hsgd4") pod "edda0506-ddb2-4324-a920-ab633bc718f6" (UID: "edda0506-ddb2-4324-a920-ab633bc718f6"). InnerVolumeSpecName "kube-api-access-hsgd4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 18:59:29.232818 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:59:29.232778    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/edda0506-ddb2-4324-a920-ab633bc718f6-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "edda0506-ddb2-4324-a920-ab633bc718f6" (UID: "edda0506-ddb2-4324-a920-ab633bc718f6"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 09 18:59:29.232818 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:59:29.232780    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/edda0506-ddb2-4324-a920-ab633bc718f6-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "edda0506-ddb2-4324-a920-ab633bc718f6" (UID: "edda0506-ddb2-4324-a920-ab633bc718f6"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 18:59:29.332594 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:59:29.332557    2557 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/edda0506-ddb2-4324-a920-ab633bc718f6-istio-data\") on node \"ip-10-0-141-101.ec2.internal\" DevicePath \"\""
Jul 09 18:59:29.332594 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:59:29.332585    2557 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/edda0506-ddb2-4324-a920-ab633bc718f6-istio-podinfo\") on node \"ip-10-0-141-101.ec2.internal\" DevicePath \"\""
Jul 09 18:59:29.332594 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:59:29.332594    2557 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/edda0506-ddb2-4324-a920-ab633bc718f6-istiod-ca-cert\") on node \"ip-10-0-141-101.ec2.internal\" DevicePath \"\""
Jul 09 18:59:29.332594 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:59:29.332602    2557 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/edda0506-ddb2-4324-a920-ab633bc718f6-istio-token\") on node \"ip-10-0-141-101.ec2.internal\" DevicePath \"\""
Jul 09 18:59:29.332855 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:59:29.332611    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hsgd4\" (UniqueName: \"kubernetes.io/projected/edda0506-ddb2-4324-a920-ab633bc718f6-kube-api-access-hsgd4\") on node \"ip-10-0-141-101.ec2.internal\" DevicePath \"\""
Jul 09 18:59:29.332855 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:59:29.332635    2557 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/edda0506-ddb2-4324-a920-ab633bc718f6-istio-envoy\") on node \"ip-10-0-141-101.ec2.internal\" DevicePath \"\""
Jul 09 18:59:29.500142 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:59:29.500059    2557 generic.go:356] "Generic (PLEG): container finished" podID="edda0506-ddb2-4324-a920-ab633bc718f6" containerID="7091775af38fa6ccad4f071b237a6c005104a69b0222c5f0aacb25d3db7cd590" exitCode=0
Jul 09 18:59:29.500142 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:59:29.500107    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-15a9af-openshift-default-569766755-t47d9"
Jul 09 18:59:29.500407 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:59:29.500111    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-15a9af-openshift-default-569766755-t47d9" event={"ID":"edda0506-ddb2-4324-a920-ab633bc718f6","Type":"ContainerDied","Data":"7091775af38fa6ccad4f071b237a6c005104a69b0222c5f0aacb25d3db7cd590"}
Jul 09 18:59:29.500407 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:59:29.500242    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-15a9af-openshift-default-569766755-t47d9" event={"ID":"edda0506-ddb2-4324-a920-ab633bc718f6","Type":"ContainerDied","Data":"c1fba2b652f0326a129c4ca11a6f9b30ad6acbd122d1f0fceec31b8385d1953e"}
Jul 09 18:59:29.500407 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:59:29.500275    2557 scope.go:117] "RemoveContainer" containerID="7091775af38fa6ccad4f071b237a6c005104a69b0222c5f0aacb25d3db7cd590"
Jul 09 18:59:29.509838 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:59:29.509817    2557 scope.go:117] "RemoveContainer" containerID="516f98e4307148c7cba143a5f9cfb0d944e1f64b45d4bc5deea054a4f2fca724"
Jul 09 18:59:29.518097 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:59:29.517829    2557 scope.go:117] "RemoveContainer" containerID="7091775af38fa6ccad4f071b237a6c005104a69b0222c5f0aacb25d3db7cd590"
Jul 09 18:59:29.518172 ip-10-0-141-101 kubenswrapper[2557]: E0709 18:59:29.518110    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7091775af38fa6ccad4f071b237a6c005104a69b0222c5f0aacb25d3db7cd590\": container with ID starting with 7091775af38fa6ccad4f071b237a6c005104a69b0222c5f0aacb25d3db7cd590 not found: ID does not exist" containerID="7091775af38fa6ccad4f071b237a6c005104a69b0222c5f0aacb25d3db7cd590"
Jul 09 18:59:29.518172 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:59:29.518145    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7091775af38fa6ccad4f071b237a6c005104a69b0222c5f0aacb25d3db7cd590"} err="failed to get container status \"7091775af38fa6ccad4f071b237a6c005104a69b0222c5f0aacb25d3db7cd590\": rpc error: code = NotFound desc = could not find container \"7091775af38fa6ccad4f071b237a6c005104a69b0222c5f0aacb25d3db7cd590\": container with ID starting with 7091775af38fa6ccad4f071b237a6c005104a69b0222c5f0aacb25d3db7cd590 not found: ID does not exist"
Jul 09 18:59:29.518172 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:59:29.518169    2557 scope.go:117] "RemoveContainer" containerID="516f98e4307148c7cba143a5f9cfb0d944e1f64b45d4bc5deea054a4f2fca724"
Jul 09 18:59:29.518430 ip-10-0-141-101 kubenswrapper[2557]: E0709 18:59:29.518411    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"516f98e4307148c7cba143a5f9cfb0d944e1f64b45d4bc5deea054a4f2fca724\": container with ID starting with 516f98e4307148c7cba143a5f9cfb0d944e1f64b45d4bc5deea054a4f2fca724 not found: ID does not exist" containerID="516f98e4307148c7cba143a5f9cfb0d944e1f64b45d4bc5deea054a4f2fca724"
Jul 09 18:59:29.518512 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:59:29.518434    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"516f98e4307148c7cba143a5f9cfb0d944e1f64b45d4bc5deea054a4f2fca724"} err="failed to get container status \"516f98e4307148c7cba143a5f9cfb0d944e1f64b45d4bc5deea054a4f2fca724\": rpc error: code = NotFound desc = could not find container \"516f98e4307148c7cba143a5f9cfb0d944e1f64b45d4bc5deea054a4f2fca724\": container with ID starting with 516f98e4307148c7cba143a5f9cfb0d944e1f64b45d4bc5deea054a4f2fca724 not found: ID does not exist"
Jul 09 18:59:29.520454 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:59:29.520433    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-15a9af-openshift-default-569766755-t47d9"]
Jul 09 18:59:29.525775 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:59:29.525754    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-a-15a9af-openshift-default-569766755-t47d9"]
Jul 09 18:59:31.262112 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:59:31.262069    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="edda0506-ddb2-4324-a920-ab633bc718f6" path="/var/lib/kubelet/pods/edda0506-ddb2-4324-a920-ab633bc718f6/volumes"
Jul 09 18:59:31.878442 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:59:31.878400    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-86d225-openshift-default-8f6bb8745-dl9c7"]
Jul 09 18:59:31.878690 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:59:31.878662    2557 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-b-86d225-openshift-default-8f6bb8745-dl9c7" podUID="267ef97a-b1e4-423c-8536-004fae9cac46" containerName="istio-proxy" containerID="cri-o://89d55c5786c2fd606319c66ababeb2744f06df749c741a6207261df82281febd" gracePeriod=30
Jul 09 18:59:33.227572 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:59:33.227534    2557 patch_prober.go:28] interesting pod/e2e-inf-b-86d225-openshift-default-8f6bb8745-dl9c7 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 09 18:59:33.228084 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:59:33.227595    2557 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-b-86d225-openshift-default-8f6bb8745-dl9c7" podUID="267ef97a-b1e4-423c-8536-004fae9cac46" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 09 18:59:37.152763 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:59:37.152691    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-86d225-openshift-default-8f6bb8745-dl9c7"
Jul 09 18:59:37.309543 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:59:37.309506    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/267ef97a-b1e4-423c-8536-004fae9cac46-istio-podinfo\") pod \"267ef97a-b1e4-423c-8536-004fae9cac46\" (UID: \"267ef97a-b1e4-423c-8536-004fae9cac46\") "
Jul 09 18:59:37.309721 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:59:37.309631    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/267ef97a-b1e4-423c-8536-004fae9cac46-credential-socket\") pod \"267ef97a-b1e4-423c-8536-004fae9cac46\" (UID: \"267ef97a-b1e4-423c-8536-004fae9cac46\") "
Jul 09 18:59:37.309721 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:59:37.309676    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tnn4z\" (UniqueName: \"kubernetes.io/projected/267ef97a-b1e4-423c-8536-004fae9cac46-kube-api-access-tnn4z\") pod \"267ef97a-b1e4-423c-8536-004fae9cac46\" (UID: \"267ef97a-b1e4-423c-8536-004fae9cac46\") "
Jul 09 18:59:37.309721 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:59:37.309710    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/267ef97a-b1e4-423c-8536-004fae9cac46-istio-token\") pod \"267ef97a-b1e4-423c-8536-004fae9cac46\" (UID: \"267ef97a-b1e4-423c-8536-004fae9cac46\") "
Jul 09 18:59:37.309912 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:59:37.309742    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/267ef97a-b1e4-423c-8536-004fae9cac46-istio-envoy\") pod \"267ef97a-b1e4-423c-8536-004fae9cac46\" (UID: \"267ef97a-b1e4-423c-8536-004fae9cac46\") "
Jul 09 18:59:37.309912 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:59:37.309767    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/267ef97a-b1e4-423c-8536-004fae9cac46-istio-data\") pod \"267ef97a-b1e4-423c-8536-004fae9cac46\" (UID: \"267ef97a-b1e4-423c-8536-004fae9cac46\") "
Jul 09 18:59:37.309912 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:59:37.309833    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/267ef97a-b1e4-423c-8536-004fae9cac46-workload-socket\") pod \"267ef97a-b1e4-423c-8536-004fae9cac46\" (UID: \"267ef97a-b1e4-423c-8536-004fae9cac46\") "
Jul 09 18:59:37.309912 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:59:37.309892    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/267ef97a-b1e4-423c-8536-004fae9cac46-istiod-ca-cert\") pod \"267ef97a-b1e4-423c-8536-004fae9cac46\" (UID: \"267ef97a-b1e4-423c-8536-004fae9cac46\") "
Jul 09 18:59:37.310115 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:59:37.309920    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/267ef97a-b1e4-423c-8536-004fae9cac46-workload-certs\") pod \"267ef97a-b1e4-423c-8536-004fae9cac46\" (UID: \"267ef97a-b1e4-423c-8536-004fae9cac46\") "
Jul 09 18:59:37.310115 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:59:37.309995    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/267ef97a-b1e4-423c-8536-004fae9cac46-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "267ef97a-b1e4-423c-8536-004fae9cac46" (UID: "267ef97a-b1e4-423c-8536-004fae9cac46"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 18:59:37.310504 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:59:37.310251    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/267ef97a-b1e4-423c-8536-004fae9cac46-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "267ef97a-b1e4-423c-8536-004fae9cac46" (UID: "267ef97a-b1e4-423c-8536-004fae9cac46"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 18:59:37.310504 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:59:37.310263    2557 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/267ef97a-b1e4-423c-8536-004fae9cac46-credential-socket\") on node \"ip-10-0-141-101.ec2.internal\" DevicePath \"\""
Jul 09 18:59:37.310504 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:59:37.310282    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/267ef97a-b1e4-423c-8536-004fae9cac46-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "267ef97a-b1e4-423c-8536-004fae9cac46" (UID: "267ef97a-b1e4-423c-8536-004fae9cac46"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 09 18:59:37.310504 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:59:37.310450    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/267ef97a-b1e4-423c-8536-004fae9cac46-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "267ef97a-b1e4-423c-8536-004fae9cac46" (UID: "267ef97a-b1e4-423c-8536-004fae9cac46"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 18:59:37.310793 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:59:37.310609    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/267ef97a-b1e4-423c-8536-004fae9cac46-istio-data" (OuterVolumeSpecName: "istio-data") pod "267ef97a-b1e4-423c-8536-004fae9cac46" (UID: "267ef97a-b1e4-423c-8536-004fae9cac46"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 18:59:37.311917 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:59:37.311885    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/267ef97a-b1e4-423c-8536-004fae9cac46-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "267ef97a-b1e4-423c-8536-004fae9cac46" (UID: "267ef97a-b1e4-423c-8536-004fae9cac46"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 18:59:37.312016 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:59:37.311926    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/267ef97a-b1e4-423c-8536-004fae9cac46-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "267ef97a-b1e4-423c-8536-004fae9cac46" (UID: "267ef97a-b1e4-423c-8536-004fae9cac46"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 09 18:59:37.312016 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:59:37.311995    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/267ef97a-b1e4-423c-8536-004fae9cac46-kube-api-access-tnn4z" (OuterVolumeSpecName: "kube-api-access-tnn4z") pod "267ef97a-b1e4-423c-8536-004fae9cac46" (UID: "267ef97a-b1e4-423c-8536-004fae9cac46"). InnerVolumeSpecName "kube-api-access-tnn4z". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 18:59:37.312159 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:59:37.312140    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/267ef97a-b1e4-423c-8536-004fae9cac46-istio-token" (OuterVolumeSpecName: "istio-token") pod "267ef97a-b1e4-423c-8536-004fae9cac46" (UID: "267ef97a-b1e4-423c-8536-004fae9cac46"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 18:59:37.411358 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:59:37.411269    2557 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/267ef97a-b1e4-423c-8536-004fae9cac46-istio-token\") on node \"ip-10-0-141-101.ec2.internal\" DevicePath \"\""
Jul 09 18:59:37.411358 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:59:37.411297    2557 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/267ef97a-b1e4-423c-8536-004fae9cac46-istio-envoy\") on node \"ip-10-0-141-101.ec2.internal\" DevicePath \"\""
Jul 09 18:59:37.411358 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:59:37.411306    2557 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/267ef97a-b1e4-423c-8536-004fae9cac46-istio-data\") on node \"ip-10-0-141-101.ec2.internal\" DevicePath \"\""
Jul 09 18:59:37.411358 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:59:37.411315    2557 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/267ef97a-b1e4-423c-8536-004fae9cac46-workload-socket\") on node \"ip-10-0-141-101.ec2.internal\" DevicePath \"\""
Jul 09 18:59:37.411358 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:59:37.411324    2557 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/267ef97a-b1e4-423c-8536-004fae9cac46-istiod-ca-cert\") on node \"ip-10-0-141-101.ec2.internal\" DevicePath \"\""
Jul 09 18:59:37.411358 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:59:37.411332    2557 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/267ef97a-b1e4-423c-8536-004fae9cac46-workload-certs\") on node \"ip-10-0-141-101.ec2.internal\" DevicePath \"\""
Jul 09 18:59:37.411358 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:59:37.411340    2557 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/267ef97a-b1e4-423c-8536-004fae9cac46-istio-podinfo\") on node \"ip-10-0-141-101.ec2.internal\" DevicePath \"\""
Jul 09 18:59:37.411358 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:59:37.411348    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tnn4z\" (UniqueName: \"kubernetes.io/projected/267ef97a-b1e4-423c-8536-004fae9cac46-kube-api-access-tnn4z\") on node \"ip-10-0-141-101.ec2.internal\" DevicePath \"\""
Jul 09 18:59:37.551670 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:59:37.551631    2557 generic.go:356] "Generic (PLEG): container finished" podID="267ef97a-b1e4-423c-8536-004fae9cac46" containerID="89d55c5786c2fd606319c66ababeb2744f06df749c741a6207261df82281febd" exitCode=0
Jul 09 18:59:37.551857 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:59:37.551695    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-86d225-openshift-default-8f6bb8745-dl9c7"
Jul 09 18:59:37.551857 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:59:37.551715    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-86d225-openshift-default-8f6bb8745-dl9c7" event={"ID":"267ef97a-b1e4-423c-8536-004fae9cac46","Type":"ContainerDied","Data":"89d55c5786c2fd606319c66ababeb2744f06df749c741a6207261df82281febd"}
Jul 09 18:59:37.551857 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:59:37.551779    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-86d225-openshift-default-8f6bb8745-dl9c7" event={"ID":"267ef97a-b1e4-423c-8536-004fae9cac46","Type":"ContainerDied","Data":"ed8cf01ec8e642b668bf4f3391988571bf1710bded88d30ff54798501898a94e"}
Jul 09 18:59:37.551857 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:59:37.551803    2557 scope.go:117] "RemoveContainer" containerID="89d55c5786c2fd606319c66ababeb2744f06df749c741a6207261df82281febd"
Jul 09 18:59:37.561926 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:59:37.561910    2557 scope.go:117] "RemoveContainer" containerID="fb65f4d7f161ff5f6951f08b0ae21e2e227059bb491919d99092004d31828c4c"
Jul 09 18:59:37.571217 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:59:37.571197    2557 scope.go:117] "RemoveContainer" containerID="89d55c5786c2fd606319c66ababeb2744f06df749c741a6207261df82281febd"
Jul 09 18:59:37.571529 ip-10-0-141-101 kubenswrapper[2557]: E0709 18:59:37.571511    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"89d55c5786c2fd606319c66ababeb2744f06df749c741a6207261df82281febd\": container with ID starting with 89d55c5786c2fd606319c66ababeb2744f06df749c741a6207261df82281febd not found: ID does not exist" containerID="89d55c5786c2fd606319c66ababeb2744f06df749c741a6207261df82281febd"
Jul 09 18:59:37.571614 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:59:37.571535    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"89d55c5786c2fd606319c66ababeb2744f06df749c741a6207261df82281febd"} err="failed to get container status \"89d55c5786c2fd606319c66ababeb2744f06df749c741a6207261df82281febd\": rpc error: code = NotFound desc = could not find container \"89d55c5786c2fd606319c66ababeb2744f06df749c741a6207261df82281febd\": container with ID starting with 89d55c5786c2fd606319c66ababeb2744f06df749c741a6207261df82281febd not found: ID does not exist"
Jul 09 18:59:37.571614 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:59:37.571553    2557 scope.go:117] "RemoveContainer" containerID="fb65f4d7f161ff5f6951f08b0ae21e2e227059bb491919d99092004d31828c4c"
Jul 09 18:59:37.571815 ip-10-0-141-101 kubenswrapper[2557]: E0709 18:59:37.571797    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fb65f4d7f161ff5f6951f08b0ae21e2e227059bb491919d99092004d31828c4c\": container with ID starting with fb65f4d7f161ff5f6951f08b0ae21e2e227059bb491919d99092004d31828c4c not found: ID does not exist" containerID="fb65f4d7f161ff5f6951f08b0ae21e2e227059bb491919d99092004d31828c4c"
Jul 09 18:59:37.571861 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:59:37.571821    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fb65f4d7f161ff5f6951f08b0ae21e2e227059bb491919d99092004d31828c4c"} err="failed to get container status \"fb65f4d7f161ff5f6951f08b0ae21e2e227059bb491919d99092004d31828c4c\": rpc error: code = NotFound desc = could not find container \"fb65f4d7f161ff5f6951f08b0ae21e2e227059bb491919d99092004d31828c4c\": container with ID starting with fb65f4d7f161ff5f6951f08b0ae21e2e227059bb491919d99092004d31828c4c not found: ID does not exist"
Jul 09 18:59:37.583091 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:59:37.583064    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-86d225-openshift-default-8f6bb8745-dl9c7"]
Jul 09 18:59:37.589334 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:59:37.589308    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-b-86d225-openshift-default-8f6bb8745-dl9c7"]
Jul 09 18:59:39.265808 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:59:39.265772    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="267ef97a-b1e4-423c-8536-004fae9cac46" path="/var/lib/kubelet/pods/267ef97a-b1e4-423c-8536-004fae9cac46/volumes"
Jul 09 18:59:41.286010 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:59:41.285977    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-b-6c0298-openshift-default-5d9cfdbf6f-k2rwd"]
Jul 09 18:59:41.286448 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:59:41.286373    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="edda0506-ddb2-4324-a920-ab633bc718f6" containerName="istio-proxy"
Jul 09 18:59:41.286448 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:59:41.286383    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="edda0506-ddb2-4324-a920-ab633bc718f6" containerName="istio-proxy"
Jul 09 18:59:41.286448 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:59:41.286392    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="267ef97a-b1e4-423c-8536-004fae9cac46" containerName="istio-proxy"
Jul 09 18:59:41.286448 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:59:41.286397    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="267ef97a-b1e4-423c-8536-004fae9cac46" containerName="istio-proxy"
Jul 09 18:59:41.286448 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:59:41.286404    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="267ef97a-b1e4-423c-8536-004fae9cac46" containerName="istio-proxy"
Jul 09 18:59:41.286448 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:59:41.286410    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="267ef97a-b1e4-423c-8536-004fae9cac46" containerName="istio-proxy"
Jul 09 18:59:41.286663 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:59:41.286499    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="edda0506-ddb2-4324-a920-ab633bc718f6" containerName="istio-proxy"
Jul 09 18:59:41.286663 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:59:41.286508    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="267ef97a-b1e4-423c-8536-004fae9cac46" containerName="istio-proxy"
Jul 09 18:59:41.286663 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:59:41.286514    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="edda0506-ddb2-4324-a920-ab633bc718f6" containerName="istio-proxy"
Jul 09 18:59:41.286663 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:59:41.286522    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="267ef97a-b1e4-423c-8536-004fae9cac46" containerName="istio-proxy"
Jul 09 18:59:41.291134 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:59:41.291114    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-6c0298-openshift-default-5d9cfdbf6f-k2rwd"
Jul 09 18:59:41.294276 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:59:41.294262    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-b-6c0298-openshift-default-dockercfg-mrsmt\""
Jul 09 18:59:41.317364 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:59:41.317335    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-6c0298-openshift-default-5d9cfdbf6f-k2rwd"]
Jul 09 18:59:41.452154 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:59:41.452115    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fe65e9f8-5a98-48f1-954d-467459dccc3d-workload-socket\") pod \"e2e-api-b-6c0298-openshift-default-5d9cfdbf6f-k2rwd\" (UID: \"fe65e9f8-5a98-48f1-954d-467459dccc3d\") " pod="openshift-ingress/e2e-api-b-6c0298-openshift-default-5d9cfdbf6f-k2rwd"
Jul 09 18:59:41.452154 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:59:41.452155    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fe65e9f8-5a98-48f1-954d-467459dccc3d-istio-data\") pod \"e2e-api-b-6c0298-openshift-default-5d9cfdbf6f-k2rwd\" (UID: \"fe65e9f8-5a98-48f1-954d-467459dccc3d\") " pod="openshift-ingress/e2e-api-b-6c0298-openshift-default-5d9cfdbf6f-k2rwd"
Jul 09 18:59:41.452390 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:59:41.452207    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fe65e9f8-5a98-48f1-954d-467459dccc3d-credential-socket\") pod \"e2e-api-b-6c0298-openshift-default-5d9cfdbf6f-k2rwd\" (UID: \"fe65e9f8-5a98-48f1-954d-467459dccc3d\") " pod="openshift-ingress/e2e-api-b-6c0298-openshift-default-5d9cfdbf6f-k2rwd"
Jul 09 18:59:41.452390 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:59:41.452226    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fe65e9f8-5a98-48f1-954d-467459dccc3d-istio-podinfo\") pod \"e2e-api-b-6c0298-openshift-default-5d9cfdbf6f-k2rwd\" (UID: \"fe65e9f8-5a98-48f1-954d-467459dccc3d\") " pod="openshift-ingress/e2e-api-b-6c0298-openshift-default-5d9cfdbf6f-k2rwd"
Jul 09 18:59:41.452390 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:59:41.452267    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wdv5n\" (UniqueName: \"kubernetes.io/projected/fe65e9f8-5a98-48f1-954d-467459dccc3d-kube-api-access-wdv5n\") pod \"e2e-api-b-6c0298-openshift-default-5d9cfdbf6f-k2rwd\" (UID: \"fe65e9f8-5a98-48f1-954d-467459dccc3d\") " pod="openshift-ingress/e2e-api-b-6c0298-openshift-default-5d9cfdbf6f-k2rwd"
Jul 09 18:59:41.452390 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:59:41.452347    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fe65e9f8-5a98-48f1-954d-467459dccc3d-workload-certs\") pod \"e2e-api-b-6c0298-openshift-default-5d9cfdbf6f-k2rwd\" (UID: \"fe65e9f8-5a98-48f1-954d-467459dccc3d\") " pod="openshift-ingress/e2e-api-b-6c0298-openshift-default-5d9cfdbf6f-k2rwd"
Jul 09 18:59:41.452585 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:59:41.452409    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fe65e9f8-5a98-48f1-954d-467459dccc3d-istio-token\") pod \"e2e-api-b-6c0298-openshift-default-5d9cfdbf6f-k2rwd\" (UID: \"fe65e9f8-5a98-48f1-954d-467459dccc3d\") " pod="openshift-ingress/e2e-api-b-6c0298-openshift-default-5d9cfdbf6f-k2rwd"
Jul 09 18:59:41.452585 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:59:41.452446    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fe65e9f8-5a98-48f1-954d-467459dccc3d-istiod-ca-cert\") pod \"e2e-api-b-6c0298-openshift-default-5d9cfdbf6f-k2rwd\" (UID: \"fe65e9f8-5a98-48f1-954d-467459dccc3d\") " pod="openshift-ingress/e2e-api-b-6c0298-openshift-default-5d9cfdbf6f-k2rwd"
Jul 09 18:59:41.452585 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:59:41.452538    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fe65e9f8-5a98-48f1-954d-467459dccc3d-istio-envoy\") pod \"e2e-api-b-6c0298-openshift-default-5d9cfdbf6f-k2rwd\" (UID: \"fe65e9f8-5a98-48f1-954d-467459dccc3d\") " pod="openshift-ingress/e2e-api-b-6c0298-openshift-default-5d9cfdbf6f-k2rwd"
Jul 09 18:59:41.553308 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:59:41.553270    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fe65e9f8-5a98-48f1-954d-467459dccc3d-istio-token\") pod \"e2e-api-b-6c0298-openshift-default-5d9cfdbf6f-k2rwd\" (UID: \"fe65e9f8-5a98-48f1-954d-467459dccc3d\") " pod="openshift-ingress/e2e-api-b-6c0298-openshift-default-5d9cfdbf6f-k2rwd"
Jul 09 18:59:41.553308 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:59:41.553309    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fe65e9f8-5a98-48f1-954d-467459dccc3d-istiod-ca-cert\") pod \"e2e-api-b-6c0298-openshift-default-5d9cfdbf6f-k2rwd\" (UID: \"fe65e9f8-5a98-48f1-954d-467459dccc3d\") " pod="openshift-ingress/e2e-api-b-6c0298-openshift-default-5d9cfdbf6f-k2rwd"
Jul 09 18:59:41.553615 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:59:41.553341    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fe65e9f8-5a98-48f1-954d-467459dccc3d-istio-envoy\") pod \"e2e-api-b-6c0298-openshift-default-5d9cfdbf6f-k2rwd\" (UID: \"fe65e9f8-5a98-48f1-954d-467459dccc3d\") " pod="openshift-ingress/e2e-api-b-6c0298-openshift-default-5d9cfdbf6f-k2rwd"
Jul 09 18:59:41.553615 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:59:41.553369    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fe65e9f8-5a98-48f1-954d-467459dccc3d-workload-socket\") pod \"e2e-api-b-6c0298-openshift-default-5d9cfdbf6f-k2rwd\" (UID: \"fe65e9f8-5a98-48f1-954d-467459dccc3d\") " pod="openshift-ingress/e2e-api-b-6c0298-openshift-default-5d9cfdbf6f-k2rwd"
Jul 09 18:59:41.553615 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:59:41.553387    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fe65e9f8-5a98-48f1-954d-467459dccc3d-istio-data\") pod \"e2e-api-b-6c0298-openshift-default-5d9cfdbf6f-k2rwd\" (UID: \"fe65e9f8-5a98-48f1-954d-467459dccc3d\") " pod="openshift-ingress/e2e-api-b-6c0298-openshift-default-5d9cfdbf6f-k2rwd"
Jul 09 18:59:41.553615 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:59:41.553430    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fe65e9f8-5a98-48f1-954d-467459dccc3d-credential-socket\") pod \"e2e-api-b-6c0298-openshift-default-5d9cfdbf6f-k2rwd\" (UID: \"fe65e9f8-5a98-48f1-954d-467459dccc3d\") " pod="openshift-ingress/e2e-api-b-6c0298-openshift-default-5d9cfdbf6f-k2rwd"
Jul 09 18:59:41.553615 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:59:41.553453    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fe65e9f8-5a98-48f1-954d-467459dccc3d-istio-podinfo\") pod \"e2e-api-b-6c0298-openshift-default-5d9cfdbf6f-k2rwd\" (UID: \"fe65e9f8-5a98-48f1-954d-467459dccc3d\") " pod="openshift-ingress/e2e-api-b-6c0298-openshift-default-5d9cfdbf6f-k2rwd"
Jul 09 18:59:41.553615 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:59:41.553532    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wdv5n\" (UniqueName: \"kubernetes.io/projected/fe65e9f8-5a98-48f1-954d-467459dccc3d-kube-api-access-wdv5n\") pod \"e2e-api-b-6c0298-openshift-default-5d9cfdbf6f-k2rwd\" (UID: \"fe65e9f8-5a98-48f1-954d-467459dccc3d\") " pod="openshift-ingress/e2e-api-b-6c0298-openshift-default-5d9cfdbf6f-k2rwd"
Jul 09 18:59:41.553615 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:59:41.553575    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fe65e9f8-5a98-48f1-954d-467459dccc3d-workload-certs\") pod \"e2e-api-b-6c0298-openshift-default-5d9cfdbf6f-k2rwd\" (UID: \"fe65e9f8-5a98-48f1-954d-467459dccc3d\") " pod="openshift-ingress/e2e-api-b-6c0298-openshift-default-5d9cfdbf6f-k2rwd"
Jul 09 18:59:41.553987 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:59:41.553850    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fe65e9f8-5a98-48f1-954d-467459dccc3d-credential-socket\") pod \"e2e-api-b-6c0298-openshift-default-5d9cfdbf6f-k2rwd\" (UID: \"fe65e9f8-5a98-48f1-954d-467459dccc3d\") " pod="openshift-ingress/e2e-api-b-6c0298-openshift-default-5d9cfdbf6f-k2rwd"
Jul 09 18:59:41.553987 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:59:41.553909    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fe65e9f8-5a98-48f1-954d-467459dccc3d-istio-data\") pod \"e2e-api-b-6c0298-openshift-default-5d9cfdbf6f-k2rwd\" (UID: \"fe65e9f8-5a98-48f1-954d-467459dccc3d\") " pod="openshift-ingress/e2e-api-b-6c0298-openshift-default-5d9cfdbf6f-k2rwd"
Jul 09 18:59:41.554102 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:59:41.553975    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fe65e9f8-5a98-48f1-954d-467459dccc3d-workload-certs\") pod \"e2e-api-b-6c0298-openshift-default-5d9cfdbf6f-k2rwd\" (UID: \"fe65e9f8-5a98-48f1-954d-467459dccc3d\") " pod="openshift-ingress/e2e-api-b-6c0298-openshift-default-5d9cfdbf6f-k2rwd"
Jul 09 18:59:41.554102 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:59:41.554066    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fe65e9f8-5a98-48f1-954d-467459dccc3d-workload-socket\") pod \"e2e-api-b-6c0298-openshift-default-5d9cfdbf6f-k2rwd\" (UID: \"fe65e9f8-5a98-48f1-954d-467459dccc3d\") " pod="openshift-ingress/e2e-api-b-6c0298-openshift-default-5d9cfdbf6f-k2rwd"
Jul 09 18:59:41.554207 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:59:41.554174    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fe65e9f8-5a98-48f1-954d-467459dccc3d-istiod-ca-cert\") pod \"e2e-api-b-6c0298-openshift-default-5d9cfdbf6f-k2rwd\" (UID: \"fe65e9f8-5a98-48f1-954d-467459dccc3d\") " pod="openshift-ingress/e2e-api-b-6c0298-openshift-default-5d9cfdbf6f-k2rwd"
Jul 09 18:59:41.555803 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:59:41.555774    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fe65e9f8-5a98-48f1-954d-467459dccc3d-istio-envoy\") pod \"e2e-api-b-6c0298-openshift-default-5d9cfdbf6f-k2rwd\" (UID: \"fe65e9f8-5a98-48f1-954d-467459dccc3d\") " pod="openshift-ingress/e2e-api-b-6c0298-openshift-default-5d9cfdbf6f-k2rwd"
Jul 09 18:59:41.555974 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:59:41.555955    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fe65e9f8-5a98-48f1-954d-467459dccc3d-istio-podinfo\") pod \"e2e-api-b-6c0298-openshift-default-5d9cfdbf6f-k2rwd\" (UID: \"fe65e9f8-5a98-48f1-954d-467459dccc3d\") " pod="openshift-ingress/e2e-api-b-6c0298-openshift-default-5d9cfdbf6f-k2rwd"
Jul 09 18:59:41.566344 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:59:41.566319    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fe65e9f8-5a98-48f1-954d-467459dccc3d-istio-token\") pod \"e2e-api-b-6c0298-openshift-default-5d9cfdbf6f-k2rwd\" (UID: \"fe65e9f8-5a98-48f1-954d-467459dccc3d\") " pod="openshift-ingress/e2e-api-b-6c0298-openshift-default-5d9cfdbf6f-k2rwd"
Jul 09 18:59:41.566598 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:59:41.566577    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wdv5n\" (UniqueName: \"kubernetes.io/projected/fe65e9f8-5a98-48f1-954d-467459dccc3d-kube-api-access-wdv5n\") pod \"e2e-api-b-6c0298-openshift-default-5d9cfdbf6f-k2rwd\" (UID: \"fe65e9f8-5a98-48f1-954d-467459dccc3d\") " pod="openshift-ingress/e2e-api-b-6c0298-openshift-default-5d9cfdbf6f-k2rwd"
Jul 09 18:59:41.601529 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:59:41.601472    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-6c0298-openshift-default-5d9cfdbf6f-k2rwd"
Jul 09 18:59:41.753180 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:59:41.753148    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-6c0298-openshift-default-5d9cfdbf6f-k2rwd"]
Jul 09 18:59:41.755413 ip-10-0-141-101 kubenswrapper[2557]: W0709 18:59:41.755386    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfe65e9f8_5a98_48f1_954d_467459dccc3d.slice/crio-eae4f7d20de68a8b85dbe94bc586da7d171127343f473a4b42a706cad22076ae WatchSource:0}: Error finding container eae4f7d20de68a8b85dbe94bc586da7d171127343f473a4b42a706cad22076ae: Status 404 returned error can't find the container with id eae4f7d20de68a8b85dbe94bc586da7d171127343f473a4b42a706cad22076ae
Jul 09 18:59:41.757415 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:59:41.757381    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 09 18:59:41.757532 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:59:41.757462    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 09 18:59:41.757604 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:59:41.757527    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 09 18:59:42.585461 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:59:42.585422    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-6c0298-openshift-default-5d9cfdbf6f-k2rwd" event={"ID":"fe65e9f8-5a98-48f1-954d-467459dccc3d","Type":"ContainerStarted","Data":"3598ba6db1c9fa0587c0acc2d835eba92789e1fd96b20009aa6571fbb35d0e56"}
Jul 09 18:59:42.585881 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:59:42.585521    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-6c0298-openshift-default-5d9cfdbf6f-k2rwd" event={"ID":"fe65e9f8-5a98-48f1-954d-467459dccc3d","Type":"ContainerStarted","Data":"eae4f7d20de68a8b85dbe94bc586da7d171127343f473a4b42a706cad22076ae"}
Jul 09 18:59:42.601858 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:59:42.601824    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-6c0298-openshift-default-5d9cfdbf6f-k2rwd"
Jul 09 18:59:42.606634 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:59:42.606607    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-6c0298-openshift-default-5d9cfdbf6f-k2rwd"
Jul 09 18:59:42.611155 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:59:42.611109    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-b-6c0298-openshift-default-5d9cfdbf6f-k2rwd" podStartSLOduration=1.61109421 podStartE2EDuration="1.61109421s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 18:59:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 18:59:42.60854339 +0000 UTC m=+2051.847888033" watchObservedRunningTime="2026-07-09 18:59:42.61109421 +0000 UTC m=+2051.850438836"
Jul 09 18:59:43.591302 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:59:43.591272    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-6c0298-openshift-default-5d9cfdbf6f-k2rwd"
Jul 09 18:59:43.592335 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:59:43.592316    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-6c0298-openshift-default-5d9cfdbf6f-k2rwd"
Jul 09 18:59:56.680455 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:59:56.680367    2557 generic.go:356] "Generic (PLEG): container finished" podID="fe65e9f8-5a98-48f1-954d-467459dccc3d" containerID="3598ba6db1c9fa0587c0acc2d835eba92789e1fd96b20009aa6571fbb35d0e56" exitCode=0
Jul 09 18:59:56.680868 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:59:56.680445    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-6c0298-openshift-default-5d9cfdbf6f-k2rwd" event={"ID":"fe65e9f8-5a98-48f1-954d-467459dccc3d","Type":"ContainerDied","Data":"3598ba6db1c9fa0587c0acc2d835eba92789e1fd96b20009aa6571fbb35d0e56"}
Jul 09 18:59:56.680958 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:59:56.680942    2557 scope.go:117] "RemoveContainer" containerID="3598ba6db1c9fa0587c0acc2d835eba92789e1fd96b20009aa6571fbb35d0e56"
Jul 09 18:59:56.682014 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:59:56.681984    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 09 18:59:56.682090 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:59:56.682058    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 09 18:59:56.682132 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:59:56.682092    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 09 18:59:57.688243 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:59:57.688208    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-6c0298-openshift-default-5d9cfdbf6f-k2rwd" event={"ID":"fe65e9f8-5a98-48f1-954d-467459dccc3d","Type":"ContainerStarted","Data":"69c8b7a3f86ba46d4313576c2e1b6e9df146dc57066564b8ae2fdcf634083aae"}
Jul 09 18:59:58.591802 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:59:58.591761    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-6c0298-openshift-default-5d9cfdbf6f-k2rwd"
Jul 09 18:59:58.602005 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:59:58.601977    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-6c0298-openshift-default-5d9cfdbf6f-k2rwd"
Jul 09 18:59:58.602994 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:59:58.602971    2557 patch_prober.go:28] interesting pod/e2e-api-b-6c0298-openshift-default-5d9cfdbf6f-k2rwd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.62:15021/healthz/ready\": dial tcp 10.133.0.62:15021: connect: connection refused" start-of-body=
Jul 09 18:59:58.603098 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:59:58.603017    2557 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-6c0298-openshift-default-5d9cfdbf6f-k2rwd" podUID="fe65e9f8-5a98-48f1-954d-467459dccc3d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.62:15021/healthz/ready\": dial tcp 10.133.0.62:15021: connect: connection refused"
Jul 09 18:59:59.602098 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:59:59.602055    2557 patch_prober.go:28] interesting pod/e2e-api-b-6c0298-openshift-default-5d9cfdbf6f-k2rwd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.62:15021/healthz/ready\": dial tcp 10.133.0.62:15021: connect: connection refused" start-of-body=
Jul 09 18:59:59.602544 ip-10-0-141-101 kubenswrapper[2557]: I0709 18:59:59.602112    2557 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-6c0298-openshift-default-5d9cfdbf6f-k2rwd" podUID="fe65e9f8-5a98-48f1-954d-467459dccc3d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.62:15021/healthz/ready\": dial tcp 10.133.0.62:15021: connect: connection refused"
Jul 09 19:00:00.138059 ip-10-0-141-101 kubenswrapper[2557]: I0709 19:00:00.138020    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-api-b-6c0298-29727060-jmwh2"]
Jul 09 19:00:00.138982 ip-10-0-141-101 kubenswrapper[2557]: I0709 19:00:00.138949    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="edda0506-ddb2-4324-a920-ab633bc718f6" containerName="istio-proxy"
Jul 09 19:00:00.139164 ip-10-0-141-101 kubenswrapper[2557]: I0709 19:00:00.139151    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="edda0506-ddb2-4324-a920-ab633bc718f6" containerName="istio-proxy"
Jul 09 19:00:00.144055 ip-10-0-141-101 kubenswrapper[2557]: I0709 19:00:00.144029    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29727060-8624q"]
Jul 09 19:00:00.147625 ip-10-0-141-101 kubenswrapper[2557]: I0709 19:00:00.147599    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-api-b-6c0298-29727060-jmwh2"
Jul 09 19:00:00.152245 ip-10-0-141-101 kubenswrapper[2557]: I0709 19:00:00.152219    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 09 19:00:00.154894 ip-10-0-141-101 kubenswrapper[2557]: I0709 19:00:00.154870    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-4zbc4\""
Jul 09 19:00:00.155944 ip-10-0-141-101 kubenswrapper[2557]: I0709 19:00:00.155922    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 09 19:00:00.161805 ip-10-0-141-101 kubenswrapper[2557]: I0709 19:00:00.161779    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-api-b-6c0298-29727060-jmwh2"]
Jul 09 19:00:00.162004 ip-10-0-141-101 kubenswrapper[2557]: I0709 19:00:00.161991    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29727060-8624q"]
Jul 09 19:00:00.162196 ip-10-0-141-101 kubenswrapper[2557]: I0709 19:00:00.162183    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29727060-8624q"
Jul 09 19:00:00.245080 ip-10-0-141-101 kubenswrapper[2557]: I0709 19:00:00.245030    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vtt8c\" (UniqueName: \"kubernetes.io/projected/5123ca4f-e2e5-4107-81b3-0da2fb736f6d-kube-api-access-vtt8c\") pod \"maas-api-key-cleanup-e2e-api-b-6c0298-29727060-jmwh2\" (UID: \"5123ca4f-e2e5-4107-81b3-0da2fb736f6d\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-api-b-6c0298-29727060-jmwh2"
Jul 09 19:00:00.245299 ip-10-0-141-101 kubenswrapper[2557]: I0709 19:00:00.245096    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7tbnj\" (UniqueName: \"kubernetes.io/projected/b6a23a7e-4d11-427e-bdbd-e5fe6724f5e1-kube-api-access-7tbnj\") pod \"maas-api-key-cleanup-29727060-8624q\" (UID: \"b6a23a7e-4d11-427e-bdbd-e5fe6724f5e1\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-29727060-8624q"
Jul 09 19:00:00.346800 ip-10-0-141-101 kubenswrapper[2557]: I0709 19:00:00.346754    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vtt8c\" (UniqueName: \"kubernetes.io/projected/5123ca4f-e2e5-4107-81b3-0da2fb736f6d-kube-api-access-vtt8c\") pod \"maas-api-key-cleanup-e2e-api-b-6c0298-29727060-jmwh2\" (UID: \"5123ca4f-e2e5-4107-81b3-0da2fb736f6d\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-api-b-6c0298-29727060-jmwh2"
Jul 09 19:00:00.347078 ip-10-0-141-101 kubenswrapper[2557]: I0709 19:00:00.347059    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7tbnj\" (UniqueName: \"kubernetes.io/projected/b6a23a7e-4d11-427e-bdbd-e5fe6724f5e1-kube-api-access-7tbnj\") pod \"maas-api-key-cleanup-29727060-8624q\" (UID: \"b6a23a7e-4d11-427e-bdbd-e5fe6724f5e1\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-29727060-8624q"
Jul 09 19:00:00.356571 ip-10-0-141-101 kubenswrapper[2557]: I0709 19:00:00.356538    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vtt8c\" (UniqueName: \"kubernetes.io/projected/5123ca4f-e2e5-4107-81b3-0da2fb736f6d-kube-api-access-vtt8c\") pod \"maas-api-key-cleanup-e2e-api-b-6c0298-29727060-jmwh2\" (UID: \"5123ca4f-e2e5-4107-81b3-0da2fb736f6d\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-api-b-6c0298-29727060-jmwh2"
Jul 09 19:00:00.356726 ip-10-0-141-101 kubenswrapper[2557]: I0709 19:00:00.356614    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7tbnj\" (UniqueName: \"kubernetes.io/projected/b6a23a7e-4d11-427e-bdbd-e5fe6724f5e1-kube-api-access-7tbnj\") pod \"maas-api-key-cleanup-29727060-8624q\" (UID: \"b6a23a7e-4d11-427e-bdbd-e5fe6724f5e1\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-29727060-8624q"
Jul 09 19:00:00.475171 ip-10-0-141-101 kubenswrapper[2557]: I0709 19:00:00.475069    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-api-b-6c0298-29727060-jmwh2"
Jul 09 19:00:00.480568 ip-10-0-141-101 kubenswrapper[2557]: I0709 19:00:00.480543    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29727060-8624q"
Jul 09 19:00:00.602261 ip-10-0-141-101 kubenswrapper[2557]: I0709 19:00:00.602096    2557 patch_prober.go:28] interesting pod/e2e-api-b-6c0298-openshift-default-5d9cfdbf6f-k2rwd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.62:15021/healthz/ready\": dial tcp 10.133.0.62:15021: connect: connection refused" start-of-body=
Jul 09 19:00:00.602261 ip-10-0-141-101 kubenswrapper[2557]: I0709 19:00:00.602157    2557 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-6c0298-openshift-default-5d9cfdbf6f-k2rwd" podUID="fe65e9f8-5a98-48f1-954d-467459dccc3d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.62:15021/healthz/ready\": dial tcp 10.133.0.62:15021: connect: connection refused"
Jul 09 19:00:00.678228 ip-10-0-141-101 kubenswrapper[2557]: I0709 19:00:00.678157    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-api-b-6c0298-29727060-jmwh2"]
Jul 09 19:00:00.679168 ip-10-0-141-101 kubenswrapper[2557]: W0709 19:00:00.679134    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5123ca4f_e2e5_4107_81b3_0da2fb736f6d.slice/crio-7f2bcd90d705fc2a967ebc7545ade6a29baead649874920387ccf344448215ae WatchSource:0}: Error finding container 7f2bcd90d705fc2a967ebc7545ade6a29baead649874920387ccf344448215ae: Status 404 returned error can't find the container with id 7f2bcd90d705fc2a967ebc7545ade6a29baead649874920387ccf344448215ae
Jul 09 19:00:00.706646 ip-10-0-141-101 kubenswrapper[2557]: I0709 19:00:00.706608    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-api-b-6c0298-29727060-jmwh2" event={"ID":"5123ca4f-e2e5-4107-81b3-0da2fb736f6d","Type":"ContainerStarted","Data":"7f2bcd90d705fc2a967ebc7545ade6a29baead649874920387ccf344448215ae"}
Jul 09 19:00:00.719422 ip-10-0-141-101 kubenswrapper[2557]: I0709 19:00:00.719399    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29727060-8624q"]
Jul 09 19:00:00.720805 ip-10-0-141-101 kubenswrapper[2557]: W0709 19:00:00.720780    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb6a23a7e_4d11_427e_bdbd_e5fe6724f5e1.slice/crio-866db3c12dd9f6adedba912c2e5b3ce78f7628243ba4595dad5aed660df9fb43 WatchSource:0}: Error finding container 866db3c12dd9f6adedba912c2e5b3ce78f7628243ba4595dad5aed660df9fb43: Status 404 returned error can't find the container with id 866db3c12dd9f6adedba912c2e5b3ce78f7628243ba4595dad5aed660df9fb43
Jul 09 19:00:01.715383 ip-10-0-141-101 kubenswrapper[2557]: I0709 19:00:01.715337    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29727060-8624q" event={"ID":"b6a23a7e-4d11-427e-bdbd-e5fe6724f5e1","Type":"ContainerStarted","Data":"a72b47c534a6546e279505fb411b4bf58b4290b64f041fc88c96e8327fd871cd"}
Jul 09 19:00:01.715881 ip-10-0-141-101 kubenswrapper[2557]: I0709 19:00:01.715413    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29727060-8624q" event={"ID":"b6a23a7e-4d11-427e-bdbd-e5fe6724f5e1","Type":"ContainerStarted","Data":"866db3c12dd9f6adedba912c2e5b3ce78f7628243ba4595dad5aed660df9fb43"}
Jul 09 19:00:01.717096 ip-10-0-141-101 kubenswrapper[2557]: I0709 19:00:01.717058    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-api-b-6c0298-29727060-jmwh2" event={"ID":"5123ca4f-e2e5-4107-81b3-0da2fb736f6d","Type":"ContainerStarted","Data":"4d862d98be9999a40ff6e44029b593683e99767794806b9dd2f4c2a084c70dd3"}
Jul 09 19:00:01.731684 ip-10-0-141-101 kubenswrapper[2557]: I0709 19:00:01.731643    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-6c0298-openshift-default-5d9cfdbf6f-k2rwd"
Jul 09 19:00:01.733556 ip-10-0-141-101 kubenswrapper[2557]: I0709 19:00:01.733514    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-6c0298-openshift-default-5d9cfdbf6f-k2rwd"
Jul 09 19:00:01.736267 ip-10-0-141-101 kubenswrapper[2557]: I0709 19:00:01.736220    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29727060-8624q" podStartSLOduration=1.736199467 podStartE2EDuration="1.736199467s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 19:00:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 19:00:01.734001923 +0000 UTC m=+2070.973346571" watchObservedRunningTime="2026-07-09 19:00:01.736199467 +0000 UTC m=+2070.975544094"
Jul 09 19:00:01.756463 ip-10-0-141-101 kubenswrapper[2557]: I0709 19:00:01.756406    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-api-b-6c0298-29727060-jmwh2" podStartSLOduration=1.756388849 podStartE2EDuration="1.756388849s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 19:00:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 19:00:01.755318524 +0000 UTC m=+2070.994663149" watchObservedRunningTime="2026-07-09 19:00:01.756388849 +0000 UTC m=+2070.995733474"
Jul 09 19:00:05.856243 ip-10-0-141-101 kubenswrapper[2557]: I0709 19:00:05.856203    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-api-b-6c0298-29727060-jmwh2"]
Jul 09 19:00:05.856709 ip-10-0-141-101 kubenswrapper[2557]: I0709 19:00:05.856408    2557 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-api-b-6c0298-29727060-jmwh2" podUID="5123ca4f-e2e5-4107-81b3-0da2fb736f6d" containerName="cleanup" containerID="cri-o://4d862d98be9999a40ff6e44029b593683e99767794806b9dd2f4c2a084c70dd3" gracePeriod=30
Jul 09 19:00:12.401711 ip-10-0-141-101 kubenswrapper[2557]: I0709 19:00:12.401674    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-6c0298-openshift-default-5d9cfdbf6f-k2rwd"]
Jul 09 19:00:12.402114 ip-10-0-141-101 kubenswrapper[2557]: I0709 19:00:12.401922    2557 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-api-b-6c0298-openshift-default-5d9cfdbf6f-k2rwd" podUID="fe65e9f8-5a98-48f1-954d-467459dccc3d" containerName="istio-proxy" containerID="cri-o://69c8b7a3f86ba46d4313576c2e1b6e9df146dc57066564b8ae2fdcf634083aae" gracePeriod=30
Jul 09 19:00:16.734803 ip-10-0-141-101 kubenswrapper[2557]: I0709 19:00:16.734762    2557 patch_prober.go:28] interesting pod/e2e-api-b-6c0298-openshift-default-5d9cfdbf6f-k2rwd container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=upstream connect error or disconnect/reset before headers. reset reason: remote connection failure, transport failure reason: delayed connect error: Connection refused
Jul 09 19:00:16.735206 ip-10-0-141-101 kubenswrapper[2557]: I0709 19:00:16.734825    2557 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-b-6c0298-openshift-default-5d9cfdbf6f-k2rwd" podUID="fe65e9f8-5a98-48f1-954d-467459dccc3d" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 09 19:00:17.664989 ip-10-0-141-101 kubenswrapper[2557]: I0709 19:00:17.664912    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-6c0298-openshift-default-5d9cfdbf6f-k2rwd"
Jul 09 19:00:17.722576 ip-10-0-141-101 kubenswrapper[2557]: I0709 19:00:17.722538    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fe65e9f8-5a98-48f1-954d-467459dccc3d-workload-socket\") pod \"fe65e9f8-5a98-48f1-954d-467459dccc3d\" (UID: \"fe65e9f8-5a98-48f1-954d-467459dccc3d\") "
Jul 09 19:00:17.722779 ip-10-0-141-101 kubenswrapper[2557]: I0709 19:00:17.722604    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fe65e9f8-5a98-48f1-954d-467459dccc3d-istio-podinfo\") pod \"fe65e9f8-5a98-48f1-954d-467459dccc3d\" (UID: \"fe65e9f8-5a98-48f1-954d-467459dccc3d\") "
Jul 09 19:00:17.722779 ip-10-0-141-101 kubenswrapper[2557]: I0709 19:00:17.722644    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wdv5n\" (UniqueName: \"kubernetes.io/projected/fe65e9f8-5a98-48f1-954d-467459dccc3d-kube-api-access-wdv5n\") pod \"fe65e9f8-5a98-48f1-954d-467459dccc3d\" (UID: \"fe65e9f8-5a98-48f1-954d-467459dccc3d\") "
Jul 09 19:00:17.722779 ip-10-0-141-101 kubenswrapper[2557]: I0709 19:00:17.722694    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fe65e9f8-5a98-48f1-954d-467459dccc3d-workload-certs\") pod \"fe65e9f8-5a98-48f1-954d-467459dccc3d\" (UID: \"fe65e9f8-5a98-48f1-954d-467459dccc3d\") "
Jul 09 19:00:17.722779 ip-10-0-141-101 kubenswrapper[2557]: I0709 19:00:17.722719    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fe65e9f8-5a98-48f1-954d-467459dccc3d-istiod-ca-cert\") pod \"fe65e9f8-5a98-48f1-954d-467459dccc3d\" (UID: \"fe65e9f8-5a98-48f1-954d-467459dccc3d\") "
Jul 09 19:00:17.722779 ip-10-0-141-101 kubenswrapper[2557]: I0709 19:00:17.722767    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fe65e9f8-5a98-48f1-954d-467459dccc3d-istio-data\") pod \"fe65e9f8-5a98-48f1-954d-467459dccc3d\" (UID: \"fe65e9f8-5a98-48f1-954d-467459dccc3d\") "
Jul 09 19:00:17.723077 ip-10-0-141-101 kubenswrapper[2557]: I0709 19:00:17.722803    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fe65e9f8-5a98-48f1-954d-467459dccc3d-istio-envoy\") pod \"fe65e9f8-5a98-48f1-954d-467459dccc3d\" (UID: \"fe65e9f8-5a98-48f1-954d-467459dccc3d\") "
Jul 09 19:00:17.723077 ip-10-0-141-101 kubenswrapper[2557]: I0709 19:00:17.722869    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fe65e9f8-5a98-48f1-954d-467459dccc3d-credential-socket\") pod \"fe65e9f8-5a98-48f1-954d-467459dccc3d\" (UID: \"fe65e9f8-5a98-48f1-954d-467459dccc3d\") "
Jul 09 19:00:17.723077 ip-10-0-141-101 kubenswrapper[2557]: I0709 19:00:17.722909    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fe65e9f8-5a98-48f1-954d-467459dccc3d-istio-token\") pod \"fe65e9f8-5a98-48f1-954d-467459dccc3d\" (UID: \"fe65e9f8-5a98-48f1-954d-467459dccc3d\") "
Jul 09 19:00:17.724265 ip-10-0-141-101 kubenswrapper[2557]: I0709 19:00:17.724074    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fe65e9f8-5a98-48f1-954d-467459dccc3d-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "fe65e9f8-5a98-48f1-954d-467459dccc3d" (UID: "fe65e9f8-5a98-48f1-954d-467459dccc3d"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 19:00:17.724265 ip-10-0-141-101 kubenswrapper[2557]: I0709 19:00:17.724146    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fe65e9f8-5a98-48f1-954d-467459dccc3d-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "fe65e9f8-5a98-48f1-954d-467459dccc3d" (UID: "fe65e9f8-5a98-48f1-954d-467459dccc3d"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 19:00:17.724459 ip-10-0-141-101 kubenswrapper[2557]: I0709 19:00:17.724355    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fe65e9f8-5a98-48f1-954d-467459dccc3d-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "fe65e9f8-5a98-48f1-954d-467459dccc3d" (UID: "fe65e9f8-5a98-48f1-954d-467459dccc3d"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 19:00:17.724459 ip-10-0-141-101 kubenswrapper[2557]: I0709 19:00:17.724368    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fe65e9f8-5a98-48f1-954d-467459dccc3d-istio-data" (OuterVolumeSpecName: "istio-data") pod "fe65e9f8-5a98-48f1-954d-467459dccc3d" (UID: "fe65e9f8-5a98-48f1-954d-467459dccc3d"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 19:00:17.724771 ip-10-0-141-101 kubenswrapper[2557]: I0709 19:00:17.724737    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fe65e9f8-5a98-48f1-954d-467459dccc3d-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "fe65e9f8-5a98-48f1-954d-467459dccc3d" (UID: "fe65e9f8-5a98-48f1-954d-467459dccc3d"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 09 19:00:17.726088 ip-10-0-141-101 kubenswrapper[2557]: I0709 19:00:17.726050    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fe65e9f8-5a98-48f1-954d-467459dccc3d-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "fe65e9f8-5a98-48f1-954d-467459dccc3d" (UID: "fe65e9f8-5a98-48f1-954d-467459dccc3d"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 19:00:17.726356 ip-10-0-141-101 kubenswrapper[2557]: I0709 19:00:17.726332    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fe65e9f8-5a98-48f1-954d-467459dccc3d-istio-token" (OuterVolumeSpecName: "istio-token") pod "fe65e9f8-5a98-48f1-954d-467459dccc3d" (UID: "fe65e9f8-5a98-48f1-954d-467459dccc3d"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 19:00:17.727106 ip-10-0-141-101 kubenswrapper[2557]: I0709 19:00:17.727074    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/fe65e9f8-5a98-48f1-954d-467459dccc3d-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "fe65e9f8-5a98-48f1-954d-467459dccc3d" (UID: "fe65e9f8-5a98-48f1-954d-467459dccc3d"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 09 19:00:17.727211 ip-10-0-141-101 kubenswrapper[2557]: I0709 19:00:17.727169    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fe65e9f8-5a98-48f1-954d-467459dccc3d-kube-api-access-wdv5n" (OuterVolumeSpecName: "kube-api-access-wdv5n") pod "fe65e9f8-5a98-48f1-954d-467459dccc3d" (UID: "fe65e9f8-5a98-48f1-954d-467459dccc3d"). InnerVolumeSpecName "kube-api-access-wdv5n". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 19:00:17.812614 ip-10-0-141-101 kubenswrapper[2557]: I0709 19:00:17.812580    2557 generic.go:356] "Generic (PLEG): container finished" podID="fe65e9f8-5a98-48f1-954d-467459dccc3d" containerID="69c8b7a3f86ba46d4313576c2e1b6e9df146dc57066564b8ae2fdcf634083aae" exitCode=0
Jul 09 19:00:17.813030 ip-10-0-141-101 kubenswrapper[2557]: I0709 19:00:17.812632    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-6c0298-openshift-default-5d9cfdbf6f-k2rwd"
Jul 09 19:00:17.813030 ip-10-0-141-101 kubenswrapper[2557]: I0709 19:00:17.812665    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-6c0298-openshift-default-5d9cfdbf6f-k2rwd" event={"ID":"fe65e9f8-5a98-48f1-954d-467459dccc3d","Type":"ContainerDied","Data":"69c8b7a3f86ba46d4313576c2e1b6e9df146dc57066564b8ae2fdcf634083aae"}
Jul 09 19:00:17.813030 ip-10-0-141-101 kubenswrapper[2557]: I0709 19:00:17.812724    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-6c0298-openshift-default-5d9cfdbf6f-k2rwd" event={"ID":"fe65e9f8-5a98-48f1-954d-467459dccc3d","Type":"ContainerDied","Data":"eae4f7d20de68a8b85dbe94bc586da7d171127343f473a4b42a706cad22076ae"}
Jul 09 19:00:17.813030 ip-10-0-141-101 kubenswrapper[2557]: I0709 19:00:17.812752    2557 scope.go:117] "RemoveContainer" containerID="69c8b7a3f86ba46d4313576c2e1b6e9df146dc57066564b8ae2fdcf634083aae"
Jul 09 19:00:17.823136 ip-10-0-141-101 kubenswrapper[2557]: I0709 19:00:17.823116    2557 scope.go:117] "RemoveContainer" containerID="3598ba6db1c9fa0587c0acc2d835eba92789e1fd96b20009aa6571fbb35d0e56"
Jul 09 19:00:17.823769 ip-10-0-141-101 kubenswrapper[2557]: I0709 19:00:17.823746    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wdv5n\" (UniqueName: \"kubernetes.io/projected/fe65e9f8-5a98-48f1-954d-467459dccc3d-kube-api-access-wdv5n\") on node \"ip-10-0-141-101.ec2.internal\" DevicePath \"\""
Jul 09 19:00:17.823769 ip-10-0-141-101 kubenswrapper[2557]: I0709 19:00:17.823768    2557 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fe65e9f8-5a98-48f1-954d-467459dccc3d-workload-certs\") on node \"ip-10-0-141-101.ec2.internal\" DevicePath \"\""
Jul 09 19:00:17.823930 ip-10-0-141-101 kubenswrapper[2557]: I0709 19:00:17.823783    2557 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fe65e9f8-5a98-48f1-954d-467459dccc3d-istiod-ca-cert\") on node \"ip-10-0-141-101.ec2.internal\" DevicePath \"\""
Jul 09 19:00:17.823930 ip-10-0-141-101 kubenswrapper[2557]: I0709 19:00:17.823819    2557 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fe65e9f8-5a98-48f1-954d-467459dccc3d-istio-data\") on node \"ip-10-0-141-101.ec2.internal\" DevicePath \"\""
Jul 09 19:00:17.823930 ip-10-0-141-101 kubenswrapper[2557]: I0709 19:00:17.823830    2557 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fe65e9f8-5a98-48f1-954d-467459dccc3d-istio-envoy\") on node \"ip-10-0-141-101.ec2.internal\" DevicePath \"\""
Jul 09 19:00:17.823930 ip-10-0-141-101 kubenswrapper[2557]: I0709 19:00:17.823840    2557 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fe65e9f8-5a98-48f1-954d-467459dccc3d-credential-socket\") on node \"ip-10-0-141-101.ec2.internal\" DevicePath \"\""
Jul 09 19:00:17.823930 ip-10-0-141-101 kubenswrapper[2557]: I0709 19:00:17.823852    2557 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fe65e9f8-5a98-48f1-954d-467459dccc3d-istio-token\") on node \"ip-10-0-141-101.ec2.internal\" DevicePath \"\""
Jul 09 19:00:17.823930 ip-10-0-141-101 kubenswrapper[2557]: I0709 19:00:17.823863    2557 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fe65e9f8-5a98-48f1-954d-467459dccc3d-workload-socket\") on node \"ip-10-0-141-101.ec2.internal\" DevicePath \"\""
Jul 09 19:00:17.823930 ip-10-0-141-101 kubenswrapper[2557]: I0709 19:00:17.823875    2557 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fe65e9f8-5a98-48f1-954d-467459dccc3d-istio-podinfo\") on node \"ip-10-0-141-101.ec2.internal\" DevicePath \"\""
Jul 09 19:00:17.832559 ip-10-0-141-101 kubenswrapper[2557]: I0709 19:00:17.832538    2557 scope.go:117] "RemoveContainer" containerID="69c8b7a3f86ba46d4313576c2e1b6e9df146dc57066564b8ae2fdcf634083aae"
Jul 09 19:00:17.832823 ip-10-0-141-101 kubenswrapper[2557]: E0709 19:00:17.832799    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"69c8b7a3f86ba46d4313576c2e1b6e9df146dc57066564b8ae2fdcf634083aae\": container with ID starting with 69c8b7a3f86ba46d4313576c2e1b6e9df146dc57066564b8ae2fdcf634083aae not found: ID does not exist" containerID="69c8b7a3f86ba46d4313576c2e1b6e9df146dc57066564b8ae2fdcf634083aae"
Jul 09 19:00:17.832872 ip-10-0-141-101 kubenswrapper[2557]: I0709 19:00:17.832832    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"69c8b7a3f86ba46d4313576c2e1b6e9df146dc57066564b8ae2fdcf634083aae"} err="failed to get container status \"69c8b7a3f86ba46d4313576c2e1b6e9df146dc57066564b8ae2fdcf634083aae\": rpc error: code = NotFound desc = could not find container \"69c8b7a3f86ba46d4313576c2e1b6e9df146dc57066564b8ae2fdcf634083aae\": container with ID starting with 69c8b7a3f86ba46d4313576c2e1b6e9df146dc57066564b8ae2fdcf634083aae not found: ID does not exist"
Jul 09 19:00:17.832872 ip-10-0-141-101 kubenswrapper[2557]: I0709 19:00:17.832851    2557 scope.go:117] "RemoveContainer" containerID="3598ba6db1c9fa0587c0acc2d835eba92789e1fd96b20009aa6571fbb35d0e56"
Jul 09 19:00:17.833132 ip-10-0-141-101 kubenswrapper[2557]: E0709 19:00:17.833110    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3598ba6db1c9fa0587c0acc2d835eba92789e1fd96b20009aa6571fbb35d0e56\": container with ID starting with 3598ba6db1c9fa0587c0acc2d835eba92789e1fd96b20009aa6571fbb35d0e56 not found: ID does not exist" containerID="3598ba6db1c9fa0587c0acc2d835eba92789e1fd96b20009aa6571fbb35d0e56"
Jul 09 19:00:17.833185 ip-10-0-141-101 kubenswrapper[2557]: I0709 19:00:17.833140    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3598ba6db1c9fa0587c0acc2d835eba92789e1fd96b20009aa6571fbb35d0e56"} err="failed to get container status \"3598ba6db1c9fa0587c0acc2d835eba92789e1fd96b20009aa6571fbb35d0e56\": rpc error: code = NotFound desc = could not find container \"3598ba6db1c9fa0587c0acc2d835eba92789e1fd96b20009aa6571fbb35d0e56\": container with ID starting with 3598ba6db1c9fa0587c0acc2d835eba92789e1fd96b20009aa6571fbb35d0e56 not found: ID does not exist"
Jul 09 19:00:17.837109 ip-10-0-141-101 kubenswrapper[2557]: I0709 19:00:17.837085    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-6c0298-openshift-default-5d9cfdbf6f-k2rwd"]
Jul 09 19:00:17.844823 ip-10-0-141-101 kubenswrapper[2557]: I0709 19:00:17.844801    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-b-6c0298-openshift-default-5d9cfdbf6f-k2rwd"]
Jul 09 19:00:19.262650 ip-10-0-141-101 kubenswrapper[2557]: I0709 19:00:19.262616    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fe65e9f8-5a98-48f1-954d-467459dccc3d" path="/var/lib/kubelet/pods/fe65e9f8-5a98-48f1-954d-467459dccc3d/volumes"
Jul 09 19:00:21.319378 ip-10-0-141-101 kubenswrapper[2557]: I0709 19:00:21.319348    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-b-172f88-openshift-default-5c95794d55-crfth"]
Jul 09 19:00:21.319788 ip-10-0-141-101 kubenswrapper[2557]: I0709 19:00:21.319774    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fe65e9f8-5a98-48f1-954d-467459dccc3d" containerName="istio-proxy"
Jul 09 19:00:21.319788 ip-10-0-141-101 kubenswrapper[2557]: I0709 19:00:21.319789    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="fe65e9f8-5a98-48f1-954d-467459dccc3d" containerName="istio-proxy"
Jul 09 19:00:21.319877 ip-10-0-141-101 kubenswrapper[2557]: I0709 19:00:21.319802    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fe65e9f8-5a98-48f1-954d-467459dccc3d" containerName="istio-proxy"
Jul 09 19:00:21.319877 ip-10-0-141-101 kubenswrapper[2557]: I0709 19:00:21.319807    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="fe65e9f8-5a98-48f1-954d-467459dccc3d" containerName="istio-proxy"
Jul 09 19:00:21.319942 ip-10-0-141-101 kubenswrapper[2557]: I0709 19:00:21.319881    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="fe65e9f8-5a98-48f1-954d-467459dccc3d" containerName="istio-proxy"
Jul 09 19:00:21.324703 ip-10-0-141-101 kubenswrapper[2557]: I0709 19:00:21.324679    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-172f88-openshift-default-5c95794d55-crfth"
Jul 09 19:00:21.329706 ip-10-0-141-101 kubenswrapper[2557]: I0709 19:00:21.329676    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-b-172f88-openshift-default-dockercfg-lwnm4\""
Jul 09 19:00:21.340264 ip-10-0-141-101 kubenswrapper[2557]: I0709 19:00:21.340242    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-172f88-openshift-default-5c95794d55-crfth"]
Jul 09 19:00:21.358592 ip-10-0-141-101 kubenswrapper[2557]: I0709 19:00:21.358562    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ac93bbf3-1a6f-40c1-8a13-482688a41e56-istio-token\") pod \"e2e-shared-b-172f88-openshift-default-5c95794d55-crfth\" (UID: \"ac93bbf3-1a6f-40c1-8a13-482688a41e56\") " pod="openshift-ingress/e2e-shared-b-172f88-openshift-default-5c95794d55-crfth"
Jul 09 19:00:21.358753 ip-10-0-141-101 kubenswrapper[2557]: I0709 19:00:21.358604    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ac93bbf3-1a6f-40c1-8a13-482688a41e56-istiod-ca-cert\") pod \"e2e-shared-b-172f88-openshift-default-5c95794d55-crfth\" (UID: \"ac93bbf3-1a6f-40c1-8a13-482688a41e56\") " pod="openshift-ingress/e2e-shared-b-172f88-openshift-default-5c95794d55-crfth"
Jul 09 19:00:21.358753 ip-10-0-141-101 kubenswrapper[2557]: I0709 19:00:21.358626    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-54rms\" (UniqueName: \"kubernetes.io/projected/ac93bbf3-1a6f-40c1-8a13-482688a41e56-kube-api-access-54rms\") pod \"e2e-shared-b-172f88-openshift-default-5c95794d55-crfth\" (UID: \"ac93bbf3-1a6f-40c1-8a13-482688a41e56\") " pod="openshift-ingress/e2e-shared-b-172f88-openshift-default-5c95794d55-crfth"
Jul 09 19:00:21.358753 ip-10-0-141-101 kubenswrapper[2557]: I0709 19:00:21.358733    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ac93bbf3-1a6f-40c1-8a13-482688a41e56-workload-certs\") pod \"e2e-shared-b-172f88-openshift-default-5c95794d55-crfth\" (UID: \"ac93bbf3-1a6f-40c1-8a13-482688a41e56\") " pod="openshift-ingress/e2e-shared-b-172f88-openshift-default-5c95794d55-crfth"
Jul 09 19:00:21.358869 ip-10-0-141-101 kubenswrapper[2557]: I0709 19:00:21.358774    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ac93bbf3-1a6f-40c1-8a13-482688a41e56-workload-socket\") pod \"e2e-shared-b-172f88-openshift-default-5c95794d55-crfth\" (UID: \"ac93bbf3-1a6f-40c1-8a13-482688a41e56\") " pod="openshift-ingress/e2e-shared-b-172f88-openshift-default-5c95794d55-crfth"
Jul 09 19:00:21.358869 ip-10-0-141-101 kubenswrapper[2557]: I0709 19:00:21.358801    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ac93bbf3-1a6f-40c1-8a13-482688a41e56-istio-envoy\") pod \"e2e-shared-b-172f88-openshift-default-5c95794d55-crfth\" (UID: \"ac93bbf3-1a6f-40c1-8a13-482688a41e56\") " pod="openshift-ingress/e2e-shared-b-172f88-openshift-default-5c95794d55-crfth"
Jul 09 19:00:21.358869 ip-10-0-141-101 kubenswrapper[2557]: I0709 19:00:21.358848    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ac93bbf3-1a6f-40c1-8a13-482688a41e56-istio-podinfo\") pod \"e2e-shared-b-172f88-openshift-default-5c95794d55-crfth\" (UID: \"ac93bbf3-1a6f-40c1-8a13-482688a41e56\") " pod="openshift-ingress/e2e-shared-b-172f88-openshift-default-5c95794d55-crfth"
Jul 09 19:00:21.358975 ip-10-0-141-101 kubenswrapper[2557]: I0709 19:00:21.358876    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ac93bbf3-1a6f-40c1-8a13-482688a41e56-istio-data\") pod \"e2e-shared-b-172f88-openshift-default-5c95794d55-crfth\" (UID: \"ac93bbf3-1a6f-40c1-8a13-482688a41e56\") " pod="openshift-ingress/e2e-shared-b-172f88-openshift-default-5c95794d55-crfth"
Jul 09 19:00:21.358975 ip-10-0-141-101 kubenswrapper[2557]: I0709 19:00:21.358903    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ac93bbf3-1a6f-40c1-8a13-482688a41e56-credential-socket\") pod \"e2e-shared-b-172f88-openshift-default-5c95794d55-crfth\" (UID: \"ac93bbf3-1a6f-40c1-8a13-482688a41e56\") " pod="openshift-ingress/e2e-shared-b-172f88-openshift-default-5c95794d55-crfth"
Jul 09 19:00:21.459863 ip-10-0-141-101 kubenswrapper[2557]: I0709 19:00:21.459830    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ac93bbf3-1a6f-40c1-8a13-482688a41e56-istio-envoy\") pod \"e2e-shared-b-172f88-openshift-default-5c95794d55-crfth\" (UID: \"ac93bbf3-1a6f-40c1-8a13-482688a41e56\") " pod="openshift-ingress/e2e-shared-b-172f88-openshift-default-5c95794d55-crfth"
Jul 09 19:00:21.460041 ip-10-0-141-101 kubenswrapper[2557]: I0709 19:00:21.459877    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ac93bbf3-1a6f-40c1-8a13-482688a41e56-istio-podinfo\") pod \"e2e-shared-b-172f88-openshift-default-5c95794d55-crfth\" (UID: \"ac93bbf3-1a6f-40c1-8a13-482688a41e56\") " pod="openshift-ingress/e2e-shared-b-172f88-openshift-default-5c95794d55-crfth"
Jul 09 19:00:21.460041 ip-10-0-141-101 kubenswrapper[2557]: I0709 19:00:21.459909    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ac93bbf3-1a6f-40c1-8a13-482688a41e56-istio-data\") pod \"e2e-shared-b-172f88-openshift-default-5c95794d55-crfth\" (UID: \"ac93bbf3-1a6f-40c1-8a13-482688a41e56\") " pod="openshift-ingress/e2e-shared-b-172f88-openshift-default-5c95794d55-crfth"
Jul 09 19:00:21.460041 ip-10-0-141-101 kubenswrapper[2557]: I0709 19:00:21.459950    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ac93bbf3-1a6f-40c1-8a13-482688a41e56-credential-socket\") pod \"e2e-shared-b-172f88-openshift-default-5c95794d55-crfth\" (UID: \"ac93bbf3-1a6f-40c1-8a13-482688a41e56\") " pod="openshift-ingress/e2e-shared-b-172f88-openshift-default-5c95794d55-crfth"
Jul 09 19:00:21.460041 ip-10-0-141-101 kubenswrapper[2557]: I0709 19:00:21.460013    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ac93bbf3-1a6f-40c1-8a13-482688a41e56-istio-token\") pod \"e2e-shared-b-172f88-openshift-default-5c95794d55-crfth\" (UID: \"ac93bbf3-1a6f-40c1-8a13-482688a41e56\") " pod="openshift-ingress/e2e-shared-b-172f88-openshift-default-5c95794d55-crfth"
Jul 09 19:00:21.460248 ip-10-0-141-101 kubenswrapper[2557]: I0709 19:00:21.460050    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ac93bbf3-1a6f-40c1-8a13-482688a41e56-istiod-ca-cert\") pod \"e2e-shared-b-172f88-openshift-default-5c95794d55-crfth\" (UID: \"ac93bbf3-1a6f-40c1-8a13-482688a41e56\") " pod="openshift-ingress/e2e-shared-b-172f88-openshift-default-5c95794d55-crfth"
Jul 09 19:00:21.460248 ip-10-0-141-101 kubenswrapper[2557]: I0709 19:00:21.460079    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-54rms\" (UniqueName: \"kubernetes.io/projected/ac93bbf3-1a6f-40c1-8a13-482688a41e56-kube-api-access-54rms\") pod \"e2e-shared-b-172f88-openshift-default-5c95794d55-crfth\" (UID: \"ac93bbf3-1a6f-40c1-8a13-482688a41e56\") " pod="openshift-ingress/e2e-shared-b-172f88-openshift-default-5c95794d55-crfth"
Jul 09 19:00:21.460394 ip-10-0-141-101 kubenswrapper[2557]: I0709 19:00:21.460361    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ac93bbf3-1a6f-40c1-8a13-482688a41e56-istio-data\") pod \"e2e-shared-b-172f88-openshift-default-5c95794d55-crfth\" (UID: \"ac93bbf3-1a6f-40c1-8a13-482688a41e56\") " pod="openshift-ingress/e2e-shared-b-172f88-openshift-default-5c95794d55-crfth"
Jul 09 19:00:21.460459 ip-10-0-141-101 kubenswrapper[2557]: I0709 19:00:21.460385    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ac93bbf3-1a6f-40c1-8a13-482688a41e56-workload-certs\") pod \"e2e-shared-b-172f88-openshift-default-5c95794d55-crfth\" (UID: \"ac93bbf3-1a6f-40c1-8a13-482688a41e56\") " pod="openshift-ingress/e2e-shared-b-172f88-openshift-default-5c95794d55-crfth"
Jul 09 19:00:21.460459 ip-10-0-141-101 kubenswrapper[2557]: I0709 19:00:21.460430    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ac93bbf3-1a6f-40c1-8a13-482688a41e56-credential-socket\") pod \"e2e-shared-b-172f88-openshift-default-5c95794d55-crfth\" (UID: \"ac93bbf3-1a6f-40c1-8a13-482688a41e56\") " pod="openshift-ingress/e2e-shared-b-172f88-openshift-default-5c95794d55-crfth"
Jul 09 19:00:21.460573 ip-10-0-141-101 kubenswrapper[2557]: I0709 19:00:21.460496    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ac93bbf3-1a6f-40c1-8a13-482688a41e56-workload-socket\") pod \"e2e-shared-b-172f88-openshift-default-5c95794d55-crfth\" (UID: \"ac93bbf3-1a6f-40c1-8a13-482688a41e56\") " pod="openshift-ingress/e2e-shared-b-172f88-openshift-default-5c95794d55-crfth"
Jul 09 19:00:21.460688 ip-10-0-141-101 kubenswrapper[2557]: I0709 19:00:21.460665    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ac93bbf3-1a6f-40c1-8a13-482688a41e56-workload-certs\") pod \"e2e-shared-b-172f88-openshift-default-5c95794d55-crfth\" (UID: \"ac93bbf3-1a6f-40c1-8a13-482688a41e56\") " pod="openshift-ingress/e2e-shared-b-172f88-openshift-default-5c95794d55-crfth"
Jul 09 19:00:21.460865 ip-10-0-141-101 kubenswrapper[2557]: I0709 19:00:21.460842    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ac93bbf3-1a6f-40c1-8a13-482688a41e56-workload-socket\") pod \"e2e-shared-b-172f88-openshift-default-5c95794d55-crfth\" (UID: \"ac93bbf3-1a6f-40c1-8a13-482688a41e56\") " pod="openshift-ingress/e2e-shared-b-172f88-openshift-default-5c95794d55-crfth"
Jul 09 19:00:21.460909 ip-10-0-141-101 kubenswrapper[2557]: I0709 19:00:21.460848    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ac93bbf3-1a6f-40c1-8a13-482688a41e56-istiod-ca-cert\") pod \"e2e-shared-b-172f88-openshift-default-5c95794d55-crfth\" (UID: \"ac93bbf3-1a6f-40c1-8a13-482688a41e56\") " pod="openshift-ingress/e2e-shared-b-172f88-openshift-default-5c95794d55-crfth"
Jul 09 19:00:21.462318 ip-10-0-141-101 kubenswrapper[2557]: I0709 19:00:21.462296    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ac93bbf3-1a6f-40c1-8a13-482688a41e56-istio-envoy\") pod \"e2e-shared-b-172f88-openshift-default-5c95794d55-crfth\" (UID: \"ac93bbf3-1a6f-40c1-8a13-482688a41e56\") " pod="openshift-ingress/e2e-shared-b-172f88-openshift-default-5c95794d55-crfth"
Jul 09 19:00:21.462459 ip-10-0-141-101 kubenswrapper[2557]: I0709 19:00:21.462441    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ac93bbf3-1a6f-40c1-8a13-482688a41e56-istio-podinfo\") pod \"e2e-shared-b-172f88-openshift-default-5c95794d55-crfth\" (UID: \"ac93bbf3-1a6f-40c1-8a13-482688a41e56\") " pod="openshift-ingress/e2e-shared-b-172f88-openshift-default-5c95794d55-crfth"
Jul 09 19:00:21.471216 ip-10-0-141-101 kubenswrapper[2557]: I0709 19:00:21.471192    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ac93bbf3-1a6f-40c1-8a13-482688a41e56-istio-token\") pod \"e2e-shared-b-172f88-openshift-default-5c95794d55-crfth\" (UID: \"ac93bbf3-1a6f-40c1-8a13-482688a41e56\") " pod="openshift-ingress/e2e-shared-b-172f88-openshift-default-5c95794d55-crfth"
Jul 09 19:00:21.471351 ip-10-0-141-101 kubenswrapper[2557]: I0709 19:00:21.471301    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-54rms\" (UniqueName: \"kubernetes.io/projected/ac93bbf3-1a6f-40c1-8a13-482688a41e56-kube-api-access-54rms\") pod \"e2e-shared-b-172f88-openshift-default-5c95794d55-crfth\" (UID: \"ac93bbf3-1a6f-40c1-8a13-482688a41e56\") " pod="openshift-ingress/e2e-shared-b-172f88-openshift-default-5c95794d55-crfth"
Jul 09 19:00:21.636521 ip-10-0-141-101 kubenswrapper[2557]: I0709 19:00:21.636422    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-172f88-openshift-default-5c95794d55-crfth"
Jul 09 19:00:21.811540 ip-10-0-141-101 kubenswrapper[2557]: I0709 19:00:21.811505    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-172f88-openshift-default-5c95794d55-crfth"]
Jul 09 19:00:21.820562 ip-10-0-141-101 kubenswrapper[2557]: W0709 19:00:21.820535    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podac93bbf3_1a6f_40c1_8a13_482688a41e56.slice/crio-e9b391a688d6e2d103651e3964631d3ec552af448fea1ad6acc3f71622ee55d0 WatchSource:0}: Error finding container e9b391a688d6e2d103651e3964631d3ec552af448fea1ad6acc3f71622ee55d0: Status 404 returned error can't find the container with id e9b391a688d6e2d103651e3964631d3ec552af448fea1ad6acc3f71622ee55d0
Jul 09 19:00:21.823311 ip-10-0-141-101 kubenswrapper[2557]: I0709 19:00:21.823264    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 09 19:00:21.823420 ip-10-0-141-101 kubenswrapper[2557]: I0709 19:00:21.823362    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 09 19:00:21.823420 ip-10-0-141-101 kubenswrapper[2557]: I0709 19:00:21.823402    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 09 19:00:21.843192 ip-10-0-141-101 kubenswrapper[2557]: I0709 19:00:21.843156    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-172f88-openshift-default-5c95794d55-crfth" event={"ID":"ac93bbf3-1a6f-40c1-8a13-482688a41e56","Type":"ContainerStarted","Data":"e9b391a688d6e2d103651e3964631d3ec552af448fea1ad6acc3f71622ee55d0"}
Jul 09 19:00:22.851365 ip-10-0-141-101 kubenswrapper[2557]: I0709 19:00:22.851323    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-172f88-openshift-default-5c95794d55-crfth" event={"ID":"ac93bbf3-1a6f-40c1-8a13-482688a41e56","Type":"ContainerStarted","Data":"bbe68a34300c82b702b34c4d60cd99432300ecc0d3f112e12832cf02db8e7826"}
Jul 09 19:00:22.881944 ip-10-0-141-101 kubenswrapper[2557]: I0709 19:00:22.881887    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-b-172f88-openshift-default-5c95794d55-crfth" podStartSLOduration=1.881870948 podStartE2EDuration="1.881870948s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 19:00:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 19:00:22.877609874 +0000 UTC m=+2092.116954517" watchObservedRunningTime="2026-07-09 19:00:22.881870948 +0000 UTC m=+2092.121215573"
Jul 09 19:00:23.636643 ip-10-0-141-101 kubenswrapper[2557]: I0709 19:00:23.636595    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-172f88-openshift-default-5c95794d55-crfth"
Jul 09 19:00:23.642128 ip-10-0-141-101 kubenswrapper[2557]: I0709 19:00:23.642101    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-172f88-openshift-default-5c95794d55-crfth"
Jul 09 19:00:23.857533 ip-10-0-141-101 kubenswrapper[2557]: I0709 19:00:23.857499    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-172f88-openshift-default-5c95794d55-crfth"
Jul 09 19:00:23.858417 ip-10-0-141-101 kubenswrapper[2557]: I0709 19:00:23.858396    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-172f88-openshift-default-5c95794d55-crfth"
Jul 09 19:00:35.946611 ip-10-0-141-101 kubenswrapper[2557]: I0709 19:00:35.946332    2557 generic.go:356] "Generic (PLEG): container finished" podID="5123ca4f-e2e5-4107-81b3-0da2fb736f6d" containerID="4d862d98be9999a40ff6e44029b593683e99767794806b9dd2f4c2a084c70dd3" exitCode=137
Jul 09 19:00:35.946611 ip-10-0-141-101 kubenswrapper[2557]: I0709 19:00:35.946542    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-api-b-6c0298-29727060-jmwh2" event={"ID":"5123ca4f-e2e5-4107-81b3-0da2fb736f6d","Type":"ContainerDied","Data":"4d862d98be9999a40ff6e44029b593683e99767794806b9dd2f4c2a084c70dd3"}
Jul 09 19:00:36.111497 ip-10-0-141-101 kubenswrapper[2557]: I0709 19:00:36.111423    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-api-b-6c0298-29727060-jmwh2"
Jul 09 19:00:36.204765 ip-10-0-141-101 kubenswrapper[2557]: I0709 19:00:36.204731    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vtt8c\" (UniqueName: \"kubernetes.io/projected/5123ca4f-e2e5-4107-81b3-0da2fb736f6d-kube-api-access-vtt8c\") pod \"5123ca4f-e2e5-4107-81b3-0da2fb736f6d\" (UID: \"5123ca4f-e2e5-4107-81b3-0da2fb736f6d\") "
Jul 09 19:00:36.206785 ip-10-0-141-101 kubenswrapper[2557]: I0709 19:00:36.206752    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5123ca4f-e2e5-4107-81b3-0da2fb736f6d-kube-api-access-vtt8c" (OuterVolumeSpecName: "kube-api-access-vtt8c") pod "5123ca4f-e2e5-4107-81b3-0da2fb736f6d" (UID: "5123ca4f-e2e5-4107-81b3-0da2fb736f6d"). InnerVolumeSpecName "kube-api-access-vtt8c". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 19:00:36.305902 ip-10-0-141-101 kubenswrapper[2557]: I0709 19:00:36.305869    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vtt8c\" (UniqueName: \"kubernetes.io/projected/5123ca4f-e2e5-4107-81b3-0da2fb736f6d-kube-api-access-vtt8c\") on node \"ip-10-0-141-101.ec2.internal\" DevicePath \"\""
Jul 09 19:00:36.953524 ip-10-0-141-101 kubenswrapper[2557]: I0709 19:00:36.953469    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-api-b-6c0298-29727060-jmwh2" event={"ID":"5123ca4f-e2e5-4107-81b3-0da2fb736f6d","Type":"ContainerDied","Data":"7f2bcd90d705fc2a967ebc7545ade6a29baead649874920387ccf344448215ae"}
Jul 09 19:00:36.953524 ip-10-0-141-101 kubenswrapper[2557]: I0709 19:00:36.953519    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-api-b-6c0298-29727060-jmwh2"
Jul 09 19:00:36.954043 ip-10-0-141-101 kubenswrapper[2557]: I0709 19:00:36.953566    2557 scope.go:117] "RemoveContainer" containerID="4d862d98be9999a40ff6e44029b593683e99767794806b9dd2f4c2a084c70dd3"
Jul 09 19:00:36.982508 ip-10-0-141-101 kubenswrapper[2557]: I0709 19:00:36.982466    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-api-b-6c0298-29727060-jmwh2"]
Jul 09 19:00:36.986383 ip-10-0-141-101 kubenswrapper[2557]: I0709 19:00:36.986345    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-api-b-6c0298-29727060-jmwh2"]
Jul 09 19:00:37.263067 ip-10-0-141-101 kubenswrapper[2557]: I0709 19:00:37.262985    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5123ca4f-e2e5-4107-81b3-0da2fb736f6d" path="/var/lib/kubelet/pods/5123ca4f-e2e5-4107-81b3-0da2fb736f6d/volumes"
Jul 09 19:00:39.709023 ip-10-0-141-101 kubenswrapper[2557]: I0709 19:00:39.707960    2557 patch_prober.go:28] interesting pod/e2e-shared-b-172f88-openshift-default-5c95794d55-crfth container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.65:15021/healthz/ready\": read tcp 10.133.0.2:59496->10.133.0.65:15021: read: connection reset by peer" start-of-body=
Jul 09 19:00:39.709023 ip-10-0-141-101 kubenswrapper[2557]: I0709 19:00:39.708034    2557 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-b-172f88-openshift-default-5c95794d55-crfth" podUID="ac93bbf3-1a6f-40c1-8a13-482688a41e56" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.65:15021/healthz/ready\": read tcp 10.133.0.2:59496->10.133.0.65:15021: read: connection reset by peer"
Jul 09 19:00:39.978193 ip-10-0-141-101 kubenswrapper[2557]: I0709 19:00:39.978084    2557 generic.go:356] "Generic (PLEG): container finished" podID="ac93bbf3-1a6f-40c1-8a13-482688a41e56" containerID="bbe68a34300c82b702b34c4d60cd99432300ecc0d3f112e12832cf02db8e7826" exitCode=0
Jul 09 19:00:39.978193 ip-10-0-141-101 kubenswrapper[2557]: I0709 19:00:39.978131    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-172f88-openshift-default-5c95794d55-crfth" event={"ID":"ac93bbf3-1a6f-40c1-8a13-482688a41e56","Type":"ContainerDied","Data":"bbe68a34300c82b702b34c4d60cd99432300ecc0d3f112e12832cf02db8e7826"}
Jul 09 19:00:39.978663 ip-10-0-141-101 kubenswrapper[2557]: I0709 19:00:39.978644    2557 scope.go:117] "RemoveContainer" containerID="bbe68a34300c82b702b34c4d60cd99432300ecc0d3f112e12832cf02db8e7826"
Jul 09 19:00:39.979707 ip-10-0-141-101 kubenswrapper[2557]: I0709 19:00:39.979680    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 09 19:00:39.979774 ip-10-0-141-101 kubenswrapper[2557]: I0709 19:00:39.979757    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 09 19:00:39.979815 ip-10-0-141-101 kubenswrapper[2557]: I0709 19:00:39.979789    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 09 19:00:40.985910 ip-10-0-141-101 kubenswrapper[2557]: I0709 19:00:40.985876    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-172f88-openshift-default-5c95794d55-crfth" event={"ID":"ac93bbf3-1a6f-40c1-8a13-482688a41e56","Type":"ContainerStarted","Data":"d84e5105f3395997e351db27cf66b1d7c5aa471525c1858f539c365eef99bc9a"}
Jul 09 19:00:41.637949 ip-10-0-141-101 kubenswrapper[2557]: I0709 19:00:41.637901    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-172f88-openshift-default-5c95794d55-crfth"
Jul 09 19:00:41.638362 ip-10-0-141-101 kubenswrapper[2557]: I0709 19:00:41.638338    2557 patch_prober.go:28] interesting pod/e2e-shared-b-172f88-openshift-default-5c95794d55-crfth container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.65:15021/healthz/ready\": dial tcp 10.133.0.65:15021: connect: connection refused" start-of-body=
Jul 09 19:00:41.638586 ip-10-0-141-101 kubenswrapper[2557]: I0709 19:00:41.638562    2557 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-172f88-openshift-default-5c95794d55-crfth" podUID="ac93bbf3-1a6f-40c1-8a13-482688a41e56" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.65:15021/healthz/ready\": dial tcp 10.133.0.65:15021: connect: connection refused"
Jul 09 19:00:42.637837 ip-10-0-141-101 kubenswrapper[2557]: I0709 19:00:42.637784    2557 patch_prober.go:28] interesting pod/e2e-shared-b-172f88-openshift-default-5c95794d55-crfth container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.65:15021/healthz/ready\": dial tcp 10.133.0.65:15021: connect: connection refused" start-of-body=
Jul 09 19:00:42.638354 ip-10-0-141-101 kubenswrapper[2557]: I0709 19:00:42.637866    2557 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-172f88-openshift-default-5c95794d55-crfth" podUID="ac93bbf3-1a6f-40c1-8a13-482688a41e56" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.65:15021/healthz/ready\": dial tcp 10.133.0.65:15021: connect: connection refused"
Jul 09 19:00:43.637625 ip-10-0-141-101 kubenswrapper[2557]: I0709 19:00:43.637581    2557 patch_prober.go:28] interesting pod/e2e-shared-b-172f88-openshift-default-5c95794d55-crfth container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.65:15021/healthz/ready\": dial tcp 10.133.0.65:15021: connect: connection refused" start-of-body=
Jul 09 19:00:43.637856 ip-10-0-141-101 kubenswrapper[2557]: I0709 19:00:43.637667    2557 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-172f88-openshift-default-5c95794d55-crfth" podUID="ac93bbf3-1a6f-40c1-8a13-482688a41e56" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.65:15021/healthz/ready\": dial tcp 10.133.0.65:15021: connect: connection refused"
Jul 09 19:00:44.637803 ip-10-0-141-101 kubenswrapper[2557]: I0709 19:00:44.637754    2557 patch_prober.go:28] interesting pod/e2e-shared-b-172f88-openshift-default-5c95794d55-crfth container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.65:15021/healthz/ready\": dial tcp 10.133.0.65:15021: connect: connection refused" start-of-body=
Jul 09 19:00:44.638030 ip-10-0-141-101 kubenswrapper[2557]: I0709 19:00:44.637871    2557 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-172f88-openshift-default-5c95794d55-crfth" podUID="ac93bbf3-1a6f-40c1-8a13-482688a41e56" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.65:15021/healthz/ready\": dial tcp 10.133.0.65:15021: connect: connection refused"
Jul 09 19:00:45.640769 ip-10-0-141-101 kubenswrapper[2557]: I0709 19:00:45.640736    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-172f88-openshift-default-5c95794d55-crfth"
Jul 09 19:00:45.641253 ip-10-0-141-101 kubenswrapper[2557]: I0709 19:00:45.641145    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-172f88-openshift-default-5c95794d55-crfth"
Jul 09 19:00:45.641909 ip-10-0-141-101 kubenswrapper[2557]: I0709 19:00:45.641887    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-172f88-openshift-default-5c95794d55-crfth"
Jul 09 19:01:00.011946 ip-10-0-141-101 kubenswrapper[2557]: I0709 19:01:00.011899    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29727060-8624q"]
Jul 09 19:01:00.012364 ip-10-0-141-101 kubenswrapper[2557]: I0709 19:01:00.012108    2557 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29727060-8624q" podUID="b6a23a7e-4d11-427e-bdbd-e5fe6724f5e1" containerName="cleanup" containerID="cri-o://a72b47c534a6546e279505fb411b4bf58b4290b64f041fc88c96e8327fd871cd" gracePeriod=30
Jul 09 19:01:30.193018 ip-10-0-141-101 kubenswrapper[2557]: I0709 19:01:30.192993    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29727060-8624q"
Jul 09 19:01:30.270321 ip-10-0-141-101 kubenswrapper[2557]: I0709 19:01:30.270231    2557 generic.go:356] "Generic (PLEG): container finished" podID="b6a23a7e-4d11-427e-bdbd-e5fe6724f5e1" containerID="a72b47c534a6546e279505fb411b4bf58b4290b64f041fc88c96e8327fd871cd" exitCode=137
Jul 09 19:01:30.270321 ip-10-0-141-101 kubenswrapper[2557]: I0709 19:01:30.270278    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29727060-8624q"
Jul 09 19:01:30.270321 ip-10-0-141-101 kubenswrapper[2557]: I0709 19:01:30.270281    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29727060-8624q" event={"ID":"b6a23a7e-4d11-427e-bdbd-e5fe6724f5e1","Type":"ContainerDied","Data":"a72b47c534a6546e279505fb411b4bf58b4290b64f041fc88c96e8327fd871cd"}
Jul 09 19:01:30.270589 ip-10-0-141-101 kubenswrapper[2557]: I0709 19:01:30.270334    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29727060-8624q" event={"ID":"b6a23a7e-4d11-427e-bdbd-e5fe6724f5e1","Type":"ContainerDied","Data":"866db3c12dd9f6adedba912c2e5b3ce78f7628243ba4595dad5aed660df9fb43"}
Jul 09 19:01:30.270589 ip-10-0-141-101 kubenswrapper[2557]: I0709 19:01:30.270357    2557 scope.go:117] "RemoveContainer" containerID="a72b47c534a6546e279505fb411b4bf58b4290b64f041fc88c96e8327fd871cd"
Jul 09 19:01:30.279845 ip-10-0-141-101 kubenswrapper[2557]: I0709 19:01:30.279824    2557 scope.go:117] "RemoveContainer" containerID="a72b47c534a6546e279505fb411b4bf58b4290b64f041fc88c96e8327fd871cd"
Jul 09 19:01:30.280114 ip-10-0-141-101 kubenswrapper[2557]: E0709 19:01:30.280095    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a72b47c534a6546e279505fb411b4bf58b4290b64f041fc88c96e8327fd871cd\": container with ID starting with a72b47c534a6546e279505fb411b4bf58b4290b64f041fc88c96e8327fd871cd not found: ID does not exist" containerID="a72b47c534a6546e279505fb411b4bf58b4290b64f041fc88c96e8327fd871cd"
Jul 09 19:01:30.280175 ip-10-0-141-101 kubenswrapper[2557]: I0709 19:01:30.280129    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a72b47c534a6546e279505fb411b4bf58b4290b64f041fc88c96e8327fd871cd"} err="failed to get container status \"a72b47c534a6546e279505fb411b4bf58b4290b64f041fc88c96e8327fd871cd\": rpc error: code = NotFound desc = could not find container \"a72b47c534a6546e279505fb411b4bf58b4290b64f041fc88c96e8327fd871cd\": container with ID starting with a72b47c534a6546e279505fb411b4bf58b4290b64f041fc88c96e8327fd871cd not found: ID does not exist"
Jul 09 19:01:30.338314 ip-10-0-141-101 kubenswrapper[2557]: I0709 19:01:30.338276    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7tbnj\" (UniqueName: \"kubernetes.io/projected/b6a23a7e-4d11-427e-bdbd-e5fe6724f5e1-kube-api-access-7tbnj\") pod \"b6a23a7e-4d11-427e-bdbd-e5fe6724f5e1\" (UID: \"b6a23a7e-4d11-427e-bdbd-e5fe6724f5e1\") "
Jul 09 19:01:30.340381 ip-10-0-141-101 kubenswrapper[2557]: I0709 19:01:30.340352    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b6a23a7e-4d11-427e-bdbd-e5fe6724f5e1-kube-api-access-7tbnj" (OuterVolumeSpecName: "kube-api-access-7tbnj") pod "b6a23a7e-4d11-427e-bdbd-e5fe6724f5e1" (UID: "b6a23a7e-4d11-427e-bdbd-e5fe6724f5e1"). InnerVolumeSpecName "kube-api-access-7tbnj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 19:01:30.439218 ip-10-0-141-101 kubenswrapper[2557]: I0709 19:01:30.439174    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7tbnj\" (UniqueName: \"kubernetes.io/projected/b6a23a7e-4d11-427e-bdbd-e5fe6724f5e1-kube-api-access-7tbnj\") on node \"ip-10-0-141-101.ec2.internal\" DevicePath \"\""
Jul 09 19:01:30.593793 ip-10-0-141-101 kubenswrapper[2557]: I0709 19:01:30.593759    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29727060-8624q"]
Jul 09 19:01:30.598043 ip-10-0-141-101 kubenswrapper[2557]: I0709 19:01:30.598016    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29727060-8624q"]
Jul 09 19:01:31.262711 ip-10-0-141-101 kubenswrapper[2557]: I0709 19:01:31.262677    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b6a23a7e-4d11-427e-bdbd-e5fe6724f5e1" path="/var/lib/kubelet/pods/b6a23a7e-4d11-427e-bdbd-e5fe6724f5e1/volumes"
Jul 09 19:03:40.994540 ip-10-0-141-101 kubenswrapper[2557]: I0709 19:03:40.994501    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-4805f3/sub-test-model-4805f3-kserve-66fcf449cf-bxlzn"]
Jul 09 19:03:40.994990 ip-10-0-141-101 kubenswrapper[2557]: I0709 19:03:40.994975    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5123ca4f-e2e5-4107-81b3-0da2fb736f6d" containerName="cleanup"
Jul 09 19:03:40.995035 ip-10-0-141-101 kubenswrapper[2557]: I0709 19:03:40.994991    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="5123ca4f-e2e5-4107-81b3-0da2fb736f6d" containerName="cleanup"
Jul 09 19:03:40.995035 ip-10-0-141-101 kubenswrapper[2557]: I0709 19:03:40.995009    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b6a23a7e-4d11-427e-bdbd-e5fe6724f5e1" containerName="cleanup"
Jul 09 19:03:40.995035 ip-10-0-141-101 kubenswrapper[2557]: I0709 19:03:40.995015    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="b6a23a7e-4d11-427e-bdbd-e5fe6724f5e1" containerName="cleanup"
Jul 09 19:03:40.995141 ip-10-0-141-101 kubenswrapper[2557]: I0709 19:03:40.995091    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="b6a23a7e-4d11-427e-bdbd-e5fe6724f5e1" containerName="cleanup"
Jul 09 19:03:40.995141 ip-10-0-141-101 kubenswrapper[2557]: I0709 19:03:40.995104    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="5123ca4f-e2e5-4107-81b3-0da2fb736f6d" containerName="cleanup"
Jul 09 19:03:40.995141 ip-10-0-141-101 kubenswrapper[2557]: I0709 19:03:40.995115    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="fe65e9f8-5a98-48f1-954d-467459dccc3d" containerName="istio-proxy"
Jul 09 19:03:40.998129 ip-10-0-141-101 kubenswrapper[2557]: I0709 19:03:40.998112    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-4805f3/sub-test-model-4805f3-kserve-66fcf449cf-bxlzn"
Jul 09 19:03:41.000848 ip-10-0-141-101 kubenswrapper[2557]: I0709 19:03:41.000825    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-4805f3\"/\"openshift-service-ca.crt\""
Jul 09 19:03:41.001670 ip-10-0-141-101 kubenswrapper[2557]: I0709 19:03:41.001639    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-4805f3\"/\"default-dockercfg-97whk\""
Jul 09 19:03:41.001809 ip-10-0-141-101 kubenswrapper[2557]: I0709 19:03:41.001685    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-4805f3\"/\"kube-root-ca.crt\""
Jul 09 19:03:41.001809 ip-10-0-141-101 kubenswrapper[2557]: I0709 19:03:41.001784    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-4805f3\"/\"sub-test-model-4805f3-kserve-self-signed-certs\""
Jul 09 19:03:41.008407 ip-10-0-141-101 kubenswrapper[2557]: I0709 19:03:41.008383    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-4805f3/sub-test-model-4805f3-kserve-66fcf449cf-bxlzn"]
Jul 09 19:03:41.015026 ip-10-0-141-101 kubenswrapper[2557]: I0709 19:03:41.014995    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1681039c-c1c2-4561-b96c-04f369bc68b1-model-cache\") pod \"sub-test-model-4805f3-kserve-66fcf449cf-bxlzn\" (UID: \"1681039c-c1c2-4561-b96c-04f369bc68b1\") " pod="ai-tenant-e2e-shared-a-4805f3/sub-test-model-4805f3-kserve-66fcf449cf-bxlzn"
Jul 09 19:03:41.015242 ip-10-0-141-101 kubenswrapper[2557]: I0709 19:03:41.015096    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1681039c-c1c2-4561-b96c-04f369bc68b1-dshm\") pod \"sub-test-model-4805f3-kserve-66fcf449cf-bxlzn\" (UID: \"1681039c-c1c2-4561-b96c-04f369bc68b1\") " pod="ai-tenant-e2e-shared-a-4805f3/sub-test-model-4805f3-kserve-66fcf449cf-bxlzn"
Jul 09 19:03:41.015242 ip-10-0-141-101 kubenswrapper[2557]: I0709 19:03:41.015141    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1681039c-c1c2-4561-b96c-04f369bc68b1-tmp-dir\") pod \"sub-test-model-4805f3-kserve-66fcf449cf-bxlzn\" (UID: \"1681039c-c1c2-4561-b96c-04f369bc68b1\") " pod="ai-tenant-e2e-shared-a-4805f3/sub-test-model-4805f3-kserve-66fcf449cf-bxlzn"
Jul 09 19:03:41.015366 ip-10-0-141-101 kubenswrapper[2557]: I0709 19:03:41.015263    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1681039c-c1c2-4561-b96c-04f369bc68b1-tls-certs\") pod \"sub-test-model-4805f3-kserve-66fcf449cf-bxlzn\" (UID: \"1681039c-c1c2-4561-b96c-04f369bc68b1\") " pod="ai-tenant-e2e-shared-a-4805f3/sub-test-model-4805f3-kserve-66fcf449cf-bxlzn"
Jul 09 19:03:41.015366 ip-10-0-141-101 kubenswrapper[2557]: I0709 19:03:41.015300    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1681039c-c1c2-4561-b96c-04f369bc68b1-home\") pod \"sub-test-model-4805f3-kserve-66fcf449cf-bxlzn\" (UID: \"1681039c-c1c2-4561-b96c-04f369bc68b1\") " pod="ai-tenant-e2e-shared-a-4805f3/sub-test-model-4805f3-kserve-66fcf449cf-bxlzn"
Jul 09 19:03:41.015366 ip-10-0-141-101 kubenswrapper[2557]: I0709 19:03:41.015337    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rq5kr\" (UniqueName: \"kubernetes.io/projected/1681039c-c1c2-4561-b96c-04f369bc68b1-kube-api-access-rq5kr\") pod \"sub-test-model-4805f3-kserve-66fcf449cf-bxlzn\" (UID: \"1681039c-c1c2-4561-b96c-04f369bc68b1\") " pod="ai-tenant-e2e-shared-a-4805f3/sub-test-model-4805f3-kserve-66fcf449cf-bxlzn"
Jul 09 19:03:41.116459 ip-10-0-141-101 kubenswrapper[2557]: I0709 19:03:41.116418    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1681039c-c1c2-4561-b96c-04f369bc68b1-tls-certs\") pod \"sub-test-model-4805f3-kserve-66fcf449cf-bxlzn\" (UID: \"1681039c-c1c2-4561-b96c-04f369bc68b1\") " pod="ai-tenant-e2e-shared-a-4805f3/sub-test-model-4805f3-kserve-66fcf449cf-bxlzn"
Jul 09 19:03:41.116459 ip-10-0-141-101 kubenswrapper[2557]: I0709 19:03:41.116461    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1681039c-c1c2-4561-b96c-04f369bc68b1-home\") pod \"sub-test-model-4805f3-kserve-66fcf449cf-bxlzn\" (UID: \"1681039c-c1c2-4561-b96c-04f369bc68b1\") " pod="ai-tenant-e2e-shared-a-4805f3/sub-test-model-4805f3-kserve-66fcf449cf-bxlzn"
Jul 09 19:03:41.116691 ip-10-0-141-101 kubenswrapper[2557]: I0709 19:03:41.116518    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rq5kr\" (UniqueName: \"kubernetes.io/projected/1681039c-c1c2-4561-b96c-04f369bc68b1-kube-api-access-rq5kr\") pod \"sub-test-model-4805f3-kserve-66fcf449cf-bxlzn\" (UID: \"1681039c-c1c2-4561-b96c-04f369bc68b1\") " pod="ai-tenant-e2e-shared-a-4805f3/sub-test-model-4805f3-kserve-66fcf449cf-bxlzn"
Jul 09 19:03:41.116691 ip-10-0-141-101 kubenswrapper[2557]: I0709 19:03:41.116641    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1681039c-c1c2-4561-b96c-04f369bc68b1-model-cache\") pod \"sub-test-model-4805f3-kserve-66fcf449cf-bxlzn\" (UID: \"1681039c-c1c2-4561-b96c-04f369bc68b1\") " pod="ai-tenant-e2e-shared-a-4805f3/sub-test-model-4805f3-kserve-66fcf449cf-bxlzn"
Jul 09 19:03:41.116766 ip-10-0-141-101 kubenswrapper[2557]: I0709 19:03:41.116735    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1681039c-c1c2-4561-b96c-04f369bc68b1-dshm\") pod \"sub-test-model-4805f3-kserve-66fcf449cf-bxlzn\" (UID: \"1681039c-c1c2-4561-b96c-04f369bc68b1\") " pod="ai-tenant-e2e-shared-a-4805f3/sub-test-model-4805f3-kserve-66fcf449cf-bxlzn"
Jul 09 19:03:41.116802 ip-10-0-141-101 kubenswrapper[2557]: I0709 19:03:41.116776    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1681039c-c1c2-4561-b96c-04f369bc68b1-tmp-dir\") pod \"sub-test-model-4805f3-kserve-66fcf449cf-bxlzn\" (UID: \"1681039c-c1c2-4561-b96c-04f369bc68b1\") " pod="ai-tenant-e2e-shared-a-4805f3/sub-test-model-4805f3-kserve-66fcf449cf-bxlzn"
Jul 09 19:03:41.116959 ip-10-0-141-101 kubenswrapper[2557]: I0709 19:03:41.116936    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1681039c-c1c2-4561-b96c-04f369bc68b1-home\") pod \"sub-test-model-4805f3-kserve-66fcf449cf-bxlzn\" (UID: \"1681039c-c1c2-4561-b96c-04f369bc68b1\") " pod="ai-tenant-e2e-shared-a-4805f3/sub-test-model-4805f3-kserve-66fcf449cf-bxlzn"
Jul 09 19:03:41.117010 ip-10-0-141-101 kubenswrapper[2557]: I0709 19:03:41.116994    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1681039c-c1c2-4561-b96c-04f369bc68b1-model-cache\") pod \"sub-test-model-4805f3-kserve-66fcf449cf-bxlzn\" (UID: \"1681039c-c1c2-4561-b96c-04f369bc68b1\") " pod="ai-tenant-e2e-shared-a-4805f3/sub-test-model-4805f3-kserve-66fcf449cf-bxlzn"
Jul 09 19:03:41.117189 ip-10-0-141-101 kubenswrapper[2557]: I0709 19:03:41.117162    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1681039c-c1c2-4561-b96c-04f369bc68b1-tmp-dir\") pod \"sub-test-model-4805f3-kserve-66fcf449cf-bxlzn\" (UID: \"1681039c-c1c2-4561-b96c-04f369bc68b1\") " pod="ai-tenant-e2e-shared-a-4805f3/sub-test-model-4805f3-kserve-66fcf449cf-bxlzn"
Jul 09 19:03:41.118998 ip-10-0-141-101 kubenswrapper[2557]: I0709 19:03:41.118976    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1681039c-c1c2-4561-b96c-04f369bc68b1-dshm\") pod \"sub-test-model-4805f3-kserve-66fcf449cf-bxlzn\" (UID: \"1681039c-c1c2-4561-b96c-04f369bc68b1\") " pod="ai-tenant-e2e-shared-a-4805f3/sub-test-model-4805f3-kserve-66fcf449cf-bxlzn"
Jul 09 19:03:41.119115 ip-10-0-141-101 kubenswrapper[2557]: I0709 19:03:41.119097    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1681039c-c1c2-4561-b96c-04f369bc68b1-tls-certs\") pod \"sub-test-model-4805f3-kserve-66fcf449cf-bxlzn\" (UID: \"1681039c-c1c2-4561-b96c-04f369bc68b1\") " pod="ai-tenant-e2e-shared-a-4805f3/sub-test-model-4805f3-kserve-66fcf449cf-bxlzn"
Jul 09 19:03:41.129225 ip-10-0-141-101 kubenswrapper[2557]: I0709 19:03:41.129201    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rq5kr\" (UniqueName: \"kubernetes.io/projected/1681039c-c1c2-4561-b96c-04f369bc68b1-kube-api-access-rq5kr\") pod \"sub-test-model-4805f3-kserve-66fcf449cf-bxlzn\" (UID: \"1681039c-c1c2-4561-b96c-04f369bc68b1\") " pod="ai-tenant-e2e-shared-a-4805f3/sub-test-model-4805f3-kserve-66fcf449cf-bxlzn"
Jul 09 19:03:41.308191 ip-10-0-141-101 kubenswrapper[2557]: I0709 19:03:41.308138    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-4805f3/sub-test-model-4805f3-kserve-66fcf449cf-bxlzn"
Jul 09 19:03:41.466204 ip-10-0-141-101 kubenswrapper[2557]: I0709 19:03:41.466176    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-4805f3/sub-test-model-4805f3-kserve-66fcf449cf-bxlzn"]
Jul 09 19:03:41.468225 ip-10-0-141-101 kubenswrapper[2557]: W0709 19:03:41.468193    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod1681039c_c1c2_4561_b96c_04f369bc68b1.slice/crio-2798a97565e80e3618d49684b8dae746a434ba0db52d24ef5db84a2a5b09b5c1 WatchSource:0}: Error finding container 2798a97565e80e3618d49684b8dae746a434ba0db52d24ef5db84a2a5b09b5c1: Status 404 returned error can't find the container with id 2798a97565e80e3618d49684b8dae746a434ba0db52d24ef5db84a2a5b09b5c1
Jul 09 19:03:42.024613 ip-10-0-141-101 kubenswrapper[2557]: I0709 19:03:42.024578    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-4805f3/sub-test-model-4805f3-kserve-66fcf449cf-bxlzn" event={"ID":"1681039c-c1c2-4561-b96c-04f369bc68b1","Type":"ContainerStarted","Data":"5e305380f6daeb2dc0cd41d9434166e479d1cba0c297dd4511ced94fdba12747"}
Jul 09 19:03:42.024613 ip-10-0-141-101 kubenswrapper[2557]: I0709 19:03:42.024619    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-4805f3/sub-test-model-4805f3-kserve-66fcf449cf-bxlzn" event={"ID":"1681039c-c1c2-4561-b96c-04f369bc68b1","Type":"ContainerStarted","Data":"2798a97565e80e3618d49684b8dae746a434ba0db52d24ef5db84a2a5b09b5c1"}
Jul 09 19:03:42.047027 ip-10-0-141-101 kubenswrapper[2557]: I0709 19:03:42.046972    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-4805f3/sub-test-model-4805f3-kserve-66fcf449cf-bxlzn" podStartSLOduration=2.046954284 podStartE2EDuration="2.046954284s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 19:03:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 19:03:42.044834591 +0000 UTC m=+2291.284179230" watchObservedRunningTime="2026-07-09 19:03:42.046954284 +0000 UTC m=+2291.286298910"
Jul 09 19:03:51.308784 ip-10-0-141-101 kubenswrapper[2557]: I0709 19:03:51.308741    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-4805f3/sub-test-model-4805f3-kserve-66fcf449cf-bxlzn"
Jul 09 19:03:51.309317 ip-10-0-141-101 kubenswrapper[2557]: I0709 19:03:51.308897    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-4805f3/sub-test-model-4805f3-kserve-66fcf449cf-bxlzn"
Jul 09 19:03:51.321453 ip-10-0-141-101 kubenswrapper[2557]: I0709 19:03:51.321421    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-4805f3/sub-test-model-4805f3-kserve-66fcf449cf-bxlzn"
Jul 09 19:03:52.095285 ip-10-0-141-101 kubenswrapper[2557]: I0709 19:03:52.095255    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-4805f3/sub-test-model-4805f3-kserve-66fcf449cf-bxlzn"
Jul 09 19:04:43.541678 ip-10-0-141-101 kubenswrapper[2557]: I0709 19:04:43.541637    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-4805f3/sub-test-model-4805f3-kserve-66fcf449cf-bxlzn"]
Jul 09 19:04:58.562096 ip-10-0-141-101 kubenswrapper[2557]: I0709 19:04:58.562027    2557 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-4805f3/sub-test-model-4805f3-kserve-66fcf449cf-bxlzn" podUID="1681039c-c1c2-4561-b96c-04f369bc68b1" containerName="main" containerID="cri-o://5e305380f6daeb2dc0cd41d9434166e479d1cba0c297dd4511ced94fdba12747" gracePeriod=45
Jul 09 19:04:58.823657 ip-10-0-141-101 kubenswrapper[2557]: I0709 19:04:58.823586    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-4805f3/sub-test-model-4805f3-kserve-66fcf449cf-bxlzn"
Jul 09 19:04:58.868654 ip-10-0-141-101 kubenswrapper[2557]: I0709 19:04:58.868616    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1681039c-c1c2-4561-b96c-04f369bc68b1-model-cache\") pod \"1681039c-c1c2-4561-b96c-04f369bc68b1\" (UID: \"1681039c-c1c2-4561-b96c-04f369bc68b1\") "
Jul 09 19:04:58.868654 ip-10-0-141-101 kubenswrapper[2557]: I0709 19:04:58.868656    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rq5kr\" (UniqueName: \"kubernetes.io/projected/1681039c-c1c2-4561-b96c-04f369bc68b1-kube-api-access-rq5kr\") pod \"1681039c-c1c2-4561-b96c-04f369bc68b1\" (UID: \"1681039c-c1c2-4561-b96c-04f369bc68b1\") "
Jul 09 19:04:58.868911 ip-10-0-141-101 kubenswrapper[2557]: I0709 19:04:58.868732    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1681039c-c1c2-4561-b96c-04f369bc68b1-home\") pod \"1681039c-c1c2-4561-b96c-04f369bc68b1\" (UID: \"1681039c-c1c2-4561-b96c-04f369bc68b1\") "
Jul 09 19:04:58.868911 ip-10-0-141-101 kubenswrapper[2557]: I0709 19:04:58.868764    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1681039c-c1c2-4561-b96c-04f369bc68b1-tmp-dir\") pod \"1681039c-c1c2-4561-b96c-04f369bc68b1\" (UID: \"1681039c-c1c2-4561-b96c-04f369bc68b1\") "
Jul 09 19:04:58.868911 ip-10-0-141-101 kubenswrapper[2557]: I0709 19:04:58.868842    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1681039c-c1c2-4561-b96c-04f369bc68b1-tls-certs\") pod \"1681039c-c1c2-4561-b96c-04f369bc68b1\" (UID: \"1681039c-c1c2-4561-b96c-04f369bc68b1\") "
Jul 09 19:04:58.868911 ip-10-0-141-101 kubenswrapper[2557]: I0709 19:04:58.868896    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1681039c-c1c2-4561-b96c-04f369bc68b1-dshm\") pod \"1681039c-c1c2-4561-b96c-04f369bc68b1\" (UID: \"1681039c-c1c2-4561-b96c-04f369bc68b1\") "
Jul 09 19:04:58.869155 ip-10-0-141-101 kubenswrapper[2557]: I0709 19:04:58.869006    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1681039c-c1c2-4561-b96c-04f369bc68b1-home" (OuterVolumeSpecName: "home") pod "1681039c-c1c2-4561-b96c-04f369bc68b1" (UID: "1681039c-c1c2-4561-b96c-04f369bc68b1"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 19:04:58.869155 ip-10-0-141-101 kubenswrapper[2557]: I0709 19:04:58.869118    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1681039c-c1c2-4561-b96c-04f369bc68b1-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "1681039c-c1c2-4561-b96c-04f369bc68b1" (UID: "1681039c-c1c2-4561-b96c-04f369bc68b1"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 19:04:58.869273 ip-10-0-141-101 kubenswrapper[2557]: I0709 19:04:58.869206    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1681039c-c1c2-4561-b96c-04f369bc68b1-model-cache" (OuterVolumeSpecName: "model-cache") pod "1681039c-c1c2-4561-b96c-04f369bc68b1" (UID: "1681039c-c1c2-4561-b96c-04f369bc68b1"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 19:04:58.869329 ip-10-0-141-101 kubenswrapper[2557]: I0709 19:04:58.869284    2557 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1681039c-c1c2-4561-b96c-04f369bc68b1-model-cache\") on node \"ip-10-0-141-101.ec2.internal\" DevicePath \"\""
Jul 09 19:04:58.869329 ip-10-0-141-101 kubenswrapper[2557]: I0709 19:04:58.869304    2557 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1681039c-c1c2-4561-b96c-04f369bc68b1-home\") on node \"ip-10-0-141-101.ec2.internal\" DevicePath \"\""
Jul 09 19:04:58.869329 ip-10-0-141-101 kubenswrapper[2557]: I0709 19:04:58.869319    2557 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1681039c-c1c2-4561-b96c-04f369bc68b1-tmp-dir\") on node \"ip-10-0-141-101.ec2.internal\" DevicePath \"\""
Jul 09 19:04:58.871048 ip-10-0-141-101 kubenswrapper[2557]: I0709 19:04:58.871001    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1681039c-c1c2-4561-b96c-04f369bc68b1-dshm" (OuterVolumeSpecName: "dshm") pod "1681039c-c1c2-4561-b96c-04f369bc68b1" (UID: "1681039c-c1c2-4561-b96c-04f369bc68b1"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 19:04:58.871048 ip-10-0-141-101 kubenswrapper[2557]: I0709 19:04:58.871033    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1681039c-c1c2-4561-b96c-04f369bc68b1-kube-api-access-rq5kr" (OuterVolumeSpecName: "kube-api-access-rq5kr") pod "1681039c-c1c2-4561-b96c-04f369bc68b1" (UID: "1681039c-c1c2-4561-b96c-04f369bc68b1"). InnerVolumeSpecName "kube-api-access-rq5kr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 19:04:58.871223 ip-10-0-141-101 kubenswrapper[2557]: I0709 19:04:58.871120    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1681039c-c1c2-4561-b96c-04f369bc68b1-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "1681039c-c1c2-4561-b96c-04f369bc68b1" (UID: "1681039c-c1c2-4561-b96c-04f369bc68b1"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 19:04:58.970540 ip-10-0-141-101 kubenswrapper[2557]: I0709 19:04:58.970470    2557 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1681039c-c1c2-4561-b96c-04f369bc68b1-tls-certs\") on node \"ip-10-0-141-101.ec2.internal\" DevicePath \"\""
Jul 09 19:04:58.970540 ip-10-0-141-101 kubenswrapper[2557]: I0709 19:04:58.970533    2557 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1681039c-c1c2-4561-b96c-04f369bc68b1-dshm\") on node \"ip-10-0-141-101.ec2.internal\" DevicePath \"\""
Jul 09 19:04:58.970540 ip-10-0-141-101 kubenswrapper[2557]: I0709 19:04:58.970543    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rq5kr\" (UniqueName: \"kubernetes.io/projected/1681039c-c1c2-4561-b96c-04f369bc68b1-kube-api-access-rq5kr\") on node \"ip-10-0-141-101.ec2.internal\" DevicePath \"\""
Jul 09 19:04:59.477697 ip-10-0-141-101 kubenswrapper[2557]: I0709 19:04:59.477658    2557 generic.go:356] "Generic (PLEG): container finished" podID="1681039c-c1c2-4561-b96c-04f369bc68b1" containerID="5e305380f6daeb2dc0cd41d9434166e479d1cba0c297dd4511ced94fdba12747" exitCode=0
Jul 09 19:04:59.477863 ip-10-0-141-101 kubenswrapper[2557]: I0709 19:04:59.477709    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-4805f3/sub-test-model-4805f3-kserve-66fcf449cf-bxlzn"
Jul 09 19:04:59.477863 ip-10-0-141-101 kubenswrapper[2557]: I0709 19:04:59.477745    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-4805f3/sub-test-model-4805f3-kserve-66fcf449cf-bxlzn" event={"ID":"1681039c-c1c2-4561-b96c-04f369bc68b1","Type":"ContainerDied","Data":"5e305380f6daeb2dc0cd41d9434166e479d1cba0c297dd4511ced94fdba12747"}
Jul 09 19:04:59.477863 ip-10-0-141-101 kubenswrapper[2557]: I0709 19:04:59.477791    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-4805f3/sub-test-model-4805f3-kserve-66fcf449cf-bxlzn" event={"ID":"1681039c-c1c2-4561-b96c-04f369bc68b1","Type":"ContainerDied","Data":"2798a97565e80e3618d49684b8dae746a434ba0db52d24ef5db84a2a5b09b5c1"}
Jul 09 19:04:59.477863 ip-10-0-141-101 kubenswrapper[2557]: I0709 19:04:59.477810    2557 scope.go:117] "RemoveContainer" containerID="5e305380f6daeb2dc0cd41d9434166e479d1cba0c297dd4511ced94fdba12747"
Jul 09 19:04:59.487057 ip-10-0-141-101 kubenswrapper[2557]: I0709 19:04:59.487039    2557 scope.go:117] "RemoveContainer" containerID="5e305380f6daeb2dc0cd41d9434166e479d1cba0c297dd4511ced94fdba12747"
Jul 09 19:04:59.487329 ip-10-0-141-101 kubenswrapper[2557]: E0709 19:04:59.487311    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5e305380f6daeb2dc0cd41d9434166e479d1cba0c297dd4511ced94fdba12747\": container with ID starting with 5e305380f6daeb2dc0cd41d9434166e479d1cba0c297dd4511ced94fdba12747 not found: ID does not exist" containerID="5e305380f6daeb2dc0cd41d9434166e479d1cba0c297dd4511ced94fdba12747"
Jul 09 19:04:59.487387 ip-10-0-141-101 kubenswrapper[2557]: I0709 19:04:59.487339    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5e305380f6daeb2dc0cd41d9434166e479d1cba0c297dd4511ced94fdba12747"} err="failed to get container status \"5e305380f6daeb2dc0cd41d9434166e479d1cba0c297dd4511ced94fdba12747\": rpc error: code = NotFound desc = could not find container \"5e305380f6daeb2dc0cd41d9434166e479d1cba0c297dd4511ced94fdba12747\": container with ID starting with 5e305380f6daeb2dc0cd41d9434166e479d1cba0c297dd4511ced94fdba12747 not found: ID does not exist"
Jul 09 19:04:59.508455 ip-10-0-141-101 kubenswrapper[2557]: I0709 19:04:59.508416    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-4805f3/sub-test-model-4805f3-kserve-66fcf449cf-bxlzn"]
Jul 09 19:04:59.515116 ip-10-0-141-101 kubenswrapper[2557]: I0709 19:04:59.515090    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-4805f3/sub-test-model-4805f3-kserve-66fcf449cf-bxlzn"]
Jul 09 19:05:01.261896 ip-10-0-141-101 kubenswrapper[2557]: I0709 19:05:01.261861    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1681039c-c1c2-4561-b96c-04f369bc68b1" path="/var/lib/kubelet/pods/1681039c-c1c2-4561-b96c-04f369bc68b1/volumes"
Jul 09 19:06:43.468377 ip-10-0-141-101 kubenswrapper[2557]: I0709 19:06:43.468340    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/test-curl-7662-139921168956336"]
Jul 09 19:06:43.468859 ip-10-0-141-101 kubenswrapper[2557]: I0709 19:06:43.468843    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1681039c-c1c2-4561-b96c-04f369bc68b1" containerName="main"
Jul 09 19:06:43.468925 ip-10-0-141-101 kubenswrapper[2557]: I0709 19:06:43.468864    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="1681039c-c1c2-4561-b96c-04f369bc68b1" containerName="main"
Jul 09 19:06:43.468994 ip-10-0-141-101 kubenswrapper[2557]: I0709 19:06:43.468974    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="1681039c-c1c2-4561-b96c-04f369bc68b1" containerName="main"
Jul 09 19:06:43.472100 ip-10-0-141-101 kubenswrapper[2557]: I0709 19:06:43.472085    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7662-139921168956336"
Jul 09 19:06:43.474974 ip-10-0-141-101 kubenswrapper[2557]: I0709 19:06:43.474955    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-dockercfg-p22g6\""
Jul 09 19:06:43.486898 ip-10-0-141-101 kubenswrapper[2557]: I0709 19:06:43.486874    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/test-curl-7662-139921168956336"]
Jul 09 19:06:43.582041 ip-10-0-141-101 kubenswrapper[2557]: I0709 19:06:43.581999    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wjmqf\" (UniqueName: \"kubernetes.io/projected/74b78ccf-0e0f-4090-9b09-1efe77737d9e-kube-api-access-wjmqf\") pod \"test-curl-7662-139921168956336\" (UID: \"74b78ccf-0e0f-4090-9b09-1efe77737d9e\") " pod="openshift-ingress/test-curl-7662-139921168956336"
Jul 09 19:06:43.683603 ip-10-0-141-101 kubenswrapper[2557]: I0709 19:06:43.683555    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wjmqf\" (UniqueName: \"kubernetes.io/projected/74b78ccf-0e0f-4090-9b09-1efe77737d9e-kube-api-access-wjmqf\") pod \"test-curl-7662-139921168956336\" (UID: \"74b78ccf-0e0f-4090-9b09-1efe77737d9e\") " pod="openshift-ingress/test-curl-7662-139921168956336"
Jul 09 19:06:43.694020 ip-10-0-141-101 kubenswrapper[2557]: I0709 19:06:43.693984    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wjmqf\" (UniqueName: \"kubernetes.io/projected/74b78ccf-0e0f-4090-9b09-1efe77737d9e-kube-api-access-wjmqf\") pod \"test-curl-7662-139921168956336\" (UID: \"74b78ccf-0e0f-4090-9b09-1efe77737d9e\") " pod="openshift-ingress/test-curl-7662-139921168956336"
Jul 09 19:06:43.781679 ip-10-0-141-101 kubenswrapper[2557]: I0709 19:06:43.781593    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7662-139921168956336"
Jul 09 19:06:43.923522 ip-10-0-141-101 kubenswrapper[2557]: I0709 19:06:43.923495    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/test-curl-7662-139921168956336"]
Jul 09 19:06:43.925545 ip-10-0-141-101 kubenswrapper[2557]: W0709 19:06:43.925510    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod74b78ccf_0e0f_4090_9b09_1efe77737d9e.slice/crio-2123a87e650b6fa5fc20e1ece1162033c65cb6639212b175f3acb42fa2763468 WatchSource:0}: Error finding container 2123a87e650b6fa5fc20e1ece1162033c65cb6639212b175f3acb42fa2763468: Status 404 returned error can't find the container with id 2123a87e650b6fa5fc20e1ece1162033c65cb6639212b175f3acb42fa2763468
Jul 09 19:06:43.926775 ip-10-0-141-101 kubenswrapper[2557]: I0709 19:06:43.926758    2557 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 09 19:06:44.082237 ip-10-0-141-101 kubenswrapper[2557]: I0709 19:06:44.082198    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/test-curl-7662-139921168956336" event={"ID":"74b78ccf-0e0f-4090-9b09-1efe77737d9e","Type":"ContainerStarted","Data":"2123a87e650b6fa5fc20e1ece1162033c65cb6639212b175f3acb42fa2763468"}
Jul 09 19:06:45.089396 ip-10-0-141-101 kubenswrapper[2557]: I0709 19:06:45.089360    2557 generic.go:356] "Generic (PLEG): container finished" podID="74b78ccf-0e0f-4090-9b09-1efe77737d9e" containerID="5c8e437408c52a6f2a64c4603c95f8d0f9c77696d8f58611aaec71bec537b31a" exitCode=0
Jul 09 19:06:45.089782 ip-10-0-141-101 kubenswrapper[2557]: I0709 19:06:45.089441    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/test-curl-7662-139921168956336" event={"ID":"74b78ccf-0e0f-4090-9b09-1efe77737d9e","Type":"ContainerDied","Data":"5c8e437408c52a6f2a64c4603c95f8d0f9c77696d8f58611aaec71bec537b31a"}
Jul 09 19:06:46.243522 ip-10-0-141-101 kubenswrapper[2557]: I0709 19:06:46.243498    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7662-139921168956336"
Jul 09 19:06:46.280925 ip-10-0-141-101 kubenswrapper[2557]: I0709 19:06:46.280896    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_test-curl-7662-139921168956336_74b78ccf-0e0f-4090-9b09-1efe77737d9e/test-curl-7662-139921168956336/0.log"
Jul 09 19:06:46.304254 ip-10-0-141-101 kubenswrapper[2557]: I0709 19:06:46.304222    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/test-curl-7662-139921168956336"]
Jul 09 19:06:46.308054 ip-10-0-141-101 kubenswrapper[2557]: I0709 19:06:46.308027    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/test-curl-7662-139921168956336"]
Jul 09 19:06:46.414373 ip-10-0-141-101 kubenswrapper[2557]: I0709 19:06:46.414278    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wjmqf\" (UniqueName: \"kubernetes.io/projected/74b78ccf-0e0f-4090-9b09-1efe77737d9e-kube-api-access-wjmqf\") pod \"74b78ccf-0e0f-4090-9b09-1efe77737d9e\" (UID: \"74b78ccf-0e0f-4090-9b09-1efe77737d9e\") "
Jul 09 19:06:46.416762 ip-10-0-141-101 kubenswrapper[2557]: I0709 19:06:46.416734    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/74b78ccf-0e0f-4090-9b09-1efe77737d9e-kube-api-access-wjmqf" (OuterVolumeSpecName: "kube-api-access-wjmqf") pod "74b78ccf-0e0f-4090-9b09-1efe77737d9e" (UID: "74b78ccf-0e0f-4090-9b09-1efe77737d9e"). InnerVolumeSpecName "kube-api-access-wjmqf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 19:06:46.424654 ip-10-0-141-101 kubenswrapper[2557]: I0709 19:06:46.424631    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/test-curl-7662-139921168954672"]
Jul 09 19:06:46.425073 ip-10-0-141-101 kubenswrapper[2557]: I0709 19:06:46.425058    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="74b78ccf-0e0f-4090-9b09-1efe77737d9e" containerName="test-curl-7662-139921168956336"
Jul 09 19:06:46.425073 ip-10-0-141-101 kubenswrapper[2557]: I0709 19:06:46.425073    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="74b78ccf-0e0f-4090-9b09-1efe77737d9e" containerName="test-curl-7662-139921168956336"
Jul 09 19:06:46.425197 ip-10-0-141-101 kubenswrapper[2557]: I0709 19:06:46.425158    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="74b78ccf-0e0f-4090-9b09-1efe77737d9e" containerName="test-curl-7662-139921168956336"
Jul 09 19:06:46.428301 ip-10-0-141-101 kubenswrapper[2557]: I0709 19:06:46.428282    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7662-139921168954672"
Jul 09 19:06:46.435275 ip-10-0-141-101 kubenswrapper[2557]: I0709 19:06:46.435254    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/test-curl-7662-139921168954672"]
Jul 09 19:06:46.515440 ip-10-0-141-101 kubenswrapper[2557]: I0709 19:06:46.515407    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-shz4j\" (UniqueName: \"kubernetes.io/projected/7526454c-dcc4-4651-94f3-4a5ccc1510fc-kube-api-access-shz4j\") pod \"test-curl-7662-139921168954672\" (UID: \"7526454c-dcc4-4651-94f3-4a5ccc1510fc\") " pod="openshift-ingress/test-curl-7662-139921168954672"
Jul 09 19:06:46.515654 ip-10-0-141-101 kubenswrapper[2557]: I0709 19:06:46.515535    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wjmqf\" (UniqueName: \"kubernetes.io/projected/74b78ccf-0e0f-4090-9b09-1efe77737d9e-kube-api-access-wjmqf\") on node \"ip-10-0-141-101.ec2.internal\" DevicePath \"\""
Jul 09 19:06:46.617069 ip-10-0-141-101 kubenswrapper[2557]: I0709 19:06:46.617030    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-shz4j\" (UniqueName: \"kubernetes.io/projected/7526454c-dcc4-4651-94f3-4a5ccc1510fc-kube-api-access-shz4j\") pod \"test-curl-7662-139921168954672\" (UID: \"7526454c-dcc4-4651-94f3-4a5ccc1510fc\") " pod="openshift-ingress/test-curl-7662-139921168954672"
Jul 09 19:06:46.625705 ip-10-0-141-101 kubenswrapper[2557]: I0709 19:06:46.625677    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-shz4j\" (UniqueName: \"kubernetes.io/projected/7526454c-dcc4-4651-94f3-4a5ccc1510fc-kube-api-access-shz4j\") pod \"test-curl-7662-139921168954672\" (UID: \"7526454c-dcc4-4651-94f3-4a5ccc1510fc\") " pod="openshift-ingress/test-curl-7662-139921168954672"
Jul 09 19:06:46.739462 ip-10-0-141-101 kubenswrapper[2557]: I0709 19:06:46.739369    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7662-139921168954672"
Jul 09 19:06:46.883641 ip-10-0-141-101 kubenswrapper[2557]: I0709 19:06:46.883612    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/test-curl-7662-139921168954672"]
Jul 09 19:06:46.885372 ip-10-0-141-101 kubenswrapper[2557]: W0709 19:06:46.885346    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod7526454c_dcc4_4651_94f3_4a5ccc1510fc.slice/crio-3393519030f9353a0eaaf079fdcaa7add7e704bdbd4bcf54ce001fe2c80fb99b WatchSource:0}: Error finding container 3393519030f9353a0eaaf079fdcaa7add7e704bdbd4bcf54ce001fe2c80fb99b: Status 404 returned error can't find the container with id 3393519030f9353a0eaaf079fdcaa7add7e704bdbd4bcf54ce001fe2c80fb99b
Jul 09 19:06:47.103072 ip-10-0-141-101 kubenswrapper[2557]: I0709 19:06:47.103035    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/test-curl-7662-139921168954672" event={"ID":"7526454c-dcc4-4651-94f3-4a5ccc1510fc","Type":"ContainerStarted","Data":"3393519030f9353a0eaaf079fdcaa7add7e704bdbd4bcf54ce001fe2c80fb99b"}
Jul 09 19:06:47.104508 ip-10-0-141-101 kubenswrapper[2557]: I0709 19:06:47.104469    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7662-139921168956336"
Jul 09 19:06:47.104655 ip-10-0-141-101 kubenswrapper[2557]: I0709 19:06:47.104510    2557 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="2123a87e650b6fa5fc20e1ece1162033c65cb6639212b175f3acb42fa2763468"
Jul 09 19:06:47.117764 ip-10-0-141-101 kubenswrapper[2557]: E0709 19:06:47.117732    2557 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7662-139921168956336\" is forbidden: User \"system:node:ip-10-0-141-101.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-ingress\": no relationship found between node 'ip-10-0-141-101.ec2.internal' and this object" podUID="74b78ccf-0e0f-4090-9b09-1efe77737d9e" pod="openshift-ingress/test-curl-7662-139921168956336"
Jul 09 19:06:47.262657 ip-10-0-141-101 kubenswrapper[2557]: I0709 19:06:47.262630    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="74b78ccf-0e0f-4090-9b09-1efe77737d9e" path="/var/lib/kubelet/pods/74b78ccf-0e0f-4090-9b09-1efe77737d9e/volumes"
Jul 09 19:06:48.112268 ip-10-0-141-101 kubenswrapper[2557]: I0709 19:06:48.112230    2557 generic.go:356] "Generic (PLEG): container finished" podID="7526454c-dcc4-4651-94f3-4a5ccc1510fc" containerID="d28dc800ccec72d0a03847f136199596151ba9ce3f2b6c13a408c82ca3c0314c" exitCode=0
Jul 09 19:06:48.112439 ip-10-0-141-101 kubenswrapper[2557]: I0709 19:06:48.112314    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/test-curl-7662-139921168954672" event={"ID":"7526454c-dcc4-4651-94f3-4a5ccc1510fc","Type":"ContainerDied","Data":"d28dc800ccec72d0a03847f136199596151ba9ce3f2b6c13a408c82ca3c0314c"}
Jul 09 19:06:49.255288 ip-10-0-141-101 kubenswrapper[2557]: I0709 19:06:49.255264    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7662-139921168954672"
Jul 09 19:06:49.279265 ip-10-0-141-101 kubenswrapper[2557]: I0709 19:06:49.279209    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_test-curl-7662-139921168954672_7526454c-dcc4-4651-94f3-4a5ccc1510fc/test-curl-7662-139921168954672/0.log"
Jul 09 19:06:49.302785 ip-10-0-141-101 kubenswrapper[2557]: I0709 19:06:49.302739    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/test-curl-7662-139921168954672"]
Jul 09 19:06:49.306204 ip-10-0-141-101 kubenswrapper[2557]: I0709 19:06:49.306176    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/test-curl-7662-139921168954672"]
Jul 09 19:06:49.343023 ip-10-0-141-101 kubenswrapper[2557]: I0709 19:06:49.342983    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-shz4j\" (UniqueName: \"kubernetes.io/projected/7526454c-dcc4-4651-94f3-4a5ccc1510fc-kube-api-access-shz4j\") pod \"7526454c-dcc4-4651-94f3-4a5ccc1510fc\" (UID: \"7526454c-dcc4-4651-94f3-4a5ccc1510fc\") "
Jul 09 19:06:49.345127 ip-10-0-141-101 kubenswrapper[2557]: I0709 19:06:49.345096    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7526454c-dcc4-4651-94f3-4a5ccc1510fc-kube-api-access-shz4j" (OuterVolumeSpecName: "kube-api-access-shz4j") pod "7526454c-dcc4-4651-94f3-4a5ccc1510fc" (UID: "7526454c-dcc4-4651-94f3-4a5ccc1510fc"). InnerVolumeSpecName "kube-api-access-shz4j". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 19:06:49.444497 ip-10-0-141-101 kubenswrapper[2557]: I0709 19:06:49.444387    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-shz4j\" (UniqueName: \"kubernetes.io/projected/7526454c-dcc4-4651-94f3-4a5ccc1510fc-kube-api-access-shz4j\") on node \"ip-10-0-141-101.ec2.internal\" DevicePath \"\""
Jul 09 19:06:49.455279 ip-10-0-141-101 kubenswrapper[2557]: I0709 19:06:49.455247    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/test-curl-7662-139921169013760"]
Jul 09 19:06:49.455696 ip-10-0-141-101 kubenswrapper[2557]: I0709 19:06:49.455681    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7526454c-dcc4-4651-94f3-4a5ccc1510fc" containerName="test-curl-7662-139921168954672"
Jul 09 19:06:49.455744 ip-10-0-141-101 kubenswrapper[2557]: I0709 19:06:49.455697    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="7526454c-dcc4-4651-94f3-4a5ccc1510fc" containerName="test-curl-7662-139921168954672"
Jul 09 19:06:49.455780 ip-10-0-141-101 kubenswrapper[2557]: I0709 19:06:49.455775    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="7526454c-dcc4-4651-94f3-4a5ccc1510fc" containerName="test-curl-7662-139921168954672"
Jul 09 19:06:49.458890 ip-10-0-141-101 kubenswrapper[2557]: I0709 19:06:49.458871    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7662-139921169013760"
Jul 09 19:06:49.465064 ip-10-0-141-101 kubenswrapper[2557]: I0709 19:06:49.465041    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/test-curl-7662-139921169013760"]
Jul 09 19:06:49.545552 ip-10-0-141-101 kubenswrapper[2557]: I0709 19:06:49.545511    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jtdn9\" (UniqueName: \"kubernetes.io/projected/35db16dc-bba3-46c5-97b7-11605e8596c1-kube-api-access-jtdn9\") pod \"test-curl-7662-139921169013760\" (UID: \"35db16dc-bba3-46c5-97b7-11605e8596c1\") " pod="openshift-ingress/test-curl-7662-139921169013760"
Jul 09 19:06:49.646756 ip-10-0-141-101 kubenswrapper[2557]: I0709 19:06:49.646723    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jtdn9\" (UniqueName: \"kubernetes.io/projected/35db16dc-bba3-46c5-97b7-11605e8596c1-kube-api-access-jtdn9\") pod \"test-curl-7662-139921169013760\" (UID: \"35db16dc-bba3-46c5-97b7-11605e8596c1\") " pod="openshift-ingress/test-curl-7662-139921169013760"
Jul 09 19:06:49.654976 ip-10-0-141-101 kubenswrapper[2557]: I0709 19:06:49.654954    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jtdn9\" (UniqueName: \"kubernetes.io/projected/35db16dc-bba3-46c5-97b7-11605e8596c1-kube-api-access-jtdn9\") pod \"test-curl-7662-139921169013760\" (UID: \"35db16dc-bba3-46c5-97b7-11605e8596c1\") " pod="openshift-ingress/test-curl-7662-139921169013760"
Jul 09 19:06:49.768883 ip-10-0-141-101 kubenswrapper[2557]: I0709 19:06:49.768787    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7662-139921169013760"
Jul 09 19:06:49.913327 ip-10-0-141-101 kubenswrapper[2557]: I0709 19:06:49.913301    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/test-curl-7662-139921169013760"]
Jul 09 19:06:49.915303 ip-10-0-141-101 kubenswrapper[2557]: W0709 19:06:49.915274    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod35db16dc_bba3_46c5_97b7_11605e8596c1.slice/crio-5a8d72ecb0bbea517ee09ba767ca9924fb37f6c382844f9d9b52f9227191b438 WatchSource:0}: Error finding container 5a8d72ecb0bbea517ee09ba767ca9924fb37f6c382844f9d9b52f9227191b438: Status 404 returned error can't find the container with id 5a8d72ecb0bbea517ee09ba767ca9924fb37f6c382844f9d9b52f9227191b438
Jul 09 19:06:50.125404 ip-10-0-141-101 kubenswrapper[2557]: I0709 19:06:50.125377    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7662-139921168954672"
Jul 09 19:06:50.125614 ip-10-0-141-101 kubenswrapper[2557]: I0709 19:06:50.125451    2557 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="3393519030f9353a0eaaf079fdcaa7add7e704bdbd4bcf54ce001fe2c80fb99b"
Jul 09 19:06:50.126770 ip-10-0-141-101 kubenswrapper[2557]: I0709 19:06:50.126741    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/test-curl-7662-139921169013760" event={"ID":"35db16dc-bba3-46c5-97b7-11605e8596c1","Type":"ContainerStarted","Data":"5a8d72ecb0bbea517ee09ba767ca9924fb37f6c382844f9d9b52f9227191b438"}
Jul 09 19:06:50.139547 ip-10-0-141-101 kubenswrapper[2557]: E0709 19:06:50.139515    2557 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7662-139921168954672\" is forbidden: User \"system:node:ip-10-0-141-101.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-ingress\": no relationship found between node 'ip-10-0-141-101.ec2.internal' and this object" podUID="7526454c-dcc4-4651-94f3-4a5ccc1510fc" pod="openshift-ingress/test-curl-7662-139921168954672"
Jul 09 19:06:51.134268 ip-10-0-141-101 kubenswrapper[2557]: I0709 19:06:51.134234    2557 generic.go:356] "Generic (PLEG): container finished" podID="35db16dc-bba3-46c5-97b7-11605e8596c1" containerID="fab45ee530c3615310b15161775be54f3c3c6639752a94fd92f726fb26246cee" exitCode=0
Jul 09 19:06:51.134670 ip-10-0-141-101 kubenswrapper[2557]: I0709 19:06:51.134321    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/test-curl-7662-139921169013760" event={"ID":"35db16dc-bba3-46c5-97b7-11605e8596c1","Type":"ContainerDied","Data":"fab45ee530c3615310b15161775be54f3c3c6639752a94fd92f726fb26246cee"}
Jul 09 19:06:51.136427 ip-10-0-141-101 kubenswrapper[2557]: E0709 19:06:51.136402    2557 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7662-139921168954672\" is forbidden: User \"system:node:ip-10-0-141-101.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-ingress\": no relationship found between node 'ip-10-0-141-101.ec2.internal' and this object" podUID="7526454c-dcc4-4651-94f3-4a5ccc1510fc" pod="openshift-ingress/test-curl-7662-139921168954672"
Jul 09 19:06:51.260596 ip-10-0-141-101 kubenswrapper[2557]: E0709 19:06:51.260552    2557 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7662-139921168954672\" is forbidden: User \"system:node:ip-10-0-141-101.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-ingress\": no relationship found between node 'ip-10-0-141-101.ec2.internal' and this object" podUID="7526454c-dcc4-4651-94f3-4a5ccc1510fc" pod="openshift-ingress/test-curl-7662-139921168954672"
Jul 09 19:06:51.261890 ip-10-0-141-101 kubenswrapper[2557]: I0709 19:06:51.261868    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7526454c-dcc4-4651-94f3-4a5ccc1510fc" path="/var/lib/kubelet/pods/7526454c-dcc4-4651-94f3-4a5ccc1510fc/volumes"
Jul 09 19:06:52.289209 ip-10-0-141-101 kubenswrapper[2557]: I0709 19:06:52.289184    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7662-139921169013760"
Jul 09 19:06:52.310573 ip-10-0-141-101 kubenswrapper[2557]: I0709 19:06:52.310526    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_test-curl-7662-139921169013760_35db16dc-bba3-46c5-97b7-11605e8596c1/test-curl-7662-139921169013760/0.log"
Jul 09 19:06:52.334273 ip-10-0-141-101 kubenswrapper[2557]: I0709 19:06:52.334239    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/test-curl-7662-139921169013760"]
Jul 09 19:06:52.336621 ip-10-0-141-101 kubenswrapper[2557]: I0709 19:06:52.336599    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/test-curl-7662-139921169013760"]
Jul 09 19:06:52.453090 ip-10-0-141-101 kubenswrapper[2557]: I0709 19:06:52.453016    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/test-curl-7662-139921169013760"]
Jul 09 19:06:52.453432 ip-10-0-141-101 kubenswrapper[2557]: I0709 19:06:52.453419    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="35db16dc-bba3-46c5-97b7-11605e8596c1" containerName="test-curl-7662-139921169013760"
Jul 09 19:06:52.453528 ip-10-0-141-101 kubenswrapper[2557]: I0709 19:06:52.453433    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="35db16dc-bba3-46c5-97b7-11605e8596c1" containerName="test-curl-7662-139921169013760"
Jul 09 19:06:52.453578 ip-10-0-141-101 kubenswrapper[2557]: I0709 19:06:52.453544    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="35db16dc-bba3-46c5-97b7-11605e8596c1" containerName="test-curl-7662-139921169013760"
Jul 09 19:06:52.456394 ip-10-0-141-101 kubenswrapper[2557]: I0709 19:06:52.456377    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7662-139921169013760"
Jul 09 19:06:52.464395 ip-10-0-141-101 kubenswrapper[2557]: I0709 19:06:52.464372    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/test-curl-7662-139921169013760"]
Jul 09 19:06:52.473586 ip-10-0-141-101 kubenswrapper[2557]: I0709 19:06:52.473360    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jtdn9\" (UniqueName: \"kubernetes.io/projected/35db16dc-bba3-46c5-97b7-11605e8596c1-kube-api-access-jtdn9\") pod \"35db16dc-bba3-46c5-97b7-11605e8596c1\" (UID: \"35db16dc-bba3-46c5-97b7-11605e8596c1\") "
Jul 09 19:06:52.475399 ip-10-0-141-101 kubenswrapper[2557]: I0709 19:06:52.475370    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/35db16dc-bba3-46c5-97b7-11605e8596c1-kube-api-access-jtdn9" (OuterVolumeSpecName: "kube-api-access-jtdn9") pod "35db16dc-bba3-46c5-97b7-11605e8596c1" (UID: "35db16dc-bba3-46c5-97b7-11605e8596c1"). InnerVolumeSpecName "kube-api-access-jtdn9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 19:06:52.574188 ip-10-0-141-101 kubenswrapper[2557]: I0709 19:06:52.574150    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ksggm\" (UniqueName: \"kubernetes.io/projected/de602e4f-789a-495a-a54c-4864ddb19622-kube-api-access-ksggm\") pod \"test-curl-7662-139921169013760\" (UID: \"de602e4f-789a-495a-a54c-4864ddb19622\") " pod="openshift-ingress/test-curl-7662-139921169013760"
Jul 09 19:06:52.574343 ip-10-0-141-101 kubenswrapper[2557]: I0709 19:06:52.574208    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jtdn9\" (UniqueName: \"kubernetes.io/projected/35db16dc-bba3-46c5-97b7-11605e8596c1-kube-api-access-jtdn9\") on node \"ip-10-0-141-101.ec2.internal\" DevicePath \"\""
Jul 09 19:06:52.674709 ip-10-0-141-101 kubenswrapper[2557]: I0709 19:06:52.674674    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ksggm\" (UniqueName: \"kubernetes.io/projected/de602e4f-789a-495a-a54c-4864ddb19622-kube-api-access-ksggm\") pod \"test-curl-7662-139921169013760\" (UID: \"de602e4f-789a-495a-a54c-4864ddb19622\") " pod="openshift-ingress/test-curl-7662-139921169013760"
Jul 09 19:06:52.683874 ip-10-0-141-101 kubenswrapper[2557]: I0709 19:06:52.683851    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ksggm\" (UniqueName: \"kubernetes.io/projected/de602e4f-789a-495a-a54c-4864ddb19622-kube-api-access-ksggm\") pod \"test-curl-7662-139921169013760\" (UID: \"de602e4f-789a-495a-a54c-4864ddb19622\") " pod="openshift-ingress/test-curl-7662-139921169013760"
Jul 09 19:06:52.766527 ip-10-0-141-101 kubenswrapper[2557]: I0709 19:06:52.766405    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7662-139921169013760"
Jul 09 19:06:52.907949 ip-10-0-141-101 kubenswrapper[2557]: I0709 19:06:52.907923    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/test-curl-7662-139921169013760"]
Jul 09 19:06:52.909692 ip-10-0-141-101 kubenswrapper[2557]: W0709 19:06:52.909666    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podde602e4f_789a_495a_a54c_4864ddb19622.slice/crio-1d72bbb9d7230e040a16e2d4288176a7b80dc74200cf3b8fa9ac7e71fba8b5db WatchSource:0}: Error finding container 1d72bbb9d7230e040a16e2d4288176a7b80dc74200cf3b8fa9ac7e71fba8b5db: Status 404 returned error can't find the container with id 1d72bbb9d7230e040a16e2d4288176a7b80dc74200cf3b8fa9ac7e71fba8b5db
Jul 09 19:06:53.147350 ip-10-0-141-101 kubenswrapper[2557]: I0709 19:06:53.147313    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/test-curl-7662-139921169013760" event={"ID":"de602e4f-789a-495a-a54c-4864ddb19622","Type":"ContainerStarted","Data":"1d72bbb9d7230e040a16e2d4288176a7b80dc74200cf3b8fa9ac7e71fba8b5db"}
Jul 09 19:06:53.148611 ip-10-0-141-101 kubenswrapper[2557]: I0709 19:06:53.148591    2557 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="5a8d72ecb0bbea517ee09ba767ca9924fb37f6c382844f9d9b52f9227191b438"
Jul 09 19:06:53.148727 ip-10-0-141-101 kubenswrapper[2557]: I0709 19:06:53.148627    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7662-139921169013760"
Jul 09 19:06:53.160199 ip-10-0-141-101 kubenswrapper[2557]: I0709 19:06:53.160166    2557 status_manager.go:1027] "Pod was deleted and then recreated, skipping status update" pod="openshift-ingress/test-curl-7662-139921169013760" oldPodUID="35db16dc-bba3-46c5-97b7-11605e8596c1" podUID="de602e4f-789a-495a-a54c-4864ddb19622"
Jul 09 19:06:53.263506 ip-10-0-141-101 kubenswrapper[2557]: I0709 19:06:53.263463    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="35db16dc-bba3-46c5-97b7-11605e8596c1" path="/var/lib/kubelet/pods/35db16dc-bba3-46c5-97b7-11605e8596c1/volumes"
Jul 09 19:06:54.156081 ip-10-0-141-101 kubenswrapper[2557]: I0709 19:06:54.156045    2557 generic.go:356] "Generic (PLEG): container finished" podID="de602e4f-789a-495a-a54c-4864ddb19622" containerID="ba985edb3ae67e2e7a51bdcb329d50b0ed30b2ab7fe9d6b2ee0a68f1de5ebce5" exitCode=0
Jul 09 19:06:54.156508 ip-10-0-141-101 kubenswrapper[2557]: I0709 19:06:54.156134    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/test-curl-7662-139921169013760" event={"ID":"de602e4f-789a-495a-a54c-4864ddb19622","Type":"ContainerDied","Data":"ba985edb3ae67e2e7a51bdcb329d50b0ed30b2ab7fe9d6b2ee0a68f1de5ebce5"}
Jul 09 19:06:55.315662 ip-10-0-141-101 kubenswrapper[2557]: I0709 19:06:55.315637    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7662-139921169013760"
Jul 09 19:06:55.336098 ip-10-0-141-101 kubenswrapper[2557]: I0709 19:06:55.336032    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_test-curl-7662-139921169013760_de602e4f-789a-495a-a54c-4864ddb19622/test-curl-7662-139921169013760/0.log"
Jul 09 19:06:55.357928 ip-10-0-141-101 kubenswrapper[2557]: I0709 19:06:55.357892    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/test-curl-7662-139921169013760"]
Jul 09 19:06:55.362501 ip-10-0-141-101 kubenswrapper[2557]: I0709 19:06:55.362458    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/test-curl-7662-139921169013760"]
Jul 09 19:06:55.477717 ip-10-0-141-101 kubenswrapper[2557]: I0709 19:06:55.477635    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/test-curl-7662-139921169014624"]
Jul 09 19:06:55.478068 ip-10-0-141-101 kubenswrapper[2557]: I0709 19:06:55.478054    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="de602e4f-789a-495a-a54c-4864ddb19622" containerName="test-curl-7662-139921169013760"
Jul 09 19:06:55.478115 ip-10-0-141-101 kubenswrapper[2557]: I0709 19:06:55.478070    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="de602e4f-789a-495a-a54c-4864ddb19622" containerName="test-curl-7662-139921169013760"
Jul 09 19:06:55.478161 ip-10-0-141-101 kubenswrapper[2557]: I0709 19:06:55.478151    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="de602e4f-789a-495a-a54c-4864ddb19622" containerName="test-curl-7662-139921169013760"
Jul 09 19:06:55.481321 ip-10-0-141-101 kubenswrapper[2557]: I0709 19:06:55.481296    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7662-139921169014624"
Jul 09 19:06:55.487889 ip-10-0-141-101 kubenswrapper[2557]: I0709 19:06:55.487860    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/test-curl-7662-139921169014624"]
Jul 09 19:06:55.503052 ip-10-0-141-101 kubenswrapper[2557]: I0709 19:06:55.503027    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ksggm\" (UniqueName: \"kubernetes.io/projected/de602e4f-789a-495a-a54c-4864ddb19622-kube-api-access-ksggm\") pod \"de602e4f-789a-495a-a54c-4864ddb19622\" (UID: \"de602e4f-789a-495a-a54c-4864ddb19622\") "
Jul 09 19:06:55.505178 ip-10-0-141-101 kubenswrapper[2557]: I0709 19:06:55.505150    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/de602e4f-789a-495a-a54c-4864ddb19622-kube-api-access-ksggm" (OuterVolumeSpecName: "kube-api-access-ksggm") pod "de602e4f-789a-495a-a54c-4864ddb19622" (UID: "de602e4f-789a-495a-a54c-4864ddb19622"). InnerVolumeSpecName "kube-api-access-ksggm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 19:06:55.604412 ip-10-0-141-101 kubenswrapper[2557]: I0709 19:06:55.604371    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pv6zt\" (UniqueName: \"kubernetes.io/projected/85ad84e3-8407-468f-8576-9e7d4f920947-kube-api-access-pv6zt\") pod \"test-curl-7662-139921169014624\" (UID: \"85ad84e3-8407-468f-8576-9e7d4f920947\") " pod="openshift-ingress/test-curl-7662-139921169014624"
Jul 09 19:06:55.604635 ip-10-0-141-101 kubenswrapper[2557]: I0709 19:06:55.604435    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ksggm\" (UniqueName: \"kubernetes.io/projected/de602e4f-789a-495a-a54c-4864ddb19622-kube-api-access-ksggm\") on node \"ip-10-0-141-101.ec2.internal\" DevicePath \"\""
Jul 09 19:06:55.705210 ip-10-0-141-101 kubenswrapper[2557]: I0709 19:06:55.705164    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pv6zt\" (UniqueName: \"kubernetes.io/projected/85ad84e3-8407-468f-8576-9e7d4f920947-kube-api-access-pv6zt\") pod \"test-curl-7662-139921169014624\" (UID: \"85ad84e3-8407-468f-8576-9e7d4f920947\") " pod="openshift-ingress/test-curl-7662-139921169014624"
Jul 09 19:06:55.714143 ip-10-0-141-101 kubenswrapper[2557]: I0709 19:06:55.714112    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pv6zt\" (UniqueName: \"kubernetes.io/projected/85ad84e3-8407-468f-8576-9e7d4f920947-kube-api-access-pv6zt\") pod \"test-curl-7662-139921169014624\" (UID: \"85ad84e3-8407-468f-8576-9e7d4f920947\") " pod="openshift-ingress/test-curl-7662-139921169014624"
Jul 09 19:06:55.791991 ip-10-0-141-101 kubenswrapper[2557]: I0709 19:06:55.791963    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7662-139921169014624"
Jul 09 19:06:55.955367 ip-10-0-141-101 kubenswrapper[2557]: I0709 19:06:55.955337    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/test-curl-7662-139921169014624"]
Jul 09 19:06:55.957363 ip-10-0-141-101 kubenswrapper[2557]: W0709 19:06:55.957334    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod85ad84e3_8407_468f_8576_9e7d4f920947.slice/crio-e164a28db0469c7f2a420958941aa81195b8b9871ceb85f4c105d45db23ba069 WatchSource:0}: Error finding container e164a28db0469c7f2a420958941aa81195b8b9871ceb85f4c105d45db23ba069: Status 404 returned error can't find the container with id e164a28db0469c7f2a420958941aa81195b8b9871ceb85f4c105d45db23ba069
Jul 09 19:06:56.168960 ip-10-0-141-101 kubenswrapper[2557]: I0709 19:06:56.168860    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/test-curl-7662-139921169014624" event={"ID":"85ad84e3-8407-468f-8576-9e7d4f920947","Type":"ContainerStarted","Data":"e164a28db0469c7f2a420958941aa81195b8b9871ceb85f4c105d45db23ba069"}
Jul 09 19:06:56.170153 ip-10-0-141-101 kubenswrapper[2557]: I0709 19:06:56.170133    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7662-139921169013760"
Jul 09 19:06:56.170272 ip-10-0-141-101 kubenswrapper[2557]: I0709 19:06:56.170185    2557 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="1d72bbb9d7230e040a16e2d4288176a7b80dc74200cf3b8fa9ac7e71fba8b5db"
Jul 09 19:06:56.180851 ip-10-0-141-101 kubenswrapper[2557]: E0709 19:06:56.180819    2557 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7662-139921169013760\" is forbidden: User \"system:node:ip-10-0-141-101.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-ingress\": no relationship found between node 'ip-10-0-141-101.ec2.internal' and this object" podUID="de602e4f-789a-495a-a54c-4864ddb19622" pod="openshift-ingress/test-curl-7662-139921169013760"
Jul 09 19:06:57.176829 ip-10-0-141-101 kubenswrapper[2557]: I0709 19:06:57.176796    2557 generic.go:356] "Generic (PLEG): container finished" podID="85ad84e3-8407-468f-8576-9e7d4f920947" containerID="87386ed086edf6b9a7e3354948c2e1305ef7b24c8e2572e77a1ca98881681408" exitCode=0
Jul 09 19:06:57.177250 ip-10-0-141-101 kubenswrapper[2557]: I0709 19:06:57.176882    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/test-curl-7662-139921169014624" event={"ID":"85ad84e3-8407-468f-8576-9e7d4f920947","Type":"ContainerDied","Data":"87386ed086edf6b9a7e3354948c2e1305ef7b24c8e2572e77a1ca98881681408"}
Jul 09 19:06:57.178838 ip-10-0-141-101 kubenswrapper[2557]: E0709 19:06:57.178815    2557 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7662-139921169013760\" is forbidden: User \"system:node:ip-10-0-141-101.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-ingress\": no relationship found between node 'ip-10-0-141-101.ec2.internal' and this object" podUID="de602e4f-789a-495a-a54c-4864ddb19622" pod="openshift-ingress/test-curl-7662-139921169013760"
Jul 09 19:06:57.263163 ip-10-0-141-101 kubenswrapper[2557]: I0709 19:06:57.263130    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="de602e4f-789a-495a-a54c-4864ddb19622" path="/var/lib/kubelet/pods/de602e4f-789a-495a-a54c-4864ddb19622/volumes"
Jul 09 19:06:58.336184 ip-10-0-141-101 kubenswrapper[2557]: I0709 19:06:58.336158    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7662-139921169014624"
Jul 09 19:06:58.356704 ip-10-0-141-101 kubenswrapper[2557]: I0709 19:06:58.356662    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_test-curl-7662-139921169014624_85ad84e3-8407-468f-8576-9e7d4f920947/test-curl-7662-139921169014624/0.log"
Jul 09 19:06:58.379096 ip-10-0-141-101 kubenswrapper[2557]: I0709 19:06:58.379046    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/test-curl-7662-139921169014624"]
Jul 09 19:06:58.382871 ip-10-0-141-101 kubenswrapper[2557]: I0709 19:06:58.382846    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/test-curl-7662-139921169014624"]
Jul 09 19:06:58.429270 ip-10-0-141-101 kubenswrapper[2557]: I0709 19:06:58.429241    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pv6zt\" (UniqueName: \"kubernetes.io/projected/85ad84e3-8407-468f-8576-9e7d4f920947-kube-api-access-pv6zt\") pod \"85ad84e3-8407-468f-8576-9e7d4f920947\" (UID: \"85ad84e3-8407-468f-8576-9e7d4f920947\") "
Jul 09 19:06:58.431259 ip-10-0-141-101 kubenswrapper[2557]: I0709 19:06:58.431236    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/85ad84e3-8407-468f-8576-9e7d4f920947-kube-api-access-pv6zt" (OuterVolumeSpecName: "kube-api-access-pv6zt") pod "85ad84e3-8407-468f-8576-9e7d4f920947" (UID: "85ad84e3-8407-468f-8576-9e7d4f920947"). InnerVolumeSpecName "kube-api-access-pv6zt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 19:06:58.530514 ip-10-0-141-101 kubenswrapper[2557]: I0709 19:06:58.530453    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pv6zt\" (UniqueName: \"kubernetes.io/projected/85ad84e3-8407-468f-8576-9e7d4f920947-kube-api-access-pv6zt\") on node \"ip-10-0-141-101.ec2.internal\" DevicePath \"\""
Jul 09 19:06:59.191127 ip-10-0-141-101 kubenswrapper[2557]: I0709 19:06:59.191096    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7662-139921169014624"
Jul 09 19:06:59.191283 ip-10-0-141-101 kubenswrapper[2557]: I0709 19:06:59.191144    2557 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e164a28db0469c7f2a420958941aa81195b8b9871ceb85f4c105d45db23ba069"
Jul 09 19:06:59.201606 ip-10-0-141-101 kubenswrapper[2557]: E0709 19:06:59.201573    2557 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7662-139921169014624\" is forbidden: User \"system:node:ip-10-0-141-101.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-ingress\": no relationship found between node 'ip-10-0-141-101.ec2.internal' and this object" podUID="85ad84e3-8407-468f-8576-9e7d4f920947" pod="openshift-ingress/test-curl-7662-139921169014624"
Jul 09 19:06:59.263628 ip-10-0-141-101 kubenswrapper[2557]: I0709 19:06:59.263599    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="85ad84e3-8407-468f-8576-9e7d4f920947" path="/var/lib/kubelet/pods/85ad84e3-8407-468f-8576-9e7d4f920947/volumes"
Jul 09 19:07:16.596116 ip-10-0-141-101 kubenswrapper[2557]: I0709 19:07:16.596073    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-172f88-openshift-default-5c95794d55-crfth"]
Jul 09 19:07:16.596751 ip-10-0-141-101 kubenswrapper[2557]: I0709 19:07:16.596329    2557 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-b-172f88-openshift-default-5c95794d55-crfth" podUID="ac93bbf3-1a6f-40c1-8a13-482688a41e56" containerName="istio-proxy" containerID="cri-o://d84e5105f3395997e351db27cf66b1d7c5aa471525c1858f539c365eef99bc9a" gracePeriod=30
Jul 09 19:07:21.860319 ip-10-0-141-101 kubenswrapper[2557]: I0709 19:07:21.860249    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-172f88-openshift-default-5c95794d55-crfth"
Jul 09 19:07:21.947171 ip-10-0-141-101 kubenswrapper[2557]: I0709 19:07:21.947139    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ac93bbf3-1a6f-40c1-8a13-482688a41e56-workload-certs\") pod \"ac93bbf3-1a6f-40c1-8a13-482688a41e56\" (UID: \"ac93bbf3-1a6f-40c1-8a13-482688a41e56\") "
Jul 09 19:07:21.947171 ip-10-0-141-101 kubenswrapper[2557]: I0709 19:07:21.947173    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ac93bbf3-1a6f-40c1-8a13-482688a41e56-istio-data\") pod \"ac93bbf3-1a6f-40c1-8a13-482688a41e56\" (UID: \"ac93bbf3-1a6f-40c1-8a13-482688a41e56\") "
Jul 09 19:07:21.947440 ip-10-0-141-101 kubenswrapper[2557]: I0709 19:07:21.947195    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-54rms\" (UniqueName: \"kubernetes.io/projected/ac93bbf3-1a6f-40c1-8a13-482688a41e56-kube-api-access-54rms\") pod \"ac93bbf3-1a6f-40c1-8a13-482688a41e56\" (UID: \"ac93bbf3-1a6f-40c1-8a13-482688a41e56\") "
Jul 09 19:07:21.947440 ip-10-0-141-101 kubenswrapper[2557]: I0709 19:07:21.947238    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ac93bbf3-1a6f-40c1-8a13-482688a41e56-istio-envoy\") pod \"ac93bbf3-1a6f-40c1-8a13-482688a41e56\" (UID: \"ac93bbf3-1a6f-40c1-8a13-482688a41e56\") "
Jul 09 19:07:21.947440 ip-10-0-141-101 kubenswrapper[2557]: I0709 19:07:21.947262    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ac93bbf3-1a6f-40c1-8a13-482688a41e56-istio-token\") pod \"ac93bbf3-1a6f-40c1-8a13-482688a41e56\" (UID: \"ac93bbf3-1a6f-40c1-8a13-482688a41e56\") "
Jul 09 19:07:21.947440 ip-10-0-141-101 kubenswrapper[2557]: I0709 19:07:21.947300    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ac93bbf3-1a6f-40c1-8a13-482688a41e56-istiod-ca-cert\") pod \"ac93bbf3-1a6f-40c1-8a13-482688a41e56\" (UID: \"ac93bbf3-1a6f-40c1-8a13-482688a41e56\") "
Jul 09 19:07:21.947440 ip-10-0-141-101 kubenswrapper[2557]: I0709 19:07:21.947337    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ac93bbf3-1a6f-40c1-8a13-482688a41e56-workload-socket\") pod \"ac93bbf3-1a6f-40c1-8a13-482688a41e56\" (UID: \"ac93bbf3-1a6f-40c1-8a13-482688a41e56\") "
Jul 09 19:07:21.947738 ip-10-0-141-101 kubenswrapper[2557]: I0709 19:07:21.947458    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ac93bbf3-1a6f-40c1-8a13-482688a41e56-credential-socket\") pod \"ac93bbf3-1a6f-40c1-8a13-482688a41e56\" (UID: \"ac93bbf3-1a6f-40c1-8a13-482688a41e56\") "
Jul 09 19:07:21.947738 ip-10-0-141-101 kubenswrapper[2557]: I0709 19:07:21.947533    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ac93bbf3-1a6f-40c1-8a13-482688a41e56-istio-podinfo\") pod \"ac93bbf3-1a6f-40c1-8a13-482688a41e56\" (UID: \"ac93bbf3-1a6f-40c1-8a13-482688a41e56\") "
Jul 09 19:07:21.947738 ip-10-0-141-101 kubenswrapper[2557]: I0709 19:07:21.947534    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ac93bbf3-1a6f-40c1-8a13-482688a41e56-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "ac93bbf3-1a6f-40c1-8a13-482688a41e56" (UID: "ac93bbf3-1a6f-40c1-8a13-482688a41e56"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 19:07:21.947901 ip-10-0-141-101 kubenswrapper[2557]: I0709 19:07:21.947754    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ac93bbf3-1a6f-40c1-8a13-482688a41e56-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "ac93bbf3-1a6f-40c1-8a13-482688a41e56" (UID: "ac93bbf3-1a6f-40c1-8a13-482688a41e56"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 19:07:21.947901 ip-10-0-141-101 kubenswrapper[2557]: I0709 19:07:21.947782    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ac93bbf3-1a6f-40c1-8a13-482688a41e56-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "ac93bbf3-1a6f-40c1-8a13-482688a41e56" (UID: "ac93bbf3-1a6f-40c1-8a13-482688a41e56"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 09 19:07:21.948018 ip-10-0-141-101 kubenswrapper[2557]: I0709 19:07:21.947906    2557 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ac93bbf3-1a6f-40c1-8a13-482688a41e56-istiod-ca-cert\") on node \"ip-10-0-141-101.ec2.internal\" DevicePath \"\""
Jul 09 19:07:21.948018 ip-10-0-141-101 kubenswrapper[2557]: I0709 19:07:21.947924    2557 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ac93bbf3-1a6f-40c1-8a13-482688a41e56-workload-socket\") on node \"ip-10-0-141-101.ec2.internal\" DevicePath \"\""
Jul 09 19:07:21.948018 ip-10-0-141-101 kubenswrapper[2557]: I0709 19:07:21.947937    2557 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ac93bbf3-1a6f-40c1-8a13-482688a41e56-workload-certs\") on node \"ip-10-0-141-101.ec2.internal\" DevicePath \"\""
Jul 09 19:07:21.948018 ip-10-0-141-101 kubenswrapper[2557]: I0709 19:07:21.947956    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ac93bbf3-1a6f-40c1-8a13-482688a41e56-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "ac93bbf3-1a6f-40c1-8a13-482688a41e56" (UID: "ac93bbf3-1a6f-40c1-8a13-482688a41e56"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 19:07:21.948209 ip-10-0-141-101 kubenswrapper[2557]: I0709 19:07:21.948127    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ac93bbf3-1a6f-40c1-8a13-482688a41e56-istio-data" (OuterVolumeSpecName: "istio-data") pod "ac93bbf3-1a6f-40c1-8a13-482688a41e56" (UID: "ac93bbf3-1a6f-40c1-8a13-482688a41e56"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 19:07:21.949625 ip-10-0-141-101 kubenswrapper[2557]: I0709 19:07:21.949596    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ac93bbf3-1a6f-40c1-8a13-482688a41e56-kube-api-access-54rms" (OuterVolumeSpecName: "kube-api-access-54rms") pod "ac93bbf3-1a6f-40c1-8a13-482688a41e56" (UID: "ac93bbf3-1a6f-40c1-8a13-482688a41e56"). InnerVolumeSpecName "kube-api-access-54rms". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 19:07:21.949885 ip-10-0-141-101 kubenswrapper[2557]: I0709 19:07:21.949865    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ac93bbf3-1a6f-40c1-8a13-482688a41e56-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "ac93bbf3-1a6f-40c1-8a13-482688a41e56" (UID: "ac93bbf3-1a6f-40c1-8a13-482688a41e56"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 19:07:21.949885 ip-10-0-141-101 kubenswrapper[2557]: I0709 19:07:21.949877    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ac93bbf3-1a6f-40c1-8a13-482688a41e56-istio-token" (OuterVolumeSpecName: "istio-token") pod "ac93bbf3-1a6f-40c1-8a13-482688a41e56" (UID: "ac93bbf3-1a6f-40c1-8a13-482688a41e56"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 19:07:21.950008 ip-10-0-141-101 kubenswrapper[2557]: I0709 19:07:21.949902    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/ac93bbf3-1a6f-40c1-8a13-482688a41e56-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "ac93bbf3-1a6f-40c1-8a13-482688a41e56" (UID: "ac93bbf3-1a6f-40c1-8a13-482688a41e56"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 09 19:07:22.034714 ip-10-0-141-101 kubenswrapper[2557]: I0709 19:07:22.034683    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-rxlvf_f8732a9f-c4ca-486b-bf37-8bf1f99ca897/manager/0.log"
Jul 09 19:07:22.048982 ip-10-0-141-101 kubenswrapper[2557]: I0709 19:07:22.048956    2557 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ac93bbf3-1a6f-40c1-8a13-482688a41e56-credential-socket\") on node \"ip-10-0-141-101.ec2.internal\" DevicePath \"\""
Jul 09 19:07:22.048982 ip-10-0-141-101 kubenswrapper[2557]: I0709 19:07:22.048992    2557 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ac93bbf3-1a6f-40c1-8a13-482688a41e56-istio-podinfo\") on node \"ip-10-0-141-101.ec2.internal\" DevicePath \"\""
Jul 09 19:07:22.049165 ip-10-0-141-101 kubenswrapper[2557]: I0709 19:07:22.049002    2557 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ac93bbf3-1a6f-40c1-8a13-482688a41e56-istio-data\") on node \"ip-10-0-141-101.ec2.internal\" DevicePath \"\""
Jul 09 19:07:22.049165 ip-10-0-141-101 kubenswrapper[2557]: I0709 19:07:22.049022    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-54rms\" (UniqueName: \"kubernetes.io/projected/ac93bbf3-1a6f-40c1-8a13-482688a41e56-kube-api-access-54rms\") on node \"ip-10-0-141-101.ec2.internal\" DevicePath \"\""
Jul 09 19:07:22.049165 ip-10-0-141-101 kubenswrapper[2557]: I0709 19:07:22.049033    2557 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ac93bbf3-1a6f-40c1-8a13-482688a41e56-istio-envoy\") on node \"ip-10-0-141-101.ec2.internal\" DevicePath \"\""
Jul 09 19:07:22.049165 ip-10-0-141-101 kubenswrapper[2557]: I0709 19:07:22.049041    2557 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ac93bbf3-1a6f-40c1-8a13-482688a41e56-istio-token\") on node \"ip-10-0-141-101.ec2.internal\" DevicePath \"\""
Jul 09 19:07:22.153230 ip-10-0-141-101 kubenswrapper[2557]: I0709 19:07:22.153146    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-jqjtj_36545808-0daf-49b4-b2dc-76fea0005844/manager/0.log"
Jul 09 19:07:22.328848 ip-10-0-141-101 kubenswrapper[2557]: I0709 19:07:22.328817    2557 generic.go:356] "Generic (PLEG): container finished" podID="ac93bbf3-1a6f-40c1-8a13-482688a41e56" containerID="d84e5105f3395997e351db27cf66b1d7c5aa471525c1858f539c365eef99bc9a" exitCode=0
Jul 09 19:07:22.329041 ip-10-0-141-101 kubenswrapper[2557]: I0709 19:07:22.328870    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-172f88-openshift-default-5c95794d55-crfth"
Jul 09 19:07:22.329041 ip-10-0-141-101 kubenswrapper[2557]: I0709 19:07:22.328900    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-172f88-openshift-default-5c95794d55-crfth" event={"ID":"ac93bbf3-1a6f-40c1-8a13-482688a41e56","Type":"ContainerDied","Data":"d84e5105f3395997e351db27cf66b1d7c5aa471525c1858f539c365eef99bc9a"}
Jul 09 19:07:22.329041 ip-10-0-141-101 kubenswrapper[2557]: I0709 19:07:22.328954    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-172f88-openshift-default-5c95794d55-crfth" event={"ID":"ac93bbf3-1a6f-40c1-8a13-482688a41e56","Type":"ContainerDied","Data":"e9b391a688d6e2d103651e3964631d3ec552af448fea1ad6acc3f71622ee55d0"}
Jul 09 19:07:22.329041 ip-10-0-141-101 kubenswrapper[2557]: I0709 19:07:22.328978    2557 scope.go:117] "RemoveContainer" containerID="d84e5105f3395997e351db27cf66b1d7c5aa471525c1858f539c365eef99bc9a"
Jul 09 19:07:22.342434 ip-10-0-141-101 kubenswrapper[2557]: I0709 19:07:22.342413    2557 scope.go:117] "RemoveContainer" containerID="bbe68a34300c82b702b34c4d60cd99432300ecc0d3f112e12832cf02db8e7826"
Jul 09 19:07:22.351629 ip-10-0-141-101 kubenswrapper[2557]: I0709 19:07:22.351591    2557 scope.go:117] "RemoveContainer" containerID="d84e5105f3395997e351db27cf66b1d7c5aa471525c1858f539c365eef99bc9a"
Jul 09 19:07:22.351912 ip-10-0-141-101 kubenswrapper[2557]: E0709 19:07:22.351892    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d84e5105f3395997e351db27cf66b1d7c5aa471525c1858f539c365eef99bc9a\": container with ID starting with d84e5105f3395997e351db27cf66b1d7c5aa471525c1858f539c365eef99bc9a not found: ID does not exist" containerID="d84e5105f3395997e351db27cf66b1d7c5aa471525c1858f539c365eef99bc9a"
Jul 09 19:07:22.351979 ip-10-0-141-101 kubenswrapper[2557]: I0709 19:07:22.351923    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d84e5105f3395997e351db27cf66b1d7c5aa471525c1858f539c365eef99bc9a"} err="failed to get container status \"d84e5105f3395997e351db27cf66b1d7c5aa471525c1858f539c365eef99bc9a\": rpc error: code = NotFound desc = could not find container \"d84e5105f3395997e351db27cf66b1d7c5aa471525c1858f539c365eef99bc9a\": container with ID starting with d84e5105f3395997e351db27cf66b1d7c5aa471525c1858f539c365eef99bc9a not found: ID does not exist"
Jul 09 19:07:22.351979 ip-10-0-141-101 kubenswrapper[2557]: I0709 19:07:22.351943    2557 scope.go:117] "RemoveContainer" containerID="bbe68a34300c82b702b34c4d60cd99432300ecc0d3f112e12832cf02db8e7826"
Jul 09 19:07:22.352183 ip-10-0-141-101 kubenswrapper[2557]: E0709 19:07:22.352168    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bbe68a34300c82b702b34c4d60cd99432300ecc0d3f112e12832cf02db8e7826\": container with ID starting with bbe68a34300c82b702b34c4d60cd99432300ecc0d3f112e12832cf02db8e7826 not found: ID does not exist" containerID="bbe68a34300c82b702b34c4d60cd99432300ecc0d3f112e12832cf02db8e7826"
Jul 09 19:07:22.352228 ip-10-0-141-101 kubenswrapper[2557]: I0709 19:07:22.352186    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bbe68a34300c82b702b34c4d60cd99432300ecc0d3f112e12832cf02db8e7826"} err="failed to get container status \"bbe68a34300c82b702b34c4d60cd99432300ecc0d3f112e12832cf02db8e7826\": rpc error: code = NotFound desc = could not find container \"bbe68a34300c82b702b34c4d60cd99432300ecc0d3f112e12832cf02db8e7826\": container with ID starting with bbe68a34300c82b702b34c4d60cd99432300ecc0d3f112e12832cf02db8e7826 not found: ID does not exist"
Jul 09 19:07:22.357663 ip-10-0-141-101 kubenswrapper[2557]: I0709 19:07:22.357636    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-172f88-openshift-default-5c95794d55-crfth"]
Jul 09 19:07:22.364053 ip-10-0-141-101 kubenswrapper[2557]: I0709 19:07:22.364028    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-b-172f88-openshift-default-5c95794d55-crfth"]
Jul 09 19:07:22.405807 ip-10-0-141-101 kubenswrapper[2557]: I0709 19:07:22.405727    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-4wffq_238eb895-3741-4a66-b2b4-8c2a64516a11/server/0.log"
Jul 09 19:07:22.775077 ip-10-0-141-101 kubenswrapper[2557]: I0709 19:07:22.774996    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-59f7885b79-nt2jx_fc118cf6-f01e-4901-9e18-279277549dc5/manager/0.log"
Jul 09 19:07:22.784422 ip-10-0-141-101 kubenswrapper[2557]: I0709 19:07:22.784394    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-59f7885b79-nt2jx_fc118cf6-f01e-4901-9e18-279277549dc5/copy-manifests/0.log"
Jul 09 19:07:23.262921 ip-10-0-141-101 kubenswrapper[2557]: I0709 19:07:23.262885    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ac93bbf3-1a6f-40c1-8a13-482688a41e56" path="/var/lib/kubelet/pods/ac93bbf3-1a6f-40c1-8a13-482688a41e56/volumes"
Jul 09 19:07:24.120661 ip-10-0-141-101 kubenswrapper[2557]: I0709 19:07:24.120632    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759z59mf_bb7936c5-2d07-45fb-9218-0f02762821a9/util/0.log"
Jul 09 19:07:24.127344 ip-10-0-141-101 kubenswrapper[2557]: I0709 19:07:24.127312    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759z59mf_bb7936c5-2d07-45fb-9218-0f02762821a9/pull/0.log"
Jul 09 19:07:24.133509 ip-10-0-141-101 kubenswrapper[2557]: I0709 19:07:24.133466    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759z59mf_bb7936c5-2d07-45fb-9218-0f02762821a9/extract/0.log"
Jul 09 19:07:24.244201 ip-10-0-141-101 kubenswrapper[2557]: I0709 19:07:24.244169    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06pfk9_9fcd5829-c13b-433d-b6dd-2231cf459986/util/0.log"
Jul 09 19:07:24.250897 ip-10-0-141-101 kubenswrapper[2557]: I0709 19:07:24.250870    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06pfk9_9fcd5829-c13b-433d-b6dd-2231cf459986/pull/0.log"
Jul 09 19:07:24.257720 ip-10-0-141-101 kubenswrapper[2557]: I0709 19:07:24.257702    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06pfk9_9fcd5829-c13b-433d-b6dd-2231cf459986/extract/0.log"
Jul 09 19:07:24.358749 ip-10-0-141-101 kubenswrapper[2557]: I0709 19:07:24.358712    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73jwjph_b2d1d39a-f96f-4def-b6c7-5907c96db401/util/0.log"
Jul 09 19:07:24.365977 ip-10-0-141-101 kubenswrapper[2557]: I0709 19:07:24.365947    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73jwjph_b2d1d39a-f96f-4def-b6c7-5907c96db401/pull/0.log"
Jul 09 19:07:24.372259 ip-10-0-141-101 kubenswrapper[2557]: I0709 19:07:24.372201    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73jwjph_b2d1d39a-f96f-4def-b6c7-5907c96db401/extract/0.log"
Jul 09 19:07:24.479584 ip-10-0-141-101 kubenswrapper[2557]: I0709 19:07:24.479553    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef157pns_ba169fcd-c12d-49ff-a78a-061890b87071/util/0.log"
Jul 09 19:07:24.485986 ip-10-0-141-101 kubenswrapper[2557]: I0709 19:07:24.485965    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef157pns_ba169fcd-c12d-49ff-a78a-061890b87071/pull/0.log"
Jul 09 19:07:24.492043 ip-10-0-141-101 kubenswrapper[2557]: I0709 19:07:24.492019    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef157pns_ba169fcd-c12d-49ff-a78a-061890b87071/extract/0.log"
Jul 09 19:07:24.730287 ip-10-0-141-101 kubenswrapper[2557]: I0709 19:07:24.730192    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-nkdv8_ba99975f-66eb-4352-8d60-9ceace209739/manager/0.log"
Jul 09 19:07:24.838195 ip-10-0-141-101 kubenswrapper[2557]: I0709 19:07:24.838159    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-8jl6k_c3e44384-6d57-4713-89d1-2d41653cc414/manager/0.log"
Jul 09 19:07:24.947074 ip-10-0-141-101 kubenswrapper[2557]: I0709 19:07:24.947042    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-sngwl_8c39c462-bc63-45ae-945f-a13f8125dca1/kuadrant-console-plugin/0.log"
Jul 09 19:07:25.069177 ip-10-0-141-101 kubenswrapper[2557]: I0709 19:07:25.069139    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-v47l9_5be2acbb-ba31-408f-b2ee-dcb60222b037/registry-server/0.log"
Jul 09 19:07:25.189599 ip-10-0-141-101 kubenswrapper[2557]: I0709 19:07:25.189554    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-dd6g2_1c4ee6ca-bfef-4241-b88c-3dd36fe5a9b9/manager/0.log"
Jul 09 19:07:25.433304 ip-10-0-141-101 kubenswrapper[2557]: I0709 19:07:25.433206    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-62lzk_bf1fe616-28b5-4d2d-8a60-12edebb94e20/manager/0.log"
Jul 09 19:07:25.770412 ip-10-0-141-101 kubenswrapper[2557]: I0709 19:07:25.770309    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4p2shw_c5871ddf-8389-4f6f-b9ee-16c0e02c0fbf/istio-proxy/0.log"
Jul 09 19:07:26.102662 ip-10-0-141-101 kubenswrapper[2557]: I0709 19:07:26.102634    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-668f4b5f87-jmmtk_e64bfe60-9c8b-4d07-8b1d-a4f4ad954f7f/kube-auth-proxy/0.log"
Jul 09 19:07:26.340766 ip-10-0-141-101 kubenswrapper[2557]: I0709 19:07:26.340709    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7964457696-hkf65_bfbc8e56-1bdb-4b9b-922e-21cb55f09548/payload-pre-processing/0.log"
Jul 09 19:07:26.896459 ip-10-0-141-101 kubenswrapper[2557]: I0709 19:07:26.896426    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-67d8d5d6d-h2fr9_4e83f83f-9b92-412b-883d-2c0e02eb3887/main/0.log"
Jul 09 19:07:27.002264 ip-10-0-141-101 kubenswrapper[2557]: I0709 19:07:27.002234    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-59975d69f9-x2d25_08babfa7-558f-4f57-8350-abb1351525a9/main/0.log"
Jul 09 19:07:33.890018 ip-10-0-141-101 kubenswrapper[2557]: I0709 19:07:33.889977    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-9f9j6_cdb7f3b5-f8db-4d3f-8067-371e5eda9f3e/global-pull-secret-syncer/0.log"
Jul 09 19:07:34.084267 ip-10-0-141-101 kubenswrapper[2557]: I0709 19:07:34.084238    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-v55vr_62a8b86b-6eaf-4e72-aa0b-2de8fa04ed16/konnectivity-agent/0.log"
Jul 09 19:07:34.153931 ip-10-0-141-101 kubenswrapper[2557]: I0709 19:07:34.153828    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-141-101.ec2.internal_b2c36589f62defe44458de06cdd5da38/haproxy/0.log"
Jul 09 19:07:37.617504 ip-10-0-141-101 kubenswrapper[2557]: I0709 19:07:37.617454    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759z59mf_bb7936c5-2d07-45fb-9218-0f02762821a9/extract/0.log"
Jul 09 19:07:37.642443 ip-10-0-141-101 kubenswrapper[2557]: I0709 19:07:37.642410    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759z59mf_bb7936c5-2d07-45fb-9218-0f02762821a9/util/0.log"
Jul 09 19:07:37.667359 ip-10-0-141-101 kubenswrapper[2557]: I0709 19:07:37.667323    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759z59mf_bb7936c5-2d07-45fb-9218-0f02762821a9/pull/0.log"
Jul 09 19:07:37.695224 ip-10-0-141-101 kubenswrapper[2557]: I0709 19:07:37.695193    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06pfk9_9fcd5829-c13b-433d-b6dd-2231cf459986/extract/0.log"
Jul 09 19:07:37.719424 ip-10-0-141-101 kubenswrapper[2557]: I0709 19:07:37.719378    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06pfk9_9fcd5829-c13b-433d-b6dd-2231cf459986/util/0.log"
Jul 09 19:07:37.744889 ip-10-0-141-101 kubenswrapper[2557]: I0709 19:07:37.744860    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06pfk9_9fcd5829-c13b-433d-b6dd-2231cf459986/pull/0.log"
Jul 09 19:07:37.775032 ip-10-0-141-101 kubenswrapper[2557]: I0709 19:07:37.774998    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73jwjph_b2d1d39a-f96f-4def-b6c7-5907c96db401/extract/0.log"
Jul 09 19:07:37.802643 ip-10-0-141-101 kubenswrapper[2557]: I0709 19:07:37.802613    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73jwjph_b2d1d39a-f96f-4def-b6c7-5907c96db401/util/0.log"
Jul 09 19:07:37.841152 ip-10-0-141-101 kubenswrapper[2557]: I0709 19:07:37.841105    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73jwjph_b2d1d39a-f96f-4def-b6c7-5907c96db401/pull/0.log"
Jul 09 19:07:37.872040 ip-10-0-141-101 kubenswrapper[2557]: I0709 19:07:37.871942    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef157pns_ba169fcd-c12d-49ff-a78a-061890b87071/extract/0.log"
Jul 09 19:07:37.894041 ip-10-0-141-101 kubenswrapper[2557]: I0709 19:07:37.894012    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef157pns_ba169fcd-c12d-49ff-a78a-061890b87071/util/0.log"
Jul 09 19:07:37.916772 ip-10-0-141-101 kubenswrapper[2557]: I0709 19:07:37.916741    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef157pns_ba169fcd-c12d-49ff-a78a-061890b87071/pull/0.log"
Jul 09 19:07:38.454340 ip-10-0-141-101 kubenswrapper[2557]: I0709 19:07:38.454306    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-nkdv8_ba99975f-66eb-4352-8d60-9ceace209739/manager/0.log"
Jul 09 19:07:38.502544 ip-10-0-141-101 kubenswrapper[2557]: I0709 19:07:38.502500    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-8jl6k_c3e44384-6d57-4713-89d1-2d41653cc414/manager/0.log"
Jul 09 19:07:38.531992 ip-10-0-141-101 kubenswrapper[2557]: I0709 19:07:38.531964    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-sngwl_8c39c462-bc63-45ae-945f-a13f8125dca1/kuadrant-console-plugin/0.log"
Jul 09 19:07:38.584618 ip-10-0-141-101 kubenswrapper[2557]: I0709 19:07:38.584588    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-v47l9_5be2acbb-ba31-408f-b2ee-dcb60222b037/registry-server/0.log"
Jul 09 19:07:38.755895 ip-10-0-141-101 kubenswrapper[2557]: I0709 19:07:38.755808    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-dd6g2_1c4ee6ca-bfef-4241-b88c-3dd36fe5a9b9/manager/0.log"
Jul 09 19:07:38.892187 ip-10-0-141-101 kubenswrapper[2557]: I0709 19:07:38.892157    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-62lzk_bf1fe616-28b5-4d2d-8a60-12edebb94e20/manager/0.log"
Jul 09 19:07:40.833495 ip-10-0-141-101 kubenswrapper[2557]: I0709 19:07:40.833421    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-785778ff74-h4zmb_8fd6226a-1b0a-4489-b160-ff87e0c0eb0b/kube-state-metrics/0.log"
Jul 09 19:07:40.856171 ip-10-0-141-101 kubenswrapper[2557]: I0709 19:07:40.856139    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-785778ff74-h4zmb_8fd6226a-1b0a-4489-b160-ff87e0c0eb0b/kube-rbac-proxy-main/0.log"
Jul 09 19:07:40.880213 ip-10-0-141-101 kubenswrapper[2557]: I0709 19:07:40.880187    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-785778ff74-h4zmb_8fd6226a-1b0a-4489-b160-ff87e0c0eb0b/kube-rbac-proxy-self/0.log"
Jul 09 19:07:40.912582 ip-10-0-141-101 kubenswrapper[2557]: I0709 19:07:40.912548    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-76ddf9975b-7s4fw_60679719-f3ae-4a26-9827-5a0293035317/metrics-server/0.log"
Jul 09 19:07:40.941544 ip-10-0-141-101 kubenswrapper[2557]: I0709 19:07:40.941514    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-5f68df7f58-9bstm_5f9f12a5-4aaf-46c8-8385-a9aac79713c2/monitoring-plugin/0.log"
Jul 09 19:07:41.172266 ip-10-0-141-101 kubenswrapper[2557]: I0709 19:07:41.172175    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-mtj54_6fb37314-ea4d-453b-9fe5-67adcdcc5536/node-exporter/0.log"
Jul 09 19:07:41.195473 ip-10-0-141-101 kubenswrapper[2557]: I0709 19:07:41.195444    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-mtj54_6fb37314-ea4d-453b-9fe5-67adcdcc5536/kube-rbac-proxy/0.log"
Jul 09 19:07:41.223409 ip-10-0-141-101 kubenswrapper[2557]: I0709 19:07:41.223386    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-mtj54_6fb37314-ea4d-453b-9fe5-67adcdcc5536/init-textfile/0.log"
Jul 09 19:07:41.542548 ip-10-0-141-101 kubenswrapper[2557]: I0709 19:07:41.542513    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-64785b6675-gsftd_84dab160-6562-45ea-bb84-50a0437b1ed5/prometheus-operator/0.log"
Jul 09 19:07:41.580804 ip-10-0-141-101 kubenswrapper[2557]: I0709 19:07:41.580770    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-64785b6675-gsftd_84dab160-6562-45ea-bb84-50a0437b1ed5/kube-rbac-proxy/0.log"
Jul 09 19:07:41.737207 ip-10-0-141-101 kubenswrapper[2557]: I0709 19:07:41.737172    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6cc9d89b54-r4pjf_a79d7993-1a36-4038-9893-d643dd8ce0c3/thanos-query/0.log"
Jul 09 19:07:41.760742 ip-10-0-141-101 kubenswrapper[2557]: I0709 19:07:41.760709    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6cc9d89b54-r4pjf_a79d7993-1a36-4038-9893-d643dd8ce0c3/kube-rbac-proxy-web/0.log"
Jul 09 19:07:41.786906 ip-10-0-141-101 kubenswrapper[2557]: I0709 19:07:41.786876    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6cc9d89b54-r4pjf_a79d7993-1a36-4038-9893-d643dd8ce0c3/kube-rbac-proxy/0.log"
Jul 09 19:07:41.817654 ip-10-0-141-101 kubenswrapper[2557]: I0709 19:07:41.817556    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6cc9d89b54-r4pjf_a79d7993-1a36-4038-9893-d643dd8ce0c3/prom-label-proxy/0.log"
Jul 09 19:07:41.845699 ip-10-0-141-101 kubenswrapper[2557]: I0709 19:07:41.845662    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6cc9d89b54-r4pjf_a79d7993-1a36-4038-9893-d643dd8ce0c3/kube-rbac-proxy-rules/0.log"
Jul 09 19:07:41.875620 ip-10-0-141-101 kubenswrapper[2557]: I0709 19:07:41.875591    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6cc9d89b54-r4pjf_a79d7993-1a36-4038-9893-d643dd8ce0c3/kube-rbac-proxy-metrics/0.log"
Jul 09 19:07:43.870145 ip-10-0-141-101 kubenswrapper[2557]: I0709 19:07:43.870101    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-9jbd2/perf-node-gather-daemonset-b869k"]
Jul 09 19:07:43.870753 ip-10-0-141-101 kubenswrapper[2557]: I0709 19:07:43.870733    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ac93bbf3-1a6f-40c1-8a13-482688a41e56" containerName="istio-proxy"
Jul 09 19:07:43.870753 ip-10-0-141-101 kubenswrapper[2557]: I0709 19:07:43.870754    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="ac93bbf3-1a6f-40c1-8a13-482688a41e56" containerName="istio-proxy"
Jul 09 19:07:43.870853 ip-10-0-141-101 kubenswrapper[2557]: I0709 19:07:43.870769    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="85ad84e3-8407-468f-8576-9e7d4f920947" containerName="test-curl-7662-139921169014624"
Jul 09 19:07:43.870853 ip-10-0-141-101 kubenswrapper[2557]: I0709 19:07:43.870775    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="85ad84e3-8407-468f-8576-9e7d4f920947" containerName="test-curl-7662-139921169014624"
Jul 09 19:07:43.870927 ip-10-0-141-101 kubenswrapper[2557]: I0709 19:07:43.870863    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="85ad84e3-8407-468f-8576-9e7d4f920947" containerName="test-curl-7662-139921169014624"
Jul 09 19:07:43.870927 ip-10-0-141-101 kubenswrapper[2557]: I0709 19:07:43.870871    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="ac93bbf3-1a6f-40c1-8a13-482688a41e56" containerName="istio-proxy"
Jul 09 19:07:43.870927 ip-10-0-141-101 kubenswrapper[2557]: I0709 19:07:43.870878    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="ac93bbf3-1a6f-40c1-8a13-482688a41e56" containerName="istio-proxy"
Jul 09 19:07:43.874101 ip-10-0-141-101 kubenswrapper[2557]: I0709 19:07:43.874083    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-9jbd2/perf-node-gather-daemonset-b869k"
Jul 09 19:07:43.876470 ip-10-0-141-101 kubenswrapper[2557]: I0709 19:07:43.876447    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-9jbd2\"/\"openshift-service-ca.crt\""
Jul 09 19:07:43.877540 ip-10-0-141-101 kubenswrapper[2557]: I0709 19:07:43.877519    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-9jbd2\"/\"default-dockercfg-pg4rv\""
Jul 09 19:07:43.877696 ip-10-0-141-101 kubenswrapper[2557]: I0709 19:07:43.877520    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-9jbd2\"/\"kube-root-ca.crt\""
Jul 09 19:07:43.884282 ip-10-0-141-101 kubenswrapper[2557]: I0709 19:07:43.884262    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-9jbd2/perf-node-gather-daemonset-b869k"]
Jul 09 19:07:43.961256 ip-10-0-141-101 kubenswrapper[2557]: I0709 19:07:43.961218    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/4f0ce42d-115d-4a71-bd17-5dfe1d310c75-proc\") pod \"perf-node-gather-daemonset-b869k\" (UID: \"4f0ce42d-115d-4a71-bd17-5dfe1d310c75\") " pod="openshift-must-gather-9jbd2/perf-node-gather-daemonset-b869k"
Jul 09 19:07:43.961256 ip-10-0-141-101 kubenswrapper[2557]: I0709 19:07:43.961257    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/4f0ce42d-115d-4a71-bd17-5dfe1d310c75-podres\") pod \"perf-node-gather-daemonset-b869k\" (UID: \"4f0ce42d-115d-4a71-bd17-5dfe1d310c75\") " pod="openshift-must-gather-9jbd2/perf-node-gather-daemonset-b869k"
Jul 09 19:07:43.961527 ip-10-0-141-101 kubenswrapper[2557]: I0709 19:07:43.961281    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4f0ce42d-115d-4a71-bd17-5dfe1d310c75-sys\") pod \"perf-node-gather-daemonset-b869k\" (UID: \"4f0ce42d-115d-4a71-bd17-5dfe1d310c75\") " pod="openshift-must-gather-9jbd2/perf-node-gather-daemonset-b869k"
Jul 09 19:07:43.961527 ip-10-0-141-101 kubenswrapper[2557]: I0709 19:07:43.961313    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/4f0ce42d-115d-4a71-bd17-5dfe1d310c75-lib-modules\") pod \"perf-node-gather-daemonset-b869k\" (UID: \"4f0ce42d-115d-4a71-bd17-5dfe1d310c75\") " pod="openshift-must-gather-9jbd2/perf-node-gather-daemonset-b869k"
Jul 09 19:07:43.961527 ip-10-0-141-101 kubenswrapper[2557]: I0709 19:07:43.961378    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g7h2b\" (UniqueName: \"kubernetes.io/projected/4f0ce42d-115d-4a71-bd17-5dfe1d310c75-kube-api-access-g7h2b\") pod \"perf-node-gather-daemonset-b869k\" (UID: \"4f0ce42d-115d-4a71-bd17-5dfe1d310c75\") " pod="openshift-must-gather-9jbd2/perf-node-gather-daemonset-b869k"
Jul 09 19:07:44.062346 ip-10-0-141-101 kubenswrapper[2557]: I0709 19:07:44.062301    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/4f0ce42d-115d-4a71-bd17-5dfe1d310c75-lib-modules\") pod \"perf-node-gather-daemonset-b869k\" (UID: \"4f0ce42d-115d-4a71-bd17-5dfe1d310c75\") " pod="openshift-must-gather-9jbd2/perf-node-gather-daemonset-b869k"
Jul 09 19:07:44.062585 ip-10-0-141-101 kubenswrapper[2557]: I0709 19:07:44.062405    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g7h2b\" (UniqueName: \"kubernetes.io/projected/4f0ce42d-115d-4a71-bd17-5dfe1d310c75-kube-api-access-g7h2b\") pod \"perf-node-gather-daemonset-b869k\" (UID: \"4f0ce42d-115d-4a71-bd17-5dfe1d310c75\") " pod="openshift-must-gather-9jbd2/perf-node-gather-daemonset-b869k"
Jul 09 19:07:44.062585 ip-10-0-141-101 kubenswrapper[2557]: I0709 19:07:44.062452    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/4f0ce42d-115d-4a71-bd17-5dfe1d310c75-proc\") pod \"perf-node-gather-daemonset-b869k\" (UID: \"4f0ce42d-115d-4a71-bd17-5dfe1d310c75\") " pod="openshift-must-gather-9jbd2/perf-node-gather-daemonset-b869k"
Jul 09 19:07:44.062585 ip-10-0-141-101 kubenswrapper[2557]: I0709 19:07:44.062510    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/4f0ce42d-115d-4a71-bd17-5dfe1d310c75-podres\") pod \"perf-node-gather-daemonset-b869k\" (UID: \"4f0ce42d-115d-4a71-bd17-5dfe1d310c75\") " pod="openshift-must-gather-9jbd2/perf-node-gather-daemonset-b869k"
Jul 09 19:07:44.062585 ip-10-0-141-101 kubenswrapper[2557]: I0709 19:07:44.062527    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/4f0ce42d-115d-4a71-bd17-5dfe1d310c75-lib-modules\") pod \"perf-node-gather-daemonset-b869k\" (UID: \"4f0ce42d-115d-4a71-bd17-5dfe1d310c75\") " pod="openshift-must-gather-9jbd2/perf-node-gather-daemonset-b869k"
Jul 09 19:07:44.062585 ip-10-0-141-101 kubenswrapper[2557]: I0709 19:07:44.062551    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4f0ce42d-115d-4a71-bd17-5dfe1d310c75-sys\") pod \"perf-node-gather-daemonset-b869k\" (UID: \"4f0ce42d-115d-4a71-bd17-5dfe1d310c75\") " pod="openshift-must-gather-9jbd2/perf-node-gather-daemonset-b869k"
Jul 09 19:07:44.062585 ip-10-0-141-101 kubenswrapper[2557]: I0709 19:07:44.062564    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/4f0ce42d-115d-4a71-bd17-5dfe1d310c75-proc\") pod \"perf-node-gather-daemonset-b869k\" (UID: \"4f0ce42d-115d-4a71-bd17-5dfe1d310c75\") " pod="openshift-must-gather-9jbd2/perf-node-gather-daemonset-b869k"
Jul 09 19:07:44.062862 ip-10-0-141-101 kubenswrapper[2557]: I0709 19:07:44.062640    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/4f0ce42d-115d-4a71-bd17-5dfe1d310c75-podres\") pod \"perf-node-gather-daemonset-b869k\" (UID: \"4f0ce42d-115d-4a71-bd17-5dfe1d310c75\") " pod="openshift-must-gather-9jbd2/perf-node-gather-daemonset-b869k"
Jul 09 19:07:44.062862 ip-10-0-141-101 kubenswrapper[2557]: I0709 19:07:44.062664    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4f0ce42d-115d-4a71-bd17-5dfe1d310c75-sys\") pod \"perf-node-gather-daemonset-b869k\" (UID: \"4f0ce42d-115d-4a71-bd17-5dfe1d310c75\") " pod="openshift-must-gather-9jbd2/perf-node-gather-daemonset-b869k"
Jul 09 19:07:44.072511 ip-10-0-141-101 kubenswrapper[2557]: I0709 19:07:44.072473    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g7h2b\" (UniqueName: \"kubernetes.io/projected/4f0ce42d-115d-4a71-bd17-5dfe1d310c75-kube-api-access-g7h2b\") pod \"perf-node-gather-daemonset-b869k\" (UID: \"4f0ce42d-115d-4a71-bd17-5dfe1d310c75\") " pod="openshift-must-gather-9jbd2/perf-node-gather-daemonset-b869k"
Jul 09 19:07:44.185969 ip-10-0-141-101 kubenswrapper[2557]: I0709 19:07:44.185872    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-9jbd2/perf-node-gather-daemonset-b869k"
Jul 09 19:07:44.327766 ip-10-0-141-101 kubenswrapper[2557]: I0709 19:07:44.327737    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-9jbd2/perf-node-gather-daemonset-b869k"]
Jul 09 19:07:44.329471 ip-10-0-141-101 kubenswrapper[2557]: W0709 19:07:44.329444    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod4f0ce42d_115d_4a71_bd17_5dfe1d310c75.slice/crio-44a3b53af976d8cb21fa83699716e2907286bced475363ac86c59d737011e8b2 WatchSource:0}: Error finding container 44a3b53af976d8cb21fa83699716e2907286bced475363ac86c59d737011e8b2: Status 404 returned error can't find the container with id 44a3b53af976d8cb21fa83699716e2907286bced475363ac86c59d737011e8b2
Jul 09 19:07:44.405087 ip-10-0-141-101 kubenswrapper[2557]: I0709 19:07:44.405061    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-7c5cbb5cf8-g8cbv_93607a99-1497-4335-8424-60a3df172946/console/0.log"
Jul 09 19:07:44.461559 ip-10-0-141-101 kubenswrapper[2557]: I0709 19:07:44.461452    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-9jbd2/perf-node-gather-daemonset-b869k" event={"ID":"4f0ce42d-115d-4a71-bd17-5dfe1d310c75","Type":"ContainerStarted","Data":"d06d15dc16a2c22c9d2993ce121bfcb55c4f0cb45e87f62d1913307fff8ad8a2"}
Jul 09 19:07:44.461559 ip-10-0-141-101 kubenswrapper[2557]: I0709 19:07:44.461549    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-9jbd2/perf-node-gather-daemonset-b869k"
Jul 09 19:07:44.461750 ip-10-0-141-101 kubenswrapper[2557]: I0709 19:07:44.461575    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-9jbd2/perf-node-gather-daemonset-b869k" event={"ID":"4f0ce42d-115d-4a71-bd17-5dfe1d310c75","Type":"ContainerStarted","Data":"44a3b53af976d8cb21fa83699716e2907286bced475363ac86c59d737011e8b2"}
Jul 09 19:07:44.478240 ip-10-0-141-101 kubenswrapper[2557]: I0709 19:07:44.478183    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-9jbd2/perf-node-gather-daemonset-b869k" podStartSLOduration=1.4781653829999999 podStartE2EDuration="1.478165383s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 19:07:43 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 19:07:44.477800948 +0000 UTC m=+2533.717145597" watchObservedRunningTime="2026-07-09 19:07:44.478165383 +0000 UTC m=+2533.717510021"
Jul 09 19:07:45.106440 ip-10-0-141-101 kubenswrapper[2557]: I0709 19:07:45.106407    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-78495597f6-286zp_4f171f20-0b3b-4ef7-a679-b3e58fa4d7cc/volume-data-source-validator/0.log"
Jul 09 19:07:46.291436 ip-10-0-141-101 kubenswrapper[2557]: I0709 19:07:46.291405    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-g8csp_7a9dd0f3-7cbc-4c47-b47a-14437182de3a/dns/0.log"
Jul 09 19:07:46.329996 ip-10-0-141-101 kubenswrapper[2557]: I0709 19:07:46.329965    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-g8csp_7a9dd0f3-7cbc-4c47-b47a-14437182de3a/kube-rbac-proxy/0.log"
Jul 09 19:07:46.496645 ip-10-0-141-101 kubenswrapper[2557]: I0709 19:07:46.496618    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-smljn_327c1eaf-28aa-4971-8053-7d3e67515edd/dns-node-resolver/0.log"
Jul 09 19:07:47.102681 ip-10-0-141-101 kubenswrapper[2557]: I0709 19:07:47.102646    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-76c8f744f7-855qg_e0e90d41-39dc-4348-b7b7-3eb634d9de4d/registry/0.log"
Jul 09 19:07:47.183906 ip-10-0-141-101 kubenswrapper[2557]: I0709 19:07:47.183877    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-w5wgl_cc49c9d1-6be4-487b-adf1-ee18094747b6/node-ca/0.log"
Jul 09 19:07:48.133608 ip-10-0-141-101 kubenswrapper[2557]: I0709 19:07:48.133577    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4p2shw_c5871ddf-8389-4f6f-b9ee-16c0e02c0fbf/istio-proxy/0.log"
Jul 09 19:07:48.382822 ip-10-0-141-101 kubenswrapper[2557]: I0709 19:07:48.382782    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-668f4b5f87-jmmtk_e64bfe60-9c8b-4d07-8b1d-a4f4ad954f7f/kube-auth-proxy/0.log"
Jul 09 19:07:48.523459 ip-10-0-141-101 kubenswrapper[2557]: I0709 19:07:48.523355    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7964457696-hkf65_bfbc8e56-1bdb-4b9b-922e-21cb55f09548/payload-pre-processing/0.log"
Jul 09 19:07:49.291363 ip-10-0-141-101 kubenswrapper[2557]: I0709 19:07:49.291327    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-6fcpf_0bf48160-eb5b-4cb4-abf8-eafde0baca56/serve-healthcheck-canary/0.log"
Jul 09 19:07:49.973386 ip-10-0-141-101 kubenswrapper[2557]: I0709 19:07:49.973346    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-lwdkv_d3f42221-8165-4208-aeb4-9a42c7769d2b/kube-rbac-proxy/0.log"
Jul 09 19:07:49.999264 ip-10-0-141-101 kubenswrapper[2557]: I0709 19:07:49.999233    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-lwdkv_d3f42221-8165-4208-aeb4-9a42c7769d2b/exporter/0.log"
Jul 09 19:07:50.025683 ip-10-0-141-101 kubenswrapper[2557]: I0709 19:07:50.025654    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-lwdkv_d3f42221-8165-4208-aeb4-9a42c7769d2b/extractor/0.log"
Jul 09 19:07:50.477567 ip-10-0-141-101 kubenswrapper[2557]: I0709 19:07:50.477537    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-9jbd2/perf-node-gather-daemonset-b869k"
Jul 09 19:07:52.380961 ip-10-0-141-101 kubenswrapper[2557]: I0709 19:07:52.380932    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-rxlvf_f8732a9f-c4ca-486b-bf37-8bf1f99ca897/manager/0.log"
Jul 09 19:07:52.632090 ip-10-0-141-101 kubenswrapper[2557]: I0709 19:07:52.632009    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-jqjtj_36545808-0daf-49b4-b2dc-76fea0005844/manager/0.log"
Jul 09 19:07:52.827554 ip-10-0-141-101 kubenswrapper[2557]: I0709 19:07:52.827528    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-4wffq_238eb895-3741-4a66-b2b4-8c2a64516a11/server/0.log"
Jul 09 19:07:53.119237 ip-10-0-141-101 kubenswrapper[2557]: I0709 19:07:53.119208    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-59f7885b79-nt2jx_fc118cf6-f01e-4901-9e18-279277549dc5/manager/0.log"
Jul 09 19:07:53.140545 ip-10-0-141-101 kubenswrapper[2557]: I0709 19:07:53.140520    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-59f7885b79-nt2jx_fc118cf6-f01e-4901-9e18-279277549dc5/copy-manifests/0.log"
Jul 09 19:07:54.222112 ip-10-0-141-101 kubenswrapper[2557]: I0709 19:07:54.222080    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4p2shw_c5871ddf-8389-4f6f-b9ee-16c0e02c0fbf/istio-proxy/0.log"
Jul 09 19:07:54.441935 ip-10-0-141-101 kubenswrapper[2557]: I0709 19:07:54.441904    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-668f4b5f87-jmmtk_e64bfe60-9c8b-4d07-8b1d-a4f4ad954f7f/kube-auth-proxy/0.log"
Jul 09 19:07:54.535825 ip-10-0-141-101 kubenswrapper[2557]: I0709 19:07:54.535798    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-fd8ccff4c-jcqbf_ad22e01b-90f3-4031-86d1-5b8faca477ca/openshift-lws-operator/0.log"
Jul 09 19:07:54.554548 ip-10-0-141-101 kubenswrapper[2557]: I0709 19:07:54.554509    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7964457696-hkf65_bfbc8e56-1bdb-4b9b-922e-21cb55f09548/payload-pre-processing/0.log"
Jul 09 19:07:55.873768 ip-10-0-141-101 kubenswrapper[2557]: I0709 19:07:55.873669    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4p2shw_c5871ddf-8389-4f6f-b9ee-16c0e02c0fbf/istio-proxy/0.log"
Jul 09 19:07:56.097240 ip-10-0-141-101 kubenswrapper[2557]: I0709 19:07:56.097207    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-668f4b5f87-jmmtk_e64bfe60-9c8b-4d07-8b1d-a4f4ad954f7f/kube-auth-proxy/0.log"
Jul 09 19:07:56.211444 ip-10-0-141-101 kubenswrapper[2557]: I0709 19:07:56.211347    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7964457696-hkf65_bfbc8e56-1bdb-4b9b-922e-21cb55f09548/payload-pre-processing/0.log"
Jul 09 19:07:59.644145 ip-10-0-141-101 kubenswrapper[2557]: I0709 19:07:59.644117    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-7f59b54f6c-gqqk7_6ceea004-b5ab-456b-b34a-476a78286530/migrator/0.log"
Jul 09 19:07:59.664455 ip-10-0-141-101 kubenswrapper[2557]: I0709 19:07:59.664428    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-7f59b54f6c-gqqk7_6ceea004-b5ab-456b-b34a-476a78286530/graceful-termination/0.log"
Jul 09 19:08:00.054241 ip-10-0-141-101 kubenswrapper[2557]: I0709 19:08:00.054207    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-799cb7f958-kqj92_d5871ae2-0cbd-4038-8269-6343110b7b56/kube-storage-version-migrator-operator/1.log"
Jul 09 19:08:00.055815 ip-10-0-141-101 kubenswrapper[2557]: I0709 19:08:00.055781    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-799cb7f958-kqj92_d5871ae2-0cbd-4038-8269-6343110b7b56/kube-storage-version-migrator-operator/0.log"