Jul 23 16:15:18.025463 ip-10-0-143-166 systemd[1]: Starting Kubernetes Kubelet...
Jul 23 16:15:18.415559 ip-10-0-143-166 kubenswrapper[2553]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 23 16:15:18.415559 ip-10-0-143-166 kubenswrapper[2553]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jul 23 16:15:18.415559 ip-10-0-143-166 kubenswrapper[2553]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 23 16:15:18.415559 ip-10-0-143-166 kubenswrapper[2553]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jul 23 16:15:18.416185 ip-10-0-143-166 kubenswrapper[2553]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 23 16:15:18.416470 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:18.416384    2553 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jul 23 16:15:18.421977 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:15:18.421955    2553 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 23 16:15:18.421977 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:15:18.421976    2553 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 23 16:15:18.421977 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:15:18.421980    2553 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 23 16:15:18.421977 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:15:18.421983    2553 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 23 16:15:18.422142 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:15:18.421986    2553 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 23 16:15:18.422142 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:15:18.421990    2553 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 23 16:15:18.422142 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:15:18.421992    2553 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 23 16:15:18.422142 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:15:18.421995    2553 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 23 16:15:18.422142 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:15:18.421997    2553 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 23 16:15:18.422142 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:15:18.422000    2553 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 23 16:15:18.422142 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:15:18.422003    2553 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 23 16:15:18.422142 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:15:18.422005    2553 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 23 16:15:18.422142 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:15:18.422008    2553 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 23 16:15:18.422142 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:15:18.422010    2553 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 23 16:15:18.422142 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:15:18.422013    2553 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 23 16:15:18.422142 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:15:18.422016    2553 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 23 16:15:18.422142 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:15:18.422018    2553 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 23 16:15:18.422142 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:15:18.422021    2553 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 23 16:15:18.422142 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:15:18.422024    2553 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 23 16:15:18.422142 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:15:18.422026    2553 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 23 16:15:18.422142 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:15:18.422029    2553 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 23 16:15:18.422142 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:15:18.422031    2553 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 23 16:15:18.422142 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:15:18.422034    2553 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 23 16:15:18.422142 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:15:18.422045    2553 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 23 16:15:18.422636 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:15:18.422048    2553 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 23 16:15:18.422636 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:15:18.422050    2553 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 23 16:15:18.422636 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:15:18.422053    2553 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 23 16:15:18.422636 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:15:18.422056    2553 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 23 16:15:18.422636 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:15:18.422058    2553 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 23 16:15:18.422636 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:15:18.422061    2553 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 23 16:15:18.422636 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:15:18.422063    2553 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 23 16:15:18.422636 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:15:18.422065    2553 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 23 16:15:18.422636 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:15:18.422068    2553 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 23 16:15:18.422636 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:15:18.422071    2553 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 23 16:15:18.422636 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:15:18.422075    2553 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 23 16:15:18.422636 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:15:18.422077    2553 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 23 16:15:18.422636 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:15:18.422080    2553 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 23 16:15:18.422636 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:15:18.422083    2553 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 23 16:15:18.422636 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:15:18.422086    2553 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 23 16:15:18.422636 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:15:18.422089    2553 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 23 16:15:18.422636 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:15:18.422091    2553 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 23 16:15:18.422636 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:15:18.422094    2553 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 23 16:15:18.422636 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:15:18.422096    2553 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 23 16:15:18.423133 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:15:18.422099    2553 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 23 16:15:18.423133 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:15:18.422102    2553 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 23 16:15:18.423133 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:15:18.422104    2553 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 23 16:15:18.423133 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:15:18.422107    2553 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 23 16:15:18.423133 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:15:18.422110    2553 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 23 16:15:18.423133 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:15:18.422112    2553 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 23 16:15:18.423133 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:15:18.422115    2553 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 23 16:15:18.423133 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:15:18.422117    2553 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 23 16:15:18.423133 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:15:18.422120    2553 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 23 16:15:18.423133 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:15:18.422123    2553 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 23 16:15:18.423133 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:15:18.422126    2553 feature_gate.go:328] unrecognized feature gate: Example2
Jul 23 16:15:18.423133 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:15:18.422128    2553 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 23 16:15:18.423133 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:15:18.422131    2553 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 23 16:15:18.423133 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:15:18.422133    2553 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 23 16:15:18.423133 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:15:18.422136    2553 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 23 16:15:18.423133 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:15:18.422139    2553 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 23 16:15:18.423133 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:15:18.422141    2553 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 23 16:15:18.423133 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:15:18.422146    2553 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 23 16:15:18.423133 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:15:18.422150    2553 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 23 16:15:18.423133 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:15:18.422153    2553 feature_gate.go:328] unrecognized feature gate: Example
Jul 23 16:15:18.423628 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:15:18.422156    2553 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 23 16:15:18.423628 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:15:18.422160    2553 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 23 16:15:18.423628 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:15:18.422178    2553 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 23 16:15:18.423628 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:15:18.422182    2553 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 23 16:15:18.423628 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:15:18.422185    2553 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 23 16:15:18.423628 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:15:18.422189    2553 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 23 16:15:18.423628 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:15:18.422192    2553 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 23 16:15:18.423628 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:15:18.422195    2553 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 23 16:15:18.423628 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:15:18.422198    2553 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 23 16:15:18.423628 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:15:18.422200    2553 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 23 16:15:18.423628 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:15:18.422203    2553 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 23 16:15:18.423628 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:15:18.422206    2553 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 23 16:15:18.423628 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:15:18.422208    2553 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 23 16:15:18.423628 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:15:18.422211    2553 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 23 16:15:18.423628 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:15:18.422214    2553 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 23 16:15:18.423628 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:15:18.422217    2553 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 23 16:15:18.423628 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:15:18.422219    2553 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 23 16:15:18.423628 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:15:18.422222    2553 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 23 16:15:18.423628 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:15:18.422224    2553 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 23 16:15:18.424088 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:15:18.422227    2553 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 23 16:15:18.424088 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:15:18.422230    2553 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 23 16:15:18.424088 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:15:18.422233    2553 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 23 16:15:18.424088 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:15:18.422235    2553 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 23 16:15:18.424088 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:15:18.422239    2553 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 23 16:15:18.424088 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:15:18.422242    2553 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 23 16:15:18.424088 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:15:18.422244    2553 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 23 16:15:18.424088 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:15:18.422247    2553 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 23 16:15:18.424088 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:15:18.422249    2553 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 23 16:15:18.424088 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:15:18.422252    2553 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 23 16:15:18.424088 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:15:18.422254    2553 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 23 16:15:18.424088 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:15:18.422257    2553 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 23 16:15:18.424088 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:15:18.422259    2553 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 23 16:15:18.424088 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:15:18.422262    2553 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 23 16:15:18.424088 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:15:18.422265    2553 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 23 16:15:18.424088 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:15:18.422267    2553 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 23 16:15:18.424088 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:15:18.422271    2553 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 23 16:15:18.424088 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:15:18.422967    2553 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 23 16:15:18.424088 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:15:18.422974    2553 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 23 16:15:18.424088 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:15:18.422977    2553 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 23 16:15:18.424577 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:15:18.422981    2553 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 23 16:15:18.424577 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:15:18.422984    2553 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 23 16:15:18.424577 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:15:18.422987    2553 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 23 16:15:18.424577 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:15:18.422989    2553 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 23 16:15:18.424577 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:15:18.422992    2553 feature_gate.go:328] unrecognized feature gate: Example
Jul 23 16:15:18.424577 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:15:18.422994    2553 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 23 16:15:18.424577 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:15:18.422996    2553 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 23 16:15:18.424577 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:15:18.423001    2553 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 23 16:15:18.424577 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:15:18.423005    2553 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 23 16:15:18.424577 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:15:18.423007    2553 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 23 16:15:18.424577 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:15:18.423010    2553 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 23 16:15:18.424577 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:15:18.423012    2553 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 23 16:15:18.424577 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:15:18.423015    2553 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 23 16:15:18.424577 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:15:18.423017    2553 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 23 16:15:18.424577 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:15:18.423021    2553 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 23 16:15:18.424577 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:15:18.423023    2553 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 23 16:15:18.424577 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:15:18.423026    2553 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 23 16:15:18.424577 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:15:18.423030    2553 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 23 16:15:18.424577 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:15:18.423034    2553 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 23 16:15:18.425036 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:15:18.423036    2553 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 23 16:15:18.425036 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:15:18.423039    2553 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 23 16:15:18.425036 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:15:18.423041    2553 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 23 16:15:18.425036 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:15:18.423044    2553 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 23 16:15:18.425036 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:15:18.423046    2553 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 23 16:15:18.425036 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:15:18.423049    2553 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 23 16:15:18.425036 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:15:18.423051    2553 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 23 16:15:18.425036 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:15:18.423054    2553 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 23 16:15:18.425036 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:15:18.423056    2553 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 23 16:15:18.425036 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:15:18.423059    2553 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 23 16:15:18.425036 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:15:18.423061    2553 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 23 16:15:18.425036 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:15:18.423064    2553 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 23 16:15:18.425036 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:15:18.423067    2553 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 23 16:15:18.425036 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:15:18.423070    2553 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 23 16:15:18.425036 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:15:18.423072    2553 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 23 16:15:18.425036 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:15:18.423075    2553 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 23 16:15:18.425036 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:15:18.423077    2553 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 23 16:15:18.425036 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:15:18.423080    2553 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 23 16:15:18.425036 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:15:18.423082    2553 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 23 16:15:18.425036 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:15:18.423085    2553 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 23 16:15:18.425535 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:15:18.423088    2553 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 23 16:15:18.425535 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:15:18.423090    2553 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 23 16:15:18.425535 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:15:18.423093    2553 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 23 16:15:18.425535 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:15:18.423095    2553 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 23 16:15:18.425535 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:15:18.423098    2553 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 23 16:15:18.425535 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:15:18.423101    2553 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 23 16:15:18.425535 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:15:18.423103    2553 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 23 16:15:18.425535 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:15:18.423106    2553 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 23 16:15:18.425535 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:15:18.423108    2553 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 23 16:15:18.425535 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:15:18.423111    2553 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 23 16:15:18.425535 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:15:18.423115    2553 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 23 16:15:18.425535 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:15:18.423117    2553 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 23 16:15:18.425535 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:15:18.423119    2553 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 23 16:15:18.425535 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:15:18.423122    2553 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 23 16:15:18.425535 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:15:18.423125    2553 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 23 16:15:18.425535 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:15:18.423127    2553 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 23 16:15:18.425535 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:15:18.423130    2553 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 23 16:15:18.425535 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:15:18.423132    2553 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 23 16:15:18.425535 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:15:18.423135    2553 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 23 16:15:18.425535 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:15:18.423138    2553 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 23 16:15:18.425535 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:15:18.423140    2553 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 23 16:15:18.426055 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:15:18.423143    2553 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 23 16:15:18.426055 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:15:18.423148    2553 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 23 16:15:18.426055 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:15:18.423152    2553 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 23 16:15:18.426055 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:15:18.423157    2553 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 23 16:15:18.426055 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:15:18.423160    2553 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 23 16:15:18.426055 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:15:18.423179    2553 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 23 16:15:18.426055 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:15:18.423183    2553 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 23 16:15:18.426055 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:15:18.423185    2553 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 23 16:15:18.426055 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:15:18.423188    2553 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 23 16:15:18.426055 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:15:18.423191    2553 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 23 16:15:18.426055 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:15:18.423193    2553 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 23 16:15:18.426055 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:15:18.423196    2553 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 23 16:15:18.426055 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:15:18.423198    2553 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 23 16:15:18.426055 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:15:18.423201    2553 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 23 16:15:18.426055 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:15:18.423203    2553 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 23 16:15:18.426055 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:15:18.423206    2553 feature_gate.go:328] unrecognized feature gate: Example2
Jul 23 16:15:18.426055 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:15:18.423209    2553 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 23 16:15:18.426055 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:15:18.423211    2553 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 23 16:15:18.426055 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:15:18.423214    2553 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 23 16:15:18.426535 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:15:18.423216    2553 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 23 16:15:18.426535 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:15:18.423223    2553 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 23 16:15:18.426535 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:15:18.423226    2553 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 23 16:15:18.426535 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:15:18.423228    2553 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 23 16:15:18.426535 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:15:18.423231    2553 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 23 16:15:18.426535 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:15:18.423233    2553 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 23 16:15:18.426535 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:15:18.423236    2553 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 23 16:15:18.426535 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:15:18.423238    2553 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 23 16:15:18.426535 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:15:18.423241    2553 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 23 16:15:18.426535 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:15:18.423243    2553 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 23 16:15:18.426535 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:15:18.423245    2553 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 23 16:15:18.426535 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:15:18.423248    2553 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 23 16:15:18.426535 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:15:18.423251    2553 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 23 16:15:18.426535 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:15:18.423253    2553 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 23 16:15:18.426535 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:15:18.423256    2553 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 23 16:15:18.426535 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:15:18.423258    2553 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 23 16:15:18.426535 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:15:18.423261    2553 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 23 16:15:18.426535 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:15:18.423649    2553 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 23 16:15:18.426535 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:15:18.423654    2553 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 23 16:15:18.426535 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:15:18.423657    2553 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 23 16:15:18.427053 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:15:18.423660    2553 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 23 16:15:18.427053 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:15:18.423662    2553 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 23 16:15:18.427053 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:15:18.423665    2553 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 23 16:15:18.427053 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:15:18.423668    2553 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 23 16:15:18.427053 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:15:18.423670    2553 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 23 16:15:18.427053 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:15:18.423673    2553 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 23 16:15:18.427053 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:15:18.423675    2553 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 23 16:15:18.427053 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:15:18.423678    2553 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 23 16:15:18.427053 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:15:18.423682    2553 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 23 16:15:18.427053 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:15:18.423686    2553 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 23 16:15:18.427053 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:15:18.423689    2553 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 23 16:15:18.427053 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:15:18.423692    2553 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 23 16:15:18.427053 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:15:18.423695    2553 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 23 16:15:18.427053 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:15:18.423698    2553 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 23 16:15:18.427053 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:15:18.423701    2553 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 23 16:15:18.427053 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:15:18.423704    2553 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 23 16:15:18.427053 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:15:18.423707    2553 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 23 16:15:18.427053 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:15:18.423709    2553 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 23 16:15:18.427053 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:15:18.423712    2553 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 23 16:15:18.427524 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:15:18.423714    2553 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 23 16:15:18.427524 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:15:18.423717    2553 feature_gate.go:328] unrecognized feature gate: Example2
Jul 23 16:15:18.427524 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:15:18.423720    2553 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 23 16:15:18.427524 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:15:18.423723    2553 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 23 16:15:18.427524 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:15:18.423725    2553 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 23 16:15:18.427524 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:15:18.423728    2553 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 23 16:15:18.427524 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:15:18.423730    2553 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 23 16:15:18.427524 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:15:18.423733    2553 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 23 16:15:18.427524 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:15:18.423736    2553 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 23 16:15:18.427524 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:15:18.423738    2553 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 23 16:15:18.427524 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:15:18.423741    2553 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 23 16:15:18.427524 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:15:18.423744    2553 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 23 16:15:18.427524 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:15:18.423746    2553 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 23 16:15:18.427524 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:15:18.423748    2553 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 23 16:15:18.427524 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:15:18.423751    2553 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 23 16:15:18.427524 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:15:18.423753    2553 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 23 16:15:18.427524 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:15:18.423756    2553 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 23 16:15:18.427524 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:15:18.423758    2553 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 23 16:15:18.427524 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:15:18.423761    2553 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 23 16:15:18.427524 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:15:18.423763    2553 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 23 16:15:18.428011 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:15:18.423765    2553 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 23 16:15:18.428011 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:15:18.423768    2553 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 23 16:15:18.428011 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:15:18.423770    2553 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 23 16:15:18.428011 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:15:18.423773    2553 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 23 16:15:18.428011 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:15:18.423775    2553 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 23 16:15:18.428011 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:15:18.423778    2553 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 23 16:15:18.428011 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:15:18.423781    2553 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 23 16:15:18.428011 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:15:18.423784    2553 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 23 16:15:18.428011 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:15:18.423786    2553 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 23 16:15:18.428011 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:15:18.423789    2553 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 23 16:15:18.428011 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:15:18.423791    2553 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 23 16:15:18.428011 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:15:18.423794    2553 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 23 16:15:18.428011 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:15:18.423796    2553 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 23 16:15:18.428011 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:15:18.423799    2553 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 23 16:15:18.428011 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:15:18.423802    2553 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 23 16:15:18.428011 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:15:18.423804    2553 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 23 16:15:18.428011 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:15:18.423807    2553 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 23 16:15:18.428011 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:15:18.423810    2553 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 23 16:15:18.428011 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:15:18.423813    2553 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 23 16:15:18.428504 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:15:18.423816    2553 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 23 16:15:18.428504 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:15:18.423819    2553 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 23 16:15:18.428504 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:15:18.423822    2553 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 23 16:15:18.428504 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:15:18.423824    2553 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 23 16:15:18.428504 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:15:18.423826    2553 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 23 16:15:18.428504 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:15:18.423829    2553 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 23 16:15:18.428504 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:15:18.423831    2553 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 23 16:15:18.428504 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:15:18.423834    2553 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 23 16:15:18.428504 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:15:18.423836    2553 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 23 16:15:18.428504 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:15:18.423839    2553 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 23 16:15:18.428504 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:15:18.423843    2553 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 23 16:15:18.428504 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:15:18.423845    2553 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 23 16:15:18.428504 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:15:18.423848    2553 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 23 16:15:18.428504 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:15:18.423850    2553 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 23 16:15:18.428504 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:15:18.423852    2553 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 23 16:15:18.428504 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:15:18.423855    2553 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 23 16:15:18.428504 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:15:18.423857    2553 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 23 16:15:18.428504 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:15:18.423860    2553 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 23 16:15:18.428504 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:15:18.423863    2553 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 23 16:15:18.428504 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:15:18.423865    2553 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 23 16:15:18.428979 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:15:18.423868    2553 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 23 16:15:18.428979 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:15:18.423870    2553 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 23 16:15:18.428979 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:15:18.423873    2553 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 23 16:15:18.428979 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:15:18.423875    2553 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 23 16:15:18.428979 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:15:18.423878    2553 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 23 16:15:18.428979 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:15:18.423882    2553 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 23 16:15:18.428979 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:15:18.423885    2553 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 23 16:15:18.428979 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:15:18.423887    2553 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 23 16:15:18.428979 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:15:18.423890    2553 feature_gate.go:328] unrecognized feature gate: Example
Jul 23 16:15:18.428979 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:15:18.423892    2553 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 23 16:15:18.428979 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:15:18.423895    2553 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 23 16:15:18.428979 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:15:18.423899    2553 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 23 16:15:18.428979 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:15:18.423901    2553 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 23 16:15:18.428979 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:15:18.423904    2553 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 23 16:15:18.428979 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:15:18.423907    2553 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 23 16:15:18.428979 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:15:18.423910    2553 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 23 16:15:18.428979 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:15:18.423914    2553 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 23 16:15:18.428979 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:15:18.423917    2553 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 23 16:15:18.428979 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:18.423990    2553 flags.go:64] FLAG: --address="0.0.0.0"
Jul 23 16:15:18.428979 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:18.423997    2553 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jul 23 16:15:18.429479 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:18.424003    2553 flags.go:64] FLAG: --anonymous-auth="true"
Jul 23 16:15:18.429479 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:18.424008    2553 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jul 23 16:15:18.429479 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:18.424012    2553 flags.go:64] FLAG: --authentication-token-webhook="false"
Jul 23 16:15:18.429479 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:18.424016    2553 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jul 23 16:15:18.429479 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:18.424021    2553 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jul 23 16:15:18.429479 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:18.424025    2553 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jul 23 16:15:18.429479 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:18.424028    2553 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jul 23 16:15:18.429479 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:18.424031    2553 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jul 23 16:15:18.429479 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:18.424034    2553 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jul 23 16:15:18.429479 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:18.424038    2553 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jul 23 16:15:18.429479 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:18.424041    2553 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jul 23 16:15:18.429479 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:18.424044    2553 flags.go:64] FLAG: --cgroup-root=""
Jul 23 16:15:18.429479 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:18.424046    2553 flags.go:64] FLAG: --cgroups-per-qos="true"
Jul 23 16:15:18.429479 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:18.424050    2553 flags.go:64] FLAG: --client-ca-file=""
Jul 23 16:15:18.429479 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:18.424057    2553 flags.go:64] FLAG: --cloud-provider="external"
Jul 23 16:15:18.429479 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:18.424060    2553 flags.go:64] FLAG: --cluster-dns="[]"
Jul 23 16:15:18.429479 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:18.424065    2553 flags.go:64] FLAG: --cluster-domain=""
Jul 23 16:15:18.429479 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:18.424069    2553 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jul 23 16:15:18.429479 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:18.424072    2553 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jul 23 16:15:18.429479 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:18.424075    2553 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jul 23 16:15:18.429479 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:18.424079    2553 flags.go:64] FLAG: --container-log-max-files="5"
Jul 23 16:15:18.429479 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:18.424083    2553 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jul 23 16:15:18.429479 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:18.424085    2553 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jul 23 16:15:18.430091 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:18.424090    2553 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jul 23 16:15:18.430091 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:18.424094    2553 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jul 23 16:15:18.430091 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:18.424097    2553 flags.go:64] FLAG: --contention-profiling="false"
Jul 23 16:15:18.430091 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:18.424100    2553 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jul 23 16:15:18.430091 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:18.424103    2553 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jul 23 16:15:18.430091 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:18.424106    2553 flags.go:64] FLAG: --cpu-manager-policy="none"
Jul 23 16:15:18.430091 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:18.424109    2553 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jul 23 16:15:18.430091 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:18.424113    2553 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jul 23 16:15:18.430091 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:18.424116    2553 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jul 23 16:15:18.430091 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:18.424119    2553 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jul 23 16:15:18.430091 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:18.424122    2553 flags.go:64] FLAG: --enable-load-reader="false"
Jul 23 16:15:18.430091 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:18.424125    2553 flags.go:64] FLAG: --enable-server="true"
Jul 23 16:15:18.430091 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:18.424127    2553 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jul 23 16:15:18.430091 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:18.424132    2553 flags.go:64] FLAG: --event-burst="100"
Jul 23 16:15:18.430091 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:18.424135    2553 flags.go:64] FLAG: --event-qps="50"
Jul 23 16:15:18.430091 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:18.424138    2553 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jul 23 16:15:18.430091 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:18.424140    2553 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jul 23 16:15:18.430091 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:18.424144    2553 flags.go:64] FLAG: --eviction-hard=""
Jul 23 16:15:18.430091 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:18.424147    2553 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jul 23 16:15:18.430091 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:18.424150    2553 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jul 23 16:15:18.430091 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:18.424153    2553 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jul 23 16:15:18.430091 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:18.424156    2553 flags.go:64] FLAG: --eviction-soft=""
Jul 23 16:15:18.430091 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:18.424159    2553 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jul 23 16:15:18.430091 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:18.424161    2553 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jul 23 16:15:18.430091 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:18.424178    2553 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jul 23 16:15:18.430737 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:18.424181    2553 flags.go:64] FLAG: --experimental-mounter-path=""
Jul 23 16:15:18.430737 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:18.424185    2553 flags.go:64] FLAG: --fail-cgroupv1="false"
Jul 23 16:15:18.430737 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:18.424188    2553 flags.go:64] FLAG: --fail-swap-on="true"
Jul 23 16:15:18.430737 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:18.424191    2553 flags.go:64] FLAG: --feature-gates=""
Jul 23 16:15:18.430737 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:18.424194    2553 flags.go:64] FLAG: --file-check-frequency="20s"
Jul 23 16:15:18.430737 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:18.424197    2553 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jul 23 16:15:18.430737 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:18.424200    2553 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jul 23 16:15:18.430737 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:18.424205    2553 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jul 23 16:15:18.430737 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:18.424208    2553 flags.go:64] FLAG: --healthz-port="10248"
Jul 23 16:15:18.430737 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:18.424211    2553 flags.go:64] FLAG: --help="false"
Jul 23 16:15:18.430737 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:18.424214    2553 flags.go:64] FLAG: --hostname-override="ip-10-0-143-166.ec2.internal"
Jul 23 16:15:18.430737 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:18.424217    2553 flags.go:64] FLAG: --housekeeping-interval="10s"
Jul 23 16:15:18.430737 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:18.424220    2553 flags.go:64] FLAG: --http-check-frequency="20s"
Jul 23 16:15:18.430737 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:18.424223    2553 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jul 23 16:15:18.430737 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:18.424226    2553 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jul 23 16:15:18.430737 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:18.424229    2553 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jul 23 16:15:18.430737 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:18.424232    2553 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jul 23 16:15:18.430737 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:18.424235    2553 flags.go:64] FLAG: --image-service-endpoint=""
Jul 23 16:15:18.430737 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:18.424238    2553 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jul 23 16:15:18.430737 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:18.424240    2553 flags.go:64] FLAG: --kube-api-burst="100"
Jul 23 16:15:18.430737 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:18.424243    2553 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jul 23 16:15:18.430737 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:18.424247    2553 flags.go:64] FLAG: --kube-api-qps="50"
Jul 23 16:15:18.430737 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:18.424249    2553 flags.go:64] FLAG: --kube-reserved=""
Jul 23 16:15:18.430737 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:18.424252    2553 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jul 23 16:15:18.431324 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:18.424255    2553 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jul 23 16:15:18.431324 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:18.424258    2553 flags.go:64] FLAG: --kubelet-cgroups=""
Jul 23 16:15:18.431324 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:18.424261    2553 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jul 23 16:15:18.431324 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:18.424264    2553 flags.go:64] FLAG: --lock-file=""
Jul 23 16:15:18.431324 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:18.424266    2553 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jul 23 16:15:18.431324 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:18.424269    2553 flags.go:64] FLAG: --log-flush-frequency="5s"
Jul 23 16:15:18.431324 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:18.424272    2553 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jul 23 16:15:18.431324 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:18.424277    2553 flags.go:64] FLAG: --log-json-split-stream="false"
Jul 23 16:15:18.431324 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:18.424281    2553 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jul 23 16:15:18.431324 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:18.424284    2553 flags.go:64] FLAG: --log-text-split-stream="false"
Jul 23 16:15:18.431324 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:18.424286    2553 flags.go:64] FLAG: --logging-format="text"
Jul 23 16:15:18.431324 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:18.424289    2553 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jul 23 16:15:18.431324 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:18.424292    2553 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jul 23 16:15:18.431324 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:18.424295    2553 flags.go:64] FLAG: --manifest-url=""
Jul 23 16:15:18.431324 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:18.424298    2553 flags.go:64] FLAG: --manifest-url-header=""
Jul 23 16:15:18.431324 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:18.424303    2553 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jul 23 16:15:18.431324 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:18.424306    2553 flags.go:64] FLAG: --max-open-files="1000000"
Jul 23 16:15:18.431324 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:18.424310    2553 flags.go:64] FLAG: --max-pods="110"
Jul 23 16:15:18.431324 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:18.424313    2553 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jul 23 16:15:18.431324 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:18.424316    2553 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jul 23 16:15:18.431324 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:18.424319    2553 flags.go:64] FLAG: --memory-manager-policy="None"
Jul 23 16:15:18.431324 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:18.424322    2553 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jul 23 16:15:18.431324 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:18.424325    2553 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jul 23 16:15:18.431324 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:18.424328    2553 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jul 23 16:15:18.431324 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:18.424331    2553 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jul 23 16:15:18.431927 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:18.424339    2553 flags.go:64] FLAG: --node-status-max-images="50"
Jul 23 16:15:18.431927 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:18.424342    2553 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jul 23 16:15:18.431927 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:18.424345    2553 flags.go:64] FLAG: --oom-score-adj="-999"
Jul 23 16:15:18.431927 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:18.424348    2553 flags.go:64] FLAG: --pod-cidr=""
Jul 23 16:15:18.431927 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:18.424350    2553 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4017e99d76d7b91598d3a3430cd0eba6eda8b33653addd3838fdfe3cca69c5a0"
Jul 23 16:15:18.431927 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:18.424356    2553 flags.go:64] FLAG: --pod-manifest-path=""
Jul 23 16:15:18.431927 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:18.424359    2553 flags.go:64] FLAG: --pod-max-pids="-1"
Jul 23 16:15:18.431927 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:18.424362    2553 flags.go:64] FLAG: --pods-per-core="0"
Jul 23 16:15:18.431927 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:18.424364    2553 flags.go:64] FLAG: --port="10250"
Jul 23 16:15:18.431927 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:18.424367    2553 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jul 23 16:15:18.431927 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:18.424371    2553 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-056124ce86c248bfd"
Jul 23 16:15:18.431927 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:18.424374    2553 flags.go:64] FLAG: --qos-reserved=""
Jul 23 16:15:18.431927 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:18.424377    2553 flags.go:64] FLAG: --read-only-port="10255"
Jul 23 16:15:18.431927 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:18.424380    2553 flags.go:64] FLAG: --register-node="true"
Jul 23 16:15:18.431927 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:18.424382    2553 flags.go:64] FLAG: --register-with-taints=""
Jul 23 16:15:18.431927 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:18.424386    2553 flags.go:64] FLAG: --registry-burst="10"
Jul 23 16:15:18.431927 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:18.424390    2553 flags.go:64] FLAG: --registry-qps="5"
Jul 23 16:15:18.431927 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:18.424392    2553 flags.go:64] FLAG: --reserved-cpus=""
Jul 23 16:15:18.431927 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:18.424395    2553 flags.go:64] FLAG: --reserved-memory=""
Jul 23 16:15:18.431927 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:18.424399    2553 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jul 23 16:15:18.431927 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:18.424401    2553 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jul 23 16:15:18.431927 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:18.424405    2553 flags.go:64] FLAG: --rotate-certificates="false"
Jul 23 16:15:18.431927 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:18.424408    2553 flags.go:64] FLAG: --rotate-server-certificates="false"
Jul 23 16:15:18.431927 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:18.424413    2553 flags.go:64] FLAG: --runonce="false"
Jul 23 16:15:18.431927 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:18.424415    2553 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jul 23 16:15:18.432558 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:18.424418    2553 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jul 23 16:15:18.432558 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:18.424421    2553 flags.go:64] FLAG: --seccomp-default="false"
Jul 23 16:15:18.432558 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:18.424424    2553 flags.go:64] FLAG: --serialize-image-pulls="true"
Jul 23 16:15:18.432558 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:18.424427    2553 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jul 23 16:15:18.432558 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:18.424430    2553 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jul 23 16:15:18.432558 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:18.424432    2553 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jul 23 16:15:18.432558 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:18.424436    2553 flags.go:64] FLAG: --storage-driver-password="root"
Jul 23 16:15:18.432558 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:18.424438    2553 flags.go:64] FLAG: --storage-driver-secure="false"
Jul 23 16:15:18.432558 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:18.424441    2553 flags.go:64] FLAG: --storage-driver-table="stats"
Jul 23 16:15:18.432558 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:18.424444    2553 flags.go:64] FLAG: --storage-driver-user="root"
Jul 23 16:15:18.432558 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:18.424447    2553 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jul 23 16:15:18.432558 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:18.424450    2553 flags.go:64] FLAG: --sync-frequency="1m0s"
Jul 23 16:15:18.432558 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:18.424453    2553 flags.go:64] FLAG: --system-cgroups=""
Jul 23 16:15:18.432558 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:18.424456    2553 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jul 23 16:15:18.432558 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:18.424461    2553 flags.go:64] FLAG: --system-reserved-cgroup=""
Jul 23 16:15:18.432558 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:18.424463    2553 flags.go:64] FLAG: --tls-cert-file=""
Jul 23 16:15:18.432558 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:18.424466    2553 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jul 23 16:15:18.432558 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:18.424471    2553 flags.go:64] FLAG: --tls-min-version=""
Jul 23 16:15:18.432558 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:18.424474    2553 flags.go:64] FLAG: --tls-private-key-file=""
Jul 23 16:15:18.432558 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:18.424476    2553 flags.go:64] FLAG: --topology-manager-policy="none"
Jul 23 16:15:18.432558 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:18.424479    2553 flags.go:64] FLAG: --topology-manager-policy-options=""
Jul 23 16:15:18.432558 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:18.424482    2553 flags.go:64] FLAG: --topology-manager-scope="container"
Jul 23 16:15:18.432558 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:18.424485    2553 flags.go:64] FLAG: --v="2"
Jul 23 16:15:18.432558 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:18.424489    2553 flags.go:64] FLAG: --version="false"
Jul 23 16:15:18.432558 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:18.424494    2553 flags.go:64] FLAG: --vmodule=""
Jul 23 16:15:18.433191 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:18.424497    2553 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jul 23 16:15:18.433191 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:18.424500    2553 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jul 23 16:15:18.433191 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:15:18.424617    2553 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 23 16:15:18.433191 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:15:18.424621    2553 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 23 16:15:18.433191 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:15:18.424624    2553 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 23 16:15:18.433191 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:15:18.424629    2553 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 23 16:15:18.433191 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:15:18.424631    2553 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 23 16:15:18.433191 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:15:18.424635    2553 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 23 16:15:18.433191 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:15:18.424639    2553 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 23 16:15:18.433191 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:15:18.424643    2553 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 23 16:15:18.433191 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:15:18.424647    2553 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 23 16:15:18.433191 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:15:18.424650    2553 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 23 16:15:18.433191 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:15:18.424653    2553 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 23 16:15:18.433191 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:15:18.424656    2553 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 23 16:15:18.433191 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:15:18.424659    2553 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 23 16:15:18.433191 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:15:18.424663    2553 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 23 16:15:18.433191 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:15:18.424666    2553 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 23 16:15:18.433191 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:15:18.424668    2553 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 23 16:15:18.433191 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:15:18.424671    2553 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 23 16:15:18.433761 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:15:18.424674    2553 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 23 16:15:18.433761 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:15:18.424683    2553 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 23 16:15:18.433761 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:15:18.424687    2553 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 23 16:15:18.433761 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:15:18.424689    2553 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 23 16:15:18.433761 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:15:18.424692    2553 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 23 16:15:18.433761 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:15:18.424695    2553 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 23 16:15:18.433761 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:15:18.424698    2553 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 23 16:15:18.433761 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:15:18.424700    2553 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 23 16:15:18.433761 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:15:18.424703    2553 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 23 16:15:18.433761 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:15:18.424706    2553 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 23 16:15:18.433761 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:15:18.424708    2553 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 23 16:15:18.433761 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:15:18.424711    2553 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 23 16:15:18.433761 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:15:18.424713    2553 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 23 16:15:18.433761 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:15:18.424717    2553 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 23 16:15:18.433761 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:15:18.424720    2553 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 23 16:15:18.433761 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:15:18.424722    2553 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 23 16:15:18.433761 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:15:18.424725    2553 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 23 16:15:18.433761 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:15:18.424728    2553 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 23 16:15:18.433761 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:15:18.424733    2553 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 23 16:15:18.433761 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:15:18.424736    2553 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 23 16:15:18.434357 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:15:18.424738    2553 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 23 16:15:18.434357 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:15:18.424741    2553 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 23 16:15:18.434357 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:15:18.424743    2553 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 23 16:15:18.434357 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:15:18.424746    2553 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 23 16:15:18.434357 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:15:18.424748    2553 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 23 16:15:18.434357 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:15:18.424751    2553 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 23 16:15:18.434357 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:15:18.424754    2553 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 23 16:15:18.434357 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:15:18.424756    2553 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 23 16:15:18.434357 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:15:18.424760    2553 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 23 16:15:18.434357 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:15:18.424763    2553 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 23 16:15:18.434357 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:15:18.424766    2553 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 23 16:15:18.434357 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:15:18.424768    2553 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 23 16:15:18.434357 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:15:18.424771    2553 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 23 16:15:18.434357 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:15:18.424773    2553 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 23 16:15:18.434357 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:15:18.424776    2553 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 23 16:15:18.434357 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:15:18.424778    2553 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 23 16:15:18.434357 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:15:18.424781    2553 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 23 16:15:18.434357 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:15:18.424783    2553 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 23 16:15:18.434357 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:15:18.424786    2553 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 23 16:15:18.434357 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:15:18.424788    2553 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 23 16:15:18.434841 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:15:18.424791    2553 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 23 16:15:18.434841 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:15:18.424793    2553 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 23 16:15:18.434841 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:15:18.424796    2553 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 23 16:15:18.434841 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:15:18.424798    2553 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 23 16:15:18.434841 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:15:18.424801    2553 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 23 16:15:18.434841 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:15:18.424804    2553 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 23 16:15:18.434841 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:15:18.424806    2553 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 23 16:15:18.434841 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:15:18.424809    2553 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 23 16:15:18.434841 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:15:18.424811    2553 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 23 16:15:18.434841 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:15:18.424814    2553 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 23 16:15:18.434841 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:15:18.424818    2553 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 23 16:15:18.434841 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:15:18.424820    2553 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 23 16:15:18.434841 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:15:18.424823    2553 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 23 16:15:18.434841 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:15:18.424826    2553 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 23 16:15:18.434841 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:15:18.424828    2553 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 23 16:15:18.434841 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:15:18.424831    2553 feature_gate.go:328] unrecognized feature gate: Example2
Jul 23 16:15:18.434841 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:15:18.424833    2553 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 23 16:15:18.434841 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:15:18.424836    2553 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 23 16:15:18.434841 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:15:18.424838    2553 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 23 16:15:18.434841 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:15:18.424841    2553 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 23 16:15:18.435352 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:15:18.424844    2553 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 23 16:15:18.435352 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:15:18.424847    2553 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 23 16:15:18.435352 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:15:18.424849    2553 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 23 16:15:18.435352 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:15:18.424852    2553 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 23 16:15:18.435352 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:15:18.424855    2553 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 23 16:15:18.435352 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:15:18.424857    2553 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 23 16:15:18.435352 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:15:18.424860    2553 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 23 16:15:18.435352 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:15:18.424863    2553 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 23 16:15:18.435352 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:15:18.424865    2553 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 23 16:15:18.435352 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:15:18.424868    2553 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 23 16:15:18.435352 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:15:18.424870    2553 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 23 16:15:18.435352 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:15:18.424872    2553 feature_gate.go:328] unrecognized feature gate: Example
Jul 23 16:15:18.435352 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:15:18.424875    2553 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 23 16:15:18.435352 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:15:18.424878    2553 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 23 16:15:18.435352 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:15:18.424881    2553 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 23 16:15:18.435352 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:15:18.424885    2553 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 23 16:15:18.435352 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:15:18.424888    2553 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 23 16:15:18.435352 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:15:18.424891    2553 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 23 16:15:18.435352 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:15:18.424893    2553 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 23 16:15:18.435352 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:15:18.424896    2553 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 23 16:15:18.435885 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:15:18.424899    2553 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 23 16:15:18.435885 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:15:18.424901    2553 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 23 16:15:18.435885 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:18.424908    2553 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 23 16:15:18.435885 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:18.431225    2553 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Jul 23 16:15:18.435885 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:18.431244    2553 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jul 23 16:15:18.435885 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:18.431961    2553 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jul 23 16:15:18.435885 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:18.431971    2553 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jul 23 16:15:18.435885 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:15:18.432032    2553 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 23 16:15:18.435885 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:15:18.432038    2553 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 23 16:15:18.435885 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:15:18.432041    2553 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 23 16:15:18.435885 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:15:18.432044    2553 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 23 16:15:18.435885 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:15:18.432047    2553 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 23 16:15:18.435885 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:15:18.432050    2553 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 23 16:15:18.435885 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:15:18.432054    2553 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 23 16:15:18.436277 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:15:18.432058    2553 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 23 16:15:18.436277 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:15:18.432062    2553 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 23 16:15:18.436277 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:15:18.432065    2553 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 23 16:15:18.436277 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:15:18.432068    2553 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 23 16:15:18.436277 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:15:18.432071    2553 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 23 16:15:18.436277 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:15:18.432073    2553 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 23 16:15:18.436277 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:15:18.432076    2553 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 23 16:15:18.436277 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:15:18.432079    2553 feature_gate.go:328] unrecognized feature gate: Example
Jul 23 16:15:18.436277 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:15:18.432081    2553 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 23 16:15:18.436277 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:15:18.432084    2553 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 23 16:15:18.436277 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:15:18.432086    2553 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 23 16:15:18.436277 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:15:18.432089    2553 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 23 16:15:18.436277 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:15:18.432092    2553 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 23 16:15:18.436277 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:15:18.432094    2553 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 23 16:15:18.436277 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:15:18.432098    2553 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 23 16:15:18.436277 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:15:18.432102    2553 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 23 16:15:18.436277 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:15:18.432105    2553 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 23 16:15:18.436277 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:15:18.432109    2553 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 23 16:15:18.436277 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:15:18.432111    2553 feature_gate.go:328] unrecognized feature gate: Example2
Jul 23 16:15:18.436277 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:15:18.432114    2553 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 23 16:15:18.436788 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:15:18.432117    2553 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 23 16:15:18.436788 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:15:18.432119    2553 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 23 16:15:18.436788 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:15:18.432123    2553 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 23 16:15:18.436788 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:15:18.432126    2553 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 23 16:15:18.436788 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:15:18.432128    2553 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 23 16:15:18.436788 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:15:18.432131    2553 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 23 16:15:18.436788 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:15:18.432133    2553 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 23 16:15:18.436788 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:15:18.432136    2553 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 23 16:15:18.436788 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:15:18.432139    2553 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 23 16:15:18.436788 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:15:18.432141    2553 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 23 16:15:18.436788 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:15:18.432144    2553 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 23 16:15:18.436788 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:15:18.432146    2553 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 23 16:15:18.436788 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:15:18.432149    2553 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 23 16:15:18.436788 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:15:18.432151    2553 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 23 16:15:18.436788 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:15:18.432154    2553 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 23 16:15:18.436788 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:15:18.432157    2553 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 23 16:15:18.436788 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:15:18.432160    2553 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 23 16:15:18.436788 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:15:18.432175    2553 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 23 16:15:18.436788 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:15:18.432178    2553 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 23 16:15:18.436788 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:15:18.432181    2553 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 23 16:15:18.437365 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:15:18.432184    2553 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 23 16:15:18.437365 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:15:18.432187    2553 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 23 16:15:18.437365 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:15:18.432191    2553 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 23 16:15:18.437365 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:15:18.432194    2553 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 23 16:15:18.437365 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:15:18.432197    2553 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 23 16:15:18.437365 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:15:18.432201    2553 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 23 16:15:18.437365 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:15:18.432204    2553 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 23 16:15:18.437365 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:15:18.432207    2553 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 23 16:15:18.437365 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:15:18.432210    2553 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 23 16:15:18.437365 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:15:18.432213    2553 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 23 16:15:18.437365 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:15:18.432217    2553 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 23 16:15:18.437365 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:15:18.432220    2553 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 23 16:15:18.437365 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:15:18.432222    2553 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 23 16:15:18.437365 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:15:18.432225    2553 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 23 16:15:18.437365 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:15:18.432228    2553 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 23 16:15:18.437365 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:15:18.432231    2553 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 23 16:15:18.437365 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:15:18.432234    2553 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 23 16:15:18.437365 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:15:18.432236    2553 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 23 16:15:18.437365 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:15:18.432239    2553 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 23 16:15:18.437860 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:15:18.432241    2553 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 23 16:15:18.437860 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:15:18.432244    2553 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 23 16:15:18.437860 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:15:18.432247    2553 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 23 16:15:18.437860 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:15:18.432249    2553 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 23 16:15:18.437860 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:15:18.432252    2553 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 23 16:15:18.437860 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:15:18.432254    2553 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 23 16:15:18.437860 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:15:18.432257    2553 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 23 16:15:18.437860 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:15:18.432260    2553 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 23 16:15:18.437860 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:15:18.432262    2553 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 23 16:15:18.437860 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:15:18.432265    2553 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 23 16:15:18.437860 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:15:18.432267    2553 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 23 16:15:18.437860 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:15:18.432270    2553 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 23 16:15:18.437860 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:15:18.432272    2553 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 23 16:15:18.437860 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:15:18.432275    2553 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 23 16:15:18.437860 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:15:18.432277    2553 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 23 16:15:18.437860 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:15:18.432280    2553 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 23 16:15:18.437860 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:15:18.432282    2553 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 23 16:15:18.437860 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:15:18.432285    2553 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 23 16:15:18.437860 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:15:18.432287    2553 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 23 16:15:18.437860 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:15:18.432290    2553 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 23 16:15:18.438435 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:15:18.432292    2553 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 23 16:15:18.438435 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:15:18.432295    2553 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 23 16:15:18.438435 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:15:18.432297    2553 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 23 16:15:18.438435 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:15:18.432300    2553 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 23 16:15:18.438435 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:15:18.432304    2553 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 23 16:15:18.438435 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:15:18.432307    2553 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 23 16:15:18.438435 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:15:18.432311    2553 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 23 16:15:18.438435 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:15:18.432315    2553 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 23 16:15:18.438435 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:15:18.432317    2553 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 23 16:15:18.438435 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:15:18.432320    2553 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 23 16:15:18.438435 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:15:18.432323    2553 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 23 16:15:18.438435 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:15:18.432326    2553 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 23 16:15:18.438435 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:15:18.432329    2553 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 23 16:15:18.438435 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:18.432334    2553 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 23 16:15:18.438435 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:15:18.432448    2553 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 23 16:15:18.439055 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:15:18.432452    2553 feature_gate.go:328] unrecognized feature gate: Example2
Jul 23 16:15:18.439055 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:15:18.432455    2553 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 23 16:15:18.439055 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:15:18.432458    2553 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 23 16:15:18.439055 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:15:18.432461    2553 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 23 16:15:18.439055 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:15:18.432464    2553 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 23 16:15:18.439055 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:15:18.432467    2553 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 23 16:15:18.439055 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:15:18.432469    2553 feature_gate.go:328] unrecognized feature gate: Example
Jul 23 16:15:18.439055 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:15:18.432472    2553 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 23 16:15:18.439055 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:15:18.432474    2553 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 23 16:15:18.439055 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:15:18.432477    2553 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 23 16:15:18.439055 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:15:18.432480    2553 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 23 16:15:18.439055 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:15:18.432482    2553 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 23 16:15:18.439055 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:15:18.432485    2553 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 23 16:15:18.439055 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:15:18.432487    2553 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 23 16:15:18.439055 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:15:18.432490    2553 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 23 16:15:18.439055 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:15:18.432493    2553 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 23 16:15:18.439055 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:15:18.432495    2553 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 23 16:15:18.439055 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:15:18.432498    2553 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 23 16:15:18.439055 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:15:18.432501    2553 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 23 16:15:18.439055 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:15:18.432503    2553 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 23 16:15:18.439782 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:15:18.432506    2553 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 23 16:15:18.439782 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:15:18.432509    2553 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 23 16:15:18.439782 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:15:18.432512    2553 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 23 16:15:18.439782 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:15:18.432514    2553 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 23 16:15:18.439782 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:15:18.432517    2553 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 23 16:15:18.439782 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:15:18.432519    2553 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 23 16:15:18.439782 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:15:18.432522    2553 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 23 16:15:18.439782 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:15:18.432524    2553 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 23 16:15:18.439782 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:15:18.432527    2553 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 23 16:15:18.439782 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:15:18.432529    2553 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 23 16:15:18.439782 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:15:18.432532    2553 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 23 16:15:18.439782 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:15:18.432534    2553 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 23 16:15:18.439782 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:15:18.432538    2553 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 23 16:15:18.439782 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:15:18.432542    2553 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 23 16:15:18.439782 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:15:18.432545    2553 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 23 16:15:18.439782 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:15:18.432548    2553 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 23 16:15:18.439782 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:15:18.432550    2553 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 23 16:15:18.439782 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:15:18.432553    2553 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 23 16:15:18.439782 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:15:18.432556    2553 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 23 16:15:18.440354 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:15:18.432559    2553 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 23 16:15:18.440354 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:15:18.432562    2553 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 23 16:15:18.440354 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:15:18.432564    2553 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 23 16:15:18.440354 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:15:18.432567    2553 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 23 16:15:18.440354 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:15:18.432570    2553 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 23 16:15:18.440354 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:15:18.432573    2553 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 23 16:15:18.440354 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:15:18.432575    2553 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 23 16:15:18.440354 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:15:18.432578    2553 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 23 16:15:18.440354 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:15:18.432580    2553 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 23 16:15:18.440354 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:15:18.432583    2553 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 23 16:15:18.440354 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:15:18.432585    2553 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 23 16:15:18.440354 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:15:18.432588    2553 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 23 16:15:18.440354 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:15:18.432591    2553 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 23 16:15:18.440354 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:15:18.432593    2553 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 23 16:15:18.440354 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:15:18.432596    2553 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 23 16:15:18.440354 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:15:18.432598    2553 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 23 16:15:18.440354 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:15:18.432601    2553 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 23 16:15:18.440354 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:15:18.432604    2553 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 23 16:15:18.440354 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:15:18.432606    2553 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 23 16:15:18.440354 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:15:18.432609    2553 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 23 16:15:18.441058 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:15:18.432611    2553 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 23 16:15:18.441058 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:15:18.432614    2553 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 23 16:15:18.441058 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:15:18.432617    2553 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 23 16:15:18.441058 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:15:18.432619    2553 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 23 16:15:18.441058 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:15:18.432622    2553 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 23 16:15:18.441058 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:15:18.432624    2553 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 23 16:15:18.441058 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:15:18.432627    2553 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 23 16:15:18.441058 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:15:18.432630    2553 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 23 16:15:18.441058 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:15:18.432632    2553 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 23 16:15:18.441058 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:15:18.432634    2553 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 23 16:15:18.441058 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:15:18.432637    2553 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 23 16:15:18.441058 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:15:18.432639    2553 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 23 16:15:18.441058 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:15:18.432642    2553 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 23 16:15:18.441058 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:15:18.432644    2553 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 23 16:15:18.441058 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:15:18.432648    2553 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 23 16:15:18.441058 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:15:18.432651    2553 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 23 16:15:18.441058 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:15:18.432654    2553 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 23 16:15:18.441058 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:15:18.432656    2553 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 23 16:15:18.441058 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:15:18.432659    2553 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 23 16:15:18.441543 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:15:18.432661    2553 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 23 16:15:18.441543 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:15:18.432664    2553 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 23 16:15:18.441543 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:15:18.432668    2553 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 23 16:15:18.441543 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:15:18.432672    2553 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 23 16:15:18.441543 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:15:18.432675    2553 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 23 16:15:18.441543 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:15:18.432686    2553 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 23 16:15:18.441543 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:15:18.432690    2553 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 23 16:15:18.441543 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:15:18.432692    2553 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 23 16:15:18.441543 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:15:18.432695    2553 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 23 16:15:18.441543 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:15:18.432697    2553 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 23 16:15:18.441543 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:15:18.432701    2553 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 23 16:15:18.441543 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:15:18.432703    2553 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 23 16:15:18.441543 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:15:18.432706    2553 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 23 16:15:18.441543 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:15:18.432709    2553 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 23 16:15:18.441543 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:15:18.432712    2553 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 23 16:15:18.441543 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:15:18.432714    2553 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 23 16:15:18.441543 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:15:18.432717    2553 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 23 16:15:18.441543 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:15:18.432719    2553 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 23 16:15:18.441543 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:15:18.432722    2553 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 23 16:15:18.441543 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:15:18.432724    2553 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 23 16:15:18.442022 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:18.432729    2553 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 23 16:15:18.442022 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:18.432857    2553 server.go:962] "Client rotation is on, will bootstrap in background"
Jul 23 16:15:18.442022 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:18.435561    2553 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jul 23 16:15:18.442022 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:18.436695    2553 server.go:1019] "Starting client certificate rotation"
Jul 23 16:15:18.442022 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:18.436808    2553 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 23 16:15:18.442022 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:18.436863    2553 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 23 16:15:18.442022 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:18.438999    2553 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 23 16:15:18.442022 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:18.440118    2553 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 23 16:15:18.449937 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:18.449913    2553 log.go:25] "Validated CRI v1 runtime API"
Jul 23 16:15:18.452441 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:18.452423    2553 log.go:25] "Validated CRI v1 image API"
Jul 23 16:15:18.453180 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:18.453143    2553 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jul 23 16:15:18.455235 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:18.455204    2553 fs.go:135] Filesystem UUIDs: map[37e7d243-75c2-4184-a212-3cad26b887fd:/dev/nvme0n1p4 3cc61497-3e28-476b-bf8e-7d92e9125f5b:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2]
Jul 23 16:15:18.455235 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:18.455232    2553 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jul 23 16:15:18.460507 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:18.460385    2553 manager.go:216] Machine: {Timestamp:2026-07-23 16:15:18.459061236 +0000 UTC m=+0.323667354 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3094937 MemoryCapacity:33164496896 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2c414cbfa7a3a51343fdca5ad40da5 SystemUUID:ec2c414c-bfa7-a3a5-1343-fdca5ad40da5 BootID:8b828f30-8903-42e8-8cf0-6c4b16cb14a1 Filesystems:[{Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:f6:be:5e:1c:5f Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:f6:be:5e:1c:5f Speed:0 Mtu:9001} {Name:ovs-system MacAddress:16:eb:a0:dd:fc:e4 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164496896 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jul 23 16:15:18.460507 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:18.460497    2553 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jul 23 16:15:18.460626 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:18.460581    2553 manager.go:232] Version: {KernelVersion:5.14.0-570.128.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260715-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jul 23 16:15:18.463186 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:18.463131    2553 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jul 23 16:15:18.463333 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:18.463193    2553 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-143-166.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jul 23 16:15:18.463862 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:18.463850    2553 topology_manager.go:138] "Creating topology manager with none policy"
Jul 23 16:15:18.463899 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:18.463865    2553 container_manager_linux.go:309] "Creating device plugin manager"
Jul 23 16:15:18.463899 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:18.463873    2553 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 23 16:15:18.464899 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:18.464888    2553 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 23 16:15:18.465893 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:18.465883    2553 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jul 23 16:15:18.468307 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:18.468292    2553 state_mem.go:36] "Initialized new in-memory state store"
Jul 23 16:15:18.468425 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:18.468416    2553 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jul 23 16:15:18.468458 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:18.468445    2553 kubelet.go:486] "Attempting to sync node with API server"
Jul 23 16:15:18.468458 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:18.468454    2553 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jul 23 16:15:18.468512 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:18.468470    2553 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jul 23 16:15:18.468512 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:18.468479    2553 kubelet.go:398] "Adding apiserver pod source"
Jul 23 16:15:18.468512 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:18.468489    2553 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jul 23 16:15:18.468884 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:18.468871    2553 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 23 16:15:18.468934 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:18.468900    2553 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 23 16:15:18.470045 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:18.470021    2553 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 23 16:15:18.470944 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:18.470926    2553 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1"
Jul 23 16:15:18.473221 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:18.473207    2553 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jul 23 16:15:18.473286 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:18.473239    2553 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jul 23 16:15:18.474074 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:18.474064    2553 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jul 23 16:15:18.474120 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:18.474079    2553 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jul 23 16:15:18.474120 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:18.474085    2553 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jul 23 16:15:18.474120 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:18.474090    2553 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jul 23 16:15:18.474120 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:18.474099    2553 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jul 23 16:15:18.474120 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:18.474104    2553 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jul 23 16:15:18.474120 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:18.474113    2553 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jul 23 16:15:18.474120 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:18.474118    2553 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jul 23 16:15:18.474317 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:18.474125    2553 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jul 23 16:15:18.474317 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:18.474130    2553 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jul 23 16:15:18.474317 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:18.474138    2553 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jul 23 16:15:18.474317 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:18.474143    2553 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jul 23 16:15:18.474809 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:18.474799    2553 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jul 23 16:15:18.474809 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:18.474809    2553 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jul 23 16:15:18.477953 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:18.477931    2553 server.go:1268] "Started kubelet"
Jul 23 16:15:18.478032 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:18.477993    2553 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jul 23 16:15:18.478077 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:18.478024    2553 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jul 23 16:15:18.478118 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:18.478102    2553 server_v1.go:49] "podresources" method="list" useActivePods=true
Jul 23 16:15:18.478816 ip-10-0-143-166 systemd[1]: Started Kubernetes Kubelet.
Jul 23 16:15:18.480181 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:18.480148    2553 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jul 23 16:15:18.482519 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:18.482500    2553 server.go:310] "Adding debug handlers to kubelet server"
Jul 23 16:15:18.483954 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:18.483930    2553 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-143-166.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 23 16:15:18.484352 ip-10-0-143-166 kubenswrapper[2553]: E0723 16:15:18.484314    2553 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-143-166.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 23 16:15:18.484352 ip-10-0-143-166 kubenswrapper[2553]: E0723 16:15:18.484335    2553 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 23 16:15:18.486081 ip-10-0-143-166 kubenswrapper[2553]: E0723 16:15:18.486062    2553 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jul 23 16:15:18.486913 ip-10-0-143-166 kubenswrapper[2553]: E0723 16:15:18.484086    2553 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-143-166.ec2.internal.18c4f75a0cb594e4  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-143-166.ec2.internal,UID:ip-10-0-143-166.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-143-166.ec2.internal,},FirstTimestamp:2026-07-23 16:15:18.477903076 +0000 UTC m=+0.342509194,LastTimestamp:2026-07-23 16:15:18.477903076 +0000 UTC m=+0.342509194,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-143-166.ec2.internal,}"
Jul 23 16:15:18.488082 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:18.488066    2553 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jul 23 16:15:18.488179 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:18.488078    2553 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jul 23 16:15:18.488230 ip-10-0-143-166 kubenswrapper[2553]: E0723 16:15:18.488179    2553 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-166.ec2.internal\" not found"
Jul 23 16:15:18.488628 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:18.488577    2553 volume_manager.go:311] "The desired_state_of_world populator starts"
Jul 23 16:15:18.488628 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:18.488609    2553 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jul 23 16:15:18.488766 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:18.488576    2553 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jul 23 16:15:18.488807 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:18.488780    2553 reconstruct.go:97] "Volume reconstruction finished"
Jul 23 16:15:18.488807 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:18.488789    2553 reconciler.go:29] "Reconciler: start to sync state"
Jul 23 16:15:18.489026 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:18.489007    2553 factory.go:55] Registering systemd factory
Jul 23 16:15:18.489089 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:18.489030    2553 factory.go:223] Registration of the systemd container factory successfully
Jul 23 16:15:18.489304 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:18.489287    2553 factory.go:153] Registering CRI-O factory
Jul 23 16:15:18.489389 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:18.489309    2553 factory.go:223] Registration of the crio container factory successfully
Jul 23 16:15:18.489389 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:18.489380    2553 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jul 23 16:15:18.489476 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:18.489405    2553 factory.go:103] Registering Raw factory
Jul 23 16:15:18.489476 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:18.489419    2553 manager.go:1196] Started watching for new ooms in manager
Jul 23 16:15:18.489834 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:18.489818    2553 manager.go:349] Starting recovery of all containers
Jul 23 16:15:18.499786 ip-10-0-143-166 kubenswrapper[2553]: E0723 16:15:18.499653    2553 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-143-166.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Jul 23 16:15:18.499786 ip-10-0-143-166 kubenswrapper[2553]: E0723 16:15:18.499683    2553 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Jul 23 16:15:18.500109 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:18.500095    2553 manager.go:354] Recovery completed
Jul 23 16:15:18.505508 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:18.505494    2553 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 23 16:15:18.507365 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:18.507341    2553 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-166.ec2.internal" event="NodeHasSufficientMemory"
Jul 23 16:15:18.507420 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:18.507379    2553 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-166.ec2.internal" event="NodeHasNoDiskPressure"
Jul 23 16:15:18.507420 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:18.507392    2553 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-166.ec2.internal" event="NodeHasSufficientPID"
Jul 23 16:15:18.507942 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:18.507928    2553 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jul 23 16:15:18.507998 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:18.507943    2553 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jul 23 16:15:18.507998 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:18.507934    2553 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 23 16:15:18.507998 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:18.507962    2553 state_mem.go:36] "Initialized new in-memory state store"
Jul 23 16:15:18.508696 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:18.508674    2553 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-166.ec2.internal" event="NodeHasSufficientMemory"
Jul 23 16:15:18.508773 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:18.508709    2553 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-166.ec2.internal" event="NodeHasNoDiskPressure"
Jul 23 16:15:18.508773 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:18.508723    2553 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-166.ec2.internal" event="NodeHasSufficientPID"
Jul 23 16:15:18.509078 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:18.509067    2553 policy_none.go:49] "None policy: Start"
Jul 23 16:15:18.509108 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:18.509086    2553 memory_manager.go:187] "Starting memorymanager" policy="None"
Jul 23 16:15:18.509108 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:18.509096    2553 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jul 23 16:15:18.509908 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:18.509894    2553 policy_none.go:47] "Start"
Jul 23 16:15:18.519646 ip-10-0-143-166 kubenswrapper[2553]: E0723 16:15:18.519574    2553 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-143-166.ec2.internal.18c4f75a0e771ff2  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-143-166.ec2.internal,UID:ip-10-0-143-166.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-143-166.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-143-166.ec2.internal,},FirstTimestamp:2026-07-23 16:15:18.507364338 +0000 UTC m=+0.371970460,LastTimestamp:2026-07-23 16:15:18.507364338 +0000 UTC m=+0.371970460,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-143-166.ec2.internal,}"
Jul 23 16:15:18.521944 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:18.521926    2553 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-nb25t"
Jul 23 16:15:18.528913 ip-10-0-143-166 kubenswrapper[2553]: E0723 16:15:18.528828    2553 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-143-166.ec2.internal.18c4f75a0e77788d  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-143-166.ec2.internal,UID:ip-10-0-143-166.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-143-166.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-143-166.ec2.internal,},FirstTimestamp:2026-07-23 16:15:18.507387021 +0000 UTC m=+0.371993141,LastTimestamp:2026-07-23 16:15:18.507387021 +0000 UTC m=+0.371993141,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-143-166.ec2.internal,}"
Jul 23 16:15:18.529956 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:18.529941    2553 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-nb25t"
Jul 23 16:15:18.588440 ip-10-0-143-166 kubenswrapper[2553]: E0723 16:15:18.588411    2553 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-166.ec2.internal\" not found"
Jul 23 16:15:18.666977 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:18.666906    2553 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jul 23 16:15:18.668153 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:18.668134    2553 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jul 23 16:15:18.668273 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:18.668200    2553 status_manager.go:244] "Starting to sync pod status with apiserver"
Jul 23 16:15:18.668273 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:18.668228    2553 kubelet.go:2448] "Starting kubelet main sync loop"
Jul 23 16:15:18.668364 ip-10-0-143-166 kubenswrapper[2553]: E0723 16:15:18.668271    2553 kubelet.go:2472] "Skipping pod synchronization" err="[container runtime status check may not have completed yet, PLEG is not healthy: pleg has yet to be successful]"
Jul 23 16:15:18.670807 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:18.670789    2553 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 23 16:15:18.688792 ip-10-0-143-166 kubenswrapper[2553]: E0723 16:15:18.688769    2553 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-166.ec2.internal\" not found"
Jul 23 16:15:18.698864 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:18.698848    2553 manager.go:337] "Starting Device Plugin manager"
Jul 23 16:15:18.698957 ip-10-0-143-166 kubenswrapper[2553]: E0723 16:15:18.698887    2553 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jul 23 16:15:18.698957 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:18.698896    2553 server.go:87] "Starting device plugin registration server"
Jul 23 16:15:18.699197 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:18.699183    2553 eviction_manager.go:189] "Eviction manager: starting control loop"
Jul 23 16:15:18.699254 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:18.699200    2553 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jul 23 16:15:18.699318 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:18.699294    2553 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jul 23 16:15:18.699398 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:18.699386    2553 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jul 23 16:15:18.699444 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:18.699399    2553 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jul 23 16:15:18.700490 ip-10-0-143-166 kubenswrapper[2553]: E0723 16:15:18.700468    2553 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jul 23 16:15:18.700583 ip-10-0-143-166 kubenswrapper[2553]: E0723 16:15:18.700514    2553 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-143-166.ec2.internal\" not found"
Jul 23 16:15:18.705453 ip-10-0-143-166 kubenswrapper[2553]: E0723 16:15:18.705426    2553 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-143-166.ec2.internal\" not found" node="ip-10-0-143-166.ec2.internal"
Jul 23 16:15:18.768636 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:18.768572    2553 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-166.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-143-166.ec2.internal"]
Jul 23 16:15:18.768748 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:18.768709    2553 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 23 16:15:18.770003 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:18.769987    2553 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-166.ec2.internal" event="NodeHasSufficientMemory"
Jul 23 16:15:18.770121 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:18.770017    2553 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-166.ec2.internal" event="NodeHasNoDiskPressure"
Jul 23 16:15:18.770121 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:18.770027    2553 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-166.ec2.internal" event="NodeHasSufficientPID"
Jul 23 16:15:18.771299 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:18.771287    2553 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 23 16:15:18.771461 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:18.771446    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-166.ec2.internal"
Jul 23 16:15:18.771531 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:18.771478    2553 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 23 16:15:18.772043 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:18.772027    2553 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-166.ec2.internal" event="NodeHasSufficientMemory"
Jul 23 16:15:18.772122 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:18.772056    2553 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-166.ec2.internal" event="NodeHasNoDiskPressure"
Jul 23 16:15:18.772122 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:18.772067    2553 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-166.ec2.internal" event="NodeHasSufficientPID"
Jul 23 16:15:18.772122 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:18.772027    2553 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-166.ec2.internal" event="NodeHasSufficientMemory"
Jul 23 16:15:18.772278 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:18.772146    2553 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-166.ec2.internal" event="NodeHasNoDiskPressure"
Jul 23 16:15:18.772278 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:18.772181    2553 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-166.ec2.internal" event="NodeHasSufficientPID"
Jul 23 16:15:18.773334 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:18.773318    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-166.ec2.internal"
Jul 23 16:15:18.773420 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:18.773347    2553 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 23 16:15:18.774122 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:18.774109    2553 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-166.ec2.internal" event="NodeHasSufficientMemory"
Jul 23 16:15:18.774229 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:18.774130    2553 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-166.ec2.internal" event="NodeHasNoDiskPressure"
Jul 23 16:15:18.774229 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:18.774144    2553 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-166.ec2.internal" event="NodeHasSufficientPID"
Jul 23 16:15:18.787812 ip-10-0-143-166 kubenswrapper[2553]: E0723 16:15:18.787793    2553 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-143-166.ec2.internal\" not found" node="ip-10-0-143-166.ec2.internal"
Jul 23 16:15:18.789935 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:18.789915    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/0069169d441a4ee10e0c5814a4929874-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-143-166.ec2.internal\" (UID: \"0069169d441a4ee10e0c5814a4929874\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-166.ec2.internal"
Jul 23 16:15:18.789935 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:18.789938    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0069169d441a4ee10e0c5814a4929874-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-143-166.ec2.internal\" (UID: \"0069169d441a4ee10e0c5814a4929874\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-166.ec2.internal"
Jul 23 16:15:18.790069 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:18.789973    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/90edd8487e9f34a3dfeb9db04264b82f-config\") pod \"kube-apiserver-proxy-ip-10-0-143-166.ec2.internal\" (UID: \"90edd8487e9f34a3dfeb9db04264b82f\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-143-166.ec2.internal"
Jul 23 16:15:18.792039 ip-10-0-143-166 kubenswrapper[2553]: E0723 16:15:18.792023    2553 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-143-166.ec2.internal\" not found" node="ip-10-0-143-166.ec2.internal"
Jul 23 16:15:18.799434 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:18.799413    2553 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 23 16:15:18.800338 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:18.800317    2553 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-166.ec2.internal" event="NodeHasSufficientMemory"
Jul 23 16:15:18.800433 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:18.800352    2553 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-166.ec2.internal" event="NodeHasNoDiskPressure"
Jul 23 16:15:18.800433 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:18.800365    2553 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-166.ec2.internal" event="NodeHasSufficientPID"
Jul 23 16:15:18.800433 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:18.800391    2553 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-143-166.ec2.internal"
Jul 23 16:15:18.810390 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:18.810372    2553 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-143-166.ec2.internal"
Jul 23 16:15:18.810471 ip-10-0-143-166 kubenswrapper[2553]: E0723 16:15:18.810397    2553 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-143-166.ec2.internal\": node \"ip-10-0-143-166.ec2.internal\" not found"
Jul 23 16:15:18.840858 ip-10-0-143-166 kubenswrapper[2553]: E0723 16:15:18.840832    2553 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-166.ec2.internal\" not found"
Jul 23 16:15:18.890288 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:18.890260    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/90edd8487e9f34a3dfeb9db04264b82f-config\") pod \"kube-apiserver-proxy-ip-10-0-143-166.ec2.internal\" (UID: \"90edd8487e9f34a3dfeb9db04264b82f\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-143-166.ec2.internal"
Jul 23 16:15:18.890361 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:18.890290    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/0069169d441a4ee10e0c5814a4929874-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-143-166.ec2.internal\" (UID: \"0069169d441a4ee10e0c5814a4929874\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-166.ec2.internal"
Jul 23 16:15:18.890361 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:18.890308    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0069169d441a4ee10e0c5814a4929874-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-143-166.ec2.internal\" (UID: \"0069169d441a4ee10e0c5814a4929874\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-166.ec2.internal"
Jul 23 16:15:18.890361 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:18.890356    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0069169d441a4ee10e0c5814a4929874-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-143-166.ec2.internal\" (UID: \"0069169d441a4ee10e0c5814a4929874\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-166.ec2.internal"
Jul 23 16:15:18.890466 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:18.890366    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/0069169d441a4ee10e0c5814a4929874-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-143-166.ec2.internal\" (UID: \"0069169d441a4ee10e0c5814a4929874\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-166.ec2.internal"
Jul 23 16:15:18.890466 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:18.890358    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/90edd8487e9f34a3dfeb9db04264b82f-config\") pod \"kube-apiserver-proxy-ip-10-0-143-166.ec2.internal\" (UID: \"90edd8487e9f34a3dfeb9db04264b82f\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-143-166.ec2.internal"
Jul 23 16:15:18.941700 ip-10-0-143-166 kubenswrapper[2553]: E0723 16:15:18.941637    2553 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-166.ec2.internal\" not found"
Jul 23 16:15:19.042350 ip-10-0-143-166 kubenswrapper[2553]: E0723 16:15:19.042313    2553 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-166.ec2.internal\" not found"
Jul 23 16:15:19.090696 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:19.090656    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-166.ec2.internal"
Jul 23 16:15:19.094435 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:19.094242    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-166.ec2.internal"
Jul 23 16:15:19.142853 ip-10-0-143-166 kubenswrapper[2553]: E0723 16:15:19.142813    2553 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-166.ec2.internal\" not found"
Jul 23 16:15:19.246677 ip-10-0-143-166 kubenswrapper[2553]: E0723 16:15:19.246587    2553 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-166.ec2.internal\" not found"
Jul 23 16:15:19.346734 ip-10-0-143-166 kubenswrapper[2553]: E0723 16:15:19.346696    2553 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-166.ec2.internal\" not found"
Jul 23 16:15:19.436658 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:19.436618    2553 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jul 23 16:15:19.437072 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:19.436824    2553 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 23 16:15:19.447649 ip-10-0-143-166 kubenswrapper[2553]: E0723 16:15:19.447625    2553 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-166.ec2.internal\" not found"
Jul 23 16:15:19.533582 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:19.533479    2553 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-22 16:10:19 +0000 UTC" deadline="2028-01-01 06:42:43.421091487 +0000 UTC"
Jul 23 16:15:19.533582 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:19.533518    2553 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="12638h27m23.887576679s"
Jul 23 16:15:19.547734 ip-10-0-143-166 kubenswrapper[2553]: E0723 16:15:19.547708    2553 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-166.ec2.internal\" not found"
Jul 23 16:15:19.548000 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:19.547986    2553 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 23 16:15:19.591419 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:19.591371    2553 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-166.ec2.internal"
Jul 23 16:15:19.621315 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:19.621286    2553 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 23 16:15:19.623228 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:19.623208    2553 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-166.ec2.internal"
Jul 23 16:15:19.630813 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:19.630793    2553 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 23 16:15:19.774155 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:19.774121    2553 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 23 16:15:19.878027 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:19.877953    2553 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 23 16:15:20.298779 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:15:20.298746    2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0069169d441a4ee10e0c5814a4929874.slice/crio-e2a4d1628b7cc8c044ccf16a7066228c813419222a3bf2fd092b9e6b820cda3a WatchSource:0}: Error finding container e2a4d1628b7cc8c044ccf16a7066228c813419222a3bf2fd092b9e6b820cda3a: Status 404 returned error can't find the container with id e2a4d1628b7cc8c044ccf16a7066228c813419222a3bf2fd092b9e6b820cda3a
Jul 23 16:15:20.299164 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:15:20.299142    2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod90edd8487e9f34a3dfeb9db04264b82f.slice/crio-285398de4656e395b04ada6008a0dc53b5cc7c12a46c1b1d2e2f22f480e13993 WatchSource:0}: Error finding container 285398de4656e395b04ada6008a0dc53b5cc7c12a46c1b1d2e2f22f480e13993: Status 404 returned error can't find the container with id 285398de4656e395b04ada6008a0dc53b5cc7c12a46c1b1d2e2f22f480e13993
Jul 23 16:15:20.305123 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:20.305106    2553 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 23 16:15:20.446634 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:20.446540    2553 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 23 16:15:20.469646 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:20.469615    2553 apiserver.go:52] "Watching apiserver"
Jul 23 16:15:20.478633 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:20.478600    2553 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 23 16:15:20.478968 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:20.478944    2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/global-pull-secret-syncer-lqmct","kube-system/kube-apiserver-proxy-ip-10-0-143-166.ec2.internal","openshift-cluster-node-tuning-operator/tuned-ltz8k","openshift-dns/node-resolver-qbjm4","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-166.ec2.internal","openshift-multus/multus-bkx5j","openshift-multus/network-metrics-daemon-bkpz9","openshift-ovn-kubernetes/ovnkube-node-c9g74","kube-system/konnectivity-agent-j892l","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x5s6t","openshift-image-registry/node-ca-cnp2t","openshift-multus/multus-additional-cni-plugins-jjtst","openshift-network-diagnostics/network-check-target-8vt69","openshift-network-operator/iptables-alerter-2vp4s"]
Jul 23 16:15:20.483162 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:20.483139    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bkpz9"
Jul 23 16:15:20.483276 ip-10-0-143-166 kubenswrapper[2553]: E0723 16:15:20.483255    2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bkpz9" podUID="0ce6ab38-81a0-43b1-865b-42c65798de75"
Jul 23 16:15:20.485709 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:20.485690    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-cnp2t"
Jul 23 16:15:20.488021 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:20.487992    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-ltz8k"
Jul 23 16:15:20.488573 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:20.488550    2553 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jul 23 16:15:20.488681 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:20.488599    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 23 16:15:20.488891 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:20.488867    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 23 16:15:20.488998 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:20.488877    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 23 16:15:20.488998 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:20.488975    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-fddlj\""
Jul 23 16:15:20.490315 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:20.490276    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-qbjm4"
Jul 23 16:15:20.490585 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:20.490564    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 23 16:15:20.490725 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:20.490707    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 23 16:15:20.490792 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:20.490757    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-fnw2j\""
Jul 23 16:15:20.492735 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:20.492696    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-2vp4s"
Jul 23 16:15:20.492981 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:20.492965    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-v8fll\""
Jul 23 16:15:20.493264 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:20.493246    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 23 16:15:20.493338 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:20.493293    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 23 16:15:20.495079 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:20.495060    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-bkx5j"
Jul 23 16:15:20.495430 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:20.495413    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 23 16:15:20.495527 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:20.495509    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-p29wf\""
Jul 23 16:15:20.495635 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:20.495620    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 23 16:15:20.495698 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:20.495645    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 23 16:15:20.497496 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:20.497481    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-j892l"
Jul 23 16:15:20.497686 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:20.497665    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 23 16:15:20.497847 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:20.497832    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 23 16:15:20.497934 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:20.497898    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 23 16:15:20.498042 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:20.498026    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-j9c6v\""
Jul 23 16:15:20.498105 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:20.498087    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 23 16:15:20.498375 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:20.498357    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/dd8e418a-a9fa-4bb8-b939-fe242e316e72-host\") pod \"tuned-ltz8k\" (UID: \"dd8e418a-a9fa-4bb8-b939-fe242e316e72\") " pod="openshift-cluster-node-tuning-operator/tuned-ltz8k"
Jul 23 16:15:20.498445 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:20.498386    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/dd8e418a-a9fa-4bb8-b939-fe242e316e72-etc-tuned\") pod \"tuned-ltz8k\" (UID: \"dd8e418a-a9fa-4bb8-b939-fe242e316e72\") " pod="openshift-cluster-node-tuning-operator/tuned-ltz8k"
Jul 23 16:15:20.498445 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:20.498412    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kgpc6\" (UniqueName: \"kubernetes.io/projected/dd8e418a-a9fa-4bb8-b939-fe242e316e72-kube-api-access-kgpc6\") pod \"tuned-ltz8k\" (UID: \"dd8e418a-a9fa-4bb8-b939-fe242e316e72\") " pod="openshift-cluster-node-tuning-operator/tuned-ltz8k"
Jul 23 16:15:20.498445 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:20.498440    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/1af4cdcf-98b6-4aab-b234-3bed6566658b-serviceca\") pod \"node-ca-cnp2t\" (UID: \"1af4cdcf-98b6-4aab-b234-3bed6566658b\") " pod="openshift-image-registry/node-ca-cnp2t"
Jul 23 16:15:20.498572 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:20.498485    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/dd8e418a-a9fa-4bb8-b939-fe242e316e72-etc-kubernetes\") pod \"tuned-ltz8k\" (UID: \"dd8e418a-a9fa-4bb8-b939-fe242e316e72\") " pod="openshift-cluster-node-tuning-operator/tuned-ltz8k"
Jul 23 16:15:20.498572 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:20.498517    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/dd8e418a-a9fa-4bb8-b939-fe242e316e72-etc-systemd\") pod \"tuned-ltz8k\" (UID: \"dd8e418a-a9fa-4bb8-b939-fe242e316e72\") " pod="openshift-cluster-node-tuning-operator/tuned-ltz8k"
Jul 23 16:15:20.498572 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:20.498540    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/dd8e418a-a9fa-4bb8-b939-fe242e316e72-sys\") pod \"tuned-ltz8k\" (UID: \"dd8e418a-a9fa-4bb8-b939-fe242e316e72\") " pod="openshift-cluster-node-tuning-operator/tuned-ltz8k"
Jul 23 16:15:20.498572 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:20.498558    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/f8e034fc-9e28-43ab-bd6e-a62848b2ac5d-hosts-file\") pod \"node-resolver-qbjm4\" (UID: \"f8e034fc-9e28-43ab-bd6e-a62848b2ac5d\") " pod="openshift-dns/node-resolver-qbjm4"
Jul 23 16:15:20.498732 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:20.498578    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n9cc5\" (UniqueName: \"kubernetes.io/projected/0ce6ab38-81a0-43b1-865b-42c65798de75-kube-api-access-n9cc5\") pod \"network-metrics-daemon-bkpz9\" (UID: \"0ce6ab38-81a0-43b1-865b-42c65798de75\") " pod="openshift-multus/network-metrics-daemon-bkpz9"
Jul 23 16:15:20.498732 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:20.498617    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v5s2p\" (UniqueName: \"kubernetes.io/projected/1af4cdcf-98b6-4aab-b234-3bed6566658b-kube-api-access-v5s2p\") pod \"node-ca-cnp2t\" (UID: \"1af4cdcf-98b6-4aab-b234-3bed6566658b\") " pod="openshift-image-registry/node-ca-cnp2t"
Jul 23 16:15:20.498732 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:20.498656    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/dd8e418a-a9fa-4bb8-b939-fe242e316e72-etc-sysconfig\") pod \"tuned-ltz8k\" (UID: \"dd8e418a-a9fa-4bb8-b939-fe242e316e72\") " pod="openshift-cluster-node-tuning-operator/tuned-ltz8k"
Jul 23 16:15:20.498732 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:20.498681    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/dd8e418a-a9fa-4bb8-b939-fe242e316e72-run\") pod \"tuned-ltz8k\" (UID: \"dd8e418a-a9fa-4bb8-b939-fe242e316e72\") " pod="openshift-cluster-node-tuning-operator/tuned-ltz8k"
Jul 23 16:15:20.498732 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:20.498701    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/dd8e418a-a9fa-4bb8-b939-fe242e316e72-lib-modules\") pod \"tuned-ltz8k\" (UID: \"dd8e418a-a9fa-4bb8-b939-fe242e316e72\") " pod="openshift-cluster-node-tuning-operator/tuned-ltz8k"
Jul 23 16:15:20.498732 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:20.498716    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f8e034fc-9e28-43ab-bd6e-a62848b2ac5d-tmp-dir\") pod \"node-resolver-qbjm4\" (UID: \"f8e034fc-9e28-43ab-bd6e-a62848b2ac5d\") " pod="openshift-dns/node-resolver-qbjm4"
Jul 23 16:15:20.498732 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:20.498733    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0ce6ab38-81a0-43b1-865b-42c65798de75-metrics-certs\") pod \"network-metrics-daemon-bkpz9\" (UID: \"0ce6ab38-81a0-43b1-865b-42c65798de75\") " pod="openshift-multus/network-metrics-daemon-bkpz9"
Jul 23 16:15:20.499019 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:20.498768    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/dd8e418a-a9fa-4bb8-b939-fe242e316e72-etc-sysctl-d\") pod \"tuned-ltz8k\" (UID: \"dd8e418a-a9fa-4bb8-b939-fe242e316e72\") " pod="openshift-cluster-node-tuning-operator/tuned-ltz8k"
Jul 23 16:15:20.499019 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:20.498799    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/dd8e418a-a9fa-4bb8-b939-fe242e316e72-var-lib-kubelet\") pod \"tuned-ltz8k\" (UID: \"dd8e418a-a9fa-4bb8-b939-fe242e316e72\") " pod="openshift-cluster-node-tuning-operator/tuned-ltz8k"
Jul 23 16:15:20.499019 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:20.498822    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/dd8e418a-a9fa-4bb8-b939-fe242e316e72-tmp\") pod \"tuned-ltz8k\" (UID: \"dd8e418a-a9fa-4bb8-b939-fe242e316e72\") " pod="openshift-cluster-node-tuning-operator/tuned-ltz8k"
Jul 23 16:15:20.499019 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:20.498848    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jg2xg\" (UniqueName: \"kubernetes.io/projected/f8e034fc-9e28-43ab-bd6e-a62848b2ac5d-kube-api-access-jg2xg\") pod \"node-resolver-qbjm4\" (UID: \"f8e034fc-9e28-43ab-bd6e-a62848b2ac5d\") " pod="openshift-dns/node-resolver-qbjm4"
Jul 23 16:15:20.499019 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:20.498871    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/1af4cdcf-98b6-4aab-b234-3bed6566658b-host\") pod \"node-ca-cnp2t\" (UID: \"1af4cdcf-98b6-4aab-b234-3bed6566658b\") " pod="openshift-image-registry/node-ca-cnp2t"
Jul 23 16:15:20.499019 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:20.498912    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/dd8e418a-a9fa-4bb8-b939-fe242e316e72-etc-modprobe-d\") pod \"tuned-ltz8k\" (UID: \"dd8e418a-a9fa-4bb8-b939-fe242e316e72\") " pod="openshift-cluster-node-tuning-operator/tuned-ltz8k"
Jul 23 16:15:20.499019 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:20.498948    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/dd8e418a-a9fa-4bb8-b939-fe242e316e72-etc-sysctl-conf\") pod \"tuned-ltz8k\" (UID: \"dd8e418a-a9fa-4bb8-b939-fe242e316e72\") " pod="openshift-cluster-node-tuning-operator/tuned-ltz8k"
Jul 23 16:15:20.499924 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:20.499902    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8vt69"
Jul 23 16:15:20.500025 ip-10-0-143-166 kubenswrapper[2553]: E0723 16:15:20.499969    2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8vt69" podUID="633a475b-ddec-4391-856d-67674aa0ef0c"
Jul 23 16:15:20.500091 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:20.500028    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 23 16:15:20.500183 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:20.500166    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 23 16:15:20.500277 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:20.500263    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-fllwt\""
Jul 23 16:15:20.501818 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:20.501797    2553 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 23 16:15:20.502351 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:20.502334    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-c9g74"
Jul 23 16:15:20.504915 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:20.504893    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x5s6t"
Jul 23 16:15:20.505391 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:20.505369    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 23 16:15:20.505493 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:20.505395    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-w6czs\""
Jul 23 16:15:20.505493 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:20.505375    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 23 16:15:20.505598 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:20.505503    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 23 16:15:20.506766 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:20.506749    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 23 16:15:20.506865 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:20.506765    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 23 16:15:20.506865 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:20.506836    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 23 16:15:20.507287 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:20.507260    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lqmct"
Jul 23 16:15:20.507807 ip-10-0-143-166 kubenswrapper[2553]: E0723 16:15:20.507776    2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lqmct" podUID="c0d761bc-9c6e-4617-a75d-1811fc235f16"
Jul 23 16:15:20.508524 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:20.508499    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 23 16:15:20.508627 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:20.508500    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-mmtkj\""
Jul 23 16:15:20.508994 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:20.508973    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jul 23 16:15:20.510348 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:20.510325    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 23 16:15:20.511475 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:20.511458    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-jjtst"
Jul 23 16:15:20.513885 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:20.513866    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-vgl72\""
Jul 23 16:15:20.514020 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:20.514002    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 23 16:15:20.514080 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:20.514014    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 23 16:15:20.530529 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:20.530511    2553 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-xzgbc"
Jul 23 16:15:20.536402 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:20.536385    2553 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-xzgbc"
Jul 23 16:15:20.590528 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:20.590489    2553 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jul 23 16:15:20.600137 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:20.600107    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/83d1126c-3d57-463e-bce5-e1716daa5eb7-host-var-lib-cni-bin\") pod \"multus-bkx5j\" (UID: \"83d1126c-3d57-463e-bce5-e1716daa5eb7\") " pod="openshift-multus/multus-bkx5j"
Jul 23 16:15:20.600347 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:20.600144    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/bba31e38-01db-45a0-8b60-9fc626237e01-konnectivity-ca\") pod \"konnectivity-agent-j892l\" (UID: \"bba31e38-01db-45a0-8b60-9fc626237e01\") " pod="kube-system/konnectivity-agent-j892l"
Jul 23 16:15:20.600347 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:20.600171    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/ff3e02fa-45b8-4aa2-acb0-5b4e791b5c7c-run-ovn\") pod \"ovnkube-node-c9g74\" (UID: \"ff3e02fa-45b8-4aa2-acb0-5b4e791b5c7c\") " pod="openshift-ovn-kubernetes/ovnkube-node-c9g74"
Jul 23 16:15:20.600347 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:20.600212    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/bba31e38-01db-45a0-8b60-9fc626237e01-agent-certs\") pod \"konnectivity-agent-j892l\" (UID: \"bba31e38-01db-45a0-8b60-9fc626237e01\") " pod="kube-system/konnectivity-agent-j892l"
Jul 23 16:15:20.600347 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:20.600237    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wkd4x\" (UniqueName: \"kubernetes.io/projected/633a475b-ddec-4391-856d-67674aa0ef0c-kube-api-access-wkd4x\") pod \"network-check-target-8vt69\" (UID: \"633a475b-ddec-4391-856d-67674aa0ef0c\") " pod="openshift-network-diagnostics/network-check-target-8vt69"
Jul 23 16:15:20.600347 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:20.600293    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/ff3e02fa-45b8-4aa2-acb0-5b4e791b5c7c-ovnkube-config\") pod \"ovnkube-node-c9g74\" (UID: \"ff3e02fa-45b8-4aa2-acb0-5b4e791b5c7c\") " pod="openshift-ovn-kubernetes/ovnkube-node-c9g74"
Jul 23 16:15:20.600347 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:20.600331    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/dd8e418a-a9fa-4bb8-b939-fe242e316e72-etc-systemd\") pod \"tuned-ltz8k\" (UID: \"dd8e418a-a9fa-4bb8-b939-fe242e316e72\") " pod="openshift-cluster-node-tuning-operator/tuned-ltz8k"
Jul 23 16:15:20.600662 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:20.600376    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/f8e034fc-9e28-43ab-bd6e-a62848b2ac5d-hosts-file\") pod \"node-resolver-qbjm4\" (UID: \"f8e034fc-9e28-43ab-bd6e-a62848b2ac5d\") " pod="openshift-dns/node-resolver-qbjm4"
Jul 23 16:15:20.600662 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:20.600421    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/dd8e418a-a9fa-4bb8-b939-fe242e316e72-etc-systemd\") pod \"tuned-ltz8k\" (UID: \"dd8e418a-a9fa-4bb8-b939-fe242e316e72\") " pod="openshift-cluster-node-tuning-operator/tuned-ltz8k"
Jul 23 16:15:20.600662 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:20.600422    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/ff3e02fa-45b8-4aa2-acb0-5b4e791b5c7c-host-kubelet\") pod \"ovnkube-node-c9g74\" (UID: \"ff3e02fa-45b8-4aa2-acb0-5b4e791b5c7c\") " pod="openshift-ovn-kubernetes/ovnkube-node-c9g74"
Jul 23 16:15:20.600662 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:20.600439    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/f8e034fc-9e28-43ab-bd6e-a62848b2ac5d-hosts-file\") pod \"node-resolver-qbjm4\" (UID: \"f8e034fc-9e28-43ab-bd6e-a62848b2ac5d\") " pod="openshift-dns/node-resolver-qbjm4"
Jul 23 16:15:20.600662 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:20.600455    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/d1f5fd12-987e-4a35-9764-e36f41189f33-sys-fs\") pod \"aws-ebs-csi-driver-node-x5s6t\" (UID: \"d1f5fd12-987e-4a35-9764-e36f41189f33\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x5s6t"
Jul 23 16:15:20.600662 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:20.600484    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v5s2p\" (UniqueName: \"kubernetes.io/projected/1af4cdcf-98b6-4aab-b234-3bed6566658b-kube-api-access-v5s2p\") pod \"node-ca-cnp2t\" (UID: \"1af4cdcf-98b6-4aab-b234-3bed6566658b\") " pod="openshift-image-registry/node-ca-cnp2t"
Jul 23 16:15:20.600662 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:20.600500    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/83d1126c-3d57-463e-bce5-e1716daa5eb7-os-release\") pod \"multus-bkx5j\" (UID: \"83d1126c-3d57-463e-bce5-e1716daa5eb7\") " pod="openshift-multus/multus-bkx5j"
Jul 23 16:15:20.600662 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:20.600517    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/83d1126c-3d57-463e-bce5-e1716daa5eb7-host-run-multus-certs\") pod \"multus-bkx5j\" (UID: \"83d1126c-3d57-463e-bce5-e1716daa5eb7\") " pod="openshift-multus/multus-bkx5j"
Jul 23 16:15:20.600662 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:20.600540    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ff3e02fa-45b8-4aa2-acb0-5b4e791b5c7c-var-lib-openvswitch\") pod \"ovnkube-node-c9g74\" (UID: \"ff3e02fa-45b8-4aa2-acb0-5b4e791b5c7c\") " pod="openshift-ovn-kubernetes/ovnkube-node-c9g74"
Jul 23 16:15:20.600662 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:20.600568    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ff3e02fa-45b8-4aa2-acb0-5b4e791b5c7c-run-openvswitch\") pod \"ovnkube-node-c9g74\" (UID: \"ff3e02fa-45b8-4aa2-acb0-5b4e791b5c7c\") " pod="openshift-ovn-kubernetes/ovnkube-node-c9g74"
Jul 23 16:15:20.600662 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:20.600584    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/ff3e02fa-45b8-4aa2-acb0-5b4e791b5c7c-node-log\") pod \"ovnkube-node-c9g74\" (UID: \"ff3e02fa-45b8-4aa2-acb0-5b4e791b5c7c\") " pod="openshift-ovn-kubernetes/ovnkube-node-c9g74"
Jul 23 16:15:20.600662 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:20.600599    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/d1f5fd12-987e-4a35-9764-e36f41189f33-kubelet-dir\") pod \"aws-ebs-csi-driver-node-x5s6t\" (UID: \"d1f5fd12-987e-4a35-9764-e36f41189f33\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x5s6t"
Jul 23 16:15:20.600662 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:20.600614    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/83d1126c-3d57-463e-bce5-e1716daa5eb7-etc-kubernetes\") pod \"multus-bkx5j\" (UID: \"83d1126c-3d57-463e-bce5-e1716daa5eb7\") " pod="openshift-multus/multus-bkx5j"
Jul 23 16:15:20.600662 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:20.600639    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ff3e02fa-45b8-4aa2-acb0-5b4e791b5c7c-etc-openvswitch\") pod \"ovnkube-node-c9g74\" (UID: \"ff3e02fa-45b8-4aa2-acb0-5b4e791b5c7c\") " pod="openshift-ovn-kubernetes/ovnkube-node-c9g74"
Jul 23 16:15:20.600662 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:20.600669    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/ff3e02fa-45b8-4aa2-acb0-5b4e791b5c7c-host-cni-netd\") pod \"ovnkube-node-c9g74\" (UID: \"ff3e02fa-45b8-4aa2-acb0-5b4e791b5c7c\") " pod="openshift-ovn-kubernetes/ovnkube-node-c9g74"
Jul 23 16:15:20.601303 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:20.600687    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/1af4cdcf-98b6-4aab-b234-3bed6566658b-host\") pod \"node-ca-cnp2t\" (UID: \"1af4cdcf-98b6-4aab-b234-3bed6566658b\") " pod="openshift-image-registry/node-ca-cnp2t"
Jul 23 16:15:20.601303 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:20.600703    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/dd8e418a-a9fa-4bb8-b939-fe242e316e72-etc-modprobe-d\") pod \"tuned-ltz8k\" (UID: \"dd8e418a-a9fa-4bb8-b939-fe242e316e72\") " pod="openshift-cluster-node-tuning-operator/tuned-ltz8k"
Jul 23 16:15:20.601303 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:20.600728    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/dd8e418a-a9fa-4bb8-b939-fe242e316e72-etc-sysctl-conf\") pod \"tuned-ltz8k\" (UID: \"dd8e418a-a9fa-4bb8-b939-fe242e316e72\") " pod="openshift-cluster-node-tuning-operator/tuned-ltz8k"
Jul 23 16:15:20.601303 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:20.600771    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/dd8e418a-a9fa-4bb8-b939-fe242e316e72-etc-tuned\") pod \"tuned-ltz8k\" (UID: \"dd8e418a-a9fa-4bb8-b939-fe242e316e72\") " pod="openshift-cluster-node-tuning-operator/tuned-ltz8k"
Jul 23 16:15:20.601303 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:20.600797    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/1af4cdcf-98b6-4aab-b234-3bed6566658b-host\") pod \"node-ca-cnp2t\" (UID: \"1af4cdcf-98b6-4aab-b234-3bed6566658b\") " pod="openshift-image-registry/node-ca-cnp2t"
Jul 23 16:15:20.601303 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:20.600807    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/83d1126c-3d57-463e-bce5-e1716daa5eb7-multus-socket-dir-parent\") pod \"multus-bkx5j\" (UID: \"83d1126c-3d57-463e-bce5-e1716daa5eb7\") " pod="openshift-multus/multus-bkx5j"
Jul 23 16:15:20.601303 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:20.600817    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/dd8e418a-a9fa-4bb8-b939-fe242e316e72-etc-modprobe-d\") pod \"tuned-ltz8k\" (UID: \"dd8e418a-a9fa-4bb8-b939-fe242e316e72\") " pod="openshift-cluster-node-tuning-operator/tuned-ltz8k"
Jul 23 16:15:20.601303 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:20.600834    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ff3e02fa-45b8-4aa2-acb0-5b4e791b5c7c-host-cni-bin\") pod \"ovnkube-node-c9g74\" (UID: \"ff3e02fa-45b8-4aa2-acb0-5b4e791b5c7c\") " pod="openshift-ovn-kubernetes/ovnkube-node-c9g74"
Jul 23 16:15:20.601303 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:20.600858    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/ff3e02fa-45b8-4aa2-acb0-5b4e791b5c7c-env-overrides\") pod \"ovnkube-node-c9g74\" (UID: \"ff3e02fa-45b8-4aa2-acb0-5b4e791b5c7c\") " pod="openshift-ovn-kubernetes/ovnkube-node-c9g74"
Jul 23 16:15:20.601303 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:20.600862    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/dd8e418a-a9fa-4bb8-b939-fe242e316e72-etc-sysctl-conf\") pod \"tuned-ltz8k\" (UID: \"dd8e418a-a9fa-4bb8-b939-fe242e316e72\") " pod="openshift-cluster-node-tuning-operator/tuned-ltz8k"
Jul 23 16:15:20.601303 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:20.600882    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/d033268a-14e3-44c6-a470-313654dc9a6e-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-jjtst\" (UID: \"d033268a-14e3-44c6-a470-313654dc9a6e\") " pod="openshift-multus/multus-additional-cni-plugins-jjtst"
Jul 23 16:15:20.601303 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:20.600909    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/d033268a-14e3-44c6-a470-313654dc9a6e-os-release\") pod \"multus-additional-cni-plugins-jjtst\" (UID: \"d033268a-14e3-44c6-a470-313654dc9a6e\") " pod="openshift-multus/multus-additional-cni-plugins-jjtst"
Jul 23 16:15:20.601303 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:20.600936    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n9cc5\" (UniqueName: \"kubernetes.io/projected/0ce6ab38-81a0-43b1-865b-42c65798de75-kube-api-access-n9cc5\") pod \"network-metrics-daemon-bkpz9\" (UID: \"0ce6ab38-81a0-43b1-865b-42c65798de75\") " pod="openshift-multus/network-metrics-daemon-bkpz9"
Jul 23 16:15:20.601303 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:20.600962    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/dd8e418a-a9fa-4bb8-b939-fe242e316e72-run\") pod \"tuned-ltz8k\" (UID: \"dd8e418a-a9fa-4bb8-b939-fe242e316e72\") " pod="openshift-cluster-node-tuning-operator/tuned-ltz8k"
Jul 23 16:15:20.601303 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:20.600987    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f8e034fc-9e28-43ab-bd6e-a62848b2ac5d-tmp-dir\") pod \"node-resolver-qbjm4\" (UID: \"f8e034fc-9e28-43ab-bd6e-a62848b2ac5d\") " pod="openshift-dns/node-resolver-qbjm4"
Jul 23 16:15:20.601303 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:20.601014    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/75b0ea12-192f-4910-b245-83d1df9119e7-host-slash\") pod \"iptables-alerter-2vp4s\" (UID: \"75b0ea12-192f-4910-b245-83d1df9119e7\") " pod="openshift-network-operator/iptables-alerter-2vp4s"
Jul 23 16:15:20.601303 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:20.601037    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/83d1126c-3d57-463e-bce5-e1716daa5eb7-hostroot\") pod \"multus-bkx5j\" (UID: \"83d1126c-3d57-463e-bce5-e1716daa5eb7\") " pod="openshift-multus/multus-bkx5j"
Jul 23 16:15:20.602121 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:20.601076    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ff3e02fa-45b8-4aa2-acb0-5b4e791b5c7c-host-run-ovn-kubernetes\") pod \"ovnkube-node-c9g74\" (UID: \"ff3e02fa-45b8-4aa2-acb0-5b4e791b5c7c\") " pod="openshift-ovn-kubernetes/ovnkube-node-c9g74"
Jul 23 16:15:20.602121 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:20.601104    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/ff3e02fa-45b8-4aa2-acb0-5b4e791b5c7c-ovnkube-script-lib\") pod \"ovnkube-node-c9g74\" (UID: \"ff3e02fa-45b8-4aa2-acb0-5b4e791b5c7c\") " pod="openshift-ovn-kubernetes/ovnkube-node-c9g74"
Jul 23 16:15:20.602121 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:20.601127    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0ce6ab38-81a0-43b1-865b-42c65798de75-metrics-certs\") pod \"network-metrics-daemon-bkpz9\" (UID: \"0ce6ab38-81a0-43b1-865b-42c65798de75\") " pod="openshift-multus/network-metrics-daemon-bkpz9"
Jul 23 16:15:20.602121 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:20.601154    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/dd8e418a-a9fa-4bb8-b939-fe242e316e72-tmp\") pod \"tuned-ltz8k\" (UID: \"dd8e418a-a9fa-4bb8-b939-fe242e316e72\") " pod="openshift-cluster-node-tuning-operator/tuned-ltz8k"
Jul 23 16:15:20.602121 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:20.601162    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/dd8e418a-a9fa-4bb8-b939-fe242e316e72-run\") pod \"tuned-ltz8k\" (UID: \"dd8e418a-a9fa-4bb8-b939-fe242e316e72\") " pod="openshift-cluster-node-tuning-operator/tuned-ltz8k"
Jul 23 16:15:20.602121 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:20.601161    2553 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jul 23 16:15:20.602121 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:20.601197    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/75b0ea12-192f-4910-b245-83d1df9119e7-iptables-alerter-script\") pod \"iptables-alerter-2vp4s\" (UID: \"75b0ea12-192f-4910-b245-83d1df9119e7\") " pod="openshift-network-operator/iptables-alerter-2vp4s"
Jul 23 16:15:20.602121 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:20.601275    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/83d1126c-3d57-463e-bce5-e1716daa5eb7-multus-cni-dir\") pod \"multus-bkx5j\" (UID: \"83d1126c-3d57-463e-bce5-e1716daa5eb7\") " pod="openshift-multus/multus-bkx5j"
Jul 23 16:15:20.602121 ip-10-0-143-166 kubenswrapper[2553]: E0723 16:15:20.601290    2553 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 23 16:15:20.602121 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:20.601305    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k2vqj\" (UniqueName: \"kubernetes.io/projected/ff3e02fa-45b8-4aa2-acb0-5b4e791b5c7c-kube-api-access-k2vqj\") pod \"ovnkube-node-c9g74\" (UID: \"ff3e02fa-45b8-4aa2-acb0-5b4e791b5c7c\") " pod="openshift-ovn-kubernetes/ovnkube-node-c9g74"
Jul 23 16:15:20.602121 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:20.601335    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/d1f5fd12-987e-4a35-9764-e36f41189f33-registration-dir\") pod \"aws-ebs-csi-driver-node-x5s6t\" (UID: \"d1f5fd12-987e-4a35-9764-e36f41189f33\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x5s6t"
Jul 23 16:15:20.602121 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:20.601372    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f8e034fc-9e28-43ab-bd6e-a62848b2ac5d-tmp-dir\") pod \"node-resolver-qbjm4\" (UID: \"f8e034fc-9e28-43ab-bd6e-a62848b2ac5d\") " pod="openshift-dns/node-resolver-qbjm4"
Jul 23 16:15:20.602121 ip-10-0-143-166 kubenswrapper[2553]: E0723 16:15:20.601382    2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0ce6ab38-81a0-43b1-865b-42c65798de75-metrics-certs podName:0ce6ab38-81a0-43b1-865b-42c65798de75 nodeName:}" failed. No retries permitted until 2026-07-23 16:15:21.10134664 +0000 UTC m=+2.965952763 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0ce6ab38-81a0-43b1-865b-42c65798de75-metrics-certs") pod "network-metrics-daemon-bkpz9" (UID: "0ce6ab38-81a0-43b1-865b-42c65798de75") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 23 16:15:20.602121 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:20.601436    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/d1f5fd12-987e-4a35-9764-e36f41189f33-etc-selinux\") pod \"aws-ebs-csi-driver-node-x5s6t\" (UID: \"d1f5fd12-987e-4a35-9764-e36f41189f33\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x5s6t"
Jul 23 16:15:20.602121 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:20.601467    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-stmdg\" (UniqueName: \"kubernetes.io/projected/d1f5fd12-987e-4a35-9764-e36f41189f33-kube-api-access-stmdg\") pod \"aws-ebs-csi-driver-node-x5s6t\" (UID: \"d1f5fd12-987e-4a35-9764-e36f41189f33\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x5s6t"
Jul 23 16:15:20.602121 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:20.601494    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/dd8e418a-a9fa-4bb8-b939-fe242e316e72-host\") pod \"tuned-ltz8k\" (UID: \"dd8e418a-a9fa-4bb8-b939-fe242e316e72\") " pod="openshift-cluster-node-tuning-operator/tuned-ltz8k"
Jul 23 16:15:20.602121 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:20.601521    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kgpc6\" (UniqueName: \"kubernetes.io/projected/dd8e418a-a9fa-4bb8-b939-fe242e316e72-kube-api-access-kgpc6\") pod \"tuned-ltz8k\" (UID: \"dd8e418a-a9fa-4bb8-b939-fe242e316e72\") " pod="openshift-cluster-node-tuning-operator/tuned-ltz8k"
Jul 23 16:15:20.602932 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:20.601547    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/ff3e02fa-45b8-4aa2-acb0-5b4e791b5c7c-ovn-node-metrics-cert\") pod \"ovnkube-node-c9g74\" (UID: \"ff3e02fa-45b8-4aa2-acb0-5b4e791b5c7c\") " pod="openshift-ovn-kubernetes/ovnkube-node-c9g74"
Jul 23 16:15:20.602932 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:20.601552    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/dd8e418a-a9fa-4bb8-b939-fe242e316e72-host\") pod \"tuned-ltz8k\" (UID: \"dd8e418a-a9fa-4bb8-b939-fe242e316e72\") " pod="openshift-cluster-node-tuning-operator/tuned-ltz8k"
Jul 23 16:15:20.602932 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:20.601567    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/1af4cdcf-98b6-4aab-b234-3bed6566658b-serviceca\") pod \"node-ca-cnp2t\" (UID: \"1af4cdcf-98b6-4aab-b234-3bed6566658b\") " pod="openshift-image-registry/node-ca-cnp2t"
Jul 23 16:15:20.602932 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:20.601589    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/dd8e418a-a9fa-4bb8-b939-fe242e316e72-etc-kubernetes\") pod \"tuned-ltz8k\" (UID: \"dd8e418a-a9fa-4bb8-b939-fe242e316e72\") " pod="openshift-cluster-node-tuning-operator/tuned-ltz8k"
Jul 23 16:15:20.602932 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:20.601610    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/83d1126c-3d57-463e-bce5-e1716daa5eb7-cnibin\") pod \"multus-bkx5j\" (UID: \"83d1126c-3d57-463e-bce5-e1716daa5eb7\") " pod="openshift-multus/multus-bkx5j"
Jul 23 16:15:20.602932 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:20.601636    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/83d1126c-3d57-463e-bce5-e1716daa5eb7-host-run-netns\") pod \"multus-bkx5j\" (UID: \"83d1126c-3d57-463e-bce5-e1716daa5eb7\") " pod="openshift-multus/multus-bkx5j"
Jul 23 16:15:20.602932 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:20.601652    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/dd8e418a-a9fa-4bb8-b939-fe242e316e72-etc-kubernetes\") pod \"tuned-ltz8k\" (UID: \"dd8e418a-a9fa-4bb8-b939-fe242e316e72\") " pod="openshift-cluster-node-tuning-operator/tuned-ltz8k"
Jul 23 16:15:20.602932 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:20.601663    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/83d1126c-3d57-463e-bce5-e1716daa5eb7-host-var-lib-kubelet\") pod \"multus-bkx5j\" (UID: \"83d1126c-3d57-463e-bce5-e1716daa5eb7\") " pod="openshift-multus/multus-bkx5j"
Jul 23 16:15:20.602932 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:20.601703    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/ff3e02fa-45b8-4aa2-acb0-5b4e791b5c7c-systemd-units\") pod \"ovnkube-node-c9g74\" (UID: \"ff3e02fa-45b8-4aa2-acb0-5b4e791b5c7c\") " pod="openshift-ovn-kubernetes/ovnkube-node-c9g74"
Jul 23 16:15:20.602932 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:20.601723    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/ff3e02fa-45b8-4aa2-acb0-5b4e791b5c7c-log-socket\") pod \"ovnkube-node-c9g74\" (UID: \"ff3e02fa-45b8-4aa2-acb0-5b4e791b5c7c\") " pod="openshift-ovn-kubernetes/ovnkube-node-c9g74"
Jul 23 16:15:20.602932 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:20.601741    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ff3e02fa-45b8-4aa2-acb0-5b4e791b5c7c-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-c9g74\" (UID: \"ff3e02fa-45b8-4aa2-acb0-5b4e791b5c7c\") " pod="openshift-ovn-kubernetes/ovnkube-node-c9g74"
Jul 23 16:15:20.602932 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:20.601757    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c0d761bc-9c6e-4617-a75d-1811fc235f16-original-pull-secret\") pod \"global-pull-secret-syncer-lqmct\" (UID: \"c0d761bc-9c6e-4617-a75d-1811fc235f16\") " pod="kube-system/global-pull-secret-syncer-lqmct"
Jul 23 16:15:20.602932 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:20.601780    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d033268a-14e3-44c6-a470-313654dc9a6e-system-cni-dir\") pod \"multus-additional-cni-plugins-jjtst\" (UID: \"d033268a-14e3-44c6-a470-313654dc9a6e\") " pod="openshift-multus/multus-additional-cni-plugins-jjtst"
Jul 23 16:15:20.602932 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:20.601818    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d033268a-14e3-44c6-a470-313654dc9a6e-tuning-conf-dir\") pod \"multus-additional-cni-plugins-jjtst\" (UID: \"d033268a-14e3-44c6-a470-313654dc9a6e\") " pod="openshift-multus/multus-additional-cni-plugins-jjtst"
Jul 23 16:15:20.602932 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:20.601848    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/dd8e418a-a9fa-4bb8-b939-fe242e316e72-var-lib-kubelet\") pod \"tuned-ltz8k\" (UID: \"dd8e418a-a9fa-4bb8-b939-fe242e316e72\") " pod="openshift-cluster-node-tuning-operator/tuned-ltz8k"
Jul 23 16:15:20.602932 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:20.601888    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/83d1126c-3d57-463e-bce5-e1716daa5eb7-host-run-k8s-cni-cncf-io\") pod \"multus-bkx5j\" (UID: \"83d1126c-3d57-463e-bce5-e1716daa5eb7\") " pod="openshift-multus/multus-bkx5j"
Jul 23 16:15:20.602932 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:20.601912    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/83d1126c-3d57-463e-bce5-e1716daa5eb7-multus-conf-dir\") pod \"multus-bkx5j\" (UID: \"83d1126c-3d57-463e-bce5-e1716daa5eb7\") " pod="openshift-multus/multus-bkx5j"
Jul 23 16:15:20.603832 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:20.601950    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/ff3e02fa-45b8-4aa2-acb0-5b4e791b5c7c-run-systemd\") pod \"ovnkube-node-c9g74\" (UID: \"ff3e02fa-45b8-4aa2-acb0-5b4e791b5c7c\") " pod="openshift-ovn-kubernetes/ovnkube-node-c9g74"
Jul 23 16:15:20.603832 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:20.601982    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/d1f5fd12-987e-4a35-9764-e36f41189f33-device-dir\") pod \"aws-ebs-csi-driver-node-x5s6t\" (UID: \"d1f5fd12-987e-4a35-9764-e36f41189f33\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x5s6t"
Jul 23 16:15:20.603832 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:20.601957    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/dd8e418a-a9fa-4bb8-b939-fe242e316e72-var-lib-kubelet\") pod \"tuned-ltz8k\" (UID: \"dd8e418a-a9fa-4bb8-b939-fe242e316e72\") " pod="openshift-cluster-node-tuning-operator/tuned-ltz8k"
Jul 23 16:15:20.603832 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:20.602009    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/c0d761bc-9c6e-4617-a75d-1811fc235f16-kubelet-config\") pod \"global-pull-secret-syncer-lqmct\" (UID: \"c0d761bc-9c6e-4617-a75d-1811fc235f16\") " pod="kube-system/global-pull-secret-syncer-lqmct"
Jul 23 16:15:20.603832 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:20.602036    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/83d1126c-3d57-463e-bce5-e1716daa5eb7-system-cni-dir\") pod \"multus-bkx5j\" (UID: \"83d1126c-3d57-463e-bce5-e1716daa5eb7\") " pod="openshift-multus/multus-bkx5j"
Jul 23 16:15:20.603832 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:20.602062    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/83d1126c-3d57-463e-bce5-e1716daa5eb7-cni-binary-copy\") pod \"multus-bkx5j\" (UID: \"83d1126c-3d57-463e-bce5-e1716daa5eb7\") " pod="openshift-multus/multus-bkx5j"
Jul 23 16:15:20.603832 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:20.602070    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/1af4cdcf-98b6-4aab-b234-3bed6566658b-serviceca\") pod \"node-ca-cnp2t\" (UID: \"1af4cdcf-98b6-4aab-b234-3bed6566658b\") " pod="openshift-image-registry/node-ca-cnp2t"
Jul 23 16:15:20.603832 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:20.602089    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k6qn9\" (UniqueName: \"kubernetes.io/projected/83d1126c-3d57-463e-bce5-e1716daa5eb7-kube-api-access-k6qn9\") pod \"multus-bkx5j\" (UID: \"83d1126c-3d57-463e-bce5-e1716daa5eb7\") " pod="openshift-multus/multus-bkx5j"
Jul 23 16:15:20.603832 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:20.602116    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d033268a-14e3-44c6-a470-313654dc9a6e-cnibin\") pod \"multus-additional-cni-plugins-jjtst\" (UID: \"d033268a-14e3-44c6-a470-313654dc9a6e\") " pod="openshift-multus/multus-additional-cni-plugins-jjtst"
Jul 23 16:15:20.603832 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:20.602141    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/d033268a-14e3-44c6-a470-313654dc9a6e-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-jjtst\" (UID: \"d033268a-14e3-44c6-a470-313654dc9a6e\") " pod="openshift-multus/multus-additional-cni-plugins-jjtst"
Jul 23 16:15:20.603832 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:20.602217    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/dd8e418a-a9fa-4bb8-b939-fe242e316e72-sys\") pod \"tuned-ltz8k\" (UID: \"dd8e418a-a9fa-4bb8-b939-fe242e316e72\") " pod="openshift-cluster-node-tuning-operator/tuned-ltz8k"
Jul 23 16:15:20.603832 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:20.602252    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-twckl\" (UniqueName: \"kubernetes.io/projected/75b0ea12-192f-4910-b245-83d1df9119e7-kube-api-access-twckl\") pod \"iptables-alerter-2vp4s\" (UID: \"75b0ea12-192f-4910-b245-83d1df9119e7\") " pod="openshift-network-operator/iptables-alerter-2vp4s"
Jul 23 16:15:20.603832 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:20.602267    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/dd8e418a-a9fa-4bb8-b939-fe242e316e72-sys\") pod \"tuned-ltz8k\" (UID: \"dd8e418a-a9fa-4bb8-b939-fe242e316e72\") " pod="openshift-cluster-node-tuning-operator/tuned-ltz8k"
Jul 23 16:15:20.603832 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:20.602284    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/83d1126c-3d57-463e-bce5-e1716daa5eb7-multus-daemon-config\") pod \"multus-bkx5j\" (UID: \"83d1126c-3d57-463e-bce5-e1716daa5eb7\") " pod="openshift-multus/multus-bkx5j"
Jul 23 16:15:20.603832 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:20.602302    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ff3e02fa-45b8-4aa2-acb0-5b4e791b5c7c-host-slash\") pod \"ovnkube-node-c9g74\" (UID: \"ff3e02fa-45b8-4aa2-acb0-5b4e791b5c7c\") " pod="openshift-ovn-kubernetes/ovnkube-node-c9g74"
Jul 23 16:15:20.603832 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:20.602319    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d033268a-14e3-44c6-a470-313654dc9a6e-cni-binary-copy\") pod \"multus-additional-cni-plugins-jjtst\" (UID: \"d033268a-14e3-44c6-a470-313654dc9a6e\") " pod="openshift-multus/multus-additional-cni-plugins-jjtst"
Jul 23 16:15:20.603832 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:20.602337    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/dd8e418a-a9fa-4bb8-b939-fe242e316e72-etc-sysconfig\") pod \"tuned-ltz8k\" (UID: \"dd8e418a-a9fa-4bb8-b939-fe242e316e72\") " pod="openshift-cluster-node-tuning-operator/tuned-ltz8k"
Jul 23 16:15:20.604660 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:20.602363    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/dd8e418a-a9fa-4bb8-b939-fe242e316e72-lib-modules\") pod \"tuned-ltz8k\" (UID: \"dd8e418a-a9fa-4bb8-b939-fe242e316e72\") " pod="openshift-cluster-node-tuning-operator/tuned-ltz8k"
Jul 23 16:15:20.604660 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:20.602384    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/83d1126c-3d57-463e-bce5-e1716daa5eb7-host-var-lib-cni-multus\") pod \"multus-bkx5j\" (UID: \"83d1126c-3d57-463e-bce5-e1716daa5eb7\") " pod="openshift-multus/multus-bkx5j"
Jul 23 16:15:20.604660 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:20.602395    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/dd8e418a-a9fa-4bb8-b939-fe242e316e72-etc-sysconfig\") pod \"tuned-ltz8k\" (UID: \"dd8e418a-a9fa-4bb8-b939-fe242e316e72\") " pod="openshift-cluster-node-tuning-operator/tuned-ltz8k"
Jul 23 16:15:20.604660 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:20.602426    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ff3e02fa-45b8-4aa2-acb0-5b4e791b5c7c-host-run-netns\") pod \"ovnkube-node-c9g74\" (UID: \"ff3e02fa-45b8-4aa2-acb0-5b4e791b5c7c\") " pod="openshift-ovn-kubernetes/ovnkube-node-c9g74"
Jul 23 16:15:20.604660 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:20.602454    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/d1f5fd12-987e-4a35-9764-e36f41189f33-socket-dir\") pod \"aws-ebs-csi-driver-node-x5s6t\" (UID: \"d1f5fd12-987e-4a35-9764-e36f41189f33\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x5s6t"
Jul 23 16:15:20.604660 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:20.602458    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/dd8e418a-a9fa-4bb8-b939-fe242e316e72-lib-modules\") pod \"tuned-ltz8k\" (UID: \"dd8e418a-a9fa-4bb8-b939-fe242e316e72\") " pod="openshift-cluster-node-tuning-operator/tuned-ltz8k"
Jul 23 16:15:20.604660 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:20.602476    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/c0d761bc-9c6e-4617-a75d-1811fc235f16-dbus\") pod \"global-pull-secret-syncer-lqmct\" (UID: \"c0d761bc-9c6e-4617-a75d-1811fc235f16\") " pod="kube-system/global-pull-secret-syncer-lqmct"
Jul 23 16:15:20.604660 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:20.602492    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lp2fm\" (UniqueName: \"kubernetes.io/projected/d033268a-14e3-44c6-a470-313654dc9a6e-kube-api-access-lp2fm\") pod \"multus-additional-cni-plugins-jjtst\" (UID: \"d033268a-14e3-44c6-a470-313654dc9a6e\") " pod="openshift-multus/multus-additional-cni-plugins-jjtst"
Jul 23 16:15:20.604660 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:20.602510    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/dd8e418a-a9fa-4bb8-b939-fe242e316e72-etc-sysctl-d\") pod \"tuned-ltz8k\" (UID: \"dd8e418a-a9fa-4bb8-b939-fe242e316e72\") " pod="openshift-cluster-node-tuning-operator/tuned-ltz8k"
Jul 23 16:15:20.604660 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:20.602532    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jg2xg\" (UniqueName: \"kubernetes.io/projected/f8e034fc-9e28-43ab-bd6e-a62848b2ac5d-kube-api-access-jg2xg\") pod \"node-resolver-qbjm4\" (UID: \"f8e034fc-9e28-43ab-bd6e-a62848b2ac5d\") " pod="openshift-dns/node-resolver-qbjm4"
Jul 23 16:15:20.604660 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:20.602651    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/dd8e418a-a9fa-4bb8-b939-fe242e316e72-etc-sysctl-d\") pod \"tuned-ltz8k\" (UID: \"dd8e418a-a9fa-4bb8-b939-fe242e316e72\") " pod="openshift-cluster-node-tuning-operator/tuned-ltz8k"
Jul 23 16:15:20.604660 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:20.604642    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/dd8e418a-a9fa-4bb8-b939-fe242e316e72-etc-tuned\") pod \"tuned-ltz8k\" (UID: \"dd8e418a-a9fa-4bb8-b939-fe242e316e72\") " pod="openshift-cluster-node-tuning-operator/tuned-ltz8k"
Jul 23 16:15:20.605021 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:20.604729    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/dd8e418a-a9fa-4bb8-b939-fe242e316e72-tmp\") pod \"tuned-ltz8k\" (UID: \"dd8e418a-a9fa-4bb8-b939-fe242e316e72\") " pod="openshift-cluster-node-tuning-operator/tuned-ltz8k"
Jul 23 16:15:20.613151 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:20.613126    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v5s2p\" (UniqueName: \"kubernetes.io/projected/1af4cdcf-98b6-4aab-b234-3bed6566658b-kube-api-access-v5s2p\") pod \"node-ca-cnp2t\" (UID: \"1af4cdcf-98b6-4aab-b234-3bed6566658b\") " pod="openshift-image-registry/node-ca-cnp2t"
Jul 23 16:15:20.613578 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:20.613554    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kgpc6\" (UniqueName: \"kubernetes.io/projected/dd8e418a-a9fa-4bb8-b939-fe242e316e72-kube-api-access-kgpc6\") pod \"tuned-ltz8k\" (UID: \"dd8e418a-a9fa-4bb8-b939-fe242e316e72\") " pod="openshift-cluster-node-tuning-operator/tuned-ltz8k"
Jul 23 16:15:20.613646 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:20.613583    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jg2xg\" (UniqueName: \"kubernetes.io/projected/f8e034fc-9e28-43ab-bd6e-a62848b2ac5d-kube-api-access-jg2xg\") pod \"node-resolver-qbjm4\" (UID: \"f8e034fc-9e28-43ab-bd6e-a62848b2ac5d\") " pod="openshift-dns/node-resolver-qbjm4"
Jul 23 16:15:20.613646 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:20.613631    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n9cc5\" (UniqueName: \"kubernetes.io/projected/0ce6ab38-81a0-43b1-865b-42c65798de75-kube-api-access-n9cc5\") pod \"network-metrics-daemon-bkpz9\" (UID: \"0ce6ab38-81a0-43b1-865b-42c65798de75\") " pod="openshift-multus/network-metrics-daemon-bkpz9"
Jul 23 16:15:20.674859 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:20.674805    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-166.ec2.internal" event={"ID":"90edd8487e9f34a3dfeb9db04264b82f","Type":"ContainerStarted","Data":"285398de4656e395b04ada6008a0dc53b5cc7c12a46c1b1d2e2f22f480e13993"}
Jul 23 16:15:20.675857 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:20.675831    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-166.ec2.internal" event={"ID":"0069169d441a4ee10e0c5814a4929874","Type":"ContainerStarted","Data":"e2a4d1628b7cc8c044ccf16a7066228c813419222a3bf2fd092b9e6b820cda3a"}
Jul 23 16:15:20.703726 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:20.703636    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k2vqj\" (UniqueName: \"kubernetes.io/projected/ff3e02fa-45b8-4aa2-acb0-5b4e791b5c7c-kube-api-access-k2vqj\") pod \"ovnkube-node-c9g74\" (UID: \"ff3e02fa-45b8-4aa2-acb0-5b4e791b5c7c\") " pod="openshift-ovn-kubernetes/ovnkube-node-c9g74"
Jul 23 16:15:20.703726 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:20.703668    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/d1f5fd12-987e-4a35-9764-e36f41189f33-registration-dir\") pod \"aws-ebs-csi-driver-node-x5s6t\" (UID: \"d1f5fd12-987e-4a35-9764-e36f41189f33\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x5s6t"
Jul 23 16:15:20.703726 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:20.703687    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/d1f5fd12-987e-4a35-9764-e36f41189f33-etc-selinux\") pod \"aws-ebs-csi-driver-node-x5s6t\" (UID: \"d1f5fd12-987e-4a35-9764-e36f41189f33\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x5s6t"
Jul 23 16:15:20.703726 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:20.703711    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-stmdg\" (UniqueName: \"kubernetes.io/projected/d1f5fd12-987e-4a35-9764-e36f41189f33-kube-api-access-stmdg\") pod \"aws-ebs-csi-driver-node-x5s6t\" (UID: \"d1f5fd12-987e-4a35-9764-e36f41189f33\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x5s6t"
Jul 23 16:15:20.704066 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:20.703739    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/ff3e02fa-45b8-4aa2-acb0-5b4e791b5c7c-ovn-node-metrics-cert\") pod \"ovnkube-node-c9g74\" (UID: \"ff3e02fa-45b8-4aa2-acb0-5b4e791b5c7c\") " pod="openshift-ovn-kubernetes/ovnkube-node-c9g74"
Jul 23 16:15:20.704066 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:20.703768    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/83d1126c-3d57-463e-bce5-e1716daa5eb7-cnibin\") pod \"multus-bkx5j\" (UID: \"83d1126c-3d57-463e-bce5-e1716daa5eb7\") " pod="openshift-multus/multus-bkx5j"
Jul 23 16:15:20.704066 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:20.703789    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/d1f5fd12-987e-4a35-9764-e36f41189f33-registration-dir\") pod \"aws-ebs-csi-driver-node-x5s6t\" (UID: \"d1f5fd12-987e-4a35-9764-e36f41189f33\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x5s6t"
Jul 23 16:15:20.704066 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:20.703794    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/83d1126c-3d57-463e-bce5-e1716daa5eb7-host-run-netns\") pod \"multus-bkx5j\" (UID: \"83d1126c-3d57-463e-bce5-e1716daa5eb7\") " pod="openshift-multus/multus-bkx5j"
Jul 23 16:15:20.704066 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:20.703829    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/83d1126c-3d57-463e-bce5-e1716daa5eb7-host-var-lib-kubelet\") pod \"multus-bkx5j\" (UID: \"83d1126c-3d57-463e-bce5-e1716daa5eb7\") " pod="openshift-multus/multus-bkx5j"
Jul 23 16:15:20.704066 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:20.703834    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/83d1126c-3d57-463e-bce5-e1716daa5eb7-host-run-netns\") pod \"multus-bkx5j\" (UID: \"83d1126c-3d57-463e-bce5-e1716daa5eb7\") " pod="openshift-multus/multus-bkx5j"
Jul 23 16:15:20.704066 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:20.703856    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/ff3e02fa-45b8-4aa2-acb0-5b4e791b5c7c-systemd-units\") pod \"ovnkube-node-c9g74\" (UID: \"ff3e02fa-45b8-4aa2-acb0-5b4e791b5c7c\") " pod="openshift-ovn-kubernetes/ovnkube-node-c9g74"
Jul 23 16:15:20.704066 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:20.703876    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/d1f5fd12-987e-4a35-9764-e36f41189f33-etc-selinux\") pod \"aws-ebs-csi-driver-node-x5s6t\" (UID: \"d1f5fd12-987e-4a35-9764-e36f41189f33\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x5s6t"
Jul 23 16:15:20.704066 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:20.703897    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/83d1126c-3d57-463e-bce5-e1716daa5eb7-cnibin\") pod \"multus-bkx5j\" (UID: \"83d1126c-3d57-463e-bce5-e1716daa5eb7\") " pod="openshift-multus/multus-bkx5j"
Jul 23 16:15:20.704066 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:20.703885    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/ff3e02fa-45b8-4aa2-acb0-5b4e791b5c7c-log-socket\") pod \"ovnkube-node-c9g74\" (UID: \"ff3e02fa-45b8-4aa2-acb0-5b4e791b5c7c\") " pod="openshift-ovn-kubernetes/ovnkube-node-c9g74"
Jul 23 16:15:20.704066 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:20.703917    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/ff3e02fa-45b8-4aa2-acb0-5b4e791b5c7c-log-socket\") pod \"ovnkube-node-c9g74\" (UID: \"ff3e02fa-45b8-4aa2-acb0-5b4e791b5c7c\") " pod="openshift-ovn-kubernetes/ovnkube-node-c9g74"
Jul 23 16:15:20.704066 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:20.703937    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/83d1126c-3d57-463e-bce5-e1716daa5eb7-host-var-lib-kubelet\") pod \"multus-bkx5j\" (UID: \"83d1126c-3d57-463e-bce5-e1716daa5eb7\") " pod="openshift-multus/multus-bkx5j"
Jul 23 16:15:20.704066 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:20.703946    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ff3e02fa-45b8-4aa2-acb0-5b4e791b5c7c-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-c9g74\" (UID: \"ff3e02fa-45b8-4aa2-acb0-5b4e791b5c7c\") " pod="openshift-ovn-kubernetes/ovnkube-node-c9g74"
Jul 23 16:15:20.704066 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:20.703961    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/ff3e02fa-45b8-4aa2-acb0-5b4e791b5c7c-systemd-units\") pod \"ovnkube-node-c9g74\" (UID: \"ff3e02fa-45b8-4aa2-acb0-5b4e791b5c7c\") " pod="openshift-ovn-kubernetes/ovnkube-node-c9g74"
Jul 23 16:15:20.704066 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:20.703974    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ff3e02fa-45b8-4aa2-acb0-5b4e791b5c7c-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-c9g74\" (UID: \"ff3e02fa-45b8-4aa2-acb0-5b4e791b5c7c\") " pod="openshift-ovn-kubernetes/ovnkube-node-c9g74"
Jul 23 16:15:20.704066 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:20.703991    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c0d761bc-9c6e-4617-a75d-1811fc235f16-original-pull-secret\") pod \"global-pull-secret-syncer-lqmct\" (UID: \"c0d761bc-9c6e-4617-a75d-1811fc235f16\") " pod="kube-system/global-pull-secret-syncer-lqmct"
Jul 23 16:15:20.704066 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:20.704021    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d033268a-14e3-44c6-a470-313654dc9a6e-system-cni-dir\") pod \"multus-additional-cni-plugins-jjtst\" (UID: \"d033268a-14e3-44c6-a470-313654dc9a6e\") " pod="openshift-multus/multus-additional-cni-plugins-jjtst"
Jul 23 16:15:20.704953 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:20.704080    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d033268a-14e3-44c6-a470-313654dc9a6e-tuning-conf-dir\") pod \"multus-additional-cni-plugins-jjtst\" (UID: \"d033268a-14e3-44c6-a470-313654dc9a6e\") " pod="openshift-multus/multus-additional-cni-plugins-jjtst"
Jul 23 16:15:20.704953 ip-10-0-143-166 kubenswrapper[2553]: E0723 16:15:20.704102    2553 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 23 16:15:20.704953 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:20.704109    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/83d1126c-3d57-463e-bce5-e1716daa5eb7-host-run-k8s-cni-cncf-io\") pod \"multus-bkx5j\" (UID: \"83d1126c-3d57-463e-bce5-e1716daa5eb7\") " pod="openshift-multus/multus-bkx5j"
Jul 23 16:15:20.704953 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:20.704138    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/83d1126c-3d57-463e-bce5-e1716daa5eb7-multus-conf-dir\") pod \"multus-bkx5j\" (UID: \"83d1126c-3d57-463e-bce5-e1716daa5eb7\") " pod="openshift-multus/multus-bkx5j"
Jul 23 16:15:20.704953 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:20.704141    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d033268a-14e3-44c6-a470-313654dc9a6e-system-cni-dir\") pod \"multus-additional-cni-plugins-jjtst\" (UID: \"d033268a-14e3-44c6-a470-313654dc9a6e\") " pod="openshift-multus/multus-additional-cni-plugins-jjtst"
Jul 23 16:15:20.704953 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:20.704163    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/ff3e02fa-45b8-4aa2-acb0-5b4e791b5c7c-run-systemd\") pod \"ovnkube-node-c9g74\" (UID: \"ff3e02fa-45b8-4aa2-acb0-5b4e791b5c7c\") " pod="openshift-ovn-kubernetes/ovnkube-node-c9g74"
Jul 23 16:15:20.704953 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:20.704152    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/83d1126c-3d57-463e-bce5-e1716daa5eb7-host-run-k8s-cni-cncf-io\") pod \"multus-bkx5j\" (UID: \"83d1126c-3d57-463e-bce5-e1716daa5eb7\") " pod="openshift-multus/multus-bkx5j"
Jul 23 16:15:20.704953 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:20.704196    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/83d1126c-3d57-463e-bce5-e1716daa5eb7-multus-conf-dir\") pod \"multus-bkx5j\" (UID: \"83d1126c-3d57-463e-bce5-e1716daa5eb7\") " pod="openshift-multus/multus-bkx5j"
Jul 23 16:15:20.704953 ip-10-0-143-166 kubenswrapper[2553]: E0723 16:15:20.704198    2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c0d761bc-9c6e-4617-a75d-1811fc235f16-original-pull-secret podName:c0d761bc-9c6e-4617-a75d-1811fc235f16 nodeName:}" failed. No retries permitted until 2026-07-23 16:15:21.204159242 +0000 UTC m=+3.068765366 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c0d761bc-9c6e-4617-a75d-1811fc235f16-original-pull-secret") pod "global-pull-secret-syncer-lqmct" (UID: "c0d761bc-9c6e-4617-a75d-1811fc235f16") : object "kube-system"/"original-pull-secret" not registered
Jul 23 16:15:20.704953 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:20.704216    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/ff3e02fa-45b8-4aa2-acb0-5b4e791b5c7c-run-systemd\") pod \"ovnkube-node-c9g74\" (UID: \"ff3e02fa-45b8-4aa2-acb0-5b4e791b5c7c\") " pod="openshift-ovn-kubernetes/ovnkube-node-c9g74"
Jul 23 16:15:20.704953 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:20.704246    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/d1f5fd12-987e-4a35-9764-e36f41189f33-device-dir\") pod \"aws-ebs-csi-driver-node-x5s6t\" (UID: \"d1f5fd12-987e-4a35-9764-e36f41189f33\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x5s6t"
Jul 23 16:15:20.704953 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:20.704266    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/c0d761bc-9c6e-4617-a75d-1811fc235f16-kubelet-config\") pod \"global-pull-secret-syncer-lqmct\" (UID: \"c0d761bc-9c6e-4617-a75d-1811fc235f16\") " pod="kube-system/global-pull-secret-syncer-lqmct"
Jul 23 16:15:20.704953 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:20.704282    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/83d1126c-3d57-463e-bce5-e1716daa5eb7-system-cni-dir\") pod \"multus-bkx5j\" (UID: \"83d1126c-3d57-463e-bce5-e1716daa5eb7\") " pod="openshift-multus/multus-bkx5j"
Jul 23 16:15:20.704953 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:20.704299    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d033268a-14e3-44c6-a470-313654dc9a6e-tuning-conf-dir\") pod \"multus-additional-cni-plugins-jjtst\" (UID: \"d033268a-14e3-44c6-a470-313654dc9a6e\") " pod="openshift-multus/multus-additional-cni-plugins-jjtst"
Jul 23 16:15:20.704953 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:20.704305    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/83d1126c-3d57-463e-bce5-e1716daa5eb7-cni-binary-copy\") pod \"multus-bkx5j\" (UID: \"83d1126c-3d57-463e-bce5-e1716daa5eb7\") " pod="openshift-multus/multus-bkx5j"
Jul 23 16:15:20.704953 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:20.704322    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/d1f5fd12-987e-4a35-9764-e36f41189f33-device-dir\") pod \"aws-ebs-csi-driver-node-x5s6t\" (UID: \"d1f5fd12-987e-4a35-9764-e36f41189f33\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x5s6t"
Jul 23 16:15:20.704953 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:20.704345    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k6qn9\" (UniqueName: \"kubernetes.io/projected/83d1126c-3d57-463e-bce5-e1716daa5eb7-kube-api-access-k6qn9\") pod \"multus-bkx5j\" (UID: \"83d1126c-3d57-463e-bce5-e1716daa5eb7\") " pod="openshift-multus/multus-bkx5j"
Jul 23 16:15:20.705833 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:20.704367    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/83d1126c-3d57-463e-bce5-e1716daa5eb7-system-cni-dir\") pod \"multus-bkx5j\" (UID: \"83d1126c-3d57-463e-bce5-e1716daa5eb7\") " pod="openshift-multus/multus-bkx5j"
Jul 23 16:15:20.705833 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:20.704374    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d033268a-14e3-44c6-a470-313654dc9a6e-cnibin\") pod \"multus-additional-cni-plugins-jjtst\" (UID: \"d033268a-14e3-44c6-a470-313654dc9a6e\") " pod="openshift-multus/multus-additional-cni-plugins-jjtst"
Jul 23 16:15:20.705833 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:20.704345    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/c0d761bc-9c6e-4617-a75d-1811fc235f16-kubelet-config\") pod \"global-pull-secret-syncer-lqmct\" (UID: \"c0d761bc-9c6e-4617-a75d-1811fc235f16\") " pod="kube-system/global-pull-secret-syncer-lqmct"
Jul 23 16:15:20.705833 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:20.704411    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/d033268a-14e3-44c6-a470-313654dc9a6e-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-jjtst\" (UID: \"d033268a-14e3-44c6-a470-313654dc9a6e\") " pod="openshift-multus/multus-additional-cni-plugins-jjtst"
Jul 23 16:15:20.705833 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:20.704418    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d033268a-14e3-44c6-a470-313654dc9a6e-cnibin\") pod \"multus-additional-cni-plugins-jjtst\" (UID: \"d033268a-14e3-44c6-a470-313654dc9a6e\") " pod="openshift-multus/multus-additional-cni-plugins-jjtst"
Jul 23 16:15:20.705833 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:20.704442    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-twckl\" (UniqueName: \"kubernetes.io/projected/75b0ea12-192f-4910-b245-83d1df9119e7-kube-api-access-twckl\") pod \"iptables-alerter-2vp4s\" (UID: \"75b0ea12-192f-4910-b245-83d1df9119e7\") " pod="openshift-network-operator/iptables-alerter-2vp4s"
Jul 23 16:15:20.705833 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:20.704461    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/83d1126c-3d57-463e-bce5-e1716daa5eb7-multus-daemon-config\") pod \"multus-bkx5j\" (UID: \"83d1126c-3d57-463e-bce5-e1716daa5eb7\") " pod="openshift-multus/multus-bkx5j"
Jul 23 16:15:20.705833 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:20.704477    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ff3e02fa-45b8-4aa2-acb0-5b4e791b5c7c-host-slash\") pod \"ovnkube-node-c9g74\" (UID: \"ff3e02fa-45b8-4aa2-acb0-5b4e791b5c7c\") " pod="openshift-ovn-kubernetes/ovnkube-node-c9g74"
Jul 23 16:15:20.705833 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:20.704494    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d033268a-14e3-44c6-a470-313654dc9a6e-cni-binary-copy\") pod \"multus-additional-cni-plugins-jjtst\" (UID: \"d033268a-14e3-44c6-a470-313654dc9a6e\") " pod="openshift-multus/multus-additional-cni-plugins-jjtst"
Jul 23 16:15:20.705833 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:20.704524    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/83d1126c-3d57-463e-bce5-e1716daa5eb7-host-var-lib-cni-multus\") pod \"multus-bkx5j\" (UID: \"83d1126c-3d57-463e-bce5-e1716daa5eb7\") " pod="openshift-multus/multus-bkx5j"
Jul 23 16:15:20.705833 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:20.704552    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ff3e02fa-45b8-4aa2-acb0-5b4e791b5c7c-host-run-netns\") pod \"ovnkube-node-c9g74\" (UID: \"ff3e02fa-45b8-4aa2-acb0-5b4e791b5c7c\") " pod="openshift-ovn-kubernetes/ovnkube-node-c9g74"
Jul 23 16:15:20.705833 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:20.704572    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ff3e02fa-45b8-4aa2-acb0-5b4e791b5c7c-host-slash\") pod \"ovnkube-node-c9g74\" (UID: \"ff3e02fa-45b8-4aa2-acb0-5b4e791b5c7c\") " pod="openshift-ovn-kubernetes/ovnkube-node-c9g74"
Jul 23 16:15:20.705833 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:20.704577    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/d1f5fd12-987e-4a35-9764-e36f41189f33-socket-dir\") pod \"aws-ebs-csi-driver-node-x5s6t\" (UID: \"d1f5fd12-987e-4a35-9764-e36f41189f33\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x5s6t"
Jul 23 16:15:20.705833 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:20.704618    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/c0d761bc-9c6e-4617-a75d-1811fc235f16-dbus\") pod \"global-pull-secret-syncer-lqmct\" (UID: \"c0d761bc-9c6e-4617-a75d-1811fc235f16\") " pod="kube-system/global-pull-secret-syncer-lqmct"
Jul 23 16:15:20.705833 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:20.704647    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lp2fm\" (UniqueName: \"kubernetes.io/projected/d033268a-14e3-44c6-a470-313654dc9a6e-kube-api-access-lp2fm\") pod \"multus-additional-cni-plugins-jjtst\" (UID: \"d033268a-14e3-44c6-a470-313654dc9a6e\") " pod="openshift-multus/multus-additional-cni-plugins-jjtst"
Jul 23 16:15:20.705833 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:20.704675    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/83d1126c-3d57-463e-bce5-e1716daa5eb7-host-var-lib-cni-bin\") pod \"multus-bkx5j\" (UID: \"83d1126c-3d57-463e-bce5-e1716daa5eb7\") " pod="openshift-multus/multus-bkx5j"
Jul 23 16:15:20.705833 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:20.704695    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/d1f5fd12-987e-4a35-9764-e36f41189f33-socket-dir\") pod \"aws-ebs-csi-driver-node-x5s6t\" (UID: \"d1f5fd12-987e-4a35-9764-e36f41189f33\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x5s6t"
Jul 23 16:15:20.706649 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:20.704708    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/bba31e38-01db-45a0-8b60-9fc626237e01-konnectivity-ca\") pod \"konnectivity-agent-j892l\" (UID: \"bba31e38-01db-45a0-8b60-9fc626237e01\") " pod="kube-system/konnectivity-agent-j892l"
Jul 23 16:15:20.706649 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:20.704720    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/83d1126c-3d57-463e-bce5-e1716daa5eb7-host-var-lib-cni-multus\") pod \"multus-bkx5j\" (UID: \"83d1126c-3d57-463e-bce5-e1716daa5eb7\") " pod="openshift-multus/multus-bkx5j"
Jul 23 16:15:20.706649 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:20.704736    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/ff3e02fa-45b8-4aa2-acb0-5b4e791b5c7c-run-ovn\") pod \"ovnkube-node-c9g74\" (UID: \"ff3e02fa-45b8-4aa2-acb0-5b4e791b5c7c\") " pod="openshift-ovn-kubernetes/ovnkube-node-c9g74"
Jul 23 16:15:20.706649 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:20.704746    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ff3e02fa-45b8-4aa2-acb0-5b4e791b5c7c-host-run-netns\") pod \"ovnkube-node-c9g74\" (UID: \"ff3e02fa-45b8-4aa2-acb0-5b4e791b5c7c\") " pod="openshift-ovn-kubernetes/ovnkube-node-c9g74"
Jul 23 16:15:20.706649 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:20.704762    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/bba31e38-01db-45a0-8b60-9fc626237e01-agent-certs\") pod \"konnectivity-agent-j892l\" (UID: \"bba31e38-01db-45a0-8b60-9fc626237e01\") " pod="kube-system/konnectivity-agent-j892l"
Jul 23 16:15:20.706649 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:20.704786    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/83d1126c-3d57-463e-bce5-e1716daa5eb7-host-var-lib-cni-bin\") pod \"multus-bkx5j\" (UID: \"83d1126c-3d57-463e-bce5-e1716daa5eb7\") " pod="openshift-multus/multus-bkx5j"
Jul 23 16:15:20.706649 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:20.704788    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wkd4x\" (UniqueName: \"kubernetes.io/projected/633a475b-ddec-4391-856d-67674aa0ef0c-kube-api-access-wkd4x\") pod \"network-check-target-8vt69\" (UID: \"633a475b-ddec-4391-856d-67674aa0ef0c\") " pod="openshift-network-diagnostics/network-check-target-8vt69"
Jul 23 16:15:20.706649 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:20.704825    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/ff3e02fa-45b8-4aa2-acb0-5b4e791b5c7c-ovnkube-config\") pod \"ovnkube-node-c9g74\" (UID: \"ff3e02fa-45b8-4aa2-acb0-5b4e791b5c7c\") " pod="openshift-ovn-kubernetes/ovnkube-node-c9g74"
Jul 23 16:15:20.706649 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:20.704855    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/ff3e02fa-45b8-4aa2-acb0-5b4e791b5c7c-host-kubelet\") pod \"ovnkube-node-c9g74\" (UID: \"ff3e02fa-45b8-4aa2-acb0-5b4e791b5c7c\") " pod="openshift-ovn-kubernetes/ovnkube-node-c9g74"
Jul 23 16:15:20.706649 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:20.704883    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/83d1126c-3d57-463e-bce5-e1716daa5eb7-cni-binary-copy\") pod \"multus-bkx5j\" (UID: \"83d1126c-3d57-463e-bce5-e1716daa5eb7\") " pod="openshift-multus/multus-bkx5j"
Jul 23 16:15:20.706649 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:20.704895    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/d1f5fd12-987e-4a35-9764-e36f41189f33-sys-fs\") pod \"aws-ebs-csi-driver-node-x5s6t\" (UID: \"d1f5fd12-987e-4a35-9764-e36f41189f33\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x5s6t"
Jul 23 16:15:20.706649 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:20.704930    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/83d1126c-3d57-463e-bce5-e1716daa5eb7-os-release\") pod \"multus-bkx5j\" (UID: \"83d1126c-3d57-463e-bce5-e1716daa5eb7\") " pod="openshift-multus/multus-bkx5j"
Jul 23 16:15:20.706649 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:20.704946    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/ff3e02fa-45b8-4aa2-acb0-5b4e791b5c7c-run-ovn\") pod \"ovnkube-node-c9g74\" (UID: \"ff3e02fa-45b8-4aa2-acb0-5b4e791b5c7c\") " pod="openshift-ovn-kubernetes/ovnkube-node-c9g74"
Jul 23 16:15:20.706649 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:20.704958    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/83d1126c-3d57-463e-bce5-e1716daa5eb7-host-run-multus-certs\") pod \"multus-bkx5j\" (UID: \"83d1126c-3d57-463e-bce5-e1716daa5eb7\") " pod="openshift-multus/multus-bkx5j"
Jul 23 16:15:20.706649 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:20.704986    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ff3e02fa-45b8-4aa2-acb0-5b4e791b5c7c-var-lib-openvswitch\") pod \"ovnkube-node-c9g74\" (UID: \"ff3e02fa-45b8-4aa2-acb0-5b4e791b5c7c\") " pod="openshift-ovn-kubernetes/ovnkube-node-c9g74"
Jul 23 16:15:20.706649 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:20.704997    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/d033268a-14e3-44c6-a470-313654dc9a6e-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-jjtst\" (UID: \"d033268a-14e3-44c6-a470-313654dc9a6e\") " pod="openshift-multus/multus-additional-cni-plugins-jjtst"
Jul 23 16:15:20.706649 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:20.705052    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ff3e02fa-45b8-4aa2-acb0-5b4e791b5c7c-var-lib-openvswitch\") pod \"ovnkube-node-c9g74\" (UID: \"ff3e02fa-45b8-4aa2-acb0-5b4e791b5c7c\") " pod="openshift-ovn-kubernetes/ovnkube-node-c9g74"
Jul 23 16:15:20.706649 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:20.705092    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/ff3e02fa-45b8-4aa2-acb0-5b4e791b5c7c-host-kubelet\") pod \"ovnkube-node-c9g74\" (UID: \"ff3e02fa-45b8-4aa2-acb0-5b4e791b5c7c\") " pod="openshift-ovn-kubernetes/ovnkube-node-c9g74"
Jul 23 16:15:20.707181 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:20.705116    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/83d1126c-3d57-463e-bce5-e1716daa5eb7-os-release\") pod \"multus-bkx5j\" (UID: \"83d1126c-3d57-463e-bce5-e1716daa5eb7\") " pod="openshift-multus/multus-bkx5j"
Jul 23 16:15:20.707181 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:20.705136    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/c0d761bc-9c6e-4617-a75d-1811fc235f16-dbus\") pod \"global-pull-secret-syncer-lqmct\" (UID: \"c0d761bc-9c6e-4617-a75d-1811fc235f16\") " pod="kube-system/global-pull-secret-syncer-lqmct"
Jul 23 16:15:20.707181 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:20.705166    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/d1f5fd12-987e-4a35-9764-e36f41189f33-sys-fs\") pod \"aws-ebs-csi-driver-node-x5s6t\" (UID: \"d1f5fd12-987e-4a35-9764-e36f41189f33\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x5s6t"
Jul 23 16:15:20.707181 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:20.705191    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/83d1126c-3d57-463e-bce5-e1716daa5eb7-host-run-multus-certs\") pod \"multus-bkx5j\" (UID: \"83d1126c-3d57-463e-bce5-e1716daa5eb7\") " pod="openshift-multus/multus-bkx5j"
Jul 23 16:15:20.707181 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:20.705197    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ff3e02fa-45b8-4aa2-acb0-5b4e791b5c7c-run-openvswitch\") pod \"ovnkube-node-c9g74\" (UID: \"ff3e02fa-45b8-4aa2-acb0-5b4e791b5c7c\") " pod="openshift-ovn-kubernetes/ovnkube-node-c9g74"
Jul 23 16:15:20.707181 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:20.705246    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/ff3e02fa-45b8-4aa2-acb0-5b4e791b5c7c-node-log\") pod \"ovnkube-node-c9g74\" (UID: \"ff3e02fa-45b8-4aa2-acb0-5b4e791b5c7c\") " pod="openshift-ovn-kubernetes/ovnkube-node-c9g74"
Jul 23 16:15:20.707181 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:20.705251    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ff3e02fa-45b8-4aa2-acb0-5b4e791b5c7c-run-openvswitch\") pod \"ovnkube-node-c9g74\" (UID: \"ff3e02fa-45b8-4aa2-acb0-5b4e791b5c7c\") " pod="openshift-ovn-kubernetes/ovnkube-node-c9g74"
Jul 23 16:15:20.707181 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:20.705275    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/d1f5fd12-987e-4a35-9764-e36f41189f33-kubelet-dir\") pod \"aws-ebs-csi-driver-node-x5s6t\" (UID: \"d1f5fd12-987e-4a35-9764-e36f41189f33\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x5s6t"
Jul 23 16:15:20.707181 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:20.705301    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/83d1126c-3d57-463e-bce5-e1716daa5eb7-etc-kubernetes\") pod \"multus-bkx5j\" (UID: \"83d1126c-3d57-463e-bce5-e1716daa5eb7\") " pod="openshift-multus/multus-bkx5j"
Jul 23 16:15:20.707181 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:20.705333    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/83d1126c-3d57-463e-bce5-e1716daa5eb7-multus-daemon-config\") pod \"multus-bkx5j\" (UID: \"83d1126c-3d57-463e-bce5-e1716daa5eb7\") " pod="openshift-multus/multus-bkx5j"
Jul 23 16:15:20.707181 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:20.705331    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/ff3e02fa-45b8-4aa2-acb0-5b4e791b5c7c-node-log\") pod \"ovnkube-node-c9g74\" (UID: \"ff3e02fa-45b8-4aa2-acb0-5b4e791b5c7c\") " pod="openshift-ovn-kubernetes/ovnkube-node-c9g74"
Jul 23 16:15:20.707181 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:20.705327    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ff3e02fa-45b8-4aa2-acb0-5b4e791b5c7c-etc-openvswitch\") pod \"ovnkube-node-c9g74\" (UID: \"ff3e02fa-45b8-4aa2-acb0-5b4e791b5c7c\") " pod="openshift-ovn-kubernetes/ovnkube-node-c9g74"
Jul 23 16:15:20.707181 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:20.705384    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/ff3e02fa-45b8-4aa2-acb0-5b4e791b5c7c-host-cni-netd\") pod \"ovnkube-node-c9g74\" (UID: \"ff3e02fa-45b8-4aa2-acb0-5b4e791b5c7c\") " pod="openshift-ovn-kubernetes/ovnkube-node-c9g74"
Jul 23 16:15:20.707181 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:20.705387    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/d1f5fd12-987e-4a35-9764-e36f41189f33-kubelet-dir\") pod \"aws-ebs-csi-driver-node-x5s6t\" (UID: \"d1f5fd12-987e-4a35-9764-e36f41189f33\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x5s6t"
Jul 23 16:15:20.707181 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:20.705393    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/83d1126c-3d57-463e-bce5-e1716daa5eb7-etc-kubernetes\") pod \"multus-bkx5j\" (UID: \"83d1126c-3d57-463e-bce5-e1716daa5eb7\") " pod="openshift-multus/multus-bkx5j"
Jul 23 16:15:20.707181 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:20.705429    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ff3e02fa-45b8-4aa2-acb0-5b4e791b5c7c-etc-openvswitch\") pod \"ovnkube-node-c9g74\" (UID: \"ff3e02fa-45b8-4aa2-acb0-5b4e791b5c7c\") " pod="openshift-ovn-kubernetes/ovnkube-node-c9g74"
Jul 23 16:15:20.707181 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:20.705432    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d033268a-14e3-44c6-a470-313654dc9a6e-cni-binary-copy\") pod \"multus-additional-cni-plugins-jjtst\" (UID: \"d033268a-14e3-44c6-a470-313654dc9a6e\") " pod="openshift-multus/multus-additional-cni-plugins-jjtst"
Jul 23 16:15:20.707181 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:20.705441    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/ff3e02fa-45b8-4aa2-acb0-5b4e791b5c7c-host-cni-netd\") pod \"ovnkube-node-c9g74\" (UID: \"ff3e02fa-45b8-4aa2-acb0-5b4e791b5c7c\") " pod="openshift-ovn-kubernetes/ovnkube-node-c9g74"
Jul 23 16:15:20.707735 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:20.705459    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/83d1126c-3d57-463e-bce5-e1716daa5eb7-multus-socket-dir-parent\") pod \"multus-bkx5j\" (UID: \"83d1126c-3d57-463e-bce5-e1716daa5eb7\") " pod="openshift-multus/multus-bkx5j"
Jul 23 16:15:20.707735 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:20.705487    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ff3e02fa-45b8-4aa2-acb0-5b4e791b5c7c-host-cni-bin\") pod \"ovnkube-node-c9g74\" (UID: \"ff3e02fa-45b8-4aa2-acb0-5b4e791b5c7c\") " pod="openshift-ovn-kubernetes/ovnkube-node-c9g74"
Jul 23 16:15:20.707735 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:20.705513    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/ff3e02fa-45b8-4aa2-acb0-5b4e791b5c7c-env-overrides\") pod \"ovnkube-node-c9g74\" (UID: \"ff3e02fa-45b8-4aa2-acb0-5b4e791b5c7c\") " pod="openshift-ovn-kubernetes/ovnkube-node-c9g74"
Jul 23 16:15:20.707735 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:20.705540    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/d033268a-14e3-44c6-a470-313654dc9a6e-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-jjtst\" (UID: \"d033268a-14e3-44c6-a470-313654dc9a6e\") " pod="openshift-multus/multus-additional-cni-plugins-jjtst"
Jul 23 16:15:20.707735 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:20.705567    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/d033268a-14e3-44c6-a470-313654dc9a6e-os-release\") pod \"multus-additional-cni-plugins-jjtst\" (UID: \"d033268a-14e3-44c6-a470-313654dc9a6e\") " pod="openshift-multus/multus-additional-cni-plugins-jjtst"
Jul 23 16:15:20.707735 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:20.705567    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/83d1126c-3d57-463e-bce5-e1716daa5eb7-multus-socket-dir-parent\") pod \"multus-bkx5j\" (UID: \"83d1126c-3d57-463e-bce5-e1716daa5eb7\") " pod="openshift-multus/multus-bkx5j"
Jul 23 16:15:20.707735 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:20.705666    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/bba31e38-01db-45a0-8b60-9fc626237e01-konnectivity-ca\") pod \"konnectivity-agent-j892l\" (UID: \"bba31e38-01db-45a0-8b60-9fc626237e01\") " pod="kube-system/konnectivity-agent-j892l"
Jul 23 16:15:20.707735 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:20.705725    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ff3e02fa-45b8-4aa2-acb0-5b4e791b5c7c-host-cni-bin\") pod \"ovnkube-node-c9g74\" (UID: \"ff3e02fa-45b8-4aa2-acb0-5b4e791b5c7c\") " pod="openshift-ovn-kubernetes/ovnkube-node-c9g74"
Jul 23 16:15:20.707735 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:20.705759    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/d033268a-14e3-44c6-a470-313654dc9a6e-os-release\") pod \"multus-additional-cni-plugins-jjtst\" (UID: \"d033268a-14e3-44c6-a470-313654dc9a6e\") " pod="openshift-multus/multus-additional-cni-plugins-jjtst"
Jul 23 16:15:20.707735 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:20.705778    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/75b0ea12-192f-4910-b245-83d1df9119e7-host-slash\") pod \"iptables-alerter-2vp4s\" (UID: \"75b0ea12-192f-4910-b245-83d1df9119e7\") " pod="openshift-network-operator/iptables-alerter-2vp4s"
Jul 23 16:15:20.707735 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:20.705805    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/83d1126c-3d57-463e-bce5-e1716daa5eb7-hostroot\") pod \"multus-bkx5j\" (UID: \"83d1126c-3d57-463e-bce5-e1716daa5eb7\") " pod="openshift-multus/multus-bkx5j"
Jul 23 16:15:20.707735 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:20.705833    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ff3e02fa-45b8-4aa2-acb0-5b4e791b5c7c-host-run-ovn-kubernetes\") pod \"ovnkube-node-c9g74\" (UID: \"ff3e02fa-45b8-4aa2-acb0-5b4e791b5c7c\") " pod="openshift-ovn-kubernetes/ovnkube-node-c9g74"
Jul 23 16:15:20.707735 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:20.705861    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/ff3e02fa-45b8-4aa2-acb0-5b4e791b5c7c-ovnkube-script-lib\") pod \"ovnkube-node-c9g74\" (UID: \"ff3e02fa-45b8-4aa2-acb0-5b4e791b5c7c\") " pod="openshift-ovn-kubernetes/ovnkube-node-c9g74"
Jul 23 16:15:20.707735 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:20.705874    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/75b0ea12-192f-4910-b245-83d1df9119e7-host-slash\") pod \"iptables-alerter-2vp4s\" (UID: \"75b0ea12-192f-4910-b245-83d1df9119e7\") " pod="openshift-network-operator/iptables-alerter-2vp4s"
Jul 23 16:15:20.707735 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:20.705879    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/83d1126c-3d57-463e-bce5-e1716daa5eb7-hostroot\") pod \"multus-bkx5j\" (UID: \"83d1126c-3d57-463e-bce5-e1716daa5eb7\") " pod="openshift-multus/multus-bkx5j"
Jul 23 16:15:20.707735 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:20.705918    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/75b0ea12-192f-4910-b245-83d1df9119e7-iptables-alerter-script\") pod \"iptables-alerter-2vp4s\" (UID: \"75b0ea12-192f-4910-b245-83d1df9119e7\") " pod="openshift-network-operator/iptables-alerter-2vp4s"
Jul 23 16:15:20.707735 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:20.705947    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ff3e02fa-45b8-4aa2-acb0-5b4e791b5c7c-host-run-ovn-kubernetes\") pod \"ovnkube-node-c9g74\" (UID: \"ff3e02fa-45b8-4aa2-acb0-5b4e791b5c7c\") " pod="openshift-ovn-kubernetes/ovnkube-node-c9g74"
Jul 23 16:15:20.708254 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:20.706001    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/ff3e02fa-45b8-4aa2-acb0-5b4e791b5c7c-ovnkube-config\") pod \"ovnkube-node-c9g74\" (UID: \"ff3e02fa-45b8-4aa2-acb0-5b4e791b5c7c\") " pod="openshift-ovn-kubernetes/ovnkube-node-c9g74"
Jul 23 16:15:20.708254 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:20.706018    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/ff3e02fa-45b8-4aa2-acb0-5b4e791b5c7c-env-overrides\") pod \"ovnkube-node-c9g74\" (UID: \"ff3e02fa-45b8-4aa2-acb0-5b4e791b5c7c\") " pod="openshift-ovn-kubernetes/ovnkube-node-c9g74"
Jul 23 16:15:20.708254 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:20.706025    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/83d1126c-3d57-463e-bce5-e1716daa5eb7-multus-cni-dir\") pod \"multus-bkx5j\" (UID: \"83d1126c-3d57-463e-bce5-e1716daa5eb7\") " pod="openshift-multus/multus-bkx5j"
Jul 23 16:15:20.708254 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:20.705949    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/83d1126c-3d57-463e-bce5-e1716daa5eb7-multus-cni-dir\") pod \"multus-bkx5j\" (UID: \"83d1126c-3d57-463e-bce5-e1716daa5eb7\") " pod="openshift-multus/multus-bkx5j"
Jul 23 16:15:20.708254 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:20.706101    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/d033268a-14e3-44c6-a470-313654dc9a6e-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-jjtst\" (UID: \"d033268a-14e3-44c6-a470-313654dc9a6e\") " pod="openshift-multus/multus-additional-cni-plugins-jjtst"
Jul 23 16:15:20.708254 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:20.706373    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/ff3e02fa-45b8-4aa2-acb0-5b4e791b5c7c-ovnkube-script-lib\") pod \"ovnkube-node-c9g74\" (UID: \"ff3e02fa-45b8-4aa2-acb0-5b4e791b5c7c\") " pod="openshift-ovn-kubernetes/ovnkube-node-c9g74"
Jul 23 16:15:20.708254 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:20.706453    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/75b0ea12-192f-4910-b245-83d1df9119e7-iptables-alerter-script\") pod \"iptables-alerter-2vp4s\" (UID: \"75b0ea12-192f-4910-b245-83d1df9119e7\") " pod="openshift-network-operator/iptables-alerter-2vp4s"
Jul 23 16:15:20.708254 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:20.706755    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/ff3e02fa-45b8-4aa2-acb0-5b4e791b5c7c-ovn-node-metrics-cert\") pod \"ovnkube-node-c9g74\" (UID: \"ff3e02fa-45b8-4aa2-acb0-5b4e791b5c7c\") " pod="openshift-ovn-kubernetes/ovnkube-node-c9g74"
Jul 23 16:15:20.708254 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:20.707973    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/bba31e38-01db-45a0-8b60-9fc626237e01-agent-certs\") pod \"konnectivity-agent-j892l\" (UID: \"bba31e38-01db-45a0-8b60-9fc626237e01\") " pod="kube-system/konnectivity-agent-j892l"
Jul 23 16:15:20.716638 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:20.716615    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-stmdg\" (UniqueName: \"kubernetes.io/projected/d1f5fd12-987e-4a35-9764-e36f41189f33-kube-api-access-stmdg\") pod \"aws-ebs-csi-driver-node-x5s6t\" (UID: \"d1f5fd12-987e-4a35-9764-e36f41189f33\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x5s6t"
Jul 23 16:15:20.717949 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:20.717924    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k2vqj\" (UniqueName: \"kubernetes.io/projected/ff3e02fa-45b8-4aa2-acb0-5b4e791b5c7c-kube-api-access-k2vqj\") pod \"ovnkube-node-c9g74\" (UID: \"ff3e02fa-45b8-4aa2-acb0-5b4e791b5c7c\") " pod="openshift-ovn-kubernetes/ovnkube-node-c9g74"
Jul 23 16:15:20.719425 ip-10-0-143-166 kubenswrapper[2553]: E0723 16:15:20.719408    2553 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 23 16:15:20.719491 ip-10-0-143-166 kubenswrapper[2553]: E0723 16:15:20.719428    2553 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 23 16:15:20.719491 ip-10-0-143-166 kubenswrapper[2553]: E0723 16:15:20.719440    2553 projected.go:196] Error preparing data for projected volume kube-api-access-wkd4x for pod openshift-network-diagnostics/network-check-target-8vt69: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 23 16:15:20.719563 ip-10-0-143-166 kubenswrapper[2553]: E0723 16:15:20.719505    2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/633a475b-ddec-4391-856d-67674aa0ef0c-kube-api-access-wkd4x podName:633a475b-ddec-4391-856d-67674aa0ef0c nodeName:}" failed. No retries permitted until 2026-07-23 16:15:21.219490174 +0000 UTC m=+3.084096285 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-wkd4x" (UniqueName: "kubernetes.io/projected/633a475b-ddec-4391-856d-67674aa0ef0c-kube-api-access-wkd4x") pod "network-check-target-8vt69" (UID: "633a475b-ddec-4391-856d-67674aa0ef0c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 23 16:15:20.721621 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:20.721601    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-twckl\" (UniqueName: \"kubernetes.io/projected/75b0ea12-192f-4910-b245-83d1df9119e7-kube-api-access-twckl\") pod \"iptables-alerter-2vp4s\" (UID: \"75b0ea12-192f-4910-b245-83d1df9119e7\") " pod="openshift-network-operator/iptables-alerter-2vp4s"
Jul 23 16:15:20.723308 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:20.723288    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lp2fm\" (UniqueName: \"kubernetes.io/projected/d033268a-14e3-44c6-a470-313654dc9a6e-kube-api-access-lp2fm\") pod \"multus-additional-cni-plugins-jjtst\" (UID: \"d033268a-14e3-44c6-a470-313654dc9a6e\") " pod="openshift-multus/multus-additional-cni-plugins-jjtst"
Jul 23 16:15:20.723811 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:20.723795    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k6qn9\" (UniqueName: \"kubernetes.io/projected/83d1126c-3d57-463e-bce5-e1716daa5eb7-kube-api-access-k6qn9\") pod \"multus-bkx5j\" (UID: \"83d1126c-3d57-463e-bce5-e1716daa5eb7\") " pod="openshift-multus/multus-bkx5j"
Jul 23 16:15:20.796161 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:20.796129    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-cnp2t"
Jul 23 16:15:20.803301 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:20.803273    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-ltz8k"
Jul 23 16:15:20.806114 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:15:20.806083    2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1af4cdcf_98b6_4aab_b234_3bed6566658b.slice/crio-94e6e5b9a4c534cc272fc0e3b813343aad194014a9731d67a8b3dcfc5b93afdf WatchSource:0}: Error finding container 94e6e5b9a4c534cc272fc0e3b813343aad194014a9731d67a8b3dcfc5b93afdf: Status 404 returned error can't find the container with id 94e6e5b9a4c534cc272fc0e3b813343aad194014a9731d67a8b3dcfc5b93afdf
Jul 23 16:15:20.812332 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:20.812159    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-qbjm4"
Jul 23 16:15:20.815109 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:15:20.815078    2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddd8e418a_a9fa_4bb8_b939_fe242e316e72.slice/crio-e2b850ef30bc9318959491b83ec40ce0489589fc9ef7c583d2669ab2e45d38ae WatchSource:0}: Error finding container e2b850ef30bc9318959491b83ec40ce0489589fc9ef7c583d2669ab2e45d38ae: Status 404 returned error can't find the container with id e2b850ef30bc9318959491b83ec40ce0489589fc9ef7c583d2669ab2e45d38ae
Jul 23 16:15:20.818337 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:20.818312    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-2vp4s"
Jul 23 16:15:20.822644 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:15:20.822611    2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf8e034fc_9e28_43ab_bd6e_a62848b2ac5d.slice/crio-2569340a4a8bc44d214b2d33889ac75e7a33210eb7d205893683aff086284d24 WatchSource:0}: Error finding container 2569340a4a8bc44d214b2d33889ac75e7a33210eb7d205893683aff086284d24: Status 404 returned error can't find the container with id 2569340a4a8bc44d214b2d33889ac75e7a33210eb7d205893683aff086284d24
Jul 23 16:15:20.823524 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:20.823499    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-bkx5j"
Jul 23 16:15:20.829036 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:15:20.829005    2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod75b0ea12_192f_4910_b245_83d1df9119e7.slice/crio-2cb2e2fcd79575b569391cb2cf93d050b0d3faaa156b5df9bbf91f22b3b09cd6 WatchSource:0}: Error finding container 2cb2e2fcd79575b569391cb2cf93d050b0d3faaa156b5df9bbf91f22b3b09cd6: Status 404 returned error can't find the container with id 2cb2e2fcd79575b569391cb2cf93d050b0d3faaa156b5df9bbf91f22b3b09cd6
Jul 23 16:15:20.829970 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:20.829916    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-j892l"
Jul 23 16:15:20.835382 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:20.835356    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-c9g74"
Jul 23 16:15:20.835475 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:15:20.835430    2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod83d1126c_3d57_463e_bce5_e1716daa5eb7.slice/crio-afacd50f24221cab3b3e3c5bb2e0921d97a20027d2d053be348b436d02be1ebc WatchSource:0}: Error finding container afacd50f24221cab3b3e3c5bb2e0921d97a20027d2d053be348b436d02be1ebc: Status 404 returned error can't find the container with id afacd50f24221cab3b3e3c5bb2e0921d97a20027d2d053be348b436d02be1ebc
Jul 23 16:15:20.842360 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:20.842269    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x5s6t"
Jul 23 16:15:20.845383 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:15:20.845352    2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbba31e38_01db_45a0_8b60_9fc626237e01.slice/crio-99b7b9de3b04852e7fe58a59ead4aec676841213e6d4a9a7603124c1201af1c2 WatchSource:0}: Error finding container 99b7b9de3b04852e7fe58a59ead4aec676841213e6d4a9a7603124c1201af1c2: Status 404 returned error can't find the container with id 99b7b9de3b04852e7fe58a59ead4aec676841213e6d4a9a7603124c1201af1c2
Jul 23 16:15:20.846140 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:20.846116    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-jjtst"
Jul 23 16:15:20.848982 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:15:20.848672    2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podff3e02fa_45b8_4aa2_acb0_5b4e791b5c7c.slice/crio-c63cb4a2d6ec0ba6d72394965d33bb5a3a4f74c7d58193afe936c34a19da06b2 WatchSource:0}: Error finding container c63cb4a2d6ec0ba6d72394965d33bb5a3a4f74c7d58193afe936c34a19da06b2: Status 404 returned error can't find the container with id c63cb4a2d6ec0ba6d72394965d33bb5a3a4f74c7d58193afe936c34a19da06b2
Jul 23 16:15:20.856931 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:15:20.856899    2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd1f5fd12_987e_4a35_9764_e36f41189f33.slice/crio-11b0c3a0bb1c48071af04c7842b8e28b74618073fae6291602ef6b72e4562177 WatchSource:0}: Error finding container 11b0c3a0bb1c48071af04c7842b8e28b74618073fae6291602ef6b72e4562177: Status 404 returned error can't find the container with id 11b0c3a0bb1c48071af04c7842b8e28b74618073fae6291602ef6b72e4562177
Jul 23 16:15:20.858816 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:15:20.858780    2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd033268a_14e3_44c6_a470_313654dc9a6e.slice/crio-88028b531744abb29552a344806bc9ce3e445bdcaa32fad6e047db2525e2e86d WatchSource:0}: Error finding container 88028b531744abb29552a344806bc9ce3e445bdcaa32fad6e047db2525e2e86d: Status 404 returned error can't find the container with id 88028b531744abb29552a344806bc9ce3e445bdcaa32fad6e047db2525e2e86d
Jul 23 16:15:21.108732 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:21.108512    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0ce6ab38-81a0-43b1-865b-42c65798de75-metrics-certs\") pod \"network-metrics-daemon-bkpz9\" (UID: \"0ce6ab38-81a0-43b1-865b-42c65798de75\") " pod="openshift-multus/network-metrics-daemon-bkpz9"
Jul 23 16:15:21.108732 ip-10-0-143-166 kubenswrapper[2553]: E0723 16:15:21.108714    2553 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 23 16:15:21.108999 ip-10-0-143-166 kubenswrapper[2553]: E0723 16:15:21.108785    2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0ce6ab38-81a0-43b1-865b-42c65798de75-metrics-certs podName:0ce6ab38-81a0-43b1-865b-42c65798de75 nodeName:}" failed. No retries permitted until 2026-07-23 16:15:22.108765497 +0000 UTC m=+3.973371620 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0ce6ab38-81a0-43b1-865b-42c65798de75-metrics-certs") pod "network-metrics-daemon-bkpz9" (UID: "0ce6ab38-81a0-43b1-865b-42c65798de75") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 23 16:15:21.210131 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:21.209469    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c0d761bc-9c6e-4617-a75d-1811fc235f16-original-pull-secret\") pod \"global-pull-secret-syncer-lqmct\" (UID: \"c0d761bc-9c6e-4617-a75d-1811fc235f16\") " pod="kube-system/global-pull-secret-syncer-lqmct"
Jul 23 16:15:21.210131 ip-10-0-143-166 kubenswrapper[2553]: E0723 16:15:21.209684    2553 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 23 16:15:21.210131 ip-10-0-143-166 kubenswrapper[2553]: E0723 16:15:21.209749    2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c0d761bc-9c6e-4617-a75d-1811fc235f16-original-pull-secret podName:c0d761bc-9c6e-4617-a75d-1811fc235f16 nodeName:}" failed. No retries permitted until 2026-07-23 16:15:22.209730636 +0000 UTC m=+4.074336745 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c0d761bc-9c6e-4617-a75d-1811fc235f16-original-pull-secret") pod "global-pull-secret-syncer-lqmct" (UID: "c0d761bc-9c6e-4617-a75d-1811fc235f16") : object "kube-system"/"original-pull-secret" not registered
Jul 23 16:15:21.310424 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:21.310303    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wkd4x\" (UniqueName: \"kubernetes.io/projected/633a475b-ddec-4391-856d-67674aa0ef0c-kube-api-access-wkd4x\") pod \"network-check-target-8vt69\" (UID: \"633a475b-ddec-4391-856d-67674aa0ef0c\") " pod="openshift-network-diagnostics/network-check-target-8vt69"
Jul 23 16:15:21.310623 ip-10-0-143-166 kubenswrapper[2553]: E0723 16:15:21.310488    2553 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 23 16:15:21.310623 ip-10-0-143-166 kubenswrapper[2553]: E0723 16:15:21.310508    2553 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 23 16:15:21.310623 ip-10-0-143-166 kubenswrapper[2553]: E0723 16:15:21.310522    2553 projected.go:196] Error preparing data for projected volume kube-api-access-wkd4x for pod openshift-network-diagnostics/network-check-target-8vt69: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 23 16:15:21.310623 ip-10-0-143-166 kubenswrapper[2553]: E0723 16:15:21.310590    2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/633a475b-ddec-4391-856d-67674aa0ef0c-kube-api-access-wkd4x podName:633a475b-ddec-4391-856d-67674aa0ef0c nodeName:}" failed. No retries permitted until 2026-07-23 16:15:22.310570542 +0000 UTC m=+4.175176665 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-wkd4x" (UniqueName: "kubernetes.io/projected/633a475b-ddec-4391-856d-67674aa0ef0c-kube-api-access-wkd4x") pod "network-check-target-8vt69" (UID: "633a475b-ddec-4391-856d-67674aa0ef0c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 23 16:15:21.540591 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:21.540387    2553 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-22 16:10:21 +0000 UTC" deadline="2028-03-15 19:17:59.082230449 +0000 UTC"
Jul 23 16:15:21.540591 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:21.540431    2553 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14427h2m37.541804502s"
Jul 23 16:15:21.680679 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:21.680588    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-qbjm4" event={"ID":"f8e034fc-9e28-43ab-bd6e-a62848b2ac5d","Type":"ContainerStarted","Data":"2569340a4a8bc44d214b2d33889ac75e7a33210eb7d205893683aff086284d24"}
Jul 23 16:15:21.684004 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:21.683961    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-ltz8k" event={"ID":"dd8e418a-a9fa-4bb8-b939-fe242e316e72","Type":"ContainerStarted","Data":"e2b850ef30bc9318959491b83ec40ce0489589fc9ef7c583d2669ab2e45d38ae"}
Jul 23 16:15:21.685515 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:21.685490    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-cnp2t" event={"ID":"1af4cdcf-98b6-4aab-b234-3bed6566658b","Type":"ContainerStarted","Data":"94e6e5b9a4c534cc272fc0e3b813343aad194014a9731d67a8b3dcfc5b93afdf"}
Jul 23 16:15:21.687611 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:21.687584    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-jjtst" event={"ID":"d033268a-14e3-44c6-a470-313654dc9a6e","Type":"ContainerStarted","Data":"88028b531744abb29552a344806bc9ce3e445bdcaa32fad6e047db2525e2e86d"}
Jul 23 16:15:21.690797 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:21.690768    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x5s6t" event={"ID":"d1f5fd12-987e-4a35-9764-e36f41189f33","Type":"ContainerStarted","Data":"11b0c3a0bb1c48071af04c7842b8e28b74618073fae6291602ef6b72e4562177"}
Jul 23 16:15:21.692266 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:21.692152    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-c9g74" event={"ID":"ff3e02fa-45b8-4aa2-acb0-5b4e791b5c7c","Type":"ContainerStarted","Data":"c63cb4a2d6ec0ba6d72394965d33bb5a3a4f74c7d58193afe936c34a19da06b2"}
Jul 23 16:15:21.694679 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:21.694594    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-j892l" event={"ID":"bba31e38-01db-45a0-8b60-9fc626237e01","Type":"ContainerStarted","Data":"99b7b9de3b04852e7fe58a59ead4aec676841213e6d4a9a7603124c1201af1c2"}
Jul 23 16:15:21.697518 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:21.697401    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-bkx5j" event={"ID":"83d1126c-3d57-463e-bce5-e1716daa5eb7","Type":"ContainerStarted","Data":"afacd50f24221cab3b3e3c5bb2e0921d97a20027d2d053be348b436d02be1ebc"}
Jul 23 16:15:21.701801 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:21.701773    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-2vp4s" event={"ID":"75b0ea12-192f-4910-b245-83d1df9119e7","Type":"ContainerStarted","Data":"2cb2e2fcd79575b569391cb2cf93d050b0d3faaa156b5df9bbf91f22b3b09cd6"}
Jul 23 16:15:22.118221 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:22.117587    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0ce6ab38-81a0-43b1-865b-42c65798de75-metrics-certs\") pod \"network-metrics-daemon-bkpz9\" (UID: \"0ce6ab38-81a0-43b1-865b-42c65798de75\") " pod="openshift-multus/network-metrics-daemon-bkpz9"
Jul 23 16:15:22.118221 ip-10-0-143-166 kubenswrapper[2553]: E0723 16:15:22.117777    2553 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 23 16:15:22.118221 ip-10-0-143-166 kubenswrapper[2553]: E0723 16:15:22.117843    2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0ce6ab38-81a0-43b1-865b-42c65798de75-metrics-certs podName:0ce6ab38-81a0-43b1-865b-42c65798de75 nodeName:}" failed. No retries permitted until 2026-07-23 16:15:24.117822214 +0000 UTC m=+5.982428327 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0ce6ab38-81a0-43b1-865b-42c65798de75-metrics-certs") pod "network-metrics-daemon-bkpz9" (UID: "0ce6ab38-81a0-43b1-865b-42c65798de75") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 23 16:15:22.219930 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:22.219098    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c0d761bc-9c6e-4617-a75d-1811fc235f16-original-pull-secret\") pod \"global-pull-secret-syncer-lqmct\" (UID: \"c0d761bc-9c6e-4617-a75d-1811fc235f16\") " pod="kube-system/global-pull-secret-syncer-lqmct"
Jul 23 16:15:22.219930 ip-10-0-143-166 kubenswrapper[2553]: E0723 16:15:22.219317    2553 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 23 16:15:22.219930 ip-10-0-143-166 kubenswrapper[2553]: E0723 16:15:22.219386    2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c0d761bc-9c6e-4617-a75d-1811fc235f16-original-pull-secret podName:c0d761bc-9c6e-4617-a75d-1811fc235f16 nodeName:}" failed. No retries permitted until 2026-07-23 16:15:24.219365813 +0000 UTC m=+6.083971927 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c0d761bc-9c6e-4617-a75d-1811fc235f16-original-pull-secret") pod "global-pull-secret-syncer-lqmct" (UID: "c0d761bc-9c6e-4617-a75d-1811fc235f16") : object "kube-system"/"original-pull-secret" not registered
Jul 23 16:15:22.320382 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:22.320308    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wkd4x\" (UniqueName: \"kubernetes.io/projected/633a475b-ddec-4391-856d-67674aa0ef0c-kube-api-access-wkd4x\") pod \"network-check-target-8vt69\" (UID: \"633a475b-ddec-4391-856d-67674aa0ef0c\") " pod="openshift-network-diagnostics/network-check-target-8vt69"
Jul 23 16:15:22.320579 ip-10-0-143-166 kubenswrapper[2553]: E0723 16:15:22.320500    2553 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 23 16:15:22.320579 ip-10-0-143-166 kubenswrapper[2553]: E0723 16:15:22.320523    2553 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 23 16:15:22.320579 ip-10-0-143-166 kubenswrapper[2553]: E0723 16:15:22.320538    2553 projected.go:196] Error preparing data for projected volume kube-api-access-wkd4x for pod openshift-network-diagnostics/network-check-target-8vt69: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 23 16:15:22.320749 ip-10-0-143-166 kubenswrapper[2553]: E0723 16:15:22.320603    2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/633a475b-ddec-4391-856d-67674aa0ef0c-kube-api-access-wkd4x podName:633a475b-ddec-4391-856d-67674aa0ef0c nodeName:}" failed. No retries permitted until 2026-07-23 16:15:24.320584131 +0000 UTC m=+6.185190254 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-wkd4x" (UniqueName: "kubernetes.io/projected/633a475b-ddec-4391-856d-67674aa0ef0c-kube-api-access-wkd4x") pod "network-check-target-8vt69" (UID: "633a475b-ddec-4391-856d-67674aa0ef0c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 23 16:15:22.541040 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:22.540875    2553 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-22 16:10:21 +0000 UTC" deadline="2028-01-19 09:01:38.79643192 +0000 UTC"
Jul 23 16:15:22.541040 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:22.540940    2553 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13072h46m16.255496906s"
Jul 23 16:15:22.669427 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:22.669390    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8vt69"
Jul 23 16:15:22.669609 ip-10-0-143-166 kubenswrapper[2553]: E0723 16:15:22.669551    2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8vt69" podUID="633a475b-ddec-4391-856d-67674aa0ef0c"
Jul 23 16:15:22.669951 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:22.669405    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bkpz9"
Jul 23 16:15:22.670074 ip-10-0-143-166 kubenswrapper[2553]: E0723 16:15:22.670052    2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bkpz9" podUID="0ce6ab38-81a0-43b1-865b-42c65798de75"
Jul 23 16:15:22.670153 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:22.670139    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lqmct"
Jul 23 16:15:22.670236 ip-10-0-143-166 kubenswrapper[2553]: E0723 16:15:22.670218    2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lqmct" podUID="c0d761bc-9c6e-4617-a75d-1811fc235f16"
Jul 23 16:15:24.136016 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:24.135970    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0ce6ab38-81a0-43b1-865b-42c65798de75-metrics-certs\") pod \"network-metrics-daemon-bkpz9\" (UID: \"0ce6ab38-81a0-43b1-865b-42c65798de75\") " pod="openshift-multus/network-metrics-daemon-bkpz9"
Jul 23 16:15:24.136665 ip-10-0-143-166 kubenswrapper[2553]: E0723 16:15:24.136158    2553 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 23 16:15:24.136665 ip-10-0-143-166 kubenswrapper[2553]: E0723 16:15:24.136240    2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0ce6ab38-81a0-43b1-865b-42c65798de75-metrics-certs podName:0ce6ab38-81a0-43b1-865b-42c65798de75 nodeName:}" failed. No retries permitted until 2026-07-23 16:15:28.136219135 +0000 UTC m=+10.000825258 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0ce6ab38-81a0-43b1-865b-42c65798de75-metrics-certs") pod "network-metrics-daemon-bkpz9" (UID: "0ce6ab38-81a0-43b1-865b-42c65798de75") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 23 16:15:24.236716 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:24.236679    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c0d761bc-9c6e-4617-a75d-1811fc235f16-original-pull-secret\") pod \"global-pull-secret-syncer-lqmct\" (UID: \"c0d761bc-9c6e-4617-a75d-1811fc235f16\") " pod="kube-system/global-pull-secret-syncer-lqmct"
Jul 23 16:15:24.236916 ip-10-0-143-166 kubenswrapper[2553]: E0723 16:15:24.236843    2553 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 23 16:15:24.236985 ip-10-0-143-166 kubenswrapper[2553]: E0723 16:15:24.236919    2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c0d761bc-9c6e-4617-a75d-1811fc235f16-original-pull-secret podName:c0d761bc-9c6e-4617-a75d-1811fc235f16 nodeName:}" failed. No retries permitted until 2026-07-23 16:15:28.236891464 +0000 UTC m=+10.101497613 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c0d761bc-9c6e-4617-a75d-1811fc235f16-original-pull-secret") pod "global-pull-secret-syncer-lqmct" (UID: "c0d761bc-9c6e-4617-a75d-1811fc235f16") : object "kube-system"/"original-pull-secret" not registered
Jul 23 16:15:24.337434 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:24.337358    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wkd4x\" (UniqueName: \"kubernetes.io/projected/633a475b-ddec-4391-856d-67674aa0ef0c-kube-api-access-wkd4x\") pod \"network-check-target-8vt69\" (UID: \"633a475b-ddec-4391-856d-67674aa0ef0c\") " pod="openshift-network-diagnostics/network-check-target-8vt69"
Jul 23 16:15:24.337677 ip-10-0-143-166 kubenswrapper[2553]: E0723 16:15:24.337615    2553 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 23 16:15:24.337677 ip-10-0-143-166 kubenswrapper[2553]: E0723 16:15:24.337645    2553 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 23 16:15:24.337677 ip-10-0-143-166 kubenswrapper[2553]: E0723 16:15:24.337660    2553 projected.go:196] Error preparing data for projected volume kube-api-access-wkd4x for pod openshift-network-diagnostics/network-check-target-8vt69: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 23 16:15:24.337963 ip-10-0-143-166 kubenswrapper[2553]: E0723 16:15:24.337916    2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/633a475b-ddec-4391-856d-67674aa0ef0c-kube-api-access-wkd4x podName:633a475b-ddec-4391-856d-67674aa0ef0c nodeName:}" failed. No retries permitted until 2026-07-23 16:15:28.337707034 +0000 UTC m=+10.202313156 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-wkd4x" (UniqueName: "kubernetes.io/projected/633a475b-ddec-4391-856d-67674aa0ef0c-kube-api-access-wkd4x") pod "network-check-target-8vt69" (UID: "633a475b-ddec-4391-856d-67674aa0ef0c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 23 16:15:24.669024 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:24.668985    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bkpz9"
Jul 23 16:15:24.669208 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:24.668996    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8vt69"
Jul 23 16:15:24.669208 ip-10-0-143-166 kubenswrapper[2553]: E0723 16:15:24.669144    2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bkpz9" podUID="0ce6ab38-81a0-43b1-865b-42c65798de75"
Jul 23 16:15:24.669208 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:24.669159    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lqmct"
Jul 23 16:15:24.669403 ip-10-0-143-166 kubenswrapper[2553]: E0723 16:15:24.669246    2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8vt69" podUID="633a475b-ddec-4391-856d-67674aa0ef0c"
Jul 23 16:15:24.669403 ip-10-0-143-166 kubenswrapper[2553]: E0723 16:15:24.669339    2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lqmct" podUID="c0d761bc-9c6e-4617-a75d-1811fc235f16"
Jul 23 16:15:26.669464 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:26.668891    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lqmct"
Jul 23 16:15:26.669464 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:26.668911    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8vt69"
Jul 23 16:15:26.669464 ip-10-0-143-166 kubenswrapper[2553]: E0723 16:15:26.669047    2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lqmct" podUID="c0d761bc-9c6e-4617-a75d-1811fc235f16"
Jul 23 16:15:26.669464 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:26.669063    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bkpz9"
Jul 23 16:15:26.669464 ip-10-0-143-166 kubenswrapper[2553]: E0723 16:15:26.669154    2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8vt69" podUID="633a475b-ddec-4391-856d-67674aa0ef0c"
Jul 23 16:15:26.669464 ip-10-0-143-166 kubenswrapper[2553]: E0723 16:15:26.669346    2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bkpz9" podUID="0ce6ab38-81a0-43b1-865b-42c65798de75"
Jul 23 16:15:28.173982 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:28.173886    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0ce6ab38-81a0-43b1-865b-42c65798de75-metrics-certs\") pod \"network-metrics-daemon-bkpz9\" (UID: \"0ce6ab38-81a0-43b1-865b-42c65798de75\") " pod="openshift-multus/network-metrics-daemon-bkpz9"
Jul 23 16:15:28.174496 ip-10-0-143-166 kubenswrapper[2553]: E0723 16:15:28.174069    2553 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 23 16:15:28.174496 ip-10-0-143-166 kubenswrapper[2553]: E0723 16:15:28.174169    2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0ce6ab38-81a0-43b1-865b-42c65798de75-metrics-certs podName:0ce6ab38-81a0-43b1-865b-42c65798de75 nodeName:}" failed. No retries permitted until 2026-07-23 16:15:36.174142981 +0000 UTC m=+18.038749092 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0ce6ab38-81a0-43b1-865b-42c65798de75-metrics-certs") pod "network-metrics-daemon-bkpz9" (UID: "0ce6ab38-81a0-43b1-865b-42c65798de75") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 23 16:15:28.275596 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:28.274956    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c0d761bc-9c6e-4617-a75d-1811fc235f16-original-pull-secret\") pod \"global-pull-secret-syncer-lqmct\" (UID: \"c0d761bc-9c6e-4617-a75d-1811fc235f16\") " pod="kube-system/global-pull-secret-syncer-lqmct"
Jul 23 16:15:28.275596 ip-10-0-143-166 kubenswrapper[2553]: E0723 16:15:28.275143    2553 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 23 16:15:28.275596 ip-10-0-143-166 kubenswrapper[2553]: E0723 16:15:28.275226    2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c0d761bc-9c6e-4617-a75d-1811fc235f16-original-pull-secret podName:c0d761bc-9c6e-4617-a75d-1811fc235f16 nodeName:}" failed. No retries permitted until 2026-07-23 16:15:36.275191272 +0000 UTC m=+18.139797403 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c0d761bc-9c6e-4617-a75d-1811fc235f16-original-pull-secret") pod "global-pull-secret-syncer-lqmct" (UID: "c0d761bc-9c6e-4617-a75d-1811fc235f16") : object "kube-system"/"original-pull-secret" not registered
Jul 23 16:15:28.375989 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:28.375940    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wkd4x\" (UniqueName: \"kubernetes.io/projected/633a475b-ddec-4391-856d-67674aa0ef0c-kube-api-access-wkd4x\") pod \"network-check-target-8vt69\" (UID: \"633a475b-ddec-4391-856d-67674aa0ef0c\") " pod="openshift-network-diagnostics/network-check-target-8vt69"
Jul 23 16:15:28.376166 ip-10-0-143-166 kubenswrapper[2553]: E0723 16:15:28.376121    2553 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 23 16:15:28.376166 ip-10-0-143-166 kubenswrapper[2553]: E0723 16:15:28.376144    2553 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 23 16:15:28.376166 ip-10-0-143-166 kubenswrapper[2553]: E0723 16:15:28.376158    2553 projected.go:196] Error preparing data for projected volume kube-api-access-wkd4x for pod openshift-network-diagnostics/network-check-target-8vt69: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 23 16:15:28.376404 ip-10-0-143-166 kubenswrapper[2553]: E0723 16:15:28.376247    2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/633a475b-ddec-4391-856d-67674aa0ef0c-kube-api-access-wkd4x podName:633a475b-ddec-4391-856d-67674aa0ef0c nodeName:}" failed. No retries permitted until 2026-07-23 16:15:36.376208082 +0000 UTC m=+18.240814194 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-wkd4x" (UniqueName: "kubernetes.io/projected/633a475b-ddec-4391-856d-67674aa0ef0c-kube-api-access-wkd4x") pod "network-check-target-8vt69" (UID: "633a475b-ddec-4391-856d-67674aa0ef0c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 23 16:15:28.670506 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:28.670333    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8vt69"
Jul 23 16:15:28.670506 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:28.670408    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bkpz9"
Jul 23 16:15:28.670506 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:28.670405    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lqmct"
Jul 23 16:15:28.670759 ip-10-0-143-166 kubenswrapper[2553]: E0723 16:15:28.670502    2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8vt69" podUID="633a475b-ddec-4391-856d-67674aa0ef0c"
Jul 23 16:15:28.670759 ip-10-0-143-166 kubenswrapper[2553]: E0723 16:15:28.670638    2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bkpz9" podUID="0ce6ab38-81a0-43b1-865b-42c65798de75"
Jul 23 16:15:28.670759 ip-10-0-143-166 kubenswrapper[2553]: E0723 16:15:28.670725    2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lqmct" podUID="c0d761bc-9c6e-4617-a75d-1811fc235f16"
Jul 23 16:15:30.669138 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:30.668769    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lqmct"
Jul 23 16:15:30.669138 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:30.668816    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bkpz9"
Jul 23 16:15:30.669138 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:30.668850    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8vt69"
Jul 23 16:15:30.669138 ip-10-0-143-166 kubenswrapper[2553]: E0723 16:15:30.668959    2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bkpz9" podUID="0ce6ab38-81a0-43b1-865b-42c65798de75"
Jul 23 16:15:30.669138 ip-10-0-143-166 kubenswrapper[2553]: E0723 16:15:30.669055    2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8vt69" podUID="633a475b-ddec-4391-856d-67674aa0ef0c"
Jul 23 16:15:30.669138 ip-10-0-143-166 kubenswrapper[2553]: E0723 16:15:30.669143    2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lqmct" podUID="c0d761bc-9c6e-4617-a75d-1811fc235f16"
Jul 23 16:15:32.669315 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:32.669268    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lqmct"
Jul 23 16:15:32.669775 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:32.669268    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8vt69"
Jul 23 16:15:32.669775 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:32.669399    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bkpz9"
Jul 23 16:15:32.669775 ip-10-0-143-166 kubenswrapper[2553]: E0723 16:15:32.669396    2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lqmct" podUID="c0d761bc-9c6e-4617-a75d-1811fc235f16"
Jul 23 16:15:32.669775 ip-10-0-143-166 kubenswrapper[2553]: E0723 16:15:32.669488    2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8vt69" podUID="633a475b-ddec-4391-856d-67674aa0ef0c"
Jul 23 16:15:32.669775 ip-10-0-143-166 kubenswrapper[2553]: E0723 16:15:32.669553    2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bkpz9" podUID="0ce6ab38-81a0-43b1-865b-42c65798de75"
Jul 23 16:15:34.668612 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:34.668581    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bkpz9"
Jul 23 16:15:34.669066 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:34.668721    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lqmct"
Jul 23 16:15:34.669066 ip-10-0-143-166 kubenswrapper[2553]: E0723 16:15:34.668734    2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bkpz9" podUID="0ce6ab38-81a0-43b1-865b-42c65798de75"
Jul 23 16:15:34.669066 ip-10-0-143-166 kubenswrapper[2553]: E0723 16:15:34.668836    2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lqmct" podUID="c0d761bc-9c6e-4617-a75d-1811fc235f16"
Jul 23 16:15:34.669066 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:34.668885    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8vt69"
Jul 23 16:15:34.669066 ip-10-0-143-166 kubenswrapper[2553]: E0723 16:15:34.668960    2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8vt69" podUID="633a475b-ddec-4391-856d-67674aa0ef0c"
Jul 23 16:15:36.235157 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:36.235117    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0ce6ab38-81a0-43b1-865b-42c65798de75-metrics-certs\") pod \"network-metrics-daemon-bkpz9\" (UID: \"0ce6ab38-81a0-43b1-865b-42c65798de75\") " pod="openshift-multus/network-metrics-daemon-bkpz9"
Jul 23 16:15:36.235688 ip-10-0-143-166 kubenswrapper[2553]: E0723 16:15:36.235286    2553 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 23 16:15:36.235688 ip-10-0-143-166 kubenswrapper[2553]: E0723 16:15:36.235367    2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0ce6ab38-81a0-43b1-865b-42c65798de75-metrics-certs podName:0ce6ab38-81a0-43b1-865b-42c65798de75 nodeName:}" failed. No retries permitted until 2026-07-23 16:15:52.235346258 +0000 UTC m=+34.099952385 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0ce6ab38-81a0-43b1-865b-42c65798de75-metrics-certs") pod "network-metrics-daemon-bkpz9" (UID: "0ce6ab38-81a0-43b1-865b-42c65798de75") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 23 16:15:36.336096 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:36.336051    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c0d761bc-9c6e-4617-a75d-1811fc235f16-original-pull-secret\") pod \"global-pull-secret-syncer-lqmct\" (UID: \"c0d761bc-9c6e-4617-a75d-1811fc235f16\") " pod="kube-system/global-pull-secret-syncer-lqmct"
Jul 23 16:15:36.336323 ip-10-0-143-166 kubenswrapper[2553]: E0723 16:15:36.336231    2553 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 23 16:15:36.336323 ip-10-0-143-166 kubenswrapper[2553]: E0723 16:15:36.336315    2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c0d761bc-9c6e-4617-a75d-1811fc235f16-original-pull-secret podName:c0d761bc-9c6e-4617-a75d-1811fc235f16 nodeName:}" failed. No retries permitted until 2026-07-23 16:15:52.336292185 +0000 UTC m=+34.200898295 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c0d761bc-9c6e-4617-a75d-1811fc235f16-original-pull-secret") pod "global-pull-secret-syncer-lqmct" (UID: "c0d761bc-9c6e-4617-a75d-1811fc235f16") : object "kube-system"/"original-pull-secret" not registered
Jul 23 16:15:36.437101 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:36.437062    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wkd4x\" (UniqueName: \"kubernetes.io/projected/633a475b-ddec-4391-856d-67674aa0ef0c-kube-api-access-wkd4x\") pod \"network-check-target-8vt69\" (UID: \"633a475b-ddec-4391-856d-67674aa0ef0c\") " pod="openshift-network-diagnostics/network-check-target-8vt69"
Jul 23 16:15:36.437348 ip-10-0-143-166 kubenswrapper[2553]: E0723 16:15:36.437244    2553 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 23 16:15:36.437348 ip-10-0-143-166 kubenswrapper[2553]: E0723 16:15:36.437269    2553 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 23 16:15:36.437348 ip-10-0-143-166 kubenswrapper[2553]: E0723 16:15:36.437284    2553 projected.go:196] Error preparing data for projected volume kube-api-access-wkd4x for pod openshift-network-diagnostics/network-check-target-8vt69: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 23 16:15:36.437348 ip-10-0-143-166 kubenswrapper[2553]: E0723 16:15:36.437337    2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/633a475b-ddec-4391-856d-67674aa0ef0c-kube-api-access-wkd4x podName:633a475b-ddec-4391-856d-67674aa0ef0c nodeName:}" failed. No retries permitted until 2026-07-23 16:15:52.437322951 +0000 UTC m=+34.301929061 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-wkd4x" (UniqueName: "kubernetes.io/projected/633a475b-ddec-4391-856d-67674aa0ef0c-kube-api-access-wkd4x") pod "network-check-target-8vt69" (UID: "633a475b-ddec-4391-856d-67674aa0ef0c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 23 16:15:36.669056 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:36.668983    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bkpz9"
Jul 23 16:15:36.669215 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:36.668983    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8vt69"
Jul 23 16:15:36.669215 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:36.669124    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lqmct"
Jul 23 16:15:36.669215 ip-10-0-143-166 kubenswrapper[2553]: E0723 16:15:36.669125    2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bkpz9" podUID="0ce6ab38-81a0-43b1-865b-42c65798de75"
Jul 23 16:15:36.669361 ip-10-0-143-166 kubenswrapper[2553]: E0723 16:15:36.669246    2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8vt69" podUID="633a475b-ddec-4391-856d-67674aa0ef0c"
Jul 23 16:15:36.669361 ip-10-0-143-166 kubenswrapper[2553]: E0723 16:15:36.669315    2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lqmct" podUID="c0d761bc-9c6e-4617-a75d-1811fc235f16"
Jul 23 16:15:38.669372 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:38.669342    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8vt69"
Jul 23 16:15:38.669816 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:38.669385    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lqmct"
Jul 23 16:15:38.669816 ip-10-0-143-166 kubenswrapper[2553]: E0723 16:15:38.669448    2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8vt69" podUID="633a475b-ddec-4391-856d-67674aa0ef0c"
Jul 23 16:15:38.669816 ip-10-0-143-166 kubenswrapper[2553]: E0723 16:15:38.669509    2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lqmct" podUID="c0d761bc-9c6e-4617-a75d-1811fc235f16"
Jul 23 16:15:38.669816 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:38.669530    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bkpz9"
Jul 23 16:15:38.669816 ip-10-0-143-166 kubenswrapper[2553]: E0723 16:15:38.669636    2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bkpz9" podUID="0ce6ab38-81a0-43b1-865b-42c65798de75"
Jul 23 16:15:40.668691 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:40.668588    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bkpz9"
Jul 23 16:15:40.668691 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:40.668575    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lqmct"
Jul 23 16:15:40.668691 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:40.668632    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8vt69"
Jul 23 16:15:40.669291 ip-10-0-143-166 kubenswrapper[2553]: E0723 16:15:40.668743    2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bkpz9" podUID="0ce6ab38-81a0-43b1-865b-42c65798de75"
Jul 23 16:15:40.669291 ip-10-0-143-166 kubenswrapper[2553]: E0723 16:15:40.668829    2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lqmct" podUID="c0d761bc-9c6e-4617-a75d-1811fc235f16"
Jul 23 16:15:40.669291 ip-10-0-143-166 kubenswrapper[2553]: E0723 16:15:40.668934    2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8vt69" podUID="633a475b-ddec-4391-856d-67674aa0ef0c"
Jul 23 16:15:41.750850 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:41.750507    2553 generic.go:356] "Generic (PLEG): container finished" podID="0069169d441a4ee10e0c5814a4929874" containerID="52e6e9fdef2c5ecd54f3d9a12726be2b0cc277506f66c0ad11d9933a57ac1496" exitCode=0
Jul 23 16:15:41.750850 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:41.750595    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-166.ec2.internal" event={"ID":"0069169d441a4ee10e0c5814a4929874","Type":"ContainerDied","Data":"52e6e9fdef2c5ecd54f3d9a12726be2b0cc277506f66c0ad11d9933a57ac1496"}
Jul 23 16:15:41.754132 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:41.754104    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-c9g74" event={"ID":"ff3e02fa-45b8-4aa2-acb0-5b4e791b5c7c","Type":"ContainerStarted","Data":"7dccc17ca5dd58ffbb87adc6e7a7515f9520733532f58d58e8a2e655ad4cb570"}
Jul 23 16:15:41.754249 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:41.754201    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-c9g74" event={"ID":"ff3e02fa-45b8-4aa2-acb0-5b4e791b5c7c","Type":"ContainerStarted","Data":"7ab57974e5e22473760afa714d6b51ce9cee77228d567b6c5651cae003b2ef73"}
Jul 23 16:15:41.754249 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:41.754245    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-c9g74" event={"ID":"ff3e02fa-45b8-4aa2-acb0-5b4e791b5c7c","Type":"ContainerStarted","Data":"d5be5fe33e119018a5e17443d4755b66936773680afb39fea3caf39e7db23daf"}
Jul 23 16:15:41.754342 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:41.754280    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-c9g74" event={"ID":"ff3e02fa-45b8-4aa2-acb0-5b4e791b5c7c","Type":"ContainerStarted","Data":"0509093758bd53b20da51f2e0c7e07d938a1526c59a6cda971d9c87b159fb673"}
Jul 23 16:15:41.754342 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:41.754322    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-c9g74" event={"ID":"ff3e02fa-45b8-4aa2-acb0-5b4e791b5c7c","Type":"ContainerStarted","Data":"bdb461aa7f14d6cd11bf64ec142f64b398eb2e491afecaaee743e2b656c00792"}
Jul 23 16:15:41.754438 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:41.754363    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-c9g74" event={"ID":"ff3e02fa-45b8-4aa2-acb0-5b4e791b5c7c","Type":"ContainerStarted","Data":"7f9c38bda645d27781c92b96dd60e8fabff90f67ed4edc68b70cb452a16041c3"}
Jul 23 16:15:41.755456 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:41.755436    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-j892l" event={"ID":"bba31e38-01db-45a0-8b60-9fc626237e01","Type":"ContainerStarted","Data":"5f1a05cbc772c3ab99455fcae1c7e7985403256165301634f64cd12e6b261e65"}
Jul 23 16:15:41.756887 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:41.756869    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-bkx5j" event={"ID":"83d1126c-3d57-463e-bce5-e1716daa5eb7","Type":"ContainerStarted","Data":"b76a842bd66ecaea0039c13ed06c49ebac3742d408e9b3ca4dc9e3329d2a3f29"}
Jul 23 16:15:41.758281 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:41.758259    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-qbjm4" event={"ID":"f8e034fc-9e28-43ab-bd6e-a62848b2ac5d","Type":"ContainerStarted","Data":"6d64f2b92f21e1e4b5444b0fdb8e618ecc8e1db4179d767e9fd898aab0242681"}
Jul 23 16:15:41.759537 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:41.759517    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-ltz8k" event={"ID":"dd8e418a-a9fa-4bb8-b939-fe242e316e72","Type":"ContainerStarted","Data":"8efa7d0adc49233e2109e26c4faf28b472188ee42b5351a39b8822f79b493d2f"}
Jul 23 16:15:41.760929 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:41.760910    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-cnp2t" event={"ID":"1af4cdcf-98b6-4aab-b234-3bed6566658b","Type":"ContainerStarted","Data":"164a9f489a270cf0e6aee751c503881a3b122a89ecb35e4817530a95843560f4"}
Jul 23 16:15:41.762119 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:41.762093    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-166.ec2.internal" event={"ID":"90edd8487e9f34a3dfeb9db04264b82f","Type":"ContainerStarted","Data":"c611e862695bd7e02f57f299b2fc2e05c00678cc56b92a926da99aa64972e93e"}
Jul 23 16:15:41.763224 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:41.763204    2553 generic.go:356] "Generic (PLEG): container finished" podID="d033268a-14e3-44c6-a470-313654dc9a6e" containerID="02974b951a888bb4d85c5437e210c78375c999059898bea549087b2cbe405502" exitCode=0
Jul 23 16:15:41.763302 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:41.763263    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-jjtst" event={"ID":"d033268a-14e3-44c6-a470-313654dc9a6e","Type":"ContainerDied","Data":"02974b951a888bb4d85c5437e210c78375c999059898bea549087b2cbe405502"}
Jul 23 16:15:41.764669 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:41.764650    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x5s6t" event={"ID":"d1f5fd12-987e-4a35-9764-e36f41189f33","Type":"ContainerStarted","Data":"674adcd45c8e86b1a78f03c2be9e83ab1d789ba23dc8cc5d243d22002e23b370"}
Jul 23 16:15:41.802094 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:41.802032    2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-qbjm4" podStartSLOduration=2.86816521 podStartE2EDuration="22.802013874s" totalImagesPullingTime="19.933848664s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 16:15:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 16:15:41.801959212 +0000 UTC m=+23.666565341" watchObservedRunningTime="2026-07-23 16:15:41.802013874 +0000 UTC m=+23.666620004"
Jul 23 16:15:41.819082 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:41.819039    2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-bkx5j" podStartSLOduration=2.843241979 podStartE2EDuration="22.819024153s" totalImagesPullingTime="19.975782174s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 16:15:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 16:15:41.818488303 +0000 UTC m=+23.683094430" watchObservedRunningTime="2026-07-23 16:15:41.819024153 +0000 UTC m=+23.683630277"
Jul 23 16:15:41.850013 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:41.849967    2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-j892l" podStartSLOduration=2.936102916 podStartE2EDuration="22.849950094s" totalImagesPullingTime="19.913847178s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 16:15:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 16:15:41.832010342 +0000 UTC m=+23.696616471" watchObservedRunningTime="2026-07-23 16:15:41.849950094 +0000 UTC m=+23.714556221"
Jul 23 16:15:41.850348 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:41.850324    2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-ltz8k" podStartSLOduration=6.736190083 podStartE2EDuration="22.850318125s" totalImagesPullingTime="16.114128042s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 16:15:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 16:15:41.849745995 +0000 UTC m=+23.714352124" watchObservedRunningTime="2026-07-23 16:15:41.850318125 +0000 UTC m=+23.714924330"
Jul 23 16:15:41.866447 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:41.866398    2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-cnp2t" podStartSLOduration=2.914401904 podStartE2EDuration="22.86638285s" totalImagesPullingTime="19.951980946s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 16:15:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 16:15:41.866108394 +0000 UTC m=+23.730714522" watchObservedRunningTime="2026-07-23 16:15:41.86638285 +0000 UTC m=+23.730988978"
Jul 23 16:15:41.886690 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:41.886495    2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-166.ec2.internal" podStartSLOduration=21.886480945 podStartE2EDuration="21.886480945s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 16:15:20 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 16:15:41.886355881 +0000 UTC m=+23.750962008" watchObservedRunningTime="2026-07-23 16:15:41.886480945 +0000 UTC m=+23.751087071"
Jul 23 16:15:42.668951 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:42.668918    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8vt69"
Jul 23 16:15:42.669264 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:42.668936    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bkpz9"
Jul 23 16:15:42.669264 ip-10-0-143-166 kubenswrapper[2553]: E0723 16:15:42.669051    2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8vt69" podUID="633a475b-ddec-4391-856d-67674aa0ef0c"
Jul 23 16:15:42.669264 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:42.669082    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lqmct"
Jul 23 16:15:42.669264 ip-10-0-143-166 kubenswrapper[2553]: E0723 16:15:42.669194    2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bkpz9" podUID="0ce6ab38-81a0-43b1-865b-42c65798de75"
Jul 23 16:15:42.669483 ip-10-0-143-166 kubenswrapper[2553]: E0723 16:15:42.669279    2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lqmct" podUID="c0d761bc-9c6e-4617-a75d-1811fc235f16"
Jul 23 16:15:42.768549 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:42.768501    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-2vp4s" event={"ID":"75b0ea12-192f-4910-b245-83d1df9119e7","Type":"ContainerStarted","Data":"230bd0ece1668b7cf575fafe32cedcd3a11948b806490e5217c25e14c22bb876"}
Jul 23 16:15:42.770590 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:42.770556    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-166.ec2.internal" event={"ID":"0069169d441a4ee10e0c5814a4929874","Type":"ContainerStarted","Data":"d87eb7fbb7bee9aa7366a157b8d4b80d32e7729d69de2cdd66c379594c801093"}
Jul 23 16:15:42.784742 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:42.784695    2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-2vp4s" podStartSLOduration=3.8683825 podStartE2EDuration="23.784679592s" totalImagesPullingTime="19.916297092s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 16:15:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 16:15:42.784156529 +0000 UTC m=+24.648762659" watchObservedRunningTime="2026-07-23 16:15:42.784679592 +0000 UTC m=+24.649285720"
Jul 23 16:15:42.798911 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:42.798861    2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-166.ec2.internal" podStartSLOduration=22.798840202 podStartE2EDuration="22.798840202s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 16:15:20 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 16:15:42.798795009 +0000 UTC m=+24.663401138" watchObservedRunningTime="2026-07-23 16:15:42.798840202 +0000 UTC m=+24.663446337"
Jul 23 16:15:42.912373 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:42.912350    2553 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jul 23 16:15:43.715556 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:43.715424    2553 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-23T16:15:42.912367924Z","UUID":"3917e0da-d55c-4bfa-ad9e-0ccdb9761521","Handler":null,"Name":"","Endpoint":""}
Jul 23 16:15:43.718151 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:43.717585    2553 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jul 23 16:15:43.718151 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:43.717632    2553 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jul 23 16:15:43.777567 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:43.777523    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-c9g74" event={"ID":"ff3e02fa-45b8-4aa2-acb0-5b4e791b5c7c","Type":"ContainerStarted","Data":"7b24331e7d8a26cfb6cf10f30b556ea6cdc0d8fb09f12c0db229c7869fe19eed"}
Jul 23 16:15:43.780118 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:43.780083    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x5s6t" event={"ID":"d1f5fd12-987e-4a35-9764-e36f41189f33","Type":"ContainerStarted","Data":"b6fdb9920b7dfd8d1323617c2bba82bfa5fff7f608b0b3b184d68e2fd7f95209"}
Jul 23 16:15:44.669594 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:44.669478    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8vt69"
Jul 23 16:15:44.669594 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:44.669529    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lqmct"
Jul 23 16:15:44.669594 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:44.669478    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bkpz9"
Jul 23 16:15:44.669870 ip-10-0-143-166 kubenswrapper[2553]: E0723 16:15:44.669636    2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8vt69" podUID="633a475b-ddec-4391-856d-67674aa0ef0c"
Jul 23 16:15:44.669870 ip-10-0-143-166 kubenswrapper[2553]: E0723 16:15:44.669761    2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lqmct" podUID="c0d761bc-9c6e-4617-a75d-1811fc235f16"
Jul 23 16:15:44.669870 ip-10-0-143-166 kubenswrapper[2553]: E0723 16:15:44.669841    2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bkpz9" podUID="0ce6ab38-81a0-43b1-865b-42c65798de75"
Jul 23 16:15:44.785768 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:44.785730    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x5s6t" event={"ID":"d1f5fd12-987e-4a35-9764-e36f41189f33","Type":"ContainerStarted","Data":"eed3d0f5a8a6bee79e3376ce5f539cb974b482e7b2ad6eec2e3fb4d4624382d2"}
Jul 23 16:15:45.013459 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:45.013377    2553 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-j892l"
Jul 23 16:15:45.014184 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:45.014151    2553 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-j892l"
Jul 23 16:15:45.031234 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:45.031131    2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x5s6t" podStartSLOduration=3.105509215 podStartE2EDuration="26.031111444s" totalImagesPullingTime="22.925602229s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 16:15:19 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 16:15:44.804858156 +0000 UTC m=+26.669464284" watchObservedRunningTime="2026-07-23 16:15:45.031111444 +0000 UTC m=+26.895717594"
Jul 23 16:15:45.788808 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:45.788772    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-j892l"
Jul 23 16:15:45.789367 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:45.789341    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-j892l"
Jul 23 16:15:46.669056 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:46.668780    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bkpz9"
Jul 23 16:15:46.669263 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:46.668786    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8vt69"
Jul 23 16:15:46.669263 ip-10-0-143-166 kubenswrapper[2553]: E0723 16:15:46.669126    2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bkpz9" podUID="0ce6ab38-81a0-43b1-865b-42c65798de75"
Jul 23 16:15:46.669263 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:46.668812    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lqmct"
Jul 23 16:15:46.669263 ip-10-0-143-166 kubenswrapper[2553]: E0723 16:15:46.669201    2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8vt69" podUID="633a475b-ddec-4391-856d-67674aa0ef0c"
Jul 23 16:15:46.669421 ip-10-0-143-166 kubenswrapper[2553]: E0723 16:15:46.669271    2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lqmct" podUID="c0d761bc-9c6e-4617-a75d-1811fc235f16"
Jul 23 16:15:46.792132 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:46.792095    2553 generic.go:356] "Generic (PLEG): container finished" podID="d033268a-14e3-44c6-a470-313654dc9a6e" containerID="bf0524fac357c8640591ae123f66754b7d105930c0c60cc3796d1586389e179d" exitCode=0
Jul 23 16:15:46.792675 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:46.792193    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-jjtst" event={"ID":"d033268a-14e3-44c6-a470-313654dc9a6e","Type":"ContainerDied","Data":"bf0524fac357c8640591ae123f66754b7d105930c0c60cc3796d1586389e179d"}
Jul 23 16:15:46.797157 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:46.797125    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-c9g74" event={"ID":"ff3e02fa-45b8-4aa2-acb0-5b4e791b5c7c","Type":"ContainerStarted","Data":"c8894161623d6a8f5248817f8318896cf53eeaec6e6ff06193c923ffc616b4b7"}
Jul 23 16:15:46.798596 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:46.797460    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-c9g74"
Jul 23 16:15:46.798596 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:46.797563    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-c9g74"
Jul 23 16:15:46.798596 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:46.797636    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-c9g74"
Jul 23 16:15:46.814802 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:46.814772    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-c9g74"
Jul 23 16:15:46.814949 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:46.814874    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-c9g74"
Jul 23 16:15:46.883648 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:46.883600    2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-c9g74" podStartSLOduration=7.903654377 podStartE2EDuration="27.883585944s" totalImagesPullingTime="19.979931567s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 16:15:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 16:15:46.882159285 +0000 UTC m=+28.746765414" watchObservedRunningTime="2026-07-23 16:15:46.883585944 +0000 UTC m=+28.748192071"
Jul 23 16:15:47.960241 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:47.960207    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-lqmct"]
Jul 23 16:15:47.960785 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:47.960327    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lqmct"
Jul 23 16:15:47.960785 ip-10-0-143-166 kubenswrapper[2553]: E0723 16:15:47.960420    2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lqmct" podUID="c0d761bc-9c6e-4617-a75d-1811fc235f16"
Jul 23 16:15:47.963538 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:47.963512    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-8vt69"]
Jul 23 16:15:47.963670 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:47.963634    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8vt69"
Jul 23 16:15:47.963774 ip-10-0-143-166 kubenswrapper[2553]: E0723 16:15:47.963743    2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8vt69" podUID="633a475b-ddec-4391-856d-67674aa0ef0c"
Jul 23 16:15:47.964140 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:47.964121    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-bkpz9"]
Jul 23 16:15:47.964243 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:47.964229    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bkpz9"
Jul 23 16:15:47.964347 ip-10-0-143-166 kubenswrapper[2553]: E0723 16:15:47.964327    2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bkpz9" podUID="0ce6ab38-81a0-43b1-865b-42c65798de75"
Jul 23 16:15:48.802870 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:48.802833    2553 generic.go:356] "Generic (PLEG): container finished" podID="d033268a-14e3-44c6-a470-313654dc9a6e" containerID="9ab2097e8454fef57d6d95778eb84542bcec0066721c3f1a4904d08db1987492" exitCode=0
Jul 23 16:15:48.803122 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:48.802899    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-jjtst" event={"ID":"d033268a-14e3-44c6-a470-313654dc9a6e","Type":"ContainerDied","Data":"9ab2097e8454fef57d6d95778eb84542bcec0066721c3f1a4904d08db1987492"}
Jul 23 16:15:49.669274 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:49.669087    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8vt69"
Jul 23 16:15:49.669720 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:49.669181    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lqmct"
Jul 23 16:15:49.669720 ip-10-0-143-166 kubenswrapper[2553]: E0723 16:15:49.669366    2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8vt69" podUID="633a475b-ddec-4391-856d-67674aa0ef0c"
Jul 23 16:15:49.669720 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:49.669189    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bkpz9"
Jul 23 16:15:49.669720 ip-10-0-143-166 kubenswrapper[2553]: E0723 16:15:49.669428    2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lqmct" podUID="c0d761bc-9c6e-4617-a75d-1811fc235f16"
Jul 23 16:15:49.669720 ip-10-0-143-166 kubenswrapper[2553]: E0723 16:15:49.669543    2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bkpz9" podUID="0ce6ab38-81a0-43b1-865b-42c65798de75"
Jul 23 16:15:50.809600 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:50.809564    2553 generic.go:356] "Generic (PLEG): container finished" podID="d033268a-14e3-44c6-a470-313654dc9a6e" containerID="64d64101bc5fa04693e22c9be9566832bf96fe1f8add7dc078ce5a317231b53e" exitCode=0
Jul 23 16:15:50.810144 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:50.809619    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-jjtst" event={"ID":"d033268a-14e3-44c6-a470-313654dc9a6e","Type":"ContainerDied","Data":"64d64101bc5fa04693e22c9be9566832bf96fe1f8add7dc078ce5a317231b53e"}
Jul 23 16:15:51.668990 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:51.668953    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8vt69"
Jul 23 16:15:51.669215 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:51.668953    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bkpz9"
Jul 23 16:15:51.669215 ip-10-0-143-166 kubenswrapper[2553]: E0723 16:15:51.669081    2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8vt69" podUID="633a475b-ddec-4391-856d-67674aa0ef0c"
Jul 23 16:15:51.669215 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:51.668971    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lqmct"
Jul 23 16:15:51.669370 ip-10-0-143-166 kubenswrapper[2553]: E0723 16:15:51.669215    2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bkpz9" podUID="0ce6ab38-81a0-43b1-865b-42c65798de75"
Jul 23 16:15:51.669370 ip-10-0-143-166 kubenswrapper[2553]: E0723 16:15:51.669270    2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lqmct" podUID="c0d761bc-9c6e-4617-a75d-1811fc235f16"
Jul 23 16:15:52.254784 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:52.254747    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0ce6ab38-81a0-43b1-865b-42c65798de75-metrics-certs\") pod \"network-metrics-daemon-bkpz9\" (UID: \"0ce6ab38-81a0-43b1-865b-42c65798de75\") " pod="openshift-multus/network-metrics-daemon-bkpz9"
Jul 23 16:15:52.255216 ip-10-0-143-166 kubenswrapper[2553]: E0723 16:15:52.254900    2553 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 23 16:15:52.255216 ip-10-0-143-166 kubenswrapper[2553]: E0723 16:15:52.254974    2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0ce6ab38-81a0-43b1-865b-42c65798de75-metrics-certs podName:0ce6ab38-81a0-43b1-865b-42c65798de75 nodeName:}" failed. No retries permitted until 2026-07-23 16:16:24.254953631 +0000 UTC m=+66.119559739 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0ce6ab38-81a0-43b1-865b-42c65798de75-metrics-certs") pod "network-metrics-daemon-bkpz9" (UID: "0ce6ab38-81a0-43b1-865b-42c65798de75") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 23 16:15:52.355411 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:52.355371    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c0d761bc-9c6e-4617-a75d-1811fc235f16-original-pull-secret\") pod \"global-pull-secret-syncer-lqmct\" (UID: \"c0d761bc-9c6e-4617-a75d-1811fc235f16\") " pod="kube-system/global-pull-secret-syncer-lqmct"
Jul 23 16:15:52.355596 ip-10-0-143-166 kubenswrapper[2553]: E0723 16:15:52.355513    2553 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 23 16:15:52.355596 ip-10-0-143-166 kubenswrapper[2553]: E0723 16:15:52.355580    2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c0d761bc-9c6e-4617-a75d-1811fc235f16-original-pull-secret podName:c0d761bc-9c6e-4617-a75d-1811fc235f16 nodeName:}" failed. No retries permitted until 2026-07-23 16:16:24.355565187 +0000 UTC m=+66.220171315 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c0d761bc-9c6e-4617-a75d-1811fc235f16-original-pull-secret") pod "global-pull-secret-syncer-lqmct" (UID: "c0d761bc-9c6e-4617-a75d-1811fc235f16") : object "kube-system"/"original-pull-secret" not registered
Jul 23 16:15:52.456732 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:52.456697    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wkd4x\" (UniqueName: \"kubernetes.io/projected/633a475b-ddec-4391-856d-67674aa0ef0c-kube-api-access-wkd4x\") pod \"network-check-target-8vt69\" (UID: \"633a475b-ddec-4391-856d-67674aa0ef0c\") " pod="openshift-network-diagnostics/network-check-target-8vt69"
Jul 23 16:15:52.456909 ip-10-0-143-166 kubenswrapper[2553]: E0723 16:15:52.456833    2553 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 23 16:15:52.456909 ip-10-0-143-166 kubenswrapper[2553]: E0723 16:15:52.456857    2553 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 23 16:15:52.456909 ip-10-0-143-166 kubenswrapper[2553]: E0723 16:15:52.456870    2553 projected.go:196] Error preparing data for projected volume kube-api-access-wkd4x for pod openshift-network-diagnostics/network-check-target-8vt69: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 23 16:15:52.457062 ip-10-0-143-166 kubenswrapper[2553]: E0723 16:15:52.456924    2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/633a475b-ddec-4391-856d-67674aa0ef0c-kube-api-access-wkd4x podName:633a475b-ddec-4391-856d-67674aa0ef0c nodeName:}" failed. No retries permitted until 2026-07-23 16:16:24.456910451 +0000 UTC m=+66.321516558 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-wkd4x" (UniqueName: "kubernetes.io/projected/633a475b-ddec-4391-856d-67674aa0ef0c-kube-api-access-wkd4x") pod "network-check-target-8vt69" (UID: "633a475b-ddec-4391-856d-67674aa0ef0c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 23 16:15:53.458391 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:53.458362    2553 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-166.ec2.internal" event="NodeReady"
Jul 23 16:15:53.458818 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:53.458529    2553 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jul 23 16:15:53.511785 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:53.511751    2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-6868994b56-jpcfj"]
Jul 23 16:15:53.513829 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:53.513809    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6868994b56-jpcfj"
Jul 23 16:15:53.516480 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:53.516458    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Jul 23 16:15:53.517384 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:53.517342    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Jul 23 16:15:53.517763 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:53.517746    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-cvkcr\""
Jul 23 16:15:53.518765 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:53.518739    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Jul 23 16:15:53.523991 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:53.523962    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Jul 23 16:15:53.543057 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:53.542936    2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-jkc4g"]
Jul 23 16:15:53.544752 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:53.544733    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-6868994b56-jpcfj"]
Jul 23 16:15:53.544871 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:53.544845    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-jkc4g"
Jul 23 16:15:53.555389 ip-10-0-143-166 kubenswrapper[2553]: E0723 16:15:53.555357    2553 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"dns-default-metrics-tls\" is forbidden: User \"system:node:ip-10-0-143-166.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"openshift-dns\": no relationship found between node 'ip-10-0-143-166.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" type="*v1.Secret"
Jul 23 16:15:53.556280 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:53.556258    2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-gcv6f"]
Jul 23 16:15:53.557954 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:53.557937    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-gcv6f"
Jul 23 16:15:53.574527 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:53.574502    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 23 16:15:53.574771 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:53.574753    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-khnm5\""
Jul 23 16:15:53.583510 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:53.583481    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 23 16:15:53.584259 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:53.584237    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 23 16:15:53.584727 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:53.584711    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-pldcw\""
Jul 23 16:15:53.584800 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:53.584740    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 23 16:15:53.587251 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:53.587230    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-jkc4g"]
Jul 23 16:15:53.616355 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:53.616270    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-gcv6f"]
Jul 23 16:15:53.665777 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:53.665732    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/267f079f-9842-415b-858e-c591c6a73a64-installation-pull-secrets\") pod \"image-registry-6868994b56-jpcfj\" (UID: \"267f079f-9842-415b-858e-c591c6a73a64\") " pod="openshift-image-registry/image-registry-6868994b56-jpcfj"
Jul 23 16:15:53.665965 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:53.665789    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/febad6e2-993e-4dd1-b043-33db2bdda4fe-cert\") pod \"ingress-canary-gcv6f\" (UID: \"febad6e2-993e-4dd1-b043-33db2bdda4fe\") " pod="openshift-ingress-canary/ingress-canary-gcv6f"
Jul 23 16:15:53.665965 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:53.665815    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/267f079f-9842-415b-858e-c591c6a73a64-registry-certificates\") pod \"image-registry-6868994b56-jpcfj\" (UID: \"267f079f-9842-415b-858e-c591c6a73a64\") " pod="openshift-image-registry/image-registry-6868994b56-jpcfj"
Jul 23 16:15:53.665965 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:53.665873    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/267f079f-9842-415b-858e-c591c6a73a64-bound-sa-token\") pod \"image-registry-6868994b56-jpcfj\" (UID: \"267f079f-9842-415b-858e-c591c6a73a64\") " pod="openshift-image-registry/image-registry-6868994b56-jpcfj"
Jul 23 16:15:53.665965 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:53.665910    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jb8zs\" (UniqueName: \"kubernetes.io/projected/febad6e2-993e-4dd1-b043-33db2bdda4fe-kube-api-access-jb8zs\") pod \"ingress-canary-gcv6f\" (UID: \"febad6e2-993e-4dd1-b043-33db2bdda4fe\") " pod="openshift-ingress-canary/ingress-canary-gcv6f"
Jul 23 16:15:53.665965 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:53.665952    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/267f079f-9842-415b-858e-c591c6a73a64-ca-trust-extracted\") pod \"image-registry-6868994b56-jpcfj\" (UID: \"267f079f-9842-415b-858e-c591c6a73a64\") " pod="openshift-image-registry/image-registry-6868994b56-jpcfj"
Jul 23 16:15:53.666239 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:53.665973    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ztn2d\" (UniqueName: \"kubernetes.io/projected/267f079f-9842-415b-858e-c591c6a73a64-kube-api-access-ztn2d\") pod \"image-registry-6868994b56-jpcfj\" (UID: \"267f079f-9842-415b-858e-c591c6a73a64\") " pod="openshift-image-registry/image-registry-6868994b56-jpcfj"
Jul 23 16:15:53.666239 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:53.665998    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/7ca02cf0-ad65-46e4-a0bd-25a470519d68-config-volume\") pod \"dns-default-jkc4g\" (UID: \"7ca02cf0-ad65-46e4-a0bd-25a470519d68\") " pod="openshift-dns/dns-default-jkc4g"
Jul 23 16:15:53.666239 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:53.666027    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/267f079f-9842-415b-858e-c591c6a73a64-trusted-ca\") pod \"image-registry-6868994b56-jpcfj\" (UID: \"267f079f-9842-415b-858e-c591c6a73a64\") " pod="openshift-image-registry/image-registry-6868994b56-jpcfj"
Jul 23 16:15:53.666239 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:53.666108    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7ca02cf0-ad65-46e4-a0bd-25a470519d68-metrics-tls\") pod \"dns-default-jkc4g\" (UID: \"7ca02cf0-ad65-46e4-a0bd-25a470519d68\") " pod="openshift-dns/dns-default-jkc4g"
Jul 23 16:15:53.666239 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:53.666132    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kv8vj\" (UniqueName: \"kubernetes.io/projected/7ca02cf0-ad65-46e4-a0bd-25a470519d68-kube-api-access-kv8vj\") pod \"dns-default-jkc4g\" (UID: \"7ca02cf0-ad65-46e4-a0bd-25a470519d68\") " pod="openshift-dns/dns-default-jkc4g"
Jul 23 16:15:53.666239 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:53.666195    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/267f079f-9842-415b-858e-c591c6a73a64-image-registry-private-configuration\") pod \"image-registry-6868994b56-jpcfj\" (UID: \"267f079f-9842-415b-858e-c591c6a73a64\") " pod="openshift-image-registry/image-registry-6868994b56-jpcfj"
Jul 23 16:15:53.666239 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:53.666222    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/267f079f-9842-415b-858e-c591c6a73a64-registry-tls\") pod \"image-registry-6868994b56-jpcfj\" (UID: \"267f079f-9842-415b-858e-c591c6a73a64\") " pod="openshift-image-registry/image-registry-6868994b56-jpcfj"
Jul 23 16:15:53.666487 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:53.666248    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7ca02cf0-ad65-46e4-a0bd-25a470519d68-tmp-dir\") pod \"dns-default-jkc4g\" (UID: \"7ca02cf0-ad65-46e4-a0bd-25a470519d68\") " pod="openshift-dns/dns-default-jkc4g"
Jul 23 16:15:53.668864 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:53.668836    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8vt69"
Jul 23 16:15:53.668995 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:53.668850    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lqmct"
Jul 23 16:15:53.668995 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:53.668973    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bkpz9"
Jul 23 16:15:53.675702 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:53.675676    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 23 16:15:53.675839 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:53.675825    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-4khjt\""
Jul 23 16:15:53.676272 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:53.676218    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 23 16:15:53.676390 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:53.676249    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 23 16:15:53.676390 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:53.676349    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 23 16:15:53.676500 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:53.676432    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-cwhlx\""
Jul 23 16:15:53.766987 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:53.766956    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7ca02cf0-ad65-46e4-a0bd-25a470519d68-metrics-tls\") pod \"dns-default-jkc4g\" (UID: \"7ca02cf0-ad65-46e4-a0bd-25a470519d68\") " pod="openshift-dns/dns-default-jkc4g"
Jul 23 16:15:53.766987 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:53.766999    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kv8vj\" (UniqueName: \"kubernetes.io/projected/7ca02cf0-ad65-46e4-a0bd-25a470519d68-kube-api-access-kv8vj\") pod \"dns-default-jkc4g\" (UID: \"7ca02cf0-ad65-46e4-a0bd-25a470519d68\") " pod="openshift-dns/dns-default-jkc4g"
Jul 23 16:15:53.767966 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:53.767045    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/267f079f-9842-415b-858e-c591c6a73a64-image-registry-private-configuration\") pod \"image-registry-6868994b56-jpcfj\" (UID: \"267f079f-9842-415b-858e-c591c6a73a64\") " pod="openshift-image-registry/image-registry-6868994b56-jpcfj"
Jul 23 16:15:53.767966 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:53.767070    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/267f079f-9842-415b-858e-c591c6a73a64-registry-tls\") pod \"image-registry-6868994b56-jpcfj\" (UID: \"267f079f-9842-415b-858e-c591c6a73a64\") " pod="openshift-image-registry/image-registry-6868994b56-jpcfj"
Jul 23 16:15:53.767966 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:53.767099    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7ca02cf0-ad65-46e4-a0bd-25a470519d68-tmp-dir\") pod \"dns-default-jkc4g\" (UID: \"7ca02cf0-ad65-46e4-a0bd-25a470519d68\") " pod="openshift-dns/dns-default-jkc4g"
Jul 23 16:15:53.767966 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:53.767122    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/267f079f-9842-415b-858e-c591c6a73a64-installation-pull-secrets\") pod \"image-registry-6868994b56-jpcfj\" (UID: \"267f079f-9842-415b-858e-c591c6a73a64\") " pod="openshift-image-registry/image-registry-6868994b56-jpcfj"
Jul 23 16:15:53.767966 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:53.767154    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/febad6e2-993e-4dd1-b043-33db2bdda4fe-cert\") pod \"ingress-canary-gcv6f\" (UID: \"febad6e2-993e-4dd1-b043-33db2bdda4fe\") " pod="openshift-ingress-canary/ingress-canary-gcv6f"
Jul 23 16:15:53.767966 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:53.767193    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/267f079f-9842-415b-858e-c591c6a73a64-registry-certificates\") pod \"image-registry-6868994b56-jpcfj\" (UID: \"267f079f-9842-415b-858e-c591c6a73a64\") " pod="openshift-image-registry/image-registry-6868994b56-jpcfj"
Jul 23 16:15:53.767966 ip-10-0-143-166 kubenswrapper[2553]: E0723 16:15:53.767225    2553 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 23 16:15:53.767966 ip-10-0-143-166 kubenswrapper[2553]: E0723 16:15:53.767240    2553 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6868994b56-jpcfj: secret "image-registry-tls" not found
Jul 23 16:15:53.767966 ip-10-0-143-166 kubenswrapper[2553]: E0723 16:15:53.767298    2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/267f079f-9842-415b-858e-c591c6a73a64-registry-tls podName:267f079f-9842-415b-858e-c591c6a73a64 nodeName:}" failed. No retries permitted until 2026-07-23 16:15:54.267278146 +0000 UTC m=+36.131884257 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/267f079f-9842-415b-858e-c591c6a73a64-registry-tls") pod "image-registry-6868994b56-jpcfj" (UID: "267f079f-9842-415b-858e-c591c6a73a64") : secret "image-registry-tls" not found
Jul 23 16:15:53.767966 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:53.767223    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/267f079f-9842-415b-858e-c591c6a73a64-bound-sa-token\") pod \"image-registry-6868994b56-jpcfj\" (UID: \"267f079f-9842-415b-858e-c591c6a73a64\") " pod="openshift-image-registry/image-registry-6868994b56-jpcfj"
Jul 23 16:15:53.767966 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:53.767393    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jb8zs\" (UniqueName: \"kubernetes.io/projected/febad6e2-993e-4dd1-b043-33db2bdda4fe-kube-api-access-jb8zs\") pod \"ingress-canary-gcv6f\" (UID: \"febad6e2-993e-4dd1-b043-33db2bdda4fe\") " pod="openshift-ingress-canary/ingress-canary-gcv6f"
Jul 23 16:15:53.767966 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:53.767436    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/267f079f-9842-415b-858e-c591c6a73a64-ca-trust-extracted\") pod \"image-registry-6868994b56-jpcfj\" (UID: \"267f079f-9842-415b-858e-c591c6a73a64\") " pod="openshift-image-registry/image-registry-6868994b56-jpcfj"
Jul 23 16:15:53.767966 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:53.767468    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ztn2d\" (UniqueName: \"kubernetes.io/projected/267f079f-9842-415b-858e-c591c6a73a64-kube-api-access-ztn2d\") pod \"image-registry-6868994b56-jpcfj\" (UID: \"267f079f-9842-415b-858e-c591c6a73a64\") " pod="openshift-image-registry/image-registry-6868994b56-jpcfj"
Jul 23 16:15:53.767966 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:53.767496    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/7ca02cf0-ad65-46e4-a0bd-25a470519d68-config-volume\") pod \"dns-default-jkc4g\" (UID: \"7ca02cf0-ad65-46e4-a0bd-25a470519d68\") " pod="openshift-dns/dns-default-jkc4g"
Jul 23 16:15:53.767966 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:53.767506    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7ca02cf0-ad65-46e4-a0bd-25a470519d68-tmp-dir\") pod \"dns-default-jkc4g\" (UID: \"7ca02cf0-ad65-46e4-a0bd-25a470519d68\") " pod="openshift-dns/dns-default-jkc4g"
Jul 23 16:15:53.767966 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:53.767524    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/267f079f-9842-415b-858e-c591c6a73a64-trusted-ca\") pod \"image-registry-6868994b56-jpcfj\" (UID: \"267f079f-9842-415b-858e-c591c6a73a64\") " pod="openshift-image-registry/image-registry-6868994b56-jpcfj"
Jul 23 16:15:53.767966 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:53.767946    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/267f079f-9842-415b-858e-c591c6a73a64-registry-certificates\") pod \"image-registry-6868994b56-jpcfj\" (UID: \"267f079f-9842-415b-858e-c591c6a73a64\") " pod="openshift-image-registry/image-registry-6868994b56-jpcfj"
Jul 23 16:15:53.768696 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:53.768034    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/267f079f-9842-415b-858e-c591c6a73a64-ca-trust-extracted\") pod \"image-registry-6868994b56-jpcfj\" (UID: \"267f079f-9842-415b-858e-c591c6a73a64\") " pod="openshift-image-registry/image-registry-6868994b56-jpcfj"
Jul 23 16:15:53.768696 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:53.768049    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/7ca02cf0-ad65-46e4-a0bd-25a470519d68-config-volume\") pod \"dns-default-jkc4g\" (UID: \"7ca02cf0-ad65-46e4-a0bd-25a470519d68\") " pod="openshift-dns/dns-default-jkc4g"
Jul 23 16:15:53.768696 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:53.768657    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/267f079f-9842-415b-858e-c591c6a73a64-trusted-ca\") pod \"image-registry-6868994b56-jpcfj\" (UID: \"267f079f-9842-415b-858e-c591c6a73a64\") " pod="openshift-image-registry/image-registry-6868994b56-jpcfj"
Jul 23 16:15:53.771540 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:53.771519    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/267f079f-9842-415b-858e-c591c6a73a64-image-registry-private-configuration\") pod \"image-registry-6868994b56-jpcfj\" (UID: \"267f079f-9842-415b-858e-c591c6a73a64\") " pod="openshift-image-registry/image-registry-6868994b56-jpcfj"
Jul 23 16:15:53.771664 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:53.771630    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/267f079f-9842-415b-858e-c591c6a73a64-installation-pull-secrets\") pod \"image-registry-6868994b56-jpcfj\" (UID: \"267f079f-9842-415b-858e-c591c6a73a64\") " pod="openshift-image-registry/image-registry-6868994b56-jpcfj"
Jul 23 16:15:53.771717 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:53.771685    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/febad6e2-993e-4dd1-b043-33db2bdda4fe-cert\") pod \"ingress-canary-gcv6f\" (UID: \"febad6e2-993e-4dd1-b043-33db2bdda4fe\") " pod="openshift-ingress-canary/ingress-canary-gcv6f"
Jul 23 16:15:53.782599 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:53.782572    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kv8vj\" (UniqueName: \"kubernetes.io/projected/7ca02cf0-ad65-46e4-a0bd-25a470519d68-kube-api-access-kv8vj\") pod \"dns-default-jkc4g\" (UID: \"7ca02cf0-ad65-46e4-a0bd-25a470519d68\") " pod="openshift-dns/dns-default-jkc4g"
Jul 23 16:15:53.791009 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:53.790975    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/267f079f-9842-415b-858e-c591c6a73a64-bound-sa-token\") pod \"image-registry-6868994b56-jpcfj\" (UID: \"267f079f-9842-415b-858e-c591c6a73a64\") " pod="openshift-image-registry/image-registry-6868994b56-jpcfj"
Jul 23 16:15:53.793969 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:53.793933    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ztn2d\" (UniqueName: \"kubernetes.io/projected/267f079f-9842-415b-858e-c591c6a73a64-kube-api-access-ztn2d\") pod \"image-registry-6868994b56-jpcfj\" (UID: \"267f079f-9842-415b-858e-c591c6a73a64\") " pod="openshift-image-registry/image-registry-6868994b56-jpcfj"
Jul 23 16:15:53.794685 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:53.794662    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jb8zs\" (UniqueName: \"kubernetes.io/projected/febad6e2-993e-4dd1-b043-33db2bdda4fe-kube-api-access-jb8zs\") pod \"ingress-canary-gcv6f\" (UID: \"febad6e2-993e-4dd1-b043-33db2bdda4fe\") " pod="openshift-ingress-canary/ingress-canary-gcv6f"
Jul 23 16:15:53.868465 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:53.868381    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-gcv6f"
Jul 23 16:15:54.271067 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:54.271023    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/267f079f-9842-415b-858e-c591c6a73a64-registry-tls\") pod \"image-registry-6868994b56-jpcfj\" (UID: \"267f079f-9842-415b-858e-c591c6a73a64\") " pod="openshift-image-registry/image-registry-6868994b56-jpcfj"
Jul 23 16:15:54.271269 ip-10-0-143-166 kubenswrapper[2553]: E0723 16:15:54.271229    2553 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 23 16:15:54.271269 ip-10-0-143-166 kubenswrapper[2553]: E0723 16:15:54.271253    2553 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6868994b56-jpcfj: secret "image-registry-tls" not found
Jul 23 16:15:54.271357 ip-10-0-143-166 kubenswrapper[2553]: E0723 16:15:54.271317    2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/267f079f-9842-415b-858e-c591c6a73a64-registry-tls podName:267f079f-9842-415b-858e-c591c6a73a64 nodeName:}" failed. No retries permitted until 2026-07-23 16:15:55.271299553 +0000 UTC m=+37.135905659 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/267f079f-9842-415b-858e-c591c6a73a64-registry-tls") pod "image-registry-6868994b56-jpcfj" (UID: "267f079f-9842-415b-858e-c591c6a73a64") : secret "image-registry-tls" not found
Jul 23 16:15:54.740918 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:54.740886    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 23 16:15:54.747241 ip-10-0-143-166 kubenswrapper[2553]: E0723 16:15:54.747210    2553 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 23 16:15:54.747396 ip-10-0-143-166 kubenswrapper[2553]: E0723 16:15:54.747293    2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7ca02cf0-ad65-46e4-a0bd-25a470519d68-metrics-tls podName:7ca02cf0-ad65-46e4-a0bd-25a470519d68 nodeName:}" failed. No retries permitted until 2026-07-23 16:15:55.247270263 +0000 UTC m=+37.111876369 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/7ca02cf0-ad65-46e4-a0bd-25a470519d68-metrics-tls") pod "dns-default-jkc4g" (UID: "7ca02cf0-ad65-46e4-a0bd-25a470519d68") : secret "dns-default-metrics-tls" not found
Jul 23 16:15:55.007281 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:55.007075    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-gcv6f"]
Jul 23 16:15:55.011794 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:15:55.011766    2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfebad6e2_993e_4dd1_b043_33db2bdda4fe.slice/crio-233a2d4edfea1eab68e69aa22cbe024ee05c375348d9272c0671e760cfdebc1c WatchSource:0}: Error finding container 233a2d4edfea1eab68e69aa22cbe024ee05c375348d9272c0671e760cfdebc1c: Status 404 returned error can't find the container with id 233a2d4edfea1eab68e69aa22cbe024ee05c375348d9272c0671e760cfdebc1c
Jul 23 16:15:55.279680 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:55.279588    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7ca02cf0-ad65-46e4-a0bd-25a470519d68-metrics-tls\") pod \"dns-default-jkc4g\" (UID: \"7ca02cf0-ad65-46e4-a0bd-25a470519d68\") " pod="openshift-dns/dns-default-jkc4g"
Jul 23 16:15:55.279680 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:55.279638    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/267f079f-9842-415b-858e-c591c6a73a64-registry-tls\") pod \"image-registry-6868994b56-jpcfj\" (UID: \"267f079f-9842-415b-858e-c591c6a73a64\") " pod="openshift-image-registry/image-registry-6868994b56-jpcfj"
Jul 23 16:15:55.279880 ip-10-0-143-166 kubenswrapper[2553]: E0723 16:15:55.279738    2553 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 23 16:15:55.279880 ip-10-0-143-166 kubenswrapper[2553]: E0723 16:15:55.279758    2553 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 23 16:15:55.279880 ip-10-0-143-166 kubenswrapper[2553]: E0723 16:15:55.279768    2553 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6868994b56-jpcfj: secret "image-registry-tls" not found
Jul 23 16:15:55.279880 ip-10-0-143-166 kubenswrapper[2553]: E0723 16:15:55.279802    2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7ca02cf0-ad65-46e4-a0bd-25a470519d68-metrics-tls podName:7ca02cf0-ad65-46e4-a0bd-25a470519d68 nodeName:}" failed. No retries permitted until 2026-07-23 16:15:56.279787455 +0000 UTC m=+38.144393560 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/7ca02cf0-ad65-46e4-a0bd-25a470519d68-metrics-tls") pod "dns-default-jkc4g" (UID: "7ca02cf0-ad65-46e4-a0bd-25a470519d68") : secret "dns-default-metrics-tls" not found
Jul 23 16:15:55.279880 ip-10-0-143-166 kubenswrapper[2553]: E0723 16:15:55.279817    2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/267f079f-9842-415b-858e-c591c6a73a64-registry-tls podName:267f079f-9842-415b-858e-c591c6a73a64 nodeName:}" failed. No retries permitted until 2026-07-23 16:15:57.279810721 +0000 UTC m=+39.144416827 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/267f079f-9842-415b-858e-c591c6a73a64-registry-tls") pod "image-registry-6868994b56-jpcfj" (UID: "267f079f-9842-415b-858e-c591c6a73a64") : secret "image-registry-tls" not found
Jul 23 16:15:55.826180 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:55.826125    2553 generic.go:356] "Generic (PLEG): container finished" podID="d033268a-14e3-44c6-a470-313654dc9a6e" containerID="efcf04438b01b0d0d71a3855dbf39134521ee70e80fb7b63c2f1265d1d018291" exitCode=0
Jul 23 16:15:55.826847 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:55.826255    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-jjtst" event={"ID":"d033268a-14e3-44c6-a470-313654dc9a6e","Type":"ContainerDied","Data":"efcf04438b01b0d0d71a3855dbf39134521ee70e80fb7b63c2f1265d1d018291"}
Jul 23 16:15:55.829009 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:55.828976    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-gcv6f" event={"ID":"febad6e2-993e-4dd1-b043-33db2bdda4fe","Type":"ContainerStarted","Data":"233a2d4edfea1eab68e69aa22cbe024ee05c375348d9272c0671e760cfdebc1c"}
Jul 23 16:15:56.148304 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:56.148272    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j892l_bba31e38-01db-45a0-8b60-9fc626237e01/konnectivity-agent/0.log" limit=1024
Jul 23 16:15:56.232602 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:56.232557    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j892l_bba31e38-01db-45a0-8b60-9fc626237e01/konnectivity-agent/0.log" limit=1024
Jul 23 16:15:56.288623 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:56.288585    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7ca02cf0-ad65-46e4-a0bd-25a470519d68-metrics-tls\") pod \"dns-default-jkc4g\" (UID: \"7ca02cf0-ad65-46e4-a0bd-25a470519d68\") " pod="openshift-dns/dns-default-jkc4g"
Jul 23 16:15:56.288793 ip-10-0-143-166 kubenswrapper[2553]: E0723 16:15:56.288764    2553 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 23 16:15:56.288875 ip-10-0-143-166 kubenswrapper[2553]: E0723 16:15:56.288857    2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7ca02cf0-ad65-46e4-a0bd-25a470519d68-metrics-tls podName:7ca02cf0-ad65-46e4-a0bd-25a470519d68 nodeName:}" failed. No retries permitted until 2026-07-23 16:15:58.288833443 +0000 UTC m=+40.153439562 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/7ca02cf0-ad65-46e4-a0bd-25a470519d68-metrics-tls") pod "dns-default-jkc4g" (UID: "7ca02cf0-ad65-46e4-a0bd-25a470519d68") : secret "dns-default-metrics-tls" not found
Jul 23 16:15:56.298705 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:56.298678    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j892l_bba31e38-01db-45a0-8b60-9fc626237e01/konnectivity-agent/0.log" limit=1024
Jul 23 16:15:56.834708 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:56.834678    2553 generic.go:356] "Generic (PLEG): container finished" podID="d033268a-14e3-44c6-a470-313654dc9a6e" containerID="b7b8e4e033ba00d1e6114bcfa112338e3429247ab68082408f1df4b4d7cf064b" exitCode=0
Jul 23 16:15:56.835206 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:56.834734    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-jjtst" event={"ID":"d033268a-14e3-44c6-a470-313654dc9a6e","Type":"ContainerDied","Data":"b7b8e4e033ba00d1e6114bcfa112338e3429247ab68082408f1df4b4d7cf064b"}
Jul 23 16:15:57.295620 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:57.295580    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/267f079f-9842-415b-858e-c591c6a73a64-registry-tls\") pod \"image-registry-6868994b56-jpcfj\" (UID: \"267f079f-9842-415b-858e-c591c6a73a64\") " pod="openshift-image-registry/image-registry-6868994b56-jpcfj"
Jul 23 16:15:57.295794 ip-10-0-143-166 kubenswrapper[2553]: E0723 16:15:57.295706    2553 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 23 16:15:57.295794 ip-10-0-143-166 kubenswrapper[2553]: E0723 16:15:57.295731    2553 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6868994b56-jpcfj: secret "image-registry-tls" not found
Jul 23 16:15:57.295904 ip-10-0-143-166 kubenswrapper[2553]: E0723 16:15:57.295800    2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/267f079f-9842-415b-858e-c591c6a73a64-registry-tls podName:267f079f-9842-415b-858e-c591c6a73a64 nodeName:}" failed. No retries permitted until 2026-07-23 16:16:01.295777782 +0000 UTC m=+43.160383892 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/267f079f-9842-415b-858e-c591c6a73a64-registry-tls") pod "image-registry-6868994b56-jpcfj" (UID: "267f079f-9842-415b-858e-c591c6a73a64") : secret "image-registry-tls" not found
Jul 23 16:15:57.842413 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:57.842103    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-jjtst" event={"ID":"d033268a-14e3-44c6-a470-313654dc9a6e","Type":"ContainerStarted","Data":"bbf3067a8a5b3d0d745c61c0f67c98608d9a2447e53bf6433ef20d496c17e2bf"}
Jul 23 16:15:57.843868 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:57.843837    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-gcv6f" event={"ID":"febad6e2-993e-4dd1-b043-33db2bdda4fe","Type":"ContainerStarted","Data":"3e941b96befadc3fbe10deddd6b0d3bdef1c9e7abd9ee9c6a36019a978be3957"}
Jul 23 16:15:57.868928 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:57.868866    2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-jjtst" podStartSLOduration=8.510274993 podStartE2EDuration="38.868844137s" totalImagesPullingTime="30.358569144s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 16:15:19 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 16:15:57.868093192 +0000 UTC m=+39.732699320" watchObservedRunningTime="2026-07-23 16:15:57.868844137 +0000 UTC m=+39.733450269"
Jul 23 16:15:57.874540 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:57.874494    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j892l_bba31e38-01db-45a0-8b60-9fc626237e01/konnectivity-agent/0.log" limit=1024
Jul 23 16:15:57.886304 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:57.886248    2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-gcv6f" podStartSLOduration=2.274718446 podStartE2EDuration="4.886232677s" totalImagesPullingTime="2.611514231s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 16:15:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 16:15:57.88551333 +0000 UTC m=+39.750119460" watchObservedRunningTime="2026-07-23 16:15:57.886232677 +0000 UTC m=+39.750838804"
Jul 23 16:15:57.990040 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:57.989995    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j892l_bba31e38-01db-45a0-8b60-9fc626237e01/konnectivity-agent/0.log" limit=1024
Jul 23 16:15:58.089516 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:58.089478    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j892l_bba31e38-01db-45a0-8b60-9fc626237e01/konnectivity-agent/0.log" limit=1024
Jul 23 16:15:58.301816 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:15:58.301779    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7ca02cf0-ad65-46e4-a0bd-25a470519d68-metrics-tls\") pod \"dns-default-jkc4g\" (UID: \"7ca02cf0-ad65-46e4-a0bd-25a470519d68\") " pod="openshift-dns/dns-default-jkc4g"
Jul 23 16:15:58.301972 ip-10-0-143-166 kubenswrapper[2553]: E0723 16:15:58.301914    2553 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 23 16:15:58.301972 ip-10-0-143-166 kubenswrapper[2553]: E0723 16:15:58.301971    2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7ca02cf0-ad65-46e4-a0bd-25a470519d68-metrics-tls podName:7ca02cf0-ad65-46e4-a0bd-25a470519d68 nodeName:}" failed. No retries permitted until 2026-07-23 16:16:02.301956721 +0000 UTC m=+44.166562827 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/7ca02cf0-ad65-46e4-a0bd-25a470519d68-metrics-tls") pod "dns-default-jkc4g" (UID: "7ca02cf0-ad65-46e4-a0bd-25a470519d68") : secret "dns-default-metrics-tls" not found
Jul 23 16:16:00.083976 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:16:00.083937    2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-wk2tc"]
Jul 23 16:16:00.125357 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:16:00.125316    2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-7bc5b6bf85-m8xxx"]
Jul 23 16:16:00.125513 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:16:00.125446    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-wk2tc"
Jul 23 16:16:00.128715 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:16:00.128695    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\""
Jul 23 16:16:00.128715 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:16:00.128722    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\""
Jul 23 16:16:00.128979 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:16:00.128964    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\""
Jul 23 16:16:00.129085 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:16:00.128966    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-t5lq5\""
Jul 23 16:16:00.149409 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:16:00.149376    2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-76cf8966f8-jrf9k"]
Jul 23 16:16:00.149570 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:16:00.149487    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-m8xxx"
Jul 23 16:16:00.152040 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:16:00.152020    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-mr5s2\""
Jul 23 16:16:00.169150 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:16:00.169126    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-wk2tc"]
Jul 23 16:16:00.169310 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:16:00.169181    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-7bc5b6bf85-m8xxx"]
Jul 23 16:16:00.169310 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:16:00.169198    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-76cf8966f8-jrf9k"]
Jul 23 16:16:00.169310 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:16:00.169283    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-jrf9k"
Jul 23 16:16:00.172155 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:16:00.172136    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 23 16:16:00.173642 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:16:00.173623    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 23 16:16:00.173758 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:16:00.173645    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\""
Jul 23 16:16:00.173758 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:16:00.173703    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-snv5g\""
Jul 23 16:16:00.173758 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:16:00.173749    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\""
Jul 23 16:16:00.191275 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:16:00.191250    2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-ddq85"]
Jul 23 16:16:00.214429 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:16:00.214392    2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-555d9d7885-5hbck"]
Jul 23 16:16:00.214636 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:16:00.214608    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-ddq85"
Jul 23 16:16:00.216702 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:16:00.216672    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-btsms\" (UniqueName: \"kubernetes.io/projected/6abdb72f-f8eb-4ac2-b365-21769a0d3c15-kube-api-access-btsms\") pod \"cluster-samples-operator-79b7c55f87-wk2tc\" (UID: \"6abdb72f-f8eb-4ac2-b365-21769a0d3c15\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-wk2tc"
Jul 23 16:16:00.216852 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:16:00.216830    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/6abdb72f-f8eb-4ac2-b365-21769a0d3c15-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-wk2tc\" (UID: \"6abdb72f-f8eb-4ac2-b365-21769a0d3c15\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-wk2tc"
Jul 23 16:16:00.218180 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:16:00.218147    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-9fmr5\""
Jul 23 16:16:00.218390 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:16:00.218376    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\""
Jul 23 16:16:00.218454 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:16:00.218376    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\""
Jul 23 16:16:00.227334 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:16:00.227314    2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-7bc7489cb5-pksrr"]
Jul 23 16:16:00.227461 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:16:00.227443    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-555d9d7885-5hbck"
Jul 23 16:16:00.230579 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:16:00.230557    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\""
Jul 23 16:16:00.230697 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:16:00.230565    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\""
Jul 23 16:16:00.230697 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:16:00.230618    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 23 16:16:00.231037 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:16:00.231014    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 23 16:16:00.232141 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:16:00.232123    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-gh9qg\""
Jul 23 16:16:00.235877 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:16:00.235856    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\""
Jul 23 16:16:00.237403 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:16:00.237385    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-ddq85"]
Jul 23 16:16:00.237468 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:16:00.237412    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-7bc7489cb5-pksrr"]
Jul 23 16:16:00.237468 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:16:00.237427    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-555d9d7885-5hbck"]
Jul 23 16:16:00.237468 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:16:00.237442    2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-599b8db76d-sn7k4"]
Jul 23 16:16:00.237564 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:16:00.237548    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-7bc7489cb5-pksrr"
Jul 23 16:16:00.240016 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:16:00.239994    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\""
Jul 23 16:16:00.240105 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:16:00.240035    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-wgfkd\""
Jul 23 16:16:00.240275 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:16:00.240262    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\""
Jul 23 16:16:00.249493 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:16:00.249472    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-599b8db76d-sn7k4"]
Jul 23 16:16:00.249591 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:16:00.249582    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-599b8db76d-sn7k4"
Jul 23 16:16:00.252353 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:16:00.252331    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jul 23 16:16:00.252353 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:16:00.252347    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\""
Jul 23 16:16:00.252494 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:16:00.252336    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\""
Jul 23 16:16:00.252687 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:16:00.252673    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\""
Jul 23 16:16:00.252726 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:16:00.252684    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jul 23 16:16:00.252778 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:16:00.252765    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-r75cm\""
Jul 23 16:16:00.252820 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:16:00.252771    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\""
Jul 23 16:16:00.288944 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:16:00.288915    2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-tlkw4"]
Jul 23 16:16:00.303670 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:16:00.303641    2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-565b7b569d-7rmrn"]
Jul 23 16:16:00.303796 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:16:00.303747    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-tlkw4"
Jul 23 16:16:00.307577 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:16:00.307552    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-rwdj5\""
Jul 23 16:16:00.307577 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:16:00.307576    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\""
Jul 23 16:16:00.307889 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:16:00.307864    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\""
Jul 23 16:16:00.308337 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:16:00.308319    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\""
Jul 23 16:16:00.309777 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:16:00.309754    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\""
Jul 23 16:16:00.317744 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:16:00.317719    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4lv6k\" (UniqueName: \"kubernetes.io/projected/c290c129-eea4-49d9-9ca5-56b4d600275b-kube-api-access-4lv6k\") pod \"volume-data-source-validator-78cf4c6f6-ddq85\" (UID: \"c290c129-eea4-49d9-9ca5-56b4d600275b\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-ddq85"
Jul 23 16:16:00.317862 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:16:00.317752    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/6abdb72f-f8eb-4ac2-b365-21769a0d3c15-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-wk2tc\" (UID: \"6abdb72f-f8eb-4ac2-b365-21769a0d3c15\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-wk2tc"
Jul 23 16:16:00.317862 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:16:00.317773    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g74f7\" (UniqueName: \"kubernetes.io/projected/93f725de-e1d8-4c9d-9491-494072eaadf4-kube-api-access-g74f7\") pod \"insights-operator-555d9d7885-5hbck\" (UID: \"93f725de-e1d8-4c9d-9491-494072eaadf4\") " pod="openshift-insights/insights-operator-555d9d7885-5hbck"
Jul 23 16:16:00.317862 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:16:00.317801    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/0167b7d7-8b10-4847-b5ea-5dc52d892bf0-telemetry-config\") pod \"cluster-monitoring-operator-76cf8966f8-jrf9k\" (UID: \"0167b7d7-8b10-4847-b5ea-5dc52d892bf0\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-jrf9k"
Jul 23 16:16:00.317862 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:16:00.317817    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/0167b7d7-8b10-4847-b5ea-5dc52d892bf0-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-jrf9k\" (UID: \"0167b7d7-8b10-4847-b5ea-5dc52d892bf0\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-jrf9k"
Jul 23 16:16:00.317862 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:16:00.317836    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-btsms\" (UniqueName: \"kubernetes.io/projected/6abdb72f-f8eb-4ac2-b365-21769a0d3c15-kube-api-access-btsms\") pod \"cluster-samples-operator-79b7c55f87-wk2tc\" (UID: \"6abdb72f-f8eb-4ac2-b365-21769a0d3c15\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-wk2tc"
Jul 23 16:16:00.317862 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:16:00.317851    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/552a2881-1bbe-4a5e-b5fb-d245882c2933-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-pksrr\" (UID: \"552a2881-1bbe-4a5e-b5fb-d245882c2933\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-pksrr"
Jul 23 16:16:00.318137 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:16:00.317868    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/93f725de-e1d8-4c9d-9491-494072eaadf4-trusted-ca-bundle\") pod \"insights-operator-555d9d7885-5hbck\" (UID: \"93f725de-e1d8-4c9d-9491-494072eaadf4\") " pod="openshift-insights/insights-operator-555d9d7885-5hbck"
Jul 23 16:16:00.318137 ip-10-0-143-166 kubenswrapper[2553]: E0723 16:16:00.317876    2553 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 23 16:16:00.318137 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:16:00.317914    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bsdpt\" (UniqueName: \"kubernetes.io/projected/0167b7d7-8b10-4847-b5ea-5dc52d892bf0-kube-api-access-bsdpt\") pod \"cluster-monitoring-operator-76cf8966f8-jrf9k\" (UID: \"0167b7d7-8b10-4847-b5ea-5dc52d892bf0\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-jrf9k"
Jul 23 16:16:00.318137 ip-10-0-143-166 kubenswrapper[2553]: E0723 16:16:00.317938    2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6abdb72f-f8eb-4ac2-b365-21769a0d3c15-samples-operator-tls podName:6abdb72f-f8eb-4ac2-b365-21769a0d3c15 nodeName:}" failed. No retries permitted until 2026-07-23 16:16:00.817919637 +0000 UTC m=+42.682525746 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/6abdb72f-f8eb-4ac2-b365-21769a0d3c15-samples-operator-tls") pod "cluster-samples-operator-79b7c55f87-wk2tc" (UID: "6abdb72f-f8eb-4ac2-b365-21769a0d3c15") : secret "samples-operator-tls" not found
Jul 23 16:16:00.318137 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:16:00.318011    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/93f725de-e1d8-4c9d-9491-494072eaadf4-service-ca-bundle\") pod \"insights-operator-555d9d7885-5hbck\" (UID: \"93f725de-e1d8-4c9d-9491-494072eaadf4\") " pod="openshift-insights/insights-operator-555d9d7885-5hbck"
Jul 23 16:16:00.318137 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:16:00.318043    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n92tp\" (UniqueName: \"kubernetes.io/projected/f87b81d6-453b-4dd3-8d67-44e93b875a19-kube-api-access-n92tp\") pod \"network-check-source-7bc5b6bf85-m8xxx\" (UID: \"f87b81d6-453b-4dd3-8d67-44e93b875a19\") " pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-m8xxx"
Jul 23 16:16:00.318137 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:16:00.318072    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/552a2881-1bbe-4a5e-b5fb-d245882c2933-nginx-conf\") pod \"networking-console-plugin-7bc7489cb5-pksrr\" (UID: \"552a2881-1bbe-4a5e-b5fb-d245882c2933\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-pksrr"
Jul 23 16:16:00.318137 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:16:00.318097    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/93f725de-e1d8-4c9d-9491-494072eaadf4-snapshots\") pod \"insights-operator-555d9d7885-5hbck\" (UID: \"93f725de-e1d8-4c9d-9491-494072eaadf4\") " pod="openshift-insights/insights-operator-555d9d7885-5hbck"
Jul 23 16:16:00.318137 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:16:00.318137    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/93f725de-e1d8-4c9d-9491-494072eaadf4-serving-cert\") pod \"insights-operator-555d9d7885-5hbck\" (UID: \"93f725de-e1d8-4c9d-9491-494072eaadf4\") " pod="openshift-insights/insights-operator-555d9d7885-5hbck"
Jul 23 16:16:00.318606 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:16:00.318160    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/93f725de-e1d8-4c9d-9491-494072eaadf4-tmp\") pod \"insights-operator-555d9d7885-5hbck\" (UID: \"93f725de-e1d8-4c9d-9491-494072eaadf4\") " pod="openshift-insights/insights-operator-555d9d7885-5hbck"
Jul 23 16:16:00.321727 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:16:00.321707    2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5bcbc94c78-4jm7t"]
Jul 23 16:16:00.321820 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:16:00.321812    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-565b7b569d-7rmrn"
Jul 23 16:16:00.324396 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:16:00.324376    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\""
Jul 23 16:16:00.324396 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:16:00.324387    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-rdlq5\""
Jul 23 16:16:00.324687 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:16:00.324668    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\""
Jul 23 16:16:00.324687 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:16:00.324679    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\""
Jul 23 16:16:00.324811 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:16:00.324693    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\""
Jul 23 16:16:00.335311 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:16:00.335239    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\""
Jul 23 16:16:00.336667 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:16:00.336319    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-btsms\" (UniqueName: \"kubernetes.io/projected/6abdb72f-f8eb-4ac2-b365-21769a0d3c15-kube-api-access-btsms\") pod \"cluster-samples-operator-79b7c55f87-wk2tc\" (UID: \"6abdb72f-f8eb-4ac2-b365-21769a0d3c15\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-wk2tc"
Jul 23 16:16:00.339907 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:16:00.339886    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-tlkw4"]
Jul 23 16:16:00.340001 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:16:00.339927    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5bcbc94c78-4jm7t"]
Jul 23 16:16:00.340001 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:16:00.339948    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-565b7b569d-7rmrn"]
Jul 23 16:16:00.340001 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:16:00.339998    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-4jm7t"
Jul 23 16:16:00.342753 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:16:00.342729    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\""
Jul 23 16:16:00.342860 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:16:00.342729    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\""
Jul 23 16:16:00.342860 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:16:00.342768    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\""
Jul 23 16:16:00.343086 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:16:00.343070    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\""
Jul 23 16:16:00.343086 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:16:00.343079    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-h9kvc\""
Jul 23 16:16:00.366586 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:16:00.366549    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j892l_bba31e38-01db-45a0-8b60-9fc626237e01/konnectivity-agent/0.log" limit=1024
Jul 23 16:16:00.419062 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:16:00.419020    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/552a2881-1bbe-4a5e-b5fb-d245882c2933-nginx-conf\") pod \"networking-console-plugin-7bc7489cb5-pksrr\" (UID: \"552a2881-1bbe-4a5e-b5fb-d245882c2933\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-pksrr"
Jul 23 16:16:00.419062 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:16:00.419065    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/b145abca-07cb-4345-9efc-2c03f950ac14-default-certificate\") pod \"router-default-599b8db76d-sn7k4\" (UID: \"b145abca-07cb-4345-9efc-2c03f950ac14\") " pod="openshift-ingress/router-default-599b8db76d-sn7k4"
Jul 23 16:16:00.419315 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:16:00.419095    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/93f725de-e1d8-4c9d-9491-494072eaadf4-snapshots\") pod \"insights-operator-555d9d7885-5hbck\" (UID: \"93f725de-e1d8-4c9d-9491-494072eaadf4\") " pod="openshift-insights/insights-operator-555d9d7885-5hbck"
Jul 23 16:16:00.419315 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:16:00.419125    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/3468a30b-e65e-4ca8-a427-6e63953f932b-config\") pod \"service-ca-operator-5bcbc94c78-4jm7t\" (UID: \"3468a30b-e65e-4ca8-a427-6e63953f932b\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-4jm7t"
Jul 23 16:16:00.419315 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:16:00.419195    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/93f725de-e1d8-4c9d-9491-494072eaadf4-serving-cert\") pod \"insights-operator-555d9d7885-5hbck\" (UID: \"93f725de-e1d8-4c9d-9491-494072eaadf4\") " pod="openshift-insights/insights-operator-555d9d7885-5hbck"
Jul 23 16:16:00.419315 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:16:00.419221    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/93f725de-e1d8-4c9d-9491-494072eaadf4-tmp\") pod \"insights-operator-555d9d7885-5hbck\" (UID: \"93f725de-e1d8-4c9d-9491-494072eaadf4\") " pod="openshift-insights/insights-operator-555d9d7885-5hbck"
Jul 23 16:16:00.419315 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:16:00.419247    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/e4611a5f-b77b-469f-b29c-81ea53b65599-config\") pod \"kube-storage-version-migrator-operator-7658d9b749-tlkw4\" (UID: \"e4611a5f-b77b-469f-b29c-81ea53b65599\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-tlkw4"
Jul 23 16:16:00.419315 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:16:00.419277    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b145abca-07cb-4345-9efc-2c03f950ac14-service-ca-bundle\") pod \"router-default-599b8db76d-sn7k4\" (UID: \"b145abca-07cb-4345-9efc-2c03f950ac14\") " pod="openshift-ingress/router-default-599b8db76d-sn7k4"
Jul 23 16:16:00.419577 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:16:00.419340    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/b145abca-07cb-4345-9efc-2c03f950ac14-stats-auth\") pod \"router-default-599b8db76d-sn7k4\" (UID: \"b145abca-07cb-4345-9efc-2c03f950ac14\") " pod="openshift-ingress/router-default-599b8db76d-sn7k4"
Jul 23 16:16:00.419577 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:16:00.419454    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/e4611a5f-b77b-469f-b29c-81ea53b65599-serving-cert\") pod \"kube-storage-version-migrator-operator-7658d9b749-tlkw4\" (UID: \"e4611a5f-b77b-469f-b29c-81ea53b65599\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-tlkw4"
Jul 23 16:16:00.419577 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:16:00.419491    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/976a7198-cfd3-43d4-8c9f-b1f248d1f6d7-serving-cert\") pod \"console-operator-565b7b569d-7rmrn\" (UID: \"976a7198-cfd3-43d4-8c9f-b1f248d1f6d7\") " pod="openshift-console-operator/console-operator-565b7b569d-7rmrn"
Jul 23 16:16:00.419726 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:16:00.419605    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4lv6k\" (UniqueName: \"kubernetes.io/projected/c290c129-eea4-49d9-9ca5-56b4d600275b-kube-api-access-4lv6k\") pod \"volume-data-source-validator-78cf4c6f6-ddq85\" (UID: \"c290c129-eea4-49d9-9ca5-56b4d600275b\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-ddq85"
Jul 23 16:16:00.419726 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:16:00.419661    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g74f7\" (UniqueName: \"kubernetes.io/projected/93f725de-e1d8-4c9d-9491-494072eaadf4-kube-api-access-g74f7\") pod \"insights-operator-555d9d7885-5hbck\" (UID: \"93f725de-e1d8-4c9d-9491-494072eaadf4\") " pod="openshift-insights/insights-operator-555d9d7885-5hbck"
Jul 23 16:16:00.419726 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:16:00.419691    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gttcs\" (UniqueName: \"kubernetes.io/projected/976a7198-cfd3-43d4-8c9f-b1f248d1f6d7-kube-api-access-gttcs\") pod \"console-operator-565b7b569d-7rmrn\" (UID: \"976a7198-cfd3-43d4-8c9f-b1f248d1f6d7\") " pod="openshift-console-operator/console-operator-565b7b569d-7rmrn"
Jul 23 16:16:00.419726 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:16:00.419702    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/93f725de-e1d8-4c9d-9491-494072eaadf4-tmp\") pod \"insights-operator-555d9d7885-5hbck\" (UID: \"93f725de-e1d8-4c9d-9491-494072eaadf4\") " pod="openshift-insights/insights-operator-555d9d7885-5hbck"
Jul 23 16:16:00.419898 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:16:00.419755    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n45kt\" (UniqueName: \"kubernetes.io/projected/3468a30b-e65e-4ca8-a427-6e63953f932b-kube-api-access-n45kt\") pod \"service-ca-operator-5bcbc94c78-4jm7t\" (UID: \"3468a30b-e65e-4ca8-a427-6e63953f932b\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-4jm7t"
Jul 23 16:16:00.419898 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:16:00.419759    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/93f725de-e1d8-4c9d-9491-494072eaadf4-snapshots\") pod \"insights-operator-555d9d7885-5hbck\" (UID: \"93f725de-e1d8-4c9d-9491-494072eaadf4\") " pod="openshift-insights/insights-operator-555d9d7885-5hbck"
Jul 23 16:16:00.419898 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:16:00.419796    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/976a7198-cfd3-43d4-8c9f-b1f248d1f6d7-trusted-ca\") pod \"console-operator-565b7b569d-7rmrn\" (UID: \"976a7198-cfd3-43d4-8c9f-b1f248d1f6d7\") " pod="openshift-console-operator/console-operator-565b7b569d-7rmrn"
Jul 23 16:16:00.419898 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:16:00.419835    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/0167b7d7-8b10-4847-b5ea-5dc52d892bf0-telemetry-config\") pod \"cluster-monitoring-operator-76cf8966f8-jrf9k\" (UID: \"0167b7d7-8b10-4847-b5ea-5dc52d892bf0\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-jrf9k"
Jul 23 16:16:00.419898 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:16:00.419864    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b145abca-07cb-4345-9efc-2c03f950ac14-metrics-certs\") pod \"router-default-599b8db76d-sn7k4\" (UID: \"b145abca-07cb-4345-9efc-2c03f950ac14\") " pod="openshift-ingress/router-default-599b8db76d-sn7k4"
Jul 23 16:16:00.419898 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:16:00.419871    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/552a2881-1bbe-4a5e-b5fb-d245882c2933-nginx-conf\") pod \"networking-console-plugin-7bc7489cb5-pksrr\" (UID: \"552a2881-1bbe-4a5e-b5fb-d245882c2933\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-pksrr"
Jul 23 16:16:00.419898 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:16:00.419892    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/0167b7d7-8b10-4847-b5ea-5dc52d892bf0-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-jrf9k\" (UID: \"0167b7d7-8b10-4847-b5ea-5dc52d892bf0\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-jrf9k"
Jul 23 16:16:00.420256 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:16:00.419936    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/552a2881-1bbe-4a5e-b5fb-d245882c2933-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-pksrr\" (UID: \"552a2881-1bbe-4a5e-b5fb-d245882c2933\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-pksrr"
Jul 23 16:16:00.420256 ip-10-0-143-166 kubenswrapper[2553]: E0723 16:16:00.419964    2553 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 23 16:16:00.420256 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:16:00.419968    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/93f725de-e1d8-4c9d-9491-494072eaadf4-trusted-ca-bundle\") pod \"insights-operator-555d9d7885-5hbck\" (UID: \"93f725de-e1d8-4c9d-9491-494072eaadf4\") " pod="openshift-insights/insights-operator-555d9d7885-5hbck"
Jul 23 16:16:00.420256 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:16:00.420017    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bsdpt\" (UniqueName: \"kubernetes.io/projected/0167b7d7-8b10-4847-b5ea-5dc52d892bf0-kube-api-access-bsdpt\") pod \"cluster-monitoring-operator-76cf8966f8-jrf9k\" (UID: \"0167b7d7-8b10-4847-b5ea-5dc52d892bf0\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-jrf9k"
Jul 23 16:16:00.420256 ip-10-0-143-166 kubenswrapper[2553]: E0723 16:16:00.420034    2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0167b7d7-8b10-4847-b5ea-5dc52d892bf0-cluster-monitoring-operator-tls podName:0167b7d7-8b10-4847-b5ea-5dc52d892bf0 nodeName:}" failed. No retries permitted until 2026-07-23 16:16:00.920014449 +0000 UTC m=+42.784620558 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/0167b7d7-8b10-4847-b5ea-5dc52d892bf0-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-76cf8966f8-jrf9k" (UID: "0167b7d7-8b10-4847-b5ea-5dc52d892bf0") : secret "cluster-monitoring-operator-tls" not found
Jul 23 16:16:00.420256 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:16:00.420065    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/3468a30b-e65e-4ca8-a427-6e63953f932b-serving-cert\") pod \"service-ca-operator-5bcbc94c78-4jm7t\" (UID: \"3468a30b-e65e-4ca8-a427-6e63953f932b\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-4jm7t"
Jul 23 16:16:00.420256 ip-10-0-143-166 kubenswrapper[2553]: E0723 16:16:00.420109    2553 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 23 16:16:00.420256 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:16:00.420131    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vdg9h\" (UniqueName: \"kubernetes.io/projected/b145abca-07cb-4345-9efc-2c03f950ac14-kube-api-access-vdg9h\") pod \"router-default-599b8db76d-sn7k4\" (UID: \"b145abca-07cb-4345-9efc-2c03f950ac14\") " pod="openshift-ingress/router-default-599b8db76d-sn7k4"
Jul 23 16:16:00.420256 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:16:00.420183    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/976a7198-cfd3-43d4-8c9f-b1f248d1f6d7-config\") pod \"console-operator-565b7b569d-7rmrn\" (UID: \"976a7198-cfd3-43d4-8c9f-b1f248d1f6d7\") " pod="openshift-console-operator/console-operator-565b7b569d-7rmrn"
Jul 23 16:16:00.420256 ip-10-0-143-166 kubenswrapper[2553]: E0723 16:16:00.420202    2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/552a2881-1bbe-4a5e-b5fb-d245882c2933-networking-console-plugin-cert podName:552a2881-1bbe-4a5e-b5fb-d245882c2933 nodeName:}" failed. No retries permitted until 2026-07-23 16:16:00.920186219 +0000 UTC m=+42.784792343 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/552a2881-1bbe-4a5e-b5fb-d245882c2933-networking-console-plugin-cert") pod "networking-console-plugin-7bc7489cb5-pksrr" (UID: "552a2881-1bbe-4a5e-b5fb-d245882c2933") : secret "networking-console-plugin-cert" not found
Jul 23 16:16:00.420256 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:16:00.420246    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/93f725de-e1d8-4c9d-9491-494072eaadf4-service-ca-bundle\") pod \"insights-operator-555d9d7885-5hbck\" (UID: \"93f725de-e1d8-4c9d-9491-494072eaadf4\") " pod="openshift-insights/insights-operator-555d9d7885-5hbck"
Jul 23 16:16:00.420676 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:16:00.420273    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n92tp\" (UniqueName: \"kubernetes.io/projected/f87b81d6-453b-4dd3-8d67-44e93b875a19-kube-api-access-n92tp\") pod \"network-check-source-7bc5b6bf85-m8xxx\" (UID: \"f87b81d6-453b-4dd3-8d67-44e93b875a19\") " pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-m8xxx"
Jul 23 16:16:00.420676 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:16:00.420302    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-htmjs\" (UniqueName: \"kubernetes.io/projected/e4611a5f-b77b-469f-b29c-81ea53b65599-kube-api-access-htmjs\") pod \"kube-storage-version-migrator-operator-7658d9b749-tlkw4\" (UID: \"e4611a5f-b77b-469f-b29c-81ea53b65599\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-tlkw4"
Jul 23 16:16:00.420676 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:16:00.420577    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/0167b7d7-8b10-4847-b5ea-5dc52d892bf0-telemetry-config\") pod \"cluster-monitoring-operator-76cf8966f8-jrf9k\" (UID: \"0167b7d7-8b10-4847-b5ea-5dc52d892bf0\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-jrf9k"
Jul 23 16:16:00.420842 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:16:00.420821    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/93f725de-e1d8-4c9d-9491-494072eaadf4-service-ca-bundle\") pod \"insights-operator-555d9d7885-5hbck\" (UID: \"93f725de-e1d8-4c9d-9491-494072eaadf4\") " pod="openshift-insights/insights-operator-555d9d7885-5hbck"
Jul 23 16:16:00.420950 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:16:00.420936    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/93f725de-e1d8-4c9d-9491-494072eaadf4-trusted-ca-bundle\") pod \"insights-operator-555d9d7885-5hbck\" (UID: \"93f725de-e1d8-4c9d-9491-494072eaadf4\") " pod="openshift-insights/insights-operator-555d9d7885-5hbck"
Jul 23 16:16:00.421833 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:16:00.421816    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/93f725de-e1d8-4c9d-9491-494072eaadf4-serving-cert\") pod \"insights-operator-555d9d7885-5hbck\" (UID: \"93f725de-e1d8-4c9d-9491-494072eaadf4\") " pod="openshift-insights/insights-operator-555d9d7885-5hbck"
Jul 23 16:16:00.435801 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:16:00.435776    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g74f7\" (UniqueName: \"kubernetes.io/projected/93f725de-e1d8-4c9d-9491-494072eaadf4-kube-api-access-g74f7\") pod \"insights-operator-555d9d7885-5hbck\" (UID: \"93f725de-e1d8-4c9d-9491-494072eaadf4\") " pod="openshift-insights/insights-operator-555d9d7885-5hbck"
Jul 23 16:16:00.439382 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:16:00.439353    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4lv6k\" (UniqueName: \"kubernetes.io/projected/c290c129-eea4-49d9-9ca5-56b4d600275b-kube-api-access-4lv6k\") pod \"volume-data-source-validator-78cf4c6f6-ddq85\" (UID: \"c290c129-eea4-49d9-9ca5-56b4d600275b\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-ddq85"
Jul 23 16:16:00.440808 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:16:00.440781    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n92tp\" (UniqueName: \"kubernetes.io/projected/f87b81d6-453b-4dd3-8d67-44e93b875a19-kube-api-access-n92tp\") pod \"network-check-source-7bc5b6bf85-m8xxx\" (UID: \"f87b81d6-453b-4dd3-8d67-44e93b875a19\") " pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-m8xxx"
Jul 23 16:16:00.441410 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:16:00.441393    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bsdpt\" (UniqueName: \"kubernetes.io/projected/0167b7d7-8b10-4847-b5ea-5dc52d892bf0-kube-api-access-bsdpt\") pod \"cluster-monitoring-operator-76cf8966f8-jrf9k\" (UID: \"0167b7d7-8b10-4847-b5ea-5dc52d892bf0\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-jrf9k"
Jul 23 16:16:00.457175 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:16:00.457149    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-m8xxx"
Jul 23 16:16:00.503523 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:16:00.503494    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j892l_bba31e38-01db-45a0-8b60-9fc626237e01/konnectivity-agent/0.log" limit=1024
Jul 23 16:16:00.521062 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:16:00.521035    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/3468a30b-e65e-4ca8-a427-6e63953f932b-config\") pod \"service-ca-operator-5bcbc94c78-4jm7t\" (UID: \"3468a30b-e65e-4ca8-a427-6e63953f932b\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-4jm7t"
Jul 23 16:16:00.521215 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:16:00.521071    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/e4611a5f-b77b-469f-b29c-81ea53b65599-config\") pod \"kube-storage-version-migrator-operator-7658d9b749-tlkw4\" (UID: \"e4611a5f-b77b-469f-b29c-81ea53b65599\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-tlkw4"
Jul 23 16:16:00.521215 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:16:00.521091    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b145abca-07cb-4345-9efc-2c03f950ac14-service-ca-bundle\") pod \"router-default-599b8db76d-sn7k4\" (UID: \"b145abca-07cb-4345-9efc-2c03f950ac14\") " pod="openshift-ingress/router-default-599b8db76d-sn7k4"
Jul 23 16:16:00.521215 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:16:00.521121    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/b145abca-07cb-4345-9efc-2c03f950ac14-stats-auth\") pod \"router-default-599b8db76d-sn7k4\" (UID: \"b145abca-07cb-4345-9efc-2c03f950ac14\") " pod="openshift-ingress/router-default-599b8db76d-sn7k4"
Jul 23 16:16:00.521215 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:16:00.521144    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/e4611a5f-b77b-469f-b29c-81ea53b65599-serving-cert\") pod \"kube-storage-version-migrator-operator-7658d9b749-tlkw4\" (UID: \"e4611a5f-b77b-469f-b29c-81ea53b65599\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-tlkw4"
Jul 23 16:16:00.521215 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:16:00.521162    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/976a7198-cfd3-43d4-8c9f-b1f248d1f6d7-serving-cert\") pod \"console-operator-565b7b569d-7rmrn\" (UID: \"976a7198-cfd3-43d4-8c9f-b1f248d1f6d7\") " pod="openshift-console-operator/console-operator-565b7b569d-7rmrn"
Jul 23 16:16:00.521442 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:16:00.521303    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gttcs\" (UniqueName: \"kubernetes.io/projected/976a7198-cfd3-43d4-8c9f-b1f248d1f6d7-kube-api-access-gttcs\") pod \"console-operator-565b7b569d-7rmrn\" (UID: \"976a7198-cfd3-43d4-8c9f-b1f248d1f6d7\") " pod="openshift-console-operator/console-operator-565b7b569d-7rmrn"
Jul 23 16:16:00.521442 ip-10-0-143-166 kubenswrapper[2553]: E0723 16:16:00.521367    2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/b145abca-07cb-4345-9efc-2c03f950ac14-service-ca-bundle podName:b145abca-07cb-4345-9efc-2c03f950ac14 nodeName:}" failed. No retries permitted until 2026-07-23 16:16:01.021325541 +0000 UTC m=+42.885931677 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/b145abca-07cb-4345-9efc-2c03f950ac14-service-ca-bundle") pod "router-default-599b8db76d-sn7k4" (UID: "b145abca-07cb-4345-9efc-2c03f950ac14") : configmap references non-existent config key: service-ca.crt
Jul 23 16:16:00.521442 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:16:00.521435    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n45kt\" (UniqueName: \"kubernetes.io/projected/3468a30b-e65e-4ca8-a427-6e63953f932b-kube-api-access-n45kt\") pod \"service-ca-operator-5bcbc94c78-4jm7t\" (UID: \"3468a30b-e65e-4ca8-a427-6e63953f932b\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-4jm7t"
Jul 23 16:16:00.521588 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:16:00.521473    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/976a7198-cfd3-43d4-8c9f-b1f248d1f6d7-trusted-ca\") pod \"console-operator-565b7b569d-7rmrn\" (UID: \"976a7198-cfd3-43d4-8c9f-b1f248d1f6d7\") " pod="openshift-console-operator/console-operator-565b7b569d-7rmrn"
Jul 23 16:16:00.521588 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:16:00.521532    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b145abca-07cb-4345-9efc-2c03f950ac14-metrics-certs\") pod \"router-default-599b8db76d-sn7k4\" (UID: \"b145abca-07cb-4345-9efc-2c03f950ac14\") " pod="openshift-ingress/router-default-599b8db76d-sn7k4"
Jul 23 16:16:00.521683 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:16:00.521632    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/3468a30b-e65e-4ca8-a427-6e63953f932b-serving-cert\") pod \"service-ca-operator-5bcbc94c78-4jm7t\" (UID: \"3468a30b-e65e-4ca8-a427-6e63953f932b\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-4jm7t"
Jul 23 16:16:00.521683 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:16:00.521668    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/e4611a5f-b77b-469f-b29c-81ea53b65599-config\") pod \"kube-storage-version-migrator-operator-7658d9b749-tlkw4\" (UID: \"e4611a5f-b77b-469f-b29c-81ea53b65599\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-tlkw4"
Jul 23 16:16:00.521780 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:16:00.521698    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vdg9h\" (UniqueName: \"kubernetes.io/projected/b145abca-07cb-4345-9efc-2c03f950ac14-kube-api-access-vdg9h\") pod \"router-default-599b8db76d-sn7k4\" (UID: \"b145abca-07cb-4345-9efc-2c03f950ac14\") " pod="openshift-ingress/router-default-599b8db76d-sn7k4"
Jul 23 16:16:00.521780 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:16:00.521710    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/3468a30b-e65e-4ca8-a427-6e63953f932b-config\") pod \"service-ca-operator-5bcbc94c78-4jm7t\" (UID: \"3468a30b-e65e-4ca8-a427-6e63953f932b\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-4jm7t"
Jul 23 16:16:00.521780 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:16:00.521722    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/976a7198-cfd3-43d4-8c9f-b1f248d1f6d7-config\") pod \"console-operator-565b7b569d-7rmrn\" (UID: \"976a7198-cfd3-43d4-8c9f-b1f248d1f6d7\") " pod="openshift-console-operator/console-operator-565b7b569d-7rmrn"
Jul 23 16:16:00.521919 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:16:00.521774    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-htmjs\" (UniqueName: \"kubernetes.io/projected/e4611a5f-b77b-469f-b29c-81ea53b65599-kube-api-access-htmjs\") pod \"kube-storage-version-migrator-operator-7658d9b749-tlkw4\" (UID: \"e4611a5f-b77b-469f-b29c-81ea53b65599\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-tlkw4"
Jul 23 16:16:00.521919 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:16:00.521807    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/b145abca-07cb-4345-9efc-2c03f950ac14-default-certificate\") pod \"router-default-599b8db76d-sn7k4\" (UID: \"b145abca-07cb-4345-9efc-2c03f950ac14\") " pod="openshift-ingress/router-default-599b8db76d-sn7k4"
Jul 23 16:16:00.521919 ip-10-0-143-166 kubenswrapper[2553]: E0723 16:16:00.521811    2553 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 23 16:16:00.521919 ip-10-0-143-166 kubenswrapper[2553]: E0723 16:16:00.521856    2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b145abca-07cb-4345-9efc-2c03f950ac14-metrics-certs podName:b145abca-07cb-4345-9efc-2c03f950ac14 nodeName:}" failed. No retries permitted until 2026-07-23 16:16:01.021841547 +0000 UTC m=+42.886447659 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b145abca-07cb-4345-9efc-2c03f950ac14-metrics-certs") pod "router-default-599b8db76d-sn7k4" (UID: "b145abca-07cb-4345-9efc-2c03f950ac14") : secret "router-metrics-certs-default" not found
Jul 23 16:16:00.522880 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:16:00.522852    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/976a7198-cfd3-43d4-8c9f-b1f248d1f6d7-trusted-ca\") pod \"console-operator-565b7b569d-7rmrn\" (UID: \"976a7198-cfd3-43d4-8c9f-b1f248d1f6d7\") " pod="openshift-console-operator/console-operator-565b7b569d-7rmrn"
Jul 23 16:16:00.523052 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:16:00.522859    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/976a7198-cfd3-43d4-8c9f-b1f248d1f6d7-config\") pod \"console-operator-565b7b569d-7rmrn\" (UID: \"976a7198-cfd3-43d4-8c9f-b1f248d1f6d7\") " pod="openshift-console-operator/console-operator-565b7b569d-7rmrn"
Jul 23 16:16:00.524051 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:16:00.524028    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/b145abca-07cb-4345-9efc-2c03f950ac14-stats-auth\") pod \"router-default-599b8db76d-sn7k4\" (UID: \"b145abca-07cb-4345-9efc-2c03f950ac14\") " pod="openshift-ingress/router-default-599b8db76d-sn7k4"
Jul 23 16:16:00.524141 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:16:00.524080    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-ddq85"
Jul 23 16:16:00.524249 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:16:00.524229    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/3468a30b-e65e-4ca8-a427-6e63953f932b-serving-cert\") pod \"service-ca-operator-5bcbc94c78-4jm7t\" (UID: \"3468a30b-e65e-4ca8-a427-6e63953f932b\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-4jm7t"
Jul 23 16:16:00.524348 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:16:00.524327    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/976a7198-cfd3-43d4-8c9f-b1f248d1f6d7-serving-cert\") pod \"console-operator-565b7b569d-7rmrn\" (UID: \"976a7198-cfd3-43d4-8c9f-b1f248d1f6d7\") " pod="openshift-console-operator/console-operator-565b7b569d-7rmrn"
Jul 23 16:16:00.524588 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:16:00.524572    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/b145abca-07cb-4345-9efc-2c03f950ac14-default-certificate\") pod \"router-default-599b8db76d-sn7k4\" (UID: \"b145abca-07cb-4345-9efc-2c03f950ac14\") " pod="openshift-ingress/router-default-599b8db76d-sn7k4"
Jul 23 16:16:00.525288 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:16:00.525273    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/e4611a5f-b77b-469f-b29c-81ea53b65599-serving-cert\") pod \"kube-storage-version-migrator-operator-7658d9b749-tlkw4\" (UID: \"e4611a5f-b77b-469f-b29c-81ea53b65599\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-tlkw4"
Jul 23 16:16:00.533939 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:16:00.533912    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n45kt\" (UniqueName: \"kubernetes.io/projected/3468a30b-e65e-4ca8-a427-6e63953f932b-kube-api-access-n45kt\") pod \"service-ca-operator-5bcbc94c78-4jm7t\" (UID: \"3468a30b-e65e-4ca8-a427-6e63953f932b\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-4jm7t"
Jul 23 16:16:00.534483 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:16:00.534460    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-htmjs\" (UniqueName: \"kubernetes.io/projected/e4611a5f-b77b-469f-b29c-81ea53b65599-kube-api-access-htmjs\") pod \"kube-storage-version-migrator-operator-7658d9b749-tlkw4\" (UID: \"e4611a5f-b77b-469f-b29c-81ea53b65599\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-tlkw4"
Jul 23 16:16:00.534659 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:16:00.534643    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gttcs\" (UniqueName: \"kubernetes.io/projected/976a7198-cfd3-43d4-8c9f-b1f248d1f6d7-kube-api-access-gttcs\") pod \"console-operator-565b7b569d-7rmrn\" (UID: \"976a7198-cfd3-43d4-8c9f-b1f248d1f6d7\") " pod="openshift-console-operator/console-operator-565b7b569d-7rmrn"
Jul 23 16:16:00.534901 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:16:00.534881    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vdg9h\" (UniqueName: \"kubernetes.io/projected/b145abca-07cb-4345-9efc-2c03f950ac14-kube-api-access-vdg9h\") pod \"router-default-599b8db76d-sn7k4\" (UID: \"b145abca-07cb-4345-9efc-2c03f950ac14\") " pod="openshift-ingress/router-default-599b8db76d-sn7k4"
Jul 23 16:16:00.536778 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:16:00.536759    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-555d9d7885-5hbck"
Jul 23 16:16:00.606132 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:16:00.606012    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j892l_bba31e38-01db-45a0-8b60-9fc626237e01/konnectivity-agent/0.log" limit=1024
Jul 23 16:16:00.619188 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:16:00.615438    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-tlkw4"
Jul 23 16:16:00.631090 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:16:00.631010    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-565b7b569d-7rmrn"
Jul 23 16:16:00.649654 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:16:00.649568    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-4jm7t"
Jul 23 16:16:00.658318 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:16:00.657215    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-7bc5b6bf85-m8xxx"]
Jul 23 16:16:00.661870 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:16:00.661657    2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf87b81d6_453b_4dd3_8d67_44e93b875a19.slice/crio-5c7851682d4c5c6c3f827007ab4dc3124597d79355d07132b187b0e7a7fb1b4c WatchSource:0}: Error finding container 5c7851682d4c5c6c3f827007ab4dc3124597d79355d07132b187b0e7a7fb1b4c: Status 404 returned error can't find the container with id 5c7851682d4c5c6c3f827007ab4dc3124597d79355d07132b187b0e7a7fb1b4c
Jul 23 16:16:00.709249 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:16:00.709129    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-ddq85"]
Jul 23 16:16:00.714486 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:16:00.714432    2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc290c129_eea4_49d9_9ca5_56b4d600275b.slice/crio-1c6f4788a5a1bdebfed81d9a74ce95a8e60e44e05a121ac0f12a121fd27d8824 WatchSource:0}: Error finding container 1c6f4788a5a1bdebfed81d9a74ce95a8e60e44e05a121ac0f12a121fd27d8824: Status 404 returned error can't find the container with id 1c6f4788a5a1bdebfed81d9a74ce95a8e60e44e05a121ac0f12a121fd27d8824
Jul 23 16:16:00.750432 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:16:00.750335    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-555d9d7885-5hbck"]
Jul 23 16:16:00.753021 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:16:00.752988    2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod93f725de_e1d8_4c9d_9491_494072eaadf4.slice/crio-a755583f5e5dfacb72a129752c390703c4068c34713cd4fa2e731fe5ebacfcd7 WatchSource:0}: Error finding container a755583f5e5dfacb72a129752c390703c4068c34713cd4fa2e731fe5ebacfcd7: Status 404 returned error can't find the container with id a755583f5e5dfacb72a129752c390703c4068c34713cd4fa2e731fe5ebacfcd7
Jul 23 16:16:00.801634 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:16:00.801604    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-tlkw4"]
Jul 23 16:16:00.804953 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:16:00.804926    2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode4611a5f_b77b_469f_b29c_81ea53b65599.slice/crio-f21bded27551d75465aa10d855ab1873e89eeb4bd6f3d19f32b09a2cc956aada WatchSource:0}: Error finding container f21bded27551d75465aa10d855ab1873e89eeb4bd6f3d19f32b09a2cc956aada: Status 404 returned error can't find the container with id f21bded27551d75465aa10d855ab1873e89eeb4bd6f3d19f32b09a2cc956aada
Jul 23 16:16:00.817156 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:16:00.817124    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-565b7b569d-7rmrn"]
Jul 23 16:16:00.822706 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:16:00.822676    2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod976a7198_cfd3_43d4_8c9f_b1f248d1f6d7.slice/crio-e4cf3ab3df3bda0f034a936fd1f197e49ab831eae1239409d42ced98f6db92b8 WatchSource:0}: Error finding container e4cf3ab3df3bda0f034a936fd1f197e49ab831eae1239409d42ced98f6db92b8: Status 404 returned error can't find the container with id e4cf3ab3df3bda0f034a936fd1f197e49ab831eae1239409d42ced98f6db92b8
Jul 23 16:16:00.829569 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:16:00.829546    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/6abdb72f-f8eb-4ac2-b365-21769a0d3c15-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-wk2tc\" (UID: \"6abdb72f-f8eb-4ac2-b365-21769a0d3c15\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-wk2tc"
Jul 23 16:16:00.829700 ip-10-0-143-166 kubenswrapper[2553]: E0723 16:16:00.829682    2553 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 23 16:16:00.829802 ip-10-0-143-166 kubenswrapper[2553]: E0723 16:16:00.829790    2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6abdb72f-f8eb-4ac2-b365-21769a0d3c15-samples-operator-tls podName:6abdb72f-f8eb-4ac2-b365-21769a0d3c15 nodeName:}" failed. No retries permitted until 2026-07-23 16:16:01.829769082 +0000 UTC m=+43.694375203 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/6abdb72f-f8eb-4ac2-b365-21769a0d3c15-samples-operator-tls") pod "cluster-samples-operator-79b7c55f87-wk2tc" (UID: "6abdb72f-f8eb-4ac2-b365-21769a0d3c15") : secret "samples-operator-tls" not found
Jul 23 16:16:00.842674 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:16:00.842620    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5bcbc94c78-4jm7t"]
Jul 23 16:16:00.844947 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:16:00.844924    2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3468a30b_e65e_4ca8_a427_6e63953f932b.slice/crio-9fb9e5b764d02c6b0dc7b4567a724e67cfb837bba7841cc8a38fd1263390552a WatchSource:0}: Error finding container 9fb9e5b764d02c6b0dc7b4567a724e67cfb837bba7841cc8a38fd1263390552a: Status 404 returned error can't find the container with id 9fb9e5b764d02c6b0dc7b4567a724e67cfb837bba7841cc8a38fd1263390552a
Jul 23 16:16:00.851040 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:16:00.851017    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-tlkw4" event={"ID":"e4611a5f-b77b-469f-b29c-81ea53b65599","Type":"ContainerStarted","Data":"f21bded27551d75465aa10d855ab1873e89eeb4bd6f3d19f32b09a2cc956aada"}
Jul 23 16:16:00.852082 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:16:00.852052    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-ddq85" event={"ID":"c290c129-eea4-49d9-9ca5-56b4d600275b","Type":"ContainerStarted","Data":"1c6f4788a5a1bdebfed81d9a74ce95a8e60e44e05a121ac0f12a121fd27d8824"}
Jul 23 16:16:00.853073 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:16:00.853022    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-4jm7t" event={"ID":"3468a30b-e65e-4ca8-a427-6e63953f932b","Type":"ContainerStarted","Data":"9fb9e5b764d02c6b0dc7b4567a724e67cfb837bba7841cc8a38fd1263390552a"}
Jul 23 16:16:00.853930 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:16:00.853911    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-565b7b569d-7rmrn" event={"ID":"976a7198-cfd3-43d4-8c9f-b1f248d1f6d7","Type":"ContainerStarted","Data":"e4cf3ab3df3bda0f034a936fd1f197e49ab831eae1239409d42ced98f6db92b8"}
Jul 23 16:16:00.854819 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:16:00.854802    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-555d9d7885-5hbck" event={"ID":"93f725de-e1d8-4c9d-9491-494072eaadf4","Type":"ContainerStarted","Data":"a755583f5e5dfacb72a129752c390703c4068c34713cd4fa2e731fe5ebacfcd7"}
Jul 23 16:16:00.855704 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:16:00.855687    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-m8xxx" event={"ID":"f87b81d6-453b-4dd3-8d67-44e93b875a19","Type":"ContainerStarted","Data":"5c7851682d4c5c6c3f827007ab4dc3124597d79355d07132b187b0e7a7fb1b4c"}
Jul 23 16:16:00.930787 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:16:00.930754    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/0167b7d7-8b10-4847-b5ea-5dc52d892bf0-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-jrf9k\" (UID: \"0167b7d7-8b10-4847-b5ea-5dc52d892bf0\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-jrf9k"
Jul 23 16:16:00.930787 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:16:00.930793    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/552a2881-1bbe-4a5e-b5fb-d245882c2933-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-pksrr\" (UID: \"552a2881-1bbe-4a5e-b5fb-d245882c2933\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-pksrr"
Jul 23 16:16:00.930967 ip-10-0-143-166 kubenswrapper[2553]: E0723 16:16:00.930919    2553 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 23 16:16:00.930997 ip-10-0-143-166 kubenswrapper[2553]: E0723 16:16:00.930980    2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0167b7d7-8b10-4847-b5ea-5dc52d892bf0-cluster-monitoring-operator-tls podName:0167b7d7-8b10-4847-b5ea-5dc52d892bf0 nodeName:}" failed. No retries permitted until 2026-07-23 16:16:01.930966467 +0000 UTC m=+43.795572578 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/0167b7d7-8b10-4847-b5ea-5dc52d892bf0-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-76cf8966f8-jrf9k" (UID: "0167b7d7-8b10-4847-b5ea-5dc52d892bf0") : secret "cluster-monitoring-operator-tls" not found
Jul 23 16:16:00.931035 ip-10-0-143-166 kubenswrapper[2553]: E0723 16:16:00.930920    2553 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 23 16:16:00.931090 ip-10-0-143-166 kubenswrapper[2553]: E0723 16:16:00.931052    2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/552a2881-1bbe-4a5e-b5fb-d245882c2933-networking-console-plugin-cert podName:552a2881-1bbe-4a5e-b5fb-d245882c2933 nodeName:}" failed. No retries permitted until 2026-07-23 16:16:01.93103845 +0000 UTC m=+43.795644558 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/552a2881-1bbe-4a5e-b5fb-d245882c2933-networking-console-plugin-cert") pod "networking-console-plugin-7bc7489cb5-pksrr" (UID: "552a2881-1bbe-4a5e-b5fb-d245882c2933") : secret "networking-console-plugin-cert" not found
Jul 23 16:16:01.031718 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:16:01.031679    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b145abca-07cb-4345-9efc-2c03f950ac14-metrics-certs\") pod \"router-default-599b8db76d-sn7k4\" (UID: \"b145abca-07cb-4345-9efc-2c03f950ac14\") " pod="openshift-ingress/router-default-599b8db76d-sn7k4"
Jul 23 16:16:01.031912 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:16:01.031805    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b145abca-07cb-4345-9efc-2c03f950ac14-service-ca-bundle\") pod \"router-default-599b8db76d-sn7k4\" (UID: \"b145abca-07cb-4345-9efc-2c03f950ac14\") " pod="openshift-ingress/router-default-599b8db76d-sn7k4"
Jul 23 16:16:01.031912 ip-10-0-143-166 kubenswrapper[2553]: E0723 16:16:01.031829    2553 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 23 16:16:01.031912 ip-10-0-143-166 kubenswrapper[2553]: E0723 16:16:01.031898    2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b145abca-07cb-4345-9efc-2c03f950ac14-metrics-certs podName:b145abca-07cb-4345-9efc-2c03f950ac14 nodeName:}" failed. No retries permitted until 2026-07-23 16:16:02.031882904 +0000 UTC m=+43.896489010 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b145abca-07cb-4345-9efc-2c03f950ac14-metrics-certs") pod "router-default-599b8db76d-sn7k4" (UID: "b145abca-07cb-4345-9efc-2c03f950ac14") : secret "router-metrics-certs-default" not found
Jul 23 16:16:01.032060 ip-10-0-143-166 kubenswrapper[2553]: E0723 16:16:01.031943    2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/b145abca-07cb-4345-9efc-2c03f950ac14-service-ca-bundle podName:b145abca-07cb-4345-9efc-2c03f950ac14 nodeName:}" failed. No retries permitted until 2026-07-23 16:16:02.03192825 +0000 UTC m=+43.896534370 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/b145abca-07cb-4345-9efc-2c03f950ac14-service-ca-bundle") pod "router-default-599b8db76d-sn7k4" (UID: "b145abca-07cb-4345-9efc-2c03f950ac14") : configmap references non-existent config key: service-ca.crt
Jul 23 16:16:01.334234 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:16:01.334199    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/267f079f-9842-415b-858e-c591c6a73a64-registry-tls\") pod \"image-registry-6868994b56-jpcfj\" (UID: \"267f079f-9842-415b-858e-c591c6a73a64\") " pod="openshift-image-registry/image-registry-6868994b56-jpcfj"
Jul 23 16:16:01.334648 ip-10-0-143-166 kubenswrapper[2553]: E0723 16:16:01.334365    2553 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 23 16:16:01.334648 ip-10-0-143-166 kubenswrapper[2553]: E0723 16:16:01.334388    2553 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6868994b56-jpcfj: secret "image-registry-tls" not found
Jul 23 16:16:01.334648 ip-10-0-143-166 kubenswrapper[2553]: E0723 16:16:01.334452    2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/267f079f-9842-415b-858e-c591c6a73a64-registry-tls podName:267f079f-9842-415b-858e-c591c6a73a64 nodeName:}" failed. No retries permitted until 2026-07-23 16:16:09.334435119 +0000 UTC m=+51.199041225 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/267f079f-9842-415b-858e-c591c6a73a64-registry-tls") pod "image-registry-6868994b56-jpcfj" (UID: "267f079f-9842-415b-858e-c591c6a73a64") : secret "image-registry-tls" not found
Jul 23 16:16:01.839888 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:16:01.839844    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/6abdb72f-f8eb-4ac2-b365-21769a0d3c15-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-wk2tc\" (UID: \"6abdb72f-f8eb-4ac2-b365-21769a0d3c15\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-wk2tc"
Jul 23 16:16:01.840092 ip-10-0-143-166 kubenswrapper[2553]: E0723 16:16:01.839992    2553 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 23 16:16:01.840092 ip-10-0-143-166 kubenswrapper[2553]: E0723 16:16:01.840072    2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6abdb72f-f8eb-4ac2-b365-21769a0d3c15-samples-operator-tls podName:6abdb72f-f8eb-4ac2-b365-21769a0d3c15 nodeName:}" failed. No retries permitted until 2026-07-23 16:16:03.840052999 +0000 UTC m=+45.704659116 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/6abdb72f-f8eb-4ac2-b365-21769a0d3c15-samples-operator-tls") pod "cluster-samples-operator-79b7c55f87-wk2tc" (UID: "6abdb72f-f8eb-4ac2-b365-21769a0d3c15") : secret "samples-operator-tls" not found
Jul 23 16:16:01.941780 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:16:01.940916    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/0167b7d7-8b10-4847-b5ea-5dc52d892bf0-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-jrf9k\" (UID: \"0167b7d7-8b10-4847-b5ea-5dc52d892bf0\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-jrf9k"
Jul 23 16:16:01.941780 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:16:01.940969    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/552a2881-1bbe-4a5e-b5fb-d245882c2933-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-pksrr\" (UID: \"552a2881-1bbe-4a5e-b5fb-d245882c2933\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-pksrr"
Jul 23 16:16:01.941780 ip-10-0-143-166 kubenswrapper[2553]: E0723 16:16:01.941241    2553 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 23 16:16:01.941780 ip-10-0-143-166 kubenswrapper[2553]: E0723 16:16:01.941310    2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/552a2881-1bbe-4a5e-b5fb-d245882c2933-networking-console-plugin-cert podName:552a2881-1bbe-4a5e-b5fb-d245882c2933 nodeName:}" failed. No retries permitted until 2026-07-23 16:16:03.941288515 +0000 UTC m=+45.805894639 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/552a2881-1bbe-4a5e-b5fb-d245882c2933-networking-console-plugin-cert") pod "networking-console-plugin-7bc7489cb5-pksrr" (UID: "552a2881-1bbe-4a5e-b5fb-d245882c2933") : secret "networking-console-plugin-cert" not found
Jul 23 16:16:01.941780 ip-10-0-143-166 kubenswrapper[2553]: E0723 16:16:01.941700    2553 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 23 16:16:01.941780 ip-10-0-143-166 kubenswrapper[2553]: E0723 16:16:01.941746    2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0167b7d7-8b10-4847-b5ea-5dc52d892bf0-cluster-monitoring-operator-tls podName:0167b7d7-8b10-4847-b5ea-5dc52d892bf0 nodeName:}" failed. No retries permitted until 2026-07-23 16:16:03.941732397 +0000 UTC m=+45.806338512 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/0167b7d7-8b10-4847-b5ea-5dc52d892bf0-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-76cf8966f8-jrf9k" (UID: "0167b7d7-8b10-4847-b5ea-5dc52d892bf0") : secret "cluster-monitoring-operator-tls" not found
Jul 23 16:16:02.041790 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:16:02.041743    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b145abca-07cb-4345-9efc-2c03f950ac14-service-ca-bundle\") pod \"router-default-599b8db76d-sn7k4\" (UID: \"b145abca-07cb-4345-9efc-2c03f950ac14\") " pod="openshift-ingress/router-default-599b8db76d-sn7k4"
Jul 23 16:16:02.041984 ip-10-0-143-166 kubenswrapper[2553]: E0723 16:16:02.041942    2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/b145abca-07cb-4345-9efc-2c03f950ac14-service-ca-bundle podName:b145abca-07cb-4345-9efc-2c03f950ac14 nodeName:}" failed. No retries permitted until 2026-07-23 16:16:04.041919149 +0000 UTC m=+45.906525263 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/b145abca-07cb-4345-9efc-2c03f950ac14-service-ca-bundle") pod "router-default-599b8db76d-sn7k4" (UID: "b145abca-07cb-4345-9efc-2c03f950ac14") : configmap references non-existent config key: service-ca.crt
Jul 23 16:16:02.042064 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:16:02.042017    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b145abca-07cb-4345-9efc-2c03f950ac14-metrics-certs\") pod \"router-default-599b8db76d-sn7k4\" (UID: \"b145abca-07cb-4345-9efc-2c03f950ac14\") " pod="openshift-ingress/router-default-599b8db76d-sn7k4"
Jul 23 16:16:02.042387 ip-10-0-143-166 kubenswrapper[2553]: E0723 16:16:02.042257    2553 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 23 16:16:02.042387 ip-10-0-143-166 kubenswrapper[2553]: E0723 16:16:02.042320    2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b145abca-07cb-4345-9efc-2c03f950ac14-metrics-certs podName:b145abca-07cb-4345-9efc-2c03f950ac14 nodeName:}" failed. No retries permitted until 2026-07-23 16:16:04.042305645 +0000 UTC m=+45.906911756 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b145abca-07cb-4345-9efc-2c03f950ac14-metrics-certs") pod "router-default-599b8db76d-sn7k4" (UID: "b145abca-07cb-4345-9efc-2c03f950ac14") : secret "router-metrics-certs-default" not found
Jul 23 16:16:02.346710 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:16:02.346122    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7ca02cf0-ad65-46e4-a0bd-25a470519d68-metrics-tls\") pod \"dns-default-jkc4g\" (UID: \"7ca02cf0-ad65-46e4-a0bd-25a470519d68\") " pod="openshift-dns/dns-default-jkc4g"
Jul 23 16:16:02.346710 ip-10-0-143-166 kubenswrapper[2553]: E0723 16:16:02.346311    2553 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 23 16:16:02.346710 ip-10-0-143-166 kubenswrapper[2553]: E0723 16:16:02.346379    2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7ca02cf0-ad65-46e4-a0bd-25a470519d68-metrics-tls podName:7ca02cf0-ad65-46e4-a0bd-25a470519d68 nodeName:}" failed. No retries permitted until 2026-07-23 16:16:10.346358538 +0000 UTC m=+52.210964651 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/7ca02cf0-ad65-46e4-a0bd-25a470519d68-metrics-tls") pod "dns-default-jkc4g" (UID: "7ca02cf0-ad65-46e4-a0bd-25a470519d68") : secret "dns-default-metrics-tls" not found
Jul 23 16:16:03.861587 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:16:03.861543    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/6abdb72f-f8eb-4ac2-b365-21769a0d3c15-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-wk2tc\" (UID: \"6abdb72f-f8eb-4ac2-b365-21769a0d3c15\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-wk2tc"
Jul 23 16:16:03.862023 ip-10-0-143-166 kubenswrapper[2553]: E0723 16:16:03.861716    2553 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 23 16:16:03.862023 ip-10-0-143-166 kubenswrapper[2553]: E0723 16:16:03.861799    2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6abdb72f-f8eb-4ac2-b365-21769a0d3c15-samples-operator-tls podName:6abdb72f-f8eb-4ac2-b365-21769a0d3c15 nodeName:}" failed. No retries permitted until 2026-07-23 16:16:07.861776279 +0000 UTC m=+49.726382410 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/6abdb72f-f8eb-4ac2-b365-21769a0d3c15-samples-operator-tls") pod "cluster-samples-operator-79b7c55f87-wk2tc" (UID: "6abdb72f-f8eb-4ac2-b365-21769a0d3c15") : secret "samples-operator-tls" not found
Jul 23 16:16:03.962894 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:16:03.962852    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/0167b7d7-8b10-4847-b5ea-5dc52d892bf0-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-jrf9k\" (UID: \"0167b7d7-8b10-4847-b5ea-5dc52d892bf0\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-jrf9k"
Jul 23 16:16:03.962894 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:16:03.962898    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/552a2881-1bbe-4a5e-b5fb-d245882c2933-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-pksrr\" (UID: \"552a2881-1bbe-4a5e-b5fb-d245882c2933\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-pksrr"
Jul 23 16:16:03.963117 ip-10-0-143-166 kubenswrapper[2553]: E0723 16:16:03.963024    2553 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 23 16:16:03.963117 ip-10-0-143-166 kubenswrapper[2553]: E0723 16:16:03.963058    2553 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 23 16:16:03.963117 ip-10-0-143-166 kubenswrapper[2553]: E0723 16:16:03.963109    2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0167b7d7-8b10-4847-b5ea-5dc52d892bf0-cluster-monitoring-operator-tls podName:0167b7d7-8b10-4847-b5ea-5dc52d892bf0 nodeName:}" failed. No retries permitted until 2026-07-23 16:16:07.963087488 +0000 UTC m=+49.827693598 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/0167b7d7-8b10-4847-b5ea-5dc52d892bf0-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-76cf8966f8-jrf9k" (UID: "0167b7d7-8b10-4847-b5ea-5dc52d892bf0") : secret "cluster-monitoring-operator-tls" not found
Jul 23 16:16:03.963255 ip-10-0-143-166 kubenswrapper[2553]: E0723 16:16:03.963128    2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/552a2881-1bbe-4a5e-b5fb-d245882c2933-networking-console-plugin-cert podName:552a2881-1bbe-4a5e-b5fb-d245882c2933 nodeName:}" failed. No retries permitted until 2026-07-23 16:16:07.963118658 +0000 UTC m=+49.827724766 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/552a2881-1bbe-4a5e-b5fb-d245882c2933-networking-console-plugin-cert") pod "networking-console-plugin-7bc7489cb5-pksrr" (UID: "552a2881-1bbe-4a5e-b5fb-d245882c2933") : secret "networking-console-plugin-cert" not found
Jul 23 16:16:04.064285 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:16:04.064243    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b145abca-07cb-4345-9efc-2c03f950ac14-service-ca-bundle\") pod \"router-default-599b8db76d-sn7k4\" (UID: \"b145abca-07cb-4345-9efc-2c03f950ac14\") " pod="openshift-ingress/router-default-599b8db76d-sn7k4"
Jul 23 16:16:04.064499 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:16:04.064365    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b145abca-07cb-4345-9efc-2c03f950ac14-metrics-certs\") pod \"router-default-599b8db76d-sn7k4\" (UID: \"b145abca-07cb-4345-9efc-2c03f950ac14\") " pod="openshift-ingress/router-default-599b8db76d-sn7k4"
Jul 23 16:16:04.064499 ip-10-0-143-166 kubenswrapper[2553]: E0723 16:16:04.064420    2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/b145abca-07cb-4345-9efc-2c03f950ac14-service-ca-bundle podName:b145abca-07cb-4345-9efc-2c03f950ac14 nodeName:}" failed. No retries permitted until 2026-07-23 16:16:08.064399266 +0000 UTC m=+49.929005395 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/b145abca-07cb-4345-9efc-2c03f950ac14-service-ca-bundle") pod "router-default-599b8db76d-sn7k4" (UID: "b145abca-07cb-4345-9efc-2c03f950ac14") : configmap references non-existent config key: service-ca.crt
Jul 23 16:16:04.064499 ip-10-0-143-166 kubenswrapper[2553]: E0723 16:16:04.064467    2553 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 23 16:16:04.064499 ip-10-0-143-166 kubenswrapper[2553]: E0723 16:16:04.064501    2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b145abca-07cb-4345-9efc-2c03f950ac14-metrics-certs podName:b145abca-07cb-4345-9efc-2c03f950ac14 nodeName:}" failed. No retries permitted until 2026-07-23 16:16:08.064491224 +0000 UTC m=+49.929097330 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b145abca-07cb-4345-9efc-2c03f950ac14-metrics-certs") pod "router-default-599b8db76d-sn7k4" (UID: "b145abca-07cb-4345-9efc-2c03f950ac14") : secret "router-metrics-certs-default" not found
Jul 23 16:16:07.887143 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:16:07.887105    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-tlkw4" event={"ID":"e4611a5f-b77b-469f-b29c-81ea53b65599","Type":"ContainerStarted","Data":"6a3ae29c243e92e2b5f3f93cc63777d0215dabfe50417213d2cbf08a4d19bd72"}
Jul 23 16:16:07.888782 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:16:07.888754    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-ddq85" event={"ID":"c290c129-eea4-49d9-9ca5-56b4d600275b","Type":"ContainerStarted","Data":"8ff41a3ce159981fb4966a649b91f288168c9f89592389bd15736dac719c2132"}
Jul 23 16:16:07.890736 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:16:07.890708    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-4jm7t" event={"ID":"3468a30b-e65e-4ca8-a427-6e63953f932b","Type":"ContainerStarted","Data":"7a1a1d0cec67ab77b884e869121ee37891afbab1a18e856174d6ae1a2eb0440b"}
Jul 23 16:16:07.892867 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:16:07.892846    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-7rmrn_976a7198-cfd3-43d4-8c9f-b1f248d1f6d7/console-operator/0.log"
Jul 23 16:16:07.892978 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:16:07.892886    2553 generic.go:356] "Generic (PLEG): container finished" podID="976a7198-cfd3-43d4-8c9f-b1f248d1f6d7" containerID="b0f3102548e1367d75daaff6ae6782a0ca303199d56802395f4563e467df9042" exitCode=255
Jul 23 16:16:07.893036 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:16:07.892969    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-565b7b569d-7rmrn" event={"ID":"976a7198-cfd3-43d4-8c9f-b1f248d1f6d7","Type":"ContainerDied","Data":"b0f3102548e1367d75daaff6ae6782a0ca303199d56802395f4563e467df9042"}
Jul 23 16:16:07.893414 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:16:07.893397    2553 scope.go:117] "RemoveContainer" containerID="b0f3102548e1367d75daaff6ae6782a0ca303199d56802395f4563e467df9042"
Jul 23 16:16:07.894797 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:16:07.894776    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-555d9d7885-5hbck" event={"ID":"93f725de-e1d8-4c9d-9491-494072eaadf4","Type":"ContainerStarted","Data":"8be22a95298f12d85b3a1ad9b4eac28c91883dcfc0b4dde4a606fff472a2a9de"}
Jul 23 16:16:07.896443 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:16:07.896422    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-m8xxx" event={"ID":"f87b81d6-453b-4dd3-8d67-44e93b875a19","Type":"ContainerStarted","Data":"7c0e68847548236c8b31db55dda7d932d870c7d3725856c3f0df1f538383f5ea"}
Jul 23 16:16:07.897913 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:16:07.897891    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/6abdb72f-f8eb-4ac2-b365-21769a0d3c15-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-wk2tc\" (UID: \"6abdb72f-f8eb-4ac2-b365-21769a0d3c15\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-wk2tc"
Jul 23 16:16:07.898116 ip-10-0-143-166 kubenswrapper[2553]: E0723 16:16:07.898102    2553 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 23 16:16:07.898259 ip-10-0-143-166 kubenswrapper[2553]: E0723 16:16:07.898249    2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6abdb72f-f8eb-4ac2-b365-21769a0d3c15-samples-operator-tls podName:6abdb72f-f8eb-4ac2-b365-21769a0d3c15 nodeName:}" failed. No retries permitted until 2026-07-23 16:16:15.898230522 +0000 UTC m=+57.762836634 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/6abdb72f-f8eb-4ac2-b365-21769a0d3c15-samples-operator-tls") pod "cluster-samples-operator-79b7c55f87-wk2tc" (UID: "6abdb72f-f8eb-4ac2-b365-21769a0d3c15") : secret "samples-operator-tls" not found
Jul 23 16:16:07.904458 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:16:07.904415    2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-tlkw4" podStartSLOduration=1.2823525 podStartE2EDuration="7.904398493s" totalImagesPullingTime="6.622045993s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 16:16:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 16:16:07.902592399 +0000 UTC m=+49.767198520" watchObservedRunningTime="2026-07-23 16:16:07.904398493 +0000 UTC m=+49.769004626"
Jul 23 16:16:07.919364 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:16:07.918540    2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-m8xxx" podStartSLOduration=1.153239753 podStartE2EDuration="7.91851997s" totalImagesPullingTime="6.765280217s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 16:16:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 16:16:07.917226532 +0000 UTC m=+49.781832661" watchObservedRunningTime="2026-07-23 16:16:07.91851997 +0000 UTC m=+49.783126099"
Jul 23 16:16:07.938348 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:16:07.937130    2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-ddq85" podStartSLOduration=1.227791851 podStartE2EDuration="7.937110158s" totalImagesPullingTime="6.709318307s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 16:16:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 16:16:07.93655468 +0000 UTC m=+49.801160812" watchObservedRunningTime="2026-07-23 16:16:07.937110158 +0000 UTC m=+49.801716287"
Jul 23 16:16:07.994209 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:16:07.993911    2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-4jm7t" podStartSLOduration=1.410532555 podStartE2EDuration="7.993887496s" totalImagesPullingTime="6.583354941s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 16:16:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 16:16:07.972367369 +0000 UTC m=+49.836973498" watchObservedRunningTime="2026-07-23 16:16:07.993887496 +0000 UTC m=+49.858493626"
Jul 23 16:16:08.001129 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:16:08.001091    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/552a2881-1bbe-4a5e-b5fb-d245882c2933-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-pksrr\" (UID: \"552a2881-1bbe-4a5e-b5fb-d245882c2933\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-pksrr"
Jul 23 16:16:08.002035 ip-10-0-143-166 kubenswrapper[2553]: E0723 16:16:08.001593    2553 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 23 16:16:08.002035 ip-10-0-143-166 kubenswrapper[2553]: E0723 16:16:08.001739    2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/552a2881-1bbe-4a5e-b5fb-d245882c2933-networking-console-plugin-cert podName:552a2881-1bbe-4a5e-b5fb-d245882c2933 nodeName:}" failed. No retries permitted until 2026-07-23 16:16:16.001720734 +0000 UTC m=+57.866326853 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/552a2881-1bbe-4a5e-b5fb-d245882c2933-networking-console-plugin-cert") pod "networking-console-plugin-7bc7489cb5-pksrr" (UID: "552a2881-1bbe-4a5e-b5fb-d245882c2933") : secret "networking-console-plugin-cert" not found
Jul 23 16:16:08.002434 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:16:08.002415    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/0167b7d7-8b10-4847-b5ea-5dc52d892bf0-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-jrf9k\" (UID: \"0167b7d7-8b10-4847-b5ea-5dc52d892bf0\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-jrf9k"
Jul 23 16:16:08.002662 ip-10-0-143-166 kubenswrapper[2553]: E0723 16:16:08.002597    2553 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 23 16:16:08.002814 ip-10-0-143-166 kubenswrapper[2553]: E0723 16:16:08.002805    2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0167b7d7-8b10-4847-b5ea-5dc52d892bf0-cluster-monitoring-operator-tls podName:0167b7d7-8b10-4847-b5ea-5dc52d892bf0 nodeName:}" failed. No retries permitted until 2026-07-23 16:16:16.002786244 +0000 UTC m=+57.867392354 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/0167b7d7-8b10-4847-b5ea-5dc52d892bf0-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-76cf8966f8-jrf9k" (UID: "0167b7d7-8b10-4847-b5ea-5dc52d892bf0") : secret "cluster-monitoring-operator-tls" not found
Jul 23 16:16:08.023053 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:16:08.023002    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j892l_bba31e38-01db-45a0-8b60-9fc626237e01/konnectivity-agent/0.log" limit=1024
Jul 23 16:16:08.103414 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:16:08.103380    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b145abca-07cb-4345-9efc-2c03f950ac14-service-ca-bundle\") pod \"router-default-599b8db76d-sn7k4\" (UID: \"b145abca-07cb-4345-9efc-2c03f950ac14\") " pod="openshift-ingress/router-default-599b8db76d-sn7k4"
Jul 23 16:16:08.103586 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:16:08.103481    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b145abca-07cb-4345-9efc-2c03f950ac14-metrics-certs\") pod \"router-default-599b8db76d-sn7k4\" (UID: \"b145abca-07cb-4345-9efc-2c03f950ac14\") " pod="openshift-ingress/router-default-599b8db76d-sn7k4"
Jul 23 16:16:08.103586 ip-10-0-143-166 kubenswrapper[2553]: E0723 16:16:08.103555    2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/b145abca-07cb-4345-9efc-2c03f950ac14-service-ca-bundle podName:b145abca-07cb-4345-9efc-2c03f950ac14 nodeName:}" failed. No retries permitted until 2026-07-23 16:16:16.103535682 +0000 UTC m=+57.968141812 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/b145abca-07cb-4345-9efc-2c03f950ac14-service-ca-bundle") pod "router-default-599b8db76d-sn7k4" (UID: "b145abca-07cb-4345-9efc-2c03f950ac14") : configmap references non-existent config key: service-ca.crt
Jul 23 16:16:08.103707 ip-10-0-143-166 kubenswrapper[2553]: E0723 16:16:08.103652    2553 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 23 16:16:08.103760 ip-10-0-143-166 kubenswrapper[2553]: E0723 16:16:08.103727    2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b145abca-07cb-4345-9efc-2c03f950ac14-metrics-certs podName:b145abca-07cb-4345-9efc-2c03f950ac14 nodeName:}" failed. No retries permitted until 2026-07-23 16:16:16.103706745 +0000 UTC m=+57.968312852 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b145abca-07cb-4345-9efc-2c03f950ac14-metrics-certs") pod "router-default-599b8db76d-sn7k4" (UID: "b145abca-07cb-4345-9efc-2c03f950ac14") : secret "router-metrics-certs-default" not found
Jul 23 16:16:08.122374 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:16:08.122345    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j892l_bba31e38-01db-45a0-8b60-9fc626237e01/konnectivity-agent/0.log" limit=1024
Jul 23 16:16:08.819373 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:16:08.819284    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j892l_bba31e38-01db-45a0-8b60-9fc626237e01/konnectivity-agent/0.log" limit=1024
Jul 23 16:16:08.903203 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:16:08.903141    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-7rmrn_976a7198-cfd3-43d4-8c9f-b1f248d1f6d7/console-operator/1.log"
Jul 23 16:16:08.904180 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:16:08.904143    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-7rmrn_976a7198-cfd3-43d4-8c9f-b1f248d1f6d7/console-operator/0.log"
Jul 23 16:16:08.904304 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:16:08.904207    2553 generic.go:356] "Generic (PLEG): container finished" podID="976a7198-cfd3-43d4-8c9f-b1f248d1f6d7" containerID="2032f18e0514bea83886d2b3479684521d175b52702d3f6c81e3c286ca0e7863" exitCode=255
Jul 23 16:16:08.904384 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:16:08.904355    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-565b7b569d-7rmrn" event={"ID":"976a7198-cfd3-43d4-8c9f-b1f248d1f6d7","Type":"ContainerDied","Data":"2032f18e0514bea83886d2b3479684521d175b52702d3f6c81e3c286ca0e7863"}
Jul 23 16:16:08.904439 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:16:08.904420    2553 scope.go:117] "RemoveContainer" containerID="b0f3102548e1367d75daaff6ae6782a0ca303199d56802395f4563e467df9042"
Jul 23 16:16:08.905006 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:16:08.904990    2553 scope.go:117] "RemoveContainer" containerID="2032f18e0514bea83886d2b3479684521d175b52702d3f6c81e3c286ca0e7863"
Jul 23 16:16:08.905181 ip-10-0-143-166 kubenswrapper[2553]: E0723 16:16:08.905146    2553 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-565b7b569d-7rmrn_openshift-console-operator(976a7198-cfd3-43d4-8c9f-b1f248d1f6d7)\"" pod="openshift-console-operator/console-operator-565b7b569d-7rmrn" podUID="976a7198-cfd3-43d4-8c9f-b1f248d1f6d7"
Jul 23 16:16:08.914999 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:16:08.914970    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j892l_bba31e38-01db-45a0-8b60-9fc626237e01/konnectivity-agent/0.log" limit=1024
Jul 23 16:16:08.922421 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:16:08.922359    2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-555d9d7885-5hbck" podStartSLOduration=2.242696235 podStartE2EDuration="8.922337396s" totalImagesPullingTime="6.679641161s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 16:16:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 16:16:07.994194258 +0000 UTC m=+49.858800385" watchObservedRunningTime="2026-07-23 16:16:08.922337396 +0000 UTC m=+50.786943525"
Jul 23 16:16:09.322530 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:16:09.321968    2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-klcmp"]
Jul 23 16:16:09.344322 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:16:09.343663    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-klcmp"]
Jul 23 16:16:09.344322 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:16:09.343764    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-klcmp"
Jul 23 16:16:09.344322 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:16:09.344042    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j892l_bba31e38-01db-45a0-8b60-9fc626237e01/konnectivity-agent/0.log" limit=1024
Jul 23 16:16:09.346579 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:16:09.346552    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 23 16:16:09.346766 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:16:09.346687    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-tj2lp\""
Jul 23 16:16:09.346844 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:16:09.346775    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 23 16:16:09.407703 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:16:09.407665    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j892l_bba31e38-01db-45a0-8b60-9fc626237e01/konnectivity-agent/0.log" limit=1024
Jul 23 16:16:09.415812 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:16:09.415781    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/009e126d-9220-4759-b0ef-7a5b2fd70563-data-volume\") pod \"insights-runtime-extractor-klcmp\" (UID: \"009e126d-9220-4759-b0ef-7a5b2fd70563\") " pod="openshift-insights/insights-runtime-extractor-klcmp"
Jul 23 16:16:09.415941 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:16:09.415829    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/009e126d-9220-4759-b0ef-7a5b2fd70563-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-klcmp\" (UID: \"009e126d-9220-4759-b0ef-7a5b2fd70563\") " pod="openshift-insights/insights-runtime-extractor-klcmp"
Jul 23 16:16:09.415941 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:16:09.415899    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/009e126d-9220-4759-b0ef-7a5b2fd70563-crio-socket\") pod \"insights-runtime-extractor-klcmp\" (UID: \"009e126d-9220-4759-b0ef-7a5b2fd70563\") " pod="openshift-insights/insights-runtime-extractor-klcmp"
Jul 23 16:16:09.416066 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:16:09.415993    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/267f079f-9842-415b-858e-c591c6a73a64-registry-tls\") pod \"image-registry-6868994b56-jpcfj\" (UID: \"267f079f-9842-415b-858e-c591c6a73a64\") " pod="openshift-image-registry/image-registry-6868994b56-jpcfj"
Jul 23 16:16:09.416066 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:16:09.416058    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/009e126d-9220-4759-b0ef-7a5b2fd70563-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-klcmp\" (UID: \"009e126d-9220-4759-b0ef-7a5b2fd70563\") " pod="openshift-insights/insights-runtime-extractor-klcmp"
Jul 23 16:16:09.416138 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:16:09.416106    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l6xfl\" (UniqueName: \"kubernetes.io/projected/009e126d-9220-4759-b0ef-7a5b2fd70563-kube-api-access-l6xfl\") pod \"insights-runtime-extractor-klcmp\" (UID: \"009e126d-9220-4759-b0ef-7a5b2fd70563\") " pod="openshift-insights/insights-runtime-extractor-klcmp"
Jul 23 16:16:09.416138 ip-10-0-143-166 kubenswrapper[2553]: E0723 16:16:09.416115    2553 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 23 16:16:09.416138 ip-10-0-143-166 kubenswrapper[2553]: E0723 16:16:09.416134    2553 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6868994b56-jpcfj: secret "image-registry-tls" not found
Jul 23 16:16:09.416259 ip-10-0-143-166 kubenswrapper[2553]: E0723 16:16:09.416222    2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/267f079f-9842-415b-858e-c591c6a73a64-registry-tls podName:267f079f-9842-415b-858e-c591c6a73a64 nodeName:}" failed. No retries permitted until 2026-07-23 16:16:25.416202793 +0000 UTC m=+67.280808907 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/267f079f-9842-415b-858e-c591c6a73a64-registry-tls") pod "image-registry-6868994b56-jpcfj" (UID: "267f079f-9842-415b-858e-c591c6a73a64") : secret "image-registry-tls" not found
Jul 23 16:16:09.509102 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:16:09.509066    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j892l_bba31e38-01db-45a0-8b60-9fc626237e01/konnectivity-agent/0.log" limit=1024
Jul 23 16:16:09.514361 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:16:09.514334    2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-22876"]
Jul 23 16:16:09.516808 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:16:09.516787    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/009e126d-9220-4759-b0ef-7a5b2fd70563-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-klcmp\" (UID: \"009e126d-9220-4759-b0ef-7a5b2fd70563\") " pod="openshift-insights/insights-runtime-extractor-klcmp"
Jul 23 16:16:09.516879 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:16:09.516846    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/009e126d-9220-4759-b0ef-7a5b2fd70563-crio-socket\") pod \"insights-runtime-extractor-klcmp\" (UID: \"009e126d-9220-4759-b0ef-7a5b2fd70563\") " pod="openshift-insights/insights-runtime-extractor-klcmp"
Jul 23 16:16:09.516934 ip-10-0-143-166 kubenswrapper[2553]: E0723 16:16:09.516915    2553 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 23 16:16:09.516992 ip-10-0-143-166 kubenswrapper[2553]: E0723 16:16:09.516982    2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/009e126d-9220-4759-b0ef-7a5b2fd70563-kube-rbac-proxy-cm podName:009e126d-9220-4759-b0ef-7a5b2fd70563 nodeName:}" failed. No retries permitted until 2026-07-23 16:16:10.016967271 +0000 UTC m=+51.881573376 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/009e126d-9220-4759-b0ef-7a5b2fd70563-kube-rbac-proxy-cm") pod "insights-runtime-extractor-klcmp" (UID: "009e126d-9220-4759-b0ef-7a5b2fd70563") : configmap "kube-rbac-proxy" not found
Jul 23 16:16:09.517061 ip-10-0-143-166 kubenswrapper[2553]: E0723 16:16:09.516996    2553 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 23 16:16:09.517061 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:16:09.516915    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/009e126d-9220-4759-b0ef-7a5b2fd70563-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-klcmp\" (UID: \"009e126d-9220-4759-b0ef-7a5b2fd70563\") " pod="openshift-insights/insights-runtime-extractor-klcmp"
Jul 23 16:16:09.517061 ip-10-0-143-166 kubenswrapper[2553]: E0723 16:16:09.517040    2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/009e126d-9220-4759-b0ef-7a5b2fd70563-insights-runtime-extractor-tls podName:009e126d-9220-4759-b0ef-7a5b2fd70563 nodeName:}" failed. No retries permitted until 2026-07-23 16:16:10.017027578 +0000 UTC m=+51.881633685 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/009e126d-9220-4759-b0ef-7a5b2fd70563-insights-runtime-extractor-tls") pod "insights-runtime-extractor-klcmp" (UID: "009e126d-9220-4759-b0ef-7a5b2fd70563") : secret "insights-runtime-extractor-tls" not found
Jul 23 16:16:09.517159 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:16:09.517083    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l6xfl\" (UniqueName: \"kubernetes.io/projected/009e126d-9220-4759-b0ef-7a5b2fd70563-kube-api-access-l6xfl\") pod \"insights-runtime-extractor-klcmp\" (UID: \"009e126d-9220-4759-b0ef-7a5b2fd70563\") " pod="openshift-insights/insights-runtime-extractor-klcmp"
Jul 23 16:16:09.517159 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:16:09.517085    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/009e126d-9220-4759-b0ef-7a5b2fd70563-crio-socket\") pod \"insights-runtime-extractor-klcmp\" (UID: \"009e126d-9220-4759-b0ef-7a5b2fd70563\") " pod="openshift-insights/insights-runtime-extractor-klcmp"
Jul 23 16:16:09.517244 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:16:09.517193    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/009e126d-9220-4759-b0ef-7a5b2fd70563-data-volume\") pod \"insights-runtime-extractor-klcmp\" (UID: \"009e126d-9220-4759-b0ef-7a5b2fd70563\") " pod="openshift-insights/insights-runtime-extractor-klcmp"
Jul 23 16:16:09.517494 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:16:09.517478    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/009e126d-9220-4759-b0ef-7a5b2fd70563-data-volume\") pod \"insights-runtime-extractor-klcmp\" (UID: \"009e126d-9220-4759-b0ef-7a5b2fd70563\") " pod="openshift-insights/insights-runtime-extractor-klcmp"
Jul 23 16:16:09.540887 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:16:09.540860    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-22876"]
Jul 23 16:16:09.541052 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:16:09.540980    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-22876"
Jul 23 16:16:09.541281 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:16:09.541259    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l6xfl\" (UniqueName: \"kubernetes.io/projected/009e126d-9220-4759-b0ef-7a5b2fd70563-kube-api-access-l6xfl\") pod \"insights-runtime-extractor-klcmp\" (UID: \"009e126d-9220-4759-b0ef-7a5b2fd70563\") " pod="openshift-insights/insights-runtime-extractor-klcmp"
Jul 23 16:16:09.544259 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:16:09.544229    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\""
Jul 23 16:16:09.544259 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:16:09.544229    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\""
Jul 23 16:16:09.544430 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:16:09.544285    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-qm667\""
Jul 23 16:16:09.585177 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:16:09.585082    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j892l_bba31e38-01db-45a0-8b60-9fc626237e01/konnectivity-agent/0.log" limit=1024
Jul 23 16:16:09.617664 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:16:09.617623    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m625k\" (UniqueName: \"kubernetes.io/projected/1642a853-7066-4741-b260-8d7dc9fbea36-kube-api-access-m625k\") pod \"migrator-7cc9c7ffd7-22876\" (UID: \"1642a853-7066-4741-b260-8d7dc9fbea36\") " pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-22876"
Jul 23 16:16:09.718250 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:16:09.718212    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m625k\" (UniqueName: \"kubernetes.io/projected/1642a853-7066-4741-b260-8d7dc9fbea36-kube-api-access-m625k\") pod \"migrator-7cc9c7ffd7-22876\" (UID: \"1642a853-7066-4741-b260-8d7dc9fbea36\") " pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-22876"
Jul 23 16:16:09.729403 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:16:09.729379    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m625k\" (UniqueName: \"kubernetes.io/projected/1642a853-7066-4741-b260-8d7dc9fbea36-kube-api-access-m625k\") pod \"migrator-7cc9c7ffd7-22876\" (UID: \"1642a853-7066-4741-b260-8d7dc9fbea36\") " pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-22876"
Jul 23 16:16:09.854900 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:16:09.854817    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-22876"
Jul 23 16:16:09.911609 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:16:09.911577    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-7rmrn_976a7198-cfd3-43d4-8c9f-b1f248d1f6d7/console-operator/1.log"
Jul 23 16:16:09.912076 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:16:09.912022    2553 scope.go:117] "RemoveContainer" containerID="2032f18e0514bea83886d2b3479684521d175b52702d3f6c81e3c286ca0e7863"
Jul 23 16:16:09.912267 ip-10-0-143-166 kubenswrapper[2553]: E0723 16:16:09.912245    2553 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-565b7b569d-7rmrn_openshift-console-operator(976a7198-cfd3-43d4-8c9f-b1f248d1f6d7)\"" pod="openshift-console-operator/console-operator-565b7b569d-7rmrn" podUID="976a7198-cfd3-43d4-8c9f-b1f248d1f6d7"
Jul 23 16:16:10.007329 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:16:10.007296    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-22876"]
Jul 23 16:16:10.010650 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:16:10.010624    2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1642a853_7066_4741_b260_8d7dc9fbea36.slice/crio-4e123b9a5aa9c8cf32f15f94ccfc1935e61b1cfac9e255f63dafcd3632bf5b55 WatchSource:0}: Error finding container 4e123b9a5aa9c8cf32f15f94ccfc1935e61b1cfac9e255f63dafcd3632bf5b55: Status 404 returned error can't find the container with id 4e123b9a5aa9c8cf32f15f94ccfc1935e61b1cfac9e255f63dafcd3632bf5b55
Jul 23 16:16:10.021387 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:16:10.021366    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/009e126d-9220-4759-b0ef-7a5b2fd70563-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-klcmp\" (UID: \"009e126d-9220-4759-b0ef-7a5b2fd70563\") " pod="openshift-insights/insights-runtime-extractor-klcmp"
Jul 23 16:16:10.021495 ip-10-0-143-166 kubenswrapper[2553]: E0723 16:16:10.021482    2553 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 23 16:16:10.021537 ip-10-0-143-166 kubenswrapper[2553]: E0723 16:16:10.021529    2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/009e126d-9220-4759-b0ef-7a5b2fd70563-insights-runtime-extractor-tls podName:009e126d-9220-4759-b0ef-7a5b2fd70563 nodeName:}" failed. No retries permitted until 2026-07-23 16:16:11.021515716 +0000 UTC m=+52.886121822 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/009e126d-9220-4759-b0ef-7a5b2fd70563-insights-runtime-extractor-tls") pod "insights-runtime-extractor-klcmp" (UID: "009e126d-9220-4759-b0ef-7a5b2fd70563") : secret "insights-runtime-extractor-tls" not found
Jul 23 16:16:10.021579 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:16:10.021557    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/009e126d-9220-4759-b0ef-7a5b2fd70563-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-klcmp\" (UID: \"009e126d-9220-4759-b0ef-7a5b2fd70563\") " pod="openshift-insights/insights-runtime-extractor-klcmp"
Jul 23 16:16:10.021649 ip-10-0-143-166 kubenswrapper[2553]: E0723 16:16:10.021632    2553 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 23 16:16:10.021755 ip-10-0-143-166 kubenswrapper[2553]: E0723 16:16:10.021736    2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/009e126d-9220-4759-b0ef-7a5b2fd70563-kube-rbac-proxy-cm podName:009e126d-9220-4759-b0ef-7a5b2fd70563 nodeName:}" failed. No retries permitted until 2026-07-23 16:16:11.021716864 +0000 UTC m=+52.886322970 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/009e126d-9220-4759-b0ef-7a5b2fd70563-kube-rbac-proxy-cm") pod "insights-runtime-extractor-klcmp" (UID: "009e126d-9220-4759-b0ef-7a5b2fd70563") : configmap "kube-rbac-proxy" not found
Jul 23 16:16:10.425823 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:16:10.425788    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7ca02cf0-ad65-46e4-a0bd-25a470519d68-metrics-tls\") pod \"dns-default-jkc4g\" (UID: \"7ca02cf0-ad65-46e4-a0bd-25a470519d68\") " pod="openshift-dns/dns-default-jkc4g"
Jul 23 16:16:10.426007 ip-10-0-143-166 kubenswrapper[2553]: E0723 16:16:10.425957    2553 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 23 16:16:10.426046 ip-10-0-143-166 kubenswrapper[2553]: E0723 16:16:10.426034    2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7ca02cf0-ad65-46e4-a0bd-25a470519d68-metrics-tls podName:7ca02cf0-ad65-46e4-a0bd-25a470519d68 nodeName:}" failed. No retries permitted until 2026-07-23 16:16:26.426019263 +0000 UTC m=+68.290625373 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/7ca02cf0-ad65-46e4-a0bd-25a470519d68-metrics-tls") pod "dns-default-jkc4g" (UID: "7ca02cf0-ad65-46e4-a0bd-25a470519d68") : secret "dns-default-metrics-tls" not found
Jul 23 16:16:10.631912 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:16:10.631883    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-565b7b569d-7rmrn"
Jul 23 16:16:10.632070 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:16:10.631942    2553 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-565b7b569d-7rmrn"
Jul 23 16:16:10.706279 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:16:10.706209    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-qbjm4_f8e034fc-9e28-43ab-bd6e-a62848b2ac5d/dns-node-resolver/0.log"
Jul 23 16:16:10.916482 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:16:10.916446    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-22876" event={"ID":"1642a853-7066-4741-b260-8d7dc9fbea36","Type":"ContainerStarted","Data":"4e123b9a5aa9c8cf32f15f94ccfc1935e61b1cfac9e255f63dafcd3632bf5b55"}
Jul 23 16:16:10.916958 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:16:10.916832    2553 scope.go:117] "RemoveContainer" containerID="2032f18e0514bea83886d2b3479684521d175b52702d3f6c81e3c286ca0e7863"
Jul 23 16:16:10.917052 ip-10-0-143-166 kubenswrapper[2553]: E0723 16:16:10.917031    2553 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-565b7b569d-7rmrn_openshift-console-operator(976a7198-cfd3-43d4-8c9f-b1f248d1f6d7)\"" pod="openshift-console-operator/console-operator-565b7b569d-7rmrn" podUID="976a7198-cfd3-43d4-8c9f-b1f248d1f6d7"
Jul 23 16:16:11.031280 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:16:11.031187    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/009e126d-9220-4759-b0ef-7a5b2fd70563-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-klcmp\" (UID: \"009e126d-9220-4759-b0ef-7a5b2fd70563\") " pod="openshift-insights/insights-runtime-extractor-klcmp"
Jul 23 16:16:11.031436 ip-10-0-143-166 kubenswrapper[2553]: E0723 16:16:11.031293    2553 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 23 16:16:11.031436 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:16:11.031331    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/009e126d-9220-4759-b0ef-7a5b2fd70563-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-klcmp\" (UID: \"009e126d-9220-4759-b0ef-7a5b2fd70563\") " pod="openshift-insights/insights-runtime-extractor-klcmp"
Jul 23 16:16:11.031436 ip-10-0-143-166 kubenswrapper[2553]: E0723 16:16:11.031353    2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/009e126d-9220-4759-b0ef-7a5b2fd70563-insights-runtime-extractor-tls podName:009e126d-9220-4759-b0ef-7a5b2fd70563 nodeName:}" failed. No retries permitted until 2026-07-23 16:16:13.031337718 +0000 UTC m=+54.895943865 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/009e126d-9220-4759-b0ef-7a5b2fd70563-insights-runtime-extractor-tls") pod "insights-runtime-extractor-klcmp" (UID: "009e126d-9220-4759-b0ef-7a5b2fd70563") : secret "insights-runtime-extractor-tls" not found
Jul 23 16:16:11.033835 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:16:11.032250    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/009e126d-9220-4759-b0ef-7a5b2fd70563-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-klcmp\" (UID: \"009e126d-9220-4759-b0ef-7a5b2fd70563\") " pod="openshift-insights/insights-runtime-extractor-klcmp"
Jul 23 16:16:11.306520 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:16:11.306442    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-cnp2t_1af4cdcf-98b6-4aab-b234-3bed6566658b/node-ca/0.log"
Jul 23 16:16:11.938110 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:16:11.938079    2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-58598695f7-tkzpc"]
Jul 23 16:16:11.960360 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:16:11.960322    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-58598695f7-tkzpc"]
Jul 23 16:16:11.960519 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:16:11.960451    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-58598695f7-tkzpc"
Jul 23 16:16:11.963818 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:16:11.963796    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\""
Jul 23 16:16:11.963818 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:16:11.963812    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-xvvqx\""
Jul 23 16:16:11.964066 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:16:11.963793    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\""
Jul 23 16:16:11.965125 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:16:11.965105    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\""
Jul 23 16:16:11.965349 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:16:11.965184    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\""
Jul 23 16:16:12.040000 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:16:12.039972    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/5d343ac7-e47f-4b94-85b2-fd5d89dd1e69-signing-cabundle\") pod \"service-ca-58598695f7-tkzpc\" (UID: \"5d343ac7-e47f-4b94-85b2-fd5d89dd1e69\") " pod="openshift-service-ca/service-ca-58598695f7-tkzpc"
Jul 23 16:16:12.040191 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:16:12.040043    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7pgqf\" (UniqueName: \"kubernetes.io/projected/5d343ac7-e47f-4b94-85b2-fd5d89dd1e69-kube-api-access-7pgqf\") pod \"service-ca-58598695f7-tkzpc\" (UID: \"5d343ac7-e47f-4b94-85b2-fd5d89dd1e69\") " pod="openshift-service-ca/service-ca-58598695f7-tkzpc"
Jul 23 16:16:12.040191 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:16:12.040127    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/5d343ac7-e47f-4b94-85b2-fd5d89dd1e69-signing-key\") pod \"service-ca-58598695f7-tkzpc\" (UID: \"5d343ac7-e47f-4b94-85b2-fd5d89dd1e69\") " pod="openshift-service-ca/service-ca-58598695f7-tkzpc"
Jul 23 16:16:12.115758 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:16:12.115710    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-gcv6f_febad6e2-993e-4dd1-b043-33db2bdda4fe/serve-healthcheck-canary/0.log"
Jul 23 16:16:12.141268 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:16:12.141236    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/5d343ac7-e47f-4b94-85b2-fd5d89dd1e69-signing-cabundle\") pod \"service-ca-58598695f7-tkzpc\" (UID: \"5d343ac7-e47f-4b94-85b2-fd5d89dd1e69\") " pod="openshift-service-ca/service-ca-58598695f7-tkzpc"
Jul 23 16:16:12.141410 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:16:12.141387    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7pgqf\" (UniqueName: \"kubernetes.io/projected/5d343ac7-e47f-4b94-85b2-fd5d89dd1e69-kube-api-access-7pgqf\") pod \"service-ca-58598695f7-tkzpc\" (UID: \"5d343ac7-e47f-4b94-85b2-fd5d89dd1e69\") " pod="openshift-service-ca/service-ca-58598695f7-tkzpc"
Jul 23 16:16:12.141492 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:16:12.141476    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/5d343ac7-e47f-4b94-85b2-fd5d89dd1e69-signing-key\") pod \"service-ca-58598695f7-tkzpc\" (UID: \"5d343ac7-e47f-4b94-85b2-fd5d89dd1e69\") " pod="openshift-service-ca/service-ca-58598695f7-tkzpc"
Jul 23 16:16:12.142019 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:16:12.141981    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/5d343ac7-e47f-4b94-85b2-fd5d89dd1e69-signing-cabundle\") pod \"service-ca-58598695f7-tkzpc\" (UID: \"5d343ac7-e47f-4b94-85b2-fd5d89dd1e69\") " pod="openshift-service-ca/service-ca-58598695f7-tkzpc"
Jul 23 16:16:12.144104 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:16:12.144087    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/5d343ac7-e47f-4b94-85b2-fd5d89dd1e69-signing-key\") pod \"service-ca-58598695f7-tkzpc\" (UID: \"5d343ac7-e47f-4b94-85b2-fd5d89dd1e69\") " pod="openshift-service-ca/service-ca-58598695f7-tkzpc"
Jul 23 16:16:12.151781 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:16:12.151754    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7pgqf\" (UniqueName: \"kubernetes.io/projected/5d343ac7-e47f-4b94-85b2-fd5d89dd1e69-kube-api-access-7pgqf\") pod \"service-ca-58598695f7-tkzpc\" (UID: \"5d343ac7-e47f-4b94-85b2-fd5d89dd1e69\") " pod="openshift-service-ca/service-ca-58598695f7-tkzpc"
Jul 23 16:16:12.270878 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:16:12.270804    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-58598695f7-tkzpc"
Jul 23 16:16:12.667772 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:16:12.667742    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-58598695f7-tkzpc"]
Jul 23 16:16:12.671157 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:16:12.671128    2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5d343ac7_e47f_4b94_85b2_fd5d89dd1e69.slice/crio-8345ac5a11eb5c3a3965b26e07a1bd290dc98a1ce30f3bf1291cec643f5c28fd WatchSource:0}: Error finding container 8345ac5a11eb5c3a3965b26e07a1bd290dc98a1ce30f3bf1291cec643f5c28fd: Status 404 returned error can't find the container with id 8345ac5a11eb5c3a3965b26e07a1bd290dc98a1ce30f3bf1291cec643f5c28fd
Jul 23 16:16:12.924266 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:16:12.924233    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-58598695f7-tkzpc" event={"ID":"5d343ac7-e47f-4b94-85b2-fd5d89dd1e69","Type":"ContainerStarted","Data":"510881af34a9323becee2637021e5b80c0b536b78c0cefc44ce487345248cc17"}
Jul 23 16:16:12.924426 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:16:12.924281    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-58598695f7-tkzpc" event={"ID":"5d343ac7-e47f-4b94-85b2-fd5d89dd1e69","Type":"ContainerStarted","Data":"8345ac5a11eb5c3a3965b26e07a1bd290dc98a1ce30f3bf1291cec643f5c28fd"}
Jul 23 16:16:12.943050 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:16:12.943006    2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-58598695f7-tkzpc" podStartSLOduration=1.942991226 podStartE2EDuration="1.942991226s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 16:16:11 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 16:16:12.941906971 +0000 UTC m=+54.806513111" watchObservedRunningTime="2026-07-23 16:16:12.942991226 +0000 UTC m=+54.807597354"
Jul 23 16:16:13.048601 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:16:13.048573    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/009e126d-9220-4759-b0ef-7a5b2fd70563-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-klcmp\" (UID: \"009e126d-9220-4759-b0ef-7a5b2fd70563\") " pod="openshift-insights/insights-runtime-extractor-klcmp"
Jul 23 16:16:13.048734 ip-10-0-143-166 kubenswrapper[2553]: E0723 16:16:13.048717    2553 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 23 16:16:13.048783 ip-10-0-143-166 kubenswrapper[2553]: E0723 16:16:13.048775    2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/009e126d-9220-4759-b0ef-7a5b2fd70563-insights-runtime-extractor-tls podName:009e126d-9220-4759-b0ef-7a5b2fd70563 nodeName:}" failed. No retries permitted until 2026-07-23 16:16:17.048758195 +0000 UTC m=+58.913364300 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/009e126d-9220-4759-b0ef-7a5b2fd70563-insights-runtime-extractor-tls") pod "insights-runtime-extractor-klcmp" (UID: "009e126d-9220-4759-b0ef-7a5b2fd70563") : secret "insights-runtime-extractor-tls" not found
Jul 23 16:16:13.938524 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:16:13.938206    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-22876" event={"ID":"1642a853-7066-4741-b260-8d7dc9fbea36","Type":"ContainerStarted","Data":"cc98927abb8a09c470cee16284867d8c0a71d5406c9ec036bccd8e250f3b7997"}
Jul 23 16:16:13.938524 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:16:13.938270    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-22876" event={"ID":"1642a853-7066-4741-b260-8d7dc9fbea36","Type":"ContainerStarted","Data":"716f655e5491bcfc817a0d02f98c660c5d791b3490542c2b9b9a05c026a15b61"}
Jul 23 16:16:13.961551 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:16:13.961489    2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-22876" podStartSLOduration=2.039443194 podStartE2EDuration="4.961465865s" totalImagesPullingTime="2.922022671s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 16:16:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 16:16:13.9595386 +0000 UTC m=+55.824144732" watchObservedRunningTime="2026-07-23 16:16:13.961465865 +0000 UTC m=+55.826071994"
Jul 23 16:16:15.983991 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:16:15.983957    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/6abdb72f-f8eb-4ac2-b365-21769a0d3c15-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-wk2tc\" (UID: \"6abdb72f-f8eb-4ac2-b365-21769a0d3c15\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-wk2tc"
Jul 23 16:16:15.986607 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:16:15.986573    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/6abdb72f-f8eb-4ac2-b365-21769a0d3c15-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-wk2tc\" (UID: \"6abdb72f-f8eb-4ac2-b365-21769a0d3c15\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-wk2tc"
Jul 23 16:16:16.034526 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:16:16.034484    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-wk2tc"
Jul 23 16:16:16.085727 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:16:16.085687    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/0167b7d7-8b10-4847-b5ea-5dc52d892bf0-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-jrf9k\" (UID: \"0167b7d7-8b10-4847-b5ea-5dc52d892bf0\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-jrf9k"
Jul 23 16:16:16.086093 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:16:16.085749    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/552a2881-1bbe-4a5e-b5fb-d245882c2933-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-pksrr\" (UID: \"552a2881-1bbe-4a5e-b5fb-d245882c2933\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-pksrr"
Jul 23 16:16:16.086093 ip-10-0-143-166 kubenswrapper[2553]: E0723 16:16:16.085891    2553 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 23 16:16:16.086093 ip-10-0-143-166 kubenswrapper[2553]: E0723 16:16:16.085969    2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/552a2881-1bbe-4a5e-b5fb-d245882c2933-networking-console-plugin-cert podName:552a2881-1bbe-4a5e-b5fb-d245882c2933 nodeName:}" failed. No retries permitted until 2026-07-23 16:16:32.085952673 +0000 UTC m=+73.950558782 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/552a2881-1bbe-4a5e-b5fb-d245882c2933-networking-console-plugin-cert") pod "networking-console-plugin-7bc7489cb5-pksrr" (UID: "552a2881-1bbe-4a5e-b5fb-d245882c2933") : secret "networking-console-plugin-cert" not found
Jul 23 16:16:16.086335 ip-10-0-143-166 kubenswrapper[2553]: E0723 16:16:16.086243    2553 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 23 16:16:16.086335 ip-10-0-143-166 kubenswrapper[2553]: E0723 16:16:16.086332    2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0167b7d7-8b10-4847-b5ea-5dc52d892bf0-cluster-monitoring-operator-tls podName:0167b7d7-8b10-4847-b5ea-5dc52d892bf0 nodeName:}" failed. No retries permitted until 2026-07-23 16:16:32.086288856 +0000 UTC m=+73.950894972 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/0167b7d7-8b10-4847-b5ea-5dc52d892bf0-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-76cf8966f8-jrf9k" (UID: "0167b7d7-8b10-4847-b5ea-5dc52d892bf0") : secret "cluster-monitoring-operator-tls" not found
Jul 23 16:16:16.163843 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:16:16.163761    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-wk2tc"]
Jul 23 16:16:16.186361 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:16:16.186327    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b145abca-07cb-4345-9efc-2c03f950ac14-service-ca-bundle\") pod \"router-default-599b8db76d-sn7k4\" (UID: \"b145abca-07cb-4345-9efc-2c03f950ac14\") " pod="openshift-ingress/router-default-599b8db76d-sn7k4"
Jul 23 16:16:16.186507 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:16:16.186458    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b145abca-07cb-4345-9efc-2c03f950ac14-metrics-certs\") pod \"router-default-599b8db76d-sn7k4\" (UID: \"b145abca-07cb-4345-9efc-2c03f950ac14\") " pod="openshift-ingress/router-default-599b8db76d-sn7k4"
Jul 23 16:16:16.186572 ip-10-0-143-166 kubenswrapper[2553]: E0723 16:16:16.186508    2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/b145abca-07cb-4345-9efc-2c03f950ac14-service-ca-bundle podName:b145abca-07cb-4345-9efc-2c03f950ac14 nodeName:}" failed. No retries permitted until 2026-07-23 16:16:32.186486859 +0000 UTC m=+74.051092971 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/b145abca-07cb-4345-9efc-2c03f950ac14-service-ca-bundle") pod "router-default-599b8db76d-sn7k4" (UID: "b145abca-07cb-4345-9efc-2c03f950ac14") : configmap references non-existent config key: service-ca.crt
Jul 23 16:16:16.186636 ip-10-0-143-166 kubenswrapper[2553]: E0723 16:16:16.186585    2553 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 23 16:16:16.186692 ip-10-0-143-166 kubenswrapper[2553]: E0723 16:16:16.186640    2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b145abca-07cb-4345-9efc-2c03f950ac14-metrics-certs podName:b145abca-07cb-4345-9efc-2c03f950ac14 nodeName:}" failed. No retries permitted until 2026-07-23 16:16:32.186620905 +0000 UTC m=+74.051227032 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b145abca-07cb-4345-9efc-2c03f950ac14-metrics-certs") pod "router-default-599b8db76d-sn7k4" (UID: "b145abca-07cb-4345-9efc-2c03f950ac14") : secret "router-metrics-certs-default" not found
Jul 23 16:16:16.950295 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:16:16.950256    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-wk2tc" event={"ID":"6abdb72f-f8eb-4ac2-b365-21769a0d3c15","Type":"ContainerStarted","Data":"6c09ded31778b0a31f11bd28660ea8d790f7a2f0378b5f7529ca6d690391256f"}
Jul 23 16:16:17.093779 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:16:17.093736    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/009e126d-9220-4759-b0ef-7a5b2fd70563-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-klcmp\" (UID: \"009e126d-9220-4759-b0ef-7a5b2fd70563\") " pod="openshift-insights/insights-runtime-extractor-klcmp"
Jul 23 16:16:17.094275 ip-10-0-143-166 kubenswrapper[2553]: E0723 16:16:17.093920    2553 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 23 16:16:17.094275 ip-10-0-143-166 kubenswrapper[2553]: E0723 16:16:17.094004    2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/009e126d-9220-4759-b0ef-7a5b2fd70563-insights-runtime-extractor-tls podName:009e126d-9220-4759-b0ef-7a5b2fd70563 nodeName:}" failed. No retries permitted until 2026-07-23 16:16:25.093983946 +0000 UTC m=+66.958590070 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/009e126d-9220-4759-b0ef-7a5b2fd70563-insights-runtime-extractor-tls") pod "insights-runtime-extractor-klcmp" (UID: "009e126d-9220-4759-b0ef-7a5b2fd70563") : secret "insights-runtime-extractor-tls" not found
Jul 23 16:16:18.819321 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:16:18.819288    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-c9g74"
Jul 23 16:16:19.962661 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:16:19.962623    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-wk2tc" event={"ID":"6abdb72f-f8eb-4ac2-b365-21769a0d3c15","Type":"ContainerStarted","Data":"1d1e4c2efa8ad2f62d120a600784156bc8fc79ff2d252e1b0d004a0e27a6f39e"}
Jul 23 16:16:19.963062 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:16:19.962685    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-wk2tc" event={"ID":"6abdb72f-f8eb-4ac2-b365-21769a0d3c15","Type":"ContainerStarted","Data":"6ec1d298c3aa6e8a070b5e45d1a9769598ec89ca43d682e7e8dfbaf890c5e4d8"}
Jul 23 16:16:19.981277 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:16:19.981223    2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-wk2tc" podStartSLOduration=16.84680524 podStartE2EDuration="19.981205914s" totalImagesPullingTime="3.134400674s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 16:16:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 16:16:19.979450639 +0000 UTC m=+61.844056768" watchObservedRunningTime="2026-07-23 16:16:19.981205914 +0000 UTC m=+61.845812042"
Jul 23 16:16:21.669555 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:16:21.669522    2553 scope.go:117] "RemoveContainer" containerID="2032f18e0514bea83886d2b3479684521d175b52702d3f6c81e3c286ca0e7863"
Jul 23 16:16:21.971432 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:16:21.971353    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-7rmrn_976a7198-cfd3-43d4-8c9f-b1f248d1f6d7/console-operator/1.log"
Jul 23 16:16:21.971573 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:16:21.971446    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-565b7b569d-7rmrn" event={"ID":"976a7198-cfd3-43d4-8c9f-b1f248d1f6d7","Type":"ContainerStarted","Data":"4b87c2dd9e1877e157728ab173842ee78598b99562f158480f105af652c33378"}
Jul 23 16:16:21.971742 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:16:21.971706    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-565b7b569d-7rmrn"
Jul 23 16:16:21.988963 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:16:21.988905    2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-565b7b569d-7rmrn" podStartSLOduration=15.383653132 podStartE2EDuration="21.988888265s" totalImagesPullingTime="6.605235133s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 16:16:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 16:16:21.987837608 +0000 UTC m=+63.852443737" watchObservedRunningTime="2026-07-23 16:16:21.988888265 +0000 UTC m=+63.853494392"
Jul 23 16:16:22.379265 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:16:22.379187    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-565b7b569d-7rmrn"
Jul 23 16:16:24.263412 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:16:24.263374    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0ce6ab38-81a0-43b1-865b-42c65798de75-metrics-certs\") pod \"network-metrics-daemon-bkpz9\" (UID: \"0ce6ab38-81a0-43b1-865b-42c65798de75\") " pod="openshift-multus/network-metrics-daemon-bkpz9"
Jul 23 16:16:24.266139 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:16:24.266115    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 23 16:16:24.276625 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:16:24.276599    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0ce6ab38-81a0-43b1-865b-42c65798de75-metrics-certs\") pod \"network-metrics-daemon-bkpz9\" (UID: \"0ce6ab38-81a0-43b1-865b-42c65798de75\") " pod="openshift-multus/network-metrics-daemon-bkpz9"
Jul 23 16:16:24.295559 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:16:24.295526    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-cwhlx\""
Jul 23 16:16:24.303753 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:16:24.303726    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bkpz9"
Jul 23 16:16:24.364401 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:16:24.364351    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c0d761bc-9c6e-4617-a75d-1811fc235f16-original-pull-secret\") pod \"global-pull-secret-syncer-lqmct\" (UID: \"c0d761bc-9c6e-4617-a75d-1811fc235f16\") " pod="kube-system/global-pull-secret-syncer-lqmct"
Jul 23 16:16:24.367373 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:16:24.367341    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 23 16:16:24.377086 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:16:24.377045    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c0d761bc-9c6e-4617-a75d-1811fc235f16-original-pull-secret\") pod \"global-pull-secret-syncer-lqmct\" (UID: \"c0d761bc-9c6e-4617-a75d-1811fc235f16\") " pod="kube-system/global-pull-secret-syncer-lqmct"
Jul 23 16:16:24.428981 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:16:24.428952    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-bkpz9"]
Jul 23 16:16:24.432110 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:16:24.432083    2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0ce6ab38_81a0_43b1_865b_42c65798de75.slice/crio-fee700df58e6ebd2e5d881cb9c0ad2e5defb16c6e62afafcc58aadc1b1dceb1b WatchSource:0}: Error finding container fee700df58e6ebd2e5d881cb9c0ad2e5defb16c6e62afafcc58aadc1b1dceb1b: Status 404 returned error can't find the container with id fee700df58e6ebd2e5d881cb9c0ad2e5defb16c6e62afafcc58aadc1b1dceb1b
Jul 23 16:16:24.465688 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:16:24.465591    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wkd4x\" (UniqueName: \"kubernetes.io/projected/633a475b-ddec-4391-856d-67674aa0ef0c-kube-api-access-wkd4x\") pod \"network-check-target-8vt69\" (UID: \"633a475b-ddec-4391-856d-67674aa0ef0c\") " pod="openshift-network-diagnostics/network-check-target-8vt69"
Jul 23 16:16:24.467996 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:16:24.467975    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wkd4x\" (UniqueName: \"kubernetes.io/projected/633a475b-ddec-4391-856d-67674aa0ef0c-kube-api-access-wkd4x\") pod \"network-check-target-8vt69\" (UID: \"633a475b-ddec-4391-856d-67674aa0ef0c\") " pod="openshift-network-diagnostics/network-check-target-8vt69"
Jul 23 16:16:24.583068 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:16:24.582986    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-4khjt\""
Jul 23 16:16:24.588227 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:16:24.588203    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lqmct"
Jul 23 16:16:24.590920 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:16:24.590891    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8vt69"
Jul 23 16:16:24.735236 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:16:24.735154    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-lqmct"]
Jul 23 16:16:24.737881 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:16:24.737851    2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc0d761bc_9c6e_4617_a75d_1811fc235f16.slice/crio-25547b60138bcac11c75aa42e86f568de59e530b98e7bf42c471b27dd518abef WatchSource:0}: Error finding container 25547b60138bcac11c75aa42e86f568de59e530b98e7bf42c471b27dd518abef: Status 404 returned error can't find the container with id 25547b60138bcac11c75aa42e86f568de59e530b98e7bf42c471b27dd518abef
Jul 23 16:16:24.753279 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:16:24.753253    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-8vt69"]
Jul 23 16:16:24.755679 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:16:24.755656    2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod633a475b_ddec_4391_856d_67674aa0ef0c.slice/crio-3aad93bd5ae5cf7f9b66a243ad5cba678f7b20dfcb3b92dc154cbcf92ed1055f WatchSource:0}: Error finding container 3aad93bd5ae5cf7f9b66a243ad5cba678f7b20dfcb3b92dc154cbcf92ed1055f: Status 404 returned error can't find the container with id 3aad93bd5ae5cf7f9b66a243ad5cba678f7b20dfcb3b92dc154cbcf92ed1055f
Jul 23 16:16:24.986351 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:16:24.986311    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-8vt69" event={"ID":"633a475b-ddec-4391-856d-67674aa0ef0c","Type":"ContainerStarted","Data":"db2b46af451b19006f66d794be249a3cee1712c2fc8890fdb1fef6a01efd1d7a"}
Jul 23 16:16:24.986522 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:16:24.986479    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-8vt69"
Jul 23 16:16:24.986605 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:16:24.986520    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-8vt69" event={"ID":"633a475b-ddec-4391-856d-67674aa0ef0c","Type":"ContainerStarted","Data":"3aad93bd5ae5cf7f9b66a243ad5cba678f7b20dfcb3b92dc154cbcf92ed1055f"}
Jul 23 16:16:24.987441 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:16:24.987412    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-lqmct" event={"ID":"c0d761bc-9c6e-4617-a75d-1811fc235f16","Type":"ContainerStarted","Data":"25547b60138bcac11c75aa42e86f568de59e530b98e7bf42c471b27dd518abef"}
Jul 23 16:16:24.988488 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:16:24.988466    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-bkpz9" event={"ID":"0ce6ab38-81a0-43b1-865b-42c65798de75","Type":"ContainerStarted","Data":"fee700df58e6ebd2e5d881cb9c0ad2e5defb16c6e62afafcc58aadc1b1dceb1b"}
Jul 23 16:16:25.003488 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:16:25.003441    2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-8vt69" podStartSLOduration=66.003427131 podStartE2EDuration="1m6.003427131s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 16:15:19 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 16:16:25.002952329 +0000 UTC m=+66.867558459" watchObservedRunningTime="2026-07-23 16:16:25.003427131 +0000 UTC m=+66.868033258"
Jul 23 16:16:25.172038 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:16:25.171979    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/009e126d-9220-4759-b0ef-7a5b2fd70563-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-klcmp\" (UID: \"009e126d-9220-4759-b0ef-7a5b2fd70563\") " pod="openshift-insights/insights-runtime-extractor-klcmp"
Jul 23 16:16:25.174258 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:16:25.174229    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/009e126d-9220-4759-b0ef-7a5b2fd70563-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-klcmp\" (UID: \"009e126d-9220-4759-b0ef-7a5b2fd70563\") " pod="openshift-insights/insights-runtime-extractor-klcmp"
Jul 23 16:16:25.256878 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:16:25.256805    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-tj2lp\""
Jul 23 16:16:25.265233 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:16:25.265205    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-klcmp"
Jul 23 16:16:25.393935 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:16:25.393652    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-klcmp"]
Jul 23 16:16:25.396454 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:16:25.396428    2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod009e126d_9220_4759_b0ef_7a5b2fd70563.slice/crio-d3d309a933ec7fe6fd74e8a6ce92d1567debc9279de70220418ea2ff9a577061 WatchSource:0}: Error finding container d3d309a933ec7fe6fd74e8a6ce92d1567debc9279de70220418ea2ff9a577061: Status 404 returned error can't find the container with id d3d309a933ec7fe6fd74e8a6ce92d1567debc9279de70220418ea2ff9a577061
Jul 23 16:16:25.474969 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:16:25.474929    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/267f079f-9842-415b-858e-c591c6a73a64-registry-tls\") pod \"image-registry-6868994b56-jpcfj\" (UID: \"267f079f-9842-415b-858e-c591c6a73a64\") " pod="openshift-image-registry/image-registry-6868994b56-jpcfj"
Jul 23 16:16:25.477339 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:16:25.477314    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/267f079f-9842-415b-858e-c591c6a73a64-registry-tls\") pod \"image-registry-6868994b56-jpcfj\" (UID: \"267f079f-9842-415b-858e-c591c6a73a64\") " pod="openshift-image-registry/image-registry-6868994b56-jpcfj"
Jul 23 16:16:25.628227 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:16:25.628138    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-cvkcr\""
Jul 23 16:16:25.636514 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:16:25.636492    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6868994b56-jpcfj"
Jul 23 16:16:25.784864 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:16:25.784832    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-6868994b56-jpcfj"]
Jul 23 16:16:25.788701 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:16:25.788660    2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod267f079f_9842_415b_858e_c591c6a73a64.slice/crio-445f818feea886190f75f946823f905de804bb0264957b1df5ad2146981c43af WatchSource:0}: Error finding container 445f818feea886190f75f946823f905de804bb0264957b1df5ad2146981c43af: Status 404 returned error can't find the container with id 445f818feea886190f75f946823f905de804bb0264957b1df5ad2146981c43af
Jul 23 16:16:25.994378 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:16:25.994192    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6868994b56-jpcfj" event={"ID":"267f079f-9842-415b-858e-c591c6a73a64","Type":"ContainerStarted","Data":"de9ea6844c30e47c936cb2486bd2505c233486c4d9a963cf7d2f5fef9e3c3170"}
Jul 23 16:16:25.994378 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:16:25.994257    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6868994b56-jpcfj" event={"ID":"267f079f-9842-415b-858e-c591c6a73a64","Type":"ContainerStarted","Data":"445f818feea886190f75f946823f905de804bb0264957b1df5ad2146981c43af"}
Jul 23 16:16:25.994378 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:16:25.994347    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-6868994b56-jpcfj"
Jul 23 16:16:25.995706 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:16:25.995673    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-klcmp" event={"ID":"009e126d-9220-4759-b0ef-7a5b2fd70563","Type":"ContainerStarted","Data":"d3d309a933ec7fe6fd74e8a6ce92d1567debc9279de70220418ea2ff9a577061"}
Jul 23 16:16:26.019563 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:16:26.019507    2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-6868994b56-jpcfj" podStartSLOduration=67.019485853 podStartE2EDuration="1m7.019485853s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 16:15:19 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 16:16:26.018389598 +0000 UTC m=+67.882995727" watchObservedRunningTime="2026-07-23 16:16:26.019485853 +0000 UTC m=+67.884091982"
Jul 23 16:16:26.483393 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:16:26.483352    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7ca02cf0-ad65-46e4-a0bd-25a470519d68-metrics-tls\") pod \"dns-default-jkc4g\" (UID: \"7ca02cf0-ad65-46e4-a0bd-25a470519d68\") " pod="openshift-dns/dns-default-jkc4g"
Jul 23 16:16:26.486129 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:16:26.486072    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7ca02cf0-ad65-46e4-a0bd-25a470519d68-metrics-tls\") pod \"dns-default-jkc4g\" (UID: \"7ca02cf0-ad65-46e4-a0bd-25a470519d68\") " pod="openshift-dns/dns-default-jkc4g"
Jul 23 16:16:26.560605 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:16:26.560528    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-khnm5\""
Jul 23 16:16:26.567953 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:16:26.567925    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-jkc4g"
Jul 23 16:16:26.752460 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:16:26.752323    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-jkc4g"]
Jul 23 16:16:26.756667 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:16:26.756635    2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7ca02cf0_ad65_46e4_a0bd_25a470519d68.slice/crio-6ff8543bb5c4f65c624f7f1d691a6a276c09fcc3edb967a8370e4743d3e31b9a WatchSource:0}: Error finding container 6ff8543bb5c4f65c624f7f1d691a6a276c09fcc3edb967a8370e4743d3e31b9a: Status 404 returned error can't find the container with id 6ff8543bb5c4f65c624f7f1d691a6a276c09fcc3edb967a8370e4743d3e31b9a
Jul 23 16:16:27.003057 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:16:27.002986    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-jkc4g" event={"ID":"7ca02cf0-ad65-46e4-a0bd-25a470519d68","Type":"ContainerStarted","Data":"6ff8543bb5c4f65c624f7f1d691a6a276c09fcc3edb967a8370e4743d3e31b9a"}
Jul 23 16:16:27.006340 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:16:27.006017    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-bkpz9" event={"ID":"0ce6ab38-81a0-43b1-865b-42c65798de75","Type":"ContainerStarted","Data":"0032fc3ee4ce19d1391f6d007ce393b36c7011bccca470d6921e3df26be23eac"}
Jul 23 16:16:27.006340 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:16:27.006075    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-bkpz9" event={"ID":"0ce6ab38-81a0-43b1-865b-42c65798de75","Type":"ContainerStarted","Data":"08d01c1b1c9127e6642fb43f227c8c12724f582110eee79d442ed96b1bab4422"}
Jul 23 16:16:27.024373 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:16:27.024314    2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-bkpz9" podStartSLOduration=66.264387287 podStartE2EDuration="1m8.024293339s" totalImagesPullingTime="1.759906052s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 16:15:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 16:16:27.022828116 +0000 UTC m=+68.887434247" watchObservedRunningTime="2026-07-23 16:16:27.024293339 +0000 UTC m=+68.888899469"
Jul 23 16:16:30.452861 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:16:30.452827    2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-5bc67dcd46-h75zq"]
Jul 23 16:16:30.476361 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:16:30.476324    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-5bc67dcd46-h75zq"]
Jul 23 16:16:30.476530 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:16:30.476429    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-5bc67dcd46-h75zq"
Jul 23 16:16:30.479851 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:16:30.479813    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Jul 23 16:16:30.480596 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:16:30.480569    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Jul 23 16:16:30.481389 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:16:30.481368    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-snp5p\""
Jul 23 16:16:30.625129 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:16:30.625099    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tp2lr\" (UniqueName: \"kubernetes.io/projected/30db792c-cf16-411f-be26-7f278a96af89-kube-api-access-tp2lr\") pod \"downloads-5bc67dcd46-h75zq\" (UID: \"30db792c-cf16-411f-be26-7f278a96af89\") " pod="openshift-console/downloads-5bc67dcd46-h75zq"
Jul 23 16:16:30.725739 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:16:30.725660    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tp2lr\" (UniqueName: \"kubernetes.io/projected/30db792c-cf16-411f-be26-7f278a96af89-kube-api-access-tp2lr\") pod \"downloads-5bc67dcd46-h75zq\" (UID: \"30db792c-cf16-411f-be26-7f278a96af89\") " pod="openshift-console/downloads-5bc67dcd46-h75zq"
Jul 23 16:16:30.738415 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:16:30.738369    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tp2lr\" (UniqueName: \"kubernetes.io/projected/30db792c-cf16-411f-be26-7f278a96af89-kube-api-access-tp2lr\") pod \"downloads-5bc67dcd46-h75zq\" (UID: \"30db792c-cf16-411f-be26-7f278a96af89\") " pod="openshift-console/downloads-5bc67dcd46-h75zq"
Jul 23 16:16:30.788529 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:16:30.788486    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-5bc67dcd46-h75zq"
Jul 23 16:16:32.139824 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:16:32.139784    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/0167b7d7-8b10-4847-b5ea-5dc52d892bf0-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-jrf9k\" (UID: \"0167b7d7-8b10-4847-b5ea-5dc52d892bf0\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-jrf9k"
Jul 23 16:16:32.140389 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:16:32.139839    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/552a2881-1bbe-4a5e-b5fb-d245882c2933-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-pksrr\" (UID: \"552a2881-1bbe-4a5e-b5fb-d245882c2933\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-pksrr"
Jul 23 16:16:32.142536 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:16:32.142503    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/552a2881-1bbe-4a5e-b5fb-d245882c2933-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-pksrr\" (UID: \"552a2881-1bbe-4a5e-b5fb-d245882c2933\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-pksrr"
Jul 23 16:16:32.142952 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:16:32.142932    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/0167b7d7-8b10-4847-b5ea-5dc52d892bf0-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-jrf9k\" (UID: \"0167b7d7-8b10-4847-b5ea-5dc52d892bf0\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-jrf9k"
Jul 23 16:16:32.240765 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:16:32.240725    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b145abca-07cb-4345-9efc-2c03f950ac14-service-ca-bundle\") pod \"router-default-599b8db76d-sn7k4\" (UID: \"b145abca-07cb-4345-9efc-2c03f950ac14\") " pod="openshift-ingress/router-default-599b8db76d-sn7k4"
Jul 23 16:16:32.240943 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:16:32.240786    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b145abca-07cb-4345-9efc-2c03f950ac14-metrics-certs\") pod \"router-default-599b8db76d-sn7k4\" (UID: \"b145abca-07cb-4345-9efc-2c03f950ac14\") " pod="openshift-ingress/router-default-599b8db76d-sn7k4"
Jul 23 16:16:32.241636 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:16:32.241604    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b145abca-07cb-4345-9efc-2c03f950ac14-service-ca-bundle\") pod \"router-default-599b8db76d-sn7k4\" (UID: \"b145abca-07cb-4345-9efc-2c03f950ac14\") " pod="openshift-ingress/router-default-599b8db76d-sn7k4"
Jul 23 16:16:32.243427 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:16:32.243399    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b145abca-07cb-4345-9efc-2c03f950ac14-metrics-certs\") pod \"router-default-599b8db76d-sn7k4\" (UID: \"b145abca-07cb-4345-9efc-2c03f950ac14\") " pod="openshift-ingress/router-default-599b8db76d-sn7k4"
Jul 23 16:16:32.279903 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:16:32.279871    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-snv5g\""
Jul 23 16:16:32.288216 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:16:32.288188    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-jrf9k"
Jul 23 16:16:32.348655 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:16:32.348623    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-wgfkd\""
Jul 23 16:16:32.355873 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:16:32.355848    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-7bc7489cb5-pksrr"
Jul 23 16:16:32.360606 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:16:32.360588    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-r75cm\""
Jul 23 16:16:32.368433 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:16:32.368411    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-599b8db76d-sn7k4"
Jul 23 16:16:33.431214 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:16:33.431186    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-5bc67dcd46-h75zq"]
Jul 23 16:16:33.435156 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:16:33.435115    2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod30db792c_cf16_411f_be26_7f278a96af89.slice/crio-a60c06473097440b638af4a4588ca6bee850053a740179a122abd06e21ea3d3c WatchSource:0}: Error finding container a60c06473097440b638af4a4588ca6bee850053a740179a122abd06e21ea3d3c: Status 404 returned error can't find the container with id a60c06473097440b638af4a4588ca6bee850053a740179a122abd06e21ea3d3c
Jul 23 16:16:33.444549 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:16:33.444474    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-7bc7489cb5-pksrr"]
Jul 23 16:16:33.449776 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:16:33.449709    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-599b8db76d-sn7k4"]
Jul 23 16:16:33.452139 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:16:33.452099    2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod552a2881_1bbe_4a5e_b5fb_d245882c2933.slice/crio-0ea113f1069f086f7a2f4ae3305f1825fb2dfc34f0e39a9ae67616969a8917a4 WatchSource:0}: Error finding container 0ea113f1069f086f7a2f4ae3305f1825fb2dfc34f0e39a9ae67616969a8917a4: Status 404 returned error can't find the container with id 0ea113f1069f086f7a2f4ae3305f1825fb2dfc34f0e39a9ae67616969a8917a4
Jul 23 16:16:33.452500 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:16:33.452476    2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb145abca_07cb_4345_9efc_2c03f950ac14.slice/crio-ce0b42a9f316b16f22134f0c2e3da751d95adb918a9c03f79ad7717485cc3421 WatchSource:0}: Error finding container ce0b42a9f316b16f22134f0c2e3da751d95adb918a9c03f79ad7717485cc3421: Status 404 returned error can't find the container with id ce0b42a9f316b16f22134f0c2e3da751d95adb918a9c03f79ad7717485cc3421
Jul 23 16:16:33.489231 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:16:33.489203    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-76cf8966f8-jrf9k"]
Jul 23 16:16:34.035372 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:16:34.035333    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-lqmct" event={"ID":"c0d761bc-9c6e-4617-a75d-1811fc235f16","Type":"ContainerStarted","Data":"5906ca1357ff6c8a763d0ddd9a2e95cc9ca793ed8312e0508aaf9bd608d925d3"}
Jul 23 16:16:34.037004 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:16:34.036972    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-jrf9k" event={"ID":"0167b7d7-8b10-4847-b5ea-5dc52d892bf0","Type":"ContainerStarted","Data":"3fa5d3cb01c7db1ee850078b95636dde907a55aa3583c245b7a4cd35e0f36f07"}
Jul 23 16:16:34.039022 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:16:34.038986    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-klcmp" event={"ID":"009e126d-9220-4759-b0ef-7a5b2fd70563","Type":"ContainerStarted","Data":"9f1dcd6b17a855ee677b2a9e7d79f289b670cac3835d84f71c791eabfe02e711"}
Jul 23 16:16:34.040343 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:16:34.040314    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-5bc67dcd46-h75zq" event={"ID":"30db792c-cf16-411f-be26-7f278a96af89","Type":"ContainerStarted","Data":"a60c06473097440b638af4a4588ca6bee850053a740179a122abd06e21ea3d3c"}
Jul 23 16:16:34.042634 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:16:34.042337    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-599b8db76d-sn7k4" event={"ID":"b145abca-07cb-4345-9efc-2c03f950ac14","Type":"ContainerStarted","Data":"0e2c36cda840789ef6e290f3b2fa407bc7a1952dc22c36f025d83816378b6dc3"}
Jul 23 16:16:34.042634 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:16:34.042380    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-599b8db76d-sn7k4" event={"ID":"b145abca-07cb-4345-9efc-2c03f950ac14","Type":"ContainerStarted","Data":"ce0b42a9f316b16f22134f0c2e3da751d95adb918a9c03f79ad7717485cc3421"}
Jul 23 16:16:34.043973 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:16:34.043950    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-7bc7489cb5-pksrr" event={"ID":"552a2881-1bbe-4a5e-b5fb-d245882c2933","Type":"ContainerStarted","Data":"0ea113f1069f086f7a2f4ae3305f1825fb2dfc34f0e39a9ae67616969a8917a4"}
Jul 23 16:16:34.046092 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:16:34.046027    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-jkc4g" event={"ID":"7ca02cf0-ad65-46e4-a0bd-25a470519d68","Type":"ContainerStarted","Data":"bb7c20a8804e2ad57f2e15862f983a849ec8047c78b657a41837be55e76076e0"}
Jul 23 16:16:34.046092 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:16:34.046074    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-jkc4g" event={"ID":"7ca02cf0-ad65-46e4-a0bd-25a470519d68","Type":"ContainerStarted","Data":"b29857a5ec2c4f27ec0758fd200e99ee6e72440968df12d9860fff1b84f64f6d"}
Jul 23 16:16:34.046245 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:16:34.046190    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-jkc4g"
Jul 23 16:16:34.053438 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:16:34.053391    2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-lqmct" podStartSLOduration=66.5652193 podStartE2EDuration="1m15.053375272s" totalImagesPullingTime="8.488155972s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 16:15:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 16:16:34.052138622 +0000 UTC m=+75.916744751" watchObservedRunningTime="2026-07-23 16:16:34.053375272 +0000 UTC m=+75.917981399"
Jul 23 16:16:34.072760 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:16:34.072706    2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-jkc4g" podStartSLOduration=34.611053233 podStartE2EDuration="41.072685887s" totalImagesPullingTime="6.461632654s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 16:15:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 16:16:34.070908948 +0000 UTC m=+75.935515091" watchObservedRunningTime="2026-07-23 16:16:34.072685887 +0000 UTC m=+75.937292016"
Jul 23 16:16:34.091158 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:16:34.091093    2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-599b8db76d-sn7k4" podStartSLOduration=34.091073419 podStartE2EDuration="34.091073419s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 16:16:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 16:16:34.090430822 +0000 UTC m=+75.955036951" watchObservedRunningTime="2026-07-23 16:16:34.091073419 +0000 UTC m=+75.955679548"
Jul 23 16:16:34.369350 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:16:34.369274    2553 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-599b8db76d-sn7k4"
Jul 23 16:16:34.372102 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:16:34.372067    2553 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-599b8db76d-sn7k4"
Jul 23 16:16:35.052269 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:16:35.052221    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-599b8db76d-sn7k4"
Jul 23 16:16:35.054120 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:16:35.054096    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-599b8db76d-sn7k4"
Jul 23 16:16:40.076712 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:16:40.076670    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-klcmp" event={"ID":"009e126d-9220-4759-b0ef-7a5b2fd70563","Type":"ContainerStarted","Data":"79cd9ac7da7e0e9f118a8cf79642ce4207a90e39d7dcba80abc302bd93d68344"}
Jul 23 16:16:40.078343 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:16:40.078310    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-7bc7489cb5-pksrr" event={"ID":"552a2881-1bbe-4a5e-b5fb-d245882c2933","Type":"ContainerStarted","Data":"49b8e5da00372b40775e6b8049cb2e4aa9123325acb1f5eccee58aa4dd87e7db"}
Jul 23 16:16:40.080086 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:16:40.080062    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-jrf9k" event={"ID":"0167b7d7-8b10-4847-b5ea-5dc52d892bf0","Type":"ContainerStarted","Data":"f5e5217e8e375ab52ab9c847a7a8eac14637925d1cefabb28b5cbfd9c871f8b2"}
Jul 23 16:16:40.093416 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:16:40.093360    2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-7bc7489cb5-pksrr" podStartSLOduration=34.360025247 podStartE2EDuration="40.09334324s" totalImagesPullingTime="5.733317993s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 16:16:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 16:16:40.092972014 +0000 UTC m=+81.957578143" watchObservedRunningTime="2026-07-23 16:16:40.09334324 +0000 UTC m=+81.957949365"
Jul 23 16:16:40.110450 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:16:40.110395    2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-jrf9k" podStartSLOduration=34.421964362 podStartE2EDuration="40.110374787s" totalImagesPullingTime="5.688410425s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 16:16:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 16:16:40.108542216 +0000 UTC m=+81.973148375" watchObservedRunningTime="2026-07-23 16:16:40.110374787 +0000 UTC m=+81.974980915"
Jul 23 16:16:44.054343 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:16:44.054250    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-jkc4g"
Jul 23 16:16:44.101616 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:16:44.101321    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-klcmp" event={"ID":"009e126d-9220-4759-b0ef-7a5b2fd70563","Type":"ContainerStarted","Data":"ad7ed4ce48352815bf6b7b6fdfa6b45aa935ef6a48a7746fcede8f2902ece895"}
Jul 23 16:16:44.133219 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:16:44.133140    2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-klcmp" podStartSLOduration=17.100045569 podStartE2EDuration="35.133120715s" totalImagesPullingTime="18.033075146s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 16:16:09 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 16:16:44.131913378 +0000 UTC m=+85.996519531" watchObservedRunningTime="2026-07-23 16:16:44.133120715 +0000 UTC m=+85.997726845"
Jul 23 16:16:45.642016 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:16:45.641961    2553 patch_prober.go:28] interesting pod/image-registry-6868994b56-jpcfj container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Jul 23 16:16:45.642450 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:16:45.642017    2553 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-6868994b56-jpcfj" podUID="267f079f-9842-415b-858e-c591c6a73a64" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 23 16:16:47.011694 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:16:47.011663    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-6868994b56-jpcfj"
Jul 23 16:16:52.142925 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:16:52.142880    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-5bc67dcd46-h75zq" event={"ID":"30db792c-cf16-411f-be26-7f278a96af89","Type":"ContainerStarted","Data":"00715dc567533c4d50def0f383d2e17d3346d6f3bdb21afd33c34d0f5ed4c753"}
Jul 23 16:16:52.143466 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:16:52.143100    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-5bc67dcd46-h75zq"
Jul 23 16:16:52.157676 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:16:52.157645    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-5bc67dcd46-h75zq"
Jul 23 16:16:52.164303 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:16:52.164255    2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-5bc67dcd46-h75zq" podStartSLOduration=4.100570395 podStartE2EDuration="22.164240929s" totalImagesPullingTime="18.063670534s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 16:16:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 16:16:52.162637986 +0000 UTC m=+94.027244111" watchObservedRunningTime="2026-07-23 16:16:52.164240929 +0000 UTC m=+94.028847057"
Jul 23 16:16:54.178947 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:16:54.178906    2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-shbmd"]
Jul 23 16:16:54.210005 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:16:54.209964    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-shbmd"
Jul 23 16:16:54.213552 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:16:54.213522    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 23 16:16:54.213879 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:16:54.213861    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 23 16:16:54.214137 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:16:54.214114    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 23 16:16:54.214512 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:16:54.214487    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-hdrgq\""
Jul 23 16:16:54.214947 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:16:54.214932    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 23 16:16:54.233901 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:16:54.233874    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6dbae327-9634-451e-8554-dbd52547928a-metrics-client-ca\") pod \"node-exporter-shbmd\" (UID: \"6dbae327-9634-451e-8554-dbd52547928a\") " pod="openshift-monitoring/node-exporter-shbmd"
Jul 23 16:16:54.234126 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:16:54.234111    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kh9zc\" (UniqueName: \"kubernetes.io/projected/6dbae327-9634-451e-8554-dbd52547928a-kube-api-access-kh9zc\") pod \"node-exporter-shbmd\" (UID: \"6dbae327-9634-451e-8554-dbd52547928a\") " pod="openshift-monitoring/node-exporter-shbmd"
Jul 23 16:16:54.234261 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:16:54.234245    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/6dbae327-9634-451e-8554-dbd52547928a-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-shbmd\" (UID: \"6dbae327-9634-451e-8554-dbd52547928a\") " pod="openshift-monitoring/node-exporter-shbmd"
Jul 23 16:16:54.234363 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:16:54.234351    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/6dbae327-9634-451e-8554-dbd52547928a-node-exporter-wtmp\") pod \"node-exporter-shbmd\" (UID: \"6dbae327-9634-451e-8554-dbd52547928a\") " pod="openshift-monitoring/node-exporter-shbmd"
Jul 23 16:16:54.234469 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:16:54.234457    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6dbae327-9634-451e-8554-dbd52547928a-sys\") pod \"node-exporter-shbmd\" (UID: \"6dbae327-9634-451e-8554-dbd52547928a\") " pod="openshift-monitoring/node-exporter-shbmd"
Jul 23 16:16:54.234586 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:16:54.234575    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/6dbae327-9634-451e-8554-dbd52547928a-root\") pod \"node-exporter-shbmd\" (UID: \"6dbae327-9634-451e-8554-dbd52547928a\") " pod="openshift-monitoring/node-exporter-shbmd"
Jul 23 16:16:54.234673 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:16:54.234660    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/6dbae327-9634-451e-8554-dbd52547928a-node-exporter-tls\") pod \"node-exporter-shbmd\" (UID: \"6dbae327-9634-451e-8554-dbd52547928a\") " pod="openshift-monitoring/node-exporter-shbmd"
Jul 23 16:16:54.234765 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:16:54.234754    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/6dbae327-9634-451e-8554-dbd52547928a-node-exporter-textfile\") pod \"node-exporter-shbmd\" (UID: \"6dbae327-9634-451e-8554-dbd52547928a\") " pod="openshift-monitoring/node-exporter-shbmd"
Jul 23 16:16:54.234863 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:16:54.234851    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/6dbae327-9634-451e-8554-dbd52547928a-node-exporter-accelerators-collector-config\") pod \"node-exporter-shbmd\" (UID: \"6dbae327-9634-451e-8554-dbd52547928a\") " pod="openshift-monitoring/node-exporter-shbmd"
Jul 23 16:16:54.336387 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:16:54.336350    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/6dbae327-9634-451e-8554-dbd52547928a-root\") pod \"node-exporter-shbmd\" (UID: \"6dbae327-9634-451e-8554-dbd52547928a\") " pod="openshift-monitoring/node-exporter-shbmd"
Jul 23 16:16:54.336655 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:16:54.336636    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/6dbae327-9634-451e-8554-dbd52547928a-node-exporter-tls\") pod \"node-exporter-shbmd\" (UID: \"6dbae327-9634-451e-8554-dbd52547928a\") " pod="openshift-monitoring/node-exporter-shbmd"
Jul 23 16:16:54.336792 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:16:54.336778    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/6dbae327-9634-451e-8554-dbd52547928a-node-exporter-textfile\") pod \"node-exporter-shbmd\" (UID: \"6dbae327-9634-451e-8554-dbd52547928a\") " pod="openshift-monitoring/node-exporter-shbmd"
Jul 23 16:16:54.336923 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:16:54.336908    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/6dbae327-9634-451e-8554-dbd52547928a-node-exporter-accelerators-collector-config\") pod \"node-exporter-shbmd\" (UID: \"6dbae327-9634-451e-8554-dbd52547928a\") " pod="openshift-monitoring/node-exporter-shbmd"
Jul 23 16:16:54.337096 ip-10-0-143-166 kubenswrapper[2553]: E0723 16:16:54.337067    2553 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found
Jul 23 16:16:54.337196 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:16:54.337137    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/6dbae327-9634-451e-8554-dbd52547928a-root\") pod \"node-exporter-shbmd\" (UID: \"6dbae327-9634-451e-8554-dbd52547928a\") " pod="openshift-monitoring/node-exporter-shbmd"
Jul 23 16:16:54.337265 ip-10-0-143-166 kubenswrapper[2553]: E0723 16:16:54.337236    2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6dbae327-9634-451e-8554-dbd52547928a-node-exporter-tls podName:6dbae327-9634-451e-8554-dbd52547928a nodeName:}" failed. No retries permitted until 2026-07-23 16:16:54.837208723 +0000 UTC m=+96.701814829 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/6dbae327-9634-451e-8554-dbd52547928a-node-exporter-tls") pod "node-exporter-shbmd" (UID: "6dbae327-9634-451e-8554-dbd52547928a") : secret "node-exporter-tls" not found
Jul 23 16:16:54.337359 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:16:54.337341    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6dbae327-9634-451e-8554-dbd52547928a-metrics-client-ca\") pod \"node-exporter-shbmd\" (UID: \"6dbae327-9634-451e-8554-dbd52547928a\") " pod="openshift-monitoring/node-exporter-shbmd"
Jul 23 16:16:54.337527 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:16:54.337479    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kh9zc\" (UniqueName: \"kubernetes.io/projected/6dbae327-9634-451e-8554-dbd52547928a-kube-api-access-kh9zc\") pod \"node-exporter-shbmd\" (UID: \"6dbae327-9634-451e-8554-dbd52547928a\") " pod="openshift-monitoring/node-exporter-shbmd"
Jul 23 16:16:54.337653 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:16:54.337639    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/6dbae327-9634-451e-8554-dbd52547928a-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-shbmd\" (UID: \"6dbae327-9634-451e-8554-dbd52547928a\") " pod="openshift-monitoring/node-exporter-shbmd"
Jul 23 16:16:54.337776 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:16:54.337763    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/6dbae327-9634-451e-8554-dbd52547928a-node-exporter-wtmp\") pod \"node-exporter-shbmd\" (UID: \"6dbae327-9634-451e-8554-dbd52547928a\") " pod="openshift-monitoring/node-exporter-shbmd"
Jul 23 16:16:54.337921 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:16:54.337906    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6dbae327-9634-451e-8554-dbd52547928a-sys\") pod \"node-exporter-shbmd\" (UID: \"6dbae327-9634-451e-8554-dbd52547928a\") " pod="openshift-monitoring/node-exporter-shbmd"
Jul 23 16:16:54.338098 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:16:54.338076    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/6dbae327-9634-451e-8554-dbd52547928a-node-exporter-accelerators-collector-config\") pod \"node-exporter-shbmd\" (UID: \"6dbae327-9634-451e-8554-dbd52547928a\") " pod="openshift-monitoring/node-exporter-shbmd"
Jul 23 16:16:54.338098 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:16:54.338091    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6dbae327-9634-451e-8554-dbd52547928a-metrics-client-ca\") pod \"node-exporter-shbmd\" (UID: \"6dbae327-9634-451e-8554-dbd52547928a\") " pod="openshift-monitoring/node-exporter-shbmd"
Jul 23 16:16:54.338253 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:16:54.337502    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/6dbae327-9634-451e-8554-dbd52547928a-node-exporter-textfile\") pod \"node-exporter-shbmd\" (UID: \"6dbae327-9634-451e-8554-dbd52547928a\") " pod="openshift-monitoring/node-exporter-shbmd"
Jul 23 16:16:54.338377 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:16:54.338358    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6dbae327-9634-451e-8554-dbd52547928a-sys\") pod \"node-exporter-shbmd\" (UID: \"6dbae327-9634-451e-8554-dbd52547928a\") " pod="openshift-monitoring/node-exporter-shbmd"
Jul 23 16:16:54.338512 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:16:54.338490    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/6dbae327-9634-451e-8554-dbd52547928a-node-exporter-wtmp\") pod \"node-exporter-shbmd\" (UID: \"6dbae327-9634-451e-8554-dbd52547928a\") " pod="openshift-monitoring/node-exporter-shbmd"
Jul 23 16:16:54.341061 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:16:54.341033    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/6dbae327-9634-451e-8554-dbd52547928a-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-shbmd\" (UID: \"6dbae327-9634-451e-8554-dbd52547928a\") " pod="openshift-monitoring/node-exporter-shbmd"
Jul 23 16:16:54.352073 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:16:54.352052    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kh9zc\" (UniqueName: \"kubernetes.io/projected/6dbae327-9634-451e-8554-dbd52547928a-kube-api-access-kh9zc\") pod \"node-exporter-shbmd\" (UID: \"6dbae327-9634-451e-8554-dbd52547928a\") " pod="openshift-monitoring/node-exporter-shbmd"
Jul 23 16:16:54.842740 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:16:54.842701    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/6dbae327-9634-451e-8554-dbd52547928a-node-exporter-tls\") pod \"node-exporter-shbmd\" (UID: \"6dbae327-9634-451e-8554-dbd52547928a\") " pod="openshift-monitoring/node-exporter-shbmd"
Jul 23 16:16:54.845533 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:16:54.845504    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/6dbae327-9634-451e-8554-dbd52547928a-node-exporter-tls\") pod \"node-exporter-shbmd\" (UID: \"6dbae327-9634-451e-8554-dbd52547928a\") " pod="openshift-monitoring/node-exporter-shbmd"
Jul 23 16:16:55.126558 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:16:55.126469    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-shbmd"
Jul 23 16:16:55.999333 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:16:55.999302    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-8vt69"
Jul 23 16:16:56.166614 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:16:56.166572    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-shbmd" event={"ID":"6dbae327-9634-451e-8554-dbd52547928a","Type":"ContainerStarted","Data":"0c3cbecf167d4838824786cdb5d603a1adf440982deb66c16bf8f3667122ae72"}
Jul 23 16:16:57.174770 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:16:57.174564    2553 generic.go:356] "Generic (PLEG): container finished" podID="6dbae327-9634-451e-8554-dbd52547928a" containerID="cc8b5c8b54d4e1bde3d7db3c16352e5cf573b14fe11910708316fc69a13db541" exitCode=0
Jul 23 16:16:57.174770 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:16:57.174697    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-shbmd" event={"ID":"6dbae327-9634-451e-8554-dbd52547928a","Type":"ContainerDied","Data":"cc8b5c8b54d4e1bde3d7db3c16352e5cf573b14fe11910708316fc69a13db541"}
Jul 23 16:16:57.733136 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:16:57.733101    2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-6868994b56-jpcfj"]
Jul 23 16:16:58.181444 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:16:58.181407    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-shbmd" event={"ID":"6dbae327-9634-451e-8554-dbd52547928a","Type":"ContainerStarted","Data":"809f6608e8bf2148ce9be121d8b2bd84db0745a706e16d95249142ec3c947990"}
Jul 23 16:16:58.181892 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:16:58.181473    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-shbmd" event={"ID":"6dbae327-9634-451e-8554-dbd52547928a","Type":"ContainerStarted","Data":"0dbda2bb4e85bb6fd8fdc2e07ac36218efcac69256ec389abe5750801de70e01"}
Jul 23 16:16:58.204702 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:16:58.204641    2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-shbmd" podStartSLOduration=2.4323593900000002 podStartE2EDuration="4.204622629s" totalImagesPullingTime="1.627812865s" totalInitContainerRuntime="144.450374ms" isStatefulPod=true podCreationTimestamp="2026-07-23 16:16:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 16:16:58.202894862 +0000 UTC m=+100.067501002" watchObservedRunningTime="2026-07-23 16:16:58.204622629 +0000 UTC m=+100.069228758"
Jul 23 16:17:19.262553 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:17:19.262520    2553 generic.go:356] "Generic (PLEG): container finished" podID="3468a30b-e65e-4ca8-a427-6e63953f932b" containerID="7a1a1d0cec67ab77b884e869121ee37891afbab1a18e856174d6ae1a2eb0440b" exitCode=0
Jul 23 16:17:19.262957 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:17:19.262592    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-4jm7t" event={"ID":"3468a30b-e65e-4ca8-a427-6e63953f932b","Type":"ContainerDied","Data":"7a1a1d0cec67ab77b884e869121ee37891afbab1a18e856174d6ae1a2eb0440b"}
Jul 23 16:17:19.262957 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:17:19.262894    2553 scope.go:117] "RemoveContainer" containerID="7a1a1d0cec67ab77b884e869121ee37891afbab1a18e856174d6ae1a2eb0440b"
Jul 23 16:17:20.270025 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:17:20.269991    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-4jm7t" event={"ID":"3468a30b-e65e-4ca8-a427-6e63953f932b","Type":"ContainerStarted","Data":"27373258c253f2c1457f8eee4ffe0f9a47e1f93501151cb1a1cb066cee5f646c"}
Jul 23 16:17:22.759082 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:17:22.759040    2553 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-6868994b56-jpcfj" podUID="267f079f-9842-415b-858e-c591c6a73a64" containerName="registry" containerID="cri-o://de9ea6844c30e47c936cb2486bd2505c233486c4d9a963cf7d2f5fef9e3c3170" gracePeriod=30
Jul 23 16:17:23.038087 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:17:23.038061    2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6868994b56-jpcfj"
Jul 23 16:17:23.188271 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:17:23.188216    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/267f079f-9842-415b-858e-c591c6a73a64-registry-certificates\") pod \"267f079f-9842-415b-858e-c591c6a73a64\" (UID: \"267f079f-9842-415b-858e-c591c6a73a64\") "
Jul 23 16:17:23.188474 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:17:23.188281    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/267f079f-9842-415b-858e-c591c6a73a64-ca-trust-extracted\") pod \"267f079f-9842-415b-858e-c591c6a73a64\" (UID: \"267f079f-9842-415b-858e-c591c6a73a64\") "
Jul 23 16:17:23.188474 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:17:23.188312    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/267f079f-9842-415b-858e-c591c6a73a64-installation-pull-secrets\") pod \"267f079f-9842-415b-858e-c591c6a73a64\" (UID: \"267f079f-9842-415b-858e-c591c6a73a64\") "
Jul 23 16:17:23.188474 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:17:23.188335    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ztn2d\" (UniqueName: \"kubernetes.io/projected/267f079f-9842-415b-858e-c591c6a73a64-kube-api-access-ztn2d\") pod \"267f079f-9842-415b-858e-c591c6a73a64\" (UID: \"267f079f-9842-415b-858e-c591c6a73a64\") "
Jul 23 16:17:23.188474 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:17:23.188367    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/267f079f-9842-415b-858e-c591c6a73a64-image-registry-private-configuration\") pod \"267f079f-9842-415b-858e-c591c6a73a64\" (UID: \"267f079f-9842-415b-858e-c591c6a73a64\") "
Jul 23 16:17:23.188674 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:17:23.188573    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/267f079f-9842-415b-858e-c591c6a73a64-trusted-ca\") pod \"267f079f-9842-415b-858e-c591c6a73a64\" (UID: \"267f079f-9842-415b-858e-c591c6a73a64\") "
Jul 23 16:17:23.188674 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:17:23.188624    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/267f079f-9842-415b-858e-c591c6a73a64-bound-sa-token\") pod \"267f079f-9842-415b-858e-c591c6a73a64\" (UID: \"267f079f-9842-415b-858e-c591c6a73a64\") "
Jul 23 16:17:23.188674 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:17:23.188654    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/267f079f-9842-415b-858e-c591c6a73a64-registry-tls\") pod \"267f079f-9842-415b-858e-c591c6a73a64\" (UID: \"267f079f-9842-415b-858e-c591c6a73a64\") "
Jul 23 16:17:23.188814 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:17:23.188692    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/267f079f-9842-415b-858e-c591c6a73a64-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "267f079f-9842-415b-858e-c591c6a73a64" (UID: "267f079f-9842-415b-858e-c591c6a73a64"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 23 16:17:23.188906 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:17:23.188879    2553 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/267f079f-9842-415b-858e-c591c6a73a64-registry-certificates\") on node \"ip-10-0-143-166.ec2.internal\" DevicePath \"\""
Jul 23 16:17:23.189009 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:17:23.188981    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/267f079f-9842-415b-858e-c591c6a73a64-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "267f079f-9842-415b-858e-c591c6a73a64" (UID: "267f079f-9842-415b-858e-c591c6a73a64"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 23 16:17:23.191280 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:17:23.191247    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/267f079f-9842-415b-858e-c591c6a73a64-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "267f079f-9842-415b-858e-c591c6a73a64" (UID: "267f079f-9842-415b-858e-c591c6a73a64"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 23 16:17:23.191400 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:17:23.191301    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/267f079f-9842-415b-858e-c591c6a73a64-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "267f079f-9842-415b-858e-c591c6a73a64" (UID: "267f079f-9842-415b-858e-c591c6a73a64"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 16:17:23.191472 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:17:23.191440    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/267f079f-9842-415b-858e-c591c6a73a64-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "267f079f-9842-415b-858e-c591c6a73a64" (UID: "267f079f-9842-415b-858e-c591c6a73a64"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 23 16:17:23.191521 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:17:23.191478    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/267f079f-9842-415b-858e-c591c6a73a64-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "267f079f-9842-415b-858e-c591c6a73a64" (UID: "267f079f-9842-415b-858e-c591c6a73a64"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 16:17:23.191563 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:17:23.191545    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/267f079f-9842-415b-858e-c591c6a73a64-kube-api-access-ztn2d" (OuterVolumeSpecName: "kube-api-access-ztn2d") pod "267f079f-9842-415b-858e-c591c6a73a64" (UID: "267f079f-9842-415b-858e-c591c6a73a64"). InnerVolumeSpecName "kube-api-access-ztn2d". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 16:17:23.196825 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:17:23.196801    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/267f079f-9842-415b-858e-c591c6a73a64-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "267f079f-9842-415b-858e-c591c6a73a64" (UID: "267f079f-9842-415b-858e-c591c6a73a64"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 16:17:23.283066 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:17:23.282975    2553 generic.go:356] "Generic (PLEG): container finished" podID="267f079f-9842-415b-858e-c591c6a73a64" containerID="de9ea6844c30e47c936cb2486bd2505c233486c4d9a963cf7d2f5fef9e3c3170" exitCode=0
Jul 23 16:17:23.283066 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:17:23.283015    2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6868994b56-jpcfj"
Jul 23 16:17:23.283280 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:17:23.283060    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6868994b56-jpcfj" event={"ID":"267f079f-9842-415b-858e-c591c6a73a64","Type":"ContainerDied","Data":"de9ea6844c30e47c936cb2486bd2505c233486c4d9a963cf7d2f5fef9e3c3170"}
Jul 23 16:17:23.283280 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:17:23.283111    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6868994b56-jpcfj" event={"ID":"267f079f-9842-415b-858e-c591c6a73a64","Type":"ContainerDied","Data":"445f818feea886190f75f946823f905de804bb0264957b1df5ad2146981c43af"}
Jul 23 16:17:23.283280 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:17:23.283133    2553 scope.go:117] "RemoveContainer" containerID="de9ea6844c30e47c936cb2486bd2505c233486c4d9a963cf7d2f5fef9e3c3170"
Jul 23 16:17:23.289223 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:17:23.289200    2553 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/267f079f-9842-415b-858e-c591c6a73a64-bound-sa-token\") on node \"ip-10-0-143-166.ec2.internal\" DevicePath \"\""
Jul 23 16:17:23.289223 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:17:23.289222    2553 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/267f079f-9842-415b-858e-c591c6a73a64-registry-tls\") on node \"ip-10-0-143-166.ec2.internal\" DevicePath \"\""
Jul 23 16:17:23.289364 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:17:23.289231    2553 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/267f079f-9842-415b-858e-c591c6a73a64-ca-trust-extracted\") on node \"ip-10-0-143-166.ec2.internal\" DevicePath \"\""
Jul 23 16:17:23.289364 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:17:23.289241    2553 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/267f079f-9842-415b-858e-c591c6a73a64-installation-pull-secrets\") on node \"ip-10-0-143-166.ec2.internal\" DevicePath \"\""
Jul 23 16:17:23.289364 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:17:23.289251    2553 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ztn2d\" (UniqueName: \"kubernetes.io/projected/267f079f-9842-415b-858e-c591c6a73a64-kube-api-access-ztn2d\") on node \"ip-10-0-143-166.ec2.internal\" DevicePath \"\""
Jul 23 16:17:23.289364 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:17:23.289259    2553 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/267f079f-9842-415b-858e-c591c6a73a64-image-registry-private-configuration\") on node \"ip-10-0-143-166.ec2.internal\" DevicePath \"\""
Jul 23 16:17:23.289364 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:17:23.289268    2553 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/267f079f-9842-415b-858e-c591c6a73a64-trusted-ca\") on node \"ip-10-0-143-166.ec2.internal\" DevicePath \"\""
Jul 23 16:17:23.292105 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:17:23.291919    2553 scope.go:117] "RemoveContainer" containerID="de9ea6844c30e47c936cb2486bd2505c233486c4d9a963cf7d2f5fef9e3c3170"
Jul 23 16:17:23.292349 ip-10-0-143-166 kubenswrapper[2553]: E0723 16:17:23.292313    2553 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"de9ea6844c30e47c936cb2486bd2505c233486c4d9a963cf7d2f5fef9e3c3170\": container with ID starting with de9ea6844c30e47c936cb2486bd2505c233486c4d9a963cf7d2f5fef9e3c3170 not found: ID does not exist" containerID="de9ea6844c30e47c936cb2486bd2505c233486c4d9a963cf7d2f5fef9e3c3170"
Jul 23 16:17:23.292445 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:17:23.292352    2553 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"de9ea6844c30e47c936cb2486bd2505c233486c4d9a963cf7d2f5fef9e3c3170"} err="failed to get container status \"de9ea6844c30e47c936cb2486bd2505c233486c4d9a963cf7d2f5fef9e3c3170\": rpc error: code = NotFound desc = could not find container \"de9ea6844c30e47c936cb2486bd2505c233486c4d9a963cf7d2f5fef9e3c3170\": container with ID starting with de9ea6844c30e47c936cb2486bd2505c233486c4d9a963cf7d2f5fef9e3c3170 not found: ID does not exist"
Jul 23 16:17:23.306737 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:17:23.306710    2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-6868994b56-jpcfj"]
Jul 23 16:17:23.313915 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:17:23.313889    2553 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-6868994b56-jpcfj"]
Jul 23 16:17:24.293153 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:17:24.293119    2553 generic.go:356] "Generic (PLEG): container finished" podID="e4611a5f-b77b-469f-b29c-81ea53b65599" containerID="6a3ae29c243e92e2b5f3f93cc63777d0215dabfe50417213d2cbf08a4d19bd72" exitCode=0
Jul 23 16:17:24.293571 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:17:24.293196    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-tlkw4" event={"ID":"e4611a5f-b77b-469f-b29c-81ea53b65599","Type":"ContainerDied","Data":"6a3ae29c243e92e2b5f3f93cc63777d0215dabfe50417213d2cbf08a4d19bd72"}
Jul 23 16:17:24.293571 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:17:24.293532    2553 scope.go:117] "RemoveContainer" containerID="6a3ae29c243e92e2b5f3f93cc63777d0215dabfe50417213d2cbf08a4d19bd72"
Jul 23 16:17:24.673804 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:17:24.673773    2553 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="267f079f-9842-415b-858e-c591c6a73a64" path="/var/lib/kubelet/pods/267f079f-9842-415b-858e-c591c6a73a64/volumes"
Jul 23 16:17:25.298497 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:17:25.298465    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-tlkw4" event={"ID":"e4611a5f-b77b-469f-b29c-81ea53b65599","Type":"ContainerStarted","Data":"3282552c638dcc7450bd78a48df883afd0c82e3c4a81413919521df9a15c7d1e"}
Jul 23 16:17:39.352139 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:17:39.352107    2553 generic.go:356] "Generic (PLEG): container finished" podID="93f725de-e1d8-4c9d-9491-494072eaadf4" containerID="8be22a95298f12d85b3a1ad9b4eac28c91883dcfc0b4dde4a606fff472a2a9de" exitCode=0
Jul 23 16:17:39.352596 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:17:39.352201    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-555d9d7885-5hbck" event={"ID":"93f725de-e1d8-4c9d-9491-494072eaadf4","Type":"ContainerDied","Data":"8be22a95298f12d85b3a1ad9b4eac28c91883dcfc0b4dde4a606fff472a2a9de"}
Jul 23 16:17:39.352596 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:17:39.352571    2553 scope.go:117] "RemoveContainer" containerID="8be22a95298f12d85b3a1ad9b4eac28c91883dcfc0b4dde4a606fff472a2a9de"
Jul 23 16:17:40.357688 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:17:40.357658    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-555d9d7885-5hbck" event={"ID":"93f725de-e1d8-4c9d-9491-494072eaadf4","Type":"ContainerStarted","Data":"d557e6861a86a63c20fdc6011664262a68f3b80f491d9ad8f36e92b4b0d7f3d4"}
Jul 23 16:20:18.502354 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:20:18.502325    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-7rmrn_976a7198-cfd3-43d4-8c9f-b1f248d1f6d7/console-operator/1.log"
Jul 23 16:20:18.505728 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:20:18.505699    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-7rmrn_976a7198-cfd3-43d4-8c9f-b1f248d1f6d7/console-operator/1.log"
Jul 23 16:20:18.514463 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:20:18.514439    2553 kubelet.go:1648] "Image garbage collection succeeded"
Jul 23 16:20:48.917373 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:20:48.917334    2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540s4277"]
Jul 23 16:20:48.918530 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:20:48.917623    2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="267f079f-9842-415b-858e-c591c6a73a64" containerName="registry"
Jul 23 16:20:48.918530 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:20:48.917636    2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="267f079f-9842-415b-858e-c591c6a73a64" containerName="registry"
Jul 23 16:20:48.918530 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:20:48.917692    2553 memory_manager.go:368] "RemoveStaleState removing state" podUID="267f079f-9842-415b-858e-c591c6a73a64" containerName="registry"
Jul 23 16:20:48.919283 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:20:48.919268    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540s4277"
Jul 23 16:20:48.922058 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:20:48.922036    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Jul 23 16:20:48.922058 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:20:48.922065    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Jul 23 16:20:48.923202 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:20:48.923187    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-72mc7\""
Jul 23 16:20:48.929899 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:20:48.929877    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540s4277"]
Jul 23 16:20:48.931784 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:20:48.931761    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g77gs\" (UniqueName: \"kubernetes.io/projected/7969c3c4-3ae0-4c86-87d2-040e16e538d3-kube-api-access-g77gs\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540s4277\" (UID: \"7969c3c4-3ae0-4c86-87d2-040e16e538d3\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540s4277"
Jul 23 16:20:48.931894 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:20:48.931802    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7969c3c4-3ae0-4c86-87d2-040e16e538d3-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540s4277\" (UID: \"7969c3c4-3ae0-4c86-87d2-040e16e538d3\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540s4277"
Jul 23 16:20:48.931894 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:20:48.931833    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7969c3c4-3ae0-4c86-87d2-040e16e538d3-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540s4277\" (UID: \"7969c3c4-3ae0-4c86-87d2-040e16e538d3\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540s4277"
Jul 23 16:20:49.032561 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:20:49.032521    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7969c3c4-3ae0-4c86-87d2-040e16e538d3-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540s4277\" (UID: \"7969c3c4-3ae0-4c86-87d2-040e16e538d3\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540s4277"
Jul 23 16:20:49.032721 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:20:49.032605    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g77gs\" (UniqueName: \"kubernetes.io/projected/7969c3c4-3ae0-4c86-87d2-040e16e538d3-kube-api-access-g77gs\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540s4277\" (UID: \"7969c3c4-3ae0-4c86-87d2-040e16e538d3\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540s4277"
Jul 23 16:20:49.032721 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:20:49.032629    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7969c3c4-3ae0-4c86-87d2-040e16e538d3-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540s4277\" (UID: \"7969c3c4-3ae0-4c86-87d2-040e16e538d3\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540s4277"
Jul 23 16:20:49.032982 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:20:49.032958    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7969c3c4-3ae0-4c86-87d2-040e16e538d3-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540s4277\" (UID: \"7969c3c4-3ae0-4c86-87d2-040e16e538d3\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540s4277"
Jul 23 16:20:49.033024 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:20:49.032977    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7969c3c4-3ae0-4c86-87d2-040e16e538d3-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540s4277\" (UID: \"7969c3c4-3ae0-4c86-87d2-040e16e538d3\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540s4277"
Jul 23 16:20:49.040838 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:20:49.040810    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g77gs\" (UniqueName: \"kubernetes.io/projected/7969c3c4-3ae0-4c86-87d2-040e16e538d3-kube-api-access-g77gs\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540s4277\" (UID: \"7969c3c4-3ae0-4c86-87d2-040e16e538d3\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540s4277"
Jul 23 16:20:49.228423 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:20:49.228330    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540s4277"
Jul 23 16:20:49.359115 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:20:49.359056    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540s4277"]
Jul 23 16:20:49.361797 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:20:49.361764    2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7969c3c4_3ae0_4c86_87d2_040e16e538d3.slice/crio-fada4771c640fa4c763a0b09e7a76452b2a09103ebab9e2856b40a6a2db8505f WatchSource:0}: Error finding container fada4771c640fa4c763a0b09e7a76452b2a09103ebab9e2856b40a6a2db8505f: Status 404 returned error can't find the container with id fada4771c640fa4c763a0b09e7a76452b2a09103ebab9e2856b40a6a2db8505f
Jul 23 16:20:49.363909 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:20:49.363891    2553 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 23 16:20:50.055619 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:20:50.055582    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540s4277" event={"ID":"7969c3c4-3ae0-4c86-87d2-040e16e538d3","Type":"ContainerStarted","Data":"fada4771c640fa4c763a0b09e7a76452b2a09103ebab9e2856b40a6a2db8505f"}
Jul 23 16:20:56.082935 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:20:56.082895    2553 generic.go:356] "Generic (PLEG): container finished" podID="7969c3c4-3ae0-4c86-87d2-040e16e538d3" containerID="f83ea1b6d95fbc69ad9da0a4e7effaf0ef8ca466bc710086ab14a2e287898f21" exitCode=0
Jul 23 16:20:56.083420 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:20:56.082974    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540s4277" event={"ID":"7969c3c4-3ae0-4c86-87d2-040e16e538d3","Type":"ContainerDied","Data":"f83ea1b6d95fbc69ad9da0a4e7effaf0ef8ca466bc710086ab14a2e287898f21"}
Jul 23 16:20:59.098883 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:20:59.098841    2553 generic.go:356] "Generic (PLEG): container finished" podID="7969c3c4-3ae0-4c86-87d2-040e16e538d3" containerID="0f93dd38521bf83de609fc358971e6a8a798b2840c71bdf2be9dd2dd285264c5" exitCode=0
Jul 23 16:20:59.099320 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:20:59.098917    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540s4277" event={"ID":"7969c3c4-3ae0-4c86-87d2-040e16e538d3","Type":"ContainerDied","Data":"0f93dd38521bf83de609fc358971e6a8a798b2840c71bdf2be9dd2dd285264c5"}
Jul 23 16:21:07.132977 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:21:07.132935    2553 generic.go:356] "Generic (PLEG): container finished" podID="7969c3c4-3ae0-4c86-87d2-040e16e538d3" containerID="49f2ae80142e38a637f37f2f2927b11e798f56cac22285abc5aed34ef444e45a" exitCode=0
Jul 23 16:21:07.133370 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:21:07.133020    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540s4277" event={"ID":"7969c3c4-3ae0-4c86-87d2-040e16e538d3","Type":"ContainerDied","Data":"49f2ae80142e38a637f37f2f2927b11e798f56cac22285abc5aed34ef444e45a"}
Jul 23 16:21:08.261828 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:21:08.261802    2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540s4277"
Jul 23 16:21:08.288954 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:21:08.288919    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7969c3c4-3ae0-4c86-87d2-040e16e538d3-util\") pod \"7969c3c4-3ae0-4c86-87d2-040e16e538d3\" (UID: \"7969c3c4-3ae0-4c86-87d2-040e16e538d3\") "
Jul 23 16:21:08.289125 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:21:08.288961    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7969c3c4-3ae0-4c86-87d2-040e16e538d3-bundle\") pod \"7969c3c4-3ae0-4c86-87d2-040e16e538d3\" (UID: \"7969c3c4-3ae0-4c86-87d2-040e16e538d3\") "
Jul 23 16:21:08.289125 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:21:08.289008    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-g77gs\" (UniqueName: \"kubernetes.io/projected/7969c3c4-3ae0-4c86-87d2-040e16e538d3-kube-api-access-g77gs\") pod \"7969c3c4-3ae0-4c86-87d2-040e16e538d3\" (UID: \"7969c3c4-3ae0-4c86-87d2-040e16e538d3\") "
Jul 23 16:21:08.289621 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:21:08.289594    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7969c3c4-3ae0-4c86-87d2-040e16e538d3-bundle" (OuterVolumeSpecName: "bundle") pod "7969c3c4-3ae0-4c86-87d2-040e16e538d3" (UID: "7969c3c4-3ae0-4c86-87d2-040e16e538d3"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 16:21:08.291325 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:21:08.291290    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7969c3c4-3ae0-4c86-87d2-040e16e538d3-kube-api-access-g77gs" (OuterVolumeSpecName: "kube-api-access-g77gs") pod "7969c3c4-3ae0-4c86-87d2-040e16e538d3" (UID: "7969c3c4-3ae0-4c86-87d2-040e16e538d3"). InnerVolumeSpecName "kube-api-access-g77gs". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 16:21:08.293440 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:21:08.293417    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7969c3c4-3ae0-4c86-87d2-040e16e538d3-util" (OuterVolumeSpecName: "util") pod "7969c3c4-3ae0-4c86-87d2-040e16e538d3" (UID: "7969c3c4-3ae0-4c86-87d2-040e16e538d3"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 16:21:08.389988 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:21:08.389899    2553 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7969c3c4-3ae0-4c86-87d2-040e16e538d3-util\") on node \"ip-10-0-143-166.ec2.internal\" DevicePath \"\""
Jul 23 16:21:08.389988 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:21:08.389929    2553 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7969c3c4-3ae0-4c86-87d2-040e16e538d3-bundle\") on node \"ip-10-0-143-166.ec2.internal\" DevicePath \"\""
Jul 23 16:21:08.389988 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:21:08.389940    2553 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-g77gs\" (UniqueName: \"kubernetes.io/projected/7969c3c4-3ae0-4c86-87d2-040e16e538d3-kube-api-access-g77gs\") on node \"ip-10-0-143-166.ec2.internal\" DevicePath \"\""
Jul 23 16:21:09.142905 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:21:09.142873    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540s4277" event={"ID":"7969c3c4-3ae0-4c86-87d2-040e16e538d3","Type":"ContainerDied","Data":"fada4771c640fa4c763a0b09e7a76452b2a09103ebab9e2856b40a6a2db8505f"}
Jul 23 16:21:09.142905 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:21:09.142890    2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540s4277"
Jul 23 16:21:09.143088 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:21:09.142919    2553 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="fada4771c640fa4c763a0b09e7a76452b2a09103ebab9e2856b40a6a2db8505f"
Jul 23 16:21:21.408832 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:21:21.408751    2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-7vv6t"]
Jul 23 16:21:21.409284 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:21:21.409053    2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7969c3c4-3ae0-4c86-87d2-040e16e538d3" containerName="extract"
Jul 23 16:21:21.409284 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:21:21.409065    2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="7969c3c4-3ae0-4c86-87d2-040e16e538d3" containerName="extract"
Jul 23 16:21:21.409284 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:21:21.409074    2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7969c3c4-3ae0-4c86-87d2-040e16e538d3" containerName="util"
Jul 23 16:21:21.409284 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:21:21.409080    2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="7969c3c4-3ae0-4c86-87d2-040e16e538d3" containerName="util"
Jul 23 16:21:21.409284 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:21:21.409090    2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7969c3c4-3ae0-4c86-87d2-040e16e538d3" containerName="pull"
Jul 23 16:21:21.409284 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:21:21.409095    2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="7969c3c4-3ae0-4c86-87d2-040e16e538d3" containerName="pull"
Jul 23 16:21:21.409284 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:21:21.409154    2553 memory_manager.go:368] "RemoveStaleState removing state" podUID="7969c3c4-3ae0-4c86-87d2-040e16e538d3" containerName="extract"
Jul 23 16:21:21.410859 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:21:21.410843    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-7vv6t"
Jul 23 16:21:21.413973 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:21:21.413952    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
Jul 23 16:21:21.414094 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:21:21.413952    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
Jul 23 16:21:21.415102 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:21:21.415088    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-68k9f\""
Jul 23 16:21:21.422152 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:21:21.422132    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-7vv6t"]
Jul 23 16:21:21.493928 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:21:21.493895    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/21d00e5d-3aac-4e98-a537-457064b224c7-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-7vv6t\" (UID: \"21d00e5d-3aac-4e98-a537-457064b224c7\") " pod="cert-manager/cert-manager-webhook-6486ffd997-7vv6t"
Jul 23 16:21:21.494095 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:21:21.493950    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f26pd\" (UniqueName: \"kubernetes.io/projected/21d00e5d-3aac-4e98-a537-457064b224c7-kube-api-access-f26pd\") pod \"cert-manager-webhook-6486ffd997-7vv6t\" (UID: \"21d00e5d-3aac-4e98-a537-457064b224c7\") " pod="cert-manager/cert-manager-webhook-6486ffd997-7vv6t"
Jul 23 16:21:21.594417 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:21:21.594381    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f26pd\" (UniqueName: \"kubernetes.io/projected/21d00e5d-3aac-4e98-a537-457064b224c7-kube-api-access-f26pd\") pod \"cert-manager-webhook-6486ffd997-7vv6t\" (UID: \"21d00e5d-3aac-4e98-a537-457064b224c7\") " pod="cert-manager/cert-manager-webhook-6486ffd997-7vv6t"
Jul 23 16:21:21.594574 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:21:21.594445    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/21d00e5d-3aac-4e98-a537-457064b224c7-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-7vv6t\" (UID: \"21d00e5d-3aac-4e98-a537-457064b224c7\") " pod="cert-manager/cert-manager-webhook-6486ffd997-7vv6t"
Jul 23 16:21:21.603636 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:21:21.603604    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/21d00e5d-3aac-4e98-a537-457064b224c7-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-7vv6t\" (UID: \"21d00e5d-3aac-4e98-a537-457064b224c7\") " pod="cert-manager/cert-manager-webhook-6486ffd997-7vv6t"
Jul 23 16:21:21.603794 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:21:21.603776    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f26pd\" (UniqueName: \"kubernetes.io/projected/21d00e5d-3aac-4e98-a537-457064b224c7-kube-api-access-f26pd\") pod \"cert-manager-webhook-6486ffd997-7vv6t\" (UID: \"21d00e5d-3aac-4e98-a537-457064b224c7\") " pod="cert-manager/cert-manager-webhook-6486ffd997-7vv6t"
Jul 23 16:21:21.736945 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:21:21.736863    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-7vv6t"
Jul 23 16:21:21.861502 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:21:21.861462    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-7vv6t"]
Jul 23 16:21:21.865146 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:21:21.865121    2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod21d00e5d_3aac_4e98_a537_457064b224c7.slice/crio-2a56e7b6f3e0ba7b0ec2ac2a184db9e0759f5edeb7e22714be24f6e6b289c0c6 WatchSource:0}: Error finding container 2a56e7b6f3e0ba7b0ec2ac2a184db9e0759f5edeb7e22714be24f6e6b289c0c6: Status 404 returned error can't find the container with id 2a56e7b6f3e0ba7b0ec2ac2a184db9e0759f5edeb7e22714be24f6e6b289c0c6
Jul 23 16:21:22.191390 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:21:22.191349    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-7vv6t" event={"ID":"21d00e5d-3aac-4e98-a537-457064b224c7","Type":"ContainerStarted","Data":"2a56e7b6f3e0ba7b0ec2ac2a184db9e0759f5edeb7e22714be24f6e6b289c0c6"}
Jul 23 16:21:22.730385 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:21:22.730340    2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f8kbd2"]
Jul 23 16:21:22.732816 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:21:22.732795    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f8kbd2"
Jul 23 16:21:22.735526 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:21:22.735499    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Jul 23 16:21:22.735656 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:21:22.735544    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-72mc7\""
Jul 23 16:21:22.735656 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:21:22.735571    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Jul 23 16:21:22.743986 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:21:22.743950    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f8kbd2"]
Jul 23 16:21:22.806388 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:21:22.806354    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gbn2j\" (UniqueName: \"kubernetes.io/projected/463e4def-3a75-4c69-ac56-6191ff59c865-kube-api-access-gbn2j\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f8kbd2\" (UID: \"463e4def-3a75-4c69-ac56-6191ff59c865\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f8kbd2"
Jul 23 16:21:22.806555 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:21:22.806407    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/463e4def-3a75-4c69-ac56-6191ff59c865-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f8kbd2\" (UID: \"463e4def-3a75-4c69-ac56-6191ff59c865\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f8kbd2"
Jul 23 16:21:22.806555 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:21:22.806514    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/463e4def-3a75-4c69-ac56-6191ff59c865-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f8kbd2\" (UID: \"463e4def-3a75-4c69-ac56-6191ff59c865\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f8kbd2"
Jul 23 16:21:22.907976 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:21:22.907936    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/463e4def-3a75-4c69-ac56-6191ff59c865-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f8kbd2\" (UID: \"463e4def-3a75-4c69-ac56-6191ff59c865\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f8kbd2"
Jul 23 16:21:22.908191 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:21:22.907995    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gbn2j\" (UniqueName: \"kubernetes.io/projected/463e4def-3a75-4c69-ac56-6191ff59c865-kube-api-access-gbn2j\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f8kbd2\" (UID: \"463e4def-3a75-4c69-ac56-6191ff59c865\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f8kbd2"
Jul 23 16:21:22.908191 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:21:22.908050    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/463e4def-3a75-4c69-ac56-6191ff59c865-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f8kbd2\" (UID: \"463e4def-3a75-4c69-ac56-6191ff59c865\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f8kbd2"
Jul 23 16:21:22.908446 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:21:22.908420    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/463e4def-3a75-4c69-ac56-6191ff59c865-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f8kbd2\" (UID: \"463e4def-3a75-4c69-ac56-6191ff59c865\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f8kbd2"
Jul 23 16:21:22.908446 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:21:22.908438    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/463e4def-3a75-4c69-ac56-6191ff59c865-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f8kbd2\" (UID: \"463e4def-3a75-4c69-ac56-6191ff59c865\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f8kbd2"
Jul 23 16:21:22.917517 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:21:22.917478    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gbn2j\" (UniqueName: \"kubernetes.io/projected/463e4def-3a75-4c69-ac56-6191ff59c865-kube-api-access-gbn2j\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f8kbd2\" (UID: \"463e4def-3a75-4c69-ac56-6191ff59c865\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f8kbd2"
Jul 23 16:21:23.046473 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:21:23.046378    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f8kbd2"
Jul 23 16:21:23.201941 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:21:23.201910    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f8kbd2"]
Jul 23 16:21:23.206810 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:21:23.206765    2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod463e4def_3a75_4c69_ac56_6191ff59c865.slice/crio-6f284d541883906ec96e05180d4a011c0fde0b74b21fe4db588effe24de8b601 WatchSource:0}: Error finding container 6f284d541883906ec96e05180d4a011c0fde0b74b21fe4db588effe24de8b601: Status 404 returned error can't find the container with id 6f284d541883906ec96e05180d4a011c0fde0b74b21fe4db588effe24de8b601
Jul 23 16:21:24.204955 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:21:24.204868    2553 generic.go:356] "Generic (PLEG): container finished" podID="463e4def-3a75-4c69-ac56-6191ff59c865" containerID="c41e4e777f3000db709f090281a7a1e76d199b971b3f2c324fa902cd877991cf" exitCode=0
Jul 23 16:21:24.204955 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:21:24.204915    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f8kbd2" event={"ID":"463e4def-3a75-4c69-ac56-6191ff59c865","Type":"ContainerDied","Data":"c41e4e777f3000db709f090281a7a1e76d199b971b3f2c324fa902cd877991cf"}
Jul 23 16:21:24.205491 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:21:24.204996    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f8kbd2" event={"ID":"463e4def-3a75-4c69-ac56-6191ff59c865","Type":"ContainerStarted","Data":"6f284d541883906ec96e05180d4a011c0fde0b74b21fe4db588effe24de8b601"}
Jul 23 16:21:25.210221 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:21:25.210151    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-7vv6t" event={"ID":"21d00e5d-3aac-4e98-a537-457064b224c7","Type":"ContainerStarted","Data":"84d781dc7e63209d09ec83091f93316801b663743c4df9aa022574fa2ea11781"}
Jul 23 16:21:25.210633 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:21:25.210270    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-6486ffd997-7vv6t"
Jul 23 16:21:25.228278 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:21:25.228219    2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-6486ffd997-7vv6t" podStartSLOduration=1.7718653130000002 podStartE2EDuration="4.228196798s" totalImagesPullingTime="2.456331485s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 16:21:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 16:21:25.227740947 +0000 UTC m=+367.092347074" watchObservedRunningTime="2026-07-23 16:21:25.228196798 +0000 UTC m=+367.092802928"
Jul 23 16:21:27.219532 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:21:27.219497    2553 generic.go:356] "Generic (PLEG): container finished" podID="463e4def-3a75-4c69-ac56-6191ff59c865" containerID="f18db1650f838948b2cd9b84e0d6ac5f7e84bf672cd2470a522761a144ae89a5" exitCode=0
Jul 23 16:21:27.219935 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:21:27.219579    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f8kbd2" event={"ID":"463e4def-3a75-4c69-ac56-6191ff59c865","Type":"ContainerDied","Data":"f18db1650f838948b2cd9b84e0d6ac5f7e84bf672cd2470a522761a144ae89a5"}
Jul 23 16:21:28.226126 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:21:28.226094    2553 generic.go:356] "Generic (PLEG): container finished" podID="463e4def-3a75-4c69-ac56-6191ff59c865" containerID="9a0992446a35a03eab825aacb269aad93437d9eb37d52a1ce944b9e72bbcde90" exitCode=0
Jul 23 16:21:28.226520 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:21:28.226137    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f8kbd2" event={"ID":"463e4def-3a75-4c69-ac56-6191ff59c865","Type":"ContainerDied","Data":"9a0992446a35a03eab825aacb269aad93437d9eb37d52a1ce944b9e72bbcde90"}
Jul 23 16:21:29.361544 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:21:29.361517    2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f8kbd2"
Jul 23 16:21:29.463344 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:21:29.463303    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/463e4def-3a75-4c69-ac56-6191ff59c865-util\") pod \"463e4def-3a75-4c69-ac56-6191ff59c865\" (UID: \"463e4def-3a75-4c69-ac56-6191ff59c865\") "
Jul 23 16:21:29.463532 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:21:29.463394    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gbn2j\" (UniqueName: \"kubernetes.io/projected/463e4def-3a75-4c69-ac56-6191ff59c865-kube-api-access-gbn2j\") pod \"463e4def-3a75-4c69-ac56-6191ff59c865\" (UID: \"463e4def-3a75-4c69-ac56-6191ff59c865\") "
Jul 23 16:21:29.463532 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:21:29.463416    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/463e4def-3a75-4c69-ac56-6191ff59c865-bundle\") pod \"463e4def-3a75-4c69-ac56-6191ff59c865\" (UID: \"463e4def-3a75-4c69-ac56-6191ff59c865\") "
Jul 23 16:21:29.463853 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:21:29.463816    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/463e4def-3a75-4c69-ac56-6191ff59c865-bundle" (OuterVolumeSpecName: "bundle") pod "463e4def-3a75-4c69-ac56-6191ff59c865" (UID: "463e4def-3a75-4c69-ac56-6191ff59c865"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 16:21:29.465638 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:21:29.465614    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/463e4def-3a75-4c69-ac56-6191ff59c865-kube-api-access-gbn2j" (OuterVolumeSpecName: "kube-api-access-gbn2j") pod "463e4def-3a75-4c69-ac56-6191ff59c865" (UID: "463e4def-3a75-4c69-ac56-6191ff59c865"). InnerVolumeSpecName "kube-api-access-gbn2j". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 16:21:29.467400 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:21:29.467376    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/463e4def-3a75-4c69-ac56-6191ff59c865-util" (OuterVolumeSpecName: "util") pod "463e4def-3a75-4c69-ac56-6191ff59c865" (UID: "463e4def-3a75-4c69-ac56-6191ff59c865"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 16:21:29.564434 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:21:29.564351    2553 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/463e4def-3a75-4c69-ac56-6191ff59c865-util\") on node \"ip-10-0-143-166.ec2.internal\" DevicePath \"\""
Jul 23 16:21:29.564434 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:21:29.564381    2553 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gbn2j\" (UniqueName: \"kubernetes.io/projected/463e4def-3a75-4c69-ac56-6191ff59c865-kube-api-access-gbn2j\") on node \"ip-10-0-143-166.ec2.internal\" DevicePath \"\""
Jul 23 16:21:29.564434 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:21:29.564395    2553 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/463e4def-3a75-4c69-ac56-6191ff59c865-bundle\") on node \"ip-10-0-143-166.ec2.internal\" DevicePath \"\""
Jul 23 16:21:30.235198 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:21:30.235147    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f8kbd2" event={"ID":"463e4def-3a75-4c69-ac56-6191ff59c865","Type":"ContainerDied","Data":"6f284d541883906ec96e05180d4a011c0fde0b74b21fe4db588effe24de8b601"}
Jul 23 16:21:30.235198 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:21:30.235191    2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f8kbd2"
Jul 23 16:21:30.235408 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:21:30.235212    2553 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="6f284d541883906ec96e05180d4a011c0fde0b74b21fe4db588effe24de8b601"
Jul 23 16:21:31.216201 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:21:31.216157    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-6486ffd997-7vv6t"
Jul 23 16:21:32.647787 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:21:32.647756    2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-55b4d954d5-dwbxq"]
Jul 23 16:21:32.648199 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:21:32.648029    2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="463e4def-3a75-4c69-ac56-6191ff59c865" containerName="util"
Jul 23 16:21:32.648199 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:21:32.648040    2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="463e4def-3a75-4c69-ac56-6191ff59c865" containerName="util"
Jul 23 16:21:32.648199 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:21:32.648057    2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="463e4def-3a75-4c69-ac56-6191ff59c865" containerName="extract"
Jul 23 16:21:32.648199 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:21:32.648063    2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="463e4def-3a75-4c69-ac56-6191ff59c865" containerName="extract"
Jul 23 16:21:32.648199 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:21:32.648071    2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="463e4def-3a75-4c69-ac56-6191ff59c865" containerName="pull"
Jul 23 16:21:32.648199 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:21:32.648076    2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="463e4def-3a75-4c69-ac56-6191ff59c865" containerName="pull"
Jul 23 16:21:32.648199 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:21:32.648138    2553 memory_manager.go:368] "RemoveStaleState removing state" podUID="463e4def-3a75-4c69-ac56-6191ff59c865" containerName="extract"
Jul 23 16:21:32.652036 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:21:32.652019    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-dwbxq"
Jul 23 16:21:32.654751 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:21:32.654728    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-7qqzl\""
Jul 23 16:21:32.661749 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:21:32.661727    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-dwbxq"]
Jul 23 16:21:32.789023 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:21:32.788982    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/6a6c29fc-70b1-4e14-a70b-fa4211d542af-bound-sa-token\") pod \"cert-manager-55b4d954d5-dwbxq\" (UID: \"6a6c29fc-70b1-4e14-a70b-fa4211d542af\") " pod="cert-manager/cert-manager-55b4d954d5-dwbxq"
Jul 23 16:21:32.789236 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:21:32.789058    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dr5j7\" (UniqueName: \"kubernetes.io/projected/6a6c29fc-70b1-4e14-a70b-fa4211d542af-kube-api-access-dr5j7\") pod \"cert-manager-55b4d954d5-dwbxq\" (UID: \"6a6c29fc-70b1-4e14-a70b-fa4211d542af\") " pod="cert-manager/cert-manager-55b4d954d5-dwbxq"
Jul 23 16:21:32.890382 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:21:32.890344    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/6a6c29fc-70b1-4e14-a70b-fa4211d542af-bound-sa-token\") pod \"cert-manager-55b4d954d5-dwbxq\" (UID: \"6a6c29fc-70b1-4e14-a70b-fa4211d542af\") " pod="cert-manager/cert-manager-55b4d954d5-dwbxq"
Jul 23 16:21:32.890570 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:21:32.890447    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dr5j7\" (UniqueName: \"kubernetes.io/projected/6a6c29fc-70b1-4e14-a70b-fa4211d542af-kube-api-access-dr5j7\") pod \"cert-manager-55b4d954d5-dwbxq\" (UID: \"6a6c29fc-70b1-4e14-a70b-fa4211d542af\") " pod="cert-manager/cert-manager-55b4d954d5-dwbxq"
Jul 23 16:21:32.899087 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:21:32.899025    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/6a6c29fc-70b1-4e14-a70b-fa4211d542af-bound-sa-token\") pod \"cert-manager-55b4d954d5-dwbxq\" (UID: \"6a6c29fc-70b1-4e14-a70b-fa4211d542af\") " pod="cert-manager/cert-manager-55b4d954d5-dwbxq"
Jul 23 16:21:32.899087 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:21:32.899081    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dr5j7\" (UniqueName: \"kubernetes.io/projected/6a6c29fc-70b1-4e14-a70b-fa4211d542af-kube-api-access-dr5j7\") pod \"cert-manager-55b4d954d5-dwbxq\" (UID: \"6a6c29fc-70b1-4e14-a70b-fa4211d542af\") " pod="cert-manager/cert-manager-55b4d954d5-dwbxq"
Jul 23 16:21:32.961214 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:21:32.961183    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-dwbxq"
Jul 23 16:21:33.090367 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:21:33.090338    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-dwbxq"]
Jul 23 16:21:33.092946 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:21:33.092920    2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod6a6c29fc_70b1_4e14_a70b_fa4211d542af.slice/crio-23af731d7a468db3607bdd780f848b945cd54538cad1b232e7b0a97070ef9474 WatchSource:0}: Error finding container 23af731d7a468db3607bdd780f848b945cd54538cad1b232e7b0a97070ef9474: Status 404 returned error can't find the container with id 23af731d7a468db3607bdd780f848b945cd54538cad1b232e7b0a97070ef9474
Jul 23 16:21:33.248045 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:21:33.248012    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-dwbxq" event={"ID":"6a6c29fc-70b1-4e14-a70b-fa4211d542af","Type":"ContainerStarted","Data":"f030d8d6417a2d654433dd45f1eb588c70a88735b7eaa947a671972e941c82f2"}
Jul 23 16:21:33.248045 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:21:33.248052    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-dwbxq" event={"ID":"6a6c29fc-70b1-4e14-a70b-fa4211d542af","Type":"ContainerStarted","Data":"23af731d7a468db3607bdd780f848b945cd54538cad1b232e7b0a97070ef9474"}
Jul 23 16:21:33.274335 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:21:33.274285    2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-55b4d954d5-dwbxq" podStartSLOduration=1.274268926 podStartE2EDuration="1.274268926s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 16:21:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 16:21:33.272815864 +0000 UTC m=+375.137421993" watchObservedRunningTime="2026-07-23 16:21:33.274268926 +0000 UTC m=+375.138875053"
Jul 23 16:21:39.409818 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:21:39.409787    2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afnf5cg"]
Jul 23 16:21:39.412025 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:21:39.412009    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afnf5cg"
Jul 23 16:21:39.414851 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:21:39.414827    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Jul 23 16:21:39.414981 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:21:39.414919    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Jul 23 16:21:39.414981 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:21:39.414949    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-72mc7\""
Jul 23 16:21:39.427933 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:21:39.427901    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afnf5cg"]
Jul 23 16:21:39.540423 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:21:39.540379    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jsczd\" (UniqueName: \"kubernetes.io/projected/ad0d1438-e7cb-44b1-9364-4b4cc065758a-kube-api-access-jsczd\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afnf5cg\" (UID: \"ad0d1438-e7cb-44b1-9364-4b4cc065758a\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afnf5cg"
Jul 23 16:21:39.540608 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:21:39.540449    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ad0d1438-e7cb-44b1-9364-4b4cc065758a-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afnf5cg\" (UID: \"ad0d1438-e7cb-44b1-9364-4b4cc065758a\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afnf5cg"
Jul 23 16:21:39.540608 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:21:39.540507    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ad0d1438-e7cb-44b1-9364-4b4cc065758a-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afnf5cg\" (UID: \"ad0d1438-e7cb-44b1-9364-4b4cc065758a\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afnf5cg"
Jul 23 16:21:39.641348 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:21:39.641314    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jsczd\" (UniqueName: \"kubernetes.io/projected/ad0d1438-e7cb-44b1-9364-4b4cc065758a-kube-api-access-jsczd\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afnf5cg\" (UID: \"ad0d1438-e7cb-44b1-9364-4b4cc065758a\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afnf5cg"
Jul 23 16:21:39.641468 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:21:39.641384    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ad0d1438-e7cb-44b1-9364-4b4cc065758a-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afnf5cg\" (UID: \"ad0d1438-e7cb-44b1-9364-4b4cc065758a\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afnf5cg"
Jul 23 16:21:39.641468 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:21:39.641417    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ad0d1438-e7cb-44b1-9364-4b4cc065758a-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afnf5cg\" (UID: \"ad0d1438-e7cb-44b1-9364-4b4cc065758a\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afnf5cg"
Jul 23 16:21:39.641825 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:21:39.641808    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ad0d1438-e7cb-44b1-9364-4b4cc065758a-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afnf5cg\" (UID: \"ad0d1438-e7cb-44b1-9364-4b4cc065758a\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afnf5cg"
Jul 23 16:21:39.641864 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:21:39.641842    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ad0d1438-e7cb-44b1-9364-4b4cc065758a-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afnf5cg\" (UID: \"ad0d1438-e7cb-44b1-9364-4b4cc065758a\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afnf5cg"
Jul 23 16:21:39.650418 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:21:39.650394    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jsczd\" (UniqueName: \"kubernetes.io/projected/ad0d1438-e7cb-44b1-9364-4b4cc065758a-kube-api-access-jsczd\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afnf5cg\" (UID: \"ad0d1438-e7cb-44b1-9364-4b4cc065758a\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afnf5cg"
Jul 23 16:21:39.721447 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:21:39.721361    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afnf5cg"
Jul 23 16:21:39.854989 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:21:39.854907    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afnf5cg"]
Jul 23 16:21:39.857346 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:21:39.857315    2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podad0d1438_e7cb_44b1_9364_4b4cc065758a.slice/crio-5f2bab34b79d05905bf4324f33e5ed12898091d6967ac798ab62a9d40351d892 WatchSource:0}: Error finding container 5f2bab34b79d05905bf4324f33e5ed12898091d6967ac798ab62a9d40351d892: Status 404 returned error can't find the container with id 5f2bab34b79d05905bf4324f33e5ed12898091d6967ac798ab62a9d40351d892
Jul 23 16:21:40.277277 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:21:40.277241    2553 generic.go:356] "Generic (PLEG): container finished" podID="ad0d1438-e7cb-44b1-9364-4b4cc065758a" containerID="8eeb04b9bca179af4cc699e1d50f68238369bbd1fe9ecc0d5bc7f7cf763cb5ab" exitCode=0
Jul 23 16:21:40.277443 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:21:40.277332    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afnf5cg" event={"ID":"ad0d1438-e7cb-44b1-9364-4b4cc065758a","Type":"ContainerDied","Data":"8eeb04b9bca179af4cc699e1d50f68238369bbd1fe9ecc0d5bc7f7cf763cb5ab"}
Jul 23 16:21:40.277443 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:21:40.277381    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afnf5cg" event={"ID":"ad0d1438-e7cb-44b1-9364-4b4cc065758a","Type":"ContainerStarted","Data":"5f2bab34b79d05905bf4324f33e5ed12898091d6967ac798ab62a9d40351d892"}
Jul 23 16:21:41.284510 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:21:41.284474    2553 generic.go:356] "Generic (PLEG): container finished" podID="ad0d1438-e7cb-44b1-9364-4b4cc065758a" containerID="d24b35140d0a23f77d549fe3842d03fa9007440d4df6f46ebf2a0ce99aeee338" exitCode=0
Jul 23 16:21:41.284975 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:21:41.284515    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afnf5cg" event={"ID":"ad0d1438-e7cb-44b1-9364-4b4cc065758a","Type":"ContainerDied","Data":"d24b35140d0a23f77d549fe3842d03fa9007440d4df6f46ebf2a0ce99aeee338"}
Jul 23 16:21:42.290804 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:21:42.290768    2553 generic.go:356] "Generic (PLEG): container finished" podID="ad0d1438-e7cb-44b1-9364-4b4cc065758a" containerID="20e58024cb086e78bbeaad980e92131730e7081986adad4cc5e292ea1f3139cb" exitCode=0
Jul 23 16:21:42.291279 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:21:42.290866    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afnf5cg" event={"ID":"ad0d1438-e7cb-44b1-9364-4b4cc065758a","Type":"ContainerDied","Data":"20e58024cb086e78bbeaad980e92131730e7081986adad4cc5e292ea1f3139cb"}
Jul 23 16:21:43.418122 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:21:43.418096    2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afnf5cg"
Jul 23 16:21:43.575435 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:21:43.575332    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ad0d1438-e7cb-44b1-9364-4b4cc065758a-util\") pod \"ad0d1438-e7cb-44b1-9364-4b4cc065758a\" (UID: \"ad0d1438-e7cb-44b1-9364-4b4cc065758a\") "
Jul 23 16:21:43.575435 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:21:43.575396    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jsczd\" (UniqueName: \"kubernetes.io/projected/ad0d1438-e7cb-44b1-9364-4b4cc065758a-kube-api-access-jsczd\") pod \"ad0d1438-e7cb-44b1-9364-4b4cc065758a\" (UID: \"ad0d1438-e7cb-44b1-9364-4b4cc065758a\") "
Jul 23 16:21:43.575678 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:21:43.575452    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ad0d1438-e7cb-44b1-9364-4b4cc065758a-bundle\") pod \"ad0d1438-e7cb-44b1-9364-4b4cc065758a\" (UID: \"ad0d1438-e7cb-44b1-9364-4b4cc065758a\") "
Jul 23 16:21:43.576148 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:21:43.576118    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ad0d1438-e7cb-44b1-9364-4b4cc065758a-bundle" (OuterVolumeSpecName: "bundle") pod "ad0d1438-e7cb-44b1-9364-4b4cc065758a" (UID: "ad0d1438-e7cb-44b1-9364-4b4cc065758a"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 16:21:43.577625 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:21:43.577600    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ad0d1438-e7cb-44b1-9364-4b4cc065758a-kube-api-access-jsczd" (OuterVolumeSpecName: "kube-api-access-jsczd") pod "ad0d1438-e7cb-44b1-9364-4b4cc065758a" (UID: "ad0d1438-e7cb-44b1-9364-4b4cc065758a"). InnerVolumeSpecName "kube-api-access-jsczd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 16:21:43.581117 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:21:43.581083    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ad0d1438-e7cb-44b1-9364-4b4cc065758a-util" (OuterVolumeSpecName: "util") pod "ad0d1438-e7cb-44b1-9364-4b4cc065758a" (UID: "ad0d1438-e7cb-44b1-9364-4b4cc065758a"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 16:21:43.675963 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:21:43.675923    2553 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ad0d1438-e7cb-44b1-9364-4b4cc065758a-util\") on node \"ip-10-0-143-166.ec2.internal\" DevicePath \"\""
Jul 23 16:21:43.675963 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:21:43.675957    2553 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jsczd\" (UniqueName: \"kubernetes.io/projected/ad0d1438-e7cb-44b1-9364-4b4cc065758a-kube-api-access-jsczd\") on node \"ip-10-0-143-166.ec2.internal\" DevicePath \"\""
Jul 23 16:21:43.675963 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:21:43.675967    2553 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ad0d1438-e7cb-44b1-9364-4b4cc065758a-bundle\") on node \"ip-10-0-143-166.ec2.internal\" DevicePath \"\""
Jul 23 16:21:44.306322 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:21:44.306292    2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afnf5cg"
Jul 23 16:21:44.306496 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:21:44.306318    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afnf5cg" event={"ID":"ad0d1438-e7cb-44b1-9364-4b4cc065758a","Type":"ContainerDied","Data":"5f2bab34b79d05905bf4324f33e5ed12898091d6967ac798ab62a9d40351d892"}
Jul 23 16:21:44.306496 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:21:44.306384    2553 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="5f2bab34b79d05905bf4324f33e5ed12898091d6967ac798ab62a9d40351d892"
Jul 23 16:21:56.342984 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:21:56.342948    2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-678945769f-69jmp"]
Jul 23 16:21:56.343419 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:21:56.343296    2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ad0d1438-e7cb-44b1-9364-4b4cc065758a" containerName="extract"
Jul 23 16:21:56.343419 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:21:56.343308    2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="ad0d1438-e7cb-44b1-9364-4b4cc065758a" containerName="extract"
Jul 23 16:21:56.343419 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:21:56.343318    2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ad0d1438-e7cb-44b1-9364-4b4cc065758a" containerName="util"
Jul 23 16:21:56.343419 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:21:56.343324    2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="ad0d1438-e7cb-44b1-9364-4b4cc065758a" containerName="util"
Jul 23 16:21:56.343419 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:21:56.343344    2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ad0d1438-e7cb-44b1-9364-4b4cc065758a" containerName="pull"
Jul 23 16:21:56.343419 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:21:56.343354    2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="ad0d1438-e7cb-44b1-9364-4b4cc065758a" containerName="pull"
Jul 23 16:21:56.343419 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:21:56.343415    2553 memory_manager.go:368] "RemoveStaleState removing state" podUID="ad0d1438-e7cb-44b1-9364-4b4cc065758a" containerName="extract"
Jul 23 16:21:56.349370 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:21:56.349350    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-678945769f-69jmp"
Jul 23 16:21:56.353757 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:21:56.353720    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Jul 23 16:21:56.354205 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:21:56.354184    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Jul 23 16:21:56.354302 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:21:56.354182    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Jul 23 16:21:56.354302 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:21:56.354266    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-p2hj9\""
Jul 23 16:21:56.354302 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:21:56.354209    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Jul 23 16:21:56.371236 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:21:56.371207    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-678945769f-69jmp"]
Jul 23 16:21:56.480600 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:21:56.480557    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a74ccce6-3ea9-4933-86e9-e2dbc5777b9a-tmp\") pod \"opendatahub-operator-controller-manager-678945769f-69jmp\" (UID: \"a74ccce6-3ea9-4933-86e9-e2dbc5777b9a\") " pod="opendatahub/opendatahub-operator-controller-manager-678945769f-69jmp"
Jul 23 16:21:56.480600 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:21:56.480599    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/a74ccce6-3ea9-4933-86e9-e2dbc5777b9a-webhook-cert\") pod \"opendatahub-operator-controller-manager-678945769f-69jmp\" (UID: \"a74ccce6-3ea9-4933-86e9-e2dbc5777b9a\") " pod="opendatahub/opendatahub-operator-controller-manager-678945769f-69jmp"
Jul 23 16:21:56.480865 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:21:56.480664    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/a74ccce6-3ea9-4933-86e9-e2dbc5777b9a-apiservice-cert\") pod \"opendatahub-operator-controller-manager-678945769f-69jmp\" (UID: \"a74ccce6-3ea9-4933-86e9-e2dbc5777b9a\") " pod="opendatahub/opendatahub-operator-controller-manager-678945769f-69jmp"
Jul 23 16:21:56.480865 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:21:56.480735    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c9x6t\" (UniqueName: \"kubernetes.io/projected/a74ccce6-3ea9-4933-86e9-e2dbc5777b9a-kube-api-access-c9x6t\") pod \"opendatahub-operator-controller-manager-678945769f-69jmp\" (UID: \"a74ccce6-3ea9-4933-86e9-e2dbc5777b9a\") " pod="opendatahub/opendatahub-operator-controller-manager-678945769f-69jmp"
Jul 23 16:21:56.480865 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:21:56.480786    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/a74ccce6-3ea9-4933-86e9-e2dbc5777b9a-manifests\") pod \"opendatahub-operator-controller-manager-678945769f-69jmp\" (UID: \"a74ccce6-3ea9-4933-86e9-e2dbc5777b9a\") " pod="opendatahub/opendatahub-operator-controller-manager-678945769f-69jmp"
Jul 23 16:21:56.581133 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:21:56.581098    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/a74ccce6-3ea9-4933-86e9-e2dbc5777b9a-manifests\") pod \"opendatahub-operator-controller-manager-678945769f-69jmp\" (UID: \"a74ccce6-3ea9-4933-86e9-e2dbc5777b9a\") " pod="opendatahub/opendatahub-operator-controller-manager-678945769f-69jmp"
Jul 23 16:21:56.581353 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:21:56.581147    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a74ccce6-3ea9-4933-86e9-e2dbc5777b9a-tmp\") pod \"opendatahub-operator-controller-manager-678945769f-69jmp\" (UID: \"a74ccce6-3ea9-4933-86e9-e2dbc5777b9a\") " pod="opendatahub/opendatahub-operator-controller-manager-678945769f-69jmp"
Jul 23 16:21:56.581353 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:21:56.581191    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/a74ccce6-3ea9-4933-86e9-e2dbc5777b9a-webhook-cert\") pod \"opendatahub-operator-controller-manager-678945769f-69jmp\" (UID: \"a74ccce6-3ea9-4933-86e9-e2dbc5777b9a\") " pod="opendatahub/opendatahub-operator-controller-manager-678945769f-69jmp"
Jul 23 16:21:56.581353 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:21:56.581227    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/a74ccce6-3ea9-4933-86e9-e2dbc5777b9a-apiservice-cert\") pod \"opendatahub-operator-controller-manager-678945769f-69jmp\" (UID: \"a74ccce6-3ea9-4933-86e9-e2dbc5777b9a\") " pod="opendatahub/opendatahub-operator-controller-manager-678945769f-69jmp"
Jul 23 16:21:56.581353 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:21:56.581267    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c9x6t\" (UniqueName: \"kubernetes.io/projected/a74ccce6-3ea9-4933-86e9-e2dbc5777b9a-kube-api-access-c9x6t\") pod \"opendatahub-operator-controller-manager-678945769f-69jmp\" (UID: \"a74ccce6-3ea9-4933-86e9-e2dbc5777b9a\") " pod="opendatahub/opendatahub-operator-controller-manager-678945769f-69jmp"
Jul 23 16:21:56.581598 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:21:56.581575    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/a74ccce6-3ea9-4933-86e9-e2dbc5777b9a-manifests\") pod \"opendatahub-operator-controller-manager-678945769f-69jmp\" (UID: \"a74ccce6-3ea9-4933-86e9-e2dbc5777b9a\") " pod="opendatahub/opendatahub-operator-controller-manager-678945769f-69jmp"
Jul 23 16:21:56.583552 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:21:56.583524    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a74ccce6-3ea9-4933-86e9-e2dbc5777b9a-tmp\") pod \"opendatahub-operator-controller-manager-678945769f-69jmp\" (UID: \"a74ccce6-3ea9-4933-86e9-e2dbc5777b9a\") " pod="opendatahub/opendatahub-operator-controller-manager-678945769f-69jmp"
Jul 23 16:21:56.583754 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:21:56.583739    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/a74ccce6-3ea9-4933-86e9-e2dbc5777b9a-apiservice-cert\") pod \"opendatahub-operator-controller-manager-678945769f-69jmp\" (UID: \"a74ccce6-3ea9-4933-86e9-e2dbc5777b9a\") " pod="opendatahub/opendatahub-operator-controller-manager-678945769f-69jmp"
Jul 23 16:21:56.583800 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:21:56.583760    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/a74ccce6-3ea9-4933-86e9-e2dbc5777b9a-webhook-cert\") pod \"opendatahub-operator-controller-manager-678945769f-69jmp\" (UID: \"a74ccce6-3ea9-4933-86e9-e2dbc5777b9a\") " pod="opendatahub/opendatahub-operator-controller-manager-678945769f-69jmp"
Jul 23 16:21:56.594001 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:21:56.593936    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c9x6t\" (UniqueName: \"kubernetes.io/projected/a74ccce6-3ea9-4933-86e9-e2dbc5777b9a-kube-api-access-c9x6t\") pod \"opendatahub-operator-controller-manager-678945769f-69jmp\" (UID: \"a74ccce6-3ea9-4933-86e9-e2dbc5777b9a\") " pod="opendatahub/opendatahub-operator-controller-manager-678945769f-69jmp"
Jul 23 16:21:56.660460 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:21:56.660411    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-678945769f-69jmp"
Jul 23 16:21:56.821774 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:21:56.821743    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-678945769f-69jmp"]
Jul 23 16:21:56.826087 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:21:56.826065    2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda74ccce6_3ea9_4933_86e9_e2dbc5777b9a.slice/crio-9dd34a472581aa152a981325074e748be95c585d1516c847db2c7514c40b8420 WatchSource:0}: Error finding container 9dd34a472581aa152a981325074e748be95c585d1516c847db2c7514c40b8420: Status 404 returned error can't find the container with id 9dd34a472581aa152a981325074e748be95c585d1516c847db2c7514c40b8420
Jul 23 16:21:57.364242 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:21:57.364207    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-678945769f-69jmp" event={"ID":"a74ccce6-3ea9-4933-86e9-e2dbc5777b9a","Type":"ContainerStarted","Data":"9dd34a472581aa152a981325074e748be95c585d1516c847db2c7514c40b8420"}
Jul 23 16:22:00.380233 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:22:00.380188    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-678945769f-69jmp" event={"ID":"a74ccce6-3ea9-4933-86e9-e2dbc5777b9a","Type":"ContainerStarted","Data":"81cfbec9a136574ca9a3c4178538fa28534d27a72789efdc820cecf9bdefec7a"}
Jul 23 16:22:01.387231 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:22:01.387115    2553 generic.go:356] "Generic (PLEG): container finished" podID="a74ccce6-3ea9-4933-86e9-e2dbc5777b9a" containerID="81cfbec9a136574ca9a3c4178538fa28534d27a72789efdc820cecf9bdefec7a" exitCode=0
Jul 23 16:22:01.387231 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:22:01.387161    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-678945769f-69jmp" event={"ID":"a74ccce6-3ea9-4933-86e9-e2dbc5777b9a","Type":"ContainerDied","Data":"81cfbec9a136574ca9a3c4178538fa28534d27a72789efdc820cecf9bdefec7a"}
Jul 23 16:22:02.393673 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:22:02.393634    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-678945769f-69jmp" event={"ID":"a74ccce6-3ea9-4933-86e9-e2dbc5777b9a","Type":"ContainerStarted","Data":"0cafb852bbf76fa9724c117150657f45aee0d7e1473754da85d455c8e408ae52"}
Jul 23 16:22:02.394076 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:22:02.393737    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-678945769f-69jmp"
Jul 23 16:22:02.416816 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:22:02.416770    2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-678945769f-69jmp" podStartSLOduration=1.980408079 podStartE2EDuration="6.416755117s" totalImagesPullingTime="3.257268819s" totalInitContainerRuntime="1.179078219s" isStatefulPod=false podCreationTimestamp="2026-07-23 16:21:56 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 16:22:02.415544132 +0000 UTC m=+404.280150261" watchObservedRunningTime="2026-07-23 16:22:02.416755117 +0000 UTC m=+404.281361244"
Jul 23 16:22:13.400130 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:22:13.400099    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-678945769f-69jmp"
Jul 23 16:22:15.802341 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:22:15.802307    2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-4gzgh"]
Jul 23 16:22:15.805799 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:22:15.805781    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-4gzgh"
Jul 23 16:22:15.808614 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:22:15.808591    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\""
Jul 23 16:22:15.808763 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:22:15.808625    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-nwj94\""
Jul 23 16:22:15.824226 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:22:15.824197    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-4gzgh"]
Jul 23 16:22:15.834859 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:22:15.834833    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/50c15f91-b24d-49ba-85af-4615ce9ab662-cert\") pod \"odh-model-controller-7998c67dc4-4gzgh\" (UID: \"50c15f91-b24d-49ba-85af-4615ce9ab662\") " pod="opendatahub/odh-model-controller-7998c67dc4-4gzgh"
Jul 23 16:22:15.835003 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:22:15.834863    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6rzjx\" (UniqueName: \"kubernetes.io/projected/50c15f91-b24d-49ba-85af-4615ce9ab662-kube-api-access-6rzjx\") pod \"odh-model-controller-7998c67dc4-4gzgh\" (UID: \"50c15f91-b24d-49ba-85af-4615ce9ab662\") " pod="opendatahub/odh-model-controller-7998c67dc4-4gzgh"
Jul 23 16:22:15.935699 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:22:15.935665    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/50c15f91-b24d-49ba-85af-4615ce9ab662-cert\") pod \"odh-model-controller-7998c67dc4-4gzgh\" (UID: \"50c15f91-b24d-49ba-85af-4615ce9ab662\") " pod="opendatahub/odh-model-controller-7998c67dc4-4gzgh"
Jul 23 16:22:15.935699 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:22:15.935703    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6rzjx\" (UniqueName: \"kubernetes.io/projected/50c15f91-b24d-49ba-85af-4615ce9ab662-kube-api-access-6rzjx\") pod \"odh-model-controller-7998c67dc4-4gzgh\" (UID: \"50c15f91-b24d-49ba-85af-4615ce9ab662\") " pod="opendatahub/odh-model-controller-7998c67dc4-4gzgh"
Jul 23 16:22:15.935918 ip-10-0-143-166 kubenswrapper[2553]: E0723 16:22:15.935822    2553 secret.go:189] Couldn't get secret opendatahub/odh-model-controller-webhook-cert: secret "odh-model-controller-webhook-cert" not found
Jul 23 16:22:15.935918 ip-10-0-143-166 kubenswrapper[2553]: E0723 16:22:15.935885    2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/50c15f91-b24d-49ba-85af-4615ce9ab662-cert podName:50c15f91-b24d-49ba-85af-4615ce9ab662 nodeName:}" failed. No retries permitted until 2026-07-23 16:22:16.435868143 +0000 UTC m=+418.300474253 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/50c15f91-b24d-49ba-85af-4615ce9ab662-cert") pod "odh-model-controller-7998c67dc4-4gzgh" (UID: "50c15f91-b24d-49ba-85af-4615ce9ab662") : secret "odh-model-controller-webhook-cert" not found
Jul 23 16:22:15.947730 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:22:15.947700    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6rzjx\" (UniqueName: \"kubernetes.io/projected/50c15f91-b24d-49ba-85af-4615ce9ab662-kube-api-access-6rzjx\") pod \"odh-model-controller-7998c67dc4-4gzgh\" (UID: \"50c15f91-b24d-49ba-85af-4615ce9ab662\") " pod="opendatahub/odh-model-controller-7998c67dc4-4gzgh"
Jul 23 16:22:16.438913 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:22:16.438877    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/50c15f91-b24d-49ba-85af-4615ce9ab662-cert\") pod \"odh-model-controller-7998c67dc4-4gzgh\" (UID: \"50c15f91-b24d-49ba-85af-4615ce9ab662\") " pod="opendatahub/odh-model-controller-7998c67dc4-4gzgh"
Jul 23 16:22:16.441325 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:22:16.441303    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/50c15f91-b24d-49ba-85af-4615ce9ab662-cert\") pod \"odh-model-controller-7998c67dc4-4gzgh\" (UID: \"50c15f91-b24d-49ba-85af-4615ce9ab662\") " pod="opendatahub/odh-model-controller-7998c67dc4-4gzgh"
Jul 23 16:22:16.541639 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:22:16.541602    2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-hw7h6"]
Jul 23 16:22:16.544935 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:22:16.544916    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-hw7h6"
Jul 23 16:22:16.547780 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:22:16.547757    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-dockercfg-s8d7d\""
Jul 23 16:22:16.547972 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:22:16.547955    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\""
Jul 23 16:22:16.568671 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:22:16.568648    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-hw7h6"]
Jul 23 16:22:16.640864 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:22:16.640830    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5z22b\" (UniqueName: \"kubernetes.io/projected/1dc8b88c-360e-483e-b896-6f0aa35b32fe-kube-api-access-5z22b\") pod \"model-serving-api-54d89bd5fc-hw7h6\" (UID: \"1dc8b88c-360e-483e-b896-6f0aa35b32fe\") " pod="opendatahub/model-serving-api-54d89bd5fc-hw7h6"
Jul 23 16:22:16.641044 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:22:16.640923    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1dc8b88c-360e-483e-b896-6f0aa35b32fe-tls-certs\") pod \"model-serving-api-54d89bd5fc-hw7h6\" (UID: \"1dc8b88c-360e-483e-b896-6f0aa35b32fe\") " pod="opendatahub/model-serving-api-54d89bd5fc-hw7h6"
Jul 23 16:22:16.716084 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:22:16.715997    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-4gzgh"
Jul 23 16:22:16.741484 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:22:16.741454    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5z22b\" (UniqueName: \"kubernetes.io/projected/1dc8b88c-360e-483e-b896-6f0aa35b32fe-kube-api-access-5z22b\") pod \"model-serving-api-54d89bd5fc-hw7h6\" (UID: \"1dc8b88c-360e-483e-b896-6f0aa35b32fe\") " pod="opendatahub/model-serving-api-54d89bd5fc-hw7h6"
Jul 23 16:22:16.742025 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:22:16.741758    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1dc8b88c-360e-483e-b896-6f0aa35b32fe-tls-certs\") pod \"model-serving-api-54d89bd5fc-hw7h6\" (UID: \"1dc8b88c-360e-483e-b896-6f0aa35b32fe\") " pod="opendatahub/model-serving-api-54d89bd5fc-hw7h6"
Jul 23 16:22:16.742025 ip-10-0-143-166 kubenswrapper[2553]: E0723 16:22:16.741878    2553 secret.go:189] Couldn't get secret opendatahub/model-serving-api-tls: secret "model-serving-api-tls" not found
Jul 23 16:22:16.742025 ip-10-0-143-166 kubenswrapper[2553]: E0723 16:22:16.741952    2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1dc8b88c-360e-483e-b896-6f0aa35b32fe-tls-certs podName:1dc8b88c-360e-483e-b896-6f0aa35b32fe nodeName:}" failed. No retries permitted until 2026-07-23 16:22:17.241931765 +0000 UTC m=+419.106537876 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/1dc8b88c-360e-483e-b896-6f0aa35b32fe-tls-certs") pod "model-serving-api-54d89bd5fc-hw7h6" (UID: "1dc8b88c-360e-483e-b896-6f0aa35b32fe") : secret "model-serving-api-tls" not found
Jul 23 16:22:16.751045 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:22:16.751016    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5z22b\" (UniqueName: \"kubernetes.io/projected/1dc8b88c-360e-483e-b896-6f0aa35b32fe-kube-api-access-5z22b\") pod \"model-serving-api-54d89bd5fc-hw7h6\" (UID: \"1dc8b88c-360e-483e-b896-6f0aa35b32fe\") " pod="opendatahub/model-serving-api-54d89bd5fc-hw7h6"
Jul 23 16:22:16.871108 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:22:16.870936    2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod50c15f91_b24d_49ba_85af_4615ce9ab662.slice/crio-903d2768f93f848ceebe936704fd4514b70f8239300c9ab16af5fbb1f463c87b WatchSource:0}: Error finding container 903d2768f93f848ceebe936704fd4514b70f8239300c9ab16af5fbb1f463c87b: Status 404 returned error can't find the container with id 903d2768f93f848ceebe936704fd4514b70f8239300c9ab16af5fbb1f463c87b
Jul 23 16:22:16.873277 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:22:16.873256    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-4gzgh"]
Jul 23 16:22:17.245081 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:22:17.245046    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1dc8b88c-360e-483e-b896-6f0aa35b32fe-tls-certs\") pod \"model-serving-api-54d89bd5fc-hw7h6\" (UID: \"1dc8b88c-360e-483e-b896-6f0aa35b32fe\") " pod="opendatahub/model-serving-api-54d89bd5fc-hw7h6"
Jul 23 16:22:17.247601 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:22:17.247572    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1dc8b88c-360e-483e-b896-6f0aa35b32fe-tls-certs\") pod \"model-serving-api-54d89bd5fc-hw7h6\" (UID: \"1dc8b88c-360e-483e-b896-6f0aa35b32fe\") " pod="opendatahub/model-serving-api-54d89bd5fc-hw7h6"
Jul 23 16:22:17.454825 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:22:17.454795    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-hw7h6"
Jul 23 16:22:17.460790 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:22:17.460762    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-4gzgh" event={"ID":"50c15f91-b24d-49ba-85af-4615ce9ab662","Type":"ContainerStarted","Data":"903d2768f93f848ceebe936704fd4514b70f8239300c9ab16af5fbb1f463c87b"}
Jul 23 16:22:17.585071 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:22:17.585037    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-hw7h6"]
Jul 23 16:22:17.587806 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:22:17.587773    2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1dc8b88c_360e_483e_b896_6f0aa35b32fe.slice/crio-6d2765e97125e7772c032809b2448787f1151ea5826b2721f76715810bf54f39 WatchSource:0}: Error finding container 6d2765e97125e7772c032809b2448787f1151ea5826b2721f76715810bf54f39: Status 404 returned error can't find the container with id 6d2765e97125e7772c032809b2448787f1151ea5826b2721f76715810bf54f39
Jul 23 16:22:18.468895 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:22:18.468853    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-hw7h6" event={"ID":"1dc8b88c-360e-483e-b896-6f0aa35b32fe","Type":"ContainerStarted","Data":"6d2765e97125e7772c032809b2448787f1151ea5826b2721f76715810bf54f39"}
Jul 23 16:22:20.480421 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:22:20.480383    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-hw7h6" event={"ID":"1dc8b88c-360e-483e-b896-6f0aa35b32fe","Type":"ContainerStarted","Data":"591c625f1877ccea4de2ad1ad69794e9beacbf8d64aa46da4c6f01068e1713c3"}
Jul 23 16:22:20.480924 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:22:20.480450    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-54d89bd5fc-hw7h6"
Jul 23 16:22:20.481905 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:22:20.481874    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-4gzgh" event={"ID":"50c15f91-b24d-49ba-85af-4615ce9ab662","Type":"ContainerStarted","Data":"fc0833fb1db438307b64e3873e570405dcea44afe59bce14c88a3962d9f51a5c"}
Jul 23 16:22:20.482017 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:22:20.481945    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-7998c67dc4-4gzgh"
Jul 23 16:22:20.497980 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:22:20.497931    2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/model-serving-api-54d89bd5fc-hw7h6" podStartSLOduration=2.117521988 podStartE2EDuration="4.497919286s" totalImagesPullingTime="2.380397298s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 16:22:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 16:22:20.496862118 +0000 UTC m=+422.361468262" watchObservedRunningTime="2026-07-23 16:22:20.497919286 +0000 UTC m=+422.362525414"
Jul 23 16:22:20.514872 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:22:20.514831    2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/odh-model-controller-7998c67dc4-4gzgh" podStartSLOduration=2.414314218 podStartE2EDuration="5.514817927s" totalImagesPullingTime="3.100503709s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 16:22:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 16:22:20.513207962 +0000 UTC m=+422.377814080" watchObservedRunningTime="2026-07-23 16:22:20.514817927 +0000 UTC m=+422.379424084"
Jul 23 16:22:21.039714 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:22:21.039685    2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-545d74bcdb-98x2h"]
Jul 23 16:22:21.042640 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:22:21.042620    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-545d74bcdb-98x2h"
Jul 23 16:22:21.045260 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:22:21.045237    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-gh92z\""
Jul 23 16:22:21.045373 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:22:21.045346    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Jul 23 16:22:21.046610 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:22:21.046591    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
Jul 23 16:22:21.054872 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:22:21.054850    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-545d74bcdb-98x2h"]
Jul 23 16:22:21.076703 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:22:21.076661    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/38c05ca6-e42d-478d-afed-b773f76733d8-tmp\") pod \"kube-auth-proxy-545d74bcdb-98x2h\" (UID: \"38c05ca6-e42d-478d-afed-b773f76733d8\") " pod="openshift-ingress/kube-auth-proxy-545d74bcdb-98x2h"
Jul 23 16:22:21.076861 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:22:21.076725    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bqnrm\" (UniqueName: \"kubernetes.io/projected/38c05ca6-e42d-478d-afed-b773f76733d8-kube-api-access-bqnrm\") pod \"kube-auth-proxy-545d74bcdb-98x2h\" (UID: \"38c05ca6-e42d-478d-afed-b773f76733d8\") " pod="openshift-ingress/kube-auth-proxy-545d74bcdb-98x2h"
Jul 23 16:22:21.076861 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:22:21.076806    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/38c05ca6-e42d-478d-afed-b773f76733d8-tls-certs\") pod \"kube-auth-proxy-545d74bcdb-98x2h\" (UID: \"38c05ca6-e42d-478d-afed-b773f76733d8\") " pod="openshift-ingress/kube-auth-proxy-545d74bcdb-98x2h"
Jul 23 16:22:21.177948 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:22:21.177907    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/38c05ca6-e42d-478d-afed-b773f76733d8-tmp\") pod \"kube-auth-proxy-545d74bcdb-98x2h\" (UID: \"38c05ca6-e42d-478d-afed-b773f76733d8\") " pod="openshift-ingress/kube-auth-proxy-545d74bcdb-98x2h"
Jul 23 16:22:21.178135 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:22:21.177957    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bqnrm\" (UniqueName: \"kubernetes.io/projected/38c05ca6-e42d-478d-afed-b773f76733d8-kube-api-access-bqnrm\") pod \"kube-auth-proxy-545d74bcdb-98x2h\" (UID: \"38c05ca6-e42d-478d-afed-b773f76733d8\") " pod="openshift-ingress/kube-auth-proxy-545d74bcdb-98x2h"
Jul 23 16:22:21.178135 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:22:21.178000    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/38c05ca6-e42d-478d-afed-b773f76733d8-tls-certs\") pod \"kube-auth-proxy-545d74bcdb-98x2h\" (UID: \"38c05ca6-e42d-478d-afed-b773f76733d8\") " pod="openshift-ingress/kube-auth-proxy-545d74bcdb-98x2h"
Jul 23 16:22:21.180306 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:22:21.180277    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/38c05ca6-e42d-478d-afed-b773f76733d8-tmp\") pod \"kube-auth-proxy-545d74bcdb-98x2h\" (UID: \"38c05ca6-e42d-478d-afed-b773f76733d8\") " pod="openshift-ingress/kube-auth-proxy-545d74bcdb-98x2h"
Jul 23 16:22:21.180500 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:22:21.180480    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/38c05ca6-e42d-478d-afed-b773f76733d8-tls-certs\") pod \"kube-auth-proxy-545d74bcdb-98x2h\" (UID: \"38c05ca6-e42d-478d-afed-b773f76733d8\") " pod="openshift-ingress/kube-auth-proxy-545d74bcdb-98x2h"
Jul 23 16:22:21.186160 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:22:21.186137    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bqnrm\" (UniqueName: \"kubernetes.io/projected/38c05ca6-e42d-478d-afed-b773f76733d8-kube-api-access-bqnrm\") pod \"kube-auth-proxy-545d74bcdb-98x2h\" (UID: \"38c05ca6-e42d-478d-afed-b773f76733d8\") " pod="openshift-ingress/kube-auth-proxy-545d74bcdb-98x2h"
Jul 23 16:22:21.352200 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:22:21.352088    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-545d74bcdb-98x2h"
Jul 23 16:22:21.509577 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:22:21.509553    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-545d74bcdb-98x2h"]
Jul 23 16:22:21.511406 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:22:21.511378    2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod38c05ca6_e42d_478d_afed_b773f76733d8.slice/crio-5d8e095e50e362952484d45a899b29e4c1d87a8ed9daf5ac271b4d9d2760b839 WatchSource:0}: Error finding container 5d8e095e50e362952484d45a899b29e4c1d87a8ed9daf5ac271b4d9d2760b839: Status 404 returned error can't find the container with id 5d8e095e50e362952484d45a899b29e4c1d87a8ed9daf5ac271b4d9d2760b839
Jul 23 16:22:22.492405 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:22:22.492371    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-545d74bcdb-98x2h" event={"ID":"38c05ca6-e42d-478d-afed-b773f76733d8","Type":"ContainerStarted","Data":"5d8e095e50e362952484d45a899b29e4c1d87a8ed9daf5ac271b4d9d2760b839"}
Jul 23 16:22:23.671898 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:22:23.671867    2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-598cd96689-4jxg8"]
Jul 23 16:22:23.675222 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:22:23.675198    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-598cd96689-4jxg8"
Jul 23 16:22:23.681380 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:22:23.681354    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\""
Jul 23 16:22:23.682130 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:22:23.682111    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Jul 23 16:22:23.682691 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:22:23.682656    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\""
Jul 23 16:22:23.682807 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:22:23.682690    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\""
Jul 23 16:22:23.682960 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:22:23.682941    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Jul 23 16:22:23.683106 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:22:23.683026    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-z65b7\""
Jul 23 16:22:23.692424 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:22:23.692395    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-598cd96689-4jxg8"]
Jul 23 16:22:23.703693 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:22:23.703662    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/cf7332fa-4994-433e-8ffa-eb1472f3ceba-metrics-cert\") pod \"lws-controller-manager-598cd96689-4jxg8\" (UID: \"cf7332fa-4994-433e-8ffa-eb1472f3ceba\") " pod="openshift-lws-operator/lws-controller-manager-598cd96689-4jxg8"
Jul 23 16:22:23.703833 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:22:23.703720    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/cf7332fa-4994-433e-8ffa-eb1472f3ceba-cert\") pod \"lws-controller-manager-598cd96689-4jxg8\" (UID: \"cf7332fa-4994-433e-8ffa-eb1472f3ceba\") " pod="openshift-lws-operator/lws-controller-manager-598cd96689-4jxg8"
Jul 23 16:22:23.703833 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:22:23.703751    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fsfh8\" (UniqueName: \"kubernetes.io/projected/cf7332fa-4994-433e-8ffa-eb1472f3ceba-kube-api-access-fsfh8\") pod \"lws-controller-manager-598cd96689-4jxg8\" (UID: \"cf7332fa-4994-433e-8ffa-eb1472f3ceba\") " pod="openshift-lws-operator/lws-controller-manager-598cd96689-4jxg8"
Jul 23 16:22:23.703833 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:22:23.703800    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/cf7332fa-4994-433e-8ffa-eb1472f3ceba-manager-config\") pod \"lws-controller-manager-598cd96689-4jxg8\" (UID: \"cf7332fa-4994-433e-8ffa-eb1472f3ceba\") " pod="openshift-lws-operator/lws-controller-manager-598cd96689-4jxg8"
Jul 23 16:22:23.804675 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:22:23.804638    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/cf7332fa-4994-433e-8ffa-eb1472f3ceba-cert\") pod \"lws-controller-manager-598cd96689-4jxg8\" (UID: \"cf7332fa-4994-433e-8ffa-eb1472f3ceba\") " pod="openshift-lws-operator/lws-controller-manager-598cd96689-4jxg8"
Jul 23 16:22:23.804869 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:22:23.804686    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fsfh8\" (UniqueName: \"kubernetes.io/projected/cf7332fa-4994-433e-8ffa-eb1472f3ceba-kube-api-access-fsfh8\") pod \"lws-controller-manager-598cd96689-4jxg8\" (UID: \"cf7332fa-4994-433e-8ffa-eb1472f3ceba\") " pod="openshift-lws-operator/lws-controller-manager-598cd96689-4jxg8"
Jul 23 16:22:23.804949 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:22:23.804867    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/cf7332fa-4994-433e-8ffa-eb1472f3ceba-manager-config\") pod \"lws-controller-manager-598cd96689-4jxg8\" (UID: \"cf7332fa-4994-433e-8ffa-eb1472f3ceba\") " pod="openshift-lws-operator/lws-controller-manager-598cd96689-4jxg8"
Jul 23 16:22:23.805028 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:22:23.805007    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/cf7332fa-4994-433e-8ffa-eb1472f3ceba-metrics-cert\") pod \"lws-controller-manager-598cd96689-4jxg8\" (UID: \"cf7332fa-4994-433e-8ffa-eb1472f3ceba\") " pod="openshift-lws-operator/lws-controller-manager-598cd96689-4jxg8"
Jul 23 16:22:23.805710 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:22:23.805680    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/cf7332fa-4994-433e-8ffa-eb1472f3ceba-manager-config\") pod \"lws-controller-manager-598cd96689-4jxg8\" (UID: \"cf7332fa-4994-433e-8ffa-eb1472f3ceba\") " pod="openshift-lws-operator/lws-controller-manager-598cd96689-4jxg8"
Jul 23 16:22:23.807891 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:22:23.807842    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/cf7332fa-4994-433e-8ffa-eb1472f3ceba-metrics-cert\") pod \"lws-controller-manager-598cd96689-4jxg8\" (UID: \"cf7332fa-4994-433e-8ffa-eb1472f3ceba\") " pod="openshift-lws-operator/lws-controller-manager-598cd96689-4jxg8"
Jul 23 16:22:23.808044 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:22:23.808003    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/cf7332fa-4994-433e-8ffa-eb1472f3ceba-cert\") pod \"lws-controller-manager-598cd96689-4jxg8\" (UID: \"cf7332fa-4994-433e-8ffa-eb1472f3ceba\") " pod="openshift-lws-operator/lws-controller-manager-598cd96689-4jxg8"
Jul 23 16:22:23.821648 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:22:23.821612    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fsfh8\" (UniqueName: \"kubernetes.io/projected/cf7332fa-4994-433e-8ffa-eb1472f3ceba-kube-api-access-fsfh8\") pod \"lws-controller-manager-598cd96689-4jxg8\" (UID: \"cf7332fa-4994-433e-8ffa-eb1472f3ceba\") " pod="openshift-lws-operator/lws-controller-manager-598cd96689-4jxg8"
Jul 23 16:22:23.987141 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:22:23.987053    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-598cd96689-4jxg8"
Jul 23 16:22:24.421785 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:22:24.421763    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-598cd96689-4jxg8"]
Jul 23 16:22:24.423565 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:22:24.423531    2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcf7332fa_4994_433e_8ffa_eb1472f3ceba.slice/crio-56facc62a4b821e4b0b02f672c646830bf09866b6fcf1a5f8308de7b2c5f93ee WatchSource:0}: Error finding container 56facc62a4b821e4b0b02f672c646830bf09866b6fcf1a5f8308de7b2c5f93ee: Status 404 returned error can't find the container with id 56facc62a4b821e4b0b02f672c646830bf09866b6fcf1a5f8308de7b2c5f93ee
Jul 23 16:22:24.503481 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:22:24.503442    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-545d74bcdb-98x2h" event={"ID":"38c05ca6-e42d-478d-afed-b773f76733d8","Type":"ContainerStarted","Data":"e9327b8a7be0ff795ccc6be2e2c75d085878a0d5abbe489f994030f4800b40c9"}
Jul 23 16:22:24.504696 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:22:24.504667    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-598cd96689-4jxg8" event={"ID":"cf7332fa-4994-433e-8ffa-eb1472f3ceba","Type":"ContainerStarted","Data":"56facc62a4b821e4b0b02f672c646830bf09866b6fcf1a5f8308de7b2c5f93ee"}
Jul 23 16:22:24.536026 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:22:24.535914    2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-545d74bcdb-98x2h" podStartSLOduration=0.717984624 podStartE2EDuration="3.535899702s" totalImagesPullingTime="2.817915078s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 16:22:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 16:22:24.533700227 +0000 UTC m=+426.398306357" watchObservedRunningTime="2026-07-23 16:22:24.535899702 +0000 UTC m=+426.400505838"
Jul 23 16:22:27.520711 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:22:27.520667    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-598cd96689-4jxg8" event={"ID":"cf7332fa-4994-433e-8ffa-eb1472f3ceba","Type":"ContainerStarted","Data":"34bdcfe072486df10822395337dae22d236d0e799e1f2c5baf9d4d11c1fe2afe"}
Jul 23 16:22:27.521087 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:22:27.520773    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-598cd96689-4jxg8"
Jul 23 16:22:27.551738 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:22:27.551682    2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-598cd96689-4jxg8" podStartSLOduration=2.033599282 podStartE2EDuration="4.551665202s" totalImagesPullingTime="2.51806592s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 16:22:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 16:22:27.550439125 +0000 UTC m=+429.415045252" watchObservedRunningTime="2026-07-23 16:22:27.551665202 +0000 UTC m=+429.416271330"
Jul 23 16:22:31.489615 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:22:31.489583    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-7998c67dc4-4gzgh"
Jul 23 16:22:31.491628 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:22:31.491609    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-54d89bd5fc-hw7h6"
Jul 23 16:22:38.527242 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:22:38.527206    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-598cd96689-4jxg8"
Jul 23 16:23:33.029309 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:23:33.029272    2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7372f54"]
Jul 23 16:23:33.032777 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:23:33.032760    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7372f54"
Jul 23 16:23:33.035548 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:23:33.035524    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 23 16:23:33.035671 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:23:33.035554    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 23 16:23:33.036699 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:23:33.036684    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-tgxk6\""
Jul 23 16:23:33.041577 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:23:33.041555    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7372f54"]
Jul 23 16:23:33.088461 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:23:33.088421    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5bb96e52-7c69-43a2-a110-9d59c6a1f560-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7372f54\" (UID: \"5bb96e52-7c69-43a2-a110-9d59c6a1f560\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7372f54"
Jul 23 16:23:33.088461 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:23:33.088463    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5bb96e52-7c69-43a2-a110-9d59c6a1f560-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7372f54\" (UID: \"5bb96e52-7c69-43a2-a110-9d59c6a1f560\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7372f54"
Jul 23 16:23:33.088684 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:23:33.088495    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7nm68\" (UniqueName: \"kubernetes.io/projected/5bb96e52-7c69-43a2-a110-9d59c6a1f560-kube-api-access-7nm68\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7372f54\" (UID: \"5bb96e52-7c69-43a2-a110-9d59c6a1f560\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7372f54"
Jul 23 16:23:33.189771 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:23:33.189736    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5bb96e52-7c69-43a2-a110-9d59c6a1f560-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7372f54\" (UID: \"5bb96e52-7c69-43a2-a110-9d59c6a1f560\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7372f54"
Jul 23 16:23:33.189930 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:23:33.189777    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5bb96e52-7c69-43a2-a110-9d59c6a1f560-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7372f54\" (UID: \"5bb96e52-7c69-43a2-a110-9d59c6a1f560\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7372f54"
Jul 23 16:23:33.189930 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:23:33.189801    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7nm68\" (UniqueName: \"kubernetes.io/projected/5bb96e52-7c69-43a2-a110-9d59c6a1f560-kube-api-access-7nm68\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7372f54\" (UID: \"5bb96e52-7c69-43a2-a110-9d59c6a1f560\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7372f54"
Jul 23 16:23:33.190155 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:23:33.190136    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5bb96e52-7c69-43a2-a110-9d59c6a1f560-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7372f54\" (UID: \"5bb96e52-7c69-43a2-a110-9d59c6a1f560\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7372f54"
Jul 23 16:23:33.190232 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:23:33.190222    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5bb96e52-7c69-43a2-a110-9d59c6a1f560-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7372f54\" (UID: \"5bb96e52-7c69-43a2-a110-9d59c6a1f560\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7372f54"
Jul 23 16:23:33.198920 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:23:33.198885    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7nm68\" (UniqueName: \"kubernetes.io/projected/5bb96e52-7c69-43a2-a110-9d59c6a1f560-kube-api-access-7nm68\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7372f54\" (UID: \"5bb96e52-7c69-43a2-a110-9d59c6a1f560\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7372f54"
Jul 23 16:23:33.343605 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:23:33.343519    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7372f54"
Jul 23 16:23:33.480256 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:23:33.480229    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7372f54"]
Jul 23 16:23:33.482697 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:23:33.482673    2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5bb96e52_7c69_43a2_a110_9d59c6a1f560.slice/crio-4bac7b8f97f656e2f6bab97927e97df026cd2044915bc22c067b3be37365fd00 WatchSource:0}: Error finding container 4bac7b8f97f656e2f6bab97927e97df026cd2044915bc22c067b3be37365fd00: Status 404 returned error can't find the container with id 4bac7b8f97f656e2f6bab97927e97df026cd2044915bc22c067b3be37365fd00
Jul 23 16:23:33.633891 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:23:33.633817    2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0fw8x9"]
Jul 23 16:23:33.637126 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:23:33.637108    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0fw8x9"
Jul 23 16:23:33.645812 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:23:33.645781    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0fw8x9"]
Jul 23 16:23:33.693625 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:23:33.693594    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8de7a45c-439c-49fe-ab2e-80ad09d5dbc5-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0fw8x9\" (UID: \"8de7a45c-439c-49fe-ab2e-80ad09d5dbc5\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0fw8x9"
Jul 23 16:23:33.693777 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:23:33.693630    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ggmtj\" (UniqueName: \"kubernetes.io/projected/8de7a45c-439c-49fe-ab2e-80ad09d5dbc5-kube-api-access-ggmtj\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0fw8x9\" (UID: \"8de7a45c-439c-49fe-ab2e-80ad09d5dbc5\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0fw8x9"
Jul 23 16:23:33.693777 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:23:33.693654    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8de7a45c-439c-49fe-ab2e-80ad09d5dbc5-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0fw8x9\" (UID: \"8de7a45c-439c-49fe-ab2e-80ad09d5dbc5\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0fw8x9"
Jul 23 16:23:33.794468 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:23:33.794434    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8de7a45c-439c-49fe-ab2e-80ad09d5dbc5-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0fw8x9\" (UID: \"8de7a45c-439c-49fe-ab2e-80ad09d5dbc5\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0fw8x9"
Jul 23 16:23:33.794468 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:23:33.794472    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ggmtj\" (UniqueName: \"kubernetes.io/projected/8de7a45c-439c-49fe-ab2e-80ad09d5dbc5-kube-api-access-ggmtj\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0fw8x9\" (UID: \"8de7a45c-439c-49fe-ab2e-80ad09d5dbc5\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0fw8x9"
Jul 23 16:23:33.794679 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:23:33.794490    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8de7a45c-439c-49fe-ab2e-80ad09d5dbc5-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0fw8x9\" (UID: \"8de7a45c-439c-49fe-ab2e-80ad09d5dbc5\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0fw8x9"
Jul 23 16:23:33.794912 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:23:33.794893    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8de7a45c-439c-49fe-ab2e-80ad09d5dbc5-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0fw8x9\" (UID: \"8de7a45c-439c-49fe-ab2e-80ad09d5dbc5\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0fw8x9"
Jul 23 16:23:33.794948 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:23:33.794903    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8de7a45c-439c-49fe-ab2e-80ad09d5dbc5-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0fw8x9\" (UID: \"8de7a45c-439c-49fe-ab2e-80ad09d5dbc5\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0fw8x9"
Jul 23 16:23:33.803716 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:23:33.803693    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ggmtj\" (UniqueName: \"kubernetes.io/projected/8de7a45c-439c-49fe-ab2e-80ad09d5dbc5-kube-api-access-ggmtj\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0fw8x9\" (UID: \"8de7a45c-439c-49fe-ab2e-80ad09d5dbc5\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0fw8x9"
Jul 23 16:23:33.824986 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:23:33.824950    2553 generic.go:356] "Generic (PLEG): container finished" podID="5bb96e52-7c69-43a2-a110-9d59c6a1f560" containerID="d85adcc924ec1923b6f9449563e0dc3d1b259ad911e0bd0d35c1452cd457b4f4" exitCode=0
Jul 23 16:23:33.825138 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:23:33.825039    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7372f54" event={"ID":"5bb96e52-7c69-43a2-a110-9d59c6a1f560","Type":"ContainerDied","Data":"d85adcc924ec1923b6f9449563e0dc3d1b259ad911e0bd0d35c1452cd457b4f4"}
Jul 23 16:23:33.825138 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:23:33.825087    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7372f54" event={"ID":"5bb96e52-7c69-43a2-a110-9d59c6a1f560","Type":"ContainerStarted","Data":"4bac7b8f97f656e2f6bab97927e97df026cd2044915bc22c067b3be37365fd00"}
Jul 23 16:23:33.981981 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:23:33.981946    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0fw8x9"
Jul 23 16:23:34.131866 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:23:34.131802    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0fw8x9"]
Jul 23 16:23:34.134577 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:23:34.134546    2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8de7a45c_439c_49fe_ab2e_80ad09d5dbc5.slice/crio-8ad0d559d384b2c1559b8b9a03f14577402981391fd681579d56552ad325004a WatchSource:0}: Error finding container 8ad0d559d384b2c1559b8b9a03f14577402981391fd681579d56552ad325004a: Status 404 returned error can't find the container with id 8ad0d559d384b2c1559b8b9a03f14577402981391fd681579d56552ad325004a
Jul 23 16:23:34.144813 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:23:34.144785    2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759bkr7t"]
Jul 23 16:23:34.148319 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:23:34.148300    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759bkr7t"
Jul 23 16:23:34.170328 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:23:34.170291    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759bkr7t"]
Jul 23 16:23:34.198608 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:23:34.198579    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/fe997029-66c5-4d41-8efc-96d5b847af84-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759bkr7t\" (UID: \"fe997029-66c5-4d41-8efc-96d5b847af84\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759bkr7t"
Jul 23 16:23:34.198726 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:23:34.198632    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/fe997029-66c5-4d41-8efc-96d5b847af84-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759bkr7t\" (UID: \"fe997029-66c5-4d41-8efc-96d5b847af84\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759bkr7t"
Jul 23 16:23:34.198767 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:23:34.198740    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pb8s9\" (UniqueName: \"kubernetes.io/projected/fe997029-66c5-4d41-8efc-96d5b847af84-kube-api-access-pb8s9\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759bkr7t\" (UID: \"fe997029-66c5-4d41-8efc-96d5b847af84\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759bkr7t"
Jul 23 16:23:34.300351 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:23:34.300307    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/fe997029-66c5-4d41-8efc-96d5b847af84-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759bkr7t\" (UID: \"fe997029-66c5-4d41-8efc-96d5b847af84\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759bkr7t"
Jul 23 16:23:34.300351 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:23:34.300352    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/fe997029-66c5-4d41-8efc-96d5b847af84-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759bkr7t\" (UID: \"fe997029-66c5-4d41-8efc-96d5b847af84\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759bkr7t"
Jul 23 16:23:34.300567 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:23:34.300385    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pb8s9\" (UniqueName: \"kubernetes.io/projected/fe997029-66c5-4d41-8efc-96d5b847af84-kube-api-access-pb8s9\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759bkr7t\" (UID: \"fe997029-66c5-4d41-8efc-96d5b847af84\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759bkr7t"
Jul 23 16:23:34.300727 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:23:34.300706    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/fe997029-66c5-4d41-8efc-96d5b847af84-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759bkr7t\" (UID: \"fe997029-66c5-4d41-8efc-96d5b847af84\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759bkr7t"
Jul 23 16:23:34.300764 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:23:34.300718    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/fe997029-66c5-4d41-8efc-96d5b847af84-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759bkr7t\" (UID: \"fe997029-66c5-4d41-8efc-96d5b847af84\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759bkr7t"
Jul 23 16:23:34.311128 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:23:34.311099    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pb8s9\" (UniqueName: \"kubernetes.io/projected/fe997029-66c5-4d41-8efc-96d5b847af84-kube-api-access-pb8s9\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759bkr7t\" (UID: \"fe997029-66c5-4d41-8efc-96d5b847af84\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759bkr7t"
Jul 23 16:23:34.434420 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:23:34.434385    2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1j2mxz"]
Jul 23 16:23:34.437850 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:23:34.437831    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1j2mxz"
Jul 23 16:23:34.445685 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:23:34.445657    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1j2mxz"]
Jul 23 16:23:34.479330 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:23:34.479296    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759bkr7t"
Jul 23 16:23:34.502508 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:23:34.502476    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/92310d06-adf5-4258-91a1-4d4f0185c1b0-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1j2mxz\" (UID: \"92310d06-adf5-4258-91a1-4d4f0185c1b0\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1j2mxz"
Jul 23 16:23:34.502643 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:23:34.502542    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/92310d06-adf5-4258-91a1-4d4f0185c1b0-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1j2mxz\" (UID: \"92310d06-adf5-4258-91a1-4d4f0185c1b0\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1j2mxz"
Jul 23 16:23:34.502643 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:23:34.502577    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lxbd7\" (UniqueName: \"kubernetes.io/projected/92310d06-adf5-4258-91a1-4d4f0185c1b0-kube-api-access-lxbd7\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1j2mxz\" (UID: \"92310d06-adf5-4258-91a1-4d4f0185c1b0\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1j2mxz"
Jul 23 16:23:34.603750 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:23:34.603712    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/92310d06-adf5-4258-91a1-4d4f0185c1b0-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1j2mxz\" (UID: \"92310d06-adf5-4258-91a1-4d4f0185c1b0\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1j2mxz"
Jul 23 16:23:34.603948 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:23:34.603774    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/92310d06-adf5-4258-91a1-4d4f0185c1b0-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1j2mxz\" (UID: \"92310d06-adf5-4258-91a1-4d4f0185c1b0\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1j2mxz"
Jul 23 16:23:34.603948 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:23:34.603819    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lxbd7\" (UniqueName: \"kubernetes.io/projected/92310d06-adf5-4258-91a1-4d4f0185c1b0-kube-api-access-lxbd7\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1j2mxz\" (UID: \"92310d06-adf5-4258-91a1-4d4f0185c1b0\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1j2mxz"
Jul 23 16:23:34.604572 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:23:34.604152    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/92310d06-adf5-4258-91a1-4d4f0185c1b0-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1j2mxz\" (UID: \"92310d06-adf5-4258-91a1-4d4f0185c1b0\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1j2mxz"
Jul 23 16:23:34.604572 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:23:34.604522    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/92310d06-adf5-4258-91a1-4d4f0185c1b0-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1j2mxz\" (UID: \"92310d06-adf5-4258-91a1-4d4f0185c1b0\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1j2mxz"
Jul 23 16:23:34.613315 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:23:34.613282    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lxbd7\" (UniqueName: \"kubernetes.io/projected/92310d06-adf5-4258-91a1-4d4f0185c1b0-kube-api-access-lxbd7\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1j2mxz\" (UID: \"92310d06-adf5-4258-91a1-4d4f0185c1b0\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1j2mxz"
Jul 23 16:23:34.618304 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:23:34.618279    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759bkr7t"]
Jul 23 16:23:34.620254 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:23:34.620223    2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfe997029_66c5_4d41_8efc_96d5b847af84.slice/crio-55b2be0f726942f70d2755f77aea4bc4ad3fa1fc77a285ddcc4721911c3bd18c WatchSource:0}: Error finding container 55b2be0f726942f70d2755f77aea4bc4ad3fa1fc77a285ddcc4721911c3bd18c: Status 404 returned error can't find the container with id 55b2be0f726942f70d2755f77aea4bc4ad3fa1fc77a285ddcc4721911c3bd18c
Jul 23 16:23:34.748822 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:23:34.748789    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1j2mxz"
Jul 23 16:23:34.833134 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:23:34.833102    2553 generic.go:356] "Generic (PLEG): container finished" podID="fe997029-66c5-4d41-8efc-96d5b847af84" containerID="2dd10ddd5e222bf0279a9cebeb8999a68fa6f8cdb5232dc49c0e4c5f3c305de0" exitCode=0
Jul 23 16:23:34.833483 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:23:34.833447    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759bkr7t" event={"ID":"fe997029-66c5-4d41-8efc-96d5b847af84","Type":"ContainerDied","Data":"2dd10ddd5e222bf0279a9cebeb8999a68fa6f8cdb5232dc49c0e4c5f3c305de0"}
Jul 23 16:23:34.833596 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:23:34.833553    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759bkr7t" event={"ID":"fe997029-66c5-4d41-8efc-96d5b847af84","Type":"ContainerStarted","Data":"55b2be0f726942f70d2755f77aea4bc4ad3fa1fc77a285ddcc4721911c3bd18c"}
Jul 23 16:23:34.835129 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:23:34.835101    2553 generic.go:356] "Generic (PLEG): container finished" podID="8de7a45c-439c-49fe-ab2e-80ad09d5dbc5" containerID="ba65a2403ca56c764b7daaba4b6c7f54b970f44c72650c107a9fd2b6e2ab9b06" exitCode=0
Jul 23 16:23:34.835236 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:23:34.835156    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0fw8x9" event={"ID":"8de7a45c-439c-49fe-ab2e-80ad09d5dbc5","Type":"ContainerDied","Data":"ba65a2403ca56c764b7daaba4b6c7f54b970f44c72650c107a9fd2b6e2ab9b06"}
Jul 23 16:23:34.835236 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:23:34.835231    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0fw8x9" event={"ID":"8de7a45c-439c-49fe-ab2e-80ad09d5dbc5","Type":"ContainerStarted","Data":"8ad0d559d384b2c1559b8b9a03f14577402981391fd681579d56552ad325004a"}
Jul 23 16:23:34.899080 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:23:34.899050    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1j2mxz"]
Jul 23 16:23:34.930072 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:23:34.930031    2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod92310d06_adf5_4258_91a1_4d4f0185c1b0.slice/crio-47dc6a0825157cc9f6375d14e5b4623f0e44b056a1cfac9cc160fe3355a8ca9d WatchSource:0}: Error finding container 47dc6a0825157cc9f6375d14e5b4623f0e44b056a1cfac9cc160fe3355a8ca9d: Status 404 returned error can't find the container with id 47dc6a0825157cc9f6375d14e5b4623f0e44b056a1cfac9cc160fe3355a8ca9d
Jul 23 16:23:35.844505 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:23:35.844473    2553 generic.go:356] "Generic (PLEG): container finished" podID="92310d06-adf5-4258-91a1-4d4f0185c1b0" containerID="712b2b0d102e96a36283ed59c46d2e1ab031fc47abe6872f519c588a968a5229" exitCode=0
Jul 23 16:23:35.844853 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:23:35.844596    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1j2mxz" event={"ID":"92310d06-adf5-4258-91a1-4d4f0185c1b0","Type":"ContainerDied","Data":"712b2b0d102e96a36283ed59c46d2e1ab031fc47abe6872f519c588a968a5229"}
Jul 23 16:23:35.844853 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:23:35.844654    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1j2mxz" event={"ID":"92310d06-adf5-4258-91a1-4d4f0185c1b0","Type":"ContainerStarted","Data":"47dc6a0825157cc9f6375d14e5b4623f0e44b056a1cfac9cc160fe3355a8ca9d"}
Jul 23 16:23:35.848746 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:23:35.848718    2553 generic.go:356] "Generic (PLEG): container finished" podID="5bb96e52-7c69-43a2-a110-9d59c6a1f560" containerID="8d04595452f94f80afc71435ca9fce52b59fd9b0e4b9430579d87b48ca653228" exitCode=0
Jul 23 16:23:35.848856 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:23:35.848770    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7372f54" event={"ID":"5bb96e52-7c69-43a2-a110-9d59c6a1f560","Type":"ContainerDied","Data":"8d04595452f94f80afc71435ca9fce52b59fd9b0e4b9430579d87b48ca653228"}
Jul 23 16:23:36.855440 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:23:36.855404    2553 generic.go:356] "Generic (PLEG): container finished" podID="8de7a45c-439c-49fe-ab2e-80ad09d5dbc5" containerID="facdb76026387332a2e4a93294e3debe4023f325ebaeacb4281dcb8b4d00a518" exitCode=0
Jul 23 16:23:36.855840 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:23:36.855471    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0fw8x9" event={"ID":"8de7a45c-439c-49fe-ab2e-80ad09d5dbc5","Type":"ContainerDied","Data":"facdb76026387332a2e4a93294e3debe4023f325ebaeacb4281dcb8b4d00a518"}
Jul 23 16:23:36.857775 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:23:36.857746    2553 generic.go:356] "Generic (PLEG): container finished" podID="5bb96e52-7c69-43a2-a110-9d59c6a1f560" containerID="3d043b4b4e9259f336fd842e51d8ddaa123d6b41af5f0b3828cbf0a297d7d180" exitCode=0
Jul 23 16:23:36.857873 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:23:36.857828    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7372f54" event={"ID":"5bb96e52-7c69-43a2-a110-9d59c6a1f560","Type":"ContainerDied","Data":"3d043b4b4e9259f336fd842e51d8ddaa123d6b41af5f0b3828cbf0a297d7d180"}
Jul 23 16:23:36.859502 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:23:36.859474    2553 generic.go:356] "Generic (PLEG): container finished" podID="fe997029-66c5-4d41-8efc-96d5b847af84" containerID="43f68431e520e4a891530317e3dac34086c67c735a00f223d9588220fbcc8c80" exitCode=0
Jul 23 16:23:36.859502 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:23:36.859497    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759bkr7t" event={"ID":"fe997029-66c5-4d41-8efc-96d5b847af84","Type":"ContainerDied","Data":"43f68431e520e4a891530317e3dac34086c67c735a00f223d9588220fbcc8c80"}
Jul 23 16:23:37.865903 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:23:37.865865    2553 generic.go:356] "Generic (PLEG): container finished" podID="fe997029-66c5-4d41-8efc-96d5b847af84" containerID="d261665acec885755717ad3ebc0a06655796a23e5eabaf81ca7fc58122c1a702" exitCode=0
Jul 23 16:23:37.866324 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:23:37.865908    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759bkr7t" event={"ID":"fe997029-66c5-4d41-8efc-96d5b847af84","Type":"ContainerDied","Data":"d261665acec885755717ad3ebc0a06655796a23e5eabaf81ca7fc58122c1a702"}
Jul 23 16:23:37.867564 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:23:37.867542    2553 generic.go:356] "Generic (PLEG): container finished" podID="92310d06-adf5-4258-91a1-4d4f0185c1b0" containerID="93a97851a022286d2ebb0099d364034605a74f2b41e86db59656d8ec02ac497e" exitCode=0
Jul 23 16:23:37.867692 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:23:37.867621    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1j2mxz" event={"ID":"92310d06-adf5-4258-91a1-4d4f0185c1b0","Type":"ContainerDied","Data":"93a97851a022286d2ebb0099d364034605a74f2b41e86db59656d8ec02ac497e"}
Jul 23 16:23:37.869727 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:23:37.869708    2553 generic.go:356] "Generic (PLEG): container finished" podID="8de7a45c-439c-49fe-ab2e-80ad09d5dbc5" containerID="834423b1d75a1af8c191ac186c5849ab4202db889e8420cad9175c6d6112ada1" exitCode=0
Jul 23 16:23:37.869816 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:23:37.869780    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0fw8x9" event={"ID":"8de7a45c-439c-49fe-ab2e-80ad09d5dbc5","Type":"ContainerDied","Data":"834423b1d75a1af8c191ac186c5849ab4202db889e8420cad9175c6d6112ada1"}
Jul 23 16:23:38.013810 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:23:38.013786    2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7372f54"
Jul 23 16:23:38.136076 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:23:38.135985    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7nm68\" (UniqueName: \"kubernetes.io/projected/5bb96e52-7c69-43a2-a110-9d59c6a1f560-kube-api-access-7nm68\") pod \"5bb96e52-7c69-43a2-a110-9d59c6a1f560\" (UID: \"5bb96e52-7c69-43a2-a110-9d59c6a1f560\") "
Jul 23 16:23:38.136076 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:23:38.136027    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5bb96e52-7c69-43a2-a110-9d59c6a1f560-bundle\") pod \"5bb96e52-7c69-43a2-a110-9d59c6a1f560\" (UID: \"5bb96e52-7c69-43a2-a110-9d59c6a1f560\") "
Jul 23 16:23:38.136284 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:23:38.136206    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5bb96e52-7c69-43a2-a110-9d59c6a1f560-util\") pod \"5bb96e52-7c69-43a2-a110-9d59c6a1f560\" (UID: \"5bb96e52-7c69-43a2-a110-9d59c6a1f560\") "
Jul 23 16:23:38.136761 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:23:38.136731    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5bb96e52-7c69-43a2-a110-9d59c6a1f560-bundle" (OuterVolumeSpecName: "bundle") pod "5bb96e52-7c69-43a2-a110-9d59c6a1f560" (UID: "5bb96e52-7c69-43a2-a110-9d59c6a1f560"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 16:23:38.138297 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:23:38.138273    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5bb96e52-7c69-43a2-a110-9d59c6a1f560-kube-api-access-7nm68" (OuterVolumeSpecName: "kube-api-access-7nm68") pod "5bb96e52-7c69-43a2-a110-9d59c6a1f560" (UID: "5bb96e52-7c69-43a2-a110-9d59c6a1f560"). InnerVolumeSpecName "kube-api-access-7nm68". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 16:23:38.140978 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:23:38.140954    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5bb96e52-7c69-43a2-a110-9d59c6a1f560-util" (OuterVolumeSpecName: "util") pod "5bb96e52-7c69-43a2-a110-9d59c6a1f560" (UID: "5bb96e52-7c69-43a2-a110-9d59c6a1f560"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 16:23:38.237441 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:23:38.237409    2553 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5bb96e52-7c69-43a2-a110-9d59c6a1f560-util\") on node \"ip-10-0-143-166.ec2.internal\" DevicePath \"\""
Jul 23 16:23:38.237441 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:23:38.237441    2553 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7nm68\" (UniqueName: \"kubernetes.io/projected/5bb96e52-7c69-43a2-a110-9d59c6a1f560-kube-api-access-7nm68\") on node \"ip-10-0-143-166.ec2.internal\" DevicePath \"\""
Jul 23 16:23:38.237601 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:23:38.237457    2553 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5bb96e52-7c69-43a2-a110-9d59c6a1f560-bundle\") on node \"ip-10-0-143-166.ec2.internal\" DevicePath \"\""
Jul 23 16:23:38.876352 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:23:38.876319    2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7372f54"
Jul 23 16:23:38.876836 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:23:38.876326    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7372f54" event={"ID":"5bb96e52-7c69-43a2-a110-9d59c6a1f560","Type":"ContainerDied","Data":"4bac7b8f97f656e2f6bab97927e97df026cd2044915bc22c067b3be37365fd00"}
Jul 23 16:23:38.876836 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:23:38.876453    2553 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="4bac7b8f97f656e2f6bab97927e97df026cd2044915bc22c067b3be37365fd00"
Jul 23 16:23:38.878437 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:23:38.878408    2553 generic.go:356] "Generic (PLEG): container finished" podID="92310d06-adf5-4258-91a1-4d4f0185c1b0" containerID="6cb93c100799786d3c97c5edefed90a0f404dd63f19691a9c8e910a734267c46" exitCode=0
Jul 23 16:23:38.878683 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:23:38.878464    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1j2mxz" event={"ID":"92310d06-adf5-4258-91a1-4d4f0185c1b0","Type":"ContainerDied","Data":"6cb93c100799786d3c97c5edefed90a0f404dd63f19691a9c8e910a734267c46"}
Jul 23 16:23:39.012069 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:23:39.012039    2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0fw8x9"
Jul 23 16:23:39.046324 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:23:39.046296    2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759bkr7t"
Jul 23 16:23:39.144039 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:23:39.144006    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/fe997029-66c5-4d41-8efc-96d5b847af84-bundle\") pod \"fe997029-66c5-4d41-8efc-96d5b847af84\" (UID: \"fe997029-66c5-4d41-8efc-96d5b847af84\") "
Jul 23 16:23:39.144039 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:23:39.144047    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8de7a45c-439c-49fe-ab2e-80ad09d5dbc5-util\") pod \"8de7a45c-439c-49fe-ab2e-80ad09d5dbc5\" (UID: \"8de7a45c-439c-49fe-ab2e-80ad09d5dbc5\") "
Jul 23 16:23:39.144335 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:23:39.144075    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ggmtj\" (UniqueName: \"kubernetes.io/projected/8de7a45c-439c-49fe-ab2e-80ad09d5dbc5-kube-api-access-ggmtj\") pod \"8de7a45c-439c-49fe-ab2e-80ad09d5dbc5\" (UID: \"8de7a45c-439c-49fe-ab2e-80ad09d5dbc5\") "
Jul 23 16:23:39.144335 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:23:39.144102    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/fe997029-66c5-4d41-8efc-96d5b847af84-util\") pod \"fe997029-66c5-4d41-8efc-96d5b847af84\" (UID: \"fe997029-66c5-4d41-8efc-96d5b847af84\") "
Jul 23 16:23:39.144335 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:23:39.144136    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8de7a45c-439c-49fe-ab2e-80ad09d5dbc5-bundle\") pod \"8de7a45c-439c-49fe-ab2e-80ad09d5dbc5\" (UID: \"8de7a45c-439c-49fe-ab2e-80ad09d5dbc5\") "
Jul 23 16:23:39.144335 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:23:39.144226    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pb8s9\" (UniqueName: \"kubernetes.io/projected/fe997029-66c5-4d41-8efc-96d5b847af84-kube-api-access-pb8s9\") pod \"fe997029-66c5-4d41-8efc-96d5b847af84\" (UID: \"fe997029-66c5-4d41-8efc-96d5b847af84\") "
Jul 23 16:23:39.144666 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:23:39.144639    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fe997029-66c5-4d41-8efc-96d5b847af84-bundle" (OuterVolumeSpecName: "bundle") pod "fe997029-66c5-4d41-8efc-96d5b847af84" (UID: "fe997029-66c5-4d41-8efc-96d5b847af84"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 16:23:39.144779 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:23:39.144716    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8de7a45c-439c-49fe-ab2e-80ad09d5dbc5-bundle" (OuterVolumeSpecName: "bundle") pod "8de7a45c-439c-49fe-ab2e-80ad09d5dbc5" (UID: "8de7a45c-439c-49fe-ab2e-80ad09d5dbc5"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 16:23:39.146327 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:23:39.146303    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8de7a45c-439c-49fe-ab2e-80ad09d5dbc5-kube-api-access-ggmtj" (OuterVolumeSpecName: "kube-api-access-ggmtj") pod "8de7a45c-439c-49fe-ab2e-80ad09d5dbc5" (UID: "8de7a45c-439c-49fe-ab2e-80ad09d5dbc5"). InnerVolumeSpecName "kube-api-access-ggmtj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 16:23:39.146718 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:23:39.146694    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fe997029-66c5-4d41-8efc-96d5b847af84-kube-api-access-pb8s9" (OuterVolumeSpecName: "kube-api-access-pb8s9") pod "fe997029-66c5-4d41-8efc-96d5b847af84" (UID: "fe997029-66c5-4d41-8efc-96d5b847af84"). InnerVolumeSpecName "kube-api-access-pb8s9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 16:23:39.149766 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:23:39.149731    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8de7a45c-439c-49fe-ab2e-80ad09d5dbc5-util" (OuterVolumeSpecName: "util") pod "8de7a45c-439c-49fe-ab2e-80ad09d5dbc5" (UID: "8de7a45c-439c-49fe-ab2e-80ad09d5dbc5"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 16:23:39.150242 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:23:39.150224    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fe997029-66c5-4d41-8efc-96d5b847af84-util" (OuterVolumeSpecName: "util") pod "fe997029-66c5-4d41-8efc-96d5b847af84" (UID: "fe997029-66c5-4d41-8efc-96d5b847af84"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 16:23:39.245320 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:23:39.245269    2553 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ggmtj\" (UniqueName: \"kubernetes.io/projected/8de7a45c-439c-49fe-ab2e-80ad09d5dbc5-kube-api-access-ggmtj\") on node \"ip-10-0-143-166.ec2.internal\" DevicePath \"\""
Jul 23 16:23:39.245320 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:23:39.245314    2553 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/fe997029-66c5-4d41-8efc-96d5b847af84-util\") on node \"ip-10-0-143-166.ec2.internal\" DevicePath \"\""
Jul 23 16:23:39.245320 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:23:39.245326    2553 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8de7a45c-439c-49fe-ab2e-80ad09d5dbc5-bundle\") on node \"ip-10-0-143-166.ec2.internal\" DevicePath \"\""
Jul 23 16:23:39.245320 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:23:39.245334    2553 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pb8s9\" (UniqueName: \"kubernetes.io/projected/fe997029-66c5-4d41-8efc-96d5b847af84-kube-api-access-pb8s9\") on node \"ip-10-0-143-166.ec2.internal\" DevicePath \"\""
Jul 23 16:23:39.245578 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:23:39.245343    2553 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/fe997029-66c5-4d41-8efc-96d5b847af84-bundle\") on node \"ip-10-0-143-166.ec2.internal\" DevicePath \"\""
Jul 23 16:23:39.245578 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:23:39.245352    2553 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8de7a45c-439c-49fe-ab2e-80ad09d5dbc5-util\") on node \"ip-10-0-143-166.ec2.internal\" DevicePath \"\""
Jul 23 16:23:39.885675 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:23:39.885642    2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759bkr7t"
Jul 23 16:23:39.885675 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:23:39.885662    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759bkr7t" event={"ID":"fe997029-66c5-4d41-8efc-96d5b847af84","Type":"ContainerDied","Data":"55b2be0f726942f70d2755f77aea4bc4ad3fa1fc77a285ddcc4721911c3bd18c"}
Jul 23 16:23:39.886139 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:23:39.885707    2553 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="55b2be0f726942f70d2755f77aea4bc4ad3fa1fc77a285ddcc4721911c3bd18c"
Jul 23 16:23:39.887556 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:23:39.887533    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0fw8x9" event={"ID":"8de7a45c-439c-49fe-ab2e-80ad09d5dbc5","Type":"ContainerDied","Data":"8ad0d559d384b2c1559b8b9a03f14577402981391fd681579d56552ad325004a"}
Jul 23 16:23:39.887668 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:23:39.887571    2553 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="8ad0d559d384b2c1559b8b9a03f14577402981391fd681579d56552ad325004a"
Jul 23 16:23:39.887668 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:23:39.887541    2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0fw8x9"
Jul 23 16:23:40.027385 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:23:40.027359    2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1j2mxz"
Jul 23 16:23:40.153991 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:23:40.153959    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/92310d06-adf5-4258-91a1-4d4f0185c1b0-bundle\") pod \"92310d06-adf5-4258-91a1-4d4f0185c1b0\" (UID: \"92310d06-adf5-4258-91a1-4d4f0185c1b0\") "
Jul 23 16:23:40.154161 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:23:40.154029    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lxbd7\" (UniqueName: \"kubernetes.io/projected/92310d06-adf5-4258-91a1-4d4f0185c1b0-kube-api-access-lxbd7\") pod \"92310d06-adf5-4258-91a1-4d4f0185c1b0\" (UID: \"92310d06-adf5-4258-91a1-4d4f0185c1b0\") "
Jul 23 16:23:40.154242 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:23:40.154155    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/92310d06-adf5-4258-91a1-4d4f0185c1b0-util\") pod \"92310d06-adf5-4258-91a1-4d4f0185c1b0\" (UID: \"92310d06-adf5-4258-91a1-4d4f0185c1b0\") "
Jul 23 16:23:40.154552 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:23:40.154529    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/92310d06-adf5-4258-91a1-4d4f0185c1b0-bundle" (OuterVolumeSpecName: "bundle") pod "92310d06-adf5-4258-91a1-4d4f0185c1b0" (UID: "92310d06-adf5-4258-91a1-4d4f0185c1b0"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 16:23:40.156048 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:23:40.156028    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/92310d06-adf5-4258-91a1-4d4f0185c1b0-kube-api-access-lxbd7" (OuterVolumeSpecName: "kube-api-access-lxbd7") pod "92310d06-adf5-4258-91a1-4d4f0185c1b0" (UID: "92310d06-adf5-4258-91a1-4d4f0185c1b0"). InnerVolumeSpecName "kube-api-access-lxbd7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 16:23:40.193243 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:23:40.193185    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/92310d06-adf5-4258-91a1-4d4f0185c1b0-util" (OuterVolumeSpecName: "util") pod "92310d06-adf5-4258-91a1-4d4f0185c1b0" (UID: "92310d06-adf5-4258-91a1-4d4f0185c1b0"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 16:23:40.255612 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:23:40.255579    2553 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lxbd7\" (UniqueName: \"kubernetes.io/projected/92310d06-adf5-4258-91a1-4d4f0185c1b0-kube-api-access-lxbd7\") on node \"ip-10-0-143-166.ec2.internal\" DevicePath \"\""
Jul 23 16:23:40.255612 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:23:40.255608    2553 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/92310d06-adf5-4258-91a1-4d4f0185c1b0-util\") on node \"ip-10-0-143-166.ec2.internal\" DevicePath \"\""
Jul 23 16:23:40.255612 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:23:40.255619    2553 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/92310d06-adf5-4258-91a1-4d4f0185c1b0-bundle\") on node \"ip-10-0-143-166.ec2.internal\" DevicePath \"\""
Jul 23 16:23:40.894229 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:23:40.894196    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1j2mxz" event={"ID":"92310d06-adf5-4258-91a1-4d4f0185c1b0","Type":"ContainerDied","Data":"47dc6a0825157cc9f6375d14e5b4623f0e44b056a1cfac9cc160fe3355a8ca9d"}
Jul 23 16:23:40.894610 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:23:40.894246    2553 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="47dc6a0825157cc9f6375d14e5b4623f0e44b056a1cfac9cc160fe3355a8ca9d"
Jul 23 16:23:40.894610 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:23:40.894208    2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1j2mxz"
Jul 23 16:24:00.204642 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:24:00.204600    2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-hpsmb"]
Jul 23 16:24:00.204993 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:24:00.204940    2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5bb96e52-7c69-43a2-a110-9d59c6a1f560" containerName="util"
Jul 23 16:24:00.204993 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:24:00.204954    2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="5bb96e52-7c69-43a2-a110-9d59c6a1f560" containerName="util"
Jul 23 16:24:00.204993 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:24:00.204962    2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5bb96e52-7c69-43a2-a110-9d59c6a1f560" containerName="extract"
Jul 23 16:24:00.204993 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:24:00.204968    2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="5bb96e52-7c69-43a2-a110-9d59c6a1f560" containerName="extract"
Jul 23 16:24:00.204993 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:24:00.204979    2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fe997029-66c5-4d41-8efc-96d5b847af84" containerName="extract"
Jul 23 16:24:00.204993 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:24:00.204986    2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="fe997029-66c5-4d41-8efc-96d5b847af84" containerName="extract"
Jul 23 16:24:00.204993 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:24:00.204993    2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="92310d06-adf5-4258-91a1-4d4f0185c1b0" containerName="extract"
Jul 23 16:24:00.204993 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:24:00.204998    2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="92310d06-adf5-4258-91a1-4d4f0185c1b0" containerName="extract"
Jul 23 16:24:00.205277 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:24:00.205010    2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8de7a45c-439c-49fe-ab2e-80ad09d5dbc5" containerName="util"
Jul 23 16:24:00.205277 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:24:00.205015    2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="8de7a45c-439c-49fe-ab2e-80ad09d5dbc5" containerName="util"
Jul 23 16:24:00.205277 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:24:00.205022    2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fe997029-66c5-4d41-8efc-96d5b847af84" containerName="pull"
Jul 23 16:24:00.205277 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:24:00.205027    2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="fe997029-66c5-4d41-8efc-96d5b847af84" containerName="pull"
Jul 23 16:24:00.205277 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:24:00.205035    2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5bb96e52-7c69-43a2-a110-9d59c6a1f560" containerName="pull"
Jul 23 16:24:00.205277 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:24:00.205040    2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="5bb96e52-7c69-43a2-a110-9d59c6a1f560" containerName="pull"
Jul 23 16:24:00.205277 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:24:00.205045    2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8de7a45c-439c-49fe-ab2e-80ad09d5dbc5" containerName="pull"
Jul 23 16:24:00.205277 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:24:00.205049    2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="8de7a45c-439c-49fe-ab2e-80ad09d5dbc5" containerName="pull"
Jul 23 16:24:00.205277 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:24:00.205056    2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fe997029-66c5-4d41-8efc-96d5b847af84" containerName="util"
Jul 23 16:24:00.205277 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:24:00.205061    2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="fe997029-66c5-4d41-8efc-96d5b847af84" containerName="util"
Jul 23 16:24:00.205277 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:24:00.205069    2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8de7a45c-439c-49fe-ab2e-80ad09d5dbc5" containerName="extract"
Jul 23 16:24:00.205277 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:24:00.205074    2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="8de7a45c-439c-49fe-ab2e-80ad09d5dbc5" containerName="extract"
Jul 23 16:24:00.205277 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:24:00.205079    2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="92310d06-adf5-4258-91a1-4d4f0185c1b0" containerName="util"
Jul 23 16:24:00.205277 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:24:00.205085    2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="92310d06-adf5-4258-91a1-4d4f0185c1b0" containerName="util"
Jul 23 16:24:00.205277 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:24:00.205090    2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="92310d06-adf5-4258-91a1-4d4f0185c1b0" containerName="pull"
Jul 23 16:24:00.205277 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:24:00.205095    2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="92310d06-adf5-4258-91a1-4d4f0185c1b0" containerName="pull"
Jul 23 16:24:00.205277 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:24:00.205143    2553 memory_manager.go:368] "RemoveStaleState removing state" podUID="fe997029-66c5-4d41-8efc-96d5b847af84" containerName="extract"
Jul 23 16:24:00.205277 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:24:00.205150    2553 memory_manager.go:368] "RemoveStaleState removing state" podUID="8de7a45c-439c-49fe-ab2e-80ad09d5dbc5" containerName="extract"
Jul 23 16:24:00.205277 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:24:00.205156    2553 memory_manager.go:368] "RemoveStaleState removing state" podUID="5bb96e52-7c69-43a2-a110-9d59c6a1f560" containerName="extract"
Jul 23 16:24:00.205277 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:24:00.205161    2553 memory_manager.go:368] "RemoveStaleState removing state" podUID="92310d06-adf5-4258-91a1-4d4f0185c1b0" containerName="extract"
Jul 23 16:24:00.209678 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:24:00.209657    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-hpsmb"
Jul 23 16:24:00.213192 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:24:00.213156    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 23 16:24:00.214467 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:24:00.214449    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"plugin-serving-cert\""
Jul 23 16:24:00.214566 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:24:00.214537    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kuadrant-console-nginx-conf\""
Jul 23 16:24:00.214566 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:24:00.214543    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-tgxk6\""
Jul 23 16:24:00.214689 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:24:00.214542    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 23 16:24:00.221247 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:24:00.221224    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-hpsmb"]
Jul 23 16:24:00.332340 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:24:00.332306    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/aba9d5ae-8f09-4bcc-a6ca-2d5ff4944f0c-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-hpsmb\" (UID: \"aba9d5ae-8f09-4bcc-a6ca-2d5ff4944f0c\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-hpsmb"
Jul 23 16:24:00.332523 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:24:00.332362    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/aba9d5ae-8f09-4bcc-a6ca-2d5ff4944f0c-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-hpsmb\" (UID: \"aba9d5ae-8f09-4bcc-a6ca-2d5ff4944f0c\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-hpsmb"
Jul 23 16:24:00.332523 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:24:00.332459    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z5prl\" (UniqueName: \"kubernetes.io/projected/aba9d5ae-8f09-4bcc-a6ca-2d5ff4944f0c-kube-api-access-z5prl\") pod \"kuadrant-console-plugin-66b5774985-hpsmb\" (UID: \"aba9d5ae-8f09-4bcc-a6ca-2d5ff4944f0c\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-hpsmb"
Jul 23 16:24:00.433774 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:24:00.433737    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z5prl\" (UniqueName: \"kubernetes.io/projected/aba9d5ae-8f09-4bcc-a6ca-2d5ff4944f0c-kube-api-access-z5prl\") pod \"kuadrant-console-plugin-66b5774985-hpsmb\" (UID: \"aba9d5ae-8f09-4bcc-a6ca-2d5ff4944f0c\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-hpsmb"
Jul 23 16:24:00.433774 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:24:00.433784    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/aba9d5ae-8f09-4bcc-a6ca-2d5ff4944f0c-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-hpsmb\" (UID: \"aba9d5ae-8f09-4bcc-a6ca-2d5ff4944f0c\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-hpsmb"
Jul 23 16:24:00.434003 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:24:00.433817    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/aba9d5ae-8f09-4bcc-a6ca-2d5ff4944f0c-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-hpsmb\" (UID: \"aba9d5ae-8f09-4bcc-a6ca-2d5ff4944f0c\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-hpsmb"
Jul 23 16:24:00.434448 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:24:00.434426    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/aba9d5ae-8f09-4bcc-a6ca-2d5ff4944f0c-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-hpsmb\" (UID: \"aba9d5ae-8f09-4bcc-a6ca-2d5ff4944f0c\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-hpsmb"
Jul 23 16:24:00.436285 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:24:00.436266    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/aba9d5ae-8f09-4bcc-a6ca-2d5ff4944f0c-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-hpsmb\" (UID: \"aba9d5ae-8f09-4bcc-a6ca-2d5ff4944f0c\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-hpsmb"
Jul 23 16:24:00.446180 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:24:00.446140    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z5prl\" (UniqueName: \"kubernetes.io/projected/aba9d5ae-8f09-4bcc-a6ca-2d5ff4944f0c-kube-api-access-z5prl\") pod \"kuadrant-console-plugin-66b5774985-hpsmb\" (UID: \"aba9d5ae-8f09-4bcc-a6ca-2d5ff4944f0c\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-hpsmb"
Jul 23 16:24:00.519114 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:24:00.519033    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-hpsmb"
Jul 23 16:24:00.647805 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:24:00.647547    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-hpsmb"]
Jul 23 16:24:00.649963 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:24:00.649926    2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podaba9d5ae_8f09_4bcc_a6ca_2d5ff4944f0c.slice/crio-5075009bcdb1ac7a6f2e5f258fd231240c9689e2143b3c39cd10206a0757d08d WatchSource:0}: Error finding container 5075009bcdb1ac7a6f2e5f258fd231240c9689e2143b3c39cd10206a0757d08d: Status 404 returned error can't find the container with id 5075009bcdb1ac7a6f2e5f258fd231240c9689e2143b3c39cd10206a0757d08d
Jul 23 16:24:00.992338 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:24:00.992305    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-hpsmb" event={"ID":"aba9d5ae-8f09-4bcc-a6ca-2d5ff4944f0c","Type":"ContainerStarted","Data":"5075009bcdb1ac7a6f2e5f258fd231240c9689e2143b3c39cd10206a0757d08d"}
Jul 23 16:24:23.133062 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:24:23.133023    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-hpsmb" event={"ID":"aba9d5ae-8f09-4bcc-a6ca-2d5ff4944f0c","Type":"ContainerStarted","Data":"3c8512f441fdda3bb1a82ce7975777dd353615ca806c933432a4e917a92799d2"}
Jul 23 16:24:23.162253 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:24:23.162205    2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-hpsmb" podStartSLOduration=0.895145783 podStartE2EDuration="23.162189854s" totalImagesPullingTime="22.267044071s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 16:24:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 16:24:23.160511708 +0000 UTC m=+545.025117838" watchObservedRunningTime="2026-07-23 16:24:23.162189854 +0000 UTC m=+545.026795973"
Jul 23 16:24:47.612144 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:24:47.612111    2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-58cd955675-fmqmc"]
Jul 23 16:24:47.647546 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:24:47.647503    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-fmqmc"]
Jul 23 16:24:47.647707 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:24:47.647601    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-fmqmc"
Jul 23 16:24:47.650400 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:24:47.650379    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-ww84n\""
Jul 23 16:24:47.736839 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:24:47.736803    2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-75d556bd77-xdbwx"]
Jul 23 16:24:47.738900 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:24:47.738864    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zfnpk\" (UniqueName: \"kubernetes.io/projected/7255259b-0fcc-4e5b-bc13-eb12b9b5cb03-kube-api-access-zfnpk\") pod \"authorino-58cd955675-fmqmc\" (UID: \"7255259b-0fcc-4e5b-bc13-eb12b9b5cb03\") " pod="kuadrant-system/authorino-58cd955675-fmqmc"
Jul 23 16:24:47.738900 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:24:47.738897    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-xdbwx"
Jul 23 16:24:47.747343 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:24:47.747316    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-xdbwx"]
Jul 23 16:24:47.840155 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:24:47.840105    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dkwqb\" (UniqueName: \"kubernetes.io/projected/5e948d54-7216-488a-8bb2-16f8cf8a0da4-kube-api-access-dkwqb\") pod \"authorino-75d556bd77-xdbwx\" (UID: \"5e948d54-7216-488a-8bb2-16f8cf8a0da4\") " pod="kuadrant-system/authorino-75d556bd77-xdbwx"
Jul 23 16:24:47.840339 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:24:47.840196    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zfnpk\" (UniqueName: \"kubernetes.io/projected/7255259b-0fcc-4e5b-bc13-eb12b9b5cb03-kube-api-access-zfnpk\") pod \"authorino-58cd955675-fmqmc\" (UID: \"7255259b-0fcc-4e5b-bc13-eb12b9b5cb03\") " pod="kuadrant-system/authorino-58cd955675-fmqmc"
Jul 23 16:24:47.848422 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:24:47.848391    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zfnpk\" (UniqueName: \"kubernetes.io/projected/7255259b-0fcc-4e5b-bc13-eb12b9b5cb03-kube-api-access-zfnpk\") pod \"authorino-58cd955675-fmqmc\" (UID: \"7255259b-0fcc-4e5b-bc13-eb12b9b5cb03\") " pod="kuadrant-system/authorino-58cd955675-fmqmc"
Jul 23 16:24:47.941462 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:24:47.941430    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dkwqb\" (UniqueName: \"kubernetes.io/projected/5e948d54-7216-488a-8bb2-16f8cf8a0da4-kube-api-access-dkwqb\") pod \"authorino-75d556bd77-xdbwx\" (UID: \"5e948d54-7216-488a-8bb2-16f8cf8a0da4\") " pod="kuadrant-system/authorino-75d556bd77-xdbwx"
Jul 23 16:24:47.949600 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:24:47.949570    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dkwqb\" (UniqueName: \"kubernetes.io/projected/5e948d54-7216-488a-8bb2-16f8cf8a0da4-kube-api-access-dkwqb\") pod \"authorino-75d556bd77-xdbwx\" (UID: \"5e948d54-7216-488a-8bb2-16f8cf8a0da4\") " pod="kuadrant-system/authorino-75d556bd77-xdbwx"
Jul 23 16:24:47.956320 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:24:47.956301    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-fmqmc"
Jul 23 16:24:48.048871 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:24:48.048834    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-xdbwx"
Jul 23 16:24:48.093473 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:24:48.093443    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-fmqmc"]
Jul 23 16:24:48.095040 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:24:48.095013    2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod7255259b_0fcc_4e5b_bc13_eb12b9b5cb03.slice/crio-a64a8b57af0fa075b3d69ac23ff4f8c7e6bbf1dd9ff85a3c45c2e9691ff427c4 WatchSource:0}: Error finding container a64a8b57af0fa075b3d69ac23ff4f8c7e6bbf1dd9ff85a3c45c2e9691ff427c4: Status 404 returned error can't find the container with id a64a8b57af0fa075b3d69ac23ff4f8c7e6bbf1dd9ff85a3c45c2e9691ff427c4
Jul 23 16:24:48.184098 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:24:48.184073    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-xdbwx"]
Jul 23 16:24:48.185938 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:24:48.185908    2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod5e948d54_7216_488a_8bb2_16f8cf8a0da4.slice/crio-899e7d058a6fbf85348b7500525b98c5d4930d9aa8619e97b7e7261af1073ec6 WatchSource:0}: Error finding container 899e7d058a6fbf85348b7500525b98c5d4930d9aa8619e97b7e7261af1073ec6: Status 404 returned error can't find the container with id 899e7d058a6fbf85348b7500525b98c5d4930d9aa8619e97b7e7261af1073ec6
Jul 23 16:24:48.259774 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:24:48.259687    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-xdbwx" event={"ID":"5e948d54-7216-488a-8bb2-16f8cf8a0da4","Type":"ContainerStarted","Data":"899e7d058a6fbf85348b7500525b98c5d4930d9aa8619e97b7e7261af1073ec6"}
Jul 23 16:24:48.260939 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:24:48.260912    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-fmqmc" event={"ID":"7255259b-0fcc-4e5b-bc13-eb12b9b5cb03","Type":"ContainerStarted","Data":"a64a8b57af0fa075b3d69ac23ff4f8c7e6bbf1dd9ff85a3c45c2e9691ff427c4"}
Jul 23 16:24:53.299516 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:24:53.299474    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-xdbwx" event={"ID":"5e948d54-7216-488a-8bb2-16f8cf8a0da4","Type":"ContainerStarted","Data":"bef2d0529cdd5780921ad14e57f6e799a902c2132acf07272e5bf9ac2d60f939"}
Jul 23 16:24:53.301263 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:24:53.301223    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-fmqmc" event={"ID":"7255259b-0fcc-4e5b-bc13-eb12b9b5cb03","Type":"ContainerStarted","Data":"f162e0e1506690d0ac9a2233bafaf3e3afb4d17687db5fe0f3cf634f8ef8c044"}
Jul 23 16:24:53.315731 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:24:53.315678    2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-75d556bd77-xdbwx" podStartSLOduration=2.265106833 podStartE2EDuration="6.315661845s" totalImagesPullingTime="4.050555012s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 16:24:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 16:24:53.314989275 +0000 UTC m=+575.179595413" watchObservedRunningTime="2026-07-23 16:24:53.315661845 +0000 UTC m=+575.180267951"
Jul 23 16:24:53.331221 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:24:53.331142    2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-58cd955675-fmqmc" podStartSLOduration=2.1752481 podStartE2EDuration="6.331125399s" totalImagesPullingTime="4.155877299s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 16:24:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 16:24:53.330143862 +0000 UTC m=+575.194749992" watchObservedRunningTime="2026-07-23 16:24:53.331125399 +0000 UTC m=+575.195731557"
Jul 23 16:24:53.362319 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:24:53.362283    2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-fmqmc"]
Jul 23 16:24:55.310490 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:24:55.310448    2553 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-58cd955675-fmqmc" podUID="7255259b-0fcc-4e5b-bc13-eb12b9b5cb03" containerName="authorino" containerID="cri-o://f162e0e1506690d0ac9a2233bafaf3e3afb4d17687db5fe0f3cf634f8ef8c044" gracePeriod=30
Jul 23 16:24:55.566448 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:24:55.566372    2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-fmqmc"
Jul 23 16:24:55.713661 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:24:55.713624    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zfnpk\" (UniqueName: \"kubernetes.io/projected/7255259b-0fcc-4e5b-bc13-eb12b9b5cb03-kube-api-access-zfnpk\") pod \"7255259b-0fcc-4e5b-bc13-eb12b9b5cb03\" (UID: \"7255259b-0fcc-4e5b-bc13-eb12b9b5cb03\") "
Jul 23 16:24:55.715762 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:24:55.715735    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7255259b-0fcc-4e5b-bc13-eb12b9b5cb03-kube-api-access-zfnpk" (OuterVolumeSpecName: "kube-api-access-zfnpk") pod "7255259b-0fcc-4e5b-bc13-eb12b9b5cb03" (UID: "7255259b-0fcc-4e5b-bc13-eb12b9b5cb03"). InnerVolumeSpecName "kube-api-access-zfnpk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 16:24:55.814431 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:24:55.814379    2553 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zfnpk\" (UniqueName: \"kubernetes.io/projected/7255259b-0fcc-4e5b-bc13-eb12b9b5cb03-kube-api-access-zfnpk\") on node \"ip-10-0-143-166.ec2.internal\" DevicePath \"\""
Jul 23 16:24:56.316389 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:24:56.316357    2553 generic.go:356] "Generic (PLEG): container finished" podID="7255259b-0fcc-4e5b-bc13-eb12b9b5cb03" containerID="f162e0e1506690d0ac9a2233bafaf3e3afb4d17687db5fe0f3cf634f8ef8c044" exitCode=0
Jul 23 16:24:56.316870 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:24:56.316401    2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-fmqmc"
Jul 23 16:24:56.316870 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:24:56.316452    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-fmqmc" event={"ID":"7255259b-0fcc-4e5b-bc13-eb12b9b5cb03","Type":"ContainerDied","Data":"f162e0e1506690d0ac9a2233bafaf3e3afb4d17687db5fe0f3cf634f8ef8c044"}
Jul 23 16:24:56.316870 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:24:56.316502    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-fmqmc" event={"ID":"7255259b-0fcc-4e5b-bc13-eb12b9b5cb03","Type":"ContainerDied","Data":"a64a8b57af0fa075b3d69ac23ff4f8c7e6bbf1dd9ff85a3c45c2e9691ff427c4"}
Jul 23 16:24:56.316870 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:24:56.316526    2553 scope.go:117] "RemoveContainer" containerID="f162e0e1506690d0ac9a2233bafaf3e3afb4d17687db5fe0f3cf634f8ef8c044"
Jul 23 16:24:56.325462 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:24:56.325443    2553 scope.go:117] "RemoveContainer" containerID="f162e0e1506690d0ac9a2233bafaf3e3afb4d17687db5fe0f3cf634f8ef8c044"
Jul 23 16:24:56.325728 ip-10-0-143-166 kubenswrapper[2553]: E0723 16:24:56.325710    2553 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f162e0e1506690d0ac9a2233bafaf3e3afb4d17687db5fe0f3cf634f8ef8c044\": container with ID starting with f162e0e1506690d0ac9a2233bafaf3e3afb4d17687db5fe0f3cf634f8ef8c044 not found: ID does not exist" containerID="f162e0e1506690d0ac9a2233bafaf3e3afb4d17687db5fe0f3cf634f8ef8c044"
Jul 23 16:24:56.325765 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:24:56.325740    2553 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f162e0e1506690d0ac9a2233bafaf3e3afb4d17687db5fe0f3cf634f8ef8c044"} err="failed to get container status \"f162e0e1506690d0ac9a2233bafaf3e3afb4d17687db5fe0f3cf634f8ef8c044\": rpc error: code = NotFound desc = could not find container \"f162e0e1506690d0ac9a2233bafaf3e3afb4d17687db5fe0f3cf634f8ef8c044\": container with ID starting with f162e0e1506690d0ac9a2233bafaf3e3afb4d17687db5fe0f3cf634f8ef8c044 not found: ID does not exist"
Jul 23 16:24:56.339106 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:24:56.339074    2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-fmqmc"]
Jul 23 16:24:56.342802 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:24:56.342780    2553 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-58cd955675-fmqmc"]
Jul 23 16:24:56.674582 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:24:56.674552    2553 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7255259b-0fcc-4e5b-bc13-eb12b9b5cb03" path="/var/lib/kubelet/pods/7255259b-0fcc-4e5b-bc13-eb12b9b5cb03/volumes"
Jul 23 16:25:18.536750 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:25:18.536723    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-7rmrn_976a7198-cfd3-43d4-8c9f-b1f248d1f6d7/console-operator/1.log"
Jul 23 16:25:18.538047 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:25:18.538028    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-7rmrn_976a7198-cfd3-43d4-8c9f-b1f248d1f6d7/console-operator/1.log"
Jul 23 16:25:21.497152 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:25:21.497117    2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5d4b67c446-cbslf"]
Jul 23 16:25:21.497557 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:25:21.497459    2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7255259b-0fcc-4e5b-bc13-eb12b9b5cb03" containerName="authorino"
Jul 23 16:25:21.497557 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:25:21.497474    2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="7255259b-0fcc-4e5b-bc13-eb12b9b5cb03" containerName="authorino"
Jul 23 16:25:21.497633 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:25:21.497564    2553 memory_manager.go:368] "RemoveStaleState removing state" podUID="7255259b-0fcc-4e5b-bc13-eb12b9b5cb03" containerName="authorino"
Jul 23 16:25:21.501564 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:25:21.501547    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-cbslf"
Jul 23 16:25:21.509679 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:25:21.509652    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-cbslf"]
Jul 23 16:25:21.640545 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:25:21.640512    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g49qr\" (UniqueName: \"kubernetes.io/projected/99c3dd9d-f128-4bac-b9e1-f3e029de3e56-kube-api-access-g49qr\") pod \"authorino-5d4b67c446-cbslf\" (UID: \"99c3dd9d-f128-4bac-b9e1-f3e029de3e56\") " pod="kuadrant-system/authorino-5d4b67c446-cbslf"
Jul 23 16:25:21.741750 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:25:21.741720    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g49qr\" (UniqueName: \"kubernetes.io/projected/99c3dd9d-f128-4bac-b9e1-f3e029de3e56-kube-api-access-g49qr\") pod \"authorino-5d4b67c446-cbslf\" (UID: \"99c3dd9d-f128-4bac-b9e1-f3e029de3e56\") " pod="kuadrant-system/authorino-5d4b67c446-cbslf"
Jul 23 16:25:21.752483 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:25:21.752422    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g49qr\" (UniqueName: \"kubernetes.io/projected/99c3dd9d-f128-4bac-b9e1-f3e029de3e56-kube-api-access-g49qr\") pod \"authorino-5d4b67c446-cbslf\" (UID: \"99c3dd9d-f128-4bac-b9e1-f3e029de3e56\") " pod="kuadrant-system/authorino-5d4b67c446-cbslf"
Jul 23 16:25:21.764603 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:25:21.764573    2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-cbslf"]
Jul 23 16:25:21.764837 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:25:21.764825    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-cbslf"
Jul 23 16:25:21.792682 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:25:21.792655    2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-76cb5fbf6d-gzprh"]
Jul 23 16:25:21.796216 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:25:21.796199    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-76cb5fbf6d-gzprh"
Jul 23 16:25:21.798917 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:25:21.798896    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\""
Jul 23 16:25:21.804344 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:25:21.804324    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-76cb5fbf6d-gzprh"]
Jul 23 16:25:21.843103 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:25:21.843076    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jf5nl\" (UniqueName: \"kubernetes.io/projected/bca8b878-71e1-4114-a30c-a9bca0b9a903-kube-api-access-jf5nl\") pod \"authorino-76cb5fbf6d-gzprh\" (UID: \"bca8b878-71e1-4114-a30c-a9bca0b9a903\") " pod="kuadrant-system/authorino-76cb5fbf6d-gzprh"
Jul 23 16:25:21.843266 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:25:21.843124    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/bca8b878-71e1-4114-a30c-a9bca0b9a903-tls-cert\") pod \"authorino-76cb5fbf6d-gzprh\" (UID: \"bca8b878-71e1-4114-a30c-a9bca0b9a903\") " pod="kuadrant-system/authorino-76cb5fbf6d-gzprh"
Jul 23 16:25:21.899655 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:25:21.899631    2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-cbslf"]
Jul 23 16:25:21.901380 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:25:21.901350    2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod99c3dd9d_f128_4bac_b9e1_f3e029de3e56.slice/crio-d2be5ae12e60bfb283a4b9a38c29fbcbd202d4d11e16291a03cd723940cd4aab WatchSource:0}: Error finding container d2be5ae12e60bfb283a4b9a38c29fbcbd202d4d11e16291a03cd723940cd4aab: Status 404 returned error can't find the container with id d2be5ae12e60bfb283a4b9a38c29fbcbd202d4d11e16291a03cd723940cd4aab
Jul 23 16:25:21.944072 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:25:21.944040    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jf5nl\" (UniqueName: \"kubernetes.io/projected/bca8b878-71e1-4114-a30c-a9bca0b9a903-kube-api-access-jf5nl\") pod \"authorino-76cb5fbf6d-gzprh\" (UID: \"bca8b878-71e1-4114-a30c-a9bca0b9a903\") " pod="kuadrant-system/authorino-76cb5fbf6d-gzprh"
Jul 23 16:25:21.944266 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:25:21.944098    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/bca8b878-71e1-4114-a30c-a9bca0b9a903-tls-cert\") pod \"authorino-76cb5fbf6d-gzprh\" (UID: \"bca8b878-71e1-4114-a30c-a9bca0b9a903\") " pod="kuadrant-system/authorino-76cb5fbf6d-gzprh"
Jul 23 16:25:21.946484 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:25:21.946463    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/bca8b878-71e1-4114-a30c-a9bca0b9a903-tls-cert\") pod \"authorino-76cb5fbf6d-gzprh\" (UID: \"bca8b878-71e1-4114-a30c-a9bca0b9a903\") " pod="kuadrant-system/authorino-76cb5fbf6d-gzprh"
Jul 23 16:25:21.955476 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:25:21.955453    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jf5nl\" (UniqueName: \"kubernetes.io/projected/bca8b878-71e1-4114-a30c-a9bca0b9a903-kube-api-access-jf5nl\") pod \"authorino-76cb5fbf6d-gzprh\" (UID: \"bca8b878-71e1-4114-a30c-a9bca0b9a903\") " pod="kuadrant-system/authorino-76cb5fbf6d-gzprh"
Jul 23 16:25:22.106965 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:25:22.106871    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-76cb5fbf6d-gzprh"
Jul 23 16:25:22.269924 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:25:22.267101    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-76cb5fbf6d-gzprh"]
Jul 23 16:25:22.443744 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:25:22.443699    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-76cb5fbf6d-gzprh" event={"ID":"bca8b878-71e1-4114-a30c-a9bca0b9a903","Type":"ContainerStarted","Data":"1c5446c5d4fd0db2da2a96f994eb7008a17d0c0bfb6c7457d7c71926da3c3a43"}
Jul 23 16:25:22.444740 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:25:22.444709    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-cbslf" event={"ID":"99c3dd9d-f128-4bac-b9e1-f3e029de3e56","Type":"ContainerStarted","Data":"d2be5ae12e60bfb283a4b9a38c29fbcbd202d4d11e16291a03cd723940cd4aab"}
Jul 23 16:25:23.452126 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:25:23.452079    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-76cb5fbf6d-gzprh" event={"ID":"bca8b878-71e1-4114-a30c-a9bca0b9a903","Type":"ContainerStarted","Data":"5fe49ed42db27662bad60528b9f5b7726f3e951e0fd09645cd21398571819843"}
Jul 23 16:25:23.453568 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:25:23.453542    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-cbslf" event={"ID":"99c3dd9d-f128-4bac-b9e1-f3e029de3e56","Type":"ContainerStarted","Data":"5791d0d3e9abda4f1d332d7308a12f1fed178900c84a1147b845b48843378c55"}
Jul 23 16:25:23.453666 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:25:23.453607    2553 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-5d4b67c446-cbslf" podUID="99c3dd9d-f128-4bac-b9e1-f3e029de3e56" containerName="authorino" containerID="cri-o://5791d0d3e9abda4f1d332d7308a12f1fed178900c84a1147b845b48843378c55" gracePeriod=30
Jul 23 16:25:23.470212 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:25:23.470145    2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-76cb5fbf6d-gzprh" podStartSLOduration=2.077596535 podStartE2EDuration="2.470126523s" totalImagesPullingTime="392.529988ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 16:25:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 16:25:23.469360681 +0000 UTC m=+605.333966810" watchObservedRunningTime="2026-07-23 16:25:23.470126523 +0000 UTC m=+605.334732652"
Jul 23 16:25:23.485694 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:25:23.485645    2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-5d4b67c446-cbslf" podStartSLOduration=1.919019652 podStartE2EDuration="2.485627528s" totalImagesPullingTime="566.607876ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 16:25:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 16:25:23.484749608 +0000 UTC m=+605.349355736" watchObservedRunningTime="2026-07-23 16:25:23.485627528 +0000 UTC m=+605.350233656"
Jul 23 16:25:23.505910 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:25:23.505876    2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-xdbwx"]
Jul 23 16:25:23.506112 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:25:23.506087    2553 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-75d556bd77-xdbwx" podUID="5e948d54-7216-488a-8bb2-16f8cf8a0da4" containerName="authorino" containerID="cri-o://bef2d0529cdd5780921ad14e57f6e799a902c2132acf07272e5bf9ac2d60f939" gracePeriod=30
Jul 23 16:25:23.779980 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:25:23.779952    2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-cbslf"
Jul 23 16:25:23.782725 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:25:23.782708    2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-xdbwx"
Jul 23 16:25:23.861773 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:25:23.861739    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-g49qr\" (UniqueName: \"kubernetes.io/projected/99c3dd9d-f128-4bac-b9e1-f3e029de3e56-kube-api-access-g49qr\") pod \"99c3dd9d-f128-4bac-b9e1-f3e029de3e56\" (UID: \"99c3dd9d-f128-4bac-b9e1-f3e029de3e56\") "
Jul 23 16:25:23.861953 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:25:23.861805    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dkwqb\" (UniqueName: \"kubernetes.io/projected/5e948d54-7216-488a-8bb2-16f8cf8a0da4-kube-api-access-dkwqb\") pod \"5e948d54-7216-488a-8bb2-16f8cf8a0da4\" (UID: \"5e948d54-7216-488a-8bb2-16f8cf8a0da4\") "
Jul 23 16:25:23.863842 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:25:23.863808    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5e948d54-7216-488a-8bb2-16f8cf8a0da4-kube-api-access-dkwqb" (OuterVolumeSpecName: "kube-api-access-dkwqb") pod "5e948d54-7216-488a-8bb2-16f8cf8a0da4" (UID: "5e948d54-7216-488a-8bb2-16f8cf8a0da4"). InnerVolumeSpecName "kube-api-access-dkwqb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 16:25:23.863982 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:25:23.863909    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/99c3dd9d-f128-4bac-b9e1-f3e029de3e56-kube-api-access-g49qr" (OuterVolumeSpecName: "kube-api-access-g49qr") pod "99c3dd9d-f128-4bac-b9e1-f3e029de3e56" (UID: "99c3dd9d-f128-4bac-b9e1-f3e029de3e56"). InnerVolumeSpecName "kube-api-access-g49qr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 16:25:23.962468 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:25:23.962379    2553 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-g49qr\" (UniqueName: \"kubernetes.io/projected/99c3dd9d-f128-4bac-b9e1-f3e029de3e56-kube-api-access-g49qr\") on node \"ip-10-0-143-166.ec2.internal\" DevicePath \"\""
Jul 23 16:25:23.962468 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:25:23.962410    2553 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dkwqb\" (UniqueName: \"kubernetes.io/projected/5e948d54-7216-488a-8bb2-16f8cf8a0da4-kube-api-access-dkwqb\") on node \"ip-10-0-143-166.ec2.internal\" DevicePath \"\""
Jul 23 16:25:24.459339 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:25:24.459300    2553 generic.go:356] "Generic (PLEG): container finished" podID="99c3dd9d-f128-4bac-b9e1-f3e029de3e56" containerID="5791d0d3e9abda4f1d332d7308a12f1fed178900c84a1147b845b48843378c55" exitCode=0
Jul 23 16:25:24.459778 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:25:24.459346    2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-cbslf"
Jul 23 16:25:24.459778 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:25:24.459400    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-cbslf" event={"ID":"99c3dd9d-f128-4bac-b9e1-f3e029de3e56","Type":"ContainerDied","Data":"5791d0d3e9abda4f1d332d7308a12f1fed178900c84a1147b845b48843378c55"}
Jul 23 16:25:24.459778 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:25:24.459448    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-cbslf" event={"ID":"99c3dd9d-f128-4bac-b9e1-f3e029de3e56","Type":"ContainerDied","Data":"d2be5ae12e60bfb283a4b9a38c29fbcbd202d4d11e16291a03cd723940cd4aab"}
Jul 23 16:25:24.459778 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:25:24.459472    2553 scope.go:117] "RemoveContainer" containerID="5791d0d3e9abda4f1d332d7308a12f1fed178900c84a1147b845b48843378c55"
Jul 23 16:25:24.460819 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:25:24.460745    2553 generic.go:356] "Generic (PLEG): container finished" podID="5e948d54-7216-488a-8bb2-16f8cf8a0da4" containerID="bef2d0529cdd5780921ad14e57f6e799a902c2132acf07272e5bf9ac2d60f939" exitCode=0
Jul 23 16:25:24.460819 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:25:24.460787    2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-xdbwx"
Jul 23 16:25:24.460925 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:25:24.460821    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-xdbwx" event={"ID":"5e948d54-7216-488a-8bb2-16f8cf8a0da4","Type":"ContainerDied","Data":"bef2d0529cdd5780921ad14e57f6e799a902c2132acf07272e5bf9ac2d60f939"}
Jul 23 16:25:24.460925 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:25:24.460853    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-xdbwx" event={"ID":"5e948d54-7216-488a-8bb2-16f8cf8a0da4","Type":"ContainerDied","Data":"899e7d058a6fbf85348b7500525b98c5d4930d9aa8619e97b7e7261af1073ec6"}
Jul 23 16:25:24.468704 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:25:24.468689    2553 scope.go:117] "RemoveContainer" containerID="5791d0d3e9abda4f1d332d7308a12f1fed178900c84a1147b845b48843378c55"
Jul 23 16:25:24.468940 ip-10-0-143-166 kubenswrapper[2553]: E0723 16:25:24.468925    2553 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5791d0d3e9abda4f1d332d7308a12f1fed178900c84a1147b845b48843378c55\": container with ID starting with 5791d0d3e9abda4f1d332d7308a12f1fed178900c84a1147b845b48843378c55 not found: ID does not exist" containerID="5791d0d3e9abda4f1d332d7308a12f1fed178900c84a1147b845b48843378c55"
Jul 23 16:25:24.469016 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:25:24.468946    2553 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5791d0d3e9abda4f1d332d7308a12f1fed178900c84a1147b845b48843378c55"} err="failed to get container status \"5791d0d3e9abda4f1d332d7308a12f1fed178900c84a1147b845b48843378c55\": rpc error: code = NotFound desc = could not find container \"5791d0d3e9abda4f1d332d7308a12f1fed178900c84a1147b845b48843378c55\": container with ID starting with 5791d0d3e9abda4f1d332d7308a12f1fed178900c84a1147b845b48843378c55 not found: ID does not exist"
Jul 23 16:25:24.469016 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:25:24.468961    2553 scope.go:117] "RemoveContainer" containerID="bef2d0529cdd5780921ad14e57f6e799a902c2132acf07272e5bf9ac2d60f939"
Jul 23 16:25:24.477088 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:25:24.477072    2553 scope.go:117] "RemoveContainer" containerID="bef2d0529cdd5780921ad14e57f6e799a902c2132acf07272e5bf9ac2d60f939"
Jul 23 16:25:24.477370 ip-10-0-143-166 kubenswrapper[2553]: E0723 16:25:24.477353    2553 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bef2d0529cdd5780921ad14e57f6e799a902c2132acf07272e5bf9ac2d60f939\": container with ID starting with bef2d0529cdd5780921ad14e57f6e799a902c2132acf07272e5bf9ac2d60f939 not found: ID does not exist" containerID="bef2d0529cdd5780921ad14e57f6e799a902c2132acf07272e5bf9ac2d60f939"
Jul 23 16:25:24.477424 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:25:24.477377    2553 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bef2d0529cdd5780921ad14e57f6e799a902c2132acf07272e5bf9ac2d60f939"} err="failed to get container status \"bef2d0529cdd5780921ad14e57f6e799a902c2132acf07272e5bf9ac2d60f939\": rpc error: code = NotFound desc = could not find container \"bef2d0529cdd5780921ad14e57f6e799a902c2132acf07272e5bf9ac2d60f939\": container with ID starting with bef2d0529cdd5780921ad14e57f6e799a902c2132acf07272e5bf9ac2d60f939 not found: ID does not exist"
Jul 23 16:25:24.481581 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:25:24.481559    2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-cbslf"]
Jul 23 16:25:24.487894 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:25:24.487863    2553 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-cbslf"]
Jul 23 16:25:24.499283 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:25:24.499259    2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-xdbwx"]
Jul 23 16:25:24.503599 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:25:24.503578    2553 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-75d556bd77-xdbwx"]
Jul 23 16:25:24.675521 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:25:24.675485    2553 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5e948d54-7216-488a-8bb2-16f8cf8a0da4" path="/var/lib/kubelet/pods/5e948d54-7216-488a-8bb2-16f8cf8a0da4/volumes"
Jul 23 16:25:24.675795 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:25:24.675783    2553 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="99c3dd9d-f128-4bac-b9e1-f3e029de3e56" path="/var/lib/kubelet/pods/99c3dd9d-f128-4bac-b9e1-f3e029de3e56/volumes"
Jul 23 16:26:37.541458 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:26:37.541424    2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-2nk7c"]
Jul 23 16:26:37.542036 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:26:37.541891    2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5e948d54-7216-488a-8bb2-16f8cf8a0da4" containerName="authorino"
Jul 23 16:26:37.542036 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:26:37.541909    2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="5e948d54-7216-488a-8bb2-16f8cf8a0da4" containerName="authorino"
Jul 23 16:26:37.542036 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:26:37.541921    2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="99c3dd9d-f128-4bac-b9e1-f3e029de3e56" containerName="authorino"
Jul 23 16:26:37.542036 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:26:37.541931    2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="99c3dd9d-f128-4bac-b9e1-f3e029de3e56" containerName="authorino"
Jul 23 16:26:37.542284 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:26:37.542040    2553 memory_manager.go:368] "RemoveStaleState removing state" podUID="5e948d54-7216-488a-8bb2-16f8cf8a0da4" containerName="authorino"
Jul 23 16:26:37.542284 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:26:37.542054    2553 memory_manager.go:368] "RemoveStaleState removing state" podUID="99c3dd9d-f128-4bac-b9e1-f3e029de3e56" containerName="authorino"
Jul 23 16:26:37.546544 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:26:37.546522    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-2nk7c"
Jul 23 16:26:37.549453 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:26:37.549434    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Jul 23 16:26:37.550536 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:26:37.550521    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Jul 23 16:26:37.550597 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:26:37.550555    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-jvnq5\""
Jul 23 16:26:37.550597 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:26:37.550556    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\""
Jul 23 16:26:37.555785 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:26:37.555763    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-2nk7c"]
Jul 23 16:26:37.660929 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:26:37.660896    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0e180557-6ae4-4e82-bcdc-a52826ec9f66-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-2nk7c\" (UID: \"0e180557-6ae4-4e82-bcdc-a52826ec9f66\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-2nk7c"
Jul 23 16:26:37.660929 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:26:37.660933    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wt6fb\" (UniqueName: \"kubernetes.io/projected/0e180557-6ae4-4e82-bcdc-a52826ec9f66-kube-api-access-wt6fb\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-2nk7c\" (UID: \"0e180557-6ae4-4e82-bcdc-a52826ec9f66\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-2nk7c"
Jul 23 16:26:37.661137 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:26:37.660963    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0e180557-6ae4-4e82-bcdc-a52826ec9f66-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-2nk7c\" (UID: \"0e180557-6ae4-4e82-bcdc-a52826ec9f66\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-2nk7c"
Jul 23 16:26:37.661137 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:26:37.660990    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0e180557-6ae4-4e82-bcdc-a52826ec9f66-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-2nk7c\" (UID: \"0e180557-6ae4-4e82-bcdc-a52826ec9f66\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-2nk7c"
Jul 23 16:26:37.661137 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:26:37.661031    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0e180557-6ae4-4e82-bcdc-a52826ec9f66-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-2nk7c\" (UID: \"0e180557-6ae4-4e82-bcdc-a52826ec9f66\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-2nk7c"
Jul 23 16:26:37.661137 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:26:37.661074    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0e180557-6ae4-4e82-bcdc-a52826ec9f66-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-2nk7c\" (UID: \"0e180557-6ae4-4e82-bcdc-a52826ec9f66\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-2nk7c"
Jul 23 16:26:37.761909 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:26:37.761870    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0e180557-6ae4-4e82-bcdc-a52826ec9f66-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-2nk7c\" (UID: \"0e180557-6ae4-4e82-bcdc-a52826ec9f66\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-2nk7c"
Jul 23 16:26:37.762078 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:26:37.761925    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0e180557-6ae4-4e82-bcdc-a52826ec9f66-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-2nk7c\" (UID: \"0e180557-6ae4-4e82-bcdc-a52826ec9f66\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-2nk7c"
Jul 23 16:26:37.762078 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:26:37.761986    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0e180557-6ae4-4e82-bcdc-a52826ec9f66-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-2nk7c\" (UID: \"0e180557-6ae4-4e82-bcdc-a52826ec9f66\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-2nk7c"
Jul 23 16:26:37.762078 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:26:37.762030    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0e180557-6ae4-4e82-bcdc-a52826ec9f66-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-2nk7c\" (UID: \"0e180557-6ae4-4e82-bcdc-a52826ec9f66\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-2nk7c"
Jul 23 16:26:37.762078 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:26:37.762058    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wt6fb\" (UniqueName: \"kubernetes.io/projected/0e180557-6ae4-4e82-bcdc-a52826ec9f66-kube-api-access-wt6fb\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-2nk7c\" (UID: \"0e180557-6ae4-4e82-bcdc-a52826ec9f66\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-2nk7c"
Jul 23 16:26:37.762311 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:26:37.762101    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0e180557-6ae4-4e82-bcdc-a52826ec9f66-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-2nk7c\" (UID: \"0e180557-6ae4-4e82-bcdc-a52826ec9f66\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-2nk7c"
Jul 23 16:26:37.762410 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:26:37.762386    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0e180557-6ae4-4e82-bcdc-a52826ec9f66-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-2nk7c\" (UID: \"0e180557-6ae4-4e82-bcdc-a52826ec9f66\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-2nk7c"
Jul 23 16:26:37.762481 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:26:37.762421    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0e180557-6ae4-4e82-bcdc-a52826ec9f66-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-2nk7c\" (UID: \"0e180557-6ae4-4e82-bcdc-a52826ec9f66\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-2nk7c"
Jul 23 16:26:37.762568 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:26:37.762548    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0e180557-6ae4-4e82-bcdc-a52826ec9f66-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-2nk7c\" (UID: \"0e180557-6ae4-4e82-bcdc-a52826ec9f66\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-2nk7c"
Jul 23 16:26:37.764492 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:26:37.764469    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0e180557-6ae4-4e82-bcdc-a52826ec9f66-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-2nk7c\" (UID: \"0e180557-6ae4-4e82-bcdc-a52826ec9f66\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-2nk7c"
Jul 23 16:26:37.764760 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:26:37.764739    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0e180557-6ae4-4e82-bcdc-a52826ec9f66-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-2nk7c\" (UID: \"0e180557-6ae4-4e82-bcdc-a52826ec9f66\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-2nk7c"
Jul 23 16:26:37.770273 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:26:37.770228    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wt6fb\" (UniqueName: \"kubernetes.io/projected/0e180557-6ae4-4e82-bcdc-a52826ec9f66-kube-api-access-wt6fb\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-2nk7c\" (UID: \"0e180557-6ae4-4e82-bcdc-a52826ec9f66\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-2nk7c"
Jul 23 16:26:37.857281 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:26:37.857197    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-2nk7c"
Jul 23 16:26:37.993158 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:26:37.993130    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-2nk7c"]
Jul 23 16:26:37.995299 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:26:37.995265    2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0e180557_6ae4_4e82_bcdc_a52826ec9f66.slice/crio-a20e431cce456b27c0ef77d75e843f7202ce5a9968502d45e1dd575ce3b1f1f2 WatchSource:0}: Error finding container a20e431cce456b27c0ef77d75e843f7202ce5a9968502d45e1dd575ce3b1f1f2: Status 404 returned error can't find the container with id a20e431cce456b27c0ef77d75e843f7202ce5a9968502d45e1dd575ce3b1f1f2
Jul 23 16:26:37.997230 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:26:37.997207    2553 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 23 16:26:38.847551 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:26:38.847501    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-2nk7c" event={"ID":"0e180557-6ae4-4e82-bcdc-a52826ec9f66","Type":"ContainerStarted","Data":"a20e431cce456b27c0ef77d75e843f7202ce5a9968502d45e1dd575ce3b1f1f2"}
Jul 23 16:26:39.853918 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:26:39.853831    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-2nk7c" event={"ID":"0e180557-6ae4-4e82-bcdc-a52826ec9f66","Type":"ContainerStarted","Data":"16f610f4b96b2221ad2f0b22345e35f53b04adc4b2bfd6343c54e5a9fea2ad67"}
Jul 23 16:26:39.872340 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:26:39.872294    2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-2nk7c" podStartSLOduration=1.358018735 podStartE2EDuration="2.872279885s" totalImagesPullingTime="1.51426115s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 16:26:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 16:26:39.870258366 +0000 UTC m=+681.734864495" watchObservedRunningTime="2026-07-23 16:26:39.872279885 +0000 UTC m=+681.736886012"
Jul 23 16:26:47.857482 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:26:47.857442    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-2nk7c"
Jul 23 16:26:47.857907 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:26:47.857507    2553 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-2nk7c"
Jul 23 16:26:47.870041 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:26:47.870010    2553 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-2nk7c"
Jul 23 16:26:47.904962 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:26:47.904930    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-2nk7c"
Jul 23 16:29:03.277424 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:29:03.277387    2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-795674df9c-xsm7j"]
Jul 23 16:29:03.280995 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:29:03.280974    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-795674df9c-xsm7j"
Jul 23 16:29:03.289126 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:29:03.289104    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-795674df9c-xsm7j"]
Jul 23 16:29:03.414501 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:29:03.414449    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/6d2ed5f0-e198-49bc-b05b-4433565c26f4-tls-cert\") pod \"authorino-795674df9c-xsm7j\" (UID: \"6d2ed5f0-e198-49bc-b05b-4433565c26f4\") " pod="kuadrant-system/authorino-795674df9c-xsm7j"
Jul 23 16:29:03.414681 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:29:03.414577    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dtnhp\" (UniqueName: \"kubernetes.io/projected/6d2ed5f0-e198-49bc-b05b-4433565c26f4-kube-api-access-dtnhp\") pod \"authorino-795674df9c-xsm7j\" (UID: \"6d2ed5f0-e198-49bc-b05b-4433565c26f4\") " pod="kuadrant-system/authorino-795674df9c-xsm7j"
Jul 23 16:29:03.515600 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:29:03.515543    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/6d2ed5f0-e198-49bc-b05b-4433565c26f4-tls-cert\") pod \"authorino-795674df9c-xsm7j\" (UID: \"6d2ed5f0-e198-49bc-b05b-4433565c26f4\") " pod="kuadrant-system/authorino-795674df9c-xsm7j"
Jul 23 16:29:03.515811 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:29:03.515635    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dtnhp\" (UniqueName: \"kubernetes.io/projected/6d2ed5f0-e198-49bc-b05b-4433565c26f4-kube-api-access-dtnhp\") pod \"authorino-795674df9c-xsm7j\" (UID: \"6d2ed5f0-e198-49bc-b05b-4433565c26f4\") " pod="kuadrant-system/authorino-795674df9c-xsm7j"
Jul 23 16:29:03.517995 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:29:03.517971    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/6d2ed5f0-e198-49bc-b05b-4433565c26f4-tls-cert\") pod \"authorino-795674df9c-xsm7j\" (UID: \"6d2ed5f0-e198-49bc-b05b-4433565c26f4\") " pod="kuadrant-system/authorino-795674df9c-xsm7j"
Jul 23 16:29:03.524717 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:29:03.524696    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dtnhp\" (UniqueName: \"kubernetes.io/projected/6d2ed5f0-e198-49bc-b05b-4433565c26f4-kube-api-access-dtnhp\") pod \"authorino-795674df9c-xsm7j\" (UID: \"6d2ed5f0-e198-49bc-b05b-4433565c26f4\") " pod="kuadrant-system/authorino-795674df9c-xsm7j"
Jul 23 16:29:03.590855 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:29:03.590772    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-795674df9c-xsm7j"
Jul 23 16:29:03.722562 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:29:03.722540    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-795674df9c-xsm7j"]
Jul 23 16:29:03.724359 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:29:03.724332    2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod6d2ed5f0_e198_49bc_b05b_4433565c26f4.slice/crio-9f6877cc4135344adb5fa67ebd1ca0fc34880eb36f057655165c27c8c24d7192 WatchSource:0}: Error finding container 9f6877cc4135344adb5fa67ebd1ca0fc34880eb36f057655165c27c8c24d7192: Status 404 returned error can't find the container with id 9f6877cc4135344adb5fa67ebd1ca0fc34880eb36f057655165c27c8c24d7192
Jul 23 16:29:04.580488 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:29:04.580396    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-795674df9c-xsm7j" event={"ID":"6d2ed5f0-e198-49bc-b05b-4433565c26f4","Type":"ContainerStarted","Data":"a2b2baf18211f21e94a761ebbcab3678123840e2b8dbfd37ca24ebad307fc30a"}
Jul 23 16:29:04.580488 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:29:04.580445    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-795674df9c-xsm7j" event={"ID":"6d2ed5f0-e198-49bc-b05b-4433565c26f4","Type":"ContainerStarted","Data":"9f6877cc4135344adb5fa67ebd1ca0fc34880eb36f057655165c27c8c24d7192"}
Jul 23 16:29:04.616345 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:29:04.616280    2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-795674df9c-xsm7j" podStartSLOduration=1.098014397 podStartE2EDuration="1.616259008s" totalImagesPullingTime="518.244611ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 16:29:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 16:29:04.613250598 +0000 UTC m=+826.477856724" watchObservedRunningTime="2026-07-23 16:29:04.616259008 +0000 UTC m=+826.480865136"
Jul 23 16:29:04.680942 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:29:04.680903    2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-76cb5fbf6d-gzprh"]
Jul 23 16:29:04.681193 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:29:04.681113    2553 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-76cb5fbf6d-gzprh" podUID="bca8b878-71e1-4114-a30c-a9bca0b9a903" containerName="authorino" containerID="cri-o://5fe49ed42db27662bad60528b9f5b7726f3e951e0fd09645cd21398571819843" gracePeriod=30
Jul 23 16:29:04.945214 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:29:04.945181    2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-76cb5fbf6d-gzprh"
Jul 23 16:29:05.024980 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:29:05.024934    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/bca8b878-71e1-4114-a30c-a9bca0b9a903-tls-cert\") pod \"bca8b878-71e1-4114-a30c-a9bca0b9a903\" (UID: \"bca8b878-71e1-4114-a30c-a9bca0b9a903\") "
Jul 23 16:29:05.025181 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:29:05.025012    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jf5nl\" (UniqueName: \"kubernetes.io/projected/bca8b878-71e1-4114-a30c-a9bca0b9a903-kube-api-access-jf5nl\") pod \"bca8b878-71e1-4114-a30c-a9bca0b9a903\" (UID: \"bca8b878-71e1-4114-a30c-a9bca0b9a903\") "
Jul 23 16:29:05.027142 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:29:05.027111    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bca8b878-71e1-4114-a30c-a9bca0b9a903-kube-api-access-jf5nl" (OuterVolumeSpecName: "kube-api-access-jf5nl") pod "bca8b878-71e1-4114-a30c-a9bca0b9a903" (UID: "bca8b878-71e1-4114-a30c-a9bca0b9a903"). InnerVolumeSpecName "kube-api-access-jf5nl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 16:29:05.035724 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:29:05.035689    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bca8b878-71e1-4114-a30c-a9bca0b9a903-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "bca8b878-71e1-4114-a30c-a9bca0b9a903" (UID: "bca8b878-71e1-4114-a30c-a9bca0b9a903"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 23 16:29:05.126271 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:29:05.126190    2553 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/bca8b878-71e1-4114-a30c-a9bca0b9a903-tls-cert\") on node \"ip-10-0-143-166.ec2.internal\" DevicePath \"\""
Jul 23 16:29:05.126271 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:29:05.126218    2553 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jf5nl\" (UniqueName: \"kubernetes.io/projected/bca8b878-71e1-4114-a30c-a9bca0b9a903-kube-api-access-jf5nl\") on node \"ip-10-0-143-166.ec2.internal\" DevicePath \"\""
Jul 23 16:29:05.592225 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:29:05.592186    2553 generic.go:356] "Generic (PLEG): container finished" podID="bca8b878-71e1-4114-a30c-a9bca0b9a903" containerID="5fe49ed42db27662bad60528b9f5b7726f3e951e0fd09645cd21398571819843" exitCode=0
Jul 23 16:29:05.592225 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:29:05.592208    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-76cb5fbf6d-gzprh" event={"ID":"bca8b878-71e1-4114-a30c-a9bca0b9a903","Type":"ContainerDied","Data":"5fe49ed42db27662bad60528b9f5b7726f3e951e0fd09645cd21398571819843"}
Jul 23 16:29:05.592225 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:29:05.592231    2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-76cb5fbf6d-gzprh"
Jul 23 16:29:05.592836 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:29:05.592252    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-76cb5fbf6d-gzprh" event={"ID":"bca8b878-71e1-4114-a30c-a9bca0b9a903","Type":"ContainerDied","Data":"1c5446c5d4fd0db2da2a96f994eb7008a17d0c0bfb6c7457d7c71926da3c3a43"}
Jul 23 16:29:05.592836 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:29:05.592275    2553 scope.go:117] "RemoveContainer" containerID="5fe49ed42db27662bad60528b9f5b7726f3e951e0fd09645cd21398571819843"
Jul 23 16:29:05.602255 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:29:05.602159    2553 scope.go:117] "RemoveContainer" containerID="5fe49ed42db27662bad60528b9f5b7726f3e951e0fd09645cd21398571819843"
Jul 23 16:29:05.602573 ip-10-0-143-166 kubenswrapper[2553]: E0723 16:29:05.602553    2553 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5fe49ed42db27662bad60528b9f5b7726f3e951e0fd09645cd21398571819843\": container with ID starting with 5fe49ed42db27662bad60528b9f5b7726f3e951e0fd09645cd21398571819843 not found: ID does not exist" containerID="5fe49ed42db27662bad60528b9f5b7726f3e951e0fd09645cd21398571819843"
Jul 23 16:29:05.602637 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:29:05.602589    2553 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5fe49ed42db27662bad60528b9f5b7726f3e951e0fd09645cd21398571819843"} err="failed to get container status \"5fe49ed42db27662bad60528b9f5b7726f3e951e0fd09645cd21398571819843\": rpc error: code = NotFound desc = could not find container \"5fe49ed42db27662bad60528b9f5b7726f3e951e0fd09645cd21398571819843\": container with ID starting with 5fe49ed42db27662bad60528b9f5b7726f3e951e0fd09645cd21398571819843 not found: ID does not exist"
Jul 23 16:29:05.623326 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:29:05.623285    2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-76cb5fbf6d-gzprh"]
Jul 23 16:29:05.647822 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:29:05.647782    2553 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-76cb5fbf6d-gzprh"]
Jul 23 16:29:06.676541 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:29:06.676492    2553 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bca8b878-71e1-4114-a30c-a9bca0b9a903" path="/var/lib/kubelet/pods/bca8b878-71e1-4114-a30c-a9bca0b9a903/volumes"
Jul 23 16:30:00.147229 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:30:00.147194    2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29747070-v6j5j"]
Jul 23 16:30:00.147698 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:30:00.147525    2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bca8b878-71e1-4114-a30c-a9bca0b9a903" containerName="authorino"
Jul 23 16:30:00.147698 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:30:00.147536    2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="bca8b878-71e1-4114-a30c-a9bca0b9a903" containerName="authorino"
Jul 23 16:30:00.147698 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:30:00.147593    2553 memory_manager.go:368] "RemoveStaleState removing state" podUID="bca8b878-71e1-4114-a30c-a9bca0b9a903" containerName="authorino"
Jul 23 16:30:00.150437 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:30:00.150422    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29747070-v6j5j"
Jul 23 16:30:00.153302 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:30:00.153282    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-plqcf\""
Jul 23 16:30:00.158070 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:30:00.158050    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29747070-v6j5j"]
Jul 23 16:30:00.161499 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:30:00.161476    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29747070-v6j5j"
Jul 23 16:30:00.298511 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:30:00.298476    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29747070-v6j5j"]
Jul 23 16:30:00.299074 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:30:00.299050    2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb68a4008_7671_4c63_baba_8e1174052e9d.slice/crio-6ed267a8c3afb907bcd8e859f13c3a9a3379b339c37fba4aaf832648a47da046 WatchSource:0}: Error finding container 6ed267a8c3afb907bcd8e859f13c3a9a3379b339c37fba4aaf832648a47da046: Status 404 returned error can't find the container with id 6ed267a8c3afb907bcd8e859f13c3a9a3379b339c37fba4aaf832648a47da046
Jul 23 16:30:00.866142 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:30:00.866107    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29747070-v6j5j" event={"ID":"b68a4008-7671-4c63-baba-8e1174052e9d","Type":"ContainerStarted","Data":"6ed267a8c3afb907bcd8e859f13c3a9a3379b339c37fba4aaf832648a47da046"}
Jul 23 16:30:02.880380 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:30:02.880344    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29747070-v6j5j" event={"ID":"b68a4008-7671-4c63-baba-8e1174052e9d","Type":"ContainerStarted","Data":"078e4360bf89000a6430ca5f328e7d0bdc7bb7a443068739a0ce8cd1dbbb0087"}
Jul 23 16:30:02.897864 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:30:02.897816    2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29747070-v6j5j" podStartSLOduration=0.763634622 podStartE2EDuration="2.89779932s" totalImagesPullingTime="2.134164698s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 16:30:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 16:30:02.896671532 +0000 UTC m=+884.761277660" watchObservedRunningTime="2026-07-23 16:30:02.89779932 +0000 UTC m=+884.762405465"
Jul 23 16:30:03.886648 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:30:03.886613    2553 generic.go:356] "Generic (PLEG): container finished" podID="b68a4008-7671-4c63-baba-8e1174052e9d" containerID="078e4360bf89000a6430ca5f328e7d0bdc7bb7a443068739a0ce8cd1dbbb0087" exitCode=0
Jul 23 16:30:03.887024 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:30:03.886674    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29747070-v6j5j" event={"ID":"b68a4008-7671-4c63-baba-8e1174052e9d","Type":"ContainerDied","Data":"078e4360bf89000a6430ca5f328e7d0bdc7bb7a443068739a0ce8cd1dbbb0087"}
Jul 23 16:30:05.028197 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:30:05.027976    2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29747070-v6j5j"
Jul 23 16:30:05.899611 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:30:05.899583    2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29747070-v6j5j"
Jul 23 16:30:05.899611 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:30:05.899595    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29747070-v6j5j" event={"ID":"b68a4008-7671-4c63-baba-8e1174052e9d","Type":"ContainerDied","Data":"6ed267a8c3afb907bcd8e859f13c3a9a3379b339c37fba4aaf832648a47da046"}
Jul 23 16:30:05.899896 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:30:05.899641    2553 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="6ed267a8c3afb907bcd8e859f13c3a9a3379b339c37fba4aaf832648a47da046"
Jul 23 16:30:18.569874 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:30:18.569853    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-7rmrn_976a7198-cfd3-43d4-8c9f-b1f248d1f6d7/console-operator/1.log"
Jul 23 16:30:18.570484 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:30:18.570468    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-7rmrn_976a7198-cfd3-43d4-8c9f-b1f248d1f6d7/console-operator/1.log"
Jul 23 16:35:18.602842 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:35:18.602812    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-7rmrn_976a7198-cfd3-43d4-8c9f-b1f248d1f6d7/console-operator/1.log"
Jul 23 16:35:18.604933 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:35:18.604909    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-7rmrn_976a7198-cfd3-43d4-8c9f-b1f248d1f6d7/console-operator/1.log"
Jul 23 16:39:43.923552 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:39:43.923472    2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-same-id-b-4afbf09d-kserve-79d958df67-qrzkz"]
Jul 23 16:39:43.924027 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:39:43.923830    2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b68a4008-7671-4c63-baba-8e1174052e9d" containerName="cleanup"
Jul 23 16:39:43.924027 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:39:43.923844    2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="b68a4008-7671-4c63-baba-8e1174052e9d" containerName="cleanup"
Jul 23 16:39:43.924027 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:39:43.923910    2553 memory_manager.go:368] "RemoveStaleState removing state" podUID="b68a4008-7671-4c63-baba-8e1174052e9d" containerName="cleanup"
Jul 23 16:39:43.926888 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:39:43.926871    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-4afbf09d-kserve-79d958df67-qrzkz"
Jul 23 16:39:43.929598 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:39:43.929573    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-same-id-b-4afbf09d-kserve-self-signed-certs\""
Jul 23 16:39:43.935704 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:39:43.935681    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-same-id-b-4afbf09d-kserve-79d958df67-qrzkz"]
Jul 23 16:39:44.089489 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:39:44.089449    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d9e8ae95-4d11-48a6-8b30-4683ecfa5e28-home\") pod \"e2e-same-id-b-4afbf09d-kserve-79d958df67-qrzkz\" (UID: \"d9e8ae95-4d11-48a6-8b30-4683ecfa5e28\") " pod="llm/e2e-same-id-b-4afbf09d-kserve-79d958df67-qrzkz"
Jul 23 16:39:44.089489 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:39:44.089492    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d9e8ae95-4d11-48a6-8b30-4683ecfa5e28-model-cache\") pod \"e2e-same-id-b-4afbf09d-kserve-79d958df67-qrzkz\" (UID: \"d9e8ae95-4d11-48a6-8b30-4683ecfa5e28\") " pod="llm/e2e-same-id-b-4afbf09d-kserve-79d958df67-qrzkz"
Jul 23 16:39:44.089730 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:39:44.089558    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-68t7p\" (UniqueName: \"kubernetes.io/projected/d9e8ae95-4d11-48a6-8b30-4683ecfa5e28-kube-api-access-68t7p\") pod \"e2e-same-id-b-4afbf09d-kserve-79d958df67-qrzkz\" (UID: \"d9e8ae95-4d11-48a6-8b30-4683ecfa5e28\") " pod="llm/e2e-same-id-b-4afbf09d-kserve-79d958df67-qrzkz"
Jul 23 16:39:44.089730 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:39:44.089621    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d9e8ae95-4d11-48a6-8b30-4683ecfa5e28-tls-certs\") pod \"e2e-same-id-b-4afbf09d-kserve-79d958df67-qrzkz\" (UID: \"d9e8ae95-4d11-48a6-8b30-4683ecfa5e28\") " pod="llm/e2e-same-id-b-4afbf09d-kserve-79d958df67-qrzkz"
Jul 23 16:39:44.089730 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:39:44.089647    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d9e8ae95-4d11-48a6-8b30-4683ecfa5e28-dshm\") pod \"e2e-same-id-b-4afbf09d-kserve-79d958df67-qrzkz\" (UID: \"d9e8ae95-4d11-48a6-8b30-4683ecfa5e28\") " pod="llm/e2e-same-id-b-4afbf09d-kserve-79d958df67-qrzkz"
Jul 23 16:39:44.089730 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:39:44.089706    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d9e8ae95-4d11-48a6-8b30-4683ecfa5e28-tmp-dir\") pod \"e2e-same-id-b-4afbf09d-kserve-79d958df67-qrzkz\" (UID: \"d9e8ae95-4d11-48a6-8b30-4683ecfa5e28\") " pod="llm/e2e-same-id-b-4afbf09d-kserve-79d958df67-qrzkz"
Jul 23 16:39:44.190304 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:39:44.190159    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d9e8ae95-4d11-48a6-8b30-4683ecfa5e28-tmp-dir\") pod \"e2e-same-id-b-4afbf09d-kserve-79d958df67-qrzkz\" (UID: \"d9e8ae95-4d11-48a6-8b30-4683ecfa5e28\") " pod="llm/e2e-same-id-b-4afbf09d-kserve-79d958df67-qrzkz"
Jul 23 16:39:44.190304 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:39:44.190289    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d9e8ae95-4d11-48a6-8b30-4683ecfa5e28-home\") pod \"e2e-same-id-b-4afbf09d-kserve-79d958df67-qrzkz\" (UID: \"d9e8ae95-4d11-48a6-8b30-4683ecfa5e28\") " pod="llm/e2e-same-id-b-4afbf09d-kserve-79d958df67-qrzkz"
Jul 23 16:39:44.190304 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:39:44.190310    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d9e8ae95-4d11-48a6-8b30-4683ecfa5e28-model-cache\") pod \"e2e-same-id-b-4afbf09d-kserve-79d958df67-qrzkz\" (UID: \"d9e8ae95-4d11-48a6-8b30-4683ecfa5e28\") " pod="llm/e2e-same-id-b-4afbf09d-kserve-79d958df67-qrzkz"
Jul 23 16:39:44.190600 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:39:44.190329    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-68t7p\" (UniqueName: \"kubernetes.io/projected/d9e8ae95-4d11-48a6-8b30-4683ecfa5e28-kube-api-access-68t7p\") pod \"e2e-same-id-b-4afbf09d-kserve-79d958df67-qrzkz\" (UID: \"d9e8ae95-4d11-48a6-8b30-4683ecfa5e28\") " pod="llm/e2e-same-id-b-4afbf09d-kserve-79d958df67-qrzkz"
Jul 23 16:39:44.190600 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:39:44.190363    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d9e8ae95-4d11-48a6-8b30-4683ecfa5e28-tls-certs\") pod \"e2e-same-id-b-4afbf09d-kserve-79d958df67-qrzkz\" (UID: \"d9e8ae95-4d11-48a6-8b30-4683ecfa5e28\") " pod="llm/e2e-same-id-b-4afbf09d-kserve-79d958df67-qrzkz"
Jul 23 16:39:44.190600 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:39:44.190391    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d9e8ae95-4d11-48a6-8b30-4683ecfa5e28-dshm\") pod \"e2e-same-id-b-4afbf09d-kserve-79d958df67-qrzkz\" (UID: \"d9e8ae95-4d11-48a6-8b30-4683ecfa5e28\") " pod="llm/e2e-same-id-b-4afbf09d-kserve-79d958df67-qrzkz"
Jul 23 16:39:44.190600 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:39:44.190582    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d9e8ae95-4d11-48a6-8b30-4683ecfa5e28-tmp-dir\") pod \"e2e-same-id-b-4afbf09d-kserve-79d958df67-qrzkz\" (UID: \"d9e8ae95-4d11-48a6-8b30-4683ecfa5e28\") " pod="llm/e2e-same-id-b-4afbf09d-kserve-79d958df67-qrzkz"
Jul 23 16:39:44.190788 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:39:44.190619    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d9e8ae95-4d11-48a6-8b30-4683ecfa5e28-home\") pod \"e2e-same-id-b-4afbf09d-kserve-79d958df67-qrzkz\" (UID: \"d9e8ae95-4d11-48a6-8b30-4683ecfa5e28\") " pod="llm/e2e-same-id-b-4afbf09d-kserve-79d958df67-qrzkz"
Jul 23 16:39:44.190788 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:39:44.190689    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d9e8ae95-4d11-48a6-8b30-4683ecfa5e28-model-cache\") pod \"e2e-same-id-b-4afbf09d-kserve-79d958df67-qrzkz\" (UID: \"d9e8ae95-4d11-48a6-8b30-4683ecfa5e28\") " pod="llm/e2e-same-id-b-4afbf09d-kserve-79d958df67-qrzkz"
Jul 23 16:39:44.192698 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:39:44.192669    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d9e8ae95-4d11-48a6-8b30-4683ecfa5e28-dshm\") pod \"e2e-same-id-b-4afbf09d-kserve-79d958df67-qrzkz\" (UID: \"d9e8ae95-4d11-48a6-8b30-4683ecfa5e28\") " pod="llm/e2e-same-id-b-4afbf09d-kserve-79d958df67-qrzkz"
Jul 23 16:39:44.192835 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:39:44.192816    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d9e8ae95-4d11-48a6-8b30-4683ecfa5e28-tls-certs\") pod \"e2e-same-id-b-4afbf09d-kserve-79d958df67-qrzkz\" (UID: \"d9e8ae95-4d11-48a6-8b30-4683ecfa5e28\") " pod="llm/e2e-same-id-b-4afbf09d-kserve-79d958df67-qrzkz"
Jul 23 16:39:44.199107 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:39:44.199077    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-68t7p\" (UniqueName: \"kubernetes.io/projected/d9e8ae95-4d11-48a6-8b30-4683ecfa5e28-kube-api-access-68t7p\") pod \"e2e-same-id-b-4afbf09d-kserve-79d958df67-qrzkz\" (UID: \"d9e8ae95-4d11-48a6-8b30-4683ecfa5e28\") " pod="llm/e2e-same-id-b-4afbf09d-kserve-79d958df67-qrzkz"
Jul 23 16:39:44.237005 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:39:44.236966    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-4afbf09d-kserve-79d958df67-qrzkz"
Jul 23 16:39:44.378674 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:39:44.378644    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-same-id-b-4afbf09d-kserve-79d958df67-qrzkz"]
Jul 23 16:39:44.379985 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:39:44.379958    2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd9e8ae95_4d11_48a6_8b30_4683ecfa5e28.slice/crio-d24c8ab9bc7b2ca7866526a032ab57161d9f30b070c37cbc1e9c717b9756f4c3 WatchSource:0}: Error finding container d24c8ab9bc7b2ca7866526a032ab57161d9f30b070c37cbc1e9c717b9756f4c3: Status 404 returned error can't find the container with id d24c8ab9bc7b2ca7866526a032ab57161d9f30b070c37cbc1e9c717b9756f4c3
Jul 23 16:39:44.850482 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:39:44.850446    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-4afbf09d-kserve-79d958df67-qrzkz" event={"ID":"d9e8ae95-4d11-48a6-8b30-4683ecfa5e28","Type":"ContainerStarted","Data":"deb006ac6ffc46aecde75c5e407ce971d138de45243fc2d8c629c22056c33a2f"}
Jul 23 16:39:44.850655 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:39:44.850492    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-4afbf09d-kserve-79d958df67-qrzkz" event={"ID":"d9e8ae95-4d11-48a6-8b30-4683ecfa5e28","Type":"ContainerStarted","Data":"d24c8ab9bc7b2ca7866526a032ab57161d9f30b070c37cbc1e9c717b9756f4c3"}
Jul 23 16:39:44.871090 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:39:44.871028    2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-same-id-b-4afbf09d-kserve-79d958df67-qrzkz" podStartSLOduration=1.8710117290000001 podStartE2EDuration="1.871011729s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 16:39:43 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 16:39:44.868936733 +0000 UTC m=+1466.733542862" watchObservedRunningTime="2026-07-23 16:39:44.871011729 +0000 UTC m=+1466.735617857"
Jul 23 16:39:54.237846 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:39:54.237800    2553 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-same-id-b-4afbf09d-kserve-79d958df67-qrzkz"
Jul 23 16:39:54.238361 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:39:54.237863    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-same-id-b-4afbf09d-kserve-79d958df67-qrzkz"
Jul 23 16:39:54.250930 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:39:54.250900    2553 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-same-id-b-4afbf09d-kserve-79d958df67-qrzkz"
Jul 23 16:39:54.912918 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:39:54.912889    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-same-id-b-4afbf09d-kserve-79d958df67-qrzkz"
Jul 23 16:40:18.637722 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:40:18.637691    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-7rmrn_976a7198-cfd3-43d4-8c9f-b1f248d1f6d7/console-operator/1.log"
Jul 23 16:40:18.643347 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:40:18.643313    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-7rmrn_976a7198-cfd3-43d4-8c9f-b1f248d1f6d7/console-operator/1.log"
Jul 23 16:40:40.643431 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:40:40.643396    2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-same-id-b-4afbf09d-kserve-79d958df67-qrzkz"]
Jul 23 16:40:55.664856 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:40:55.664791    2553 kuberuntime_container.go:873] "Killing container with a grace period" pod="llm/e2e-same-id-b-4afbf09d-kserve-79d958df67-qrzkz" podUID="d9e8ae95-4d11-48a6-8b30-4683ecfa5e28" containerName="main" containerID="cri-o://deb006ac6ffc46aecde75c5e407ce971d138de45243fc2d8c629c22056c33a2f" gracePeriod=45
Jul 23 16:40:55.921492 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:40:55.921422    2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-4afbf09d-kserve-79d958df67-qrzkz"
Jul 23 16:40:56.023086 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:40:56.023050    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-68t7p\" (UniqueName: \"kubernetes.io/projected/d9e8ae95-4d11-48a6-8b30-4683ecfa5e28-kube-api-access-68t7p\") pod \"d9e8ae95-4d11-48a6-8b30-4683ecfa5e28\" (UID: \"d9e8ae95-4d11-48a6-8b30-4683ecfa5e28\") "
Jul 23 16:40:56.023305 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:40:56.023099    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d9e8ae95-4d11-48a6-8b30-4683ecfa5e28-tmp-dir\") pod \"d9e8ae95-4d11-48a6-8b30-4683ecfa5e28\" (UID: \"d9e8ae95-4d11-48a6-8b30-4683ecfa5e28\") "
Jul 23 16:40:56.023305 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:40:56.023137    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d9e8ae95-4d11-48a6-8b30-4683ecfa5e28-home\") pod \"d9e8ae95-4d11-48a6-8b30-4683ecfa5e28\" (UID: \"d9e8ae95-4d11-48a6-8b30-4683ecfa5e28\") "
Jul 23 16:40:56.023305 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:40:56.023162    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d9e8ae95-4d11-48a6-8b30-4683ecfa5e28-tls-certs\") pod \"d9e8ae95-4d11-48a6-8b30-4683ecfa5e28\" (UID: \"d9e8ae95-4d11-48a6-8b30-4683ecfa5e28\") "
Jul 23 16:40:56.023305 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:40:56.023277    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d9e8ae95-4d11-48a6-8b30-4683ecfa5e28-model-cache\") pod \"d9e8ae95-4d11-48a6-8b30-4683ecfa5e28\" (UID: \"d9e8ae95-4d11-48a6-8b30-4683ecfa5e28\") "
Jul 23 16:40:56.023525 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:40:56.023329    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d9e8ae95-4d11-48a6-8b30-4683ecfa5e28-dshm\") pod \"d9e8ae95-4d11-48a6-8b30-4683ecfa5e28\" (UID: \"d9e8ae95-4d11-48a6-8b30-4683ecfa5e28\") "
Jul 23 16:40:56.023525 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:40:56.023466    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d9e8ae95-4d11-48a6-8b30-4683ecfa5e28-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "d9e8ae95-4d11-48a6-8b30-4683ecfa5e28" (UID: "d9e8ae95-4d11-48a6-8b30-4683ecfa5e28"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 16:40:56.023525 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:40:56.023478    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d9e8ae95-4d11-48a6-8b30-4683ecfa5e28-home" (OuterVolumeSpecName: "home") pod "d9e8ae95-4d11-48a6-8b30-4683ecfa5e28" (UID: "d9e8ae95-4d11-48a6-8b30-4683ecfa5e28"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 16:40:56.023689 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:40:56.023562    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d9e8ae95-4d11-48a6-8b30-4683ecfa5e28-model-cache" (OuterVolumeSpecName: "model-cache") pod "d9e8ae95-4d11-48a6-8b30-4683ecfa5e28" (UID: "d9e8ae95-4d11-48a6-8b30-4683ecfa5e28"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 16:40:56.023689 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:40:56.023653    2553 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d9e8ae95-4d11-48a6-8b30-4683ecfa5e28-home\") on node \"ip-10-0-143-166.ec2.internal\" DevicePath \"\""
Jul 23 16:40:56.023689 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:40:56.023664    2553 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d9e8ae95-4d11-48a6-8b30-4683ecfa5e28-model-cache\") on node \"ip-10-0-143-166.ec2.internal\" DevicePath \"\""
Jul 23 16:40:56.023689 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:40:56.023674    2553 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d9e8ae95-4d11-48a6-8b30-4683ecfa5e28-tmp-dir\") on node \"ip-10-0-143-166.ec2.internal\" DevicePath \"\""
Jul 23 16:40:56.025599 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:40:56.025567    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d9e8ae95-4d11-48a6-8b30-4683ecfa5e28-dshm" (OuterVolumeSpecName: "dshm") pod "d9e8ae95-4d11-48a6-8b30-4683ecfa5e28" (UID: "d9e8ae95-4d11-48a6-8b30-4683ecfa5e28"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 16:40:56.025708 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:40:56.025606    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d9e8ae95-4d11-48a6-8b30-4683ecfa5e28-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "d9e8ae95-4d11-48a6-8b30-4683ecfa5e28" (UID: "d9e8ae95-4d11-48a6-8b30-4683ecfa5e28"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 23 16:40:56.025708 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:40:56.025625    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d9e8ae95-4d11-48a6-8b30-4683ecfa5e28-kube-api-access-68t7p" (OuterVolumeSpecName: "kube-api-access-68t7p") pod "d9e8ae95-4d11-48a6-8b30-4683ecfa5e28" (UID: "d9e8ae95-4d11-48a6-8b30-4683ecfa5e28"). InnerVolumeSpecName "kube-api-access-68t7p". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 16:40:56.124806 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:40:56.124764    2553 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-68t7p\" (UniqueName: \"kubernetes.io/projected/d9e8ae95-4d11-48a6-8b30-4683ecfa5e28-kube-api-access-68t7p\") on node \"ip-10-0-143-166.ec2.internal\" DevicePath \"\""
Jul 23 16:40:56.124806 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:40:56.124800    2553 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d9e8ae95-4d11-48a6-8b30-4683ecfa5e28-tls-certs\") on node \"ip-10-0-143-166.ec2.internal\" DevicePath \"\""
Jul 23 16:40:56.124806 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:40:56.124809    2553 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d9e8ae95-4d11-48a6-8b30-4683ecfa5e28-dshm\") on node \"ip-10-0-143-166.ec2.internal\" DevicePath \"\""
Jul 23 16:40:56.222245 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:40:56.222148    2553 generic.go:356] "Generic (PLEG): container finished" podID="d9e8ae95-4d11-48a6-8b30-4683ecfa5e28" containerID="deb006ac6ffc46aecde75c5e407ce971d138de45243fc2d8c629c22056c33a2f" exitCode=0
Jul 23 16:40:56.222245 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:40:56.222200    2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-4afbf09d-kserve-79d958df67-qrzkz"
Jul 23 16:40:56.222245 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:40:56.222225    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-4afbf09d-kserve-79d958df67-qrzkz" event={"ID":"d9e8ae95-4d11-48a6-8b30-4683ecfa5e28","Type":"ContainerDied","Data":"deb006ac6ffc46aecde75c5e407ce971d138de45243fc2d8c629c22056c33a2f"}
Jul 23 16:40:56.222490 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:40:56.222266    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-4afbf09d-kserve-79d958df67-qrzkz" event={"ID":"d9e8ae95-4d11-48a6-8b30-4683ecfa5e28","Type":"ContainerDied","Data":"d24c8ab9bc7b2ca7866526a032ab57161d9f30b070c37cbc1e9c717b9756f4c3"}
Jul 23 16:40:56.222490 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:40:56.222283    2553 scope.go:117] "RemoveContainer" containerID="deb006ac6ffc46aecde75c5e407ce971d138de45243fc2d8c629c22056c33a2f"
Jul 23 16:40:56.234314 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:40:56.234288    2553 scope.go:117] "RemoveContainer" containerID="deb006ac6ffc46aecde75c5e407ce971d138de45243fc2d8c629c22056c33a2f"
Jul 23 16:40:56.234618 ip-10-0-143-166 kubenswrapper[2553]: E0723 16:40:56.234596    2553 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"deb006ac6ffc46aecde75c5e407ce971d138de45243fc2d8c629c22056c33a2f\": container with ID starting with deb006ac6ffc46aecde75c5e407ce971d138de45243fc2d8c629c22056c33a2f not found: ID does not exist" containerID="deb006ac6ffc46aecde75c5e407ce971d138de45243fc2d8c629c22056c33a2f"
Jul 23 16:40:56.234670 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:40:56.234630    2553 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"deb006ac6ffc46aecde75c5e407ce971d138de45243fc2d8c629c22056c33a2f"} err="failed to get container status \"deb006ac6ffc46aecde75c5e407ce971d138de45243fc2d8c629c22056c33a2f\": rpc error: code = NotFound desc = could not find container \"deb006ac6ffc46aecde75c5e407ce971d138de45243fc2d8c629c22056c33a2f\": container with ID starting with deb006ac6ffc46aecde75c5e407ce971d138de45243fc2d8c629c22056c33a2f not found: ID does not exist"
Jul 23 16:40:56.245609 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:40:56.245575    2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-same-id-b-4afbf09d-kserve-79d958df67-qrzkz"]
Jul 23 16:40:56.251966 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:40:56.251935    2553 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["llm/e2e-same-id-b-4afbf09d-kserve-79d958df67-qrzkz"]
Jul 23 16:40:56.679511 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:40:56.676703    2553 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d9e8ae95-4d11-48a6-8b30-4683ecfa5e28" path="/var/lib/kubelet/pods/d9e8ae95-4d11-48a6-8b30-4683ecfa5e28/volumes"
Jul 23 16:44:16.529819 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:44:16.529774    2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-6a47fe09-openshift-default-7cc9587b8c-9pvps"]
Jul 23 16:44:16.532405 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:44:16.530160    2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d9e8ae95-4d11-48a6-8b30-4683ecfa5e28" containerName="main"
Jul 23 16:44:16.532405 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:44:16.530193    2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="d9e8ae95-4d11-48a6-8b30-4683ecfa5e28" containerName="main"
Jul 23 16:44:16.532405 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:44:16.530274    2553 memory_manager.go:368] "RemoveStaleState removing state" podUID="d9e8ae95-4d11-48a6-8b30-4683ecfa5e28" containerName="main"
Jul 23 16:44:16.533416 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:44:16.533398    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-6a47fe09-openshift-default-7cc9587b8c-9pvps"
Jul 23 16:44:16.536214 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:44:16.536161    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Jul 23 16:44:16.536379 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:44:16.536305    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-6a47fe09-openshift-default-dockercfg-5l6b8\""
Jul 23 16:44:16.555534 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:44:16.555492    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-6a47fe09-openshift-default-7cc9587b8c-9pvps"]
Jul 23 16:44:16.692079 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:44:16.692029    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9db38c82-9856-49d3-974e-96a836d6a6da-workload-socket\") pod \"e2e-ait-6a47fe09-openshift-default-7cc9587b8c-9pvps\" (UID: \"9db38c82-9856-49d3-974e-96a836d6a6da\") " pod="openshift-ingress/e2e-ait-6a47fe09-openshift-default-7cc9587b8c-9pvps"
Jul 23 16:44:16.692079 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:44:16.692074    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9db38c82-9856-49d3-974e-96a836d6a6da-istiod-ca-cert\") pod \"e2e-ait-6a47fe09-openshift-default-7cc9587b8c-9pvps\" (UID: \"9db38c82-9856-49d3-974e-96a836d6a6da\") " pod="openshift-ingress/e2e-ait-6a47fe09-openshift-default-7cc9587b8c-9pvps"
Jul 23 16:44:16.692327 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:44:16.692102    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9db38c82-9856-49d3-974e-96a836d6a6da-workload-certs\") pod \"e2e-ait-6a47fe09-openshift-default-7cc9587b8c-9pvps\" (UID: \"9db38c82-9856-49d3-974e-96a836d6a6da\") " pod="openshift-ingress/e2e-ait-6a47fe09-openshift-default-7cc9587b8c-9pvps"
Jul 23 16:44:16.692327 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:44:16.692184    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9db38c82-9856-49d3-974e-96a836d6a6da-istio-envoy\") pod \"e2e-ait-6a47fe09-openshift-default-7cc9587b8c-9pvps\" (UID: \"9db38c82-9856-49d3-974e-96a836d6a6da\") " pod="openshift-ingress/e2e-ait-6a47fe09-openshift-default-7cc9587b8c-9pvps"
Jul 23 16:44:16.692327 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:44:16.692234    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g8n7q\" (UniqueName: \"kubernetes.io/projected/9db38c82-9856-49d3-974e-96a836d6a6da-kube-api-access-g8n7q\") pod \"e2e-ait-6a47fe09-openshift-default-7cc9587b8c-9pvps\" (UID: \"9db38c82-9856-49d3-974e-96a836d6a6da\") " pod="openshift-ingress/e2e-ait-6a47fe09-openshift-default-7cc9587b8c-9pvps"
Jul 23 16:44:16.692327 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:44:16.692291    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9db38c82-9856-49d3-974e-96a836d6a6da-credential-socket\") pod \"e2e-ait-6a47fe09-openshift-default-7cc9587b8c-9pvps\" (UID: \"9db38c82-9856-49d3-974e-96a836d6a6da\") " pod="openshift-ingress/e2e-ait-6a47fe09-openshift-default-7cc9587b8c-9pvps"
Jul 23 16:44:16.692327 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:44:16.692310    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9db38c82-9856-49d3-974e-96a836d6a6da-istio-token\") pod \"e2e-ait-6a47fe09-openshift-default-7cc9587b8c-9pvps\" (UID: \"9db38c82-9856-49d3-974e-96a836d6a6da\") " pod="openshift-ingress/e2e-ait-6a47fe09-openshift-default-7cc9587b8c-9pvps"
Jul 23 16:44:16.692483 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:44:16.692335    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9db38c82-9856-49d3-974e-96a836d6a6da-istio-podinfo\") pod \"e2e-ait-6a47fe09-openshift-default-7cc9587b8c-9pvps\" (UID: \"9db38c82-9856-49d3-974e-96a836d6a6da\") " pod="openshift-ingress/e2e-ait-6a47fe09-openshift-default-7cc9587b8c-9pvps"
Jul 23 16:44:16.692483 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:44:16.692373    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9db38c82-9856-49d3-974e-96a836d6a6da-istio-data\") pod \"e2e-ait-6a47fe09-openshift-default-7cc9587b8c-9pvps\" (UID: \"9db38c82-9856-49d3-974e-96a836d6a6da\") " pod="openshift-ingress/e2e-ait-6a47fe09-openshift-default-7cc9587b8c-9pvps"
Jul 23 16:44:16.793678 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:44:16.793585    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g8n7q\" (UniqueName: \"kubernetes.io/projected/9db38c82-9856-49d3-974e-96a836d6a6da-kube-api-access-g8n7q\") pod \"e2e-ait-6a47fe09-openshift-default-7cc9587b8c-9pvps\" (UID: \"9db38c82-9856-49d3-974e-96a836d6a6da\") " pod="openshift-ingress/e2e-ait-6a47fe09-openshift-default-7cc9587b8c-9pvps"
Jul 23 16:44:16.793678 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:44:16.793651    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9db38c82-9856-49d3-974e-96a836d6a6da-credential-socket\") pod \"e2e-ait-6a47fe09-openshift-default-7cc9587b8c-9pvps\" (UID: \"9db38c82-9856-49d3-974e-96a836d6a6da\") " pod="openshift-ingress/e2e-ait-6a47fe09-openshift-default-7cc9587b8c-9pvps"
Jul 23 16:44:16.793678 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:44:16.793680    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9db38c82-9856-49d3-974e-96a836d6a6da-istio-token\") pod \"e2e-ait-6a47fe09-openshift-default-7cc9587b8c-9pvps\" (UID: \"9db38c82-9856-49d3-974e-96a836d6a6da\") " pod="openshift-ingress/e2e-ait-6a47fe09-openshift-default-7cc9587b8c-9pvps"
Jul 23 16:44:16.793943 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:44:16.793709    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9db38c82-9856-49d3-974e-96a836d6a6da-istio-podinfo\") pod \"e2e-ait-6a47fe09-openshift-default-7cc9587b8c-9pvps\" (UID: \"9db38c82-9856-49d3-974e-96a836d6a6da\") " pod="openshift-ingress/e2e-ait-6a47fe09-openshift-default-7cc9587b8c-9pvps"
Jul 23 16:44:16.793943 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:44:16.793762    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9db38c82-9856-49d3-974e-96a836d6a6da-istio-data\") pod \"e2e-ait-6a47fe09-openshift-default-7cc9587b8c-9pvps\" (UID: \"9db38c82-9856-49d3-974e-96a836d6a6da\") " pod="openshift-ingress/e2e-ait-6a47fe09-openshift-default-7cc9587b8c-9pvps"
Jul 23 16:44:16.793943 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:44:16.793815    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9db38c82-9856-49d3-974e-96a836d6a6da-workload-socket\") pod \"e2e-ait-6a47fe09-openshift-default-7cc9587b8c-9pvps\" (UID: \"9db38c82-9856-49d3-974e-96a836d6a6da\") " pod="openshift-ingress/e2e-ait-6a47fe09-openshift-default-7cc9587b8c-9pvps"
Jul 23 16:44:16.793943 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:44:16.793838    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9db38c82-9856-49d3-974e-96a836d6a6da-istiod-ca-cert\") pod \"e2e-ait-6a47fe09-openshift-default-7cc9587b8c-9pvps\" (UID: \"9db38c82-9856-49d3-974e-96a836d6a6da\") " pod="openshift-ingress/e2e-ait-6a47fe09-openshift-default-7cc9587b8c-9pvps"
Jul 23 16:44:16.793943 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:44:16.793878    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9db38c82-9856-49d3-974e-96a836d6a6da-workload-certs\") pod \"e2e-ait-6a47fe09-openshift-default-7cc9587b8c-9pvps\" (UID: \"9db38c82-9856-49d3-974e-96a836d6a6da\") " pod="openshift-ingress/e2e-ait-6a47fe09-openshift-default-7cc9587b8c-9pvps"
Jul 23 16:44:16.794382 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:44:16.794031    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9db38c82-9856-49d3-974e-96a836d6a6da-istio-envoy\") pod \"e2e-ait-6a47fe09-openshift-default-7cc9587b8c-9pvps\" (UID: \"9db38c82-9856-49d3-974e-96a836d6a6da\") " pod="openshift-ingress/e2e-ait-6a47fe09-openshift-default-7cc9587b8c-9pvps"
Jul 23 16:44:16.794382 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:44:16.794202    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9db38c82-9856-49d3-974e-96a836d6a6da-credential-socket\") pod \"e2e-ait-6a47fe09-openshift-default-7cc9587b8c-9pvps\" (UID: \"9db38c82-9856-49d3-974e-96a836d6a6da\") " pod="openshift-ingress/e2e-ait-6a47fe09-openshift-default-7cc9587b8c-9pvps"
Jul 23 16:44:16.794382 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:44:16.794329    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9db38c82-9856-49d3-974e-96a836d6a6da-istio-data\") pod \"e2e-ait-6a47fe09-openshift-default-7cc9587b8c-9pvps\" (UID: \"9db38c82-9856-49d3-974e-96a836d6a6da\") " pod="openshift-ingress/e2e-ait-6a47fe09-openshift-default-7cc9587b8c-9pvps"
Jul 23 16:44:16.794857 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:44:16.794644    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9db38c82-9856-49d3-974e-96a836d6a6da-istiod-ca-cert\") pod \"e2e-ait-6a47fe09-openshift-default-7cc9587b8c-9pvps\" (UID: \"9db38c82-9856-49d3-974e-96a836d6a6da\") " pod="openshift-ingress/e2e-ait-6a47fe09-openshift-default-7cc9587b8c-9pvps"
Jul 23 16:44:16.794857 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:44:16.794812    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9db38c82-9856-49d3-974e-96a836d6a6da-workload-socket\") pod \"e2e-ait-6a47fe09-openshift-default-7cc9587b8c-9pvps\" (UID: \"9db38c82-9856-49d3-974e-96a836d6a6da\") " pod="openshift-ingress/e2e-ait-6a47fe09-openshift-default-7cc9587b8c-9pvps"
Jul 23 16:44:16.795033 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:44:16.794873    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9db38c82-9856-49d3-974e-96a836d6a6da-workload-certs\") pod \"e2e-ait-6a47fe09-openshift-default-7cc9587b8c-9pvps\" (UID: \"9db38c82-9856-49d3-974e-96a836d6a6da\") " pod="openshift-ingress/e2e-ait-6a47fe09-openshift-default-7cc9587b8c-9pvps"
Jul 23 16:44:16.796481 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:44:16.796456    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9db38c82-9856-49d3-974e-96a836d6a6da-istio-envoy\") pod \"e2e-ait-6a47fe09-openshift-default-7cc9587b8c-9pvps\" (UID: \"9db38c82-9856-49d3-974e-96a836d6a6da\") " pod="openshift-ingress/e2e-ait-6a47fe09-openshift-default-7cc9587b8c-9pvps"
Jul 23 16:44:16.796668 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:44:16.796650    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9db38c82-9856-49d3-974e-96a836d6a6da-istio-podinfo\") pod \"e2e-ait-6a47fe09-openshift-default-7cc9587b8c-9pvps\" (UID: \"9db38c82-9856-49d3-974e-96a836d6a6da\") " pod="openshift-ingress/e2e-ait-6a47fe09-openshift-default-7cc9587b8c-9pvps"
Jul 23 16:44:16.802592 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:44:16.802550    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9db38c82-9856-49d3-974e-96a836d6a6da-istio-token\") pod \"e2e-ait-6a47fe09-openshift-default-7cc9587b8c-9pvps\" (UID: \"9db38c82-9856-49d3-974e-96a836d6a6da\") " pod="openshift-ingress/e2e-ait-6a47fe09-openshift-default-7cc9587b8c-9pvps"
Jul 23 16:44:16.802592 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:44:16.802568    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g8n7q\" (UniqueName: \"kubernetes.io/projected/9db38c82-9856-49d3-974e-96a836d6a6da-kube-api-access-g8n7q\") pod \"e2e-ait-6a47fe09-openshift-default-7cc9587b8c-9pvps\" (UID: \"9db38c82-9856-49d3-974e-96a836d6a6da\") " pod="openshift-ingress/e2e-ait-6a47fe09-openshift-default-7cc9587b8c-9pvps"
Jul 23 16:44:16.846615 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:44:16.846574    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-6a47fe09-openshift-default-7cc9587b8c-9pvps"
Jul 23 16:44:17.000614 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:44:17.000580    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-6a47fe09-openshift-default-7cc9587b8c-9pvps"]
Jul 23 16:44:17.003072 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:44:17.003042    2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9db38c82_9856_49d3_974e_96a836d6a6da.slice/crio-4993eb5d6778d214ed345b626be42eb2fff062eac8d4f3eb9ef3008cba3f17f8 WatchSource:0}: Error finding container 4993eb5d6778d214ed345b626be42eb2fff062eac8d4f3eb9ef3008cba3f17f8: Status 404 returned error can't find the container with id 4993eb5d6778d214ed345b626be42eb2fff062eac8d4f3eb9ef3008cba3f17f8
Jul 23 16:44:17.005622 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:44:17.005600    2553 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 23 16:44:17.272254 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:44:17.272206    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-6a47fe09-openshift-default-7cc9587b8c-9pvps" event={"ID":"9db38c82-9856-49d3-974e-96a836d6a6da","Type":"ContainerStarted","Data":"4993eb5d6778d214ed345b626be42eb2fff062eac8d4f3eb9ef3008cba3f17f8"}
Jul 23 16:44:19.587934 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:44:19.587893    2553 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 23 16:44:19.588355 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:44:19.587981    2553 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 23 16:44:19.588355 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:44:19.588032    2553 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 23 16:44:20.293901 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:44:20.293863    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-6a47fe09-openshift-default-7cc9587b8c-9pvps" event={"ID":"9db38c82-9856-49d3-974e-96a836d6a6da","Type":"ContainerStarted","Data":"86bfbf4091c9d8e83efe2c340100f1355158eee50fc17c9396c261401607f9eb"}
Jul 23 16:44:20.316803 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:44:20.316753    2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-6a47fe09-openshift-default-7cc9587b8c-9pvps" podStartSLOduration=1.735280562 podStartE2EDuration="4.316732919s" totalImagesPullingTime="2.581452357s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 16:44:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 16:44:20.315749387 +0000 UTC m=+1742.180355515" watchObservedRunningTime="2026-07-23 16:44:20.316732919 +0000 UTC m=+1742.181339025"
Jul 23 16:44:20.847154 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:44:20.847115    2553 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-6a47fe09-openshift-default-7cc9587b8c-9pvps"
Jul 23 16:44:20.852037 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:44:20.852010    2553 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-6a47fe09-openshift-default-7cc9587b8c-9pvps"
Jul 23 16:44:21.299193 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:44:21.299138    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-6a47fe09-openshift-default-7cc9587b8c-9pvps"
Jul 23 16:44:21.300295 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:44:21.300276    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-6a47fe09-openshift-default-7cc9587b8c-9pvps"
Jul 23 16:44:34.385830 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:44:34.385792    2553 generic.go:356] "Generic (PLEG): container finished" podID="9db38c82-9856-49d3-974e-96a836d6a6da" containerID="86bfbf4091c9d8e83efe2c340100f1355158eee50fc17c9396c261401607f9eb" exitCode=0
Jul 23 16:44:34.385830 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:44:34.385834    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-6a47fe09-openshift-default-7cc9587b8c-9pvps" event={"ID":"9db38c82-9856-49d3-974e-96a836d6a6da","Type":"ContainerDied","Data":"86bfbf4091c9d8e83efe2c340100f1355158eee50fc17c9396c261401607f9eb"}
Jul 23 16:44:34.386465 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:44:34.386337    2553 scope.go:117] "RemoveContainer" containerID="86bfbf4091c9d8e83efe2c340100f1355158eee50fc17c9396c261401607f9eb"
Jul 23 16:44:34.387411 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:44:34.387384    2553 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 23 16:44:34.387481 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:44:34.387451    2553 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 23 16:44:34.387516 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:44:34.387483    2553 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 23 16:44:35.392772 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:44:35.392732    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-6a47fe09-openshift-default-7cc9587b8c-9pvps" event={"ID":"9db38c82-9856-49d3-974e-96a836d6a6da","Type":"ContainerStarted","Data":"db08765cc86952bbd2bc9dd8132a30a8c9533b6d2d11eec557d8b492a9c99842"}
Jul 23 16:44:35.846913 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:44:35.846811    2553 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-6a47fe09-openshift-default-7cc9587b8c-9pvps"
Jul 23 16:44:35.848314 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:44:35.848282    2553 patch_prober.go:28] interesting pod/e2e-ait-6a47fe09-openshift-default-7cc9587b8c-9pvps container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.46:15021/healthz/ready\": dial tcp 10.132.0.46:15021: connect: connection refused" start-of-body=
Jul 23 16:44:35.848471 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:44:35.848359    2553 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-6a47fe09-openshift-default-7cc9587b8c-9pvps" podUID="9db38c82-9856-49d3-974e-96a836d6a6da" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.46:15021/healthz/ready\": dial tcp 10.132.0.46:15021: connect: connection refused"
Jul 23 16:44:36.299499 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:44:36.299460    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-6a47fe09-openshift-default-7cc9587b8c-9pvps"
Jul 23 16:44:36.847626 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:44:36.847141    2553 patch_prober.go:28] interesting pod/e2e-ait-6a47fe09-openshift-default-7cc9587b8c-9pvps container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.46:15021/healthz/ready\": dial tcp 10.132.0.46:15021: connect: connection refused" start-of-body=
Jul 23 16:44:36.847626 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:44:36.847229    2553 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-6a47fe09-openshift-default-7cc9587b8c-9pvps" podUID="9db38c82-9856-49d3-974e-96a836d6a6da" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.46:15021/healthz/ready\": dial tcp 10.132.0.46:15021: connect: connection refused"
Jul 23 16:44:37.847902 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:44:37.847859    2553 patch_prober.go:28] interesting pod/e2e-ait-6a47fe09-openshift-default-7cc9587b8c-9pvps container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.46:15021/healthz/ready\": dial tcp 10.132.0.46:15021: connect: connection refused" start-of-body=
Jul 23 16:44:37.848435 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:44:37.847931    2553 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-6a47fe09-openshift-default-7cc9587b8c-9pvps" podUID="9db38c82-9856-49d3-974e-96a836d6a6da" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.46:15021/healthz/ready\": dial tcp 10.132.0.46:15021: connect: connection refused"
Jul 23 16:44:38.847760 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:44:38.847720    2553 patch_prober.go:28] interesting pod/e2e-ait-6a47fe09-openshift-default-7cc9587b8c-9pvps container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.46:15021/healthz/ready\": dial tcp 10.132.0.46:15021: connect: connection refused" start-of-body=
Jul 23 16:44:38.848050 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:44:38.848020    2553 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-6a47fe09-openshift-default-7cc9587b8c-9pvps" podUID="9db38c82-9856-49d3-974e-96a836d6a6da" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.46:15021/healthz/ready\": dial tcp 10.132.0.46:15021: connect: connection refused"
Jul 23 16:44:39.851722 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:44:39.851688    2553 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-6a47fe09-openshift-default-7cc9587b8c-9pvps"
Jul 23 16:44:39.852916 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:44:39.852897    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-6a47fe09-openshift-default-7cc9587b8c-9pvps"
Jul 23 16:44:47.362369 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:44:47.362330    2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-6a47fe09-s4rtn"]
Jul 23 16:44:47.371732 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:44:47.371696    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-6a47fe09-s4rtn"
Jul 23 16:44:47.373986 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:44:47.373940    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-6a47fe09-s4rtn"]
Jul 23 16:44:47.374727 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:44:47.374701    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 23 16:44:47.374867 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:44:47.374701    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-plqcf\""
Jul 23 16:44:47.440384 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:44:47.440346    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/80dd12ff-f899-42af-92e7-ed5feea03c9a-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-6a47fe09-s4rtn\" (UID: \"80dd12ff-f899-42af-92e7-ed5feea03c9a\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-6a47fe09-s4rtn"
Jul 23 16:44:47.541015 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:44:47.540977    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/80dd12ff-f899-42af-92e7-ed5feea03c9a-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-6a47fe09-s4rtn\" (UID: \"80dd12ff-f899-42af-92e7-ed5feea03c9a\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-6a47fe09-s4rtn"
Jul 23 16:44:47.541675 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:44:47.541653    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/80dd12ff-f899-42af-92e7-ed5feea03c9a-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-6a47fe09-s4rtn\" (UID: \"80dd12ff-f899-42af-92e7-ed5feea03c9a\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-6a47fe09-s4rtn"
Jul 23 16:44:47.684160 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:44:47.684111    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-6a47fe09-s4rtn"
Jul 23 16:44:47.825289 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:44:47.825263    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-6a47fe09-s4rtn"]
Jul 23 16:44:47.827894 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:44:47.827858    2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod80dd12ff_f899_42af_92e7_ed5feea03c9a.slice/crio-211f9694f38bf2d56695cdbc0c859d8fc85d3ae3c01cc23df57f7d64a5c67420 WatchSource:0}: Error finding container 211f9694f38bf2d56695cdbc0c859d8fc85d3ae3c01cc23df57f7d64a5c67420: Status 404 returned error can't find the container with id 211f9694f38bf2d56695cdbc0c859d8fc85d3ae3c01cc23df57f7d64a5c67420
Jul 23 16:44:48.459809 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:44:48.459773    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-6a47fe09-s4rtn" event={"ID":"80dd12ff-f899-42af-92e7-ed5feea03c9a","Type":"ContainerStarted","Data":"453afac80878890ad1ca479f31310620d3487233ec6d1f9106084651c2ba7b10"}
Jul 23 16:44:48.460250 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:44:48.459833    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-6a47fe09-s4rtn" event={"ID":"80dd12ff-f899-42af-92e7-ed5feea03c9a","Type":"ContainerStarted","Data":"211f9694f38bf2d56695cdbc0c859d8fc85d3ae3c01cc23df57f7d64a5c67420"}
Jul 23 16:44:48.476847 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:44:48.476797    2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-6a47fe09-s4rtn" podStartSLOduration=1.476778264 podStartE2EDuration="1.476778264s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 16:44:47 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 16:44:48.475218153 +0000 UTC m=+1770.339824404" watchObservedRunningTime="2026-07-23 16:44:48.476778264 +0000 UTC m=+1770.341384422"
Jul 23 16:44:49.467669 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:44:49.467635    2553 generic.go:356] "Generic (PLEG): container finished" podID="80dd12ff-f899-42af-92e7-ed5feea03c9a" containerID="453afac80878890ad1ca479f31310620d3487233ec6d1f9106084651c2ba7b10" exitCode=0
Jul 23 16:44:49.468091 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:44:49.467720    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-6a47fe09-s4rtn" event={"ID":"80dd12ff-f899-42af-92e7-ed5feea03c9a","Type":"ContainerDied","Data":"453afac80878890ad1ca479f31310620d3487233ec6d1f9106084651c2ba7b10"}
Jul 23 16:44:50.606072 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:44:50.606039    2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-6a47fe09-s4rtn"
Jul 23 16:44:50.669107 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:44:50.669068    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/80dd12ff-f899-42af-92e7-ed5feea03c9a-maas-api-service-ca\") pod \"80dd12ff-f899-42af-92e7-ed5feea03c9a\" (UID: \"80dd12ff-f899-42af-92e7-ed5feea03c9a\") "
Jul 23 16:44:50.669391 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:44:50.669371    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/80dd12ff-f899-42af-92e7-ed5feea03c9a-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "80dd12ff-f899-42af-92e7-ed5feea03c9a" (UID: "80dd12ff-f899-42af-92e7-ed5feea03c9a"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 23 16:44:50.770290 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:44:50.770196    2553 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/80dd12ff-f899-42af-92e7-ed5feea03c9a-maas-api-service-ca\") on node \"ip-10-0-143-166.ec2.internal\" DevicePath \"\""
Jul 23 16:44:51.479921 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:44:51.479892    2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-6a47fe09-s4rtn"
Jul 23 16:44:51.480106 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:44:51.479888    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-6a47fe09-s4rtn" event={"ID":"80dd12ff-f899-42af-92e7-ed5feea03c9a","Type":"ContainerDied","Data":"211f9694f38bf2d56695cdbc0c859d8fc85d3ae3c01cc23df57f7d64a5c67420"}
Jul 23 16:44:51.480106 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:44:51.480027    2553 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="211f9694f38bf2d56695cdbc0c859d8fc85d3ae3c01cc23df57f7d64a5c67420"
Jul 23 16:45:00.142592 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:45:00.142550    2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29747085-ls6wn"]
Jul 23 16:45:00.143075 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:45:00.143055    2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="80dd12ff-f899-42af-92e7-ed5feea03c9a" containerName="revoke-keys"
Jul 23 16:45:00.143159 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:45:00.143079    2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="80dd12ff-f899-42af-92e7-ed5feea03c9a" containerName="revoke-keys"
Jul 23 16:45:00.143242 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:45:00.143199    2553 memory_manager.go:368] "RemoveStaleState removing state" podUID="80dd12ff-f899-42af-92e7-ed5feea03c9a" containerName="revoke-keys"
Jul 23 16:45:00.146331 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:45:00.146310    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29747085-ls6wn"
Jul 23 16:45:00.149066 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:45:00.149047    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-plqcf\""
Jul 23 16:45:00.154422 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:45:00.154394    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29747085-ls6wn"]
Jul 23 16:45:00.157361 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:45:00.157341    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29747085-ls6wn"
Jul 23 16:45:00.297543 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:45:00.297513    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29747085-ls6wn"]
Jul 23 16:45:00.299530 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:45:00.299491    2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda3ef3e11_4611_4573_9f9a_cb82067da938.slice/crio-57ba330b66c6ee93be598aefa0dcd721181327d5216a161ccbe5df5efcbff8c1 WatchSource:0}: Error finding container 57ba330b66c6ee93be598aefa0dcd721181327d5216a161ccbe5df5efcbff8c1: Status 404 returned error can't find the container with id 57ba330b66c6ee93be598aefa0dcd721181327d5216a161ccbe5df5efcbff8c1
Jul 23 16:45:00.541038 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:45:00.540943    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29747085-ls6wn" event={"ID":"a3ef3e11-4611-4573-9f9a-cb82067da938","Type":"ContainerStarted","Data":"57ba330b66c6ee93be598aefa0dcd721181327d5216a161ccbe5df5efcbff8c1"}
Jul 23 16:45:01.548752 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:45:01.548664    2553 generic.go:356] "Generic (PLEG): container finished" podID="a3ef3e11-4611-4573-9f9a-cb82067da938" containerID="724cdcd6a650a015976b09c3dab246434ba2eddedc6807eabb2fb6995ff88225" exitCode=0
Jul 23 16:45:01.549104 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:45:01.548751    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29747085-ls6wn" event={"ID":"a3ef3e11-4611-4573-9f9a-cb82067da938","Type":"ContainerDied","Data":"724cdcd6a650a015976b09c3dab246434ba2eddedc6807eabb2fb6995ff88225"}
Jul 23 16:45:02.452853 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:45:02.452819    2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-6a47fe09-s4rtn"]
Jul 23 16:45:02.455049 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:45:02.455022    2553 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-6a47fe09-s4rtn"]
Jul 23 16:45:02.595660 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:45:02.595618    2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-6a47fe09-openshift-default-7cc9587b8c-9pvps"]
Jul 23 16:45:02.596134 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:45:02.595883    2553 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-6a47fe09-openshift-default-7cc9587b8c-9pvps" podUID="9db38c82-9856-49d3-974e-96a836d6a6da" containerName="istio-proxy" containerID="cri-o://db08765cc86952bbd2bc9dd8132a30a8c9533b6d2d11eec557d8b492a9c99842" gracePeriod=30
Jul 23 16:45:02.676389 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:45:02.676360    2553 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="80dd12ff-f899-42af-92e7-ed5feea03c9a" path="/var/lib/kubelet/pods/80dd12ff-f899-42af-92e7-ed5feea03c9a/volumes"
Jul 23 16:45:02.708610 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:45:02.708532    2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29747085-ls6wn"
Jul 23 16:45:03.567157 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:45:03.567126    2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29747085-ls6wn"
Jul 23 16:45:03.567387 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:45:03.567187    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29747085-ls6wn" event={"ID":"a3ef3e11-4611-4573-9f9a-cb82067da938","Type":"ContainerDied","Data":"57ba330b66c6ee93be598aefa0dcd721181327d5216a161ccbe5df5efcbff8c1"}
Jul 23 16:45:03.567387 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:45:03.567237    2553 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="57ba330b66c6ee93be598aefa0dcd721181327d5216a161ccbe5df5efcbff8c1"
Jul 23 16:45:03.681083 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:45:03.681052    2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-migrate-fe63dc8a-gw-openshift-default-b59d6778c-4q44p"]
Jul 23 16:45:03.681583 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:45:03.681433    2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a3ef3e11-4611-4573-9f9a-cb82067da938" containerName="cleanup"
Jul 23 16:45:03.681583 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:45:03.681445    2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="a3ef3e11-4611-4573-9f9a-cb82067da938" containerName="cleanup"
Jul 23 16:45:03.681583 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:45:03.681513    2553 memory_manager.go:368] "RemoveStaleState removing state" podUID="a3ef3e11-4611-4573-9f9a-cb82067da938" containerName="cleanup"
Jul 23 16:45:03.684489 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:45:03.684466    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-fe63dc8a-gw-openshift-default-b59d6778c-4q44p"
Jul 23 16:45:03.687123 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:45:03.687099    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-migrate-fe63dc8a-gw-openshift-default-dockercfg-lkgpg\""
Jul 23 16:45:03.696742 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:45:03.696713    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-migrate-fe63dc8a-gw-openshift-default-b59d6778c-4q44p"]
Jul 23 16:45:03.791815 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:45:03.791778    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d74b5d4b-9571-4992-af99-e5bdb74e3e79-istio-data\") pod \"e2e-migrate-fe63dc8a-gw-openshift-default-b59d6778c-4q44p\" (UID: \"d74b5d4b-9571-4992-af99-e5bdb74e3e79\") " pod="openshift-ingress/e2e-migrate-fe63dc8a-gw-openshift-default-b59d6778c-4q44p"
Jul 23 16:45:03.792025 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:45:03.791833    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d74b5d4b-9571-4992-af99-e5bdb74e3e79-workload-certs\") pod \"e2e-migrate-fe63dc8a-gw-openshift-default-b59d6778c-4q44p\" (UID: \"d74b5d4b-9571-4992-af99-e5bdb74e3e79\") " pod="openshift-ingress/e2e-migrate-fe63dc8a-gw-openshift-default-b59d6778c-4q44p"
Jul 23 16:45:03.792025 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:45:03.791856    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d74b5d4b-9571-4992-af99-e5bdb74e3e79-istio-token\") pod \"e2e-migrate-fe63dc8a-gw-openshift-default-b59d6778c-4q44p\" (UID: \"d74b5d4b-9571-4992-af99-e5bdb74e3e79\") " pod="openshift-ingress/e2e-migrate-fe63dc8a-gw-openshift-default-b59d6778c-4q44p"
Jul 23 16:45:03.792025 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:45:03.791905    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d74b5d4b-9571-4992-af99-e5bdb74e3e79-istio-envoy\") pod \"e2e-migrate-fe63dc8a-gw-openshift-default-b59d6778c-4q44p\" (UID: \"d74b5d4b-9571-4992-af99-e5bdb74e3e79\") " pod="openshift-ingress/e2e-migrate-fe63dc8a-gw-openshift-default-b59d6778c-4q44p"
Jul 23 16:45:03.792025 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:45:03.791940    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d74b5d4b-9571-4992-af99-e5bdb74e3e79-credential-socket\") pod \"e2e-migrate-fe63dc8a-gw-openshift-default-b59d6778c-4q44p\" (UID: \"d74b5d4b-9571-4992-af99-e5bdb74e3e79\") " pod="openshift-ingress/e2e-migrate-fe63dc8a-gw-openshift-default-b59d6778c-4q44p"
Jul 23 16:45:03.792275 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:45:03.792223    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wkmkj\" (UniqueName: \"kubernetes.io/projected/d74b5d4b-9571-4992-af99-e5bdb74e3e79-kube-api-access-wkmkj\") pod \"e2e-migrate-fe63dc8a-gw-openshift-default-b59d6778c-4q44p\" (UID: \"d74b5d4b-9571-4992-af99-e5bdb74e3e79\") " pod="openshift-ingress/e2e-migrate-fe63dc8a-gw-openshift-default-b59d6778c-4q44p"
Jul 23 16:45:03.792365 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:45:03.792346    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d74b5d4b-9571-4992-af99-e5bdb74e3e79-istiod-ca-cert\") pod \"e2e-migrate-fe63dc8a-gw-openshift-default-b59d6778c-4q44p\" (UID: \"d74b5d4b-9571-4992-af99-e5bdb74e3e79\") " pod="openshift-ingress/e2e-migrate-fe63dc8a-gw-openshift-default-b59d6778c-4q44p"
Jul 23 16:45:03.792441 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:45:03.792421    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d74b5d4b-9571-4992-af99-e5bdb74e3e79-istio-podinfo\") pod \"e2e-migrate-fe63dc8a-gw-openshift-default-b59d6778c-4q44p\" (UID: \"d74b5d4b-9571-4992-af99-e5bdb74e3e79\") " pod="openshift-ingress/e2e-migrate-fe63dc8a-gw-openshift-default-b59d6778c-4q44p"
Jul 23 16:45:03.792499 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:45:03.792459    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d74b5d4b-9571-4992-af99-e5bdb74e3e79-workload-socket\") pod \"e2e-migrate-fe63dc8a-gw-openshift-default-b59d6778c-4q44p\" (UID: \"d74b5d4b-9571-4992-af99-e5bdb74e3e79\") " pod="openshift-ingress/e2e-migrate-fe63dc8a-gw-openshift-default-b59d6778c-4q44p"
Jul 23 16:45:03.893694 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:45:03.893658    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d74b5d4b-9571-4992-af99-e5bdb74e3e79-istio-envoy\") pod \"e2e-migrate-fe63dc8a-gw-openshift-default-b59d6778c-4q44p\" (UID: \"d74b5d4b-9571-4992-af99-e5bdb74e3e79\") " pod="openshift-ingress/e2e-migrate-fe63dc8a-gw-openshift-default-b59d6778c-4q44p"
Jul 23 16:45:03.893897 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:45:03.893708    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d74b5d4b-9571-4992-af99-e5bdb74e3e79-credential-socket\") pod \"e2e-migrate-fe63dc8a-gw-openshift-default-b59d6778c-4q44p\" (UID: \"d74b5d4b-9571-4992-af99-e5bdb74e3e79\") " pod="openshift-ingress/e2e-migrate-fe63dc8a-gw-openshift-default-b59d6778c-4q44p"
Jul 23 16:45:03.893897 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:45:03.893767    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wkmkj\" (UniqueName: \"kubernetes.io/projected/d74b5d4b-9571-4992-af99-e5bdb74e3e79-kube-api-access-wkmkj\") pod \"e2e-migrate-fe63dc8a-gw-openshift-default-b59d6778c-4q44p\" (UID: \"d74b5d4b-9571-4992-af99-e5bdb74e3e79\") " pod="openshift-ingress/e2e-migrate-fe63dc8a-gw-openshift-default-b59d6778c-4q44p"
Jul 23 16:45:03.893897 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:45:03.893794    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d74b5d4b-9571-4992-af99-e5bdb74e3e79-istiod-ca-cert\") pod \"e2e-migrate-fe63dc8a-gw-openshift-default-b59d6778c-4q44p\" (UID: \"d74b5d4b-9571-4992-af99-e5bdb74e3e79\") " pod="openshift-ingress/e2e-migrate-fe63dc8a-gw-openshift-default-b59d6778c-4q44p"
Jul 23 16:45:03.893897 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:45:03.893840    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d74b5d4b-9571-4992-af99-e5bdb74e3e79-istio-podinfo\") pod \"e2e-migrate-fe63dc8a-gw-openshift-default-b59d6778c-4q44p\" (UID: \"d74b5d4b-9571-4992-af99-e5bdb74e3e79\") " pod="openshift-ingress/e2e-migrate-fe63dc8a-gw-openshift-default-b59d6778c-4q44p"
Jul 23 16:45:03.893897 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:45:03.893866    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d74b5d4b-9571-4992-af99-e5bdb74e3e79-workload-socket\") pod \"e2e-migrate-fe63dc8a-gw-openshift-default-b59d6778c-4q44p\" (UID: \"d74b5d4b-9571-4992-af99-e5bdb74e3e79\") " pod="openshift-ingress/e2e-migrate-fe63dc8a-gw-openshift-default-b59d6778c-4q44p"
Jul 23 16:45:03.893897 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:45:03.893890    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d74b5d4b-9571-4992-af99-e5bdb74e3e79-istio-data\") pod \"e2e-migrate-fe63dc8a-gw-openshift-default-b59d6778c-4q44p\" (UID: \"d74b5d4b-9571-4992-af99-e5bdb74e3e79\") " pod="openshift-ingress/e2e-migrate-fe63dc8a-gw-openshift-default-b59d6778c-4q44p"
Jul 23 16:45:03.894239 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:45:03.893929    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d74b5d4b-9571-4992-af99-e5bdb74e3e79-workload-certs\") pod \"e2e-migrate-fe63dc8a-gw-openshift-default-b59d6778c-4q44p\" (UID: \"d74b5d4b-9571-4992-af99-e5bdb74e3e79\") " pod="openshift-ingress/e2e-migrate-fe63dc8a-gw-openshift-default-b59d6778c-4q44p"
Jul 23 16:45:03.894239 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:45:03.893957    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d74b5d4b-9571-4992-af99-e5bdb74e3e79-istio-token\") pod \"e2e-migrate-fe63dc8a-gw-openshift-default-b59d6778c-4q44p\" (UID: \"d74b5d4b-9571-4992-af99-e5bdb74e3e79\") " pod="openshift-ingress/e2e-migrate-fe63dc8a-gw-openshift-default-b59d6778c-4q44p"
Jul 23 16:45:03.894340 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:45:03.894296    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d74b5d4b-9571-4992-af99-e5bdb74e3e79-credential-socket\") pod \"e2e-migrate-fe63dc8a-gw-openshift-default-b59d6778c-4q44p\" (UID: \"d74b5d4b-9571-4992-af99-e5bdb74e3e79\") " pod="openshift-ingress/e2e-migrate-fe63dc8a-gw-openshift-default-b59d6778c-4q44p"
Jul 23 16:45:03.894340 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:45:03.894326    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d74b5d4b-9571-4992-af99-e5bdb74e3e79-istio-data\") pod \"e2e-migrate-fe63dc8a-gw-openshift-default-b59d6778c-4q44p\" (UID: \"d74b5d4b-9571-4992-af99-e5bdb74e3e79\") " pod="openshift-ingress/e2e-migrate-fe63dc8a-gw-openshift-default-b59d6778c-4q44p"
Jul 23 16:45:03.894446 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:45:03.894373    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d74b5d4b-9571-4992-af99-e5bdb74e3e79-workload-certs\") pod \"e2e-migrate-fe63dc8a-gw-openshift-default-b59d6778c-4q44p\" (UID: \"d74b5d4b-9571-4992-af99-e5bdb74e3e79\") " pod="openshift-ingress/e2e-migrate-fe63dc8a-gw-openshift-default-b59d6778c-4q44p"
Jul 23 16:45:03.894446 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:45:03.894396    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d74b5d4b-9571-4992-af99-e5bdb74e3e79-workload-socket\") pod \"e2e-migrate-fe63dc8a-gw-openshift-default-b59d6778c-4q44p\" (UID: \"d74b5d4b-9571-4992-af99-e5bdb74e3e79\") " pod="openshift-ingress/e2e-migrate-fe63dc8a-gw-openshift-default-b59d6778c-4q44p"
Jul 23 16:45:03.894745 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:45:03.894725    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d74b5d4b-9571-4992-af99-e5bdb74e3e79-istiod-ca-cert\") pod \"e2e-migrate-fe63dc8a-gw-openshift-default-b59d6778c-4q44p\" (UID: \"d74b5d4b-9571-4992-af99-e5bdb74e3e79\") " pod="openshift-ingress/e2e-migrate-fe63dc8a-gw-openshift-default-b59d6778c-4q44p"
Jul 23 16:45:03.896367 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:45:03.896348    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d74b5d4b-9571-4992-af99-e5bdb74e3e79-istio-envoy\") pod \"e2e-migrate-fe63dc8a-gw-openshift-default-b59d6778c-4q44p\" (UID: \"d74b5d4b-9571-4992-af99-e5bdb74e3e79\") " pod="openshift-ingress/e2e-migrate-fe63dc8a-gw-openshift-default-b59d6778c-4q44p"
Jul 23 16:45:03.896483 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:45:03.896434    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d74b5d4b-9571-4992-af99-e5bdb74e3e79-istio-podinfo\") pod \"e2e-migrate-fe63dc8a-gw-openshift-default-b59d6778c-4q44p\" (UID: \"d74b5d4b-9571-4992-af99-e5bdb74e3e79\") " pod="openshift-ingress/e2e-migrate-fe63dc8a-gw-openshift-default-b59d6778c-4q44p"
Jul 23 16:45:03.902865 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:45:03.902838    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d74b5d4b-9571-4992-af99-e5bdb74e3e79-istio-token\") pod \"e2e-migrate-fe63dc8a-gw-openshift-default-b59d6778c-4q44p\" (UID: \"d74b5d4b-9571-4992-af99-e5bdb74e3e79\") " pod="openshift-ingress/e2e-migrate-fe63dc8a-gw-openshift-default-b59d6778c-4q44p"
Jul 23 16:45:03.902984 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:45:03.902958    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wkmkj\" (UniqueName: \"kubernetes.io/projected/d74b5d4b-9571-4992-af99-e5bdb74e3e79-kube-api-access-wkmkj\") pod \"e2e-migrate-fe63dc8a-gw-openshift-default-b59d6778c-4q44p\" (UID: \"d74b5d4b-9571-4992-af99-e5bdb74e3e79\") " pod="openshift-ingress/e2e-migrate-fe63dc8a-gw-openshift-default-b59d6778c-4q44p"
Jul 23 16:45:03.995451 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:45:03.995415    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-fe63dc8a-gw-openshift-default-b59d6778c-4q44p"
Jul 23 16:45:04.157993 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:45:04.157959    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-migrate-fe63dc8a-gw-openshift-default-b59d6778c-4q44p"]
Jul 23 16:45:04.158476 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:45:04.158451    2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd74b5d4b_9571_4992_af99_e5bdb74e3e79.slice/crio-fb322ba7ad5c98223e5dce4d84e56217891cc9d6ccd8c34860b5370e9e5a5f2c WatchSource:0}: Error finding container fb322ba7ad5c98223e5dce4d84e56217891cc9d6ccd8c34860b5370e9e5a5f2c: Status 404 returned error can't find the container with id fb322ba7ad5c98223e5dce4d84e56217891cc9d6ccd8c34860b5370e9e5a5f2c
Jul 23 16:45:04.160831 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:45:04.160798    2553 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 23 16:45:04.160912 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:45:04.160868    2553 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 23 16:45:04.160912 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:45:04.160898    2553 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 23 16:45:04.575000 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:45:04.574902    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-fe63dc8a-gw-openshift-default-b59d6778c-4q44p" event={"ID":"d74b5d4b-9571-4992-af99-e5bdb74e3e79","Type":"ContainerStarted","Data":"c428626d94f27016374b0f655ec96e9fd93272df8d348c9f5b57badda59cfd0f"}
Jul 23 16:45:04.575000 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:45:04.574958    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-fe63dc8a-gw-openshift-default-b59d6778c-4q44p" event={"ID":"d74b5d4b-9571-4992-af99-e5bdb74e3e79","Type":"ContainerStarted","Data":"fb322ba7ad5c98223e5dce4d84e56217891cc9d6ccd8c34860b5370e9e5a5f2c"}
Jul 23 16:45:04.599215 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:45:04.599141    2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-migrate-fe63dc8a-gw-openshift-default-b59d6778c-4q44p" podStartSLOduration=1.5991240869999999 podStartE2EDuration="1.599124087s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 16:45:03 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 16:45:04.596784097 +0000 UTC m=+1786.461390225" watchObservedRunningTime="2026-07-23 16:45:04.599124087 +0000 UTC m=+1786.463730215"
Jul 23 16:45:04.996451 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:45:04.996418    2553 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-migrate-fe63dc8a-gw-openshift-default-b59d6778c-4q44p"
Jul 23 16:45:06.001862 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:45:06.001829    2553 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-migrate-fe63dc8a-gw-openshift-default-b59d6778c-4q44p"
Jul 23 16:45:06.586532 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:45:06.586505    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-migrate-fe63dc8a-gw-openshift-default-b59d6778c-4q44p"
Jul 23 16:45:06.587596 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:45:06.587571    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-migrate-fe63dc8a-gw-openshift-default-b59d6778c-4q44p"
Jul 23 16:45:07.854244 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:45:07.854218    2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-6a47fe09-openshift-default-7cc9587b8c-9pvps"
Jul 23 16:45:07.933321 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:45:07.933289    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9db38c82-9856-49d3-974e-96a836d6a6da-credential-socket\") pod \"9db38c82-9856-49d3-974e-96a836d6a6da\" (UID: \"9db38c82-9856-49d3-974e-96a836d6a6da\") "
Jul 23 16:45:07.933537 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:45:07.933343    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9db38c82-9856-49d3-974e-96a836d6a6da-istio-data\") pod \"9db38c82-9856-49d3-974e-96a836d6a6da\" (UID: \"9db38c82-9856-49d3-974e-96a836d6a6da\") "
Jul 23 16:45:07.933537 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:45:07.933404    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9db38c82-9856-49d3-974e-96a836d6a6da-workload-socket\") pod \"9db38c82-9856-49d3-974e-96a836d6a6da\" (UID: \"9db38c82-9856-49d3-974e-96a836d6a6da\") "
Jul 23 16:45:07.933537 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:45:07.933428    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9db38c82-9856-49d3-974e-96a836d6a6da-istio-envoy\") pod \"9db38c82-9856-49d3-974e-96a836d6a6da\" (UID: \"9db38c82-9856-49d3-974e-96a836d6a6da\") "
Jul 23 16:45:07.933537 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:45:07.933466    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9db38c82-9856-49d3-974e-96a836d6a6da-workload-certs\") pod \"9db38c82-9856-49d3-974e-96a836d6a6da\" (UID: \"9db38c82-9856-49d3-974e-96a836d6a6da\") "
Jul 23 16:45:07.933537 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:45:07.933495    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9db38c82-9856-49d3-974e-96a836d6a6da-istiod-ca-cert\") pod \"9db38c82-9856-49d3-974e-96a836d6a6da\" (UID: \"9db38c82-9856-49d3-974e-96a836d6a6da\") "
Jul 23 16:45:07.933537 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:45:07.933530    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-g8n7q\" (UniqueName: \"kubernetes.io/projected/9db38c82-9856-49d3-974e-96a836d6a6da-kube-api-access-g8n7q\") pod \"9db38c82-9856-49d3-974e-96a836d6a6da\" (UID: \"9db38c82-9856-49d3-974e-96a836d6a6da\") "
Jul 23 16:45:07.933833 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:45:07.933576    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9db38c82-9856-49d3-974e-96a836d6a6da-istio-token\") pod \"9db38c82-9856-49d3-974e-96a836d6a6da\" (UID: \"9db38c82-9856-49d3-974e-96a836d6a6da\") "
Jul 23 16:45:07.933833 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:45:07.933604    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9db38c82-9856-49d3-974e-96a836d6a6da-istio-podinfo\") pod \"9db38c82-9856-49d3-974e-96a836d6a6da\" (UID: \"9db38c82-9856-49d3-974e-96a836d6a6da\") "
Jul 23 16:45:07.933833 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:45:07.933639    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9db38c82-9856-49d3-974e-96a836d6a6da-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "9db38c82-9856-49d3-974e-96a836d6a6da" (UID: "9db38c82-9856-49d3-974e-96a836d6a6da"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 16:45:07.933833 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:45:07.933739    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9db38c82-9856-49d3-974e-96a836d6a6da-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "9db38c82-9856-49d3-974e-96a836d6a6da" (UID: "9db38c82-9856-49d3-974e-96a836d6a6da"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 16:45:07.934042 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:45:07.933855    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9db38c82-9856-49d3-974e-96a836d6a6da-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "9db38c82-9856-49d3-974e-96a836d6a6da" (UID: "9db38c82-9856-49d3-974e-96a836d6a6da"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 16:45:07.934042 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:45:07.933985    2553 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9db38c82-9856-49d3-974e-96a836d6a6da-credential-socket\") on node \"ip-10-0-143-166.ec2.internal\" DevicePath \"\""
Jul 23 16:45:07.934042 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:45:07.934006    2553 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9db38c82-9856-49d3-974e-96a836d6a6da-workload-socket\") on node \"ip-10-0-143-166.ec2.internal\" DevicePath \"\""
Jul 23 16:45:07.934042 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:45:07.934023    2553 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9db38c82-9856-49d3-974e-96a836d6a6da-workload-certs\") on node \"ip-10-0-143-166.ec2.internal\" DevicePath \"\""
Jul 23 16:45:07.934289 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:45:07.934068    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9db38c82-9856-49d3-974e-96a836d6a6da-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "9db38c82-9856-49d3-974e-96a836d6a6da" (UID: "9db38c82-9856-49d3-974e-96a836d6a6da"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 23 16:45:07.934354 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:45:07.934305    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9db38c82-9856-49d3-974e-96a836d6a6da-istio-data" (OuterVolumeSpecName: "istio-data") pod "9db38c82-9856-49d3-974e-96a836d6a6da" (UID: "9db38c82-9856-49d3-974e-96a836d6a6da"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 16:45:07.935929 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:45:07.935898    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9db38c82-9856-49d3-974e-96a836d6a6da-istio-token" (OuterVolumeSpecName: "istio-token") pod "9db38c82-9856-49d3-974e-96a836d6a6da" (UID: "9db38c82-9856-49d3-974e-96a836d6a6da"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 16:45:07.936084 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:45:07.936065    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9db38c82-9856-49d3-974e-96a836d6a6da-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "9db38c82-9856-49d3-974e-96a836d6a6da" (UID: "9db38c82-9856-49d3-974e-96a836d6a6da"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 16:45:07.936295 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:45:07.936277    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/9db38c82-9856-49d3-974e-96a836d6a6da-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "9db38c82-9856-49d3-974e-96a836d6a6da" (UID: "9db38c82-9856-49d3-974e-96a836d6a6da"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 23 16:45:07.936378 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:45:07.936359    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9db38c82-9856-49d3-974e-96a836d6a6da-kube-api-access-g8n7q" (OuterVolumeSpecName: "kube-api-access-g8n7q") pod "9db38c82-9856-49d3-974e-96a836d6a6da" (UID: "9db38c82-9856-49d3-974e-96a836d6a6da"). InnerVolumeSpecName "kube-api-access-g8n7q". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 16:45:08.034525 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:45:08.034480    2553 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9db38c82-9856-49d3-974e-96a836d6a6da-istio-data\") on node \"ip-10-0-143-166.ec2.internal\" DevicePath \"\""
Jul 23 16:45:08.034525 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:45:08.034514    2553 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9db38c82-9856-49d3-974e-96a836d6a6da-istio-envoy\") on node \"ip-10-0-143-166.ec2.internal\" DevicePath \"\""
Jul 23 16:45:08.034525 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:45:08.034523    2553 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9db38c82-9856-49d3-974e-96a836d6a6da-istiod-ca-cert\") on node \"ip-10-0-143-166.ec2.internal\" DevicePath \"\""
Jul 23 16:45:08.034525 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:45:08.034532    2553 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-g8n7q\" (UniqueName: \"kubernetes.io/projected/9db38c82-9856-49d3-974e-96a836d6a6da-kube-api-access-g8n7q\") on node \"ip-10-0-143-166.ec2.internal\" DevicePath \"\""
Jul 23 16:45:08.034525 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:45:08.034542    2553 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9db38c82-9856-49d3-974e-96a836d6a6da-istio-token\") on node \"ip-10-0-143-166.ec2.internal\" DevicePath \"\""
Jul 23 16:45:08.034833 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:45:08.034551    2553 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9db38c82-9856-49d3-974e-96a836d6a6da-istio-podinfo\") on node \"ip-10-0-143-166.ec2.internal\" DevicePath \"\""
Jul 23 16:45:08.598708 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:45:08.598672    2553 generic.go:356] "Generic (PLEG): container finished" podID="9db38c82-9856-49d3-974e-96a836d6a6da" containerID="db08765cc86952bbd2bc9dd8132a30a8c9533b6d2d11eec557d8b492a9c99842" exitCode=0
Jul 23 16:45:08.598887 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:45:08.598716    2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-6a47fe09-openshift-default-7cc9587b8c-9pvps"
Jul 23 16:45:08.598887 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:45:08.598755    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-6a47fe09-openshift-default-7cc9587b8c-9pvps" event={"ID":"9db38c82-9856-49d3-974e-96a836d6a6da","Type":"ContainerDied","Data":"db08765cc86952bbd2bc9dd8132a30a8c9533b6d2d11eec557d8b492a9c99842"}
Jul 23 16:45:08.598887 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:45:08.598814    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-6a47fe09-openshift-default-7cc9587b8c-9pvps" event={"ID":"9db38c82-9856-49d3-974e-96a836d6a6da","Type":"ContainerDied","Data":"4993eb5d6778d214ed345b626be42eb2fff062eac8d4f3eb9ef3008cba3f17f8"}
Jul 23 16:45:08.599819 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:45:08.598845    2553 scope.go:117] "RemoveContainer" containerID="db08765cc86952bbd2bc9dd8132a30a8c9533b6d2d11eec557d8b492a9c99842"
Jul 23 16:45:08.609309 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:45:08.609285    2553 scope.go:117] "RemoveContainer" containerID="86bfbf4091c9d8e83efe2c340100f1355158eee50fc17c9396c261401607f9eb"
Jul 23 16:45:08.620235 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:45:08.620139    2553 scope.go:117] "RemoveContainer" containerID="db08765cc86952bbd2bc9dd8132a30a8c9533b6d2d11eec557d8b492a9c99842"
Jul 23 16:45:08.620530 ip-10-0-143-166 kubenswrapper[2553]: E0723 16:45:08.620511    2553 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"db08765cc86952bbd2bc9dd8132a30a8c9533b6d2d11eec557d8b492a9c99842\": container with ID starting with db08765cc86952bbd2bc9dd8132a30a8c9533b6d2d11eec557d8b492a9c99842 not found: ID does not exist" containerID="db08765cc86952bbd2bc9dd8132a30a8c9533b6d2d11eec557d8b492a9c99842"
Jul 23 16:45:08.620599 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:45:08.620539    2553 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"db08765cc86952bbd2bc9dd8132a30a8c9533b6d2d11eec557d8b492a9c99842"} err="failed to get container status \"db08765cc86952bbd2bc9dd8132a30a8c9533b6d2d11eec557d8b492a9c99842\": rpc error: code = NotFound desc = could not find container \"db08765cc86952bbd2bc9dd8132a30a8c9533b6d2d11eec557d8b492a9c99842\": container with ID starting with db08765cc86952bbd2bc9dd8132a30a8c9533b6d2d11eec557d8b492a9c99842 not found: ID does not exist"
Jul 23 16:45:08.620599 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:45:08.620556    2553 scope.go:117] "RemoveContainer" containerID="86bfbf4091c9d8e83efe2c340100f1355158eee50fc17c9396c261401607f9eb"
Jul 23 16:45:08.620820 ip-10-0-143-166 kubenswrapper[2553]: E0723 16:45:08.620798    2553 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"86bfbf4091c9d8e83efe2c340100f1355158eee50fc17c9396c261401607f9eb\": container with ID starting with 86bfbf4091c9d8e83efe2c340100f1355158eee50fc17c9396c261401607f9eb not found: ID does not exist" containerID="86bfbf4091c9d8e83efe2c340100f1355158eee50fc17c9396c261401607f9eb"
Jul 23 16:45:08.620860 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:45:08.620827    2553 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"86bfbf4091c9d8e83efe2c340100f1355158eee50fc17c9396c261401607f9eb"} err="failed to get container status \"86bfbf4091c9d8e83efe2c340100f1355158eee50fc17c9396c261401607f9eb\": rpc error: code = NotFound desc = could not find container \"86bfbf4091c9d8e83efe2c340100f1355158eee50fc17c9396c261401607f9eb\": container with ID starting with 86bfbf4091c9d8e83efe2c340100f1355158eee50fc17c9396c261401607f9eb not found: ID does not exist"
Jul 23 16:45:08.622155 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:45:08.622136    2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-6a47fe09-openshift-default-7cc9587b8c-9pvps"]
Jul 23 16:45:08.626683 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:45:08.626660    2553 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-6a47fe09-openshift-default-7cc9587b8c-9pvps"]
Jul 23 16:45:08.675213 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:45:08.675185    2553 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9db38c82-9856-49d3-974e-96a836d6a6da" path="/var/lib/kubelet/pods/9db38c82-9856-49d3-974e-96a836d6a6da/volumes"
Jul 23 16:45:18.681038 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:45:18.681005    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-7rmrn_976a7198-cfd3-43d4-8c9f-b1f248d1f6d7/console-operator/1.log"
Jul 23 16:45:18.683801 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:45:18.683776    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-7rmrn_976a7198-cfd3-43d4-8c9f-b1f248d1f6d7/console-operator/1.log"
Jul 23 16:45:20.675437 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:45:20.675404    2553 generic.go:356] "Generic (PLEG): container finished" podID="d74b5d4b-9571-4992-af99-e5bdb74e3e79" containerID="c428626d94f27016374b0f655ec96e9fd93272df8d348c9f5b57badda59cfd0f" exitCode=0
Jul 23 16:45:20.675859 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:45:20.675470    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-fe63dc8a-gw-openshift-default-b59d6778c-4q44p" event={"ID":"d74b5d4b-9571-4992-af99-e5bdb74e3e79","Type":"ContainerDied","Data":"c428626d94f27016374b0f655ec96e9fd93272df8d348c9f5b57badda59cfd0f"}
Jul 23 16:45:20.675859 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:45:20.675844    2553 scope.go:117] "RemoveContainer" containerID="c428626d94f27016374b0f655ec96e9fd93272df8d348c9f5b57badda59cfd0f"
Jul 23 16:45:20.682735 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:45:20.682704    2553 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 23 16:45:20.682862 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:45:20.682794    2553 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 23 16:45:20.682862 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:45:20.682837    2553 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 23 16:45:21.586481 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:45:21.586428    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-migrate-fe63dc8a-gw-openshift-default-b59d6778c-4q44p"
Jul 23 16:45:21.682692 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:45:21.682654    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-fe63dc8a-gw-openshift-default-b59d6778c-4q44p" event={"ID":"d74b5d4b-9571-4992-af99-e5bdb74e3e79","Type":"ContainerStarted","Data":"bb28e0fe7d3c15c1090f5ca31dbfb59678ede16a061cfdfe6b46082b80f66a59"}
Jul 23 16:45:21.996504 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:45:21.996459    2553 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-migrate-fe63dc8a-gw-openshift-default-b59d6778c-4q44p"
Jul 23 16:45:21.997700 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:45:21.997671    2553 patch_prober.go:28] interesting pod/e2e-migrate-fe63dc8a-gw-openshift-default-b59d6778c-4q44p container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.49:15021/healthz/ready\": dial tcp 10.132.0.49:15021: connect: connection refused" start-of-body=
Jul 23 16:45:21.997823 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:45:21.997723    2553 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-fe63dc8a-gw-openshift-default-b59d6778c-4q44p" podUID="d74b5d4b-9571-4992-af99-e5bdb74e3e79" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.49:15021/healthz/ready\": dial tcp 10.132.0.49:15021: connect: connection refused"
Jul 23 16:45:22.996213 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:45:22.996151    2553 patch_prober.go:28] interesting pod/e2e-migrate-fe63dc8a-gw-openshift-default-b59d6778c-4q44p container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.49:15021/healthz/ready\": dial tcp 10.132.0.49:15021: connect: connection refused" start-of-body=
Jul 23 16:45:22.996603 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:45:22.996244    2553 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-fe63dc8a-gw-openshift-default-b59d6778c-4q44p" podUID="d74b5d4b-9571-4992-af99-e5bdb74e3e79" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.49:15021/healthz/ready\": dial tcp 10.132.0.49:15021: connect: connection refused"
Jul 23 16:45:23.996644 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:45:23.996609    2553 patch_prober.go:28] interesting pod/e2e-migrate-fe63dc8a-gw-openshift-default-b59d6778c-4q44p container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.49:15021/healthz/ready\": dial tcp 10.132.0.49:15021: connect: connection refused" start-of-body=
Jul 23 16:45:23.997044 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:45:23.996676    2553 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-fe63dc8a-gw-openshift-default-b59d6778c-4q44p" podUID="d74b5d4b-9571-4992-af99-e5bdb74e3e79" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.49:15021/healthz/ready\": dial tcp 10.132.0.49:15021: connect: connection refused"
Jul 23 16:45:24.996728 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:45:24.996693    2553 patch_prober.go:28] interesting pod/e2e-migrate-fe63dc8a-gw-openshift-default-b59d6778c-4q44p container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.49:15021/healthz/ready\": dial tcp 10.132.0.49:15021: connect: connection refused" start-of-body=
Jul 23 16:45:24.997127 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:45:24.996748    2553 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-fe63dc8a-gw-openshift-default-b59d6778c-4q44p" podUID="d74b5d4b-9571-4992-af99-e5bdb74e3e79" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.49:15021/healthz/ready\": dial tcp 10.132.0.49:15021: connect: connection refused"
Jul 23 16:45:25.996104 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:45:25.996066    2553 patch_prober.go:28] interesting pod/e2e-migrate-fe63dc8a-gw-openshift-default-b59d6778c-4q44p container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.49:15021/healthz/ready\": dial tcp 10.132.0.49:15021: connect: connection refused" start-of-body=
Jul 23 16:45:25.996336 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:45:25.996139    2553 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-fe63dc8a-gw-openshift-default-b59d6778c-4q44p" podUID="d74b5d4b-9571-4992-af99-e5bdb74e3e79" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.49:15021/healthz/ready\": dial tcp 10.132.0.49:15021: connect: connection refused"
Jul 23 16:45:27.000413 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:45:27.000379    2553 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-migrate-fe63dc8a-gw-openshift-default-b59d6778c-4q44p"
Jul 23 16:45:27.000813 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:45:27.000653    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-migrate-fe63dc8a-gw-openshift-default-b59d6778c-4q44p"
Jul 23 16:45:27.001332 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:45:27.001311    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-migrate-fe63dc8a-gw-openshift-default-b59d6778c-4q44p"
Jul 23 16:45:31.200980 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:45:31.200938    2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-fe63dc8a-pplrv"]
Jul 23 16:45:31.201405 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:45:31.201299    2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9db38c82-9856-49d3-974e-96a836d6a6da" containerName="istio-proxy"
Jul 23 16:45:31.201405 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:45:31.201310    2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="9db38c82-9856-49d3-974e-96a836d6a6da" containerName="istio-proxy"
Jul 23 16:45:31.201405 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:45:31.201322    2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9db38c82-9856-49d3-974e-96a836d6a6da" containerName="istio-proxy"
Jul 23 16:45:31.201405 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:45:31.201328    2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="9db38c82-9856-49d3-974e-96a836d6a6da" containerName="istio-proxy"
Jul 23 16:45:31.201405 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:45:31.201394    2553 memory_manager.go:368] "RemoveStaleState removing state" podUID="9db38c82-9856-49d3-974e-96a836d6a6da" containerName="istio-proxy"
Jul 23 16:45:31.201405 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:45:31.201405    2553 memory_manager.go:368] "RemoveStaleState removing state" podUID="9db38c82-9856-49d3-974e-96a836d6a6da" containerName="istio-proxy"
Jul 23 16:45:31.204774 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:45:31.204754    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-fe63dc8a-pplrv"
Jul 23 16:45:31.208154 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:45:31.208118    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-plqcf\""
Jul 23 16:45:31.208353 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:45:31.208336    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 23 16:45:31.221353 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:45:31.221315    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-fe63dc8a-pplrv"]
Jul 23 16:45:31.341478 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:45:31.341431    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/7818d8a0-5a97-449d-bb66-1e6de8427fb9-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-fe63dc8a-pplrv\" (UID: \"7818d8a0-5a97-449d-bb66-1e6de8427fb9\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-fe63dc8a-pplrv"
Jul 23 16:45:31.442567 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:45:31.442532    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/7818d8a0-5a97-449d-bb66-1e6de8427fb9-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-fe63dc8a-pplrv\" (UID: \"7818d8a0-5a97-449d-bb66-1e6de8427fb9\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-fe63dc8a-pplrv"
Jul 23 16:45:31.443183 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:45:31.443141    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/7818d8a0-5a97-449d-bb66-1e6de8427fb9-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-fe63dc8a-pplrv\" (UID: \"7818d8a0-5a97-449d-bb66-1e6de8427fb9\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-fe63dc8a-pplrv"
Jul 23 16:45:31.515139 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:45:31.515036    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-fe63dc8a-pplrv"
Jul 23 16:45:31.672728 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:45:31.672690    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-fe63dc8a-pplrv"]
Jul 23 16:45:31.676291 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:45:31.676265    2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7818d8a0_5a97_449d_bb66_1e6de8427fb9.slice/crio-00ab006f7d3146a69150a8526d649c6ef9af7b2e358ddc48bcf3aa083808775e WatchSource:0}: Error finding container 00ab006f7d3146a69150a8526d649c6ef9af7b2e358ddc48bcf3aa083808775e: Status 404 returned error can't find the container with id 00ab006f7d3146a69150a8526d649c6ef9af7b2e358ddc48bcf3aa083808775e
Jul 23 16:45:31.747822 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:45:31.747786    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-fe63dc8a-pplrv" event={"ID":"7818d8a0-5a97-449d-bb66-1e6de8427fb9","Type":"ContainerStarted","Data":"00ab006f7d3146a69150a8526d649c6ef9af7b2e358ddc48bcf3aa083808775e"}
Jul 23 16:45:32.754303 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:45:32.754268    2553 generic.go:356] "Generic (PLEG): container finished" podID="7818d8a0-5a97-449d-bb66-1e6de8427fb9" containerID="b49a0ffc37c8b6d086693ddad8e5ec18744ad8f46b9866ddfc4c9638679d67e3" exitCode=0
Jul 23 16:45:32.754775 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:45:32.754340    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-fe63dc8a-pplrv" event={"ID":"7818d8a0-5a97-449d-bb66-1e6de8427fb9","Type":"ContainerDied","Data":"b49a0ffc37c8b6d086693ddad8e5ec18744ad8f46b9866ddfc4c9638679d67e3"}
Jul 23 16:45:33.907222 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:45:33.907187    2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-fe63dc8a-pplrv"
Jul 23 16:45:34.067208 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:45:34.067069    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/7818d8a0-5a97-449d-bb66-1e6de8427fb9-maas-api-service-ca\") pod \"7818d8a0-5a97-449d-bb66-1e6de8427fb9\" (UID: \"7818d8a0-5a97-449d-bb66-1e6de8427fb9\") "
Jul 23 16:45:34.067487 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:45:34.067463    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7818d8a0-5a97-449d-bb66-1e6de8427fb9-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "7818d8a0-5a97-449d-bb66-1e6de8427fb9" (UID: "7818d8a0-5a97-449d-bb66-1e6de8427fb9"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 23 16:45:34.168021 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:45:34.167984    2553 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/7818d8a0-5a97-449d-bb66-1e6de8427fb9-maas-api-service-ca\") on node \"ip-10-0-143-166.ec2.internal\" DevicePath \"\""
Jul 23 16:45:34.766895 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:45:34.766861    2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-fe63dc8a-pplrv"
Jul 23 16:45:34.766895 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:45:34.766888    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-fe63dc8a-pplrv" event={"ID":"7818d8a0-5a97-449d-bb66-1e6de8427fb9","Type":"ContainerDied","Data":"00ab006f7d3146a69150a8526d649c6ef9af7b2e358ddc48bcf3aa083808775e"}
Jul 23 16:45:34.767104 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:45:34.766937    2553 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="00ab006f7d3146a69150a8526d649c6ef9af7b2e358ddc48bcf3aa083808775e"
Jul 23 16:45:46.265086 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:45:46.265047    2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-fe63dc8a-pplrv"]
Jul 23 16:45:46.268227 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:45:46.268194    2553 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-fe63dc8a-pplrv"]
Jul 23 16:45:46.413624 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:45:46.413587    2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-migrate-fe63dc8a-gw-openshift-default-b59d6778c-4q44p"]
Jul 23 16:45:46.413902 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:45:46.413857    2553 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-migrate-fe63dc8a-gw-openshift-default-b59d6778c-4q44p" podUID="d74b5d4b-9571-4992-af99-e5bdb74e3e79" containerName="istio-proxy" containerID="cri-o://bb28e0fe7d3c15c1090f5ca31dbfb59678ede16a061cfdfe6b46082b80f66a59" gracePeriod=30
Jul 23 16:45:46.675033 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:45:46.674993    2553 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7818d8a0-5a97-449d-bb66-1e6de8427fb9" path="/var/lib/kubelet/pods/7818d8a0-5a97-449d-bb66-1e6de8427fb9/volumes"
Jul 23 16:45:47.293027 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:45:47.292977    2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-8d7afb36-openshift-default-5699c46f9c-8k664"]
Jul 23 16:45:47.293465 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:45:47.293389    2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7818d8a0-5a97-449d-bb66-1e6de8427fb9" containerName="revoke-keys"
Jul 23 16:45:47.293465 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:45:47.293402    2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="7818d8a0-5a97-449d-bb66-1e6de8427fb9" containerName="revoke-keys"
Jul 23 16:45:47.293551 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:45:47.293469    2553 memory_manager.go:368] "RemoveStaleState removing state" podUID="7818d8a0-5a97-449d-bb66-1e6de8427fb9" containerName="revoke-keys"
Jul 23 16:45:47.296840 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:45:47.296819    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-8d7afb36-openshift-default-5699c46f9c-8k664"
Jul 23 16:45:47.300291 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:45:47.300261    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-8d7afb36-openshift-default-dockercfg-lstbc\""
Jul 23 16:45:47.319852 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:45:47.319799    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-8d7afb36-openshift-default-5699c46f9c-8k664"]
Jul 23 16:45:47.376370 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:45:47.376330    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1b861fa8-4ff6-422f-af86-53778f25eedc-credential-socket\") pod \"e2e-ait-8d7afb36-openshift-default-5699c46f9c-8k664\" (UID: \"1b861fa8-4ff6-422f-af86-53778f25eedc\") " pod="openshift-ingress/e2e-ait-8d7afb36-openshift-default-5699c46f9c-8k664"
Jul 23 16:45:47.376370 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:45:47.376374    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1b861fa8-4ff6-422f-af86-53778f25eedc-istio-podinfo\") pod \"e2e-ait-8d7afb36-openshift-default-5699c46f9c-8k664\" (UID: \"1b861fa8-4ff6-422f-af86-53778f25eedc\") " pod="openshift-ingress/e2e-ait-8d7afb36-openshift-default-5699c46f9c-8k664"
Jul 23 16:45:47.376641 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:45:47.376401    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1b861fa8-4ff6-422f-af86-53778f25eedc-istiod-ca-cert\") pod \"e2e-ait-8d7afb36-openshift-default-5699c46f9c-8k664\" (UID: \"1b861fa8-4ff6-422f-af86-53778f25eedc\") " pod="openshift-ingress/e2e-ait-8d7afb36-openshift-default-5699c46f9c-8k664"
Jul 23 16:45:47.376641 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:45:47.376499    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1b861fa8-4ff6-422f-af86-53778f25eedc-workload-certs\") pod \"e2e-ait-8d7afb36-openshift-default-5699c46f9c-8k664\" (UID: \"1b861fa8-4ff6-422f-af86-53778f25eedc\") " pod="openshift-ingress/e2e-ait-8d7afb36-openshift-default-5699c46f9c-8k664"
Jul 23 16:45:47.376641 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:45:47.376542    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1b861fa8-4ff6-422f-af86-53778f25eedc-istio-envoy\") pod \"e2e-ait-8d7afb36-openshift-default-5699c46f9c-8k664\" (UID: \"1b861fa8-4ff6-422f-af86-53778f25eedc\") " pod="openshift-ingress/e2e-ait-8d7afb36-openshift-default-5699c46f9c-8k664"
Jul 23 16:45:47.376641 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:45:47.376579    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fnsbk\" (UniqueName: \"kubernetes.io/projected/1b861fa8-4ff6-422f-af86-53778f25eedc-kube-api-access-fnsbk\") pod \"e2e-ait-8d7afb36-openshift-default-5699c46f9c-8k664\" (UID: \"1b861fa8-4ff6-422f-af86-53778f25eedc\") " pod="openshift-ingress/e2e-ait-8d7afb36-openshift-default-5699c46f9c-8k664"
Jul 23 16:45:47.376641 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:45:47.376618    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1b861fa8-4ff6-422f-af86-53778f25eedc-istio-token\") pod \"e2e-ait-8d7afb36-openshift-default-5699c46f9c-8k664\" (UID: \"1b861fa8-4ff6-422f-af86-53778f25eedc\") " pod="openshift-ingress/e2e-ait-8d7afb36-openshift-default-5699c46f9c-8k664"
Jul 23 16:45:47.376822 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:45:47.376658    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1b861fa8-4ff6-422f-af86-53778f25eedc-workload-socket\") pod \"e2e-ait-8d7afb36-openshift-default-5699c46f9c-8k664\" (UID: \"1b861fa8-4ff6-422f-af86-53778f25eedc\") " pod="openshift-ingress/e2e-ait-8d7afb36-openshift-default-5699c46f9c-8k664"
Jul 23 16:45:47.376822 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:45:47.376678    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1b861fa8-4ff6-422f-af86-53778f25eedc-istio-data\") pod \"e2e-ait-8d7afb36-openshift-default-5699c46f9c-8k664\" (UID: \"1b861fa8-4ff6-422f-af86-53778f25eedc\") " pod="openshift-ingress/e2e-ait-8d7afb36-openshift-default-5699c46f9c-8k664"
Jul 23 16:45:47.477636 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:45:47.477589    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1b861fa8-4ff6-422f-af86-53778f25eedc-workload-socket\") pod \"e2e-ait-8d7afb36-openshift-default-5699c46f9c-8k664\" (UID: \"1b861fa8-4ff6-422f-af86-53778f25eedc\") " pod="openshift-ingress/e2e-ait-8d7afb36-openshift-default-5699c46f9c-8k664"
Jul 23 16:45:47.477636 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:45:47.477636    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1b861fa8-4ff6-422f-af86-53778f25eedc-istio-data\") pod \"e2e-ait-8d7afb36-openshift-default-5699c46f9c-8k664\" (UID: \"1b861fa8-4ff6-422f-af86-53778f25eedc\") " pod="openshift-ingress/e2e-ait-8d7afb36-openshift-default-5699c46f9c-8k664"
Jul 23 16:45:47.477906 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:45:47.477685    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1b861fa8-4ff6-422f-af86-53778f25eedc-credential-socket\") pod \"e2e-ait-8d7afb36-openshift-default-5699c46f9c-8k664\" (UID: \"1b861fa8-4ff6-422f-af86-53778f25eedc\") " pod="openshift-ingress/e2e-ait-8d7afb36-openshift-default-5699c46f9c-8k664"
Jul 23 16:45:47.477906 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:45:47.477708    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1b861fa8-4ff6-422f-af86-53778f25eedc-istio-podinfo\") pod \"e2e-ait-8d7afb36-openshift-default-5699c46f9c-8k664\" (UID: \"1b861fa8-4ff6-422f-af86-53778f25eedc\") " pod="openshift-ingress/e2e-ait-8d7afb36-openshift-default-5699c46f9c-8k664"
Jul 23 16:45:47.477906 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:45:47.477731    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1b861fa8-4ff6-422f-af86-53778f25eedc-istiod-ca-cert\") pod \"e2e-ait-8d7afb36-openshift-default-5699c46f9c-8k664\" (UID: \"1b861fa8-4ff6-422f-af86-53778f25eedc\") " pod="openshift-ingress/e2e-ait-8d7afb36-openshift-default-5699c46f9c-8k664"
Jul 23 16:45:47.477906 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:45:47.477768    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1b861fa8-4ff6-422f-af86-53778f25eedc-workload-certs\") pod \"e2e-ait-8d7afb36-openshift-default-5699c46f9c-8k664\" (UID: \"1b861fa8-4ff6-422f-af86-53778f25eedc\") " pod="openshift-ingress/e2e-ait-8d7afb36-openshift-default-5699c46f9c-8k664"
Jul 23 16:45:47.477906 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:45:47.477795    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1b861fa8-4ff6-422f-af86-53778f25eedc-istio-envoy\") pod \"e2e-ait-8d7afb36-openshift-default-5699c46f9c-8k664\" (UID: \"1b861fa8-4ff6-422f-af86-53778f25eedc\") " pod="openshift-ingress/e2e-ait-8d7afb36-openshift-default-5699c46f9c-8k664"
Jul 23 16:45:47.477906 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:45:47.477824    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fnsbk\" (UniqueName: \"kubernetes.io/projected/1b861fa8-4ff6-422f-af86-53778f25eedc-kube-api-access-fnsbk\") pod \"e2e-ait-8d7afb36-openshift-default-5699c46f9c-8k664\" (UID: \"1b861fa8-4ff6-422f-af86-53778f25eedc\") " pod="openshift-ingress/e2e-ait-8d7afb36-openshift-default-5699c46f9c-8k664"
Jul 23 16:45:47.477906 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:45:47.477850    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1b861fa8-4ff6-422f-af86-53778f25eedc-istio-token\") pod \"e2e-ait-8d7afb36-openshift-default-5699c46f9c-8k664\" (UID: \"1b861fa8-4ff6-422f-af86-53778f25eedc\") " pod="openshift-ingress/e2e-ait-8d7afb36-openshift-default-5699c46f9c-8k664"
Jul 23 16:45:47.478308 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:45:47.478080    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1b861fa8-4ff6-422f-af86-53778f25eedc-workload-socket\") pod \"e2e-ait-8d7afb36-openshift-default-5699c46f9c-8k664\" (UID: \"1b861fa8-4ff6-422f-af86-53778f25eedc\") " pod="openshift-ingress/e2e-ait-8d7afb36-openshift-default-5699c46f9c-8k664"
Jul 23 16:45:47.478308 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:45:47.478117    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1b861fa8-4ff6-422f-af86-53778f25eedc-credential-socket\") pod \"e2e-ait-8d7afb36-openshift-default-5699c46f9c-8k664\" (UID: \"1b861fa8-4ff6-422f-af86-53778f25eedc\") " pod="openshift-ingress/e2e-ait-8d7afb36-openshift-default-5699c46f9c-8k664"
Jul 23 16:45:47.478308 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:45:47.478272    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1b861fa8-4ff6-422f-af86-53778f25eedc-workload-certs\") pod \"e2e-ait-8d7afb36-openshift-default-5699c46f9c-8k664\" (UID: \"1b861fa8-4ff6-422f-af86-53778f25eedc\") " pod="openshift-ingress/e2e-ait-8d7afb36-openshift-default-5699c46f9c-8k664"
Jul 23 16:45:47.478509 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:45:47.478485    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1b861fa8-4ff6-422f-af86-53778f25eedc-istio-data\") pod \"e2e-ait-8d7afb36-openshift-default-5699c46f9c-8k664\" (UID: \"1b861fa8-4ff6-422f-af86-53778f25eedc\") " pod="openshift-ingress/e2e-ait-8d7afb36-openshift-default-5699c46f9c-8k664"
Jul 23 16:45:47.478568 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:45:47.478547    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1b861fa8-4ff6-422f-af86-53778f25eedc-istiod-ca-cert\") pod \"e2e-ait-8d7afb36-openshift-default-5699c46f9c-8k664\" (UID: \"1b861fa8-4ff6-422f-af86-53778f25eedc\") " pod="openshift-ingress/e2e-ait-8d7afb36-openshift-default-5699c46f9c-8k664"
Jul 23 16:45:47.480406 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:45:47.480373    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1b861fa8-4ff6-422f-af86-53778f25eedc-istio-envoy\") pod \"e2e-ait-8d7afb36-openshift-default-5699c46f9c-8k664\" (UID: \"1b861fa8-4ff6-422f-af86-53778f25eedc\") " pod="openshift-ingress/e2e-ait-8d7afb36-openshift-default-5699c46f9c-8k664"
Jul 23 16:45:47.480587 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:45:47.480562    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1b861fa8-4ff6-422f-af86-53778f25eedc-istio-podinfo\") pod \"e2e-ait-8d7afb36-openshift-default-5699c46f9c-8k664\" (UID: \"1b861fa8-4ff6-422f-af86-53778f25eedc\") " pod="openshift-ingress/e2e-ait-8d7afb36-openshift-default-5699c46f9c-8k664"
Jul 23 16:45:47.488110 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:45:47.488065    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1b861fa8-4ff6-422f-af86-53778f25eedc-istio-token\") pod \"e2e-ait-8d7afb36-openshift-default-5699c46f9c-8k664\" (UID: \"1b861fa8-4ff6-422f-af86-53778f25eedc\") " pod="openshift-ingress/e2e-ait-8d7afb36-openshift-default-5699c46f9c-8k664"
Jul 23 16:45:47.488368 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:45:47.488339    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fnsbk\" (UniqueName: \"kubernetes.io/projected/1b861fa8-4ff6-422f-af86-53778f25eedc-kube-api-access-fnsbk\") pod \"e2e-ait-8d7afb36-openshift-default-5699c46f9c-8k664\" (UID: \"1b861fa8-4ff6-422f-af86-53778f25eedc\") " pod="openshift-ingress/e2e-ait-8d7afb36-openshift-default-5699c46f9c-8k664"
Jul 23 16:45:47.608284 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:45:47.608186    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-8d7afb36-openshift-default-5699c46f9c-8k664"
Jul 23 16:45:47.759050 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:45:47.759024    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-8d7afb36-openshift-default-5699c46f9c-8k664"]
Jul 23 16:45:47.760964 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:45:47.760936    2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1b861fa8_4ff6_422f_af86_53778f25eedc.slice/crio-0c1cf0525f37c14925ade013aab5142ee5fc7d545dea4cd7c480dfe229b9a62f WatchSource:0}: Error finding container 0c1cf0525f37c14925ade013aab5142ee5fc7d545dea4cd7c480dfe229b9a62f: Status 404 returned error can't find the container with id 0c1cf0525f37c14925ade013aab5142ee5fc7d545dea4cd7c480dfe229b9a62f
Jul 23 16:45:47.763349 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:45:47.763314    2553 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 23 16:45:47.763454 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:45:47.763385    2553 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 23 16:45:47.763454 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:45:47.763415    2553 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 23 16:45:47.845246 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:45:47.845208    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-8d7afb36-openshift-default-5699c46f9c-8k664" event={"ID":"1b861fa8-4ff6-422f-af86-53778f25eedc","Type":"ContainerStarted","Data":"0dba262f2a6d403a52134cd0c395cbb4e565bff5a6ec3733c3a8a9e77ed9d658"}
Jul 23 16:45:47.845402 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:45:47.845270    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-8d7afb36-openshift-default-5699c46f9c-8k664" event={"ID":"1b861fa8-4ff6-422f-af86-53778f25eedc","Type":"ContainerStarted","Data":"0c1cf0525f37c14925ade013aab5142ee5fc7d545dea4cd7c480dfe229b9a62f"}
Jul 23 16:45:47.866361 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:45:47.866232    2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-8d7afb36-openshift-default-5699c46f9c-8k664" podStartSLOduration=0.86620776 podStartE2EDuration="866.20776ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 16:45:47 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 16:45:47.864039805 +0000 UTC m=+1829.728645947" watchObservedRunningTime="2026-07-23 16:45:47.86620776 +0000 UTC m=+1829.730813890"
Jul 23 16:45:48.608698 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:45:48.608659    2553 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-8d7afb36-openshift-default-5699c46f9c-8k664"
Jul 23 16:45:48.613796 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:45:48.613766    2553 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-8d7afb36-openshift-default-5699c46f9c-8k664"
Jul 23 16:45:48.851505 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:45:48.851476    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-8d7afb36-openshift-default-5699c46f9c-8k664"
Jul 23 16:45:48.852484 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:45:48.852461    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-8d7afb36-openshift-default-5699c46f9c-8k664"
Jul 23 16:45:51.681870 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:45:51.681794    2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-fe63dc8a-gw-openshift-default-b59d6778c-4q44p"
Jul 23 16:45:51.720046 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:45:51.720010    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d74b5d4b-9571-4992-af99-e5bdb74e3e79-credential-socket\") pod \"d74b5d4b-9571-4992-af99-e5bdb74e3e79\" (UID: \"d74b5d4b-9571-4992-af99-e5bdb74e3e79\") "
Jul 23 16:45:51.720046 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:45:51.720047    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wkmkj\" (UniqueName: \"kubernetes.io/projected/d74b5d4b-9571-4992-af99-e5bdb74e3e79-kube-api-access-wkmkj\") pod \"d74b5d4b-9571-4992-af99-e5bdb74e3e79\" (UID: \"d74b5d4b-9571-4992-af99-e5bdb74e3e79\") "
Jul 23 16:45:51.720359 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:45:51.720109    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d74b5d4b-9571-4992-af99-e5bdb74e3e79-istio-podinfo\") pod \"d74b5d4b-9571-4992-af99-e5bdb74e3e79\" (UID: \"d74b5d4b-9571-4992-af99-e5bdb74e3e79\") "
Jul 23 16:45:51.720359 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:45:51.720178    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d74b5d4b-9571-4992-af99-e5bdb74e3e79-istio-envoy\") pod \"d74b5d4b-9571-4992-af99-e5bdb74e3e79\" (UID: \"d74b5d4b-9571-4992-af99-e5bdb74e3e79\") "
Jul 23 16:45:51.720359 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:45:51.720260    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d74b5d4b-9571-4992-af99-e5bdb74e3e79-istiod-ca-cert\") pod \"d74b5d4b-9571-4992-af99-e5bdb74e3e79\" (UID: \"d74b5d4b-9571-4992-af99-e5bdb74e3e79\") "
Jul 23 16:45:51.720359 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:45:51.720327    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d74b5d4b-9571-4992-af99-e5bdb74e3e79-workload-socket\") pod \"d74b5d4b-9571-4992-af99-e5bdb74e3e79\" (UID: \"d74b5d4b-9571-4992-af99-e5bdb74e3e79\") "
Jul 23 16:45:51.720359 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:45:51.720355    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d74b5d4b-9571-4992-af99-e5bdb74e3e79-istio-data\") pod \"d74b5d4b-9571-4992-af99-e5bdb74e3e79\" (UID: \"d74b5d4b-9571-4992-af99-e5bdb74e3e79\") "
Jul 23 16:45:51.720640 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:45:51.720379    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d74b5d4b-9571-4992-af99-e5bdb74e3e79-istio-token\") pod \"d74b5d4b-9571-4992-af99-e5bdb74e3e79\" (UID: \"d74b5d4b-9571-4992-af99-e5bdb74e3e79\") "
Jul 23 16:45:51.720640 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:45:51.720384    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d74b5d4b-9571-4992-af99-e5bdb74e3e79-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "d74b5d4b-9571-4992-af99-e5bdb74e3e79" (UID: "d74b5d4b-9571-4992-af99-e5bdb74e3e79"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 16:45:51.720640 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:45:51.720448    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d74b5d4b-9571-4992-af99-e5bdb74e3e79-workload-certs\") pod \"d74b5d4b-9571-4992-af99-e5bdb74e3e79\" (UID: \"d74b5d4b-9571-4992-af99-e5bdb74e3e79\") "
Jul 23 16:45:51.720807 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:45:51.720711    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d74b5d4b-9571-4992-af99-e5bdb74e3e79-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "d74b5d4b-9571-4992-af99-e5bdb74e3e79" (UID: "d74b5d4b-9571-4992-af99-e5bdb74e3e79"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 23 16:45:51.720923 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:45:51.720884    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d74b5d4b-9571-4992-af99-e5bdb74e3e79-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "d74b5d4b-9571-4992-af99-e5bdb74e3e79" (UID: "d74b5d4b-9571-4992-af99-e5bdb74e3e79"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 16:45:51.720923 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:45:51.720897    2553 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d74b5d4b-9571-4992-af99-e5bdb74e3e79-credential-socket\") on node \"ip-10-0-143-166.ec2.internal\" DevicePath \"\""
Jul 23 16:45:51.720923 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:45:51.720916    2553 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d74b5d4b-9571-4992-af99-e5bdb74e3e79-istiod-ca-cert\") on node \"ip-10-0-143-166.ec2.internal\" DevicePath \"\""
Jul 23 16:45:51.721405 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:45:51.721380    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d74b5d4b-9571-4992-af99-e5bdb74e3e79-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "d74b5d4b-9571-4992-af99-e5bdb74e3e79" (UID: "d74b5d4b-9571-4992-af99-e5bdb74e3e79"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 16:45:51.721497 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:45:51.721478    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d74b5d4b-9571-4992-af99-e5bdb74e3e79-istio-data" (OuterVolumeSpecName: "istio-data") pod "d74b5d4b-9571-4992-af99-e5bdb74e3e79" (UID: "d74b5d4b-9571-4992-af99-e5bdb74e3e79"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 16:45:51.722625 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:45:51.722602    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d74b5d4b-9571-4992-af99-e5bdb74e3e79-kube-api-access-wkmkj" (OuterVolumeSpecName: "kube-api-access-wkmkj") pod "d74b5d4b-9571-4992-af99-e5bdb74e3e79" (UID: "d74b5d4b-9571-4992-af99-e5bdb74e3e79"). InnerVolumeSpecName "kube-api-access-wkmkj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 16:45:51.722913 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:45:51.722887    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/d74b5d4b-9571-4992-af99-e5bdb74e3e79-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "d74b5d4b-9571-4992-af99-e5bdb74e3e79" (UID: "d74b5d4b-9571-4992-af99-e5bdb74e3e79"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 23 16:45:51.722998 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:45:51.722939    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d74b5d4b-9571-4992-af99-e5bdb74e3e79-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "d74b5d4b-9571-4992-af99-e5bdb74e3e79" (UID: "d74b5d4b-9571-4992-af99-e5bdb74e3e79"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 16:45:51.723040 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:45:51.723012    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d74b5d4b-9571-4992-af99-e5bdb74e3e79-istio-token" (OuterVolumeSpecName: "istio-token") pod "d74b5d4b-9571-4992-af99-e5bdb74e3e79" (UID: "d74b5d4b-9571-4992-af99-e5bdb74e3e79"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 16:45:51.821846 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:45:51.821788    2553 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d74b5d4b-9571-4992-af99-e5bdb74e3e79-istio-podinfo\") on node \"ip-10-0-143-166.ec2.internal\" DevicePath \"\""
Jul 23 16:45:51.821846 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:45:51.821837    2553 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d74b5d4b-9571-4992-af99-e5bdb74e3e79-istio-envoy\") on node \"ip-10-0-143-166.ec2.internal\" DevicePath \"\""
Jul 23 16:45:51.821846 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:45:51.821847    2553 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d74b5d4b-9571-4992-af99-e5bdb74e3e79-workload-socket\") on node \"ip-10-0-143-166.ec2.internal\" DevicePath \"\""
Jul 23 16:45:51.821846 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:45:51.821856    2553 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d74b5d4b-9571-4992-af99-e5bdb74e3e79-istio-data\") on node \"ip-10-0-143-166.ec2.internal\" DevicePath \"\""
Jul 23 16:45:51.821846 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:45:51.821865    2553 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d74b5d4b-9571-4992-af99-e5bdb74e3e79-istio-token\") on node \"ip-10-0-143-166.ec2.internal\" DevicePath \"\""
Jul 23 16:45:51.822205 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:45:51.821872    2553 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d74b5d4b-9571-4992-af99-e5bdb74e3e79-workload-certs\") on node \"ip-10-0-143-166.ec2.internal\" DevicePath \"\""
Jul 23 16:45:51.822205 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:45:51.821880    2553 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wkmkj\" (UniqueName: \"kubernetes.io/projected/d74b5d4b-9571-4992-af99-e5bdb74e3e79-kube-api-access-wkmkj\") on node \"ip-10-0-143-166.ec2.internal\" DevicePath \"\""
Jul 23 16:45:51.871141 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:45:51.871104    2553 generic.go:356] "Generic (PLEG): container finished" podID="d74b5d4b-9571-4992-af99-e5bdb74e3e79" containerID="bb28e0fe7d3c15c1090f5ca31dbfb59678ede16a061cfdfe6b46082b80f66a59" exitCode=0
Jul 23 16:45:51.871335 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:45:51.871159    2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-fe63dc8a-gw-openshift-default-b59d6778c-4q44p"
Jul 23 16:45:51.871335 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:45:51.871194    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-fe63dc8a-gw-openshift-default-b59d6778c-4q44p" event={"ID":"d74b5d4b-9571-4992-af99-e5bdb74e3e79","Type":"ContainerDied","Data":"bb28e0fe7d3c15c1090f5ca31dbfb59678ede16a061cfdfe6b46082b80f66a59"}
Jul 23 16:45:51.871419 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:45:51.871339    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-fe63dc8a-gw-openshift-default-b59d6778c-4q44p" event={"ID":"d74b5d4b-9571-4992-af99-e5bdb74e3e79","Type":"ContainerDied","Data":"fb322ba7ad5c98223e5dce4d84e56217891cc9d6ccd8c34860b5370e9e5a5f2c"}
Jul 23 16:45:51.871419 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:45:51.871363    2553 scope.go:117] "RemoveContainer" containerID="bb28e0fe7d3c15c1090f5ca31dbfb59678ede16a061cfdfe6b46082b80f66a59"
Jul 23 16:45:51.881481 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:45:51.881457    2553 scope.go:117] "RemoveContainer" containerID="c428626d94f27016374b0f655ec96e9fd93272df8d348c9f5b57badda59cfd0f"
Jul 23 16:45:51.891048 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:45:51.891023    2553 scope.go:117] "RemoveContainer" containerID="bb28e0fe7d3c15c1090f5ca31dbfb59678ede16a061cfdfe6b46082b80f66a59"
Jul 23 16:45:51.891384 ip-10-0-143-166 kubenswrapper[2553]: E0723 16:45:51.891361    2553 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bb28e0fe7d3c15c1090f5ca31dbfb59678ede16a061cfdfe6b46082b80f66a59\": container with ID starting with bb28e0fe7d3c15c1090f5ca31dbfb59678ede16a061cfdfe6b46082b80f66a59 not found: ID does not exist" containerID="bb28e0fe7d3c15c1090f5ca31dbfb59678ede16a061cfdfe6b46082b80f66a59"
Jul 23 16:45:51.891445 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:45:51.891395    2553 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bb28e0fe7d3c15c1090f5ca31dbfb59678ede16a061cfdfe6b46082b80f66a59"} err="failed to get container status \"bb28e0fe7d3c15c1090f5ca31dbfb59678ede16a061cfdfe6b46082b80f66a59\": rpc error: code = NotFound desc = could not find container \"bb28e0fe7d3c15c1090f5ca31dbfb59678ede16a061cfdfe6b46082b80f66a59\": container with ID starting with bb28e0fe7d3c15c1090f5ca31dbfb59678ede16a061cfdfe6b46082b80f66a59 not found: ID does not exist"
Jul 23 16:45:51.891445 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:45:51.891414    2553 scope.go:117] "RemoveContainer" containerID="c428626d94f27016374b0f655ec96e9fd93272df8d348c9f5b57badda59cfd0f"
Jul 23 16:45:51.891652 ip-10-0-143-166 kubenswrapper[2553]: E0723 16:45:51.891634    2553 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c428626d94f27016374b0f655ec96e9fd93272df8d348c9f5b57badda59cfd0f\": container with ID starting with c428626d94f27016374b0f655ec96e9fd93272df8d348c9f5b57badda59cfd0f not found: ID does not exist" containerID="c428626d94f27016374b0f655ec96e9fd93272df8d348c9f5b57badda59cfd0f"
Jul 23 16:45:51.891693 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:45:51.891660    2553 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c428626d94f27016374b0f655ec96e9fd93272df8d348c9f5b57badda59cfd0f"} err="failed to get container status \"c428626d94f27016374b0f655ec96e9fd93272df8d348c9f5b57badda59cfd0f\": rpc error: code = NotFound desc = could not find container \"c428626d94f27016374b0f655ec96e9fd93272df8d348c9f5b57badda59cfd0f\": container with ID starting with c428626d94f27016374b0f655ec96e9fd93272df8d348c9f5b57badda59cfd0f not found: ID does not exist"
Jul 23 16:45:51.898671 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:45:51.898642    2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-migrate-fe63dc8a-gw-openshift-default-b59d6778c-4q44p"]
Jul 23 16:45:51.900846 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:45:51.900820    2553 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-migrate-fe63dc8a-gw-openshift-default-b59d6778c-4q44p"]
Jul 23 16:45:52.675241 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:45:52.675203    2553 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d74b5d4b-9571-4992-af99-e5bdb74e3e79" path="/var/lib/kubelet/pods/d74b5d4b-9571-4992-af99-e5bdb74e3e79/volumes"
Jul 23 16:46:03.924711 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:46:03.924236    2553 patch_prober.go:28] interesting pod/e2e-ait-8d7afb36-openshift-default-5699c46f9c-8k664 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.51:15021/healthz/ready\": read tcp 10.132.0.2:53454->10.132.0.51:15021: read: connection reset by peer" start-of-body=
Jul 23 16:46:03.924711 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:46:03.924305    2553 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ait-8d7afb36-openshift-default-5699c46f9c-8k664" podUID="1b861fa8-4ff6-422f-af86-53778f25eedc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.51:15021/healthz/ready\": read tcp 10.132.0.2:53454->10.132.0.51:15021: read: connection reset by peer"
Jul 23 16:46:03.949380 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:46:03.949355    2553 generic.go:356] "Generic (PLEG): container finished" podID="1b861fa8-4ff6-422f-af86-53778f25eedc" containerID="0dba262f2a6d403a52134cd0c395cbb4e565bff5a6ec3733c3a8a9e77ed9d658" exitCode=0
Jul 23 16:46:03.949505 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:46:03.949390    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-8d7afb36-openshift-default-5699c46f9c-8k664" event={"ID":"1b861fa8-4ff6-422f-af86-53778f25eedc","Type":"ContainerDied","Data":"0dba262f2a6d403a52134cd0c395cbb4e565bff5a6ec3733c3a8a9e77ed9d658"}
Jul 23 16:46:03.949781 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:46:03.949768    2553 scope.go:117] "RemoveContainer" containerID="0dba262f2a6d403a52134cd0c395cbb4e565bff5a6ec3733c3a8a9e77ed9d658"
Jul 23 16:46:03.950751 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:46:03.950721    2553 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 23 16:46:03.950829 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:46:03.950811    2553 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 23 16:46:03.950869 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:46:03.950858    2553 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 23 16:46:04.958127 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:46:04.958085    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-8d7afb36-openshift-default-5699c46f9c-8k664" event={"ID":"1b861fa8-4ff6-422f-af86-53778f25eedc","Type":"ContainerStarted","Data":"38ea1aed11ca7b79276939f5a6904f5f74076108c21eb96c7d7dd5b35de0b41e"}
Jul 23 16:46:05.608529 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:46:05.608491    2553 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-8d7afb36-openshift-default-5699c46f9c-8k664"
Jul 23 16:46:05.608763 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:46:05.608744    2553 patch_prober.go:28] interesting pod/e2e-ait-8d7afb36-openshift-default-5699c46f9c-8k664 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.51:15021/healthz/ready\": dial tcp 10.132.0.51:15021: connect: connection refused" start-of-body=
Jul 23 16:46:05.608825 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:46:05.608806    2553 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-8d7afb36-openshift-default-5699c46f9c-8k664" podUID="1b861fa8-4ff6-422f-af86-53778f25eedc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.51:15021/healthz/ready\": dial tcp 10.132.0.51:15021: connect: connection refused"
Jul 23 16:46:06.608849 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:46:06.608809    2553 patch_prober.go:28] interesting pod/e2e-ait-8d7afb36-openshift-default-5699c46f9c-8k664 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.51:15021/healthz/ready\": dial tcp 10.132.0.51:15021: connect: connection refused" start-of-body=
Jul 23 16:46:06.609289 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:46:06.608868    2553 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-8d7afb36-openshift-default-5699c46f9c-8k664" podUID="1b861fa8-4ff6-422f-af86-53778f25eedc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.51:15021/healthz/ready\": dial tcp 10.132.0.51:15021: connect: connection refused"
Jul 23 16:46:07.609335 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:46:07.609297    2553 patch_prober.go:28] interesting pod/e2e-ait-8d7afb36-openshift-default-5699c46f9c-8k664 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.51:15021/healthz/ready\": dial tcp 10.132.0.51:15021: connect: connection refused" start-of-body=
Jul 23 16:46:07.609819 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:46:07.609359    2553 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-8d7afb36-openshift-default-5699c46f9c-8k664" podUID="1b861fa8-4ff6-422f-af86-53778f25eedc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.51:15021/healthz/ready\": dial tcp 10.132.0.51:15021: connect: connection refused"
Jul 23 16:46:08.609151 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:46:08.609113    2553 patch_prober.go:28] interesting pod/e2e-ait-8d7afb36-openshift-default-5699c46f9c-8k664 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.51:15021/healthz/ready\": dial tcp 10.132.0.51:15021: connect: connection refused" start-of-body=
Jul 23 16:46:08.609380 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:46:08.609201    2553 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-8d7afb36-openshift-default-5699c46f9c-8k664" podUID="1b861fa8-4ff6-422f-af86-53778f25eedc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.51:15021/healthz/ready\": dial tcp 10.132.0.51:15021: connect: connection refused"
Jul 23 16:46:09.612412 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:46:09.612375    2553 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-8d7afb36-openshift-default-5699c46f9c-8k664"
Jul 23 16:46:09.612894 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:46:09.612641    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-8d7afb36-openshift-default-5699c46f9c-8k664"
Jul 23 16:46:09.613407 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:46:09.613392    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-8d7afb36-openshift-default-5699c46f9c-8k664"
Jul 23 16:46:15.153134 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:46:15.153102    2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-8d7afb36-j6c5x"]
Jul 23 16:46:15.153535 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:46:15.153449    2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d74b5d4b-9571-4992-af99-e5bdb74e3e79" containerName="istio-proxy"
Jul 23 16:46:15.153535 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:46:15.153460    2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="d74b5d4b-9571-4992-af99-e5bdb74e3e79" containerName="istio-proxy"
Jul 23 16:46:15.153535 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:46:15.153479    2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d74b5d4b-9571-4992-af99-e5bdb74e3e79" containerName="istio-proxy"
Jul 23 16:46:15.153535 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:46:15.153485    2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="d74b5d4b-9571-4992-af99-e5bdb74e3e79" containerName="istio-proxy"
Jul 23 16:46:15.153670 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:46:15.153560    2553 memory_manager.go:368] "RemoveStaleState removing state" podUID="d74b5d4b-9571-4992-af99-e5bdb74e3e79" containerName="istio-proxy"
Jul 23 16:46:15.156865 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:46:15.156848    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-8d7afb36-j6c5x"
Jul 23 16:46:15.159398 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:46:15.159373    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 23 16:46:15.160697 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:46:15.160675    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-plqcf\""
Jul 23 16:46:15.164264 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:46:15.164234    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-8d7afb36-j6c5x"]
Jul 23 16:46:15.338763 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:46:15.338727    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/618dd0fa-b237-4158-ab3e-f9dfbe38f0dd-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-8d7afb36-j6c5x\" (UID: \"618dd0fa-b237-4158-ab3e-f9dfbe38f0dd\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-8d7afb36-j6c5x"
Jul 23 16:46:15.439849 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:46:15.439755    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/618dd0fa-b237-4158-ab3e-f9dfbe38f0dd-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-8d7afb36-j6c5x\" (UID: \"618dd0fa-b237-4158-ab3e-f9dfbe38f0dd\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-8d7afb36-j6c5x"
Jul 23 16:46:15.440401 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:46:15.440383    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/618dd0fa-b237-4158-ab3e-f9dfbe38f0dd-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-8d7afb36-j6c5x\" (UID: \"618dd0fa-b237-4158-ab3e-f9dfbe38f0dd\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-8d7afb36-j6c5x"
Jul 23 16:46:15.469821 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:46:15.469793    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-8d7afb36-j6c5x"
Jul 23 16:46:15.607817 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:46:15.607793    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-8d7afb36-j6c5x"]
Jul 23 16:46:15.609860 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:46:15.609834    2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod618dd0fa_b237_4158_ab3e_f9dfbe38f0dd.slice/crio-f7fe3a6ba602c1f9cd64d7b1e71a7e04b7836d837330c4a99e100cf85271c411 WatchSource:0}: Error finding container f7fe3a6ba602c1f9cd64d7b1e71a7e04b7836d837330c4a99e100cf85271c411: Status 404 returned error can't find the container with id f7fe3a6ba602c1f9cd64d7b1e71a7e04b7836d837330c4a99e100cf85271c411
Jul 23 16:46:16.020945 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:46:16.020906    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-8d7afb36-j6c5x" event={"ID":"618dd0fa-b237-4158-ab3e-f9dfbe38f0dd","Type":"ContainerStarted","Data":"43c09ed959bbcbb40299a6a609219e3a0220df2517ec876b5d16b7f55b5a06ce"}
Jul 23 16:46:16.021155 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:46:16.020966    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-8d7afb36-j6c5x" event={"ID":"618dd0fa-b237-4158-ab3e-f9dfbe38f0dd","Type":"ContainerStarted","Data":"f7fe3a6ba602c1f9cd64d7b1e71a7e04b7836d837330c4a99e100cf85271c411"}
Jul 23 16:46:16.040541 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:46:16.040486    2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-8d7afb36-j6c5x" podStartSLOduration=1.040471511 podStartE2EDuration="1.040471511s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 16:46:15 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 16:46:16.038960573 +0000 UTC m=+1857.903566701" watchObservedRunningTime="2026-07-23 16:46:16.040471511 +0000 UTC m=+1857.905077639"
Jul 23 16:46:17.027993 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:46:17.027957    2553 generic.go:356] "Generic (PLEG): container finished" podID="618dd0fa-b237-4158-ab3e-f9dfbe38f0dd" containerID="43c09ed959bbcbb40299a6a609219e3a0220df2517ec876b5d16b7f55b5a06ce" exitCode=0
Jul 23 16:46:17.028430 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:46:17.028051    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-8d7afb36-j6c5x" event={"ID":"618dd0fa-b237-4158-ab3e-f9dfbe38f0dd","Type":"ContainerDied","Data":"43c09ed959bbcbb40299a6a609219e3a0220df2517ec876b5d16b7f55b5a06ce"}
Jul 23 16:46:18.170063 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:46:18.170033    2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-8d7afb36-j6c5x"
Jul 23 16:46:18.264539 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:46:18.264501    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/618dd0fa-b237-4158-ab3e-f9dfbe38f0dd-maas-api-service-ca\") pod \"618dd0fa-b237-4158-ab3e-f9dfbe38f0dd\" (UID: \"618dd0fa-b237-4158-ab3e-f9dfbe38f0dd\") "
Jul 23 16:46:18.264901 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:46:18.264876    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/618dd0fa-b237-4158-ab3e-f9dfbe38f0dd-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "618dd0fa-b237-4158-ab3e-f9dfbe38f0dd" (UID: "618dd0fa-b237-4158-ab3e-f9dfbe38f0dd"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 23 16:46:18.365813 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:46:18.365720    2553 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/618dd0fa-b237-4158-ab3e-f9dfbe38f0dd-maas-api-service-ca\") on node \"ip-10-0-143-166.ec2.internal\" DevicePath \"\""
Jul 23 16:46:19.039183 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:46:19.039081    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-8d7afb36-j6c5x" event={"ID":"618dd0fa-b237-4158-ab3e-f9dfbe38f0dd","Type":"ContainerDied","Data":"f7fe3a6ba602c1f9cd64d7b1e71a7e04b7836d837330c4a99e100cf85271c411"}
Jul 23 16:46:19.039183 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:46:19.039129    2553 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="f7fe3a6ba602c1f9cd64d7b1e71a7e04b7836d837330c4a99e100cf85271c411"
Jul 23 16:46:19.039183 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:46:19.039090    2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-8d7afb36-j6c5x"
Jul 23 16:46:30.245629 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:46:30.245587    2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-8d7afb36-j6c5x"]
Jul 23 16:46:30.247728 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:46:30.247708    2553 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-8d7afb36-j6c5x"]
Jul 23 16:46:30.674808 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:46:30.674774    2553 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="618dd0fa-b237-4158-ab3e-f9dfbe38f0dd" path="/var/lib/kubelet/pods/618dd0fa-b237-4158-ab3e-f9dfbe38f0dd/volumes"
Jul 23 16:46:31.540276 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:46:31.540237    2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-8d7afb36-openshift-default-5699c46f9c-8k664"]
Jul 23 16:46:31.540761 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:46:31.540444    2553 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-8d7afb36-openshift-default-5699c46f9c-8k664" podUID="1b861fa8-4ff6-422f-af86-53778f25eedc" containerName="istio-proxy" containerID="cri-o://38ea1aed11ca7b79276939f5a6904f5f74076108c21eb96c7d7dd5b35de0b41e" gracePeriod=30
Jul 23 16:46:32.348618 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:46:32.348581    2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-derive-8be8a357-openshift-default-6dfb5b66ff-cv68t"]
Jul 23 16:46:32.349084 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:46:32.349069    2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="618dd0fa-b237-4158-ab3e-f9dfbe38f0dd" containerName="revoke-keys"
Jul 23 16:46:32.349129 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:46:32.349087    2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="618dd0fa-b237-4158-ab3e-f9dfbe38f0dd" containerName="revoke-keys"
Jul 23 16:46:32.349221 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:46:32.349210    2553 memory_manager.go:368] "RemoveStaleState removing state" podUID="d74b5d4b-9571-4992-af99-e5bdb74e3e79" containerName="istio-proxy"
Jul 23 16:46:32.349260 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:46:32.349227    2553 memory_manager.go:368] "RemoveStaleState removing state" podUID="618dd0fa-b237-4158-ab3e-f9dfbe38f0dd" containerName="revoke-keys"
Jul 23 16:46:32.352702 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:46:32.352683    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-8be8a357-openshift-default-6dfb5b66ff-cv68t"
Jul 23 16:46:32.355672 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:46:32.355651    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-derive-8be8a357-openshift-default-dockercfg-645w4\""
Jul 23 16:46:32.362473 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:46:32.362447    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-8be8a357-openshift-default-6dfb5b66ff-cv68t"]
Jul 23 16:46:32.367607 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:46:32.367582    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ae06f6fb-745b-4a79-b460-344876ad6125-workload-certs\") pod \"e2e-derive-8be8a357-openshift-default-6dfb5b66ff-cv68t\" (UID: \"ae06f6fb-745b-4a79-b460-344876ad6125\") " pod="openshift-ingress/e2e-derive-8be8a357-openshift-default-6dfb5b66ff-cv68t"
Jul 23 16:46:32.367747 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:46:32.367633    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ae06f6fb-745b-4a79-b460-344876ad6125-istio-envoy\") pod \"e2e-derive-8be8a357-openshift-default-6dfb5b66ff-cv68t\" (UID: \"ae06f6fb-745b-4a79-b460-344876ad6125\") " pod="openshift-ingress/e2e-derive-8be8a357-openshift-default-6dfb5b66ff-cv68t"
Jul 23 16:46:32.367747 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:46:32.367665    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ae06f6fb-745b-4a79-b460-344876ad6125-istiod-ca-cert\") pod \"e2e-derive-8be8a357-openshift-default-6dfb5b66ff-cv68t\" (UID: \"ae06f6fb-745b-4a79-b460-344876ad6125\") " pod="openshift-ingress/e2e-derive-8be8a357-openshift-default-6dfb5b66ff-cv68t"
Jul 23 16:46:32.367747 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:46:32.367730    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ae06f6fb-745b-4a79-b460-344876ad6125-istio-data\") pod \"e2e-derive-8be8a357-openshift-default-6dfb5b66ff-cv68t\" (UID: \"ae06f6fb-745b-4a79-b460-344876ad6125\") " pod="openshift-ingress/e2e-derive-8be8a357-openshift-default-6dfb5b66ff-cv68t"
Jul 23 16:46:32.367869 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:46:32.367792    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-68wgb\" (UniqueName: \"kubernetes.io/projected/ae06f6fb-745b-4a79-b460-344876ad6125-kube-api-access-68wgb\") pod \"e2e-derive-8be8a357-openshift-default-6dfb5b66ff-cv68t\" (UID: \"ae06f6fb-745b-4a79-b460-344876ad6125\") " pod="openshift-ingress/e2e-derive-8be8a357-openshift-default-6dfb5b66ff-cv68t"
Jul 23 16:46:32.367869 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:46:32.367833    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ae06f6fb-745b-4a79-b460-344876ad6125-credential-socket\") pod \"e2e-derive-8be8a357-openshift-default-6dfb5b66ff-cv68t\" (UID: \"ae06f6fb-745b-4a79-b460-344876ad6125\") " pod="openshift-ingress/e2e-derive-8be8a357-openshift-default-6dfb5b66ff-cv68t"
Jul 23 16:46:32.367869 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:46:32.367859    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ae06f6fb-745b-4a79-b460-344876ad6125-istio-podinfo\") pod \"e2e-derive-8be8a357-openshift-default-6dfb5b66ff-cv68t\" (UID: \"ae06f6fb-745b-4a79-b460-344876ad6125\") " pod="openshift-ingress/e2e-derive-8be8a357-openshift-default-6dfb5b66ff-cv68t"
Jul 23 16:46:32.368022 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:46:32.367886    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ae06f6fb-745b-4a79-b460-344876ad6125-istio-token\") pod \"e2e-derive-8be8a357-openshift-default-6dfb5b66ff-cv68t\" (UID: \"ae06f6fb-745b-4a79-b460-344876ad6125\") " pod="openshift-ingress/e2e-derive-8be8a357-openshift-default-6dfb5b66ff-cv68t"
Jul 23 16:46:32.368022 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:46:32.367954    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ae06f6fb-745b-4a79-b460-344876ad6125-workload-socket\") pod \"e2e-derive-8be8a357-openshift-default-6dfb5b66ff-cv68t\" (UID: \"ae06f6fb-745b-4a79-b460-344876ad6125\") " pod="openshift-ingress/e2e-derive-8be8a357-openshift-default-6dfb5b66ff-cv68t"
Jul 23 16:46:32.468505 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:46:32.468470    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ae06f6fb-745b-4a79-b460-344876ad6125-workload-certs\") pod \"e2e-derive-8be8a357-openshift-default-6dfb5b66ff-cv68t\" (UID: \"ae06f6fb-745b-4a79-b460-344876ad6125\") " pod="openshift-ingress/e2e-derive-8be8a357-openshift-default-6dfb5b66ff-cv68t"
Jul 23 16:46:32.468505 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:46:32.468521    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ae06f6fb-745b-4a79-b460-344876ad6125-istio-envoy\") pod \"e2e-derive-8be8a357-openshift-default-6dfb5b66ff-cv68t\" (UID: \"ae06f6fb-745b-4a79-b460-344876ad6125\") " pod="openshift-ingress/e2e-derive-8be8a357-openshift-default-6dfb5b66ff-cv68t"
Jul 23 16:46:32.468780 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:46:32.468545    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ae06f6fb-745b-4a79-b460-344876ad6125-istiod-ca-cert\") pod \"e2e-derive-8be8a357-openshift-default-6dfb5b66ff-cv68t\" (UID: \"ae06f6fb-745b-4a79-b460-344876ad6125\") " pod="openshift-ingress/e2e-derive-8be8a357-openshift-default-6dfb5b66ff-cv68t"
Jul 23 16:46:32.468780 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:46:32.468574    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ae06f6fb-745b-4a79-b460-344876ad6125-istio-data\") pod \"e2e-derive-8be8a357-openshift-default-6dfb5b66ff-cv68t\" (UID: \"ae06f6fb-745b-4a79-b460-344876ad6125\") " pod="openshift-ingress/e2e-derive-8be8a357-openshift-default-6dfb5b66ff-cv68t"
Jul 23 16:46:32.468780 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:46:32.468632    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-68wgb\" (UniqueName: \"kubernetes.io/projected/ae06f6fb-745b-4a79-b460-344876ad6125-kube-api-access-68wgb\") pod \"e2e-derive-8be8a357-openshift-default-6dfb5b66ff-cv68t\" (UID: \"ae06f6fb-745b-4a79-b460-344876ad6125\") " pod="openshift-ingress/e2e-derive-8be8a357-openshift-default-6dfb5b66ff-cv68t"
Jul 23 16:46:32.468780 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:46:32.468670    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ae06f6fb-745b-4a79-b460-344876ad6125-credential-socket\") pod \"e2e-derive-8be8a357-openshift-default-6dfb5b66ff-cv68t\" (UID: \"ae06f6fb-745b-4a79-b460-344876ad6125\") " pod="openshift-ingress/e2e-derive-8be8a357-openshift-default-6dfb5b66ff-cv68t"
Jul 23 16:46:32.468780 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:46:32.468712    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ae06f6fb-745b-4a79-b460-344876ad6125-istio-podinfo\") pod \"e2e-derive-8be8a357-openshift-default-6dfb5b66ff-cv68t\" (UID: \"ae06f6fb-745b-4a79-b460-344876ad6125\") " pod="openshift-ingress/e2e-derive-8be8a357-openshift-default-6dfb5b66ff-cv68t"
Jul 23 16:46:32.468780 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:46:32.468735    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ae06f6fb-745b-4a79-b460-344876ad6125-istio-token\") pod \"e2e-derive-8be8a357-openshift-default-6dfb5b66ff-cv68t\" (UID: \"ae06f6fb-745b-4a79-b460-344876ad6125\") " pod="openshift-ingress/e2e-derive-8be8a357-openshift-default-6dfb5b66ff-cv68t"
Jul 23 16:46:32.469107 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:46:32.468783    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ae06f6fb-745b-4a79-b460-344876ad6125-workload-socket\") pod \"e2e-derive-8be8a357-openshift-default-6dfb5b66ff-cv68t\" (UID: \"ae06f6fb-745b-4a79-b460-344876ad6125\") " pod="openshift-ingress/e2e-derive-8be8a357-openshift-default-6dfb5b66ff-cv68t"
Jul 23 16:46:32.469107 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:46:32.468922    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ae06f6fb-745b-4a79-b460-344876ad6125-workload-certs\") pod \"e2e-derive-8be8a357-openshift-default-6dfb5b66ff-cv68t\" (UID: \"ae06f6fb-745b-4a79-b460-344876ad6125\") " pod="openshift-ingress/e2e-derive-8be8a357-openshift-default-6dfb5b66ff-cv68t"
Jul 23 16:46:32.469107 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:46:32.469011    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ae06f6fb-745b-4a79-b460-344876ad6125-istio-data\") pod \"e2e-derive-8be8a357-openshift-default-6dfb5b66ff-cv68t\" (UID: \"ae06f6fb-745b-4a79-b460-344876ad6125\") " pod="openshift-ingress/e2e-derive-8be8a357-openshift-default-6dfb5b66ff-cv68t"
Jul 23 16:46:32.469377 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:46:32.469335    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ae06f6fb-745b-4a79-b460-344876ad6125-credential-socket\") pod \"e2e-derive-8be8a357-openshift-default-6dfb5b66ff-cv68t\" (UID: \"ae06f6fb-745b-4a79-b460-344876ad6125\") " pod="openshift-ingress/e2e-derive-8be8a357-openshift-default-6dfb5b66ff-cv68t"
Jul 23 16:46:32.469377 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:46:32.469355    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ae06f6fb-745b-4a79-b460-344876ad6125-istiod-ca-cert\") pod \"e2e-derive-8be8a357-openshift-default-6dfb5b66ff-cv68t\" (UID: \"ae06f6fb-745b-4a79-b460-344876ad6125\") " pod="openshift-ingress/e2e-derive-8be8a357-openshift-default-6dfb5b66ff-cv68t"
Jul 23 16:46:32.469487 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:46:32.469450    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ae06f6fb-745b-4a79-b460-344876ad6125-workload-socket\") pod \"e2e-derive-8be8a357-openshift-default-6dfb5b66ff-cv68t\" (UID: \"ae06f6fb-745b-4a79-b460-344876ad6125\") " pod="openshift-ingress/e2e-derive-8be8a357-openshift-default-6dfb5b66ff-cv68t"
Jul 23 16:46:32.470983 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:46:32.470966    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ae06f6fb-745b-4a79-b460-344876ad6125-istio-envoy\") pod \"e2e-derive-8be8a357-openshift-default-6dfb5b66ff-cv68t\" (UID: \"ae06f6fb-745b-4a79-b460-344876ad6125\") " pod="openshift-ingress/e2e-derive-8be8a357-openshift-default-6dfb5b66ff-cv68t"
Jul 23 16:46:32.471233 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:46:32.471215    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ae06f6fb-745b-4a79-b460-344876ad6125-istio-podinfo\") pod \"e2e-derive-8be8a357-openshift-default-6dfb5b66ff-cv68t\" (UID: \"ae06f6fb-745b-4a79-b460-344876ad6125\") " pod="openshift-ingress/e2e-derive-8be8a357-openshift-default-6dfb5b66ff-cv68t"
Jul 23 16:46:32.477282 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:46:32.477252    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ae06f6fb-745b-4a79-b460-344876ad6125-istio-token\") pod \"e2e-derive-8be8a357-openshift-default-6dfb5b66ff-cv68t\" (UID: \"ae06f6fb-745b-4a79-b460-344876ad6125\") " pod="openshift-ingress/e2e-derive-8be8a357-openshift-default-6dfb5b66ff-cv68t"
Jul 23 16:46:32.477411 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:46:32.477372    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-68wgb\" (UniqueName: \"kubernetes.io/projected/ae06f6fb-745b-4a79-b460-344876ad6125-kube-api-access-68wgb\") pod \"e2e-derive-8be8a357-openshift-default-6dfb5b66ff-cv68t\" (UID: \"ae06f6fb-745b-4a79-b460-344876ad6125\") " pod="openshift-ingress/e2e-derive-8be8a357-openshift-default-6dfb5b66ff-cv68t"
Jul 23 16:46:32.665410 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:46:32.665378    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-8be8a357-openshift-default-6dfb5b66ff-cv68t"
Jul 23 16:46:32.820557 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:46:32.820521    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-8be8a357-openshift-default-6dfb5b66ff-cv68t"]
Jul 23 16:46:32.821436 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:46:32.821398    2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podae06f6fb_745b_4a79_b460_344876ad6125.slice/crio-89047ef9cb80240e39c0e69fe07472963345bbd50311e7ab3e6ab2e3f9976a3e WatchSource:0}: Error finding container 89047ef9cb80240e39c0e69fe07472963345bbd50311e7ab3e6ab2e3f9976a3e: Status 404 returned error can't find the container with id 89047ef9cb80240e39c0e69fe07472963345bbd50311e7ab3e6ab2e3f9976a3e
Jul 23 16:46:32.823620 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:46:32.823586    2553 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 23 16:46:32.823708 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:46:32.823662    2553 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 23 16:46:32.823708 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:46:32.823698    2553 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 23 16:46:33.112533 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:46:33.112435    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-8be8a357-openshift-default-6dfb5b66ff-cv68t" event={"ID":"ae06f6fb-745b-4a79-b460-344876ad6125","Type":"ContainerStarted","Data":"9ce4d2a6190e8c55b2ed835164017bac6aa57e24d4177b339293d2f811eb479a"}
Jul 23 16:46:33.112533 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:46:33.112497    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-8be8a357-openshift-default-6dfb5b66ff-cv68t" event={"ID":"ae06f6fb-745b-4a79-b460-344876ad6125","Type":"ContainerStarted","Data":"89047ef9cb80240e39c0e69fe07472963345bbd50311e7ab3e6ab2e3f9976a3e"}
Jul 23 16:46:33.143187 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:46:33.140642    2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-derive-8be8a357-openshift-default-6dfb5b66ff-cv68t" podStartSLOduration=1.140620014 podStartE2EDuration="1.140620014s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 16:46:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 16:46:33.136891746 +0000 UTC m=+1875.001497875" watchObservedRunningTime="2026-07-23 16:46:33.140620014 +0000 UTC m=+1875.005226143"
Jul 23 16:46:33.666511 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:46:33.666470    2553 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-8be8a357-openshift-default-6dfb5b66ff-cv68t"
Jul 23 16:46:33.671610 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:46:33.671584    2553 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-8be8a357-openshift-default-6dfb5b66ff-cv68t"
Jul 23 16:46:34.118306 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:46:34.118219    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-8be8a357-openshift-default-6dfb5b66ff-cv68t"
Jul 23 16:46:34.119080 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:46:34.119060    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-8be8a357-openshift-default-6dfb5b66ff-cv68t"
Jul 23 16:46:36.795728 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:46:36.795702    2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-8d7afb36-openshift-default-5699c46f9c-8k664"
Jul 23 16:46:36.810116 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:46:36.810038    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1b861fa8-4ff6-422f-af86-53778f25eedc-credential-socket\") pod \"1b861fa8-4ff6-422f-af86-53778f25eedc\" (UID: \"1b861fa8-4ff6-422f-af86-53778f25eedc\") "
Jul 23 16:46:36.810116 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:46:36.810078    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1b861fa8-4ff6-422f-af86-53778f25eedc-istio-podinfo\") pod \"1b861fa8-4ff6-422f-af86-53778f25eedc\" (UID: \"1b861fa8-4ff6-422f-af86-53778f25eedc\") "
Jul 23 16:46:36.810116 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:46:36.810100    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1b861fa8-4ff6-422f-af86-53778f25eedc-workload-certs\") pod \"1b861fa8-4ff6-422f-af86-53778f25eedc\" (UID: \"1b861fa8-4ff6-422f-af86-53778f25eedc\") "
Jul 23 16:46:36.810426 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:46:36.810131    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1b861fa8-4ff6-422f-af86-53778f25eedc-istio-data\") pod \"1b861fa8-4ff6-422f-af86-53778f25eedc\" (UID: \"1b861fa8-4ff6-422f-af86-53778f25eedc\") "
Jul 23 16:46:36.810426 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:46:36.810181    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1b861fa8-4ff6-422f-af86-53778f25eedc-workload-socket\") pod \"1b861fa8-4ff6-422f-af86-53778f25eedc\" (UID: \"1b861fa8-4ff6-422f-af86-53778f25eedc\") "
Jul 23 16:46:36.810426 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:46:36.810251    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1b861fa8-4ff6-422f-af86-53778f25eedc-istiod-ca-cert\") pod \"1b861fa8-4ff6-422f-af86-53778f25eedc\" (UID: \"1b861fa8-4ff6-422f-af86-53778f25eedc\") "
Jul 23 16:46:36.810426 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:46:36.810292    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fnsbk\" (UniqueName: \"kubernetes.io/projected/1b861fa8-4ff6-422f-af86-53778f25eedc-kube-api-access-fnsbk\") pod \"1b861fa8-4ff6-422f-af86-53778f25eedc\" (UID: \"1b861fa8-4ff6-422f-af86-53778f25eedc\") "
Jul 23 16:46:36.810426 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:46:36.810353    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1b861fa8-4ff6-422f-af86-53778f25eedc-istio-token\") pod \"1b861fa8-4ff6-422f-af86-53778f25eedc\" (UID: \"1b861fa8-4ff6-422f-af86-53778f25eedc\") "
Jul 23 16:46:36.810426 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:46:36.810385    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1b861fa8-4ff6-422f-af86-53778f25eedc-istio-envoy\") pod \"1b861fa8-4ff6-422f-af86-53778f25eedc\" (UID: \"1b861fa8-4ff6-422f-af86-53778f25eedc\") "
Jul 23 16:46:36.810426 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:46:36.810411    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1b861fa8-4ff6-422f-af86-53778f25eedc-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "1b861fa8-4ff6-422f-af86-53778f25eedc" (UID: "1b861fa8-4ff6-422f-af86-53778f25eedc"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 16:46:36.810790 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:46:36.810671    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1b861fa8-4ff6-422f-af86-53778f25eedc-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "1b861fa8-4ff6-422f-af86-53778f25eedc" (UID: "1b861fa8-4ff6-422f-af86-53778f25eedc"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 23 16:46:36.810790 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:46:36.810677    2553 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1b861fa8-4ff6-422f-af86-53778f25eedc-workload-certs\") on node \"ip-10-0-143-166.ec2.internal\" DevicePath \"\""
Jul 23 16:46:36.810961 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:46:36.810923    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1b861fa8-4ff6-422f-af86-53778f25eedc-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "1b861fa8-4ff6-422f-af86-53778f25eedc" (UID: "1b861fa8-4ff6-422f-af86-53778f25eedc"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 16:46:36.811325 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:46:36.811291    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1b861fa8-4ff6-422f-af86-53778f25eedc-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "1b861fa8-4ff6-422f-af86-53778f25eedc" (UID: "1b861fa8-4ff6-422f-af86-53778f25eedc"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 16:46:36.811753 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:46:36.811711    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1b861fa8-4ff6-422f-af86-53778f25eedc-istio-data" (OuterVolumeSpecName: "istio-data") pod "1b861fa8-4ff6-422f-af86-53778f25eedc" (UID: "1b861fa8-4ff6-422f-af86-53778f25eedc"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 16:46:36.812852 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:46:36.812719    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/1b861fa8-4ff6-422f-af86-53778f25eedc-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "1b861fa8-4ff6-422f-af86-53778f25eedc" (UID: "1b861fa8-4ff6-422f-af86-53778f25eedc"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 23 16:46:36.813240 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:46:36.813197    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1b861fa8-4ff6-422f-af86-53778f25eedc-istio-token" (OuterVolumeSpecName: "istio-token") pod "1b861fa8-4ff6-422f-af86-53778f25eedc" (UID: "1b861fa8-4ff6-422f-af86-53778f25eedc"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 16:46:36.813991 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:46:36.813800    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1b861fa8-4ff6-422f-af86-53778f25eedc-kube-api-access-fnsbk" (OuterVolumeSpecName: "kube-api-access-fnsbk") pod "1b861fa8-4ff6-422f-af86-53778f25eedc" (UID: "1b861fa8-4ff6-422f-af86-53778f25eedc"). InnerVolumeSpecName "kube-api-access-fnsbk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 16:46:36.814100 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:46:36.814025    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1b861fa8-4ff6-422f-af86-53778f25eedc-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "1b861fa8-4ff6-422f-af86-53778f25eedc" (UID: "1b861fa8-4ff6-422f-af86-53778f25eedc"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 16:46:36.911820 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:46:36.911781    2553 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1b861fa8-4ff6-422f-af86-53778f25eedc-istio-token\") on node \"ip-10-0-143-166.ec2.internal\" DevicePath \"\""
Jul 23 16:46:36.911820 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:46:36.911813    2553 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1b861fa8-4ff6-422f-af86-53778f25eedc-istio-envoy\") on node \"ip-10-0-143-166.ec2.internal\" DevicePath \"\""
Jul 23 16:46:36.911820 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:46:36.911826    2553 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1b861fa8-4ff6-422f-af86-53778f25eedc-credential-socket\") on node \"ip-10-0-143-166.ec2.internal\" DevicePath \"\""
Jul 23 16:46:36.912078 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:46:36.911838    2553 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1b861fa8-4ff6-422f-af86-53778f25eedc-istio-podinfo\") on node \"ip-10-0-143-166.ec2.internal\" DevicePath \"\""
Jul 23 16:46:36.912078 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:46:36.911850    2553 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1b861fa8-4ff6-422f-af86-53778f25eedc-istio-data\") on node \"ip-10-0-143-166.ec2.internal\" DevicePath \"\""
Jul 23 16:46:36.912078 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:46:36.911862    2553 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1b861fa8-4ff6-422f-af86-53778f25eedc-workload-socket\") on node \"ip-10-0-143-166.ec2.internal\" DevicePath \"\""
Jul 23 16:46:36.912078 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:46:36.911872    2553 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1b861fa8-4ff6-422f-af86-53778f25eedc-istiod-ca-cert\") on node \"ip-10-0-143-166.ec2.internal\" DevicePath \"\""
Jul 23 16:46:36.912078 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:46:36.911883    2553 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fnsbk\" (UniqueName: \"kubernetes.io/projected/1b861fa8-4ff6-422f-af86-53778f25eedc-kube-api-access-fnsbk\") on node \"ip-10-0-143-166.ec2.internal\" DevicePath \"\""
Jul 23 16:46:37.135060 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:46:37.134973    2553 generic.go:356] "Generic (PLEG): container finished" podID="1b861fa8-4ff6-422f-af86-53778f25eedc" containerID="38ea1aed11ca7b79276939f5a6904f5f74076108c21eb96c7d7dd5b35de0b41e" exitCode=0
Jul 23 16:46:37.135060 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:46:37.135013    2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-8d7afb36-openshift-default-5699c46f9c-8k664"
Jul 23 16:46:37.135274 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:46:37.135058    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-8d7afb36-openshift-default-5699c46f9c-8k664" event={"ID":"1b861fa8-4ff6-422f-af86-53778f25eedc","Type":"ContainerDied","Data":"38ea1aed11ca7b79276939f5a6904f5f74076108c21eb96c7d7dd5b35de0b41e"}
Jul 23 16:46:37.135274 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:46:37.135111    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-8d7afb36-openshift-default-5699c46f9c-8k664" event={"ID":"1b861fa8-4ff6-422f-af86-53778f25eedc","Type":"ContainerDied","Data":"0c1cf0525f37c14925ade013aab5142ee5fc7d545dea4cd7c480dfe229b9a62f"}
Jul 23 16:46:37.135274 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:46:37.135136    2553 scope.go:117] "RemoveContainer" containerID="38ea1aed11ca7b79276939f5a6904f5f74076108c21eb96c7d7dd5b35de0b41e"
Jul 23 16:46:37.144756 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:46:37.144734    2553 scope.go:117] "RemoveContainer" containerID="0dba262f2a6d403a52134cd0c395cbb4e565bff5a6ec3733c3a8a9e77ed9d658"
Jul 23 16:46:37.153177 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:46:37.153148    2553 scope.go:117] "RemoveContainer" containerID="38ea1aed11ca7b79276939f5a6904f5f74076108c21eb96c7d7dd5b35de0b41e"
Jul 23 16:46:37.153452 ip-10-0-143-166 kubenswrapper[2553]: E0723 16:46:37.153433    2553 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"38ea1aed11ca7b79276939f5a6904f5f74076108c21eb96c7d7dd5b35de0b41e\": container with ID starting with 38ea1aed11ca7b79276939f5a6904f5f74076108c21eb96c7d7dd5b35de0b41e not found: ID does not exist" containerID="38ea1aed11ca7b79276939f5a6904f5f74076108c21eb96c7d7dd5b35de0b41e"
Jul 23 16:46:37.153506 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:46:37.153463    2553 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"38ea1aed11ca7b79276939f5a6904f5f74076108c21eb96c7d7dd5b35de0b41e"} err="failed to get container status \"38ea1aed11ca7b79276939f5a6904f5f74076108c21eb96c7d7dd5b35de0b41e\": rpc error: code = NotFound desc = could not find container \"38ea1aed11ca7b79276939f5a6904f5f74076108c21eb96c7d7dd5b35de0b41e\": container with ID starting with 38ea1aed11ca7b79276939f5a6904f5f74076108c21eb96c7d7dd5b35de0b41e not found: ID does not exist"
Jul 23 16:46:37.153506 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:46:37.153482    2553 scope.go:117] "RemoveContainer" containerID="0dba262f2a6d403a52134cd0c395cbb4e565bff5a6ec3733c3a8a9e77ed9d658"
Jul 23 16:46:37.153715 ip-10-0-143-166 kubenswrapper[2553]: E0723 16:46:37.153701    2553 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0dba262f2a6d403a52134cd0c395cbb4e565bff5a6ec3733c3a8a9e77ed9d658\": container with ID starting with 0dba262f2a6d403a52134cd0c395cbb4e565bff5a6ec3733c3a8a9e77ed9d658 not found: ID does not exist" containerID="0dba262f2a6d403a52134cd0c395cbb4e565bff5a6ec3733c3a8a9e77ed9d658"
Jul 23 16:46:37.153752 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:46:37.153719    2553 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0dba262f2a6d403a52134cd0c395cbb4e565bff5a6ec3733c3a8a9e77ed9d658"} err="failed to get container status \"0dba262f2a6d403a52134cd0c395cbb4e565bff5a6ec3733c3a8a9e77ed9d658\": rpc error: code = NotFound desc = could not find container \"0dba262f2a6d403a52134cd0c395cbb4e565bff5a6ec3733c3a8a9e77ed9d658\": container with ID starting with 0dba262f2a6d403a52134cd0c395cbb4e565bff5a6ec3733c3a8a9e77ed9d658 not found: ID does not exist"
Jul 23 16:46:37.158577 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:46:37.158555    2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-8d7afb36-openshift-default-5699c46f9c-8k664"]
Jul 23 16:46:37.162326 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:46:37.162304    2553 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-8d7afb36-openshift-default-5699c46f9c-8k664"]
Jul 23 16:46:38.674938 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:46:38.674907    2553 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1b861fa8-4ff6-422f-af86-53778f25eedc" path="/var/lib/kubelet/pods/1b861fa8-4ff6-422f-af86-53778f25eedc/volumes"
Jul 23 16:46:48.196691 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:46:48.196657    2553 generic.go:356] "Generic (PLEG): container finished" podID="ae06f6fb-745b-4a79-b460-344876ad6125" containerID="9ce4d2a6190e8c55b2ed835164017bac6aa57e24d4177b339293d2f811eb479a" exitCode=0
Jul 23 16:46:48.197131 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:46:48.196732    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-8be8a357-openshift-default-6dfb5b66ff-cv68t" event={"ID":"ae06f6fb-745b-4a79-b460-344876ad6125","Type":"ContainerDied","Data":"9ce4d2a6190e8c55b2ed835164017bac6aa57e24d4177b339293d2f811eb479a"}
Jul 23 16:46:48.197131 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:46:48.197116    2553 scope.go:117] "RemoveContainer" containerID="9ce4d2a6190e8c55b2ed835164017bac6aa57e24d4177b339293d2f811eb479a"
Jul 23 16:46:48.198113 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:46:48.198087    2553 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 23 16:46:48.198177 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:46:48.198153    2553 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 23 16:46:48.198220 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:46:48.198203    2553 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 23 16:46:49.118657 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:46:49.118604    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-8be8a357-openshift-default-6dfb5b66ff-cv68t"
Jul 23 16:46:49.203361 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:46:49.203326    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-8be8a357-openshift-default-6dfb5b66ff-cv68t" event={"ID":"ae06f6fb-745b-4a79-b460-344876ad6125","Type":"ContainerStarted","Data":"c27d462dbef49f9eeb77a15635e20773f368971163270955a83c467096c25396"}
Jul 23 16:46:49.666327 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:46:49.666287    2553 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-8be8a357-openshift-default-6dfb5b66ff-cv68t"
Jul 23 16:46:49.667515 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:46:49.667489    2553 patch_prober.go:28] interesting pod/e2e-derive-8be8a357-openshift-default-6dfb5b66ff-cv68t container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.53:15021/healthz/ready\": dial tcp 10.132.0.53:15021: connect: connection refused" start-of-body=
Jul 23 16:46:49.667636 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:46:49.667538    2553 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-8be8a357-openshift-default-6dfb5b66ff-cv68t" podUID="ae06f6fb-745b-4a79-b460-344876ad6125" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.53:15021/healthz/ready\": dial tcp 10.132.0.53:15021: connect: connection refused"
Jul 23 16:46:50.666345 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:46:50.666301    2553 patch_prober.go:28] interesting pod/e2e-derive-8be8a357-openshift-default-6dfb5b66ff-cv68t container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.53:15021/healthz/ready\": dial tcp 10.132.0.53:15021: connect: connection refused" start-of-body=
Jul 23 16:46:50.666746 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:46:50.666360    2553 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-8be8a357-openshift-default-6dfb5b66ff-cv68t" podUID="ae06f6fb-745b-4a79-b460-344876ad6125" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.53:15021/healthz/ready\": dial tcp 10.132.0.53:15021: connect: connection refused"
Jul 23 16:46:51.666645 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:46:51.666610    2553 patch_prober.go:28] interesting pod/e2e-derive-8be8a357-openshift-default-6dfb5b66ff-cv68t container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.53:15021/healthz/ready\": dial tcp 10.132.0.53:15021: connect: connection refused" start-of-body=
Jul 23 16:46:51.667058 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:46:51.666679    2553 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-8be8a357-openshift-default-6dfb5b66ff-cv68t" podUID="ae06f6fb-745b-4a79-b460-344876ad6125" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.53:15021/healthz/ready\": dial tcp 10.132.0.53:15021: connect: connection refused"
Jul 23 16:46:52.666130 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:46:52.666086    2553 patch_prober.go:28] interesting pod/e2e-derive-8be8a357-openshift-default-6dfb5b66ff-cv68t container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.53:15021/healthz/ready\": dial tcp 10.132.0.53:15021: connect: connection refused" start-of-body=
Jul 23 16:46:52.666345 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:46:52.666145    2553 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-8be8a357-openshift-default-6dfb5b66ff-cv68t" podUID="ae06f6fb-745b-4a79-b460-344876ad6125" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.53:15021/healthz/ready\": dial tcp 10.132.0.53:15021: connect: connection refused"
Jul 23 16:46:53.669589 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:46:53.669559    2553 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-8be8a357-openshift-default-6dfb5b66ff-cv68t"
Jul 23 16:46:53.669996 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:46:53.669839    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-8be8a357-openshift-default-6dfb5b66ff-cv68t"
Jul 23 16:46:53.670603 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:46:53.670582    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-8be8a357-openshift-default-6dfb5b66ff-cv68t"
Jul 23 16:46:59.440418 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:46:59.440386    2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-8be8a357-bds65"]
Jul 23 16:46:59.440906 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:46:59.440787    2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1b861fa8-4ff6-422f-af86-53778f25eedc" containerName="istio-proxy"
Jul 23 16:46:59.440906 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:46:59.440801    2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="1b861fa8-4ff6-422f-af86-53778f25eedc" containerName="istio-proxy"
Jul 23 16:46:59.440906 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:46:59.440813    2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1b861fa8-4ff6-422f-af86-53778f25eedc" containerName="istio-proxy"
Jul 23 16:46:59.440906 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:46:59.440820    2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="1b861fa8-4ff6-422f-af86-53778f25eedc" containerName="istio-proxy"
Jul 23 16:46:59.440906 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:46:59.440895    2553 memory_manager.go:368] "RemoveStaleState removing state" podUID="1b861fa8-4ff6-422f-af86-53778f25eedc" containerName="istio-proxy"
Jul 23 16:46:59.440906 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:46:59.440905    2553 memory_manager.go:368] "RemoveStaleState removing state" podUID="1b861fa8-4ff6-422f-af86-53778f25eedc" containerName="istio-proxy"
Jul 23 16:46:59.443988 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:46:59.443971    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-8be8a357-bds65"
Jul 23 16:46:59.446710 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:46:59.446685    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-plqcf\""
Jul 23 16:46:59.446852 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:46:59.446692    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 23 16:46:59.451518 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:46:59.451493    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-8be8a357-bds65"]
Jul 23 16:46:59.515190 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:46:59.515131    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/90e17ff8-9d48-4cbb-bc54-db7d6002bbfc-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-8be8a357-bds65\" (UID: \"90e17ff8-9d48-4cbb-bc54-db7d6002bbfc\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-8be8a357-bds65"
Jul 23 16:46:59.615957 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:46:59.615920    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/90e17ff8-9d48-4cbb-bc54-db7d6002bbfc-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-8be8a357-bds65\" (UID: \"90e17ff8-9d48-4cbb-bc54-db7d6002bbfc\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-8be8a357-bds65"
Jul 23 16:46:59.616601 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:46:59.616583    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/90e17ff8-9d48-4cbb-bc54-db7d6002bbfc-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-8be8a357-bds65\" (UID: \"90e17ff8-9d48-4cbb-bc54-db7d6002bbfc\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-8be8a357-bds65"
Jul 23 16:46:59.756346 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:46:59.756255    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-8be8a357-bds65"
Jul 23 16:46:59.893686 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:46:59.893652    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-8be8a357-bds65"]
Jul 23 16:46:59.894127 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:46:59.894099    2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod90e17ff8_9d48_4cbb_bc54_db7d6002bbfc.slice/crio-803f1cab7be6902eea440cfc6c5ec7ffbe7af36ea8c75f15f534661072798c08 WatchSource:0}: Error finding container 803f1cab7be6902eea440cfc6c5ec7ffbe7af36ea8c75f15f534661072798c08: Status 404 returned error can't find the container with id 803f1cab7be6902eea440cfc6c5ec7ffbe7af36ea8c75f15f534661072798c08
Jul 23 16:47:00.262218 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:47:00.262183    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-8be8a357-bds65" event={"ID":"90e17ff8-9d48-4cbb-bc54-db7d6002bbfc","Type":"ContainerStarted","Data":"7d20e5a85f0518827a26da06276c700701d7770457a6a6136e2beaf7c7149a7d"}
Jul 23 16:47:00.262413 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:47:00.262236    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-8be8a357-bds65" event={"ID":"90e17ff8-9d48-4cbb-bc54-db7d6002bbfc","Type":"ContainerStarted","Data":"803f1cab7be6902eea440cfc6c5ec7ffbe7af36ea8c75f15f534661072798c08"}
Jul 23 16:47:00.279339 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:47:00.279279    2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-8be8a357-bds65" podStartSLOduration=1.2792648149999999 podStartE2EDuration="1.279264815s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 16:46:59 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 16:47:00.276194692 +0000 UTC m=+1902.140800822" watchObservedRunningTime="2026-07-23 16:47:00.279264815 +0000 UTC m=+1902.143870943"
Jul 23 16:47:01.268942 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:47:01.268911    2553 generic.go:356] "Generic (PLEG): container finished" podID="90e17ff8-9d48-4cbb-bc54-db7d6002bbfc" containerID="7d20e5a85f0518827a26da06276c700701d7770457a6a6136e2beaf7c7149a7d" exitCode=0
Jul 23 16:47:01.269409 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:47:01.268959    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-8be8a357-bds65" event={"ID":"90e17ff8-9d48-4cbb-bc54-db7d6002bbfc","Type":"ContainerDied","Data":"7d20e5a85f0518827a26da06276c700701d7770457a6a6136e2beaf7c7149a7d"}
Jul 23 16:47:02.421028 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:47:02.421004    2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-8be8a357-bds65"
Jul 23 16:47:02.541873 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:47:02.541780    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/90e17ff8-9d48-4cbb-bc54-db7d6002bbfc-maas-api-service-ca\") pod \"90e17ff8-9d48-4cbb-bc54-db7d6002bbfc\" (UID: \"90e17ff8-9d48-4cbb-bc54-db7d6002bbfc\") "
Jul 23 16:47:02.542151 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:47:02.542128    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/90e17ff8-9d48-4cbb-bc54-db7d6002bbfc-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "90e17ff8-9d48-4cbb-bc54-db7d6002bbfc" (UID: "90e17ff8-9d48-4cbb-bc54-db7d6002bbfc"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 23 16:47:02.642722 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:47:02.642678    2553 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/90e17ff8-9d48-4cbb-bc54-db7d6002bbfc-maas-api-service-ca\") on node \"ip-10-0-143-166.ec2.internal\" DevicePath \"\""
Jul 23 16:47:03.280498 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:47:03.280465    2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-8be8a357-bds65"
Jul 23 16:47:03.280498 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:47:03.280492    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-8be8a357-bds65" event={"ID":"90e17ff8-9d48-4cbb-bc54-db7d6002bbfc","Type":"ContainerDied","Data":"803f1cab7be6902eea440cfc6c5ec7ffbe7af36ea8c75f15f534661072798c08"}
Jul 23 16:47:03.280715 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:47:03.280570    2553 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="803f1cab7be6902eea440cfc6c5ec7ffbe7af36ea8c75f15f534661072798c08"
Jul 23 16:47:14.516918 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:47:14.516873    2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-8be8a357-bds65"]
Jul 23 16:47:14.519507 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:47:14.519477    2553 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-8be8a357-bds65"]
Jul 23 16:47:14.662041 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:47:14.662007    2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-8be8a357-openshift-default-6dfb5b66ff-cv68t"]
Jul 23 16:47:14.662296 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:47:14.662248    2553 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-derive-8be8a357-openshift-default-6dfb5b66ff-cv68t" podUID="ae06f6fb-745b-4a79-b460-344876ad6125" containerName="istio-proxy" containerID="cri-o://c27d462dbef49f9eeb77a15635e20773f368971163270955a83c467096c25396" gracePeriod=30
Jul 23 16:47:14.674854 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:47:14.674824    2553 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="90e17ff8-9d48-4cbb-bc54-db7d6002bbfc" path="/var/lib/kubelet/pods/90e17ff8-9d48-4cbb-bc54-db7d6002bbfc/volumes"
Jul 23 16:47:19.908427 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:47:19.908400    2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-8be8a357-openshift-default-6dfb5b66ff-cv68t"
Jul 23 16:47:20.096008 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:47:20.095897    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ae06f6fb-745b-4a79-b460-344876ad6125-workload-certs\") pod \"ae06f6fb-745b-4a79-b460-344876ad6125\" (UID: \"ae06f6fb-745b-4a79-b460-344876ad6125\") "
Jul 23 16:47:20.096008 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:47:20.095949    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ae06f6fb-745b-4a79-b460-344876ad6125-istio-data\") pod \"ae06f6fb-745b-4a79-b460-344876ad6125\" (UID: \"ae06f6fb-745b-4a79-b460-344876ad6125\") "
Jul 23 16:47:20.096008 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:47:20.095967    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ae06f6fb-745b-4a79-b460-344876ad6125-istio-envoy\") pod \"ae06f6fb-745b-4a79-b460-344876ad6125\" (UID: \"ae06f6fb-745b-4a79-b460-344876ad6125\") "
Jul 23 16:47:20.096008 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:47:20.095988    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ae06f6fb-745b-4a79-b460-344876ad6125-credential-socket\") pod \"ae06f6fb-745b-4a79-b460-344876ad6125\" (UID: \"ae06f6fb-745b-4a79-b460-344876ad6125\") "
Jul 23 16:47:20.096008 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:47:20.096015    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ae06f6fb-745b-4a79-b460-344876ad6125-istio-podinfo\") pod \"ae06f6fb-745b-4a79-b460-344876ad6125\" (UID: \"ae06f6fb-745b-4a79-b460-344876ad6125\") "
Jul 23 16:47:20.096473 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:47:20.096035    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ae06f6fb-745b-4a79-b460-344876ad6125-workload-socket\") pod \"ae06f6fb-745b-4a79-b460-344876ad6125\" (UID: \"ae06f6fb-745b-4a79-b460-344876ad6125\") "
Jul 23 16:47:20.096473 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:47:20.096219    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ae06f6fb-745b-4a79-b460-344876ad6125-istio-token\") pod \"ae06f6fb-745b-4a79-b460-344876ad6125\" (UID: \"ae06f6fb-745b-4a79-b460-344876ad6125\") "
Jul 23 16:47:20.096473 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:47:20.096323    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ae06f6fb-745b-4a79-b460-344876ad6125-istiod-ca-cert\") pod \"ae06f6fb-745b-4a79-b460-344876ad6125\" (UID: \"ae06f6fb-745b-4a79-b460-344876ad6125\") "
Jul 23 16:47:20.096473 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:47:20.096342    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ae06f6fb-745b-4a79-b460-344876ad6125-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "ae06f6fb-745b-4a79-b460-344876ad6125" (UID: "ae06f6fb-745b-4a79-b460-344876ad6125"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 16:47:20.096473 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:47:20.096354    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-68wgb\" (UniqueName: \"kubernetes.io/projected/ae06f6fb-745b-4a79-b460-344876ad6125-kube-api-access-68wgb\") pod \"ae06f6fb-745b-4a79-b460-344876ad6125\" (UID: \"ae06f6fb-745b-4a79-b460-344876ad6125\") "
Jul 23 16:47:20.096473 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:47:20.096417    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ae06f6fb-745b-4a79-b460-344876ad6125-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "ae06f6fb-745b-4a79-b460-344876ad6125" (UID: "ae06f6fb-745b-4a79-b460-344876ad6125"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 16:47:20.096779 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:47:20.096580    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ae06f6fb-745b-4a79-b460-344876ad6125-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "ae06f6fb-745b-4a79-b460-344876ad6125" (UID: "ae06f6fb-745b-4a79-b460-344876ad6125"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 16:47:20.096779 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:47:20.096691    2553 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ae06f6fb-745b-4a79-b460-344876ad6125-workload-certs\") on node \"ip-10-0-143-166.ec2.internal\" DevicePath \"\""
Jul 23 16:47:20.096779 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:47:20.096711    2553 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ae06f6fb-745b-4a79-b460-344876ad6125-credential-socket\") on node \"ip-10-0-143-166.ec2.internal\" DevicePath \"\""
Jul 23 16:47:20.096779 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:47:20.096725    2553 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ae06f6fb-745b-4a79-b460-344876ad6125-workload-socket\") on node \"ip-10-0-143-166.ec2.internal\" DevicePath \"\""
Jul 23 16:47:20.096779 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:47:20.096755    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ae06f6fb-745b-4a79-b460-344876ad6125-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "ae06f6fb-745b-4a79-b460-344876ad6125" (UID: "ae06f6fb-745b-4a79-b460-344876ad6125"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 23 16:47:20.096978 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:47:20.096808    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ae06f6fb-745b-4a79-b460-344876ad6125-istio-data" (OuterVolumeSpecName: "istio-data") pod "ae06f6fb-745b-4a79-b460-344876ad6125" (UID: "ae06f6fb-745b-4a79-b460-344876ad6125"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 16:47:20.098368 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:47:20.098339    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/ae06f6fb-745b-4a79-b460-344876ad6125-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "ae06f6fb-745b-4a79-b460-344876ad6125" (UID: "ae06f6fb-745b-4a79-b460-344876ad6125"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 23 16:47:20.098469 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:47:20.098376    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ae06f6fb-745b-4a79-b460-344876ad6125-istio-token" (OuterVolumeSpecName: "istio-token") pod "ae06f6fb-745b-4a79-b460-344876ad6125" (UID: "ae06f6fb-745b-4a79-b460-344876ad6125"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 16:47:20.098616 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:47:20.098604    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ae06f6fb-745b-4a79-b460-344876ad6125-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "ae06f6fb-745b-4a79-b460-344876ad6125" (UID: "ae06f6fb-745b-4a79-b460-344876ad6125"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 16:47:20.098791 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:47:20.098769    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ae06f6fb-745b-4a79-b460-344876ad6125-kube-api-access-68wgb" (OuterVolumeSpecName: "kube-api-access-68wgb") pod "ae06f6fb-745b-4a79-b460-344876ad6125" (UID: "ae06f6fb-745b-4a79-b460-344876ad6125"). InnerVolumeSpecName "kube-api-access-68wgb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 16:47:20.197415 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:47:20.197377    2553 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ae06f6fb-745b-4a79-b460-344876ad6125-istio-podinfo\") on node \"ip-10-0-143-166.ec2.internal\" DevicePath \"\""
Jul 23 16:47:20.197415 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:47:20.197406    2553 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ae06f6fb-745b-4a79-b460-344876ad6125-istio-token\") on node \"ip-10-0-143-166.ec2.internal\" DevicePath \"\""
Jul 23 16:47:20.197415 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:47:20.197415    2553 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ae06f6fb-745b-4a79-b460-344876ad6125-istiod-ca-cert\") on node \"ip-10-0-143-166.ec2.internal\" DevicePath \"\""
Jul 23 16:47:20.197415 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:47:20.197423    2553 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-68wgb\" (UniqueName: \"kubernetes.io/projected/ae06f6fb-745b-4a79-b460-344876ad6125-kube-api-access-68wgb\") on node \"ip-10-0-143-166.ec2.internal\" DevicePath \"\""
Jul 23 16:47:20.197672 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:47:20.197434    2553 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ae06f6fb-745b-4a79-b460-344876ad6125-istio-data\") on node \"ip-10-0-143-166.ec2.internal\" DevicePath \"\""
Jul 23 16:47:20.197672 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:47:20.197442    2553 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ae06f6fb-745b-4a79-b460-344876ad6125-istio-envoy\") on node \"ip-10-0-143-166.ec2.internal\" DevicePath \"\""
Jul 23 16:47:20.378991 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:47:20.378893    2553 generic.go:356] "Generic (PLEG): container finished" podID="ae06f6fb-745b-4a79-b460-344876ad6125" containerID="c27d462dbef49f9eeb77a15635e20773f368971163270955a83c467096c25396" exitCode=0
Jul 23 16:47:20.378991 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:47:20.378950    2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-8be8a357-openshift-default-6dfb5b66ff-cv68t"
Jul 23 16:47:20.379223 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:47:20.378986    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-8be8a357-openshift-default-6dfb5b66ff-cv68t" event={"ID":"ae06f6fb-745b-4a79-b460-344876ad6125","Type":"ContainerDied","Data":"c27d462dbef49f9eeb77a15635e20773f368971163270955a83c467096c25396"}
Jul 23 16:47:20.379223 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:47:20.379061    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-8be8a357-openshift-default-6dfb5b66ff-cv68t" event={"ID":"ae06f6fb-745b-4a79-b460-344876ad6125","Type":"ContainerDied","Data":"89047ef9cb80240e39c0e69fe07472963345bbd50311e7ab3e6ab2e3f9976a3e"}
Jul 23 16:47:20.379223 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:47:20.379088    2553 scope.go:117] "RemoveContainer" containerID="c27d462dbef49f9eeb77a15635e20773f368971163270955a83c467096c25396"
Jul 23 16:47:20.390597 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:47:20.390563    2553 scope.go:117] "RemoveContainer" containerID="9ce4d2a6190e8c55b2ed835164017bac6aa57e24d4177b339293d2f811eb479a"
Jul 23 16:47:20.399188 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:47:20.399140    2553 scope.go:117] "RemoveContainer" containerID="c27d462dbef49f9eeb77a15635e20773f368971163270955a83c467096c25396"
Jul 23 16:47:20.399437 ip-10-0-143-166 kubenswrapper[2553]: E0723 16:47:20.399417    2553 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c27d462dbef49f9eeb77a15635e20773f368971163270955a83c467096c25396\": container with ID starting with c27d462dbef49f9eeb77a15635e20773f368971163270955a83c467096c25396 not found: ID does not exist" containerID="c27d462dbef49f9eeb77a15635e20773f368971163270955a83c467096c25396"
Jul 23 16:47:20.399519 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:47:20.399449    2553 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c27d462dbef49f9eeb77a15635e20773f368971163270955a83c467096c25396"} err="failed to get container status \"c27d462dbef49f9eeb77a15635e20773f368971163270955a83c467096c25396\": rpc error: code = NotFound desc = could not find container \"c27d462dbef49f9eeb77a15635e20773f368971163270955a83c467096c25396\": container with ID starting with c27d462dbef49f9eeb77a15635e20773f368971163270955a83c467096c25396 not found: ID does not exist"
Jul 23 16:47:20.399519 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:47:20.399472    2553 scope.go:117] "RemoveContainer" containerID="9ce4d2a6190e8c55b2ed835164017bac6aa57e24d4177b339293d2f811eb479a"
Jul 23 16:47:20.399724 ip-10-0-143-166 kubenswrapper[2553]: E0723 16:47:20.399707    2553 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9ce4d2a6190e8c55b2ed835164017bac6aa57e24d4177b339293d2f811eb479a\": container with ID starting with 9ce4d2a6190e8c55b2ed835164017bac6aa57e24d4177b339293d2f811eb479a not found: ID does not exist" containerID="9ce4d2a6190e8c55b2ed835164017bac6aa57e24d4177b339293d2f811eb479a"
Jul 23 16:47:20.399767 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:47:20.399731    2553 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9ce4d2a6190e8c55b2ed835164017bac6aa57e24d4177b339293d2f811eb479a"} err="failed to get container status \"9ce4d2a6190e8c55b2ed835164017bac6aa57e24d4177b339293d2f811eb479a\": rpc error: code = NotFound desc = could not find container \"9ce4d2a6190e8c55b2ed835164017bac6aa57e24d4177b339293d2f811eb479a\": container with ID starting with 9ce4d2a6190e8c55b2ed835164017bac6aa57e24d4177b339293d2f811eb479a not found: ID does not exist"
Jul 23 16:47:20.424911 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:47:20.424883    2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-8be8a357-openshift-default-6dfb5b66ff-cv68t"]
Jul 23 16:47:20.431585 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:47:20.431559    2553 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-derive-8be8a357-openshift-default-6dfb5b66ff-cv68t"]
Jul 23 16:47:20.674389 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:47:20.674359    2553 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ae06f6fb-745b-4a79-b460-344876ad6125" path="/var/lib/kubelet/pods/ae06f6fb-745b-4a79-b460-344876ad6125/volumes"
Jul 23 16:48:54.675528 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:48:54.675496    2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-9affa933-openshift-default-9c8b9f98c-bbhwt"]
Jul 23 16:48:54.676146 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:48:54.675814    2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="90e17ff8-9d48-4cbb-bc54-db7d6002bbfc" containerName="revoke-keys"
Jul 23 16:48:54.676146 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:48:54.675825    2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="90e17ff8-9d48-4cbb-bc54-db7d6002bbfc" containerName="revoke-keys"
Jul 23 16:48:54.676146 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:48:54.675833    2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ae06f6fb-745b-4a79-b460-344876ad6125" containerName="istio-proxy"
Jul 23 16:48:54.676146 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:48:54.675840    2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="ae06f6fb-745b-4a79-b460-344876ad6125" containerName="istio-proxy"
Jul 23 16:48:54.676146 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:48:54.675897    2553 memory_manager.go:368] "RemoveStaleState removing state" podUID="ae06f6fb-745b-4a79-b460-344876ad6125" containerName="istio-proxy"
Jul 23 16:48:54.676146 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:48:54.675903    2553 memory_manager.go:368] "RemoveStaleState removing state" podUID="90e17ff8-9d48-4cbb-bc54-db7d6002bbfc" containerName="revoke-keys"
Jul 23 16:48:54.676146 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:48:54.675911    2553 memory_manager.go:368] "RemoveStaleState removing state" podUID="ae06f6fb-745b-4a79-b460-344876ad6125" containerName="istio-proxy"
Jul 23 16:48:54.678780 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:48:54.678761    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-9affa933-openshift-default-9c8b9f98c-bbhwt"
Jul 23 16:48:54.683910 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:48:54.683889    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Jul 23 16:48:54.684003 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:48:54.683938    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-9affa933-openshift-default-dockercfg-87jhm\""
Jul 23 16:48:54.711064 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:48:54.711036    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-9affa933-openshift-default-9c8b9f98c-bbhwt"]
Jul 23 16:48:54.811682 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:48:54.811633    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/72c6f88d-7ffe-45e3-aa9f-bf14b288bd77-credential-socket\") pod \"e2e-mt-9affa933-openshift-default-9c8b9f98c-bbhwt\" (UID: \"72c6f88d-7ffe-45e3-aa9f-bf14b288bd77\") " pod="openshift-ingress/e2e-mt-9affa933-openshift-default-9c8b9f98c-bbhwt"
Jul 23 16:48:54.811682 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:48:54.811689    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sd6kv\" (UniqueName: \"kubernetes.io/projected/72c6f88d-7ffe-45e3-aa9f-bf14b288bd77-kube-api-access-sd6kv\") pod \"e2e-mt-9affa933-openshift-default-9c8b9f98c-bbhwt\" (UID: \"72c6f88d-7ffe-45e3-aa9f-bf14b288bd77\") " pod="openshift-ingress/e2e-mt-9affa933-openshift-default-9c8b9f98c-bbhwt"
Jul 23 16:48:54.811946 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:48:54.811710    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/72c6f88d-7ffe-45e3-aa9f-bf14b288bd77-istio-podinfo\") pod \"e2e-mt-9affa933-openshift-default-9c8b9f98c-bbhwt\" (UID: \"72c6f88d-7ffe-45e3-aa9f-bf14b288bd77\") " pod="openshift-ingress/e2e-mt-9affa933-openshift-default-9c8b9f98c-bbhwt"
Jul 23 16:48:54.811946 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:48:54.811729    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/72c6f88d-7ffe-45e3-aa9f-bf14b288bd77-workload-certs\") pod \"e2e-mt-9affa933-openshift-default-9c8b9f98c-bbhwt\" (UID: \"72c6f88d-7ffe-45e3-aa9f-bf14b288bd77\") " pod="openshift-ingress/e2e-mt-9affa933-openshift-default-9c8b9f98c-bbhwt"
Jul 23 16:48:54.811946 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:48:54.811768    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/72c6f88d-7ffe-45e3-aa9f-bf14b288bd77-istio-envoy\") pod \"e2e-mt-9affa933-openshift-default-9c8b9f98c-bbhwt\" (UID: \"72c6f88d-7ffe-45e3-aa9f-bf14b288bd77\") " pod="openshift-ingress/e2e-mt-9affa933-openshift-default-9c8b9f98c-bbhwt"
Jul 23 16:48:54.811946 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:48:54.811820    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/72c6f88d-7ffe-45e3-aa9f-bf14b288bd77-istio-token\") pod \"e2e-mt-9affa933-openshift-default-9c8b9f98c-bbhwt\" (UID: \"72c6f88d-7ffe-45e3-aa9f-bf14b288bd77\") " pod="openshift-ingress/e2e-mt-9affa933-openshift-default-9c8b9f98c-bbhwt"
Jul 23 16:48:54.811946 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:48:54.811866    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/72c6f88d-7ffe-45e3-aa9f-bf14b288bd77-istio-data\") pod \"e2e-mt-9affa933-openshift-default-9c8b9f98c-bbhwt\" (UID: \"72c6f88d-7ffe-45e3-aa9f-bf14b288bd77\") " pod="openshift-ingress/e2e-mt-9affa933-openshift-default-9c8b9f98c-bbhwt"
Jul 23 16:48:54.811946 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:48:54.811889    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/72c6f88d-7ffe-45e3-aa9f-bf14b288bd77-workload-socket\") pod \"e2e-mt-9affa933-openshift-default-9c8b9f98c-bbhwt\" (UID: \"72c6f88d-7ffe-45e3-aa9f-bf14b288bd77\") " pod="openshift-ingress/e2e-mt-9affa933-openshift-default-9c8b9f98c-bbhwt"
Jul 23 16:48:54.811946 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:48:54.811913    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/72c6f88d-7ffe-45e3-aa9f-bf14b288bd77-istiod-ca-cert\") pod \"e2e-mt-9affa933-openshift-default-9c8b9f98c-bbhwt\" (UID: \"72c6f88d-7ffe-45e3-aa9f-bf14b288bd77\") " pod="openshift-ingress/e2e-mt-9affa933-openshift-default-9c8b9f98c-bbhwt"
Jul 23 16:48:54.912976 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:48:54.912939    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/72c6f88d-7ffe-45e3-aa9f-bf14b288bd77-istio-data\") pod \"e2e-mt-9affa933-openshift-default-9c8b9f98c-bbhwt\" (UID: \"72c6f88d-7ffe-45e3-aa9f-bf14b288bd77\") " pod="openshift-ingress/e2e-mt-9affa933-openshift-default-9c8b9f98c-bbhwt"
Jul 23 16:48:54.912976 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:48:54.912982    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/72c6f88d-7ffe-45e3-aa9f-bf14b288bd77-workload-socket\") pod \"e2e-mt-9affa933-openshift-default-9c8b9f98c-bbhwt\" (UID: \"72c6f88d-7ffe-45e3-aa9f-bf14b288bd77\") " pod="openshift-ingress/e2e-mt-9affa933-openshift-default-9c8b9f98c-bbhwt"
Jul 23 16:48:54.913267 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:48:54.913005    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/72c6f88d-7ffe-45e3-aa9f-bf14b288bd77-istiod-ca-cert\") pod \"e2e-mt-9affa933-openshift-default-9c8b9f98c-bbhwt\" (UID: \"72c6f88d-7ffe-45e3-aa9f-bf14b288bd77\") " pod="openshift-ingress/e2e-mt-9affa933-openshift-default-9c8b9f98c-bbhwt"
Jul 23 16:48:54.913267 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:48:54.913027    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/72c6f88d-7ffe-45e3-aa9f-bf14b288bd77-credential-socket\") pod \"e2e-mt-9affa933-openshift-default-9c8b9f98c-bbhwt\" (UID: \"72c6f88d-7ffe-45e3-aa9f-bf14b288bd77\") " pod="openshift-ingress/e2e-mt-9affa933-openshift-default-9c8b9f98c-bbhwt"
Jul 23 16:48:54.913267 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:48:54.913058    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sd6kv\" (UniqueName: \"kubernetes.io/projected/72c6f88d-7ffe-45e3-aa9f-bf14b288bd77-kube-api-access-sd6kv\") pod \"e2e-mt-9affa933-openshift-default-9c8b9f98c-bbhwt\" (UID: \"72c6f88d-7ffe-45e3-aa9f-bf14b288bd77\") " pod="openshift-ingress/e2e-mt-9affa933-openshift-default-9c8b9f98c-bbhwt"
Jul 23 16:48:54.913267 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:48:54.913078    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/72c6f88d-7ffe-45e3-aa9f-bf14b288bd77-istio-podinfo\") pod \"e2e-mt-9affa933-openshift-default-9c8b9f98c-bbhwt\" (UID: \"72c6f88d-7ffe-45e3-aa9f-bf14b288bd77\") " pod="openshift-ingress/e2e-mt-9affa933-openshift-default-9c8b9f98c-bbhwt"
Jul 23 16:48:54.913267 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:48:54.913104    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/72c6f88d-7ffe-45e3-aa9f-bf14b288bd77-workload-certs\") pod \"e2e-mt-9affa933-openshift-default-9c8b9f98c-bbhwt\" (UID: \"72c6f88d-7ffe-45e3-aa9f-bf14b288bd77\") " pod="openshift-ingress/e2e-mt-9affa933-openshift-default-9c8b9f98c-bbhwt"
Jul 23 16:48:54.913267 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:48:54.913157    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/72c6f88d-7ffe-45e3-aa9f-bf14b288bd77-istio-envoy\") pod \"e2e-mt-9affa933-openshift-default-9c8b9f98c-bbhwt\" (UID: \"72c6f88d-7ffe-45e3-aa9f-bf14b288bd77\") " pod="openshift-ingress/e2e-mt-9affa933-openshift-default-9c8b9f98c-bbhwt"
Jul 23 16:48:54.913267 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:48:54.913193    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/72c6f88d-7ffe-45e3-aa9f-bf14b288bd77-istio-token\") pod \"e2e-mt-9affa933-openshift-default-9c8b9f98c-bbhwt\" (UID: \"72c6f88d-7ffe-45e3-aa9f-bf14b288bd77\") " pod="openshift-ingress/e2e-mt-9affa933-openshift-default-9c8b9f98c-bbhwt"
Jul 23 16:48:54.913648 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:48:54.913513    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/72c6f88d-7ffe-45e3-aa9f-bf14b288bd77-workload-socket\") pod \"e2e-mt-9affa933-openshift-default-9c8b9f98c-bbhwt\" (UID: \"72c6f88d-7ffe-45e3-aa9f-bf14b288bd77\") " pod="openshift-ingress/e2e-mt-9affa933-openshift-default-9c8b9f98c-bbhwt"
Jul 23 16:48:54.913705 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:48:54.913667    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/72c6f88d-7ffe-45e3-aa9f-bf14b288bd77-credential-socket\") pod \"e2e-mt-9affa933-openshift-default-9c8b9f98c-bbhwt\" (UID: \"72c6f88d-7ffe-45e3-aa9f-bf14b288bd77\") " pod="openshift-ingress/e2e-mt-9affa933-openshift-default-9c8b9f98c-bbhwt"
Jul 23 16:48:54.913812 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:48:54.913789    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/72c6f88d-7ffe-45e3-aa9f-bf14b288bd77-workload-certs\") pod \"e2e-mt-9affa933-openshift-default-9c8b9f98c-bbhwt\" (UID: \"72c6f88d-7ffe-45e3-aa9f-bf14b288bd77\") " pod="openshift-ingress/e2e-mt-9affa933-openshift-default-9c8b9f98c-bbhwt"
Jul 23 16:48:54.913921 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:48:54.913905    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/72c6f88d-7ffe-45e3-aa9f-bf14b288bd77-istio-data\") pod \"e2e-mt-9affa933-openshift-default-9c8b9f98c-bbhwt\" (UID: \"72c6f88d-7ffe-45e3-aa9f-bf14b288bd77\") " pod="openshift-ingress/e2e-mt-9affa933-openshift-default-9c8b9f98c-bbhwt"
Jul 23 16:48:54.913979 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:48:54.913922    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/72c6f88d-7ffe-45e3-aa9f-bf14b288bd77-istiod-ca-cert\") pod \"e2e-mt-9affa933-openshift-default-9c8b9f98c-bbhwt\" (UID: \"72c6f88d-7ffe-45e3-aa9f-bf14b288bd77\") " pod="openshift-ingress/e2e-mt-9affa933-openshift-default-9c8b9f98c-bbhwt"
Jul 23 16:48:54.915465 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:48:54.915448    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/72c6f88d-7ffe-45e3-aa9f-bf14b288bd77-istio-envoy\") pod \"e2e-mt-9affa933-openshift-default-9c8b9f98c-bbhwt\" (UID: \"72c6f88d-7ffe-45e3-aa9f-bf14b288bd77\") " pod="openshift-ingress/e2e-mt-9affa933-openshift-default-9c8b9f98c-bbhwt"
Jul 23 16:48:54.915750 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:48:54.915732    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/72c6f88d-7ffe-45e3-aa9f-bf14b288bd77-istio-podinfo\") pod \"e2e-mt-9affa933-openshift-default-9c8b9f98c-bbhwt\" (UID: \"72c6f88d-7ffe-45e3-aa9f-bf14b288bd77\") " pod="openshift-ingress/e2e-mt-9affa933-openshift-default-9c8b9f98c-bbhwt"
Jul 23 16:48:54.923160 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:48:54.923125    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/72c6f88d-7ffe-45e3-aa9f-bf14b288bd77-istio-token\") pod \"e2e-mt-9affa933-openshift-default-9c8b9f98c-bbhwt\" (UID: \"72c6f88d-7ffe-45e3-aa9f-bf14b288bd77\") " pod="openshift-ingress/e2e-mt-9affa933-openshift-default-9c8b9f98c-bbhwt"
Jul 23 16:48:54.923415 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:48:54.923392    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sd6kv\" (UniqueName: \"kubernetes.io/projected/72c6f88d-7ffe-45e3-aa9f-bf14b288bd77-kube-api-access-sd6kv\") pod \"e2e-mt-9affa933-openshift-default-9c8b9f98c-bbhwt\" (UID: \"72c6f88d-7ffe-45e3-aa9f-bf14b288bd77\") " pod="openshift-ingress/e2e-mt-9affa933-openshift-default-9c8b9f98c-bbhwt"
Jul 23 16:48:54.989609 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:48:54.989510    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-9affa933-openshift-default-9c8b9f98c-bbhwt"
Jul 23 16:48:55.147888 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:48:55.147844    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-9affa933-openshift-default-9c8b9f98c-bbhwt"]
Jul 23 16:48:55.153728 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:48:55.153700    2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod72c6f88d_7ffe_45e3_aa9f_bf14b288bd77.slice/crio-e2eca02b6224549e95be9d85f1d594a92f5ffc01c7cd74bc269616d1accf6ca9 WatchSource:0}: Error finding container e2eca02b6224549e95be9d85f1d594a92f5ffc01c7cd74bc269616d1accf6ca9: Status 404 returned error can't find the container with id e2eca02b6224549e95be9d85f1d594a92f5ffc01c7cd74bc269616d1accf6ca9
Jul 23 16:48:55.156459 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:48:55.156426    2553 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 23 16:48:55.156540 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:48:55.156498    2553 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 23 16:48:55.156540 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:48:55.156526    2553 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 23 16:48:55.892745 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:48:55.892708    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-9affa933-openshift-default-9c8b9f98c-bbhwt" event={"ID":"72c6f88d-7ffe-45e3-aa9f-bf14b288bd77","Type":"ContainerStarted","Data":"1cc7a0b970ae9dfe1f4053dffebf9651083de32502cf90b1febb6ad922adb753"}
Jul 23 16:48:55.893268 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:48:55.892761    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-9affa933-openshift-default-9c8b9f98c-bbhwt" event={"ID":"72c6f88d-7ffe-45e3-aa9f-bf14b288bd77","Type":"ContainerStarted","Data":"e2eca02b6224549e95be9d85f1d594a92f5ffc01c7cd74bc269616d1accf6ca9"}
Jul 23 16:48:55.990375 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:48:55.990333    2553 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-9affa933-openshift-default-9c8b9f98c-bbhwt"
Jul 23 16:48:56.994808 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:48:56.994778    2553 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-9affa933-openshift-default-9c8b9f98c-bbhwt"
Jul 23 16:48:57.034693 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:48:57.034640    2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-9affa933-openshift-default-9c8b9f98c-bbhwt" podStartSLOduration=3.034624946 podStartE2EDuration="3.034624946s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 16:48:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 16:48:55.932839968 +0000 UTC m=+2017.797446097" watchObservedRunningTime="2026-07-23 16:48:57.034624946 +0000 UTC m=+2018.899231075"
Jul 23 16:48:57.904592 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:48:57.904560    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-9affa933-openshift-default-9c8b9f98c-bbhwt"
Jul 23 16:48:57.905482 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:48:57.905461    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-9affa933-openshift-default-9c8b9f98c-bbhwt"
Jul 23 16:49:09.981839 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:49:09.981801    2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-9affa933-hhb4p"]
Jul 23 16:49:09.982345 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:49:09.982197    2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ae06f6fb-745b-4a79-b460-344876ad6125" containerName="istio-proxy"
Jul 23 16:49:09.982345 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:49:09.982212    2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="ae06f6fb-745b-4a79-b460-344876ad6125" containerName="istio-proxy"
Jul 23 16:49:09.987319 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:49:09.987295    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-9affa933-hhb4p"
Jul 23 16:49:09.991234 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:49:09.991208    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 23 16:49:09.991480 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:49:09.991456    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-plqcf\""
Jul 23 16:49:09.993873 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:49:09.993845    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-9affa933-hhb4p"]
Jul 23 16:49:10.153276 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:49:10.153236    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f94802b8-6381-434b-b5bf-baa4ec776766-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-9affa933-hhb4p\" (UID: \"f94802b8-6381-434b-b5bf-baa4ec776766\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-9affa933-hhb4p"
Jul 23 16:49:10.254691 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:49:10.254605    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f94802b8-6381-434b-b5bf-baa4ec776766-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-9affa933-hhb4p\" (UID: \"f94802b8-6381-434b-b5bf-baa4ec776766\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-9affa933-hhb4p"
Jul 23 16:49:10.255348 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:49:10.255325    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f94802b8-6381-434b-b5bf-baa4ec776766-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-9affa933-hhb4p\" (UID: \"f94802b8-6381-434b-b5bf-baa4ec776766\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-9affa933-hhb4p"
Jul 23 16:49:10.300714 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:49:10.300680    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-9affa933-hhb4p"
Jul 23 16:49:10.445182 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:49:10.445141    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-9affa933-hhb4p"]
Jul 23 16:49:10.447882 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:49:10.447848    2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf94802b8_6381_434b_b5bf_baa4ec776766.slice/crio-91559dddaca4a7d0df8978aa65ae6d6dc9336ddaba1e5cb365212078ca827c29 WatchSource:0}: Error finding container 91559dddaca4a7d0df8978aa65ae6d6dc9336ddaba1e5cb365212078ca827c29: Status 404 returned error can't find the container with id 91559dddaca4a7d0df8978aa65ae6d6dc9336ddaba1e5cb365212078ca827c29
Jul 23 16:49:10.994555 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:49:10.994517    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-9affa933-hhb4p" event={"ID":"f94802b8-6381-434b-b5bf-baa4ec776766","Type":"ContainerStarted","Data":"8bc57b083ca070d07d38153256772bf17475c6decdef35427e6959f101eb594a"}
Jul 23 16:49:10.995035 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:49:10.994581    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-9affa933-hhb4p" event={"ID":"f94802b8-6381-434b-b5bf-baa4ec776766","Type":"ContainerStarted","Data":"91559dddaca4a7d0df8978aa65ae6d6dc9336ddaba1e5cb365212078ca827c29"}
Jul 23 16:49:11.012792 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:49:11.012737    2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-9affa933-hhb4p" podStartSLOduration=2.012719676 podStartE2EDuration="2.012719676s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 16:49:09 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 16:49:11.011374673 +0000 UTC m=+2032.875980802" watchObservedRunningTime="2026-07-23 16:49:11.012719676 +0000 UTC m=+2032.877325803"
Jul 23 16:49:12.002635 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:49:12.002549    2553 generic.go:356] "Generic (PLEG): container finished" podID="72c6f88d-7ffe-45e3-aa9f-bf14b288bd77" containerID="1cc7a0b970ae9dfe1f4053dffebf9651083de32502cf90b1febb6ad922adb753" exitCode=0
Jul 23 16:49:12.003105 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:49:12.002631    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-9affa933-openshift-default-9c8b9f98c-bbhwt" event={"ID":"72c6f88d-7ffe-45e3-aa9f-bf14b288bd77","Type":"ContainerDied","Data":"1cc7a0b970ae9dfe1f4053dffebf9651083de32502cf90b1febb6ad922adb753"}
Jul 23 16:49:12.003105 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:49:12.003050    2553 scope.go:117] "RemoveContainer" containerID="1cc7a0b970ae9dfe1f4053dffebf9651083de32502cf90b1febb6ad922adb753"
Jul 23 16:49:12.004116 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:49:12.004079    2553 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 23 16:49:12.004221 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:49:12.004205    2553 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 23 16:49:12.004268 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:49:12.004248    2553 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 23 16:49:12.004494 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:49:12.004471    2553 generic.go:356] "Generic (PLEG): container finished" podID="f94802b8-6381-434b-b5bf-baa4ec776766" containerID="8bc57b083ca070d07d38153256772bf17475c6decdef35427e6959f101eb594a" exitCode=0
Jul 23 16:49:12.004548 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:49:12.004517    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-9affa933-hhb4p" event={"ID":"f94802b8-6381-434b-b5bf-baa4ec776766","Type":"ContainerDied","Data":"8bc57b083ca070d07d38153256772bf17475c6decdef35427e6959f101eb594a"}
Jul 23 16:49:12.905219 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:49:12.905177    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-9affa933-openshift-default-9c8b9f98c-bbhwt"
Jul 23 16:49:13.011874 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:49:13.011833    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-9affa933-openshift-default-9c8b9f98c-bbhwt" event={"ID":"72c6f88d-7ffe-45e3-aa9f-bf14b288bd77","Type":"ContainerStarted","Data":"1282d2abf75c67cf7602b3c089f6bc58aaf3067306e9f27079f7d224379a0442"}
Jul 23 16:49:13.173452 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:49:13.173424    2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-9affa933-hhb4p"
Jul 23 16:49:13.282457 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:49:13.282421    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f94802b8-6381-434b-b5bf-baa4ec776766-maas-api-service-ca\") pod \"f94802b8-6381-434b-b5bf-baa4ec776766\" (UID: \"f94802b8-6381-434b-b5bf-baa4ec776766\") "
Jul 23 16:49:13.282806 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:49:13.282778    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f94802b8-6381-434b-b5bf-baa4ec776766-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "f94802b8-6381-434b-b5bf-baa4ec776766" (UID: "f94802b8-6381-434b-b5bf-baa4ec776766"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 23 16:49:13.383745 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:49:13.383704    2553 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f94802b8-6381-434b-b5bf-baa4ec776766-maas-api-service-ca\") on node \"ip-10-0-143-166.ec2.internal\" DevicePath \"\""
Jul 23 16:49:13.989734 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:49:13.989692    2553 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-9affa933-openshift-default-9c8b9f98c-bbhwt"
Jul 23 16:49:13.990945 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:49:13.990916    2553 patch_prober.go:28] interesting pod/e2e-mt-9affa933-openshift-default-9c8b9f98c-bbhwt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.55:15021/healthz/ready\": dial tcp 10.132.0.55:15021: connect: connection refused" start-of-body=
Jul 23 16:49:13.991076 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:49:13.990976    2553 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-9affa933-openshift-default-9c8b9f98c-bbhwt" podUID="72c6f88d-7ffe-45e3-aa9f-bf14b288bd77" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.55:15021/healthz/ready\": dial tcp 10.132.0.55:15021: connect: connection refused"
Jul 23 16:49:14.018268 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:49:14.018230    2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-9affa933-hhb4p"
Jul 23 16:49:14.018268 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:49:14.018256    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-9affa933-hhb4p" event={"ID":"f94802b8-6381-434b-b5bf-baa4ec776766","Type":"ContainerDied","Data":"91559dddaca4a7d0df8978aa65ae6d6dc9336ddaba1e5cb365212078ca827c29"}
Jul 23 16:49:14.018707 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:49:14.018308    2553 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="91559dddaca4a7d0df8978aa65ae6d6dc9336ddaba1e5cb365212078ca827c29"
Jul 23 16:49:14.990245 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:49:14.990208    2553 patch_prober.go:28] interesting pod/e2e-mt-9affa933-openshift-default-9c8b9f98c-bbhwt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.55:15021/healthz/ready\": dial tcp 10.132.0.55:15021: connect: connection refused" start-of-body=
Jul 23 16:49:14.990432 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:49:14.990267    2553 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-9affa933-openshift-default-9c8b9f98c-bbhwt" podUID="72c6f88d-7ffe-45e3-aa9f-bf14b288bd77" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.55:15021/healthz/ready\": dial tcp 10.132.0.55:15021: connect: connection refused"
Jul 23 16:49:15.990618 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:49:15.990581    2553 patch_prober.go:28] interesting pod/e2e-mt-9affa933-openshift-default-9c8b9f98c-bbhwt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.55:15021/healthz/ready\": dial tcp 10.132.0.55:15021: connect: connection refused" start-of-body=
Jul 23 16:49:15.991034 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:49:15.990636    2553 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-9affa933-openshift-default-9c8b9f98c-bbhwt" podUID="72c6f88d-7ffe-45e3-aa9f-bf14b288bd77" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.55:15021/healthz/ready\": dial tcp 10.132.0.55:15021: connect: connection refused"
Jul 23 16:49:16.990389 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:49:16.990350    2553 patch_prober.go:28] interesting pod/e2e-mt-9affa933-openshift-default-9c8b9f98c-bbhwt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.55:15021/healthz/ready\": dial tcp 10.132.0.55:15021: connect: connection refused" start-of-body=
Jul 23 16:49:16.990600 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:49:16.990409    2553 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-9affa933-openshift-default-9c8b9f98c-bbhwt" podUID="72c6f88d-7ffe-45e3-aa9f-bf14b288bd77" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.55:15021/healthz/ready\": dial tcp 10.132.0.55:15021: connect: connection refused"
Jul 23 16:49:17.994244 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:49:17.994214    2553 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-9affa933-openshift-default-9c8b9f98c-bbhwt"
Jul 23 16:49:17.994695 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:49:17.994644    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-9affa933-openshift-default-9c8b9f98c-bbhwt"
Jul 23 16:49:17.995286 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:49:17.995265    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-9affa933-openshift-default-9c8b9f98c-bbhwt"
Jul 23 16:49:25.082472 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:49:25.082438    2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-9affa933-hhb4p"]
Jul 23 16:49:25.088064 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:49:25.088039    2553 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-9affa933-hhb4p"]
Jul 23 16:49:26.674331 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:49:26.674292    2553 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f94802b8-6381-434b-b5bf-baa4ec776766" path="/var/lib/kubelet/pods/f94802b8-6381-434b-b5bf-baa4ec776766/volumes"
Jul 23 16:49:31.554688 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:49:31.554649    2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-9affa933-openshift-default-9c8b9f98c-bbhwt"]
Jul 23 16:49:31.555122 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:49:31.554880    2553 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-9affa933-openshift-default-9c8b9f98c-bbhwt" podUID="72c6f88d-7ffe-45e3-aa9f-bf14b288bd77" containerName="istio-proxy" containerID="cri-o://1282d2abf75c67cf7602b3c089f6bc58aaf3067306e9f27079f7d224379a0442" gracePeriod=30
Jul 23 16:49:32.997325 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:49:32.997285    2553 patch_prober.go:28] interesting pod/e2e-mt-9affa933-openshift-default-9c8b9f98c-bbhwt container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=upstream connect error or disconnect/reset before headers. reset reason: remote connection failure, transport failure reason: delayed connect error: Connection refused
Jul 23 16:49:32.997727 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:49:32.997361    2553 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-9affa933-openshift-default-9c8b9f98c-bbhwt" podUID="72c6f88d-7ffe-45e3-aa9f-bf14b288bd77" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 23 16:49:36.813205 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:49:36.813151    2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-9affa933-openshift-default-9c8b9f98c-bbhwt"
Jul 23 16:49:36.871689 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:49:36.871598    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/72c6f88d-7ffe-45e3-aa9f-bf14b288bd77-workload-certs\") pod \"72c6f88d-7ffe-45e3-aa9f-bf14b288bd77\" (UID: \"72c6f88d-7ffe-45e3-aa9f-bf14b288bd77\") "
Jul 23 16:49:36.871689 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:49:36.871658    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/72c6f88d-7ffe-45e3-aa9f-bf14b288bd77-istio-token\") pod \"72c6f88d-7ffe-45e3-aa9f-bf14b288bd77\" (UID: \"72c6f88d-7ffe-45e3-aa9f-bf14b288bd77\") "
Jul 23 16:49:36.871912 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:49:36.871689    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sd6kv\" (UniqueName: \"kubernetes.io/projected/72c6f88d-7ffe-45e3-aa9f-bf14b288bd77-kube-api-access-sd6kv\") pod \"72c6f88d-7ffe-45e3-aa9f-bf14b288bd77\" (UID: \"72c6f88d-7ffe-45e3-aa9f-bf14b288bd77\") "
Jul 23 16:49:36.871912 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:49:36.871721    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/72c6f88d-7ffe-45e3-aa9f-bf14b288bd77-istio-podinfo\") pod \"72c6f88d-7ffe-45e3-aa9f-bf14b288bd77\" (UID: \"72c6f88d-7ffe-45e3-aa9f-bf14b288bd77\") "
Jul 23 16:49:36.871912 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:49:36.871742    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/72c6f88d-7ffe-45e3-aa9f-bf14b288bd77-istio-data\") pod \"72c6f88d-7ffe-45e3-aa9f-bf14b288bd77\" (UID: \"72c6f88d-7ffe-45e3-aa9f-bf14b288bd77\") "
Jul 23 16:49:36.871912 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:49:36.871776    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/72c6f88d-7ffe-45e3-aa9f-bf14b288bd77-istio-envoy\") pod \"72c6f88d-7ffe-45e3-aa9f-bf14b288bd77\" (UID: \"72c6f88d-7ffe-45e3-aa9f-bf14b288bd77\") "
Jul 23 16:49:36.871912 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:49:36.871804    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/72c6f88d-7ffe-45e3-aa9f-bf14b288bd77-workload-socket\") pod \"72c6f88d-7ffe-45e3-aa9f-bf14b288bd77\" (UID: \"72c6f88d-7ffe-45e3-aa9f-bf14b288bd77\") "
Jul 23 16:49:36.871912 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:49:36.871845    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/72c6f88d-7ffe-45e3-aa9f-bf14b288bd77-istiod-ca-cert\") pod \"72c6f88d-7ffe-45e3-aa9f-bf14b288bd77\" (UID: \"72c6f88d-7ffe-45e3-aa9f-bf14b288bd77\") "
Jul 23 16:49:36.872264 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:49:36.871910    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/72c6f88d-7ffe-45e3-aa9f-bf14b288bd77-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "72c6f88d-7ffe-45e3-aa9f-bf14b288bd77" (UID: "72c6f88d-7ffe-45e3-aa9f-bf14b288bd77"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 16:49:36.872264 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:49:36.871923    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/72c6f88d-7ffe-45e3-aa9f-bf14b288bd77-credential-socket\") pod \"72c6f88d-7ffe-45e3-aa9f-bf14b288bd77\" (UID: \"72c6f88d-7ffe-45e3-aa9f-bf14b288bd77\") "
Jul 23 16:49:36.872264 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:49:36.872151    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/72c6f88d-7ffe-45e3-aa9f-bf14b288bd77-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "72c6f88d-7ffe-45e3-aa9f-bf14b288bd77" (UID: "72c6f88d-7ffe-45e3-aa9f-bf14b288bd77"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 16:49:36.872499 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:49:36.872307    2553 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/72c6f88d-7ffe-45e3-aa9f-bf14b288bd77-credential-socket\") on node \"ip-10-0-143-166.ec2.internal\" DevicePath \"\""
Jul 23 16:49:36.872499 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:49:36.872328    2553 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/72c6f88d-7ffe-45e3-aa9f-bf14b288bd77-workload-certs\") on node \"ip-10-0-143-166.ec2.internal\" DevicePath \"\""
Jul 23 16:49:36.872499 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:49:36.872385    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/72c6f88d-7ffe-45e3-aa9f-bf14b288bd77-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "72c6f88d-7ffe-45e3-aa9f-bf14b288bd77" (UID: "72c6f88d-7ffe-45e3-aa9f-bf14b288bd77"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 16:49:36.872499 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:49:36.872459    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/72c6f88d-7ffe-45e3-aa9f-bf14b288bd77-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "72c6f88d-7ffe-45e3-aa9f-bf14b288bd77" (UID: "72c6f88d-7ffe-45e3-aa9f-bf14b288bd77"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 23 16:49:36.872757 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:49:36.872727    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/72c6f88d-7ffe-45e3-aa9f-bf14b288bd77-istio-data" (OuterVolumeSpecName: "istio-data") pod "72c6f88d-7ffe-45e3-aa9f-bf14b288bd77" (UID: "72c6f88d-7ffe-45e3-aa9f-bf14b288bd77"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 16:49:36.874112 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:49:36.874088    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/72c6f88d-7ffe-45e3-aa9f-bf14b288bd77-kube-api-access-sd6kv" (OuterVolumeSpecName: "kube-api-access-sd6kv") pod "72c6f88d-7ffe-45e3-aa9f-bf14b288bd77" (UID: "72c6f88d-7ffe-45e3-aa9f-bf14b288bd77"). InnerVolumeSpecName "kube-api-access-sd6kv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 16:49:36.874327 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:49:36.874145    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/72c6f88d-7ffe-45e3-aa9f-bf14b288bd77-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "72c6f88d-7ffe-45e3-aa9f-bf14b288bd77" (UID: "72c6f88d-7ffe-45e3-aa9f-bf14b288bd77"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 16:49:36.874412 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:49:36.874395    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/72c6f88d-7ffe-45e3-aa9f-bf14b288bd77-istio-token" (OuterVolumeSpecName: "istio-token") pod "72c6f88d-7ffe-45e3-aa9f-bf14b288bd77" (UID: "72c6f88d-7ffe-45e3-aa9f-bf14b288bd77"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 16:49:36.874467 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:49:36.874399    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/72c6f88d-7ffe-45e3-aa9f-bf14b288bd77-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "72c6f88d-7ffe-45e3-aa9f-bf14b288bd77" (UID: "72c6f88d-7ffe-45e3-aa9f-bf14b288bd77"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 23 16:49:36.973447 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:49:36.973398    2553 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/72c6f88d-7ffe-45e3-aa9f-bf14b288bd77-istio-envoy\") on node \"ip-10-0-143-166.ec2.internal\" DevicePath \"\""
Jul 23 16:49:36.973447 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:49:36.973440    2553 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/72c6f88d-7ffe-45e3-aa9f-bf14b288bd77-workload-socket\") on node \"ip-10-0-143-166.ec2.internal\" DevicePath \"\""
Jul 23 16:49:36.973447 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:49:36.973449    2553 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/72c6f88d-7ffe-45e3-aa9f-bf14b288bd77-istiod-ca-cert\") on node \"ip-10-0-143-166.ec2.internal\" DevicePath \"\""
Jul 23 16:49:36.973447 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:49:36.973458    2553 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/72c6f88d-7ffe-45e3-aa9f-bf14b288bd77-istio-token\") on node \"ip-10-0-143-166.ec2.internal\" DevicePath \"\""
Jul 23 16:49:36.973447 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:49:36.973466    2553 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sd6kv\" (UniqueName: \"kubernetes.io/projected/72c6f88d-7ffe-45e3-aa9f-bf14b288bd77-kube-api-access-sd6kv\") on node \"ip-10-0-143-166.ec2.internal\" DevicePath \"\""
Jul 23 16:49:36.973760 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:49:36.973475    2553 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/72c6f88d-7ffe-45e3-aa9f-bf14b288bd77-istio-podinfo\") on node \"ip-10-0-143-166.ec2.internal\" DevicePath \"\""
Jul 23 16:49:36.973760 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:49:36.973483    2553 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/72c6f88d-7ffe-45e3-aa9f-bf14b288bd77-istio-data\") on node \"ip-10-0-143-166.ec2.internal\" DevicePath \"\""
Jul 23 16:49:37.149748 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:49:37.149716    2553 generic.go:356] "Generic (PLEG): container finished" podID="72c6f88d-7ffe-45e3-aa9f-bf14b288bd77" containerID="1282d2abf75c67cf7602b3c089f6bc58aaf3067306e9f27079f7d224379a0442" exitCode=0
Jul 23 16:49:37.149914 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:49:37.149754    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-9affa933-openshift-default-9c8b9f98c-bbhwt" event={"ID":"72c6f88d-7ffe-45e3-aa9f-bf14b288bd77","Type":"ContainerDied","Data":"1282d2abf75c67cf7602b3c089f6bc58aaf3067306e9f27079f7d224379a0442"}
Jul 23 16:49:37.149914 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:49:37.149763    2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-9affa933-openshift-default-9c8b9f98c-bbhwt"
Jul 23 16:49:37.149914 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:49:37.149795    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-9affa933-openshift-default-9c8b9f98c-bbhwt" event={"ID":"72c6f88d-7ffe-45e3-aa9f-bf14b288bd77","Type":"ContainerDied","Data":"e2eca02b6224549e95be9d85f1d594a92f5ffc01c7cd74bc269616d1accf6ca9"}
Jul 23 16:49:37.149914 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:49:37.149819    2553 scope.go:117] "RemoveContainer" containerID="1282d2abf75c67cf7602b3c089f6bc58aaf3067306e9f27079f7d224379a0442"
Jul 23 16:49:37.159933 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:49:37.159916    2553 scope.go:117] "RemoveContainer" containerID="1cc7a0b970ae9dfe1f4053dffebf9651083de32502cf90b1febb6ad922adb753"
Jul 23 16:49:37.168315 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:49:37.168294    2553 scope.go:117] "RemoveContainer" containerID="1282d2abf75c67cf7602b3c089f6bc58aaf3067306e9f27079f7d224379a0442"
Jul 23 16:49:37.168597 ip-10-0-143-166 kubenswrapper[2553]: E0723 16:49:37.168578    2553 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1282d2abf75c67cf7602b3c089f6bc58aaf3067306e9f27079f7d224379a0442\": container with ID starting with 1282d2abf75c67cf7602b3c089f6bc58aaf3067306e9f27079f7d224379a0442 not found: ID does not exist" containerID="1282d2abf75c67cf7602b3c089f6bc58aaf3067306e9f27079f7d224379a0442"
Jul 23 16:49:37.168649 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:49:37.168607    2553 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1282d2abf75c67cf7602b3c089f6bc58aaf3067306e9f27079f7d224379a0442"} err="failed to get container status \"1282d2abf75c67cf7602b3c089f6bc58aaf3067306e9f27079f7d224379a0442\": rpc error: code = NotFound desc = could not find container \"1282d2abf75c67cf7602b3c089f6bc58aaf3067306e9f27079f7d224379a0442\": container with ID starting with 1282d2abf75c67cf7602b3c089f6bc58aaf3067306e9f27079f7d224379a0442 not found: ID does not exist"
Jul 23 16:49:37.168649 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:49:37.168626    2553 scope.go:117] "RemoveContainer" containerID="1cc7a0b970ae9dfe1f4053dffebf9651083de32502cf90b1febb6ad922adb753"
Jul 23 16:49:37.168840 ip-10-0-143-166 kubenswrapper[2553]: E0723 16:49:37.168826    2553 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1cc7a0b970ae9dfe1f4053dffebf9651083de32502cf90b1febb6ad922adb753\": container with ID starting with 1cc7a0b970ae9dfe1f4053dffebf9651083de32502cf90b1febb6ad922adb753 not found: ID does not exist" containerID="1cc7a0b970ae9dfe1f4053dffebf9651083de32502cf90b1febb6ad922adb753"
Jul 23 16:49:37.168878 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:49:37.168843    2553 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1cc7a0b970ae9dfe1f4053dffebf9651083de32502cf90b1febb6ad922adb753"} err="failed to get container status \"1cc7a0b970ae9dfe1f4053dffebf9651083de32502cf90b1febb6ad922adb753\": rpc error: code = NotFound desc = could not find container \"1cc7a0b970ae9dfe1f4053dffebf9651083de32502cf90b1febb6ad922adb753\": container with ID starting with 1cc7a0b970ae9dfe1f4053dffebf9651083de32502cf90b1febb6ad922adb753 not found: ID does not exist"
Jul 23 16:49:37.184747 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:49:37.184715    2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-9affa933-openshift-default-9c8b9f98c-bbhwt"]
Jul 23 16:49:37.190673 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:49:37.190648    2553 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-9affa933-openshift-default-9c8b9f98c-bbhwt"]
Jul 23 16:49:38.674960 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:49:38.674916    2553 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="72c6f88d-7ffe-45e3-aa9f-bf14b288bd77" path="/var/lib/kubelet/pods/72c6f88d-7ffe-45e3-aa9f-bf14b288bd77/volumes"
Jul 23 16:49:52.896926 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:49:52.896845    2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-4fef36f3-openshift-default-677b8fc8c9-qn7mx"]
Jul 23 16:49:52.897299 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:49:52.897198    2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="72c6f88d-7ffe-45e3-aa9f-bf14b288bd77" containerName="istio-proxy"
Jul 23 16:49:52.897299 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:49:52.897210    2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="72c6f88d-7ffe-45e3-aa9f-bf14b288bd77" containerName="istio-proxy"
Jul 23 16:49:52.897299 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:49:52.897223    2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="72c6f88d-7ffe-45e3-aa9f-bf14b288bd77" containerName="istio-proxy"
Jul 23 16:49:52.897299 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:49:52.897228    2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="72c6f88d-7ffe-45e3-aa9f-bf14b288bd77" containerName="istio-proxy"
Jul 23 16:49:52.897299 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:49:52.897235    2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f94802b8-6381-434b-b5bf-baa4ec776766" containerName="revoke-keys"
Jul 23 16:49:52.897299 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:49:52.897241    2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="f94802b8-6381-434b-b5bf-baa4ec776766" containerName="revoke-keys"
Jul 23 16:49:52.897494 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:49:52.897307    2553 memory_manager.go:368] "RemoveStaleState removing state" podUID="72c6f88d-7ffe-45e3-aa9f-bf14b288bd77" containerName="istio-proxy"
Jul 23 16:49:52.897494 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:49:52.897318    2553 memory_manager.go:368] "RemoveStaleState removing state" podUID="f94802b8-6381-434b-b5bf-baa4ec776766" containerName="revoke-keys"
Jul 23 16:49:52.902021 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:49:52.901999    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-4fef36f3-openshift-default-677b8fc8c9-qn7mx"
Jul 23 16:49:52.904901 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:49:52.904878    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-4fef36f3-openshift-default-dockercfg-stxt7\""
Jul 23 16:49:52.905268 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:49:52.905246    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Jul 23 16:49:52.916291 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:49:52.916258    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-4fef36f3-openshift-default-677b8fc8c9-qn7mx"]
Jul 23 16:49:53.003258 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:49:53.003217    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a7b52719-ec86-4b3a-92f7-4cc7075f7a75-istio-data\") pod \"e2e-mt-4fef36f3-openshift-default-677b8fc8c9-qn7mx\" (UID: \"a7b52719-ec86-4b3a-92f7-4cc7075f7a75\") " pod="openshift-ingress/e2e-mt-4fef36f3-openshift-default-677b8fc8c9-qn7mx"
Jul 23 16:49:53.003258 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:49:53.003260    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a7b52719-ec86-4b3a-92f7-4cc7075f7a75-credential-socket\") pod \"e2e-mt-4fef36f3-openshift-default-677b8fc8c9-qn7mx\" (UID: \"a7b52719-ec86-4b3a-92f7-4cc7075f7a75\") " pod="openshift-ingress/e2e-mt-4fef36f3-openshift-default-677b8fc8c9-qn7mx"
Jul 23 16:49:53.003472 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:49:53.003289    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a7b52719-ec86-4b3a-92f7-4cc7075f7a75-istiod-ca-cert\") pod \"e2e-mt-4fef36f3-openshift-default-677b8fc8c9-qn7mx\" (UID: \"a7b52719-ec86-4b3a-92f7-4cc7075f7a75\") " pod="openshift-ingress/e2e-mt-4fef36f3-openshift-default-677b8fc8c9-qn7mx"
Jul 23 16:49:53.003472 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:49:53.003385    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a7b52719-ec86-4b3a-92f7-4cc7075f7a75-workload-socket\") pod \"e2e-mt-4fef36f3-openshift-default-677b8fc8c9-qn7mx\" (UID: \"a7b52719-ec86-4b3a-92f7-4cc7075f7a75\") " pod="openshift-ingress/e2e-mt-4fef36f3-openshift-default-677b8fc8c9-qn7mx"
Jul 23 16:49:53.003472 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:49:53.003416    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a7b52719-ec86-4b3a-92f7-4cc7075f7a75-istio-token\") pod \"e2e-mt-4fef36f3-openshift-default-677b8fc8c9-qn7mx\" (UID: \"a7b52719-ec86-4b3a-92f7-4cc7075f7a75\") " pod="openshift-ingress/e2e-mt-4fef36f3-openshift-default-677b8fc8c9-qn7mx"
Jul 23 16:49:53.003472 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:49:53.003448    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a7b52719-ec86-4b3a-92f7-4cc7075f7a75-workload-certs\") pod \"e2e-mt-4fef36f3-openshift-default-677b8fc8c9-qn7mx\" (UID: \"a7b52719-ec86-4b3a-92f7-4cc7075f7a75\") " pod="openshift-ingress/e2e-mt-4fef36f3-openshift-default-677b8fc8c9-qn7mx"
Jul 23 16:49:53.003626 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:49:53.003510    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hhm6b\" (UniqueName: \"kubernetes.io/projected/a7b52719-ec86-4b3a-92f7-4cc7075f7a75-kube-api-access-hhm6b\") pod \"e2e-mt-4fef36f3-openshift-default-677b8fc8c9-qn7mx\" (UID: \"a7b52719-ec86-4b3a-92f7-4cc7075f7a75\") " pod="openshift-ingress/e2e-mt-4fef36f3-openshift-default-677b8fc8c9-qn7mx"
Jul 23 16:49:53.003626 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:49:53.003552    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a7b52719-ec86-4b3a-92f7-4cc7075f7a75-istio-podinfo\") pod \"e2e-mt-4fef36f3-openshift-default-677b8fc8c9-qn7mx\" (UID: \"a7b52719-ec86-4b3a-92f7-4cc7075f7a75\") " pod="openshift-ingress/e2e-mt-4fef36f3-openshift-default-677b8fc8c9-qn7mx"
Jul 23 16:49:53.003701 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:49:53.003633    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a7b52719-ec86-4b3a-92f7-4cc7075f7a75-istio-envoy\") pod \"e2e-mt-4fef36f3-openshift-default-677b8fc8c9-qn7mx\" (UID: \"a7b52719-ec86-4b3a-92f7-4cc7075f7a75\") " pod="openshift-ingress/e2e-mt-4fef36f3-openshift-default-677b8fc8c9-qn7mx"
Jul 23 16:49:53.104429 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:49:53.104384    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a7b52719-ec86-4b3a-92f7-4cc7075f7a75-istio-envoy\") pod \"e2e-mt-4fef36f3-openshift-default-677b8fc8c9-qn7mx\" (UID: \"a7b52719-ec86-4b3a-92f7-4cc7075f7a75\") " pod="openshift-ingress/e2e-mt-4fef36f3-openshift-default-677b8fc8c9-qn7mx"
Jul 23 16:49:53.104429 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:49:53.104432    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a7b52719-ec86-4b3a-92f7-4cc7075f7a75-istio-data\") pod \"e2e-mt-4fef36f3-openshift-default-677b8fc8c9-qn7mx\" (UID: \"a7b52719-ec86-4b3a-92f7-4cc7075f7a75\") " pod="openshift-ingress/e2e-mt-4fef36f3-openshift-default-677b8fc8c9-qn7mx"
Jul 23 16:49:53.104692 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:49:53.104462    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a7b52719-ec86-4b3a-92f7-4cc7075f7a75-credential-socket\") pod \"e2e-mt-4fef36f3-openshift-default-677b8fc8c9-qn7mx\" (UID: \"a7b52719-ec86-4b3a-92f7-4cc7075f7a75\") " pod="openshift-ingress/e2e-mt-4fef36f3-openshift-default-677b8fc8c9-qn7mx"
Jul 23 16:49:53.104692 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:49:53.104501    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a7b52719-ec86-4b3a-92f7-4cc7075f7a75-istiod-ca-cert\") pod \"e2e-mt-4fef36f3-openshift-default-677b8fc8c9-qn7mx\" (UID: \"a7b52719-ec86-4b3a-92f7-4cc7075f7a75\") " pod="openshift-ingress/e2e-mt-4fef36f3-openshift-default-677b8fc8c9-qn7mx"
Jul 23 16:49:53.104692 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:49:53.104538    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a7b52719-ec86-4b3a-92f7-4cc7075f7a75-workload-socket\") pod \"e2e-mt-4fef36f3-openshift-default-677b8fc8c9-qn7mx\" (UID: \"a7b52719-ec86-4b3a-92f7-4cc7075f7a75\") " pod="openshift-ingress/e2e-mt-4fef36f3-openshift-default-677b8fc8c9-qn7mx"
Jul 23 16:49:53.104692 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:49:53.104564    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a7b52719-ec86-4b3a-92f7-4cc7075f7a75-istio-token\") pod \"e2e-mt-4fef36f3-openshift-default-677b8fc8c9-qn7mx\" (UID: \"a7b52719-ec86-4b3a-92f7-4cc7075f7a75\") " pod="openshift-ingress/e2e-mt-4fef36f3-openshift-default-677b8fc8c9-qn7mx"
Jul 23 16:49:53.104692 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:49:53.104595    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a7b52719-ec86-4b3a-92f7-4cc7075f7a75-workload-certs\") pod \"e2e-mt-4fef36f3-openshift-default-677b8fc8c9-qn7mx\" (UID: \"a7b52719-ec86-4b3a-92f7-4cc7075f7a75\") " pod="openshift-ingress/e2e-mt-4fef36f3-openshift-default-677b8fc8c9-qn7mx"
Jul 23 16:49:53.104692 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:49:53.104634    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hhm6b\" (UniqueName: \"kubernetes.io/projected/a7b52719-ec86-4b3a-92f7-4cc7075f7a75-kube-api-access-hhm6b\") pod \"e2e-mt-4fef36f3-openshift-default-677b8fc8c9-qn7mx\" (UID: \"a7b52719-ec86-4b3a-92f7-4cc7075f7a75\") " pod="openshift-ingress/e2e-mt-4fef36f3-openshift-default-677b8fc8c9-qn7mx"
Jul 23 16:49:53.104692 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:49:53.104667    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a7b52719-ec86-4b3a-92f7-4cc7075f7a75-istio-podinfo\") pod \"e2e-mt-4fef36f3-openshift-default-677b8fc8c9-qn7mx\" (UID: \"a7b52719-ec86-4b3a-92f7-4cc7075f7a75\") " pod="openshift-ingress/e2e-mt-4fef36f3-openshift-default-677b8fc8c9-qn7mx"
Jul 23 16:49:53.105056 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:49:53.104922    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a7b52719-ec86-4b3a-92f7-4cc7075f7a75-istio-data\") pod \"e2e-mt-4fef36f3-openshift-default-677b8fc8c9-qn7mx\" (UID: \"a7b52719-ec86-4b3a-92f7-4cc7075f7a75\") " pod="openshift-ingress/e2e-mt-4fef36f3-openshift-default-677b8fc8c9-qn7mx"
Jul 23 16:49:53.105056 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:49:53.104987    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a7b52719-ec86-4b3a-92f7-4cc7075f7a75-credential-socket\") pod \"e2e-mt-4fef36f3-openshift-default-677b8fc8c9-qn7mx\" (UID: \"a7b52719-ec86-4b3a-92f7-4cc7075f7a75\") " pod="openshift-ingress/e2e-mt-4fef36f3-openshift-default-677b8fc8c9-qn7mx"
Jul 23 16:49:53.105284 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:49:53.105247    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a7b52719-ec86-4b3a-92f7-4cc7075f7a75-workload-certs\") pod \"e2e-mt-4fef36f3-openshift-default-677b8fc8c9-qn7mx\" (UID: \"a7b52719-ec86-4b3a-92f7-4cc7075f7a75\") " pod="openshift-ingress/e2e-mt-4fef36f3-openshift-default-677b8fc8c9-qn7mx"
Jul 23 16:49:53.105409 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:49:53.105353    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a7b52719-ec86-4b3a-92f7-4cc7075f7a75-istiod-ca-cert\") pod \"e2e-mt-4fef36f3-openshift-default-677b8fc8c9-qn7mx\" (UID: \"a7b52719-ec86-4b3a-92f7-4cc7075f7a75\") " pod="openshift-ingress/e2e-mt-4fef36f3-openshift-default-677b8fc8c9-qn7mx"
Jul 23 16:49:53.105481 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:49:53.105438    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a7b52719-ec86-4b3a-92f7-4cc7075f7a75-workload-socket\") pod \"e2e-mt-4fef36f3-openshift-default-677b8fc8c9-qn7mx\" (UID: \"a7b52719-ec86-4b3a-92f7-4cc7075f7a75\") " pod="openshift-ingress/e2e-mt-4fef36f3-openshift-default-677b8fc8c9-qn7mx"
Jul 23 16:49:53.107303 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:49:53.107282    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a7b52719-ec86-4b3a-92f7-4cc7075f7a75-istio-envoy\") pod \"e2e-mt-4fef36f3-openshift-default-677b8fc8c9-qn7mx\" (UID: \"a7b52719-ec86-4b3a-92f7-4cc7075f7a75\") " pod="openshift-ingress/e2e-mt-4fef36f3-openshift-default-677b8fc8c9-qn7mx"
Jul 23 16:49:53.107435 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:49:53.107418    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a7b52719-ec86-4b3a-92f7-4cc7075f7a75-istio-podinfo\") pod \"e2e-mt-4fef36f3-openshift-default-677b8fc8c9-qn7mx\" (UID: \"a7b52719-ec86-4b3a-92f7-4cc7075f7a75\") " pod="openshift-ingress/e2e-mt-4fef36f3-openshift-default-677b8fc8c9-qn7mx"
Jul 23 16:49:53.115328 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:49:53.115288    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a7b52719-ec86-4b3a-92f7-4cc7075f7a75-istio-token\") pod \"e2e-mt-4fef36f3-openshift-default-677b8fc8c9-qn7mx\" (UID: \"a7b52719-ec86-4b3a-92f7-4cc7075f7a75\") " pod="openshift-ingress/e2e-mt-4fef36f3-openshift-default-677b8fc8c9-qn7mx"
Jul 23 16:49:53.115445 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:49:53.115400    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hhm6b\" (UniqueName: \"kubernetes.io/projected/a7b52719-ec86-4b3a-92f7-4cc7075f7a75-kube-api-access-hhm6b\") pod \"e2e-mt-4fef36f3-openshift-default-677b8fc8c9-qn7mx\" (UID: \"a7b52719-ec86-4b3a-92f7-4cc7075f7a75\") " pod="openshift-ingress/e2e-mt-4fef36f3-openshift-default-677b8fc8c9-qn7mx"
Jul 23 16:49:53.212712 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:49:53.212615    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-4fef36f3-openshift-default-677b8fc8c9-qn7mx"
Jul 23 16:49:53.358408 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:49:53.358377    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-4fef36f3-openshift-default-677b8fc8c9-qn7mx"]
Jul 23 16:49:53.359698 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:49:53.359671    2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda7b52719_ec86_4b3a_92f7_4cc7075f7a75.slice/crio-2a878ade522f07a3d61443b79a75747268d2ddf3c4d19c256d99a0fef4861585 WatchSource:0}: Error finding container 2a878ade522f07a3d61443b79a75747268d2ddf3c4d19c256d99a0fef4861585: Status 404 returned error can't find the container with id 2a878ade522f07a3d61443b79a75747268d2ddf3c4d19c256d99a0fef4861585
Jul 23 16:49:53.361854 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:49:53.361821    2553 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 23 16:49:53.361963 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:49:53.361901    2553 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 23 16:49:53.361963 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:49:53.361948    2553 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 23 16:49:54.243687 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:49:54.243652    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-4fef36f3-openshift-default-677b8fc8c9-qn7mx" event={"ID":"a7b52719-ec86-4b3a-92f7-4cc7075f7a75","Type":"ContainerStarted","Data":"67212d48ea6a6c8b80f55900c2c5d948582d707a6f570eb9b6ec1d0f36a74df5"}
Jul 23 16:49:54.244116 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:49:54.243702    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-4fef36f3-openshift-default-677b8fc8c9-qn7mx" event={"ID":"a7b52719-ec86-4b3a-92f7-4cc7075f7a75","Type":"ContainerStarted","Data":"2a878ade522f07a3d61443b79a75747268d2ddf3c4d19c256d99a0fef4861585"}
Jul 23 16:49:54.268297 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:49:54.268243    2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-4fef36f3-openshift-default-677b8fc8c9-qn7mx" podStartSLOduration=2.268227847 podStartE2EDuration="2.268227847s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 16:49:52 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 16:49:54.266426356 +0000 UTC m=+2076.131032484" watchObservedRunningTime="2026-07-23 16:49:54.268227847 +0000 UTC m=+2076.132833976"
Jul 23 16:49:55.213186 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:49:55.213132    2553 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-4fef36f3-openshift-default-677b8fc8c9-qn7mx"
Jul 23 16:49:55.218629 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:49:55.218602    2553 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-4fef36f3-openshift-default-677b8fc8c9-qn7mx"
Jul 23 16:49:55.250250 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:49:55.250215    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-4fef36f3-openshift-default-677b8fc8c9-qn7mx"
Jul 23 16:49:55.251117 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:49:55.251102    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-4fef36f3-openshift-default-677b8fc8c9-qn7mx"
Jul 23 16:50:10.496453 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:50:10.496348    2553 patch_prober.go:28] interesting pod/e2e-mt-4fef36f3-openshift-default-677b8fc8c9-qn7mx container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.57:15021/healthz/ready\": read tcp 10.132.0.2:59390->10.132.0.57:15021: read: connection reset by peer" start-of-body=
Jul 23 16:50:10.496453 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:50:10.496431    2553 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-4fef36f3-openshift-default-677b8fc8c9-qn7mx" podUID="a7b52719-ec86-4b3a-92f7-4cc7075f7a75" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.57:15021/healthz/ready\": read tcp 10.132.0.2:59390->10.132.0.57:15021: read: connection reset by peer"
Jul 23 16:50:11.337074 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:50:11.337041    2553 generic.go:356] "Generic (PLEG): container finished" podID="a7b52719-ec86-4b3a-92f7-4cc7075f7a75" containerID="67212d48ea6a6c8b80f55900c2c5d948582d707a6f570eb9b6ec1d0f36a74df5" exitCode=0
Jul 23 16:50:11.337276 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:50:11.337116    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-4fef36f3-openshift-default-677b8fc8c9-qn7mx" event={"ID":"a7b52719-ec86-4b3a-92f7-4cc7075f7a75","Type":"ContainerDied","Data":"67212d48ea6a6c8b80f55900c2c5d948582d707a6f570eb9b6ec1d0f36a74df5"}
Jul 23 16:50:11.337535 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:50:11.337523    2553 scope.go:117] "RemoveContainer" containerID="67212d48ea6a6c8b80f55900c2c5d948582d707a6f570eb9b6ec1d0f36a74df5"
Jul 23 16:50:11.338497 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:50:11.338472    2553 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 23 16:50:11.338576 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:50:11.338555    2553 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 23 16:50:11.338613 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:50:11.338598    2553 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 23 16:50:12.348626 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:50:12.348581    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-4fef36f3-openshift-default-677b8fc8c9-qn7mx" event={"ID":"a7b52719-ec86-4b3a-92f7-4cc7075f7a75","Type":"ContainerStarted","Data":"d2a47a40c8a9bab3557f6bc8738dcb5991cf47825f326680311e77957a20499f"}
Jul 23 16:50:13.213254 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:50:13.213216    2553 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-4fef36f3-openshift-default-677b8fc8c9-qn7mx"
Jul 23 16:50:13.213485 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:50:13.213462    2553 patch_prober.go:28] interesting pod/e2e-mt-4fef36f3-openshift-default-677b8fc8c9-qn7mx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused" start-of-body=
Jul 23 16:50:13.213534 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:50:13.213509    2553 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-4fef36f3-openshift-default-677b8fc8c9-qn7mx" podUID="a7b52719-ec86-4b3a-92f7-4cc7075f7a75" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused"
Jul 23 16:50:14.213283 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:50:14.213247    2553 patch_prober.go:28] interesting pod/e2e-mt-4fef36f3-openshift-default-677b8fc8c9-qn7mx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused" start-of-body=
Jul 23 16:50:14.213659 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:50:14.213314    2553 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-4fef36f3-openshift-default-677b8fc8c9-qn7mx" podUID="a7b52719-ec86-4b3a-92f7-4cc7075f7a75" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused"
Jul 23 16:50:15.213692 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:50:15.213649    2553 patch_prober.go:28] interesting pod/e2e-mt-4fef36f3-openshift-default-677b8fc8c9-qn7mx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused" start-of-body=
Jul 23 16:50:15.214103 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:50:15.213707    2553 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-4fef36f3-openshift-default-677b8fc8c9-qn7mx" podUID="a7b52719-ec86-4b3a-92f7-4cc7075f7a75" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused"
Jul 23 16:50:16.213632 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:50:16.213588    2553 patch_prober.go:28] interesting pod/e2e-mt-4fef36f3-openshift-default-677b8fc8c9-qn7mx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused" start-of-body=
Jul 23 16:50:16.213821 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:50:16.213652    2553 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-4fef36f3-openshift-default-677b8fc8c9-qn7mx" podUID="a7b52719-ec86-4b3a-92f7-4cc7075f7a75" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused"
Jul 23 16:50:17.216393 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:50:17.216362    2553 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-4fef36f3-openshift-default-677b8fc8c9-qn7mx"
Jul 23 16:50:17.216797 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:50:17.216784    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-4fef36f3-openshift-default-677b8fc8c9-qn7mx"
Jul 23 16:50:17.217545 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:50:17.217527    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-4fef36f3-openshift-default-677b8fc8c9-qn7mx"
Jul 23 16:50:18.723006 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:50:18.722978    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-7rmrn_976a7198-cfd3-43d4-8c9f-b1f248d1f6d7/console-operator/1.log"
Jul 23 16:50:18.727879 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:50:18.727852    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-7rmrn_976a7198-cfd3-43d4-8c9f-b1f248d1f6d7/console-operator/1.log"
Jul 23 16:50:24.299906 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:50:24.299871    2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-4fef36f3-5wx9h"]
Jul 23 16:50:24.300327 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:50:24.300288    2553 memory_manager.go:368] "RemoveStaleState removing state" podUID="72c6f88d-7ffe-45e3-aa9f-bf14b288bd77" containerName="istio-proxy"
Jul 23 16:50:24.303212 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:50:24.303195    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-4fef36f3-5wx9h"
Jul 23 16:50:24.305874 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:50:24.305850    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-plqcf\""
Jul 23 16:50:24.306216 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:50:24.306198    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 23 16:50:24.311768 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:50:24.311742    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-4fef36f3-5wx9h"]
Jul 23 16:50:24.479006 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:50:24.478967    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/03fd948b-ee0b-44b0-a820-37c67826c2fd-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-4fef36f3-5wx9h\" (UID: \"03fd948b-ee0b-44b0-a820-37c67826c2fd\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-4fef36f3-5wx9h"
Jul 23 16:50:24.580045 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:50:24.579954    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/03fd948b-ee0b-44b0-a820-37c67826c2fd-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-4fef36f3-5wx9h\" (UID: \"03fd948b-ee0b-44b0-a820-37c67826c2fd\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-4fef36f3-5wx9h"
Jul 23 16:50:24.580574 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:50:24.580553    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/03fd948b-ee0b-44b0-a820-37c67826c2fd-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-4fef36f3-5wx9h\" (UID: \"03fd948b-ee0b-44b0-a820-37c67826c2fd\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-4fef36f3-5wx9h"
Jul 23 16:50:24.615010 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:50:24.614965    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-4fef36f3-5wx9h"
Jul 23 16:50:24.751411 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:50:24.751381    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-4fef36f3-5wx9h"]
Jul 23 16:50:24.753180 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:50:24.753129    2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod03fd948b_ee0b_44b0_a820_37c67826c2fd.slice/crio-169a2f5bad28ffb131e1f6762c69b683f559d05da12ed880089fcc9f74ee12c6 WatchSource:0}: Error finding container 169a2f5bad28ffb131e1f6762c69b683f559d05da12ed880089fcc9f74ee12c6: Status 404 returned error can't find the container with id 169a2f5bad28ffb131e1f6762c69b683f559d05da12ed880089fcc9f74ee12c6
Jul 23 16:50:25.424401 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:50:25.424356    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-4fef36f3-5wx9h" event={"ID":"03fd948b-ee0b-44b0-a820-37c67826c2fd","Type":"ContainerStarted","Data":"9a6ef756ccebcb0396fbd5c1ffca431062d77d2abd572a3c32b9745a10bd49a8"}
Jul 23 16:50:25.424834 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:50:25.424462    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-4fef36f3-5wx9h" event={"ID":"03fd948b-ee0b-44b0-a820-37c67826c2fd","Type":"ContainerStarted","Data":"169a2f5bad28ffb131e1f6762c69b683f559d05da12ed880089fcc9f74ee12c6"}
Jul 23 16:50:25.443555 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:50:25.443505    2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-4fef36f3-5wx9h" podStartSLOduration=1.443487956 podStartE2EDuration="1.443487956s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 16:50:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 16:50:25.440663749 +0000 UTC m=+2107.305269878" watchObservedRunningTime="2026-07-23 16:50:25.443487956 +0000 UTC m=+2107.308094084"
Jul 23 16:50:26.431132 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:50:26.431098    2553 generic.go:356] "Generic (PLEG): container finished" podID="03fd948b-ee0b-44b0-a820-37c67826c2fd" containerID="9a6ef756ccebcb0396fbd5c1ffca431062d77d2abd572a3c32b9745a10bd49a8" exitCode=0
Jul 23 16:50:26.431538 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:50:26.431183    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-4fef36f3-5wx9h" event={"ID":"03fd948b-ee0b-44b0-a820-37c67826c2fd","Type":"ContainerDied","Data":"9a6ef756ccebcb0396fbd5c1ffca431062d77d2abd572a3c32b9745a10bd49a8"}
Jul 23 16:50:27.565926 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:50:27.565897    2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-4fef36f3-5wx9h"
Jul 23 16:50:27.706580 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:50:27.706495    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/03fd948b-ee0b-44b0-a820-37c67826c2fd-maas-api-service-ca\") pod \"03fd948b-ee0b-44b0-a820-37c67826c2fd\" (UID: \"03fd948b-ee0b-44b0-a820-37c67826c2fd\") "
Jul 23 16:50:27.706890 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:50:27.706868    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/03fd948b-ee0b-44b0-a820-37c67826c2fd-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "03fd948b-ee0b-44b0-a820-37c67826c2fd" (UID: "03fd948b-ee0b-44b0-a820-37c67826c2fd"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 23 16:50:27.808129 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:50:27.808079    2553 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/03fd948b-ee0b-44b0-a820-37c67826c2fd-maas-api-service-ca\") on node \"ip-10-0-143-166.ec2.internal\" DevicePath \"\""
Jul 23 16:50:28.442660 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:50:28.442629    2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-4fef36f3-5wx9h"
Jul 23 16:50:28.442842 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:50:28.442666    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-4fef36f3-5wx9h" event={"ID":"03fd948b-ee0b-44b0-a820-37c67826c2fd","Type":"ContainerDied","Data":"169a2f5bad28ffb131e1f6762c69b683f559d05da12ed880089fcc9f74ee12c6"}
Jul 23 16:50:28.442842 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:50:28.442711    2553 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="169a2f5bad28ffb131e1f6762c69b683f559d05da12ed880089fcc9f74ee12c6"
Jul 23 16:50:44.398873 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:50:44.398830    2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-4fef36f3-5wx9h"]
Jul 23 16:50:44.402670 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:50:44.402645    2553 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-4fef36f3-5wx9h"]
Jul 23 16:50:44.674398 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:50:44.674317    2553 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="03fd948b-ee0b-44b0-a820-37c67826c2fd" path="/var/lib/kubelet/pods/03fd948b-ee0b-44b0-a820-37c67826c2fd/volumes"
Jul 23 16:51:18.803113 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:51:18.803038    2553 scope.go:117] "RemoveContainer" containerID="453afac80878890ad1ca479f31310620d3487233ec6d1f9106084651c2ba7b10"
Jul 23 16:51:34.931617 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:51:34.931576    2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-4fef36f3-openshift-default-677b8fc8c9-qn7mx"]
Jul 23 16:51:34.932090 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:51:34.931857    2553 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-4fef36f3-openshift-default-677b8fc8c9-qn7mx" podUID="a7b52719-ec86-4b3a-92f7-4cc7075f7a75" containerName="istio-proxy" containerID="cri-o://d2a47a40c8a9bab3557f6bc8738dcb5991cf47825f326680311e77957a20499f" gracePeriod=30
Jul 23 16:51:40.204872 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:51:40.204803    2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-4fef36f3-openshift-default-677b8fc8c9-qn7mx"
Jul 23 16:51:40.309671 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:51:40.309626    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a7b52719-ec86-4b3a-92f7-4cc7075f7a75-workload-socket\") pod \"a7b52719-ec86-4b3a-92f7-4cc7075f7a75\" (UID: \"a7b52719-ec86-4b3a-92f7-4cc7075f7a75\") "
Jul 23 16:51:40.309859 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:51:40.309728    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a7b52719-ec86-4b3a-92f7-4cc7075f7a75-istiod-ca-cert\") pod \"a7b52719-ec86-4b3a-92f7-4cc7075f7a75\" (UID: \"a7b52719-ec86-4b3a-92f7-4cc7075f7a75\") "
Jul 23 16:51:40.309859 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:51:40.309756    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a7b52719-ec86-4b3a-92f7-4cc7075f7a75-istio-token\") pod \"a7b52719-ec86-4b3a-92f7-4cc7075f7a75\" (UID: \"a7b52719-ec86-4b3a-92f7-4cc7075f7a75\") "
Jul 23 16:51:40.309859 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:51:40.309780    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hhm6b\" (UniqueName: \"kubernetes.io/projected/a7b52719-ec86-4b3a-92f7-4cc7075f7a75-kube-api-access-hhm6b\") pod \"a7b52719-ec86-4b3a-92f7-4cc7075f7a75\" (UID: \"a7b52719-ec86-4b3a-92f7-4cc7075f7a75\") "
Jul 23 16:51:40.309859 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:51:40.309840    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a7b52719-ec86-4b3a-92f7-4cc7075f7a75-istio-envoy\") pod \"a7b52719-ec86-4b3a-92f7-4cc7075f7a75\" (UID: \"a7b52719-ec86-4b3a-92f7-4cc7075f7a75\") "
Jul 23 16:51:40.310087 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:51:40.309877    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a7b52719-ec86-4b3a-92f7-4cc7075f7a75-workload-certs\") pod \"a7b52719-ec86-4b3a-92f7-4cc7075f7a75\" (UID: \"a7b52719-ec86-4b3a-92f7-4cc7075f7a75\") "
Jul 23 16:51:40.310087 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:51:40.309890    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a7b52719-ec86-4b3a-92f7-4cc7075f7a75-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "a7b52719-ec86-4b3a-92f7-4cc7075f7a75" (UID: "a7b52719-ec86-4b3a-92f7-4cc7075f7a75"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 16:51:40.310087 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:51:40.309913    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a7b52719-ec86-4b3a-92f7-4cc7075f7a75-istio-podinfo\") pod \"a7b52719-ec86-4b3a-92f7-4cc7075f7a75\" (UID: \"a7b52719-ec86-4b3a-92f7-4cc7075f7a75\") "
Jul 23 16:51:40.310087 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:51:40.309942    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a7b52719-ec86-4b3a-92f7-4cc7075f7a75-credential-socket\") pod \"a7b52719-ec86-4b3a-92f7-4cc7075f7a75\" (UID: \"a7b52719-ec86-4b3a-92f7-4cc7075f7a75\") "
Jul 23 16:51:40.310087 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:51:40.310000    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a7b52719-ec86-4b3a-92f7-4cc7075f7a75-istio-data\") pod \"a7b52719-ec86-4b3a-92f7-4cc7075f7a75\" (UID: \"a7b52719-ec86-4b3a-92f7-4cc7075f7a75\") "
Jul 23 16:51:40.310392 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:51:40.310196    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a7b52719-ec86-4b3a-92f7-4cc7075f7a75-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "a7b52719-ec86-4b3a-92f7-4cc7075f7a75" (UID: "a7b52719-ec86-4b3a-92f7-4cc7075f7a75"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 23 16:51:40.310392 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:51:40.310314    2553 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a7b52719-ec86-4b3a-92f7-4cc7075f7a75-workload-socket\") on node \"ip-10-0-143-166.ec2.internal\" DevicePath \"\""
Jul 23 16:51:40.310392 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:51:40.310333    2553 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a7b52719-ec86-4b3a-92f7-4cc7075f7a75-istiod-ca-cert\") on node \"ip-10-0-143-166.ec2.internal\" DevicePath \"\""
Jul 23 16:51:40.310552 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:51:40.310421    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a7b52719-ec86-4b3a-92f7-4cc7075f7a75-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "a7b52719-ec86-4b3a-92f7-4cc7075f7a75" (UID: "a7b52719-ec86-4b3a-92f7-4cc7075f7a75"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 16:51:40.310552 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:51:40.310459    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a7b52719-ec86-4b3a-92f7-4cc7075f7a75-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "a7b52719-ec86-4b3a-92f7-4cc7075f7a75" (UID: "a7b52719-ec86-4b3a-92f7-4cc7075f7a75"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 16:51:40.311038 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:51:40.311009    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a7b52719-ec86-4b3a-92f7-4cc7075f7a75-istio-data" (OuterVolumeSpecName: "istio-data") pod "a7b52719-ec86-4b3a-92f7-4cc7075f7a75" (UID: "a7b52719-ec86-4b3a-92f7-4cc7075f7a75"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 16:51:40.312307 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:51:40.312273    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/a7b52719-ec86-4b3a-92f7-4cc7075f7a75-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "a7b52719-ec86-4b3a-92f7-4cc7075f7a75" (UID: "a7b52719-ec86-4b3a-92f7-4cc7075f7a75"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 23 16:51:40.312415 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:51:40.312365    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a7b52719-ec86-4b3a-92f7-4cc7075f7a75-istio-token" (OuterVolumeSpecName: "istio-token") pod "a7b52719-ec86-4b3a-92f7-4cc7075f7a75" (UID: "a7b52719-ec86-4b3a-92f7-4cc7075f7a75"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 16:51:40.312527 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:51:40.312502    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a7b52719-ec86-4b3a-92f7-4cc7075f7a75-kube-api-access-hhm6b" (OuterVolumeSpecName: "kube-api-access-hhm6b") pod "a7b52719-ec86-4b3a-92f7-4cc7075f7a75" (UID: "a7b52719-ec86-4b3a-92f7-4cc7075f7a75"). InnerVolumeSpecName "kube-api-access-hhm6b". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 16:51:40.312623 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:51:40.312540    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a7b52719-ec86-4b3a-92f7-4cc7075f7a75-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "a7b52719-ec86-4b3a-92f7-4cc7075f7a75" (UID: "a7b52719-ec86-4b3a-92f7-4cc7075f7a75"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 16:51:40.411195 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:51:40.411034    2553 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a7b52719-ec86-4b3a-92f7-4cc7075f7a75-istio-envoy\") on node \"ip-10-0-143-166.ec2.internal\" DevicePath \"\""
Jul 23 16:51:40.411195 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:51:40.411085    2553 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a7b52719-ec86-4b3a-92f7-4cc7075f7a75-workload-certs\") on node \"ip-10-0-143-166.ec2.internal\" DevicePath \"\""
Jul 23 16:51:40.411195 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:51:40.411096    2553 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a7b52719-ec86-4b3a-92f7-4cc7075f7a75-istio-podinfo\") on node \"ip-10-0-143-166.ec2.internal\" DevicePath \"\""
Jul 23 16:51:40.411195 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:51:40.411109    2553 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a7b52719-ec86-4b3a-92f7-4cc7075f7a75-credential-socket\") on node \"ip-10-0-143-166.ec2.internal\" DevicePath \"\""
Jul 23 16:51:40.411195 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:51:40.411123    2553 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a7b52719-ec86-4b3a-92f7-4cc7075f7a75-istio-data\") on node \"ip-10-0-143-166.ec2.internal\" DevicePath \"\""
Jul 23 16:51:40.411195 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:51:40.411138    2553 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a7b52719-ec86-4b3a-92f7-4cc7075f7a75-istio-token\") on node \"ip-10-0-143-166.ec2.internal\" DevicePath \"\""
Jul 23 16:51:40.411195 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:51:40.411150    2553 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hhm6b\" (UniqueName: \"kubernetes.io/projected/a7b52719-ec86-4b3a-92f7-4cc7075f7a75-kube-api-access-hhm6b\") on node \"ip-10-0-143-166.ec2.internal\" DevicePath \"\""
Jul 23 16:51:40.829739 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:51:40.829697    2553 generic.go:356] "Generic (PLEG): container finished" podID="a7b52719-ec86-4b3a-92f7-4cc7075f7a75" containerID="d2a47a40c8a9bab3557f6bc8738dcb5991cf47825f326680311e77957a20499f" exitCode=0
Jul 23 16:51:40.829945 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:51:40.829761    2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-4fef36f3-openshift-default-677b8fc8c9-qn7mx"
Jul 23 16:51:40.829945 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:51:40.829790    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-4fef36f3-openshift-default-677b8fc8c9-qn7mx" event={"ID":"a7b52719-ec86-4b3a-92f7-4cc7075f7a75","Type":"ContainerDied","Data":"d2a47a40c8a9bab3557f6bc8738dcb5991cf47825f326680311e77957a20499f"}
Jul 23 16:51:40.829945 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:51:40.829852    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-4fef36f3-openshift-default-677b8fc8c9-qn7mx" event={"ID":"a7b52719-ec86-4b3a-92f7-4cc7075f7a75","Type":"ContainerDied","Data":"2a878ade522f07a3d61443b79a75747268d2ddf3c4d19c256d99a0fef4861585"}
Jul 23 16:51:40.829945 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:51:40.829875    2553 scope.go:117] "RemoveContainer" containerID="d2a47a40c8a9bab3557f6bc8738dcb5991cf47825f326680311e77957a20499f"
Jul 23 16:51:40.839863 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:51:40.839832    2553 scope.go:117] "RemoveContainer" containerID="67212d48ea6a6c8b80f55900c2c5d948582d707a6f570eb9b6ec1d0f36a74df5"
Jul 23 16:51:40.848968 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:51:40.848943    2553 scope.go:117] "RemoveContainer" containerID="d2a47a40c8a9bab3557f6bc8738dcb5991cf47825f326680311e77957a20499f"
Jul 23 16:51:40.849323 ip-10-0-143-166 kubenswrapper[2553]: E0723 16:51:40.849300    2553 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d2a47a40c8a9bab3557f6bc8738dcb5991cf47825f326680311e77957a20499f\": container with ID starting with d2a47a40c8a9bab3557f6bc8738dcb5991cf47825f326680311e77957a20499f not found: ID does not exist" containerID="d2a47a40c8a9bab3557f6bc8738dcb5991cf47825f326680311e77957a20499f"
Jul 23 16:51:40.849422 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:51:40.849338    2553 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d2a47a40c8a9bab3557f6bc8738dcb5991cf47825f326680311e77957a20499f"} err="failed to get container status \"d2a47a40c8a9bab3557f6bc8738dcb5991cf47825f326680311e77957a20499f\": rpc error: code = NotFound desc = could not find container \"d2a47a40c8a9bab3557f6bc8738dcb5991cf47825f326680311e77957a20499f\": container with ID starting with d2a47a40c8a9bab3557f6bc8738dcb5991cf47825f326680311e77957a20499f not found: ID does not exist"
Jul 23 16:51:40.849422 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:51:40.849357    2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-4fef36f3-openshift-default-677b8fc8c9-qn7mx"]
Jul 23 16:51:40.849422 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:51:40.849367    2553 scope.go:117] "RemoveContainer" containerID="67212d48ea6a6c8b80f55900c2c5d948582d707a6f570eb9b6ec1d0f36a74df5"
Jul 23 16:51:40.849652 ip-10-0-143-166 kubenswrapper[2553]: E0723 16:51:40.849633    2553 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"67212d48ea6a6c8b80f55900c2c5d948582d707a6f570eb9b6ec1d0f36a74df5\": container with ID starting with 67212d48ea6a6c8b80f55900c2c5d948582d707a6f570eb9b6ec1d0f36a74df5 not found: ID does not exist" containerID="67212d48ea6a6c8b80f55900c2c5d948582d707a6f570eb9b6ec1d0f36a74df5"
Jul 23 16:51:40.849730 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:51:40.849663    2553 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"67212d48ea6a6c8b80f55900c2c5d948582d707a6f570eb9b6ec1d0f36a74df5"} err="failed to get container status \"67212d48ea6a6c8b80f55900c2c5d948582d707a6f570eb9b6ec1d0f36a74df5\": rpc error: code = NotFound desc = could not find container \"67212d48ea6a6c8b80f55900c2c5d948582d707a6f570eb9b6ec1d0f36a74df5\": container with ID starting with 67212d48ea6a6c8b80f55900c2c5d948582d707a6f570eb9b6ec1d0f36a74df5 not found: ID does not exist"
Jul 23 16:51:40.852563 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:51:40.852540    2553 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-4fef36f3-openshift-default-677b8fc8c9-qn7mx"]
Jul 23 16:51:42.675128 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:51:42.675092    2553 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a7b52719-ec86-4b3a-92f7-4cc7075f7a75" path="/var/lib/kubelet/pods/a7b52719-ec86-4b3a-92f7-4cc7075f7a75/volumes"
Jul 23 16:52:18.826117 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:52:18.826082    2553 scope.go:117] "RemoveContainer" containerID="b49a0ffc37c8b6d086693ddad8e5ec18744ad8f46b9866ddfc4c9638679d67e3"
Jul 23 16:52:18.834969 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:52:18.834951    2553 scope.go:117] "RemoveContainer" containerID="43c09ed959bbcbb40299a6a609219e3a0220df2517ec876b5d16b7f55b5a06ce"
Jul 23 16:52:32.043022 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:52:32.042990    2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-a-546d5f-openshift-default-7759769765-nh4p9"]
Jul 23 16:52:32.043606 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:52:32.043382    2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="03fd948b-ee0b-44b0-a820-37c67826c2fd" containerName="revoke-keys"
Jul 23 16:52:32.043606 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:52:32.043395    2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="03fd948b-ee0b-44b0-a820-37c67826c2fd" containerName="revoke-keys"
Jul 23 16:52:32.043606 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:52:32.043412    2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a7b52719-ec86-4b3a-92f7-4cc7075f7a75" containerName="istio-proxy"
Jul 23 16:52:32.043606 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:52:32.043417    2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="a7b52719-ec86-4b3a-92f7-4cc7075f7a75" containerName="istio-proxy"
Jul 23 16:52:32.043606 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:52:32.043425    2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a7b52719-ec86-4b3a-92f7-4cc7075f7a75" containerName="istio-proxy"
Jul 23 16:52:32.043606 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:52:32.043430    2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="a7b52719-ec86-4b3a-92f7-4cc7075f7a75" containerName="istio-proxy"
Jul 23 16:52:32.043606 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:52:32.043489    2553 memory_manager.go:368] "RemoveStaleState removing state" podUID="a7b52719-ec86-4b3a-92f7-4cc7075f7a75" containerName="istio-proxy"
Jul 23 16:52:32.043606 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:52:32.043497    2553 memory_manager.go:368] "RemoveStaleState removing state" podUID="03fd948b-ee0b-44b0-a820-37c67826c2fd" containerName="revoke-keys"
Jul 23 16:52:32.043606 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:52:32.043505    2553 memory_manager.go:368] "RemoveStaleState removing state" podUID="a7b52719-ec86-4b3a-92f7-4cc7075f7a75" containerName="istio-proxy"
Jul 23 16:52:32.046452 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:52:32.046432    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-546d5f-openshift-default-7759769765-nh4p9"
Jul 23 16:52:32.049344 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:52:32.049322    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Jul 23 16:52:32.049507 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:52:32.049443    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-a-546d5f-openshift-default-dockercfg-cmb8w\""
Jul 23 16:52:32.061037 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:52:32.061004    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1ad377d7-54e3-480b-939e-6c64edc33126-istio-token\") pod \"e2e-inf-a-546d5f-openshift-default-7759769765-nh4p9\" (UID: \"1ad377d7-54e3-480b-939e-6c64edc33126\") " pod="openshift-ingress/e2e-inf-a-546d5f-openshift-default-7759769765-nh4p9"
Jul 23 16:52:32.061209 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:52:32.061049    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1ad377d7-54e3-480b-939e-6c64edc33126-istio-envoy\") pod \"e2e-inf-a-546d5f-openshift-default-7759769765-nh4p9\" (UID: \"1ad377d7-54e3-480b-939e-6c64edc33126\") " pod="openshift-ingress/e2e-inf-a-546d5f-openshift-default-7759769765-nh4p9"
Jul 23 16:52:32.061209 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:52:32.061077    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mthk7\" (UniqueName: \"kubernetes.io/projected/1ad377d7-54e3-480b-939e-6c64edc33126-kube-api-access-mthk7\") pod \"e2e-inf-a-546d5f-openshift-default-7759769765-nh4p9\" (UID: \"1ad377d7-54e3-480b-939e-6c64edc33126\") " pod="openshift-ingress/e2e-inf-a-546d5f-openshift-default-7759769765-nh4p9"
Jul 23 16:52:32.061209 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:52:32.061130    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1ad377d7-54e3-480b-939e-6c64edc33126-istio-data\") pod \"e2e-inf-a-546d5f-openshift-default-7759769765-nh4p9\" (UID: \"1ad377d7-54e3-480b-939e-6c64edc33126\") " pod="openshift-ingress/e2e-inf-a-546d5f-openshift-default-7759769765-nh4p9"
Jul 23 16:52:32.061209 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:52:32.061195    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1ad377d7-54e3-480b-939e-6c64edc33126-workload-certs\") pod \"e2e-inf-a-546d5f-openshift-default-7759769765-nh4p9\" (UID: \"1ad377d7-54e3-480b-939e-6c64edc33126\") " pod="openshift-ingress/e2e-inf-a-546d5f-openshift-default-7759769765-nh4p9"
Jul 23 16:52:32.061448 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:52:32.061222    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1ad377d7-54e3-480b-939e-6c64edc33126-istio-podinfo\") pod \"e2e-inf-a-546d5f-openshift-default-7759769765-nh4p9\" (UID: \"1ad377d7-54e3-480b-939e-6c64edc33126\") " pod="openshift-ingress/e2e-inf-a-546d5f-openshift-default-7759769765-nh4p9"
Jul 23 16:52:32.061448 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:52:32.061243    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1ad377d7-54e3-480b-939e-6c64edc33126-workload-socket\") pod \"e2e-inf-a-546d5f-openshift-default-7759769765-nh4p9\" (UID: \"1ad377d7-54e3-480b-939e-6c64edc33126\") " pod="openshift-ingress/e2e-inf-a-546d5f-openshift-default-7759769765-nh4p9"
Jul 23 16:52:32.061448 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:52:32.061314    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-546d5f-openshift-default-7759769765-nh4p9"]
Jul 23 16:52:32.061448 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:52:32.061328    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1ad377d7-54e3-480b-939e-6c64edc33126-credential-socket\") pod \"e2e-inf-a-546d5f-openshift-default-7759769765-nh4p9\" (UID: \"1ad377d7-54e3-480b-939e-6c64edc33126\") " pod="openshift-ingress/e2e-inf-a-546d5f-openshift-default-7759769765-nh4p9"
Jul 23 16:52:32.061448 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:52:32.061372    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1ad377d7-54e3-480b-939e-6c64edc33126-istiod-ca-cert\") pod \"e2e-inf-a-546d5f-openshift-default-7759769765-nh4p9\" (UID: \"1ad377d7-54e3-480b-939e-6c64edc33126\") " pod="openshift-ingress/e2e-inf-a-546d5f-openshift-default-7759769765-nh4p9"
Jul 23 16:52:32.162591 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:52:32.162559    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1ad377d7-54e3-480b-939e-6c64edc33126-istio-token\") pod \"e2e-inf-a-546d5f-openshift-default-7759769765-nh4p9\" (UID: \"1ad377d7-54e3-480b-939e-6c64edc33126\") " pod="openshift-ingress/e2e-inf-a-546d5f-openshift-default-7759769765-nh4p9"
Jul 23 16:52:32.162770 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:52:32.162603    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1ad377d7-54e3-480b-939e-6c64edc33126-istio-envoy\") pod \"e2e-inf-a-546d5f-openshift-default-7759769765-nh4p9\" (UID: \"1ad377d7-54e3-480b-939e-6c64edc33126\") " pod="openshift-ingress/e2e-inf-a-546d5f-openshift-default-7759769765-nh4p9"
Jul 23 16:52:32.162770 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:52:32.162625    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mthk7\" (UniqueName: \"kubernetes.io/projected/1ad377d7-54e3-480b-939e-6c64edc33126-kube-api-access-mthk7\") pod \"e2e-inf-a-546d5f-openshift-default-7759769765-nh4p9\" (UID: \"1ad377d7-54e3-480b-939e-6c64edc33126\") " pod="openshift-ingress/e2e-inf-a-546d5f-openshift-default-7759769765-nh4p9"
Jul 23 16:52:32.162770 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:52:32.162680    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1ad377d7-54e3-480b-939e-6c64edc33126-istio-data\") pod \"e2e-inf-a-546d5f-openshift-default-7759769765-nh4p9\" (UID: \"1ad377d7-54e3-480b-939e-6c64edc33126\") " pod="openshift-ingress/e2e-inf-a-546d5f-openshift-default-7759769765-nh4p9"
Jul 23 16:52:32.162770 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:52:32.162707    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1ad377d7-54e3-480b-939e-6c64edc33126-workload-certs\") pod \"e2e-inf-a-546d5f-openshift-default-7759769765-nh4p9\" (UID: \"1ad377d7-54e3-480b-939e-6c64edc33126\") " pod="openshift-ingress/e2e-inf-a-546d5f-openshift-default-7759769765-nh4p9"
Jul 23 16:52:32.162770 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:52:32.162731    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1ad377d7-54e3-480b-939e-6c64edc33126-istio-podinfo\") pod \"e2e-inf-a-546d5f-openshift-default-7759769765-nh4p9\" (UID: \"1ad377d7-54e3-480b-939e-6c64edc33126\") " pod="openshift-ingress/e2e-inf-a-546d5f-openshift-default-7759769765-nh4p9"
Jul 23 16:52:32.162770 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:52:32.162758    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1ad377d7-54e3-480b-939e-6c64edc33126-workload-socket\") pod \"e2e-inf-a-546d5f-openshift-default-7759769765-nh4p9\" (UID: \"1ad377d7-54e3-480b-939e-6c64edc33126\") " pod="openshift-ingress/e2e-inf-a-546d5f-openshift-default-7759769765-nh4p9"
Jul 23 16:52:32.163064 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:52:32.162800    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1ad377d7-54e3-480b-939e-6c64edc33126-credential-socket\") pod \"e2e-inf-a-546d5f-openshift-default-7759769765-nh4p9\" (UID: \"1ad377d7-54e3-480b-939e-6c64edc33126\") " pod="openshift-ingress/e2e-inf-a-546d5f-openshift-default-7759769765-nh4p9"
Jul 23 16:52:32.163064 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:52:32.162831    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1ad377d7-54e3-480b-939e-6c64edc33126-istiod-ca-cert\") pod \"e2e-inf-a-546d5f-openshift-default-7759769765-nh4p9\" (UID: \"1ad377d7-54e3-480b-939e-6c64edc33126\") " pod="openshift-ingress/e2e-inf-a-546d5f-openshift-default-7759769765-nh4p9"
Jul 23 16:52:32.163192 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:52:32.163114    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1ad377d7-54e3-480b-939e-6c64edc33126-istio-data\") pod \"e2e-inf-a-546d5f-openshift-default-7759769765-nh4p9\" (UID: \"1ad377d7-54e3-480b-939e-6c64edc33126\") " pod="openshift-ingress/e2e-inf-a-546d5f-openshift-default-7759769765-nh4p9"
Jul 23 16:52:32.163255 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:52:32.163188    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1ad377d7-54e3-480b-939e-6c64edc33126-credential-socket\") pod \"e2e-inf-a-546d5f-openshift-default-7759769765-nh4p9\" (UID: \"1ad377d7-54e3-480b-939e-6c64edc33126\") " pod="openshift-ingress/e2e-inf-a-546d5f-openshift-default-7759769765-nh4p9"
Jul 23 16:52:32.163322 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:52:32.163291    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1ad377d7-54e3-480b-939e-6c64edc33126-workload-socket\") pod \"e2e-inf-a-546d5f-openshift-default-7759769765-nh4p9\" (UID: \"1ad377d7-54e3-480b-939e-6c64edc33126\") " pod="openshift-ingress/e2e-inf-a-546d5f-openshift-default-7759769765-nh4p9"
Jul 23 16:52:32.163629 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:52:32.163605    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1ad377d7-54e3-480b-939e-6c64edc33126-istiod-ca-cert\") pod \"e2e-inf-a-546d5f-openshift-default-7759769765-nh4p9\" (UID: \"1ad377d7-54e3-480b-939e-6c64edc33126\") " pod="openshift-ingress/e2e-inf-a-546d5f-openshift-default-7759769765-nh4p9"
Jul 23 16:52:32.163773 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:52:32.163749    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1ad377d7-54e3-480b-939e-6c64edc33126-workload-certs\") pod \"e2e-inf-a-546d5f-openshift-default-7759769765-nh4p9\" (UID: \"1ad377d7-54e3-480b-939e-6c64edc33126\") " pod="openshift-ingress/e2e-inf-a-546d5f-openshift-default-7759769765-nh4p9"
Jul 23 16:52:32.165153 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:52:32.165130    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1ad377d7-54e3-480b-939e-6c64edc33126-istio-envoy\") pod \"e2e-inf-a-546d5f-openshift-default-7759769765-nh4p9\" (UID: \"1ad377d7-54e3-480b-939e-6c64edc33126\") " pod="openshift-ingress/e2e-inf-a-546d5f-openshift-default-7759769765-nh4p9"
Jul 23 16:52:32.165336 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:52:32.165319    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1ad377d7-54e3-480b-939e-6c64edc33126-istio-podinfo\") pod \"e2e-inf-a-546d5f-openshift-default-7759769765-nh4p9\" (UID: \"1ad377d7-54e3-480b-939e-6c64edc33126\") " pod="openshift-ingress/e2e-inf-a-546d5f-openshift-default-7759769765-nh4p9"
Jul 23 16:52:32.171396 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:52:32.171369    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1ad377d7-54e3-480b-939e-6c64edc33126-istio-token\") pod \"e2e-inf-a-546d5f-openshift-default-7759769765-nh4p9\" (UID: \"1ad377d7-54e3-480b-939e-6c64edc33126\") " pod="openshift-ingress/e2e-inf-a-546d5f-openshift-default-7759769765-nh4p9"
Jul 23 16:52:32.171622 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:52:32.171606    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mthk7\" (UniqueName: \"kubernetes.io/projected/1ad377d7-54e3-480b-939e-6c64edc33126-kube-api-access-mthk7\") pod \"e2e-inf-a-546d5f-openshift-default-7759769765-nh4p9\" (UID: \"1ad377d7-54e3-480b-939e-6c64edc33126\") " pod="openshift-ingress/e2e-inf-a-546d5f-openshift-default-7759769765-nh4p9"
Jul 23 16:52:32.356572 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:52:32.356477    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-546d5f-openshift-default-7759769765-nh4p9"
Jul 23 16:52:32.506125 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:52:32.506101    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-546d5f-openshift-default-7759769765-nh4p9"]
Jul 23 16:52:32.510351 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:52:32.510313    2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1ad377d7_54e3_480b_939e_6c64edc33126.slice/crio-487f5abe37f39545a08b98202f25b7b4b6baf55d70aacad021f80a1b049da30f WatchSource:0}: Error finding container 487f5abe37f39545a08b98202f25b7b4b6baf55d70aacad021f80a1b049da30f: Status 404 returned error can't find the container with id 487f5abe37f39545a08b98202f25b7b4b6baf55d70aacad021f80a1b049da30f
Jul 23 16:52:32.512880 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:52:32.512848    2553 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 23 16:52:32.512961 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:52:32.512914    2553 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 23 16:52:32.512961 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:52:32.512942    2553 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 23 16:52:33.111711 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:52:33.111676    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-546d5f-openshift-default-7759769765-nh4p9" event={"ID":"1ad377d7-54e3-480b-939e-6c64edc33126","Type":"ContainerStarted","Data":"4b56e5319a446bf3ed65e73d0ce1c60e5b52d78e7a3aa01f2d1873b4cc85ad66"}
Jul 23 16:52:33.112265 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:52:33.111733    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-546d5f-openshift-default-7759769765-nh4p9" event={"ID":"1ad377d7-54e3-480b-939e-6c64edc33126","Type":"ContainerStarted","Data":"487f5abe37f39545a08b98202f25b7b4b6baf55d70aacad021f80a1b049da30f"}
Jul 23 16:52:33.136458 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:52:33.136405    2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-a-546d5f-openshift-default-7759769765-nh4p9" podStartSLOduration=1.136389259 podStartE2EDuration="1.136389259s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 16:52:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 16:52:33.134088954 +0000 UTC m=+2234.998695093" watchObservedRunningTime="2026-07-23 16:52:33.136389259 +0000 UTC m=+2235.000995386"
Jul 23 16:52:33.356905 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:52:33.356869    2553 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-546d5f-openshift-default-7759769765-nh4p9"
Jul 23 16:52:33.362327 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:52:33.362261    2553 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-546d5f-openshift-default-7759769765-nh4p9"
Jul 23 16:52:34.117135 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:52:34.117101    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-546d5f-openshift-default-7759769765-nh4p9"
Jul 23 16:52:34.118233 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:52:34.118212    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-546d5f-openshift-default-7759769765-nh4p9"
Jul 23 16:52:40.327416 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:52:40.327374    2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-b-16a998-openshift-default-67489d6475-c2vjw"]
Jul 23 16:52:40.331288 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:52:40.331265    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-16a998-openshift-default-67489d6475-c2vjw"
Jul 23 16:52:40.334243 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:52:40.334221    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-b-16a998-openshift-default-dockercfg-fkzq7\""
Jul 23 16:52:40.346288 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:52:40.346260    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-16a998-openshift-default-67489d6475-c2vjw"]
Jul 23 16:52:40.440298 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:52:40.440256    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/77f1cd1a-bff9-4170-9fe7-970cfeb39428-credential-socket\") pod \"e2e-inf-b-16a998-openshift-default-67489d6475-c2vjw\" (UID: \"77f1cd1a-bff9-4170-9fe7-970cfeb39428\") " pod="openshift-ingress/e2e-inf-b-16a998-openshift-default-67489d6475-c2vjw"
Jul 23 16:52:40.440298 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:52:40.440299    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/77f1cd1a-bff9-4170-9fe7-970cfeb39428-workload-certs\") pod \"e2e-inf-b-16a998-openshift-default-67489d6475-c2vjw\" (UID: \"77f1cd1a-bff9-4170-9fe7-970cfeb39428\") " pod="openshift-ingress/e2e-inf-b-16a998-openshift-default-67489d6475-c2vjw"
Jul 23 16:52:40.440514 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:52:40.440325    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/77f1cd1a-bff9-4170-9fe7-970cfeb39428-istiod-ca-cert\") pod \"e2e-inf-b-16a998-openshift-default-67489d6475-c2vjw\" (UID: \"77f1cd1a-bff9-4170-9fe7-970cfeb39428\") " pod="openshift-ingress/e2e-inf-b-16a998-openshift-default-67489d6475-c2vjw"
Jul 23 16:52:40.440514 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:52:40.440350    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vchkn\" (UniqueName: \"kubernetes.io/projected/77f1cd1a-bff9-4170-9fe7-970cfeb39428-kube-api-access-vchkn\") pod \"e2e-inf-b-16a998-openshift-default-67489d6475-c2vjw\" (UID: \"77f1cd1a-bff9-4170-9fe7-970cfeb39428\") " pod="openshift-ingress/e2e-inf-b-16a998-openshift-default-67489d6475-c2vjw"
Jul 23 16:52:40.440514 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:52:40.440454    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/77f1cd1a-bff9-4170-9fe7-970cfeb39428-istio-data\") pod \"e2e-inf-b-16a998-openshift-default-67489d6475-c2vjw\" (UID: \"77f1cd1a-bff9-4170-9fe7-970cfeb39428\") " pod="openshift-ingress/e2e-inf-b-16a998-openshift-default-67489d6475-c2vjw"
Jul 23 16:52:40.440662 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:52:40.440537    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/77f1cd1a-bff9-4170-9fe7-970cfeb39428-istio-envoy\") pod \"e2e-inf-b-16a998-openshift-default-67489d6475-c2vjw\" (UID: \"77f1cd1a-bff9-4170-9fe7-970cfeb39428\") " pod="openshift-ingress/e2e-inf-b-16a998-openshift-default-67489d6475-c2vjw"
Jul 23 16:52:40.440662 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:52:40.440569    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/77f1cd1a-bff9-4170-9fe7-970cfeb39428-workload-socket\") pod \"e2e-inf-b-16a998-openshift-default-67489d6475-c2vjw\" (UID: \"77f1cd1a-bff9-4170-9fe7-970cfeb39428\") " pod="openshift-ingress/e2e-inf-b-16a998-openshift-default-67489d6475-c2vjw"
Jul 23 16:52:40.440662 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:52:40.440593    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/77f1cd1a-bff9-4170-9fe7-970cfeb39428-istio-podinfo\") pod \"e2e-inf-b-16a998-openshift-default-67489d6475-c2vjw\" (UID: \"77f1cd1a-bff9-4170-9fe7-970cfeb39428\") " pod="openshift-ingress/e2e-inf-b-16a998-openshift-default-67489d6475-c2vjw"
Jul 23 16:52:40.440813 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:52:40.440716    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/77f1cd1a-bff9-4170-9fe7-970cfeb39428-istio-token\") pod \"e2e-inf-b-16a998-openshift-default-67489d6475-c2vjw\" (UID: \"77f1cd1a-bff9-4170-9fe7-970cfeb39428\") " pod="openshift-ingress/e2e-inf-b-16a998-openshift-default-67489d6475-c2vjw"
Jul 23 16:52:40.541250 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:52:40.541207    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/77f1cd1a-bff9-4170-9fe7-970cfeb39428-istio-token\") pod \"e2e-inf-b-16a998-openshift-default-67489d6475-c2vjw\" (UID: \"77f1cd1a-bff9-4170-9fe7-970cfeb39428\") " pod="openshift-ingress/e2e-inf-b-16a998-openshift-default-67489d6475-c2vjw"
Jul 23 16:52:40.541474 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:52:40.541271    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/77f1cd1a-bff9-4170-9fe7-970cfeb39428-credential-socket\") pod \"e2e-inf-b-16a998-openshift-default-67489d6475-c2vjw\" (UID: \"77f1cd1a-bff9-4170-9fe7-970cfeb39428\") " pod="openshift-ingress/e2e-inf-b-16a998-openshift-default-67489d6475-c2vjw"
Jul 23 16:52:40.541474 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:52:40.541297    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/77f1cd1a-bff9-4170-9fe7-970cfeb39428-workload-certs\") pod \"e2e-inf-b-16a998-openshift-default-67489d6475-c2vjw\" (UID: \"77f1cd1a-bff9-4170-9fe7-970cfeb39428\") " pod="openshift-ingress/e2e-inf-b-16a998-openshift-default-67489d6475-c2vjw"
Jul 23 16:52:40.541474 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:52:40.541314    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/77f1cd1a-bff9-4170-9fe7-970cfeb39428-istiod-ca-cert\") pod \"e2e-inf-b-16a998-openshift-default-67489d6475-c2vjw\" (UID: \"77f1cd1a-bff9-4170-9fe7-970cfeb39428\") " pod="openshift-ingress/e2e-inf-b-16a998-openshift-default-67489d6475-c2vjw"
Jul 23 16:52:40.541474 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:52:40.541333    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vchkn\" (UniqueName: \"kubernetes.io/projected/77f1cd1a-bff9-4170-9fe7-970cfeb39428-kube-api-access-vchkn\") pod \"e2e-inf-b-16a998-openshift-default-67489d6475-c2vjw\" (UID: \"77f1cd1a-bff9-4170-9fe7-970cfeb39428\") " pod="openshift-ingress/e2e-inf-b-16a998-openshift-default-67489d6475-c2vjw"
Jul 23 16:52:40.541474 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:52:40.541360    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/77f1cd1a-bff9-4170-9fe7-970cfeb39428-istio-data\") pod \"e2e-inf-b-16a998-openshift-default-67489d6475-c2vjw\" (UID: \"77f1cd1a-bff9-4170-9fe7-970cfeb39428\") " pod="openshift-ingress/e2e-inf-b-16a998-openshift-default-67489d6475-c2vjw"
Jul 23 16:52:40.541474 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:52:40.541422    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/77f1cd1a-bff9-4170-9fe7-970cfeb39428-istio-envoy\") pod \"e2e-inf-b-16a998-openshift-default-67489d6475-c2vjw\" (UID: \"77f1cd1a-bff9-4170-9fe7-970cfeb39428\") " pod="openshift-ingress/e2e-inf-b-16a998-openshift-default-67489d6475-c2vjw"
Jul 23 16:52:40.541474 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:52:40.541451    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/77f1cd1a-bff9-4170-9fe7-970cfeb39428-workload-socket\") pod \"e2e-inf-b-16a998-openshift-default-67489d6475-c2vjw\" (UID: \"77f1cd1a-bff9-4170-9fe7-970cfeb39428\") " pod="openshift-ingress/e2e-inf-b-16a998-openshift-default-67489d6475-c2vjw"
Jul 23 16:52:40.541845 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:52:40.541623    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/77f1cd1a-bff9-4170-9fe7-970cfeb39428-istio-podinfo\") pod \"e2e-inf-b-16a998-openshift-default-67489d6475-c2vjw\" (UID: \"77f1cd1a-bff9-4170-9fe7-970cfeb39428\") " pod="openshift-ingress/e2e-inf-b-16a998-openshift-default-67489d6475-c2vjw"
Jul 23 16:52:40.541845 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:52:40.541766    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/77f1cd1a-bff9-4170-9fe7-970cfeb39428-workload-certs\") pod \"e2e-inf-b-16a998-openshift-default-67489d6475-c2vjw\" (UID: \"77f1cd1a-bff9-4170-9fe7-970cfeb39428\") " pod="openshift-ingress/e2e-inf-b-16a998-openshift-default-67489d6475-c2vjw"
Jul 23 16:52:40.541932 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:52:40.541916    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/77f1cd1a-bff9-4170-9fe7-970cfeb39428-credential-socket\") pod \"e2e-inf-b-16a998-openshift-default-67489d6475-c2vjw\" (UID: \"77f1cd1a-bff9-4170-9fe7-970cfeb39428\") " pod="openshift-ingress/e2e-inf-b-16a998-openshift-default-67489d6475-c2vjw"
Jul 23 16:52:40.541992 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:52:40.541974    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/77f1cd1a-bff9-4170-9fe7-970cfeb39428-workload-socket\") pod \"e2e-inf-b-16a998-openshift-default-67489d6475-c2vjw\" (UID: \"77f1cd1a-bff9-4170-9fe7-970cfeb39428\") " pod="openshift-ingress/e2e-inf-b-16a998-openshift-default-67489d6475-c2vjw"
Jul 23 16:52:40.542052 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:52:40.542016    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/77f1cd1a-bff9-4170-9fe7-970cfeb39428-istio-data\") pod \"e2e-inf-b-16a998-openshift-default-67489d6475-c2vjw\" (UID: \"77f1cd1a-bff9-4170-9fe7-970cfeb39428\") " pod="openshift-ingress/e2e-inf-b-16a998-openshift-default-67489d6475-c2vjw"
Jul 23 16:52:40.542243 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:52:40.542223    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/77f1cd1a-bff9-4170-9fe7-970cfeb39428-istiod-ca-cert\") pod \"e2e-inf-b-16a998-openshift-default-67489d6475-c2vjw\" (UID: \"77f1cd1a-bff9-4170-9fe7-970cfeb39428\") " pod="openshift-ingress/e2e-inf-b-16a998-openshift-default-67489d6475-c2vjw"
Jul 23 16:52:40.543961 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:52:40.543936    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/77f1cd1a-bff9-4170-9fe7-970cfeb39428-istio-envoy\") pod \"e2e-inf-b-16a998-openshift-default-67489d6475-c2vjw\" (UID: \"77f1cd1a-bff9-4170-9fe7-970cfeb39428\") " pod="openshift-ingress/e2e-inf-b-16a998-openshift-default-67489d6475-c2vjw"
Jul 23 16:52:40.544132 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:52:40.544118    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/77f1cd1a-bff9-4170-9fe7-970cfeb39428-istio-podinfo\") pod \"e2e-inf-b-16a998-openshift-default-67489d6475-c2vjw\" (UID: \"77f1cd1a-bff9-4170-9fe7-970cfeb39428\") " pod="openshift-ingress/e2e-inf-b-16a998-openshift-default-67489d6475-c2vjw"
Jul 23 16:52:40.552301 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:52:40.552277    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/77f1cd1a-bff9-4170-9fe7-970cfeb39428-istio-token\") pod \"e2e-inf-b-16a998-openshift-default-67489d6475-c2vjw\" (UID: \"77f1cd1a-bff9-4170-9fe7-970cfeb39428\") " pod="openshift-ingress/e2e-inf-b-16a998-openshift-default-67489d6475-c2vjw"
Jul 23 16:52:40.552442 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:52:40.552418    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vchkn\" (UniqueName: \"kubernetes.io/projected/77f1cd1a-bff9-4170-9fe7-970cfeb39428-kube-api-access-vchkn\") pod \"e2e-inf-b-16a998-openshift-default-67489d6475-c2vjw\" (UID: \"77f1cd1a-bff9-4170-9fe7-970cfeb39428\") " pod="openshift-ingress/e2e-inf-b-16a998-openshift-default-67489d6475-c2vjw"
Jul 23 16:52:40.642113 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:52:40.642077    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-16a998-openshift-default-67489d6475-c2vjw"
Jul 23 16:52:40.789677 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:52:40.789645    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-16a998-openshift-default-67489d6475-c2vjw"]
Jul 23 16:52:40.791441 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:52:40.791406    2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod77f1cd1a_bff9_4170_9fe7_970cfeb39428.slice/crio-2c97d4258655d628f8c28c216076627bb64bcb7566a2c9516867e408c39114a0 WatchSource:0}: Error finding container 2c97d4258655d628f8c28c216076627bb64bcb7566a2c9516867e408c39114a0: Status 404 returned error can't find the container with id 2c97d4258655d628f8c28c216076627bb64bcb7566a2c9516867e408c39114a0
Jul 23 16:52:40.793774 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:52:40.793743    2553 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 23 16:52:40.793858 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:52:40.793809    2553 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 23 16:52:40.793858 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:52:40.793836    2553 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 23 16:52:41.156737 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:52:41.156698    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-16a998-openshift-default-67489d6475-c2vjw" event={"ID":"77f1cd1a-bff9-4170-9fe7-970cfeb39428","Type":"ContainerStarted","Data":"1d192154341eac0a9cc4a2cf8283b5741e6ed48d6e1d4aa66a6f0be3eb0daa97"}
Jul 23 16:52:41.156918 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:52:41.156776    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-16a998-openshift-default-67489d6475-c2vjw" event={"ID":"77f1cd1a-bff9-4170-9fe7-970cfeb39428","Type":"ContainerStarted","Data":"2c97d4258655d628f8c28c216076627bb64bcb7566a2c9516867e408c39114a0"}
Jul 23 16:52:41.179575 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:52:41.179528    2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-b-16a998-openshift-default-67489d6475-c2vjw" podStartSLOduration=1.17951192 podStartE2EDuration="1.17951192s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 16:52:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 16:52:41.177381398 +0000 UTC m=+2243.041987523" watchObservedRunningTime="2026-07-23 16:52:41.17951192 +0000 UTC m=+2243.044118046"
Jul 23 16:52:41.645255 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:52:41.645220    2553 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-16a998-openshift-default-67489d6475-c2vjw"
Jul 23 16:52:41.652276 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:52:41.652233    2553 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-16a998-openshift-default-67489d6475-c2vjw"
Jul 23 16:52:42.161991 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:52:42.161959    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-16a998-openshift-default-67489d6475-c2vjw"
Jul 23 16:52:42.162961 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:52:42.162944    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-16a998-openshift-default-67489d6475-c2vjw"
Jul 23 16:52:49.119058 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:52:49.118979    2553 patch_prober.go:28] interesting pod/e2e-inf-a-546d5f-openshift-default-7759769765-nh4p9 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused" start-of-body=
Jul 23 16:52:49.119058 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:52:49.119033    2553 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-a-546d5f-openshift-default-7759769765-nh4p9" podUID="1ad377d7-54e3-480b-939e-6c64edc33126" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused"
Jul 23 16:52:49.202464 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:52:49.202432    2553 generic.go:356] "Generic (PLEG): container finished" podID="1ad377d7-54e3-480b-939e-6c64edc33126" containerID="4b56e5319a446bf3ed65e73d0ce1c60e5b52d78e7a3aa01f2d1873b4cc85ad66" exitCode=0
Jul 23 16:52:49.202647 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:52:49.202503    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-546d5f-openshift-default-7759769765-nh4p9" event={"ID":"1ad377d7-54e3-480b-939e-6c64edc33126","Type":"ContainerDied","Data":"4b56e5319a446bf3ed65e73d0ce1c60e5b52d78e7a3aa01f2d1873b4cc85ad66"}
Jul 23 16:52:49.202901 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:52:49.202888    2553 scope.go:117] "RemoveContainer" containerID="4b56e5319a446bf3ed65e73d0ce1c60e5b52d78e7a3aa01f2d1873b4cc85ad66"
Jul 23 16:52:49.203900 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:52:49.203876    2553 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 23 16:52:49.203969 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:52:49.203946    2553 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 23 16:52:49.204011 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:52:49.203981    2553 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 23 16:52:50.209449 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:52:50.209415    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-546d5f-openshift-default-7759769765-nh4p9" event={"ID":"1ad377d7-54e3-480b-939e-6c64edc33126","Type":"ContainerStarted","Data":"c9531c5dc187ec2f79fe3f146c32c716e2d2dc6430f91b01c83876b9d5cc2618"}
Jul 23 16:52:50.357971 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:52:50.357937    2553 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-546d5f-openshift-default-7759769765-nh4p9"
Jul 23 16:52:50.358485 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:52:50.358454    2553 patch_prober.go:28] interesting pod/e2e-inf-a-546d5f-openshift-default-7759769765-nh4p9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused" start-of-body=
Jul 23 16:52:50.358603 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:52:50.358514    2553 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-546d5f-openshift-default-7759769765-nh4p9" podUID="1ad377d7-54e3-480b-939e-6c64edc33126" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused"
Jul 23 16:52:51.357565 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:52:51.357472    2553 patch_prober.go:28] interesting pod/e2e-inf-a-546d5f-openshift-default-7759769765-nh4p9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused" start-of-body=
Jul 23 16:52:51.357565 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:52:51.357537    2553 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-546d5f-openshift-default-7759769765-nh4p9" podUID="1ad377d7-54e3-480b-939e-6c64edc33126" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused"
Jul 23 16:52:52.357384 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:52:52.357327    2553 patch_prober.go:28] interesting pod/e2e-inf-a-546d5f-openshift-default-7759769765-nh4p9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused" start-of-body=
Jul 23 16:52:52.357566 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:52:52.357417    2553 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-546d5f-openshift-default-7759769765-nh4p9" podUID="1ad377d7-54e3-480b-939e-6c64edc33126" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused"
Jul 23 16:52:53.357389 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:52:53.357337    2553 patch_prober.go:28] interesting pod/e2e-inf-a-546d5f-openshift-default-7759769765-nh4p9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused" start-of-body=
Jul 23 16:52:53.357913 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:52:53.357414    2553 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-546d5f-openshift-default-7759769765-nh4p9" podUID="1ad377d7-54e3-480b-939e-6c64edc33126" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused"
Jul 23 16:52:54.235125 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:52:54.235014    2553 generic.go:356] "Generic (PLEG): container finished" podID="77f1cd1a-bff9-4170-9fe7-970cfeb39428" containerID="1d192154341eac0a9cc4a2cf8283b5741e6ed48d6e1d4aa66a6f0be3eb0daa97" exitCode=0
Jul 23 16:52:54.235125 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:52:54.235100    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-16a998-openshift-default-67489d6475-c2vjw" event={"ID":"77f1cd1a-bff9-4170-9fe7-970cfeb39428","Type":"ContainerDied","Data":"1d192154341eac0a9cc4a2cf8283b5741e6ed48d6e1d4aa66a6f0be3eb0daa97"}
Jul 23 16:52:54.235544 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:52:54.235529    2553 scope.go:117] "RemoveContainer" containerID="1d192154341eac0a9cc4a2cf8283b5741e6ed48d6e1d4aa66a6f0be3eb0daa97"
Jul 23 16:52:54.236670 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:52:54.236635    2553 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 23 16:52:54.236751 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:52:54.236733    2553 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 23 16:52:54.236796 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:52:54.236780    2553 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 23 16:52:54.361693 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:52:54.361657    2553 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-546d5f-openshift-default-7759769765-nh4p9"
Jul 23 16:52:54.362156 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:52:54.361945    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-546d5f-openshift-default-7759769765-nh4p9"
Jul 23 16:52:54.362764 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:52:54.362746    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-546d5f-openshift-default-7759769765-nh4p9"
Jul 23 16:52:55.242416 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:52:55.242375    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-16a998-openshift-default-67489d6475-c2vjw" event={"ID":"77f1cd1a-bff9-4170-9fe7-970cfeb39428","Type":"ContainerStarted","Data":"9aedd10fd38a1e82b1c1ffe7c47de80e25c0c59d2834f0067804e43092064dcc"}
Jul 23 16:52:55.644613 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:52:55.644052    2553 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-16a998-openshift-default-67489d6475-c2vjw"
Jul 23 16:52:55.644613 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:52:55.644248    2553 patch_prober.go:28] interesting pod/e2e-inf-b-16a998-openshift-default-67489d6475-c2vjw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused" start-of-body=
Jul 23 16:52:55.644613 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:52:55.644309    2553 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-16a998-openshift-default-67489d6475-c2vjw" podUID="77f1cd1a-bff9-4170-9fe7-970cfeb39428" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused"
Jul 23 16:52:56.643090 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:52:56.643044    2553 patch_prober.go:28] interesting pod/e2e-inf-b-16a998-openshift-default-67489d6475-c2vjw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused" start-of-body=
Jul 23 16:52:56.643341 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:52:56.643120    2553 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-16a998-openshift-default-67489d6475-c2vjw" podUID="77f1cd1a-bff9-4170-9fe7-970cfeb39428" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused"
Jul 23 16:52:57.162471 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:52:57.162418    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-16a998-openshift-default-67489d6475-c2vjw"
Jul 23 16:52:57.643546 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:52:57.643499    2553 patch_prober.go:28] interesting pod/e2e-inf-b-16a998-openshift-default-67489d6475-c2vjw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused" start-of-body=
Jul 23 16:52:57.643759 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:52:57.643583    2553 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-16a998-openshift-default-67489d6475-c2vjw" podUID="77f1cd1a-bff9-4170-9fe7-970cfeb39428" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused"
Jul 23 16:52:58.643664 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:52:58.643616    2553 patch_prober.go:28] interesting pod/e2e-inf-b-16a998-openshift-default-67489d6475-c2vjw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused" start-of-body=
Jul 23 16:52:58.644240 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:52:58.643690    2553 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-16a998-openshift-default-67489d6475-c2vjw" podUID="77f1cd1a-bff9-4170-9fe7-970cfeb39428" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused"
Jul 23 16:52:59.647630 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:52:59.647600    2553 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-16a998-openshift-default-67489d6475-c2vjw"
Jul 23 16:52:59.648681 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:52:59.648660    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-16a998-openshift-default-67489d6475-c2vjw"
Jul 23 16:53:18.863609 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:53:18.863578    2553 scope.go:117] "RemoveContainer" containerID="7d20e5a85f0518827a26da06276c700701d7770457a6a6136e2beaf7c7149a7d"
Jul 23 16:54:29.208460 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:54:29.208369    2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-546d5f-r6h8f"]
Jul 23 16:54:29.211747 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:54:29.211730    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-546d5f-r6h8f"
Jul 23 16:54:29.214602 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:54:29.214577    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 23 16:54:29.214602 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:54:29.214577    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-plqcf\""
Jul 23 16:54:29.222224 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:54:29.222197    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-546d5f-r6h8f"]
Jul 23 16:54:29.294952 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:54:29.294916    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c5026718-d23f-4dbf-8325-50d83e005386-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-546d5f-r6h8f\" (UID: \"c5026718-d23f-4dbf-8325-50d83e005386\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-546d5f-r6h8f"
Jul 23 16:54:29.396218 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:54:29.396154    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c5026718-d23f-4dbf-8325-50d83e005386-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-546d5f-r6h8f\" (UID: \"c5026718-d23f-4dbf-8325-50d83e005386\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-546d5f-r6h8f"
Jul 23 16:54:29.396825 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:54:29.396807    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c5026718-d23f-4dbf-8325-50d83e005386-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-546d5f-r6h8f\" (UID: \"c5026718-d23f-4dbf-8325-50d83e005386\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-546d5f-r6h8f"
Jul 23 16:54:29.523305 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:54:29.523217    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-546d5f-r6h8f"
Jul 23 16:54:29.865894 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:54:29.865868    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-546d5f-r6h8f"]
Jul 23 16:54:29.867878 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:54:29.867852    2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc5026718_d23f_4dbf_8325_50d83e005386.slice/crio-4d99de3cdb5f9fc356b9710fa6c05a4fcfb05c04ceb74f522d92feaa66ade776 WatchSource:0}: Error finding container 4d99de3cdb5f9fc356b9710fa6c05a4fcfb05c04ceb74f522d92feaa66ade776: Status 404 returned error can't find the container with id 4d99de3cdb5f9fc356b9710fa6c05a4fcfb05c04ceb74f522d92feaa66ade776
Jul 23 16:54:30.765913 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:54:30.765882    2553 generic.go:356] "Generic (PLEG): container finished" podID="c5026718-d23f-4dbf-8325-50d83e005386" containerID="9995e6496f226c2b5d3279e130b0bc8d4e05c93266a4245460b3880cde188df4" exitCode=0
Jul 23 16:54:30.766320 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:54:30.765939    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-546d5f-r6h8f" event={"ID":"c5026718-d23f-4dbf-8325-50d83e005386","Type":"ContainerDied","Data":"9995e6496f226c2b5d3279e130b0bc8d4e05c93266a4245460b3880cde188df4"}
Jul 23 16:54:30.766320 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:54:30.765981    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-546d5f-r6h8f" event={"ID":"c5026718-d23f-4dbf-8325-50d83e005386","Type":"ContainerStarted","Data":"4d99de3cdb5f9fc356b9710fa6c05a4fcfb05c04ceb74f522d92feaa66ade776"}
Jul 23 16:54:31.905777 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:54:31.905752    2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-546d5f-r6h8f"
Jul 23 16:54:31.921132 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:54:31.921105    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c5026718-d23f-4dbf-8325-50d83e005386-maas-api-service-ca\") pod \"c5026718-d23f-4dbf-8325-50d83e005386\" (UID: \"c5026718-d23f-4dbf-8325-50d83e005386\") "
Jul 23 16:54:31.921528 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:54:31.921508    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c5026718-d23f-4dbf-8325-50d83e005386-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "c5026718-d23f-4dbf-8325-50d83e005386" (UID: "c5026718-d23f-4dbf-8325-50d83e005386"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 23 16:54:32.022154 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:54:32.022061    2553 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c5026718-d23f-4dbf-8325-50d83e005386-maas-api-service-ca\") on node \"ip-10-0-143-166.ec2.internal\" DevicePath \"\""
Jul 23 16:54:32.778031 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:54:32.777999    2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-546d5f-r6h8f"
Jul 23 16:54:32.778225 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:54:32.778040    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-546d5f-r6h8f" event={"ID":"c5026718-d23f-4dbf-8325-50d83e005386","Type":"ContainerDied","Data":"4d99de3cdb5f9fc356b9710fa6c05a4fcfb05c04ceb74f522d92feaa66ade776"}
Jul 23 16:54:32.778225 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:54:32.778087    2553 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="4d99de3cdb5f9fc356b9710fa6c05a4fcfb05c04ceb74f522d92feaa66ade776"
Jul 23 16:54:44.300036 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:54:44.300000    2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-546d5f-r6h8f"]
Jul 23 16:54:44.305332 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:54:44.305310    2553 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-546d5f-r6h8f"]
Jul 23 16:54:44.674782 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:54:44.674739    2553 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c5026718-d23f-4dbf-8325-50d83e005386" path="/var/lib/kubelet/pods/c5026718-d23f-4dbf-8325-50d83e005386/volumes"
Jul 23 16:54:50.830594 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:54:50.830561    2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-546d5f-openshift-default-7759769765-nh4p9"]
Jul 23 16:54:50.831087 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:54:50.830823    2553 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-a-546d5f-openshift-default-7759769765-nh4p9" podUID="1ad377d7-54e3-480b-939e-6c64edc33126" containerName="istio-proxy" containerID="cri-o://c9531c5dc187ec2f79fe3f146c32c716e2d2dc6430f91b01c83876b9d5cc2618" gracePeriod=30
Jul 23 16:54:51.217474 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:54:51.217439    2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-16a998-6b267"]
Jul 23 16:54:51.217801 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:54:51.217788    2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c5026718-d23f-4dbf-8325-50d83e005386" containerName="revoke-keys"
Jul 23 16:54:51.217845 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:54:51.217804    2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="c5026718-d23f-4dbf-8325-50d83e005386" containerName="revoke-keys"
Jul 23 16:54:51.217891 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:54:51.217881    2553 memory_manager.go:368] "RemoveStaleState removing state" podUID="c5026718-d23f-4dbf-8325-50d83e005386" containerName="revoke-keys"
Jul 23 16:54:51.221193 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:54:51.221161    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-16a998-6b267"
Jul 23 16:54:51.224315 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:54:51.224291    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-plqcf\""
Jul 23 16:54:51.224442 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:54:51.224358    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 23 16:54:51.229977 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:54:51.229957    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-16a998-6b267"]
Jul 23 16:54:51.299964 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:54:51.299936    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e2c76b23-ce45-43a0-a689-013f66427795-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-16a998-6b267\" (UID: \"e2c76b23-ce45-43a0-a689-013f66427795\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-16a998-6b267"
Jul 23 16:54:51.400773 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:54:51.400742    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e2c76b23-ce45-43a0-a689-013f66427795-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-16a998-6b267\" (UID: \"e2c76b23-ce45-43a0-a689-013f66427795\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-16a998-6b267"
Jul 23 16:54:51.401415 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:54:51.401397    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e2c76b23-ce45-43a0-a689-013f66427795-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-16a998-6b267\" (UID: \"e2c76b23-ce45-43a0-a689-013f66427795\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-16a998-6b267"
Jul 23 16:54:51.532882 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:54:51.532795    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-16a998-6b267"
Jul 23 16:54:51.676867 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:54:51.676690    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-16a998-6b267"]
Jul 23 16:54:51.882030 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:54:51.881993    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-16a998-6b267" event={"ID":"e2c76b23-ce45-43a0-a689-013f66427795","Type":"ContainerStarted","Data":"9e93ce37a68a55dd97c6824e7a395984aae55fdb9e4e6f894eafb0f77438d516"}
Jul 23 16:54:52.888674 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:54:52.888626    2553 generic.go:356] "Generic (PLEG): container finished" podID="e2c76b23-ce45-43a0-a689-013f66427795" containerID="d487fec327bff0524995191906d8deab4220cce8587d55707f8b83f1d8c511ed" exitCode=0
Jul 23 16:54:52.889100 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:54:52.888761    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-16a998-6b267" event={"ID":"e2c76b23-ce45-43a0-a689-013f66427795","Type":"ContainerDied","Data":"d487fec327bff0524995191906d8deab4220cce8587d55707f8b83f1d8c511ed"}
Jul 23 16:54:54.028124 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:54:54.028088    2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-16a998-6b267"
Jul 23 16:54:54.126270 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:54:54.126233    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e2c76b23-ce45-43a0-a689-013f66427795-maas-api-service-ca\") pod \"e2c76b23-ce45-43a0-a689-013f66427795\" (UID: \"e2c76b23-ce45-43a0-a689-013f66427795\") "
Jul 23 16:54:54.126603 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:54:54.126580    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e2c76b23-ce45-43a0-a689-013f66427795-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "e2c76b23-ce45-43a0-a689-013f66427795" (UID: "e2c76b23-ce45-43a0-a689-013f66427795"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 23 16:54:54.226915 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:54:54.226830    2553 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e2c76b23-ce45-43a0-a689-013f66427795-maas-api-service-ca\") on node \"ip-10-0-143-166.ec2.internal\" DevicePath \"\""
Jul 23 16:54:54.364411 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:54:54.364377    2553 patch_prober.go:28] interesting pod/e2e-inf-a-546d5f-openshift-default-7759769765-nh4p9 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 23 16:54:54.364578 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:54:54.364433    2553 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-a-546d5f-openshift-default-7759769765-nh4p9" podUID="1ad377d7-54e3-480b-939e-6c64edc33126" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 23 16:54:54.901252 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:54:54.901218    2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-16a998-6b267"
Jul 23 16:54:54.901252 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:54:54.901233    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-16a998-6b267" event={"ID":"e2c76b23-ce45-43a0-a689-013f66427795","Type":"ContainerDied","Data":"9e93ce37a68a55dd97c6824e7a395984aae55fdb9e4e6f894eafb0f77438d516"}
Jul 23 16:54:54.901462 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:54:54.901291    2553 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="9e93ce37a68a55dd97c6824e7a395984aae55fdb9e4e6f894eafb0f77438d516"
Jul 23 16:54:56.093876 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:54:56.093813    2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-546d5f-openshift-default-7759769765-nh4p9"
Jul 23 16:54:56.244772 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:54:56.244725    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mthk7\" (UniqueName: \"kubernetes.io/projected/1ad377d7-54e3-480b-939e-6c64edc33126-kube-api-access-mthk7\") pod \"1ad377d7-54e3-480b-939e-6c64edc33126\" (UID: \"1ad377d7-54e3-480b-939e-6c64edc33126\") "
Jul 23 16:54:56.244969 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:54:56.244809    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1ad377d7-54e3-480b-939e-6c64edc33126-istio-data\") pod \"1ad377d7-54e3-480b-939e-6c64edc33126\" (UID: \"1ad377d7-54e3-480b-939e-6c64edc33126\") "
Jul 23 16:54:56.244969 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:54:56.244846    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1ad377d7-54e3-480b-939e-6c64edc33126-istio-envoy\") pod \"1ad377d7-54e3-480b-939e-6c64edc33126\" (UID: \"1ad377d7-54e3-480b-939e-6c64edc33126\") "
Jul 23 16:54:56.244969 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:54:56.244876    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1ad377d7-54e3-480b-939e-6c64edc33126-workload-certs\") pod \"1ad377d7-54e3-480b-939e-6c64edc33126\" (UID: \"1ad377d7-54e3-480b-939e-6c64edc33126\") "
Jul 23 16:54:56.244969 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:54:56.244914    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1ad377d7-54e3-480b-939e-6c64edc33126-credential-socket\") pod \"1ad377d7-54e3-480b-939e-6c64edc33126\" (UID: \"1ad377d7-54e3-480b-939e-6c64edc33126\") "
Jul 23 16:54:56.244969 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:54:56.244953    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1ad377d7-54e3-480b-939e-6c64edc33126-istio-podinfo\") pod \"1ad377d7-54e3-480b-939e-6c64edc33126\" (UID: \"1ad377d7-54e3-480b-939e-6c64edc33126\") "
Jul 23 16:54:56.245344 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:54:56.244986    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1ad377d7-54e3-480b-939e-6c64edc33126-workload-socket\") pod \"1ad377d7-54e3-480b-939e-6c64edc33126\" (UID: \"1ad377d7-54e3-480b-939e-6c64edc33126\") "
Jul 23 16:54:56.245344 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:54:56.245009    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1ad377d7-54e3-480b-939e-6c64edc33126-istio-token\") pod \"1ad377d7-54e3-480b-939e-6c64edc33126\" (UID: \"1ad377d7-54e3-480b-939e-6c64edc33126\") "
Jul 23 16:54:56.245344 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:54:56.245033    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1ad377d7-54e3-480b-939e-6c64edc33126-istiod-ca-cert\") pod \"1ad377d7-54e3-480b-939e-6c64edc33126\" (UID: \"1ad377d7-54e3-480b-939e-6c64edc33126\") "
Jul 23 16:54:56.245344 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:54:56.245225    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1ad377d7-54e3-480b-939e-6c64edc33126-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "1ad377d7-54e3-480b-939e-6c64edc33126" (UID: "1ad377d7-54e3-480b-939e-6c64edc33126"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 16:54:56.245344 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:54:56.245268    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1ad377d7-54e3-480b-939e-6c64edc33126-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "1ad377d7-54e3-480b-939e-6c64edc33126" (UID: "1ad377d7-54e3-480b-939e-6c64edc33126"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 16:54:56.245568 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:54:56.245379    2553 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1ad377d7-54e3-480b-939e-6c64edc33126-workload-certs\") on node \"ip-10-0-143-166.ec2.internal\" DevicePath \"\""
Jul 23 16:54:56.245568 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:54:56.245396    2553 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1ad377d7-54e3-480b-939e-6c64edc33126-credential-socket\") on node \"ip-10-0-143-166.ec2.internal\" DevicePath \"\""
Jul 23 16:54:56.245568 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:54:56.245475    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1ad377d7-54e3-480b-939e-6c64edc33126-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "1ad377d7-54e3-480b-939e-6c64edc33126" (UID: "1ad377d7-54e3-480b-939e-6c64edc33126"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 16:54:56.245738 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:54:56.245567    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1ad377d7-54e3-480b-939e-6c64edc33126-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "1ad377d7-54e3-480b-939e-6c64edc33126" (UID: "1ad377d7-54e3-480b-939e-6c64edc33126"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 23 16:54:56.245738 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:54:56.245687    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1ad377d7-54e3-480b-939e-6c64edc33126-istio-data" (OuterVolumeSpecName: "istio-data") pod "1ad377d7-54e3-480b-939e-6c64edc33126" (UID: "1ad377d7-54e3-480b-939e-6c64edc33126"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 16:54:56.247211 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:54:56.247178    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1ad377d7-54e3-480b-939e-6c64edc33126-kube-api-access-mthk7" (OuterVolumeSpecName: "kube-api-access-mthk7") pod "1ad377d7-54e3-480b-939e-6c64edc33126" (UID: "1ad377d7-54e3-480b-939e-6c64edc33126"). InnerVolumeSpecName "kube-api-access-mthk7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 16:54:56.247331 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:54:56.247231    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1ad377d7-54e3-480b-939e-6c64edc33126-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "1ad377d7-54e3-480b-939e-6c64edc33126" (UID: "1ad377d7-54e3-480b-939e-6c64edc33126"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 16:54:56.247331 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:54:56.247307    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/1ad377d7-54e3-480b-939e-6c64edc33126-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "1ad377d7-54e3-480b-939e-6c64edc33126" (UID: "1ad377d7-54e3-480b-939e-6c64edc33126"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 23 16:54:56.247454 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:54:56.247366    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1ad377d7-54e3-480b-939e-6c64edc33126-istio-token" (OuterVolumeSpecName: "istio-token") pod "1ad377d7-54e3-480b-939e-6c64edc33126" (UID: "1ad377d7-54e3-480b-939e-6c64edc33126"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 16:54:56.346428 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:54:56.346346    2553 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1ad377d7-54e3-480b-939e-6c64edc33126-istio-envoy\") on node \"ip-10-0-143-166.ec2.internal\" DevicePath \"\""
Jul 23 16:54:56.346428 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:54:56.346372    2553 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1ad377d7-54e3-480b-939e-6c64edc33126-istio-podinfo\") on node \"ip-10-0-143-166.ec2.internal\" DevicePath \"\""
Jul 23 16:54:56.346428 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:54:56.346381    2553 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1ad377d7-54e3-480b-939e-6c64edc33126-workload-socket\") on node \"ip-10-0-143-166.ec2.internal\" DevicePath \"\""
Jul 23 16:54:56.346428 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:54:56.346391    2553 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1ad377d7-54e3-480b-939e-6c64edc33126-istio-token\") on node \"ip-10-0-143-166.ec2.internal\" DevicePath \"\""
Jul 23 16:54:56.346428 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:54:56.346399    2553 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1ad377d7-54e3-480b-939e-6c64edc33126-istiod-ca-cert\") on node \"ip-10-0-143-166.ec2.internal\" DevicePath \"\""
Jul 23 16:54:56.346428 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:54:56.346407    2553 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mthk7\" (UniqueName: \"kubernetes.io/projected/1ad377d7-54e3-480b-939e-6c64edc33126-kube-api-access-mthk7\") on node \"ip-10-0-143-166.ec2.internal\" DevicePath \"\""
Jul 23 16:54:56.346428 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:54:56.346417    2553 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1ad377d7-54e3-480b-939e-6c64edc33126-istio-data\") on node \"ip-10-0-143-166.ec2.internal\" DevicePath \"\""
Jul 23 16:54:56.916951 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:54:56.916911    2553 generic.go:356] "Generic (PLEG): container finished" podID="1ad377d7-54e3-480b-939e-6c64edc33126" containerID="c9531c5dc187ec2f79fe3f146c32c716e2d2dc6430f91b01c83876b9d5cc2618" exitCode=0
Jul 23 16:54:56.917158 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:54:56.916994    2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-546d5f-openshift-default-7759769765-nh4p9"
Jul 23 16:54:56.917158 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:54:56.917000    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-546d5f-openshift-default-7759769765-nh4p9" event={"ID":"1ad377d7-54e3-480b-939e-6c64edc33126","Type":"ContainerDied","Data":"c9531c5dc187ec2f79fe3f146c32c716e2d2dc6430f91b01c83876b9d5cc2618"}
Jul 23 16:54:56.917158 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:54:56.917094    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-546d5f-openshift-default-7759769765-nh4p9" event={"ID":"1ad377d7-54e3-480b-939e-6c64edc33126","Type":"ContainerDied","Data":"487f5abe37f39545a08b98202f25b7b4b6baf55d70aacad021f80a1b049da30f"}
Jul 23 16:54:56.917374 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:54:56.917139    2553 scope.go:117] "RemoveContainer" containerID="c9531c5dc187ec2f79fe3f146c32c716e2d2dc6430f91b01c83876b9d5cc2618"
Jul 23 16:54:56.927358 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:54:56.927340    2553 scope.go:117] "RemoveContainer" containerID="4b56e5319a446bf3ed65e73d0ce1c60e5b52d78e7a3aa01f2d1873b4cc85ad66"
Jul 23 16:54:56.935796 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:54:56.935772    2553 scope.go:117] "RemoveContainer" containerID="c9531c5dc187ec2f79fe3f146c32c716e2d2dc6430f91b01c83876b9d5cc2618"
Jul 23 16:54:56.936077 ip-10-0-143-166 kubenswrapper[2553]: E0723 16:54:56.936056    2553 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c9531c5dc187ec2f79fe3f146c32c716e2d2dc6430f91b01c83876b9d5cc2618\": container with ID starting with c9531c5dc187ec2f79fe3f146c32c716e2d2dc6430f91b01c83876b9d5cc2618 not found: ID does not exist" containerID="c9531c5dc187ec2f79fe3f146c32c716e2d2dc6430f91b01c83876b9d5cc2618"
Jul 23 16:54:56.936158 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:54:56.936086    2553 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c9531c5dc187ec2f79fe3f146c32c716e2d2dc6430f91b01c83876b9d5cc2618"} err="failed to get container status \"c9531c5dc187ec2f79fe3f146c32c716e2d2dc6430f91b01c83876b9d5cc2618\": rpc error: code = NotFound desc = could not find container \"c9531c5dc187ec2f79fe3f146c32c716e2d2dc6430f91b01c83876b9d5cc2618\": container with ID starting with c9531c5dc187ec2f79fe3f146c32c716e2d2dc6430f91b01c83876b9d5cc2618 not found: ID does not exist"
Jul 23 16:54:56.936158 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:54:56.936108    2553 scope.go:117] "RemoveContainer" containerID="4b56e5319a446bf3ed65e73d0ce1c60e5b52d78e7a3aa01f2d1873b4cc85ad66"
Jul 23 16:54:56.936413 ip-10-0-143-166 kubenswrapper[2553]: E0723 16:54:56.936395    2553 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4b56e5319a446bf3ed65e73d0ce1c60e5b52d78e7a3aa01f2d1873b4cc85ad66\": container with ID starting with 4b56e5319a446bf3ed65e73d0ce1c60e5b52d78e7a3aa01f2d1873b4cc85ad66 not found: ID does not exist" containerID="4b56e5319a446bf3ed65e73d0ce1c60e5b52d78e7a3aa01f2d1873b4cc85ad66"
Jul 23 16:54:56.936474 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:54:56.936421    2553 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4b56e5319a446bf3ed65e73d0ce1c60e5b52d78e7a3aa01f2d1873b4cc85ad66"} err="failed to get container status \"4b56e5319a446bf3ed65e73d0ce1c60e5b52d78e7a3aa01f2d1873b4cc85ad66\": rpc error: code = NotFound desc = could not find container \"4b56e5319a446bf3ed65e73d0ce1c60e5b52d78e7a3aa01f2d1873b4cc85ad66\": container with ID starting with 4b56e5319a446bf3ed65e73d0ce1c60e5b52d78e7a3aa01f2d1873b4cc85ad66 not found: ID does not exist"
Jul 23 16:54:56.936747 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:54:56.936729    2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-546d5f-openshift-default-7759769765-nh4p9"]
Jul 23 16:54:56.940933 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:54:56.940911    2553 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-a-546d5f-openshift-default-7759769765-nh4p9"]
Jul 23 16:54:58.675767 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:54:58.675735    2553 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1ad377d7-54e3-480b-939e-6c64edc33126" path="/var/lib/kubelet/pods/1ad377d7-54e3-480b-939e-6c64edc33126/volumes"
Jul 23 16:55:06.300388 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:55:06.300352    2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-16a998-6b267"]
Jul 23 16:55:06.302415 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:55:06.302393    2553 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-16a998-6b267"]
Jul 23 16:55:06.674717 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:55:06.674685    2553 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e2c76b23-ce45-43a0-a689-013f66427795" path="/var/lib/kubelet/pods/e2c76b23-ce45-43a0-a689-013f66427795/volumes"
Jul 23 16:55:13.217717 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:55:13.217684    2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-16a998-openshift-default-67489d6475-c2vjw"]
Jul 23 16:55:13.218157 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:55:13.217904    2553 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-b-16a998-openshift-default-67489d6475-c2vjw" podUID="77f1cd1a-bff9-4170-9fe7-970cfeb39428" containerName="istio-proxy" containerID="cri-o://9aedd10fd38a1e82b1c1ffe7c47de80e25c0c59d2834f0067804e43092064dcc" gracePeriod=30
Jul 23 16:55:14.222411 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:55:14.222380    2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-a-74f67a-openshift-default-65fd6968f7-5s9dp"]
Jul 23 16:55:14.222754 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:55:14.222716    2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e2c76b23-ce45-43a0-a689-013f66427795" containerName="revoke-keys"
Jul 23 16:55:14.222754 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:55:14.222727    2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="e2c76b23-ce45-43a0-a689-013f66427795" containerName="revoke-keys"
Jul 23 16:55:14.222754 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:55:14.222741    2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1ad377d7-54e3-480b-939e-6c64edc33126" containerName="istio-proxy"
Jul 23 16:55:14.222754 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:55:14.222746    2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="1ad377d7-54e3-480b-939e-6c64edc33126" containerName="istio-proxy"
Jul 23 16:55:14.222754 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:55:14.222756    2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1ad377d7-54e3-480b-939e-6c64edc33126" containerName="istio-proxy"
Jul 23 16:55:14.222931 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:55:14.222762    2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="1ad377d7-54e3-480b-939e-6c64edc33126" containerName="istio-proxy"
Jul 23 16:55:14.222931 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:55:14.222814    2553 memory_manager.go:368] "RemoveStaleState removing state" podUID="1ad377d7-54e3-480b-939e-6c64edc33126" containerName="istio-proxy"
Jul 23 16:55:14.222931 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:55:14.222824    2553 memory_manager.go:368] "RemoveStaleState removing state" podUID="e2c76b23-ce45-43a0-a689-013f66427795" containerName="revoke-keys"
Jul 23 16:55:14.227541 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:55:14.227516    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-74f67a-openshift-default-65fd6968f7-5s9dp"
Jul 23 16:55:14.230539 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:55:14.230517    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-a-74f67a-openshift-default-dockercfg-ctgmq\""
Jul 23 16:55:14.238731 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:55:14.238707    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-74f67a-openshift-default-65fd6968f7-5s9dp"]
Jul 23 16:55:14.314295 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:55:14.314255    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e6995e72-7316-47eb-8e8b-c573d2c31187-istio-podinfo\") pod \"e2e-api-a-74f67a-openshift-default-65fd6968f7-5s9dp\" (UID: \"e6995e72-7316-47eb-8e8b-c573d2c31187\") " pod="openshift-ingress/e2e-api-a-74f67a-openshift-default-65fd6968f7-5s9dp"
Jul 23 16:55:14.314520 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:55:14.314311    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e6995e72-7316-47eb-8e8b-c573d2c31187-istio-envoy\") pod \"e2e-api-a-74f67a-openshift-default-65fd6968f7-5s9dp\" (UID: \"e6995e72-7316-47eb-8e8b-c573d2c31187\") " pod="openshift-ingress/e2e-api-a-74f67a-openshift-default-65fd6968f7-5s9dp"
Jul 23 16:55:14.314520 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:55:14.314380    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e6995e72-7316-47eb-8e8b-c573d2c31187-istio-token\") pod \"e2e-api-a-74f67a-openshift-default-65fd6968f7-5s9dp\" (UID: \"e6995e72-7316-47eb-8e8b-c573d2c31187\") " pod="openshift-ingress/e2e-api-a-74f67a-openshift-default-65fd6968f7-5s9dp"
Jul 23 16:55:14.314520 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:55:14.314423    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e6995e72-7316-47eb-8e8b-c573d2c31187-istio-data\") pod \"e2e-api-a-74f67a-openshift-default-65fd6968f7-5s9dp\" (UID: \"e6995e72-7316-47eb-8e8b-c573d2c31187\") " pod="openshift-ingress/e2e-api-a-74f67a-openshift-default-65fd6968f7-5s9dp"
Jul 23 16:55:14.314520 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:55:14.314444    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e6995e72-7316-47eb-8e8b-c573d2c31187-credential-socket\") pod \"e2e-api-a-74f67a-openshift-default-65fd6968f7-5s9dp\" (UID: \"e6995e72-7316-47eb-8e8b-c573d2c31187\") " pod="openshift-ingress/e2e-api-a-74f67a-openshift-default-65fd6968f7-5s9dp"
Jul 23 16:55:14.314520 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:55:14.314466    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e6995e72-7316-47eb-8e8b-c573d2c31187-workload-socket\") pod \"e2e-api-a-74f67a-openshift-default-65fd6968f7-5s9dp\" (UID: \"e6995e72-7316-47eb-8e8b-c573d2c31187\") " pod="openshift-ingress/e2e-api-a-74f67a-openshift-default-65fd6968f7-5s9dp"
Jul 23 16:55:14.314520 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:55:14.314520    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e6995e72-7316-47eb-8e8b-c573d2c31187-istiod-ca-cert\") pod \"e2e-api-a-74f67a-openshift-default-65fd6968f7-5s9dp\" (UID: \"e6995e72-7316-47eb-8e8b-c573d2c31187\") " pod="openshift-ingress/e2e-api-a-74f67a-openshift-default-65fd6968f7-5s9dp"
Jul 23 16:55:14.314717 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:55:14.314536    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-27jcn\" (UniqueName: \"kubernetes.io/projected/e6995e72-7316-47eb-8e8b-c573d2c31187-kube-api-access-27jcn\") pod \"e2e-api-a-74f67a-openshift-default-65fd6968f7-5s9dp\" (UID: \"e6995e72-7316-47eb-8e8b-c573d2c31187\") " pod="openshift-ingress/e2e-api-a-74f67a-openshift-default-65fd6968f7-5s9dp"
Jul 23 16:55:14.314717 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:55:14.314610    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e6995e72-7316-47eb-8e8b-c573d2c31187-workload-certs\") pod \"e2e-api-a-74f67a-openshift-default-65fd6968f7-5s9dp\" (UID: \"e6995e72-7316-47eb-8e8b-c573d2c31187\") " pod="openshift-ingress/e2e-api-a-74f67a-openshift-default-65fd6968f7-5s9dp"
Jul 23 16:55:14.415274 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:55:14.415238    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e6995e72-7316-47eb-8e8b-c573d2c31187-istiod-ca-cert\") pod \"e2e-api-a-74f67a-openshift-default-65fd6968f7-5s9dp\" (UID: \"e6995e72-7316-47eb-8e8b-c573d2c31187\") " pod="openshift-ingress/e2e-api-a-74f67a-openshift-default-65fd6968f7-5s9dp"
Jul 23 16:55:14.415274 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:55:14.415278    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-27jcn\" (UniqueName: \"kubernetes.io/projected/e6995e72-7316-47eb-8e8b-c573d2c31187-kube-api-access-27jcn\") pod \"e2e-api-a-74f67a-openshift-default-65fd6968f7-5s9dp\" (UID: \"e6995e72-7316-47eb-8e8b-c573d2c31187\") " pod="openshift-ingress/e2e-api-a-74f67a-openshift-default-65fd6968f7-5s9dp"
Jul 23 16:55:14.415522 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:55:14.415302    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e6995e72-7316-47eb-8e8b-c573d2c31187-workload-certs\") pod \"e2e-api-a-74f67a-openshift-default-65fd6968f7-5s9dp\" (UID: \"e6995e72-7316-47eb-8e8b-c573d2c31187\") " pod="openshift-ingress/e2e-api-a-74f67a-openshift-default-65fd6968f7-5s9dp"
Jul 23 16:55:14.415522 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:55:14.415340    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e6995e72-7316-47eb-8e8b-c573d2c31187-istio-podinfo\") pod \"e2e-api-a-74f67a-openshift-default-65fd6968f7-5s9dp\" (UID: \"e6995e72-7316-47eb-8e8b-c573d2c31187\") " pod="openshift-ingress/e2e-api-a-74f67a-openshift-default-65fd6968f7-5s9dp"
Jul 23 16:55:14.415522 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:55:14.415371    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e6995e72-7316-47eb-8e8b-c573d2c31187-istio-envoy\") pod \"e2e-api-a-74f67a-openshift-default-65fd6968f7-5s9dp\" (UID: \"e6995e72-7316-47eb-8e8b-c573d2c31187\") " pod="openshift-ingress/e2e-api-a-74f67a-openshift-default-65fd6968f7-5s9dp"
Jul 23 16:55:14.415522 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:55:14.415390    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e6995e72-7316-47eb-8e8b-c573d2c31187-istio-token\") pod \"e2e-api-a-74f67a-openshift-default-65fd6968f7-5s9dp\" (UID: \"e6995e72-7316-47eb-8e8b-c573d2c31187\") " pod="openshift-ingress/e2e-api-a-74f67a-openshift-default-65fd6968f7-5s9dp"
Jul 23 16:55:14.415522 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:55:14.415411    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e6995e72-7316-47eb-8e8b-c573d2c31187-istio-data\") pod \"e2e-api-a-74f67a-openshift-default-65fd6968f7-5s9dp\" (UID: \"e6995e72-7316-47eb-8e8b-c573d2c31187\") " pod="openshift-ingress/e2e-api-a-74f67a-openshift-default-65fd6968f7-5s9dp"
Jul 23 16:55:14.415522 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:55:14.415437    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e6995e72-7316-47eb-8e8b-c573d2c31187-credential-socket\") pod \"e2e-api-a-74f67a-openshift-default-65fd6968f7-5s9dp\" (UID: \"e6995e72-7316-47eb-8e8b-c573d2c31187\") " pod="openshift-ingress/e2e-api-a-74f67a-openshift-default-65fd6968f7-5s9dp"
Jul 23 16:55:14.415522 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:55:14.415470    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e6995e72-7316-47eb-8e8b-c573d2c31187-workload-socket\") pod \"e2e-api-a-74f67a-openshift-default-65fd6968f7-5s9dp\" (UID: \"e6995e72-7316-47eb-8e8b-c573d2c31187\") " pod="openshift-ingress/e2e-api-a-74f67a-openshift-default-65fd6968f7-5s9dp"
Jul 23 16:55:14.415882 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:55:14.415755    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e6995e72-7316-47eb-8e8b-c573d2c31187-workload-certs\") pod \"e2e-api-a-74f67a-openshift-default-65fd6968f7-5s9dp\" (UID: \"e6995e72-7316-47eb-8e8b-c573d2c31187\") " pod="openshift-ingress/e2e-api-a-74f67a-openshift-default-65fd6968f7-5s9dp"
Jul 23 16:55:14.415882 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:55:14.415807    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e6995e72-7316-47eb-8e8b-c573d2c31187-istio-data\") pod \"e2e-api-a-74f67a-openshift-default-65fd6968f7-5s9dp\" (UID: \"e6995e72-7316-47eb-8e8b-c573d2c31187\") " pod="openshift-ingress/e2e-api-a-74f67a-openshift-default-65fd6968f7-5s9dp"
Jul 23 16:55:14.415996 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:55:14.415979    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e6995e72-7316-47eb-8e8b-c573d2c31187-workload-socket\") pod \"e2e-api-a-74f67a-openshift-default-65fd6968f7-5s9dp\" (UID: \"e6995e72-7316-47eb-8e8b-c573d2c31187\") " pod="openshift-ingress/e2e-api-a-74f67a-openshift-default-65fd6968f7-5s9dp"
Jul 23 16:55:14.416056 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:55:14.416041    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e6995e72-7316-47eb-8e8b-c573d2c31187-istiod-ca-cert\") pod \"e2e-api-a-74f67a-openshift-default-65fd6968f7-5s9dp\" (UID: \"e6995e72-7316-47eb-8e8b-c573d2c31187\") " pod="openshift-ingress/e2e-api-a-74f67a-openshift-default-65fd6968f7-5s9dp"
Jul 23 16:55:14.416121 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:55:14.416079    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e6995e72-7316-47eb-8e8b-c573d2c31187-credential-socket\") pod \"e2e-api-a-74f67a-openshift-default-65fd6968f7-5s9dp\" (UID: \"e6995e72-7316-47eb-8e8b-c573d2c31187\") " pod="openshift-ingress/e2e-api-a-74f67a-openshift-default-65fd6968f7-5s9dp"
Jul 23 16:55:14.418055 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:55:14.418032    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e6995e72-7316-47eb-8e8b-c573d2c31187-istio-podinfo\") pod \"e2e-api-a-74f67a-openshift-default-65fd6968f7-5s9dp\" (UID: \"e6995e72-7316-47eb-8e8b-c573d2c31187\") " pod="openshift-ingress/e2e-api-a-74f67a-openshift-default-65fd6968f7-5s9dp"
Jul 23 16:55:14.418147 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:55:14.418069    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e6995e72-7316-47eb-8e8b-c573d2c31187-istio-envoy\") pod \"e2e-api-a-74f67a-openshift-default-65fd6968f7-5s9dp\" (UID: \"e6995e72-7316-47eb-8e8b-c573d2c31187\") " pod="openshift-ingress/e2e-api-a-74f67a-openshift-default-65fd6968f7-5s9dp"
Jul 23 16:55:14.426410 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:55:14.426387    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e6995e72-7316-47eb-8e8b-c573d2c31187-istio-token\") pod \"e2e-api-a-74f67a-openshift-default-65fd6968f7-5s9dp\" (UID: \"e6995e72-7316-47eb-8e8b-c573d2c31187\") " pod="openshift-ingress/e2e-api-a-74f67a-openshift-default-65fd6968f7-5s9dp"
Jul 23 16:55:14.426614 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:55:14.426592    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-27jcn\" (UniqueName: \"kubernetes.io/projected/e6995e72-7316-47eb-8e8b-c573d2c31187-kube-api-access-27jcn\") pod \"e2e-api-a-74f67a-openshift-default-65fd6968f7-5s9dp\" (UID: \"e6995e72-7316-47eb-8e8b-c573d2c31187\") " pod="openshift-ingress/e2e-api-a-74f67a-openshift-default-65fd6968f7-5s9dp"
Jul 23 16:55:14.540608 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:55:14.540513    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-74f67a-openshift-default-65fd6968f7-5s9dp"
Jul 23 16:55:14.650755 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:55:14.650705    2553 patch_prober.go:28] interesting pod/e2e-inf-b-16a998-openshift-default-67489d6475-c2vjw container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 23 16:55:14.650933 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:55:14.650763    2553 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-b-16a998-openshift-default-67489d6475-c2vjw" podUID="77f1cd1a-bff9-4170-9fe7-970cfeb39428" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 23 16:55:14.685078 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:55:14.685048    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-74f67a-openshift-default-65fd6968f7-5s9dp"]
Jul 23 16:55:14.686473 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:55:14.686447    2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode6995e72_7316_47eb_8e8b_c573d2c31187.slice/crio-84664ac485080403a1dffb87b3fe25c0d4c445cabd69d06014ddeb18dee19776 WatchSource:0}: Error finding container 84664ac485080403a1dffb87b3fe25c0d4c445cabd69d06014ddeb18dee19776: Status 404 returned error can't find the container with id 84664ac485080403a1dffb87b3fe25c0d4c445cabd69d06014ddeb18dee19776
Jul 23 16:55:14.688563 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:55:14.688533    2553 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 23 16:55:14.688642 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:55:14.688601    2553 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 23 16:55:14.688642 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:55:14.688632    2553 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 23 16:55:15.017877 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:55:15.017843    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-74f67a-openshift-default-65fd6968f7-5s9dp" event={"ID":"e6995e72-7316-47eb-8e8b-c573d2c31187","Type":"ContainerStarted","Data":"cb5588a7b20195d691b4ba62c2ee76404a27c5457fda4b6550e3ef04e7522fcc"}
Jul 23 16:55:15.018069 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:55:15.017900    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-74f67a-openshift-default-65fd6968f7-5s9dp" event={"ID":"e6995e72-7316-47eb-8e8b-c573d2c31187","Type":"ContainerStarted","Data":"84664ac485080403a1dffb87b3fe25c0d4c445cabd69d06014ddeb18dee19776"}
Jul 23 16:55:15.059125 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:55:15.059076    2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-a-74f67a-openshift-default-65fd6968f7-5s9dp" podStartSLOduration=1.059059401 podStartE2EDuration="1.059059401s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 16:55:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 16:55:15.058869177 +0000 UTC m=+2396.923475305" watchObservedRunningTime="2026-07-23 16:55:15.059059401 +0000 UTC m=+2396.923665530"
Jul 23 16:55:15.541533 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:55:15.541491    2553 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-74f67a-openshift-default-65fd6968f7-5s9dp"
Jul 23 16:55:15.546567 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:55:15.546541    2553 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-74f67a-openshift-default-65fd6968f7-5s9dp"
Jul 23 16:55:16.022997 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:55:16.022962    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-74f67a-openshift-default-65fd6968f7-5s9dp"
Jul 23 16:55:16.023852 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:55:16.023833    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-74f67a-openshift-default-65fd6968f7-5s9dp"
Jul 23 16:55:18.478595 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:55:18.478535    2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-16a998-openshift-default-67489d6475-c2vjw"
Jul 23 16:55:18.552354 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:55:18.552326    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/77f1cd1a-bff9-4170-9fe7-970cfeb39428-istio-envoy\") pod \"77f1cd1a-bff9-4170-9fe7-970cfeb39428\" (UID: \"77f1cd1a-bff9-4170-9fe7-970cfeb39428\") "
Jul 23 16:55:18.552515 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:55:18.552381    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vchkn\" (UniqueName: \"kubernetes.io/projected/77f1cd1a-bff9-4170-9fe7-970cfeb39428-kube-api-access-vchkn\") pod \"77f1cd1a-bff9-4170-9fe7-970cfeb39428\" (UID: \"77f1cd1a-bff9-4170-9fe7-970cfeb39428\") "
Jul 23 16:55:18.552515 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:55:18.552403    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/77f1cd1a-bff9-4170-9fe7-970cfeb39428-workload-socket\") pod \"77f1cd1a-bff9-4170-9fe7-970cfeb39428\" (UID: \"77f1cd1a-bff9-4170-9fe7-970cfeb39428\") "
Jul 23 16:55:18.552515 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:55:18.552435    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/77f1cd1a-bff9-4170-9fe7-970cfeb39428-istio-data\") pod \"77f1cd1a-bff9-4170-9fe7-970cfeb39428\" (UID: \"77f1cd1a-bff9-4170-9fe7-970cfeb39428\") "
Jul 23 16:55:18.552515 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:55:18.552454    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/77f1cd1a-bff9-4170-9fe7-970cfeb39428-istio-token\") pod \"77f1cd1a-bff9-4170-9fe7-970cfeb39428\" (UID: \"77f1cd1a-bff9-4170-9fe7-970cfeb39428\") "
Jul 23 16:55:18.552515 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:55:18.552500    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/77f1cd1a-bff9-4170-9fe7-970cfeb39428-istiod-ca-cert\") pod \"77f1cd1a-bff9-4170-9fe7-970cfeb39428\" (UID: \"77f1cd1a-bff9-4170-9fe7-970cfeb39428\") "
Jul 23 16:55:18.552515 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:55:18.552516    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/77f1cd1a-bff9-4170-9fe7-970cfeb39428-workload-certs\") pod \"77f1cd1a-bff9-4170-9fe7-970cfeb39428\" (UID: \"77f1cd1a-bff9-4170-9fe7-970cfeb39428\") "
Jul 23 16:55:18.552858 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:55:18.552539    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/77f1cd1a-bff9-4170-9fe7-970cfeb39428-istio-podinfo\") pod \"77f1cd1a-bff9-4170-9fe7-970cfeb39428\" (UID: \"77f1cd1a-bff9-4170-9fe7-970cfeb39428\") "
Jul 23 16:55:18.552858 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:55:18.552577    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/77f1cd1a-bff9-4170-9fe7-970cfeb39428-credential-socket\") pod \"77f1cd1a-bff9-4170-9fe7-970cfeb39428\" (UID: \"77f1cd1a-bff9-4170-9fe7-970cfeb39428\") "
Jul 23 16:55:18.552858 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:55:18.552700    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/77f1cd1a-bff9-4170-9fe7-970cfeb39428-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "77f1cd1a-bff9-4170-9fe7-970cfeb39428" (UID: "77f1cd1a-bff9-4170-9fe7-970cfeb39428"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 16:55:18.552858 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:55:18.552833    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/77f1cd1a-bff9-4170-9fe7-970cfeb39428-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "77f1cd1a-bff9-4170-9fe7-970cfeb39428" (UID: "77f1cd1a-bff9-4170-9fe7-970cfeb39428"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 16:55:18.553118 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:55:18.552865    2553 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/77f1cd1a-bff9-4170-9fe7-970cfeb39428-workload-socket\") on node \"ip-10-0-143-166.ec2.internal\" DevicePath \"\""
Jul 23 16:55:18.553118 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:55:18.553049    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/77f1cd1a-bff9-4170-9fe7-970cfeb39428-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "77f1cd1a-bff9-4170-9fe7-970cfeb39428" (UID: "77f1cd1a-bff9-4170-9fe7-970cfeb39428"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 16:55:18.553257 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:55:18.553148    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/77f1cd1a-bff9-4170-9fe7-970cfeb39428-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "77f1cd1a-bff9-4170-9fe7-970cfeb39428" (UID: "77f1cd1a-bff9-4170-9fe7-970cfeb39428"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 23 16:55:18.553450 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:55:18.553430    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/77f1cd1a-bff9-4170-9fe7-970cfeb39428-istio-data" (OuterVolumeSpecName: "istio-data") pod "77f1cd1a-bff9-4170-9fe7-970cfeb39428" (UID: "77f1cd1a-bff9-4170-9fe7-970cfeb39428"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 16:55:18.554697 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:55:18.554673    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/77f1cd1a-bff9-4170-9fe7-970cfeb39428-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "77f1cd1a-bff9-4170-9fe7-970cfeb39428" (UID: "77f1cd1a-bff9-4170-9fe7-970cfeb39428"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 16:55:18.554697 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:55:18.554689    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/77f1cd1a-bff9-4170-9fe7-970cfeb39428-kube-api-access-vchkn" (OuterVolumeSpecName: "kube-api-access-vchkn") pod "77f1cd1a-bff9-4170-9fe7-970cfeb39428" (UID: "77f1cd1a-bff9-4170-9fe7-970cfeb39428"). InnerVolumeSpecName "kube-api-access-vchkn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 16:55:18.555003 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:55:18.554982    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/77f1cd1a-bff9-4170-9fe7-970cfeb39428-istio-token" (OuterVolumeSpecName: "istio-token") pod "77f1cd1a-bff9-4170-9fe7-970cfeb39428" (UID: "77f1cd1a-bff9-4170-9fe7-970cfeb39428"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 16:55:18.555003 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:55:18.554993    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/77f1cd1a-bff9-4170-9fe7-970cfeb39428-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "77f1cd1a-bff9-4170-9fe7-970cfeb39428" (UID: "77f1cd1a-bff9-4170-9fe7-970cfeb39428"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 23 16:55:18.653310 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:55:18.653273    2553 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/77f1cd1a-bff9-4170-9fe7-970cfeb39428-credential-socket\") on node \"ip-10-0-143-166.ec2.internal\" DevicePath \"\""
Jul 23 16:55:18.653310 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:55:18.653307    2553 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/77f1cd1a-bff9-4170-9fe7-970cfeb39428-istio-envoy\") on node \"ip-10-0-143-166.ec2.internal\" DevicePath \"\""
Jul 23 16:55:18.653310 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:55:18.653320    2553 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vchkn\" (UniqueName: \"kubernetes.io/projected/77f1cd1a-bff9-4170-9fe7-970cfeb39428-kube-api-access-vchkn\") on node \"ip-10-0-143-166.ec2.internal\" DevicePath \"\""
Jul 23 16:55:18.653563 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:55:18.653332    2553 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/77f1cd1a-bff9-4170-9fe7-970cfeb39428-istio-data\") on node \"ip-10-0-143-166.ec2.internal\" DevicePath \"\""
Jul 23 16:55:18.653563 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:55:18.653344    2553 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/77f1cd1a-bff9-4170-9fe7-970cfeb39428-istio-token\") on node \"ip-10-0-143-166.ec2.internal\" DevicePath \"\""
Jul 23 16:55:18.653563 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:55:18.653355    2553 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/77f1cd1a-bff9-4170-9fe7-970cfeb39428-istiod-ca-cert\") on node \"ip-10-0-143-166.ec2.internal\" DevicePath \"\""
Jul 23 16:55:18.653563 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:55:18.653365    2553 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/77f1cd1a-bff9-4170-9fe7-970cfeb39428-workload-certs\") on node \"ip-10-0-143-166.ec2.internal\" DevicePath \"\""
Jul 23 16:55:18.653563 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:55:18.653374    2553 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/77f1cd1a-bff9-4170-9fe7-970cfeb39428-istio-podinfo\") on node \"ip-10-0-143-166.ec2.internal\" DevicePath \"\""
Jul 23 16:55:18.758390 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:55:18.758300    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-7rmrn_976a7198-cfd3-43d4-8c9f-b1f248d1f6d7/console-operator/1.log"
Jul 23 16:55:18.764672 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:55:18.764647    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-7rmrn_976a7198-cfd3-43d4-8c9f-b1f248d1f6d7/console-operator/1.log"
Jul 23 16:55:18.900534 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:55:18.900500    2553 scope.go:117] "RemoveContainer" containerID="8bc57b083ca070d07d38153256772bf17475c6decdef35427e6959f101eb594a"
Jul 23 16:55:19.040965 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:55:19.040863    2553 generic.go:356] "Generic (PLEG): container finished" podID="77f1cd1a-bff9-4170-9fe7-970cfeb39428" containerID="9aedd10fd38a1e82b1c1ffe7c47de80e25c0c59d2834f0067804e43092064dcc" exitCode=0
Jul 23 16:55:19.040965 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:55:19.040921    2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-16a998-openshift-default-67489d6475-c2vjw"
Jul 23 16:55:19.040965 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:55:19.040951    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-16a998-openshift-default-67489d6475-c2vjw" event={"ID":"77f1cd1a-bff9-4170-9fe7-970cfeb39428","Type":"ContainerDied","Data":"9aedd10fd38a1e82b1c1ffe7c47de80e25c0c59d2834f0067804e43092064dcc"}
Jul 23 16:55:19.041244 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:55:19.041027    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-16a998-openshift-default-67489d6475-c2vjw" event={"ID":"77f1cd1a-bff9-4170-9fe7-970cfeb39428","Type":"ContainerDied","Data":"2c97d4258655d628f8c28c216076627bb64bcb7566a2c9516867e408c39114a0"}
Jul 23 16:55:19.041244 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:55:19.041053    2553 scope.go:117] "RemoveContainer" containerID="9aedd10fd38a1e82b1c1ffe7c47de80e25c0c59d2834f0067804e43092064dcc"
Jul 23 16:55:19.049711 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:55:19.049693    2553 scope.go:117] "RemoveContainer" containerID="1d192154341eac0a9cc4a2cf8283b5741e6ed48d6e1d4aa66a6f0be3eb0daa97"
Jul 23 16:55:19.057642 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:55:19.057624    2553 scope.go:117] "RemoveContainer" containerID="9aedd10fd38a1e82b1c1ffe7c47de80e25c0c59d2834f0067804e43092064dcc"
Jul 23 16:55:19.057892 ip-10-0-143-166 kubenswrapper[2553]: E0723 16:55:19.057872    2553 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9aedd10fd38a1e82b1c1ffe7c47de80e25c0c59d2834f0067804e43092064dcc\": container with ID starting with 9aedd10fd38a1e82b1c1ffe7c47de80e25c0c59d2834f0067804e43092064dcc not found: ID does not exist" containerID="9aedd10fd38a1e82b1c1ffe7c47de80e25c0c59d2834f0067804e43092064dcc"
Jul 23 16:55:19.057972 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:55:19.057905    2553 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9aedd10fd38a1e82b1c1ffe7c47de80e25c0c59d2834f0067804e43092064dcc"} err="failed to get container status \"9aedd10fd38a1e82b1c1ffe7c47de80e25c0c59d2834f0067804e43092064dcc\": rpc error: code = NotFound desc = could not find container \"9aedd10fd38a1e82b1c1ffe7c47de80e25c0c59d2834f0067804e43092064dcc\": container with ID starting with 9aedd10fd38a1e82b1c1ffe7c47de80e25c0c59d2834f0067804e43092064dcc not found: ID does not exist"
Jul 23 16:55:19.057972 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:55:19.057930    2553 scope.go:117] "RemoveContainer" containerID="1d192154341eac0a9cc4a2cf8283b5741e6ed48d6e1d4aa66a6f0be3eb0daa97"
Jul 23 16:55:19.058196 ip-10-0-143-166 kubenswrapper[2553]: E0723 16:55:19.058160    2553 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1d192154341eac0a9cc4a2cf8283b5741e6ed48d6e1d4aa66a6f0be3eb0daa97\": container with ID starting with 1d192154341eac0a9cc4a2cf8283b5741e6ed48d6e1d4aa66a6f0be3eb0daa97 not found: ID does not exist" containerID="1d192154341eac0a9cc4a2cf8283b5741e6ed48d6e1d4aa66a6f0be3eb0daa97"
Jul 23 16:55:19.058237 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:55:19.058202    2553 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1d192154341eac0a9cc4a2cf8283b5741e6ed48d6e1d4aa66a6f0be3eb0daa97"} err="failed to get container status \"1d192154341eac0a9cc4a2cf8283b5741e6ed48d6e1d4aa66a6f0be3eb0daa97\": rpc error: code = NotFound desc = could not find container \"1d192154341eac0a9cc4a2cf8283b5741e6ed48d6e1d4aa66a6f0be3eb0daa97\": container with ID starting with 1d192154341eac0a9cc4a2cf8283b5741e6ed48d6e1d4aa66a6f0be3eb0daa97 not found: ID does not exist"
Jul 23 16:55:19.065264 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:55:19.065242    2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-16a998-openshift-default-67489d6475-c2vjw"]
Jul 23 16:55:19.072202 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:55:19.072181    2553 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-b-16a998-openshift-default-67489d6475-c2vjw"]
Jul 23 16:55:20.674689 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:55:20.674656    2553 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="77f1cd1a-bff9-4170-9fe7-970cfeb39428" path="/var/lib/kubelet/pods/77f1cd1a-bff9-4170-9fe7-970cfeb39428/volumes"
Jul 23 16:55:22.444890 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:55:22.444850    2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-b-e090e9-openshift-default-56cb7d55b9-st9fl"]
Jul 23 16:55:22.445474 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:55:22.445415    2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="77f1cd1a-bff9-4170-9fe7-970cfeb39428" containerName="istio-proxy"
Jul 23 16:55:22.445474 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:55:22.445436    2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="77f1cd1a-bff9-4170-9fe7-970cfeb39428" containerName="istio-proxy"
Jul 23 16:55:22.445474 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:55:22.445452    2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="77f1cd1a-bff9-4170-9fe7-970cfeb39428" containerName="istio-proxy"
Jul 23 16:55:22.445474 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:55:22.445460    2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="77f1cd1a-bff9-4170-9fe7-970cfeb39428" containerName="istio-proxy"
Jul 23 16:55:22.445700 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:55:22.445569    2553 memory_manager.go:368] "RemoveStaleState removing state" podUID="77f1cd1a-bff9-4170-9fe7-970cfeb39428" containerName="istio-proxy"
Jul 23 16:55:22.445700 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:55:22.445583    2553 memory_manager.go:368] "RemoveStaleState removing state" podUID="1ad377d7-54e3-480b-939e-6c64edc33126" containerName="istio-proxy"
Jul 23 16:55:22.450720 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:55:22.450699    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-e090e9-openshift-default-56cb7d55b9-st9fl"
Jul 23 16:55:22.453466 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:55:22.453447    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-b-e090e9-openshift-default-dockercfg-64vrj\""
Jul 23 16:55:22.462371 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:55:22.462349    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-e090e9-openshift-default-56cb7d55b9-st9fl"]
Jul 23 16:55:22.485195 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:55:22.485127    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/70275616-883f-4d70-9577-cd565c31733a-istiod-ca-cert\") pod \"e2e-api-b-e090e9-openshift-default-56cb7d55b9-st9fl\" (UID: \"70275616-883f-4d70-9577-cd565c31733a\") " pod="openshift-ingress/e2e-api-b-e090e9-openshift-default-56cb7d55b9-st9fl"
Jul 23 16:55:22.485395 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:55:22.485219    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/70275616-883f-4d70-9577-cd565c31733a-workload-socket\") pod \"e2e-api-b-e090e9-openshift-default-56cb7d55b9-st9fl\" (UID: \"70275616-883f-4d70-9577-cd565c31733a\") " pod="openshift-ingress/e2e-api-b-e090e9-openshift-default-56cb7d55b9-st9fl"
Jul 23 16:55:22.485395 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:55:22.485262    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/70275616-883f-4d70-9577-cd565c31733a-istio-envoy\") pod \"e2e-api-b-e090e9-openshift-default-56cb7d55b9-st9fl\" (UID: \"70275616-883f-4d70-9577-cd565c31733a\") " pod="openshift-ingress/e2e-api-b-e090e9-openshift-default-56cb7d55b9-st9fl"
Jul 23 16:55:22.485395 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:55:22.485288    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/70275616-883f-4d70-9577-cd565c31733a-workload-certs\") pod \"e2e-api-b-e090e9-openshift-default-56cb7d55b9-st9fl\" (UID: \"70275616-883f-4d70-9577-cd565c31733a\") " pod="openshift-ingress/e2e-api-b-e090e9-openshift-default-56cb7d55b9-st9fl"
Jul 23 16:55:22.485395 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:55:22.485315    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4clqf\" (UniqueName: \"kubernetes.io/projected/70275616-883f-4d70-9577-cd565c31733a-kube-api-access-4clqf\") pod \"e2e-api-b-e090e9-openshift-default-56cb7d55b9-st9fl\" (UID: \"70275616-883f-4d70-9577-cd565c31733a\") " pod="openshift-ingress/e2e-api-b-e090e9-openshift-default-56cb7d55b9-st9fl"
Jul 23 16:55:22.485395 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:55:22.485380    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/70275616-883f-4d70-9577-cd565c31733a-istio-token\") pod \"e2e-api-b-e090e9-openshift-default-56cb7d55b9-st9fl\" (UID: \"70275616-883f-4d70-9577-cd565c31733a\") " pod="openshift-ingress/e2e-api-b-e090e9-openshift-default-56cb7d55b9-st9fl"
Jul 23 16:55:22.485691 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:55:22.485423    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/70275616-883f-4d70-9577-cd565c31733a-istio-podinfo\") pod \"e2e-api-b-e090e9-openshift-default-56cb7d55b9-st9fl\" (UID: \"70275616-883f-4d70-9577-cd565c31733a\") " pod="openshift-ingress/e2e-api-b-e090e9-openshift-default-56cb7d55b9-st9fl"
Jul 23 16:55:22.485691 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:55:22.485479    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/70275616-883f-4d70-9577-cd565c31733a-credential-socket\") pod \"e2e-api-b-e090e9-openshift-default-56cb7d55b9-st9fl\" (UID: \"70275616-883f-4d70-9577-cd565c31733a\") " pod="openshift-ingress/e2e-api-b-e090e9-openshift-default-56cb7d55b9-st9fl"
Jul 23 16:55:22.485691 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:55:22.485521    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/70275616-883f-4d70-9577-cd565c31733a-istio-data\") pod \"e2e-api-b-e090e9-openshift-default-56cb7d55b9-st9fl\" (UID: \"70275616-883f-4d70-9577-cd565c31733a\") " pod="openshift-ingress/e2e-api-b-e090e9-openshift-default-56cb7d55b9-st9fl"
Jul 23 16:55:22.586649 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:55:22.586615    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/70275616-883f-4d70-9577-cd565c31733a-credential-socket\") pod \"e2e-api-b-e090e9-openshift-default-56cb7d55b9-st9fl\" (UID: \"70275616-883f-4d70-9577-cd565c31733a\") " pod="openshift-ingress/e2e-api-b-e090e9-openshift-default-56cb7d55b9-st9fl"
Jul 23 16:55:22.586855 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:55:22.586693    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/70275616-883f-4d70-9577-cd565c31733a-istio-data\") pod \"e2e-api-b-e090e9-openshift-default-56cb7d55b9-st9fl\" (UID: \"70275616-883f-4d70-9577-cd565c31733a\") " pod="openshift-ingress/e2e-api-b-e090e9-openshift-default-56cb7d55b9-st9fl"
Jul 23 16:55:22.586855 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:55:22.586731    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/70275616-883f-4d70-9577-cd565c31733a-istiod-ca-cert\") pod \"e2e-api-b-e090e9-openshift-default-56cb7d55b9-st9fl\" (UID: \"70275616-883f-4d70-9577-cd565c31733a\") " pod="openshift-ingress/e2e-api-b-e090e9-openshift-default-56cb7d55b9-st9fl"
Jul 23 16:55:22.586855 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:55:22.586772    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/70275616-883f-4d70-9577-cd565c31733a-workload-socket\") pod \"e2e-api-b-e090e9-openshift-default-56cb7d55b9-st9fl\" (UID: \"70275616-883f-4d70-9577-cd565c31733a\") " pod="openshift-ingress/e2e-api-b-e090e9-openshift-default-56cb7d55b9-st9fl"
Jul 23 16:55:22.586855 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:55:22.586815    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/70275616-883f-4d70-9577-cd565c31733a-istio-envoy\") pod \"e2e-api-b-e090e9-openshift-default-56cb7d55b9-st9fl\" (UID: \"70275616-883f-4d70-9577-cd565c31733a\") " pod="openshift-ingress/e2e-api-b-e090e9-openshift-default-56cb7d55b9-st9fl"
Jul 23 16:55:22.586855 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:55:22.586839    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/70275616-883f-4d70-9577-cd565c31733a-workload-certs\") pod \"e2e-api-b-e090e9-openshift-default-56cb7d55b9-st9fl\" (UID: \"70275616-883f-4d70-9577-cd565c31733a\") " pod="openshift-ingress/e2e-api-b-e090e9-openshift-default-56cb7d55b9-st9fl"
Jul 23 16:55:22.587120 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:55:22.586921    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4clqf\" (UniqueName: \"kubernetes.io/projected/70275616-883f-4d70-9577-cd565c31733a-kube-api-access-4clqf\") pod \"e2e-api-b-e090e9-openshift-default-56cb7d55b9-st9fl\" (UID: \"70275616-883f-4d70-9577-cd565c31733a\") " pod="openshift-ingress/e2e-api-b-e090e9-openshift-default-56cb7d55b9-st9fl"
Jul 23 16:55:22.587120 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:55:22.586990    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/70275616-883f-4d70-9577-cd565c31733a-credential-socket\") pod \"e2e-api-b-e090e9-openshift-default-56cb7d55b9-st9fl\" (UID: \"70275616-883f-4d70-9577-cd565c31733a\") " pod="openshift-ingress/e2e-api-b-e090e9-openshift-default-56cb7d55b9-st9fl"
Jul 23 16:55:22.587120 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:55:22.586990    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/70275616-883f-4d70-9577-cd565c31733a-istio-token\") pod \"e2e-api-b-e090e9-openshift-default-56cb7d55b9-st9fl\" (UID: \"70275616-883f-4d70-9577-cd565c31733a\") " pod="openshift-ingress/e2e-api-b-e090e9-openshift-default-56cb7d55b9-st9fl"
Jul 23 16:55:22.587120 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:55:22.587047    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/70275616-883f-4d70-9577-cd565c31733a-istio-data\") pod \"e2e-api-b-e090e9-openshift-default-56cb7d55b9-st9fl\" (UID: \"70275616-883f-4d70-9577-cd565c31733a\") " pod="openshift-ingress/e2e-api-b-e090e9-openshift-default-56cb7d55b9-st9fl"
Jul 23 16:55:22.587120 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:55:22.587060    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/70275616-883f-4d70-9577-cd565c31733a-istio-podinfo\") pod \"e2e-api-b-e090e9-openshift-default-56cb7d55b9-st9fl\" (UID: \"70275616-883f-4d70-9577-cd565c31733a\") " pod="openshift-ingress/e2e-api-b-e090e9-openshift-default-56cb7d55b9-st9fl"
Jul 23 16:55:22.587120 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:55:22.587092    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/70275616-883f-4d70-9577-cd565c31733a-workload-socket\") pod \"e2e-api-b-e090e9-openshift-default-56cb7d55b9-st9fl\" (UID: \"70275616-883f-4d70-9577-cd565c31733a\") " pod="openshift-ingress/e2e-api-b-e090e9-openshift-default-56cb7d55b9-st9fl"
Jul 23 16:55:22.587474 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:55:22.587439    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/70275616-883f-4d70-9577-cd565c31733a-workload-certs\") pod \"e2e-api-b-e090e9-openshift-default-56cb7d55b9-st9fl\" (UID: \"70275616-883f-4d70-9577-cd565c31733a\") " pod="openshift-ingress/e2e-api-b-e090e9-openshift-default-56cb7d55b9-st9fl"
Jul 23 16:55:22.587822 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:55:22.587802    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/70275616-883f-4d70-9577-cd565c31733a-istiod-ca-cert\") pod \"e2e-api-b-e090e9-openshift-default-56cb7d55b9-st9fl\" (UID: \"70275616-883f-4d70-9577-cd565c31733a\") " pod="openshift-ingress/e2e-api-b-e090e9-openshift-default-56cb7d55b9-st9fl"
Jul 23 16:55:22.589182 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:55:22.589149    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/70275616-883f-4d70-9577-cd565c31733a-istio-envoy\") pod \"e2e-api-b-e090e9-openshift-default-56cb7d55b9-st9fl\" (UID: \"70275616-883f-4d70-9577-cd565c31733a\") " pod="openshift-ingress/e2e-api-b-e090e9-openshift-default-56cb7d55b9-st9fl"
Jul 23 16:55:22.589470 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:55:22.589452    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/70275616-883f-4d70-9577-cd565c31733a-istio-podinfo\") pod \"e2e-api-b-e090e9-openshift-default-56cb7d55b9-st9fl\" (UID: \"70275616-883f-4d70-9577-cd565c31733a\") " pod="openshift-ingress/e2e-api-b-e090e9-openshift-default-56cb7d55b9-st9fl"
Jul 23 16:55:22.596244 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:55:22.596222    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/70275616-883f-4d70-9577-cd565c31733a-istio-token\") pod \"e2e-api-b-e090e9-openshift-default-56cb7d55b9-st9fl\" (UID: \"70275616-883f-4d70-9577-cd565c31733a\") " pod="openshift-ingress/e2e-api-b-e090e9-openshift-default-56cb7d55b9-st9fl"
Jul 23 16:55:22.596466 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:55:22.596445    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4clqf\" (UniqueName: \"kubernetes.io/projected/70275616-883f-4d70-9577-cd565c31733a-kube-api-access-4clqf\") pod \"e2e-api-b-e090e9-openshift-default-56cb7d55b9-st9fl\" (UID: \"70275616-883f-4d70-9577-cd565c31733a\") " pod="openshift-ingress/e2e-api-b-e090e9-openshift-default-56cb7d55b9-st9fl"
Jul 23 16:55:22.762023 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:55:22.761924    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-e090e9-openshift-default-56cb7d55b9-st9fl"
Jul 23 16:55:22.905808 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:55:22.905778    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-e090e9-openshift-default-56cb7d55b9-st9fl"]
Jul 23 16:55:22.906757 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:55:22.906728    2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod70275616_883f_4d70_9577_cd565c31733a.slice/crio-b18cafde7800badcec4abb55f9466548f548f1bf7769da707dfb9be0ddd5c353 WatchSource:0}: Error finding container b18cafde7800badcec4abb55f9466548f548f1bf7769da707dfb9be0ddd5c353: Status 404 returned error can't find the container with id b18cafde7800badcec4abb55f9466548f548f1bf7769da707dfb9be0ddd5c353
Jul 23 16:55:22.908860 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:55:22.908830    2553 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 23 16:55:22.908958 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:55:22.908893    2553 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 23 16:55:22.908958 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:55:22.908925    2553 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 23 16:55:23.065576 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:55:23.065468    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-e090e9-openshift-default-56cb7d55b9-st9fl" event={"ID":"70275616-883f-4d70-9577-cd565c31733a","Type":"ContainerStarted","Data":"fa11f0e9ca8e7b20eaaa8b485279279fc723d63cf5083d5bce8c0ba3cf24721d"}
Jul 23 16:55:23.065576 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:55:23.065537    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-e090e9-openshift-default-56cb7d55b9-st9fl" event={"ID":"70275616-883f-4d70-9577-cd565c31733a","Type":"ContainerStarted","Data":"b18cafde7800badcec4abb55f9466548f548f1bf7769da707dfb9be0ddd5c353"}
Jul 23 16:55:23.089459 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:55:23.089397    2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-b-e090e9-openshift-default-56cb7d55b9-st9fl" podStartSLOduration=1.089374797 podStartE2EDuration="1.089374797s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 16:55:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 16:55:23.088864466 +0000 UTC m=+2404.953470597" watchObservedRunningTime="2026-07-23 16:55:23.089374797 +0000 UTC m=+2404.953980926"
Jul 23 16:55:23.762354 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:55:23.762312    2553 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-e090e9-openshift-default-56cb7d55b9-st9fl"
Jul 23 16:55:23.767008 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:55:23.766980    2553 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-e090e9-openshift-default-56cb7d55b9-st9fl"
Jul 23 16:55:24.071765 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:55:24.071675    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-e090e9-openshift-default-56cb7d55b9-st9fl"
Jul 23 16:55:24.072614 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:55:24.072598    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-e090e9-openshift-default-56cb7d55b9-st9fl"
Jul 23 16:55:35.132118 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:55:35.132072    2553 generic.go:356] "Generic (PLEG): container finished" podID="e6995e72-7316-47eb-8e8b-c573d2c31187" containerID="cb5588a7b20195d691b4ba62c2ee76404a27c5457fda4b6550e3ef04e7522fcc" exitCode=0
Jul 23 16:55:35.132753 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:55:35.132144    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-74f67a-openshift-default-65fd6968f7-5s9dp" event={"ID":"e6995e72-7316-47eb-8e8b-c573d2c31187","Type":"ContainerDied","Data":"cb5588a7b20195d691b4ba62c2ee76404a27c5457fda4b6550e3ef04e7522fcc"}
Jul 23 16:55:35.132753 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:55:35.132648    2553 scope.go:117] "RemoveContainer" containerID="cb5588a7b20195d691b4ba62c2ee76404a27c5457fda4b6550e3ef04e7522fcc"
Jul 23 16:55:35.134286 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:55:35.134246    2553 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 23 16:55:35.134395 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:55:35.134343    2553 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 23 16:55:35.134395 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:55:35.134391    2553 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 23 16:55:36.143606 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:55:36.143567    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-74f67a-openshift-default-65fd6968f7-5s9dp" event={"ID":"e6995e72-7316-47eb-8e8b-c573d2c31187","Type":"ContainerStarted","Data":"18e6d2dbc3326078218f58b710006b6f172d433bac4c431ecce0d7af968640f3"}
Jul 23 16:55:36.541850 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:55:36.541745    2553 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-74f67a-openshift-default-65fd6968f7-5s9dp"
Jul 23 16:55:36.542140 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:55:36.542050    2553 patch_prober.go:28] interesting pod/e2e-api-a-74f67a-openshift-default-65fd6968f7-5s9dp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.63:15021/healthz/ready\": dial tcp 10.132.0.63:15021: connect: connection refused" start-of-body=
Jul 23 16:55:36.542348 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:55:36.542320    2553 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-74f67a-openshift-default-65fd6968f7-5s9dp" podUID="e6995e72-7316-47eb-8e8b-c573d2c31187" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.63:15021/healthz/ready\": dial tcp 10.132.0.63:15021: connect: connection refused"
Jul 23 16:55:37.541180 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:55:37.541116    2553 patch_prober.go:28] interesting pod/e2e-api-a-74f67a-openshift-default-65fd6968f7-5s9dp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.63:15021/healthz/ready\": dial tcp 10.132.0.63:15021: connect: connection refused" start-of-body=
Jul 23 16:55:37.541731 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:55:37.541209    2553 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-74f67a-openshift-default-65fd6968f7-5s9dp" podUID="e6995e72-7316-47eb-8e8b-c573d2c31187" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.63:15021/healthz/ready\": dial tcp 10.132.0.63:15021: connect: connection refused"
Jul 23 16:55:37.875460 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:55:37.875373    2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-74f67a-fhv8x"]
Jul 23 16:55:37.875869 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:55:37.875853    2553 memory_manager.go:368] "RemoveStaleState removing state" podUID="77f1cd1a-bff9-4170-9fe7-970cfeb39428" containerName="istio-proxy"
Jul 23 16:55:37.878858 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:55:37.878844    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-74f67a-fhv8x"
Jul 23 16:55:37.881528 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:55:37.881501    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-plqcf\""
Jul 23 16:55:37.881663 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:55:37.881566    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 23 16:55:37.887160 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:55:37.887136    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-74f67a-fhv8x"]
Jul 23 16:55:37.939818 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:55:37.939692    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4c066095-1e8d-40c2-b754-42b0c07e3aa0-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-74f67a-fhv8x\" (UID: \"4c066095-1e8d-40c2-b754-42b0c07e3aa0\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-74f67a-fhv8x"
Jul 23 16:55:38.041197 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:55:38.041140    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4c066095-1e8d-40c2-b754-42b0c07e3aa0-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-74f67a-fhv8x\" (UID: \"4c066095-1e8d-40c2-b754-42b0c07e3aa0\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-74f67a-fhv8x"
Jul 23 16:55:38.042440 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:55:38.042240    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4c066095-1e8d-40c2-b754-42b0c07e3aa0-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-74f67a-fhv8x\" (UID: \"4c066095-1e8d-40c2-b754-42b0c07e3aa0\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-74f67a-fhv8x"
Jul 23 16:55:38.190558 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:55:38.190518    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-74f67a-fhv8x"
Jul 23 16:55:38.426905 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:55:38.426870    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-74f67a-fhv8x"]
Jul 23 16:55:38.545190 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:55:38.544558    2553 patch_prober.go:28] interesting pod/e2e-api-a-74f67a-openshift-default-65fd6968f7-5s9dp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.63:15021/healthz/ready\": dial tcp 10.132.0.63:15021: connect: connection refused" start-of-body=
Jul 23 16:55:38.545190 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:55:38.544618    2553 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-74f67a-openshift-default-65fd6968f7-5s9dp" podUID="e6995e72-7316-47eb-8e8b-c573d2c31187" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.63:15021/healthz/ready\": dial tcp 10.132.0.63:15021: connect: connection refused"
Jul 23 16:55:39.174873 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:55:39.174827    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-74f67a-fhv8x" event={"ID":"4c066095-1e8d-40c2-b754-42b0c07e3aa0","Type":"ContainerStarted","Data":"d57ddd362adf0e0ec2bfd1efc394824361764a241e0a6a5685fcbb27756b1e05"}
Jul 23 16:55:39.175083 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:55:39.174900    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-74f67a-fhv8x" event={"ID":"4c066095-1e8d-40c2-b754-42b0c07e3aa0","Type":"ContainerStarted","Data":"46d36988b1ddc92f50ce3a0247cd7ef189e07e53f45ed4bf15c2f66a7fab3538"}
Jul 23 16:55:39.192512 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:55:39.192454    2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-74f67a-fhv8x" podStartSLOduration=2.192439262 podStartE2EDuration="2.192439262s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 16:55:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 16:55:39.189335008 +0000 UTC m=+2421.053941137" watchObservedRunningTime="2026-07-23 16:55:39.192439262 +0000 UTC m=+2421.057045389"
Jul 23 16:55:39.541370 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:55:39.541323    2553 patch_prober.go:28] interesting pod/e2e-api-a-74f67a-openshift-default-65fd6968f7-5s9dp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.63:15021/healthz/ready\": dial tcp 10.132.0.63:15021: connect: connection refused" start-of-body=
Jul 23 16:55:39.541581 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:55:39.541393    2553 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-74f67a-openshift-default-65fd6968f7-5s9dp" podUID="e6995e72-7316-47eb-8e8b-c573d2c31187" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.63:15021/healthz/ready\": dial tcp 10.132.0.63:15021: connect: connection refused"
Jul 23 16:55:40.114378 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:55:40.114331    2553 patch_prober.go:28] interesting pod/e2e-api-b-e090e9-openshift-default-56cb7d55b9-st9fl container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.64:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Jul 23 16:55:40.114909 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:55:40.114420    2553 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-b-e090e9-openshift-default-56cb7d55b9-st9fl" podUID="70275616-883f-4d70-9577-cd565c31733a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.64:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Jul 23 16:55:40.182802 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:55:40.182766    2553 generic.go:356] "Generic (PLEG): container finished" podID="4c066095-1e8d-40c2-b754-42b0c07e3aa0" containerID="d57ddd362adf0e0ec2bfd1efc394824361764a241e0a6a5685fcbb27756b1e05" exitCode=0
Jul 23 16:55:40.183005 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:55:40.182835    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-74f67a-fhv8x" event={"ID":"4c066095-1e8d-40c2-b754-42b0c07e3aa0","Type":"ContainerDied","Data":"d57ddd362adf0e0ec2bfd1efc394824361764a241e0a6a5685fcbb27756b1e05"}
Jul 23 16:55:40.541358 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:55:40.541320    2553 patch_prober.go:28] interesting pod/e2e-api-a-74f67a-openshift-default-65fd6968f7-5s9dp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.63:15021/healthz/ready\": dial tcp 10.132.0.63:15021: connect: connection refused" start-of-body=
Jul 23 16:55:40.541676 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:55:40.541636    2553 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-74f67a-openshift-default-65fd6968f7-5s9dp" podUID="e6995e72-7316-47eb-8e8b-c573d2c31187" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.63:15021/healthz/ready\": dial tcp 10.132.0.63:15021: connect: connection refused"
Jul 23 16:55:41.361718 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:55:41.361691    2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-74f67a-fhv8x"
Jul 23 16:55:41.495132 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:55:41.495042    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4c066095-1e8d-40c2-b754-42b0c07e3aa0-maas-api-service-ca\") pod \"4c066095-1e8d-40c2-b754-42b0c07e3aa0\" (UID: \"4c066095-1e8d-40c2-b754-42b0c07e3aa0\") "
Jul 23 16:55:41.495396 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:55:41.495373    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4c066095-1e8d-40c2-b754-42b0c07e3aa0-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "4c066095-1e8d-40c2-b754-42b0c07e3aa0" (UID: "4c066095-1e8d-40c2-b754-42b0c07e3aa0"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 23 16:55:41.542485 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:55:41.541996    2553 patch_prober.go:28] interesting pod/e2e-api-a-74f67a-openshift-default-65fd6968f7-5s9dp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.63:15021/healthz/ready\": dial tcp 10.132.0.63:15021: connect: connection refused" start-of-body=
Jul 23 16:55:41.542485 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:55:41.542063    2553 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-74f67a-openshift-default-65fd6968f7-5s9dp" podUID="e6995e72-7316-47eb-8e8b-c573d2c31187" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.63:15021/healthz/ready\": dial tcp 10.132.0.63:15021: connect: connection refused"
Jul 23 16:55:41.596466 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:55:41.596424    2553 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4c066095-1e8d-40c2-b754-42b0c07e3aa0-maas-api-service-ca\") on node \"ip-10-0-143-166.ec2.internal\" DevicePath \"\""
Jul 23 16:55:42.193746 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:55:42.193726    2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-74f67a-fhv8x"
Jul 23 16:55:42.193917 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:55:42.193754    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-74f67a-fhv8x" event={"ID":"4c066095-1e8d-40c2-b754-42b0c07e3aa0","Type":"ContainerDied","Data":"46d36988b1ddc92f50ce3a0247cd7ef189e07e53f45ed4bf15c2f66a7fab3538"}
Jul 23 16:55:42.193917 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:55:42.193799    2553 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="46d36988b1ddc92f50ce3a0247cd7ef189e07e53f45ed4bf15c2f66a7fab3538"
Jul 23 16:55:42.195491 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:55:42.195468    2553 generic.go:356] "Generic (PLEG): container finished" podID="70275616-883f-4d70-9577-cd565c31733a" containerID="fa11f0e9ca8e7b20eaaa8b485279279fc723d63cf5083d5bce8c0ba3cf24721d" exitCode=0
Jul 23 16:55:42.195596 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:55:42.195501    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-e090e9-openshift-default-56cb7d55b9-st9fl" event={"ID":"70275616-883f-4d70-9577-cd565c31733a","Type":"ContainerDied","Data":"fa11f0e9ca8e7b20eaaa8b485279279fc723d63cf5083d5bce8c0ba3cf24721d"}
Jul 23 16:55:42.195838 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:55:42.195824    2553 scope.go:117] "RemoveContainer" containerID="fa11f0e9ca8e7b20eaaa8b485279279fc723d63cf5083d5bce8c0ba3cf24721d"
Jul 23 16:55:42.196940 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:55:42.196908    2553 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 23 16:55:42.197014 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:55:42.196994    2553 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 23 16:55:42.197058 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:55:42.197045    2553 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 23 16:55:42.546231 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:55:42.546129    2553 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-74f67a-openshift-default-65fd6968f7-5s9dp"
Jul 23 16:55:42.546697 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:55:42.546571    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-74f67a-openshift-default-65fd6968f7-5s9dp"
Jul 23 16:55:42.547498 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:55:42.547475    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-74f67a-openshift-default-65fd6968f7-5s9dp"
Jul 23 16:55:43.202524 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:55:43.202484    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-e090e9-openshift-default-56cb7d55b9-st9fl" event={"ID":"70275616-883f-4d70-9577-cd565c31733a","Type":"ContainerStarted","Data":"e4c4ad884b55d55eb91dc6e5818d97687c7b7cf2e2a25634fec87af8a3bda3e8"}
Jul 23 16:55:43.762110 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:55:43.762071    2553 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-e090e9-openshift-default-56cb7d55b9-st9fl"
Jul 23 16:55:43.762538 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:55:43.762373    2553 patch_prober.go:28] interesting pod/e2e-api-b-e090e9-openshift-default-56cb7d55b9-st9fl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.64:15021/healthz/ready\": dial tcp 10.132.0.64:15021: connect: connection refused" start-of-body=
Jul 23 16:55:43.762538 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:55:43.762414    2553 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-e090e9-openshift-default-56cb7d55b9-st9fl" podUID="70275616-883f-4d70-9577-cd565c31733a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.64:15021/healthz/ready\": dial tcp 10.132.0.64:15021: connect: connection refused"
Jul 23 16:55:44.762766 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:55:44.762727    2553 patch_prober.go:28] interesting pod/e2e-api-b-e090e9-openshift-default-56cb7d55b9-st9fl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.64:15021/healthz/ready\": dial tcp 10.132.0.64:15021: connect: connection refused" start-of-body=
Jul 23 16:55:44.763223 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:55:44.762801    2553 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-e090e9-openshift-default-56cb7d55b9-st9fl" podUID="70275616-883f-4d70-9577-cd565c31733a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.64:15021/healthz/ready\": dial tcp 10.132.0.64:15021: connect: connection refused"
Jul 23 16:55:45.762973 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:55:45.762936    2553 patch_prober.go:28] interesting pod/e2e-api-b-e090e9-openshift-default-56cb7d55b9-st9fl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.64:15021/healthz/ready\": dial tcp 10.132.0.64:15021: connect: connection refused" start-of-body=
Jul 23 16:55:45.763499 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:55:45.762990    2553 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-e090e9-openshift-default-56cb7d55b9-st9fl" podUID="70275616-883f-4d70-9577-cd565c31733a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.64:15021/healthz/ready\": dial tcp 10.132.0.64:15021: connect: connection refused"
Jul 23 16:55:46.763311 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:55:46.763272    2553 patch_prober.go:28] interesting pod/e2e-api-b-e090e9-openshift-default-56cb7d55b9-st9fl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.64:15021/healthz/ready\": dial tcp 10.132.0.64:15021: connect: connection refused" start-of-body=
Jul 23 16:55:46.763725 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:55:46.763330    2553 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-e090e9-openshift-default-56cb7d55b9-st9fl" podUID="70275616-883f-4d70-9577-cd565c31733a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.64:15021/healthz/ready\": dial tcp 10.132.0.64:15021: connect: connection refused"
Jul 23 16:55:47.765955 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:55:47.765919    2553 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-e090e9-openshift-default-56cb7d55b9-st9fl"
Jul 23 16:55:47.766438 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:55:47.766205    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-e090e9-openshift-default-56cb7d55b9-st9fl"
Jul 23 16:55:47.766942 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:55:47.766925    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-e090e9-openshift-default-56cb7d55b9-st9fl"
Jul 23 16:55:57.961861 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:55:57.961828    2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-74f67a-fhv8x"]
Jul 23 16:55:57.964954 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:55:57.964932    2553 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-74f67a-fhv8x"]
Jul 23 16:55:58.674720 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:55:58.674685    2553 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4c066095-1e8d-40c2-b754-42b0c07e3aa0" path="/var/lib/kubelet/pods/4c066095-1e8d-40c2-b754-42b0c07e3aa0/volumes"
Jul 23 16:56:04.355421 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:56:04.355379    2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-74f67a-openshift-default-65fd6968f7-5s9dp"]
Jul 23 16:56:04.355859 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:56:04.355625    2553 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-api-a-74f67a-openshift-default-65fd6968f7-5s9dp" podUID="e6995e72-7316-47eb-8e8b-c573d2c31187" containerName="istio-proxy" containerID="cri-o://18e6d2dbc3326078218f58b710006b6f172d433bac4c431ecce0d7af968640f3" gracePeriod=30
Jul 23 16:56:04.746004 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:56:04.745966    2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-e090e9-kg4xd"]
Jul 23 16:56:04.746430 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:56:04.746411    2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4c066095-1e8d-40c2-b754-42b0c07e3aa0" containerName="revoke-keys"
Jul 23 16:56:04.746430 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:56:04.746431    2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="4c066095-1e8d-40c2-b754-42b0c07e3aa0" containerName="revoke-keys"
Jul 23 16:56:04.746578 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:56:04.746520    2553 memory_manager.go:368] "RemoveStaleState removing state" podUID="4c066095-1e8d-40c2-b754-42b0c07e3aa0" containerName="revoke-keys"
Jul 23 16:56:04.749897 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:56:04.749877    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-e090e9-kg4xd"
Jul 23 16:56:04.752419 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:56:04.752399    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 23 16:56:04.752522 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:56:04.752472    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-plqcf\""
Jul 23 16:56:04.756925 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:56:04.756893    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-e090e9-kg4xd"]
Jul 23 16:56:04.814313 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:56:04.814276    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/eaf461d8-06dd-42f1-bdf4-72c4b4cb69af-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-b-e090e9-kg4xd\" (UID: \"eaf461d8-06dd-42f1-bdf4-72c4b4cb69af\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-e090e9-kg4xd"
Jul 23 16:56:04.915146 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:56:04.915116    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/eaf461d8-06dd-42f1-bdf4-72c4b4cb69af-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-b-e090e9-kg4xd\" (UID: \"eaf461d8-06dd-42f1-bdf4-72c4b4cb69af\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-e090e9-kg4xd"
Jul 23 16:56:04.915763 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:56:04.915741    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/eaf461d8-06dd-42f1-bdf4-72c4b4cb69af-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-b-e090e9-kg4xd\" (UID: \"eaf461d8-06dd-42f1-bdf4-72c4b4cb69af\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-e090e9-kg4xd"
Jul 23 16:56:05.063037 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:56:05.063008    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-e090e9-kg4xd"
Jul 23 16:56:05.194651 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:56:05.194622    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-e090e9-kg4xd"]
Jul 23 16:56:05.196736 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:56:05.196708    2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeaf461d8_06dd_42f1_bdf4_72c4b4cb69af.slice/crio-72f8e5970a6a65fda7b2332436d95e28fd123a136f2338d027dca634431bb71c WatchSource:0}: Error finding container 72f8e5970a6a65fda7b2332436d95e28fd123a136f2338d027dca634431bb71c: Status 404 returned error can't find the container with id 72f8e5970a6a65fda7b2332436d95e28fd123a136f2338d027dca634431bb71c
Jul 23 16:56:05.322839 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:56:05.322808    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-e090e9-kg4xd" event={"ID":"eaf461d8-06dd-42f1-bdf4-72c4b4cb69af","Type":"ContainerStarted","Data":"72f8e5970a6a65fda7b2332436d95e28fd123a136f2338d027dca634431bb71c"}
Jul 23 16:56:06.330354 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:56:06.330255    2553 generic.go:356] "Generic (PLEG): container finished" podID="eaf461d8-06dd-42f1-bdf4-72c4b4cb69af" containerID="97b80822e1f3d7d35bc52cb5dbb3284b343cea9196bbffa7a2ecad368fd0b878" exitCode=0
Jul 23 16:56:06.330717 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:56:06.330344    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-e090e9-kg4xd" event={"ID":"eaf461d8-06dd-42f1-bdf4-72c4b4cb69af","Type":"ContainerDied","Data":"97b80822e1f3d7d35bc52cb5dbb3284b343cea9196bbffa7a2ecad368fd0b878"}
Jul 23 16:56:07.470754 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:56:07.470725    2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-e090e9-kg4xd"
Jul 23 16:56:07.538510 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:56:07.538481    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/eaf461d8-06dd-42f1-bdf4-72c4b4cb69af-maas-api-service-ca\") pod \"eaf461d8-06dd-42f1-bdf4-72c4b4cb69af\" (UID: \"eaf461d8-06dd-42f1-bdf4-72c4b4cb69af\") "
Jul 23 16:56:07.538830 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:56:07.538806    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/eaf461d8-06dd-42f1-bdf4-72c4b4cb69af-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "eaf461d8-06dd-42f1-bdf4-72c4b4cb69af" (UID: "eaf461d8-06dd-42f1-bdf4-72c4b4cb69af"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 23 16:56:07.640026 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:56:07.639948    2553 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/eaf461d8-06dd-42f1-bdf4-72c4b4cb69af-maas-api-service-ca\") on node \"ip-10-0-143-166.ec2.internal\" DevicePath \"\""
Jul 23 16:56:08.341726 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:56:08.341689    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-e090e9-kg4xd" event={"ID":"eaf461d8-06dd-42f1-bdf4-72c4b4cb69af","Type":"ContainerDied","Data":"72f8e5970a6a65fda7b2332436d95e28fd123a136f2338d027dca634431bb71c"}
Jul 23 16:56:08.341726 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:56:08.341706    2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-e090e9-kg4xd"
Jul 23 16:56:08.341937 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:56:08.341743    2553 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="72f8e5970a6a65fda7b2332436d95e28fd123a136f2338d027dca634431bb71c"
Jul 23 16:56:09.608136 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:56:09.608110    2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-74f67a-openshift-default-65fd6968f7-5s9dp"
Jul 23 16:56:09.657361 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:56:09.657329    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e6995e72-7316-47eb-8e8b-c573d2c31187-istio-token\") pod \"e6995e72-7316-47eb-8e8b-c573d2c31187\" (UID: \"e6995e72-7316-47eb-8e8b-c573d2c31187\") "
Jul 23 16:56:09.657529 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:56:09.657368    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e6995e72-7316-47eb-8e8b-c573d2c31187-workload-socket\") pod \"e6995e72-7316-47eb-8e8b-c573d2c31187\" (UID: \"e6995e72-7316-47eb-8e8b-c573d2c31187\") "
Jul 23 16:56:09.657529 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:56:09.657393    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-27jcn\" (UniqueName: \"kubernetes.io/projected/e6995e72-7316-47eb-8e8b-c573d2c31187-kube-api-access-27jcn\") pod \"e6995e72-7316-47eb-8e8b-c573d2c31187\" (UID: \"e6995e72-7316-47eb-8e8b-c573d2c31187\") "
Jul 23 16:56:09.657529 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:56:09.657431    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e6995e72-7316-47eb-8e8b-c573d2c31187-istio-data\") pod \"e6995e72-7316-47eb-8e8b-c573d2c31187\" (UID: \"e6995e72-7316-47eb-8e8b-c573d2c31187\") "
Jul 23 16:56:09.657529 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:56:09.657452    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e6995e72-7316-47eb-8e8b-c573d2c31187-istio-envoy\") pod \"e6995e72-7316-47eb-8e8b-c573d2c31187\" (UID: \"e6995e72-7316-47eb-8e8b-c573d2c31187\") "
Jul 23 16:56:09.657529 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:56:09.657498    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e6995e72-7316-47eb-8e8b-c573d2c31187-istiod-ca-cert\") pod \"e6995e72-7316-47eb-8e8b-c573d2c31187\" (UID: \"e6995e72-7316-47eb-8e8b-c573d2c31187\") "
Jul 23 16:56:09.657529 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:56:09.657522    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e6995e72-7316-47eb-8e8b-c573d2c31187-workload-certs\") pod \"e6995e72-7316-47eb-8e8b-c573d2c31187\" (UID: \"e6995e72-7316-47eb-8e8b-c573d2c31187\") "
Jul 23 16:56:09.657825 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:56:09.657624    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e6995e72-7316-47eb-8e8b-c573d2c31187-istio-podinfo\") pod \"e6995e72-7316-47eb-8e8b-c573d2c31187\" (UID: \"e6995e72-7316-47eb-8e8b-c573d2c31187\") "
Jul 23 16:56:09.657825 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:56:09.657639    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e6995e72-7316-47eb-8e8b-c573d2c31187-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "e6995e72-7316-47eb-8e8b-c573d2c31187" (UID: "e6995e72-7316-47eb-8e8b-c573d2c31187"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 16:56:09.657825 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:56:09.657657    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e6995e72-7316-47eb-8e8b-c573d2c31187-credential-socket\") pod \"e6995e72-7316-47eb-8e8b-c573d2c31187\" (UID: \"e6995e72-7316-47eb-8e8b-c573d2c31187\") "
Jul 23 16:56:09.658005 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:56:09.657897    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e6995e72-7316-47eb-8e8b-c573d2c31187-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "e6995e72-7316-47eb-8e8b-c573d2c31187" (UID: "e6995e72-7316-47eb-8e8b-c573d2c31187"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 23 16:56:09.658064 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:56:09.658031    2553 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e6995e72-7316-47eb-8e8b-c573d2c31187-workload-socket\") on node \"ip-10-0-143-166.ec2.internal\" DevicePath \"\""
Jul 23 16:56:09.658064 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:56:09.658052    2553 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e6995e72-7316-47eb-8e8b-c573d2c31187-istiod-ca-cert\") on node \"ip-10-0-143-166.ec2.internal\" DevicePath \"\""
Jul 23 16:56:09.658209 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:56:09.658079    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e6995e72-7316-47eb-8e8b-c573d2c31187-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "e6995e72-7316-47eb-8e8b-c573d2c31187" (UID: "e6995e72-7316-47eb-8e8b-c573d2c31187"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 16:56:09.658209 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:56:09.658093    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e6995e72-7316-47eb-8e8b-c573d2c31187-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "e6995e72-7316-47eb-8e8b-c573d2c31187" (UID: "e6995e72-7316-47eb-8e8b-c573d2c31187"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 16:56:09.658451 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:56:09.658418    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e6995e72-7316-47eb-8e8b-c573d2c31187-istio-data" (OuterVolumeSpecName: "istio-data") pod "e6995e72-7316-47eb-8e8b-c573d2c31187" (UID: "e6995e72-7316-47eb-8e8b-c573d2c31187"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 16:56:09.659715 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:56:09.659684    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e6995e72-7316-47eb-8e8b-c573d2c31187-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "e6995e72-7316-47eb-8e8b-c573d2c31187" (UID: "e6995e72-7316-47eb-8e8b-c573d2c31187"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 16:56:09.659813 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:56:09.659733    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/e6995e72-7316-47eb-8e8b-c573d2c31187-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "e6995e72-7316-47eb-8e8b-c573d2c31187" (UID: "e6995e72-7316-47eb-8e8b-c573d2c31187"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 23 16:56:09.659813 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:56:09.659747    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e6995e72-7316-47eb-8e8b-c573d2c31187-istio-token" (OuterVolumeSpecName: "istio-token") pod "e6995e72-7316-47eb-8e8b-c573d2c31187" (UID: "e6995e72-7316-47eb-8e8b-c573d2c31187"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 16:56:09.659885 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:56:09.659860    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e6995e72-7316-47eb-8e8b-c573d2c31187-kube-api-access-27jcn" (OuterVolumeSpecName: "kube-api-access-27jcn") pod "e6995e72-7316-47eb-8e8b-c573d2c31187" (UID: "e6995e72-7316-47eb-8e8b-c573d2c31187"). InnerVolumeSpecName "kube-api-access-27jcn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 16:56:09.758560 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:56:09.758528    2553 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e6995e72-7316-47eb-8e8b-c573d2c31187-istio-token\") on node \"ip-10-0-143-166.ec2.internal\" DevicePath \"\""
Jul 23 16:56:09.758560 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:56:09.758556    2553 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-27jcn\" (UniqueName: \"kubernetes.io/projected/e6995e72-7316-47eb-8e8b-c573d2c31187-kube-api-access-27jcn\") on node \"ip-10-0-143-166.ec2.internal\" DevicePath \"\""
Jul 23 16:56:09.758560 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:56:09.758567    2553 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e6995e72-7316-47eb-8e8b-c573d2c31187-istio-data\") on node \"ip-10-0-143-166.ec2.internal\" DevicePath \"\""
Jul 23 16:56:09.758859 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:56:09.758577    2553 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e6995e72-7316-47eb-8e8b-c573d2c31187-istio-envoy\") on node \"ip-10-0-143-166.ec2.internal\" DevicePath \"\""
Jul 23 16:56:09.758859 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:56:09.758585    2553 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e6995e72-7316-47eb-8e8b-c573d2c31187-workload-certs\") on node \"ip-10-0-143-166.ec2.internal\" DevicePath \"\""
Jul 23 16:56:09.758859 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:56:09.758597    2553 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e6995e72-7316-47eb-8e8b-c573d2c31187-istio-podinfo\") on node \"ip-10-0-143-166.ec2.internal\" DevicePath \"\""
Jul 23 16:56:09.758859 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:56:09.758609    2553 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e6995e72-7316-47eb-8e8b-c573d2c31187-credential-socket\") on node \"ip-10-0-143-166.ec2.internal\" DevicePath \"\""
Jul 23 16:56:10.356013 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:56:10.355978    2553 generic.go:356] "Generic (PLEG): container finished" podID="e6995e72-7316-47eb-8e8b-c573d2c31187" containerID="18e6d2dbc3326078218f58b710006b6f172d433bac4c431ecce0d7af968640f3" exitCode=0
Jul 23 16:56:10.356238 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:56:10.356028    2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-74f67a-openshift-default-65fd6968f7-5s9dp"
Jul 23 16:56:10.356238 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:56:10.356052    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-74f67a-openshift-default-65fd6968f7-5s9dp" event={"ID":"e6995e72-7316-47eb-8e8b-c573d2c31187","Type":"ContainerDied","Data":"18e6d2dbc3326078218f58b710006b6f172d433bac4c431ecce0d7af968640f3"}
Jul 23 16:56:10.356238 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:56:10.356094    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-74f67a-openshift-default-65fd6968f7-5s9dp" event={"ID":"e6995e72-7316-47eb-8e8b-c573d2c31187","Type":"ContainerDied","Data":"84664ac485080403a1dffb87b3fe25c0d4c445cabd69d06014ddeb18dee19776"}
Jul 23 16:56:10.356238 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:56:10.356116    2553 scope.go:117] "RemoveContainer" containerID="18e6d2dbc3326078218f58b710006b6f172d433bac4c431ecce0d7af968640f3"
Jul 23 16:56:10.366127 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:56:10.366108    2553 scope.go:117] "RemoveContainer" containerID="cb5588a7b20195d691b4ba62c2ee76404a27c5457fda4b6550e3ef04e7522fcc"
Jul 23 16:56:10.374773 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:56:10.374754    2553 scope.go:117] "RemoveContainer" containerID="18e6d2dbc3326078218f58b710006b6f172d433bac4c431ecce0d7af968640f3"
Jul 23 16:56:10.375068 ip-10-0-143-166 kubenswrapper[2553]: E0723 16:56:10.375049    2553 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"18e6d2dbc3326078218f58b710006b6f172d433bac4c431ecce0d7af968640f3\": container with ID starting with 18e6d2dbc3326078218f58b710006b6f172d433bac4c431ecce0d7af968640f3 not found: ID does not exist" containerID="18e6d2dbc3326078218f58b710006b6f172d433bac4c431ecce0d7af968640f3"
Jul 23 16:56:10.375117 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:56:10.375077    2553 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"18e6d2dbc3326078218f58b710006b6f172d433bac4c431ecce0d7af968640f3"} err="failed to get container status \"18e6d2dbc3326078218f58b710006b6f172d433bac4c431ecce0d7af968640f3\": rpc error: code = NotFound desc = could not find container \"18e6d2dbc3326078218f58b710006b6f172d433bac4c431ecce0d7af968640f3\": container with ID starting with 18e6d2dbc3326078218f58b710006b6f172d433bac4c431ecce0d7af968640f3 not found: ID does not exist"
Jul 23 16:56:10.375117 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:56:10.375096    2553 scope.go:117] "RemoveContainer" containerID="cb5588a7b20195d691b4ba62c2ee76404a27c5457fda4b6550e3ef04e7522fcc"
Jul 23 16:56:10.375348 ip-10-0-143-166 kubenswrapper[2553]: E0723 16:56:10.375330    2553 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cb5588a7b20195d691b4ba62c2ee76404a27c5457fda4b6550e3ef04e7522fcc\": container with ID starting with cb5588a7b20195d691b4ba62c2ee76404a27c5457fda4b6550e3ef04e7522fcc not found: ID does not exist" containerID="cb5588a7b20195d691b4ba62c2ee76404a27c5457fda4b6550e3ef04e7522fcc"
Jul 23 16:56:10.375398 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:56:10.375354    2553 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cb5588a7b20195d691b4ba62c2ee76404a27c5457fda4b6550e3ef04e7522fcc"} err="failed to get container status \"cb5588a7b20195d691b4ba62c2ee76404a27c5457fda4b6550e3ef04e7522fcc\": rpc error: code = NotFound desc = could not find container \"cb5588a7b20195d691b4ba62c2ee76404a27c5457fda4b6550e3ef04e7522fcc\": container with ID starting with cb5588a7b20195d691b4ba62c2ee76404a27c5457fda4b6550e3ef04e7522fcc not found: ID does not exist"
Jul 23 16:56:10.379394 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:56:10.379370    2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-74f67a-openshift-default-65fd6968f7-5s9dp"]
Jul 23 16:56:10.383275 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:56:10.383255    2553 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-a-74f67a-openshift-default-65fd6968f7-5s9dp"]
Jul 23 16:56:10.675268 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:56:10.675237    2553 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e6995e72-7316-47eb-8e8b-c573d2c31187" path="/var/lib/kubelet/pods/e6995e72-7316-47eb-8e8b-c573d2c31187/volumes"
Jul 23 16:56:24.843471 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:56:24.843427    2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-e090e9-kg4xd"]
Jul 23 16:56:24.847574 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:56:24.847544    2553 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-e090e9-kg4xd"]
Jul 23 16:56:26.674691 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:56:26.674656    2553 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="eaf461d8-06dd-42f1-bdf4-72c4b4cb69af" path="/var/lib/kubelet/pods/eaf461d8-06dd-42f1-bdf4-72c4b4cb69af/volumes"
Jul 23 16:56:31.657278 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:56:31.657241    2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-e090e9-openshift-default-56cb7d55b9-st9fl"]
Jul 23 16:56:31.658013 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:56:31.657482    2553 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-api-b-e090e9-openshift-default-56cb7d55b9-st9fl" podUID="70275616-883f-4d70-9577-cd565c31733a" containerName="istio-proxy" containerID="cri-o://e4c4ad884b55d55eb91dc6e5818d97687c7b7cf2e2a25634fec87af8a3bda3e8" gracePeriod=30
Jul 23 16:56:32.594620 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:56:32.594584    2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-a-dc9a69-openshift-default-7cc8bdd9f5-dnk62"]
Jul 23 16:56:32.595002 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:56:32.594985    2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e6995e72-7316-47eb-8e8b-c573d2c31187" containerName="istio-proxy"
Jul 23 16:56:32.595092 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:56:32.595004    2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="e6995e72-7316-47eb-8e8b-c573d2c31187" containerName="istio-proxy"
Jul 23 16:56:32.595092 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:56:32.595030    2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e6995e72-7316-47eb-8e8b-c573d2c31187" containerName="istio-proxy"
Jul 23 16:56:32.595092 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:56:32.595038    2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="e6995e72-7316-47eb-8e8b-c573d2c31187" containerName="istio-proxy"
Jul 23 16:56:32.595092 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:56:32.595056    2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="eaf461d8-06dd-42f1-bdf4-72c4b4cb69af" containerName="revoke-keys"
Jul 23 16:56:32.595092 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:56:32.595065    2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="eaf461d8-06dd-42f1-bdf4-72c4b4cb69af" containerName="revoke-keys"
Jul 23 16:56:32.595380 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:56:32.595194    2553 memory_manager.go:368] "RemoveStaleState removing state" podUID="e6995e72-7316-47eb-8e8b-c573d2c31187" containerName="istio-proxy"
Jul 23 16:56:32.595380 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:56:32.595207    2553 memory_manager.go:368] "RemoveStaleState removing state" podUID="eaf461d8-06dd-42f1-bdf4-72c4b4cb69af" containerName="revoke-keys"
Jul 23 16:56:32.595380 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:56:32.595218    2553 memory_manager.go:368] "RemoveStaleState removing state" podUID="e6995e72-7316-47eb-8e8b-c573d2c31187" containerName="istio-proxy"
Jul 23 16:56:32.598563 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:56:32.598543    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-dc9a69-openshift-default-7cc8bdd9f5-dnk62"
Jul 23 16:56:32.601644 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:56:32.601621    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-a-dc9a69-openshift-default-dockercfg-d9nwx\""
Jul 23 16:56:32.611149 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:56:32.611131    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-dc9a69-openshift-default-7cc8bdd9f5-dnk62"]
Jul 23 16:56:32.676015 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:56:32.675969    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/af3ccc59-08a2-4099-acc3-b3a4291606ee-credential-socket\") pod \"e2e-shared-a-dc9a69-openshift-default-7cc8bdd9f5-dnk62\" (UID: \"af3ccc59-08a2-4099-acc3-b3a4291606ee\") " pod="openshift-ingress/e2e-shared-a-dc9a69-openshift-default-7cc8bdd9f5-dnk62"
Jul 23 16:56:32.676542 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:56:32.676025    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/af3ccc59-08a2-4099-acc3-b3a4291606ee-istio-data\") pod \"e2e-shared-a-dc9a69-openshift-default-7cc8bdd9f5-dnk62\" (UID: \"af3ccc59-08a2-4099-acc3-b3a4291606ee\") " pod="openshift-ingress/e2e-shared-a-dc9a69-openshift-default-7cc8bdd9f5-dnk62"
Jul 23 16:56:32.676542 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:56:32.676055    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/af3ccc59-08a2-4099-acc3-b3a4291606ee-workload-socket\") pod \"e2e-shared-a-dc9a69-openshift-default-7cc8bdd9f5-dnk62\" (UID: \"af3ccc59-08a2-4099-acc3-b3a4291606ee\") " pod="openshift-ingress/e2e-shared-a-dc9a69-openshift-default-7cc8bdd9f5-dnk62"
Jul 23 16:56:32.676542 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:56:32.676078    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/af3ccc59-08a2-4099-acc3-b3a4291606ee-workload-certs\") pod \"e2e-shared-a-dc9a69-openshift-default-7cc8bdd9f5-dnk62\" (UID: \"af3ccc59-08a2-4099-acc3-b3a4291606ee\") " pod="openshift-ingress/e2e-shared-a-dc9a69-openshift-default-7cc8bdd9f5-dnk62"
Jul 23 16:56:32.676542 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:56:32.676125    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/af3ccc59-08a2-4099-acc3-b3a4291606ee-istiod-ca-cert\") pod \"e2e-shared-a-dc9a69-openshift-default-7cc8bdd9f5-dnk62\" (UID: \"af3ccc59-08a2-4099-acc3-b3a4291606ee\") " pod="openshift-ingress/e2e-shared-a-dc9a69-openshift-default-7cc8bdd9f5-dnk62"
Jul 23 16:56:32.676542 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:56:32.676158    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6b697\" (UniqueName: \"kubernetes.io/projected/af3ccc59-08a2-4099-acc3-b3a4291606ee-kube-api-access-6b697\") pod \"e2e-shared-a-dc9a69-openshift-default-7cc8bdd9f5-dnk62\" (UID: \"af3ccc59-08a2-4099-acc3-b3a4291606ee\") " pod="openshift-ingress/e2e-shared-a-dc9a69-openshift-default-7cc8bdd9f5-dnk62"
Jul 23 16:56:32.676542 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:56:32.676232    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/af3ccc59-08a2-4099-acc3-b3a4291606ee-istio-token\") pod \"e2e-shared-a-dc9a69-openshift-default-7cc8bdd9f5-dnk62\" (UID: \"af3ccc59-08a2-4099-acc3-b3a4291606ee\") " pod="openshift-ingress/e2e-shared-a-dc9a69-openshift-default-7cc8bdd9f5-dnk62"
Jul 23 16:56:32.676542 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:56:32.676269    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/af3ccc59-08a2-4099-acc3-b3a4291606ee-istio-envoy\") pod \"e2e-shared-a-dc9a69-openshift-default-7cc8bdd9f5-dnk62\" (UID: \"af3ccc59-08a2-4099-acc3-b3a4291606ee\") " pod="openshift-ingress/e2e-shared-a-dc9a69-openshift-default-7cc8bdd9f5-dnk62"
Jul 23 16:56:32.676542 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:56:32.676332    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/af3ccc59-08a2-4099-acc3-b3a4291606ee-istio-podinfo\") pod \"e2e-shared-a-dc9a69-openshift-default-7cc8bdd9f5-dnk62\" (UID: \"af3ccc59-08a2-4099-acc3-b3a4291606ee\") " pod="openshift-ingress/e2e-shared-a-dc9a69-openshift-default-7cc8bdd9f5-dnk62"
Jul 23 16:56:32.768395 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:56:32.768355    2553 patch_prober.go:28] interesting pod/e2e-api-b-e090e9-openshift-default-56cb7d55b9-st9fl container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 23 16:56:32.768590 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:56:32.768442    2553 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-b-e090e9-openshift-default-56cb7d55b9-st9fl" podUID="70275616-883f-4d70-9577-cd565c31733a" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 23 16:56:32.776628 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:56:32.776598    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/af3ccc59-08a2-4099-acc3-b3a4291606ee-istio-podinfo\") pod \"e2e-shared-a-dc9a69-openshift-default-7cc8bdd9f5-dnk62\" (UID: \"af3ccc59-08a2-4099-acc3-b3a4291606ee\") " pod="openshift-ingress/e2e-shared-a-dc9a69-openshift-default-7cc8bdd9f5-dnk62"
Jul 23 16:56:32.776749 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:56:32.776634    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/af3ccc59-08a2-4099-acc3-b3a4291606ee-credential-socket\") pod \"e2e-shared-a-dc9a69-openshift-default-7cc8bdd9f5-dnk62\" (UID: \"af3ccc59-08a2-4099-acc3-b3a4291606ee\") " pod="openshift-ingress/e2e-shared-a-dc9a69-openshift-default-7cc8bdd9f5-dnk62"
Jul 23 16:56:32.776749 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:56:32.776677    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/af3ccc59-08a2-4099-acc3-b3a4291606ee-istio-data\") pod \"e2e-shared-a-dc9a69-openshift-default-7cc8bdd9f5-dnk62\" (UID: \"af3ccc59-08a2-4099-acc3-b3a4291606ee\") " pod="openshift-ingress/e2e-shared-a-dc9a69-openshift-default-7cc8bdd9f5-dnk62"
Jul 23 16:56:32.776749 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:56:32.776720    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/af3ccc59-08a2-4099-acc3-b3a4291606ee-workload-socket\") pod \"e2e-shared-a-dc9a69-openshift-default-7cc8bdd9f5-dnk62\" (UID: \"af3ccc59-08a2-4099-acc3-b3a4291606ee\") " pod="openshift-ingress/e2e-shared-a-dc9a69-openshift-default-7cc8bdd9f5-dnk62"
Jul 23 16:56:32.776749 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:56:32.776745    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/af3ccc59-08a2-4099-acc3-b3a4291606ee-workload-certs\") pod \"e2e-shared-a-dc9a69-openshift-default-7cc8bdd9f5-dnk62\" (UID: \"af3ccc59-08a2-4099-acc3-b3a4291606ee\") " pod="openshift-ingress/e2e-shared-a-dc9a69-openshift-default-7cc8bdd9f5-dnk62"
Jul 23 16:56:32.776932 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:56:32.776803    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/af3ccc59-08a2-4099-acc3-b3a4291606ee-istiod-ca-cert\") pod \"e2e-shared-a-dc9a69-openshift-default-7cc8bdd9f5-dnk62\" (UID: \"af3ccc59-08a2-4099-acc3-b3a4291606ee\") " pod="openshift-ingress/e2e-shared-a-dc9a69-openshift-default-7cc8bdd9f5-dnk62"
Jul 23 16:56:32.776932 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:56:32.776868    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6b697\" (UniqueName: \"kubernetes.io/projected/af3ccc59-08a2-4099-acc3-b3a4291606ee-kube-api-access-6b697\") pod \"e2e-shared-a-dc9a69-openshift-default-7cc8bdd9f5-dnk62\" (UID: \"af3ccc59-08a2-4099-acc3-b3a4291606ee\") " pod="openshift-ingress/e2e-shared-a-dc9a69-openshift-default-7cc8bdd9f5-dnk62"
Jul 23 16:56:32.777021 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:56:32.776964    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/af3ccc59-08a2-4099-acc3-b3a4291606ee-istio-token\") pod \"e2e-shared-a-dc9a69-openshift-default-7cc8bdd9f5-dnk62\" (UID: \"af3ccc59-08a2-4099-acc3-b3a4291606ee\") " pod="openshift-ingress/e2e-shared-a-dc9a69-openshift-default-7cc8bdd9f5-dnk62"
Jul 23 16:56:32.777065 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:56:32.777023    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/af3ccc59-08a2-4099-acc3-b3a4291606ee-istio-envoy\") pod \"e2e-shared-a-dc9a69-openshift-default-7cc8bdd9f5-dnk62\" (UID: \"af3ccc59-08a2-4099-acc3-b3a4291606ee\") " pod="openshift-ingress/e2e-shared-a-dc9a69-openshift-default-7cc8bdd9f5-dnk62"
Jul 23 16:56:32.777101 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:56:32.777059    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/af3ccc59-08a2-4099-acc3-b3a4291606ee-credential-socket\") pod \"e2e-shared-a-dc9a69-openshift-default-7cc8bdd9f5-dnk62\" (UID: \"af3ccc59-08a2-4099-acc3-b3a4291606ee\") " pod="openshift-ingress/e2e-shared-a-dc9a69-openshift-default-7cc8bdd9f5-dnk62"
Jul 23 16:56:32.777158 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:56:32.777137    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/af3ccc59-08a2-4099-acc3-b3a4291606ee-istio-data\") pod \"e2e-shared-a-dc9a69-openshift-default-7cc8bdd9f5-dnk62\" (UID: \"af3ccc59-08a2-4099-acc3-b3a4291606ee\") " pod="openshift-ingress/e2e-shared-a-dc9a69-openshift-default-7cc8bdd9f5-dnk62"
Jul 23 16:56:32.777504 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:56:32.777478    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/af3ccc59-08a2-4099-acc3-b3a4291606ee-workload-certs\") pod \"e2e-shared-a-dc9a69-openshift-default-7cc8bdd9f5-dnk62\" (UID: \"af3ccc59-08a2-4099-acc3-b3a4291606ee\") " pod="openshift-ingress/e2e-shared-a-dc9a69-openshift-default-7cc8bdd9f5-dnk62"
Jul 23 16:56:32.777688 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:56:32.777670    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/af3ccc59-08a2-4099-acc3-b3a4291606ee-workload-socket\") pod \"e2e-shared-a-dc9a69-openshift-default-7cc8bdd9f5-dnk62\" (UID: \"af3ccc59-08a2-4099-acc3-b3a4291606ee\") " pod="openshift-ingress/e2e-shared-a-dc9a69-openshift-default-7cc8bdd9f5-dnk62"
Jul 23 16:56:32.777760 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:56:32.777677    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/af3ccc59-08a2-4099-acc3-b3a4291606ee-istiod-ca-cert\") pod \"e2e-shared-a-dc9a69-openshift-default-7cc8bdd9f5-dnk62\" (UID: \"af3ccc59-08a2-4099-acc3-b3a4291606ee\") " pod="openshift-ingress/e2e-shared-a-dc9a69-openshift-default-7cc8bdd9f5-dnk62"
Jul 23 16:56:32.779352 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:56:32.779330    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/af3ccc59-08a2-4099-acc3-b3a4291606ee-istio-envoy\") pod \"e2e-shared-a-dc9a69-openshift-default-7cc8bdd9f5-dnk62\" (UID: \"af3ccc59-08a2-4099-acc3-b3a4291606ee\") " pod="openshift-ingress/e2e-shared-a-dc9a69-openshift-default-7cc8bdd9f5-dnk62"
Jul 23 16:56:32.779438 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:56:32.779373    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/af3ccc59-08a2-4099-acc3-b3a4291606ee-istio-podinfo\") pod \"e2e-shared-a-dc9a69-openshift-default-7cc8bdd9f5-dnk62\" (UID: \"af3ccc59-08a2-4099-acc3-b3a4291606ee\") " pod="openshift-ingress/e2e-shared-a-dc9a69-openshift-default-7cc8bdd9f5-dnk62"
Jul 23 16:56:32.789768 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:56:32.789738    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/af3ccc59-08a2-4099-acc3-b3a4291606ee-istio-token\") pod \"e2e-shared-a-dc9a69-openshift-default-7cc8bdd9f5-dnk62\" (UID: \"af3ccc59-08a2-4099-acc3-b3a4291606ee\") " pod="openshift-ingress/e2e-shared-a-dc9a69-openshift-default-7cc8bdd9f5-dnk62"
Jul 23 16:56:32.789902 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:56:32.789882    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6b697\" (UniqueName: \"kubernetes.io/projected/af3ccc59-08a2-4099-acc3-b3a4291606ee-kube-api-access-6b697\") pod \"e2e-shared-a-dc9a69-openshift-default-7cc8bdd9f5-dnk62\" (UID: \"af3ccc59-08a2-4099-acc3-b3a4291606ee\") " pod="openshift-ingress/e2e-shared-a-dc9a69-openshift-default-7cc8bdd9f5-dnk62"
Jul 23 16:56:32.908137 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:56:32.908105    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-dc9a69-openshift-default-7cc8bdd9f5-dnk62"
Jul 23 16:56:33.054409 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:56:33.054380    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-dc9a69-openshift-default-7cc8bdd9f5-dnk62"]
Jul 23 16:56:33.055353 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:56:33.055326    2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaf3ccc59_08a2_4099_acc3_b3a4291606ee.slice/crio-b8ceef2e3006fbf732904bdefd4436c0208effd5be4f62aefd90aca4993fe615 WatchSource:0}: Error finding container b8ceef2e3006fbf732904bdefd4436c0208effd5be4f62aefd90aca4993fe615: Status 404 returned error can't find the container with id b8ceef2e3006fbf732904bdefd4436c0208effd5be4f62aefd90aca4993fe615
Jul 23 16:56:33.057528 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:56:33.057501    2553 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 23 16:56:33.057595 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:56:33.057562    2553 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 23 16:56:33.057595 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:56:33.057590    2553 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 23 16:56:33.493568 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:56:33.493528    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-dc9a69-openshift-default-7cc8bdd9f5-dnk62" event={"ID":"af3ccc59-08a2-4099-acc3-b3a4291606ee","Type":"ContainerStarted","Data":"240c63be9aa00ba1b097a043b3a4c709808f3042c5e28272867d239db128f66d"}
Jul 23 16:56:33.493728 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:56:33.493587    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-dc9a69-openshift-default-7cc8bdd9f5-dnk62" event={"ID":"af3ccc59-08a2-4099-acc3-b3a4291606ee","Type":"ContainerStarted","Data":"b8ceef2e3006fbf732904bdefd4436c0208effd5be4f62aefd90aca4993fe615"}
Jul 23 16:56:33.517565 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:56:33.517512    2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-a-dc9a69-openshift-default-7cc8bdd9f5-dnk62" podStartSLOduration=1.517495099 podStartE2EDuration="1.517495099s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 16:56:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 16:56:33.515802885 +0000 UTC m=+2475.380409016" watchObservedRunningTime="2026-07-23 16:56:33.517495099 +0000 UTC m=+2475.382101225"
Jul 23 16:56:33.908290 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:56:33.908245    2553 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-dc9a69-openshift-default-7cc8bdd9f5-dnk62"
Jul 23 16:56:34.914483 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:56:34.914451    2553 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-dc9a69-openshift-default-7cc8bdd9f5-dnk62"
Jul 23 16:56:35.505518 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:56:35.505476    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-dc9a69-openshift-default-7cc8bdd9f5-dnk62"
Jul 23 16:56:35.506616 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:56:35.506595    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-dc9a69-openshift-default-7cc8bdd9f5-dnk62"
Jul 23 16:56:36.917413 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:56:36.917350    2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-e090e9-openshift-default-56cb7d55b9-st9fl"
Jul 23 16:56:37.008063 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:56:37.008027    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/70275616-883f-4d70-9577-cd565c31733a-istiod-ca-cert\") pod \"70275616-883f-4d70-9577-cd565c31733a\" (UID: \"70275616-883f-4d70-9577-cd565c31733a\") "
Jul 23 16:56:37.008063 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:56:37.008065    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/70275616-883f-4d70-9577-cd565c31733a-istio-token\") pod \"70275616-883f-4d70-9577-cd565c31733a\" (UID: \"70275616-883f-4d70-9577-cd565c31733a\") "
Jul 23 16:56:37.008372 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:56:37.008110    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/70275616-883f-4d70-9577-cd565c31733a-istio-envoy\") pod \"70275616-883f-4d70-9577-cd565c31733a\" (UID: \"70275616-883f-4d70-9577-cd565c31733a\") "
Jul 23 16:56:37.008372 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:56:37.008133    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/70275616-883f-4d70-9577-cd565c31733a-workload-certs\") pod \"70275616-883f-4d70-9577-cd565c31733a\" (UID: \"70275616-883f-4d70-9577-cd565c31733a\") "
Jul 23 16:56:37.008372 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:56:37.008176    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/70275616-883f-4d70-9577-cd565c31733a-istio-data\") pod \"70275616-883f-4d70-9577-cd565c31733a\" (UID: \"70275616-883f-4d70-9577-cd565c31733a\") "
Jul 23 16:56:37.008372 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:56:37.008205    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/70275616-883f-4d70-9577-cd565c31733a-istio-podinfo\") pod \"70275616-883f-4d70-9577-cd565c31733a\" (UID: \"70275616-883f-4d70-9577-cd565c31733a\") "
Jul 23 16:56:37.008372 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:56:37.008277    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4clqf\" (UniqueName: \"kubernetes.io/projected/70275616-883f-4d70-9577-cd565c31733a-kube-api-access-4clqf\") pod \"70275616-883f-4d70-9577-cd565c31733a\" (UID: \"70275616-883f-4d70-9577-cd565c31733a\") "
Jul 23 16:56:37.008372 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:56:37.008309    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/70275616-883f-4d70-9577-cd565c31733a-credential-socket\") pod \"70275616-883f-4d70-9577-cd565c31733a\" (UID: \"70275616-883f-4d70-9577-cd565c31733a\") "
Jul 23 16:56:37.008372 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:56:37.008348    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/70275616-883f-4d70-9577-cd565c31733a-workload-socket\") pod \"70275616-883f-4d70-9577-cd565c31733a\" (UID: \"70275616-883f-4d70-9577-cd565c31733a\") "
Jul 23 16:56:37.008752 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:56:37.008543    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/70275616-883f-4d70-9577-cd565c31733a-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "70275616-883f-4d70-9577-cd565c31733a" (UID: "70275616-883f-4d70-9577-cd565c31733a"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 23 16:56:37.008752 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:56:37.008549    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/70275616-883f-4d70-9577-cd565c31733a-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "70275616-883f-4d70-9577-cd565c31733a" (UID: "70275616-883f-4d70-9577-cd565c31733a"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 16:56:37.008752 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:56:37.008631    2553 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/70275616-883f-4d70-9577-cd565c31733a-workload-certs\") on node \"ip-10-0-143-166.ec2.internal\" DevicePath \"\""
Jul 23 16:56:37.008752 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:56:37.008651    2553 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/70275616-883f-4d70-9577-cd565c31733a-istiod-ca-cert\") on node \"ip-10-0-143-166.ec2.internal\" DevicePath \"\""
Jul 23 16:56:37.008950 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:56:37.008739    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/70275616-883f-4d70-9577-cd565c31733a-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "70275616-883f-4d70-9577-cd565c31733a" (UID: "70275616-883f-4d70-9577-cd565c31733a"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 16:56:37.008950 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:56:37.008777    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/70275616-883f-4d70-9577-cd565c31733a-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "70275616-883f-4d70-9577-cd565c31733a" (UID: "70275616-883f-4d70-9577-cd565c31733a"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 16:56:37.009739 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:56:37.009711    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/70275616-883f-4d70-9577-cd565c31733a-istio-data" (OuterVolumeSpecName: "istio-data") pod "70275616-883f-4d70-9577-cd565c31733a" (UID: "70275616-883f-4d70-9577-cd565c31733a"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 16:56:37.010646 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:56:37.010612    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/70275616-883f-4d70-9577-cd565c31733a-istio-token" (OuterVolumeSpecName: "istio-token") pod "70275616-883f-4d70-9577-cd565c31733a" (UID: "70275616-883f-4d70-9577-cd565c31733a"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 16:56:37.010751 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:56:37.010657    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/70275616-883f-4d70-9577-cd565c31733a-kube-api-access-4clqf" (OuterVolumeSpecName: "kube-api-access-4clqf") pod "70275616-883f-4d70-9577-cd565c31733a" (UID: "70275616-883f-4d70-9577-cd565c31733a"). InnerVolumeSpecName "kube-api-access-4clqf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 16:56:37.010751 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:56:37.010678    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/70275616-883f-4d70-9577-cd565c31733a-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "70275616-883f-4d70-9577-cd565c31733a" (UID: "70275616-883f-4d70-9577-cd565c31733a"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 23 16:56:37.010751 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:56:37.010710    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/70275616-883f-4d70-9577-cd565c31733a-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "70275616-883f-4d70-9577-cd565c31733a" (UID: "70275616-883f-4d70-9577-cd565c31733a"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 16:56:37.109089 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:56:37.109044    2553 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/70275616-883f-4d70-9577-cd565c31733a-workload-socket\") on node \"ip-10-0-143-166.ec2.internal\" DevicePath \"\""
Jul 23 16:56:37.109089 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:56:37.109078    2553 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/70275616-883f-4d70-9577-cd565c31733a-istio-token\") on node \"ip-10-0-143-166.ec2.internal\" DevicePath \"\""
Jul 23 16:56:37.109089 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:56:37.109087    2553 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/70275616-883f-4d70-9577-cd565c31733a-istio-envoy\") on node \"ip-10-0-143-166.ec2.internal\" DevicePath \"\""
Jul 23 16:56:37.109089 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:56:37.109095    2553 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/70275616-883f-4d70-9577-cd565c31733a-istio-data\") on node \"ip-10-0-143-166.ec2.internal\" DevicePath \"\""
Jul 23 16:56:37.109527 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:56:37.109103    2553 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/70275616-883f-4d70-9577-cd565c31733a-istio-podinfo\") on node \"ip-10-0-143-166.ec2.internal\" DevicePath \"\""
Jul 23 16:56:37.109527 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:56:37.109113    2553 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4clqf\" (UniqueName: \"kubernetes.io/projected/70275616-883f-4d70-9577-cd565c31733a-kube-api-access-4clqf\") on node \"ip-10-0-143-166.ec2.internal\" DevicePath \"\""
Jul 23 16:56:37.109527 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:56:37.109122    2553 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/70275616-883f-4d70-9577-cd565c31733a-credential-socket\") on node \"ip-10-0-143-166.ec2.internal\" DevicePath \"\""
Jul 23 16:56:37.517180 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:56:37.517144    2553 generic.go:356] "Generic (PLEG): container finished" podID="70275616-883f-4d70-9577-cd565c31733a" containerID="e4c4ad884b55d55eb91dc6e5818d97687c7b7cf2e2a25634fec87af8a3bda3e8" exitCode=0
Jul 23 16:56:37.517386 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:56:37.517203    2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-e090e9-openshift-default-56cb7d55b9-st9fl"
Jul 23 16:56:37.517386 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:56:37.517240    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-e090e9-openshift-default-56cb7d55b9-st9fl" event={"ID":"70275616-883f-4d70-9577-cd565c31733a","Type":"ContainerDied","Data":"e4c4ad884b55d55eb91dc6e5818d97687c7b7cf2e2a25634fec87af8a3bda3e8"}
Jul 23 16:56:37.517386 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:56:37.517308    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-e090e9-openshift-default-56cb7d55b9-st9fl" event={"ID":"70275616-883f-4d70-9577-cd565c31733a","Type":"ContainerDied","Data":"b18cafde7800badcec4abb55f9466548f548f1bf7769da707dfb9be0ddd5c353"}
Jul 23 16:56:37.517386 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:56:37.517344    2553 scope.go:117] "RemoveContainer" containerID="e4c4ad884b55d55eb91dc6e5818d97687c7b7cf2e2a25634fec87af8a3bda3e8"
Jul 23 16:56:37.527284 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:56:37.527228    2553 scope.go:117] "RemoveContainer" containerID="fa11f0e9ca8e7b20eaaa8b485279279fc723d63cf5083d5bce8c0ba3cf24721d"
Jul 23 16:56:37.535825 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:56:37.535800    2553 scope.go:117] "RemoveContainer" containerID="e4c4ad884b55d55eb91dc6e5818d97687c7b7cf2e2a25634fec87af8a3bda3e8"
Jul 23 16:56:37.536178 ip-10-0-143-166 kubenswrapper[2553]: E0723 16:56:37.536124    2553 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e4c4ad884b55d55eb91dc6e5818d97687c7b7cf2e2a25634fec87af8a3bda3e8\": container with ID starting with e4c4ad884b55d55eb91dc6e5818d97687c7b7cf2e2a25634fec87af8a3bda3e8 not found: ID does not exist" containerID="e4c4ad884b55d55eb91dc6e5818d97687c7b7cf2e2a25634fec87af8a3bda3e8"
Jul 23 16:56:37.536299 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:56:37.536273    2553 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e4c4ad884b55d55eb91dc6e5818d97687c7b7cf2e2a25634fec87af8a3bda3e8"} err="failed to get container status \"e4c4ad884b55d55eb91dc6e5818d97687c7b7cf2e2a25634fec87af8a3bda3e8\": rpc error: code = NotFound desc = could not find container \"e4c4ad884b55d55eb91dc6e5818d97687c7b7cf2e2a25634fec87af8a3bda3e8\": container with ID starting with e4c4ad884b55d55eb91dc6e5818d97687c7b7cf2e2a25634fec87af8a3bda3e8 not found: ID does not exist"
Jul 23 16:56:37.536346 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:56:37.536303    2553 scope.go:117] "RemoveContainer" containerID="fa11f0e9ca8e7b20eaaa8b485279279fc723d63cf5083d5bce8c0ba3cf24721d"
Jul 23 16:56:37.536603 ip-10-0-143-166 kubenswrapper[2553]: E0723 16:56:37.536582    2553 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fa11f0e9ca8e7b20eaaa8b485279279fc723d63cf5083d5bce8c0ba3cf24721d\": container with ID starting with fa11f0e9ca8e7b20eaaa8b485279279fc723d63cf5083d5bce8c0ba3cf24721d not found: ID does not exist" containerID="fa11f0e9ca8e7b20eaaa8b485279279fc723d63cf5083d5bce8c0ba3cf24721d"
Jul 23 16:56:37.536665 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:56:37.536610    2553 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fa11f0e9ca8e7b20eaaa8b485279279fc723d63cf5083d5bce8c0ba3cf24721d"} err="failed to get container status \"fa11f0e9ca8e7b20eaaa8b485279279fc723d63cf5083d5bce8c0ba3cf24721d\": rpc error: code = NotFound desc = could not find container \"fa11f0e9ca8e7b20eaaa8b485279279fc723d63cf5083d5bce8c0ba3cf24721d\": container with ID starting with fa11f0e9ca8e7b20eaaa8b485279279fc723d63cf5083d5bce8c0ba3cf24721d not found: ID does not exist"
Jul 23 16:56:37.542725 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:56:37.542701    2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-e090e9-openshift-default-56cb7d55b9-st9fl"]
Jul 23 16:56:37.546459 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:56:37.546438    2553 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-b-e090e9-openshift-default-56cb7d55b9-st9fl"]
Jul 23 16:56:38.674492 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:56:38.674464    2553 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="70275616-883f-4d70-9577-cd565c31733a" path="/var/lib/kubelet/pods/70275616-883f-4d70-9577-cd565c31733a/volumes"
Jul 23 16:56:40.714570 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:56:40.714539    2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-b-6a0c6b-openshift-default-78f6bb967-8hn4k"]
Jul 23 16:56:40.723760 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:56:40.723720    2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="70275616-883f-4d70-9577-cd565c31733a" containerName="istio-proxy"
Jul 23 16:56:40.723760 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:56:40.723748    2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="70275616-883f-4d70-9577-cd565c31733a" containerName="istio-proxy"
Jul 23 16:56:40.723760 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:56:40.723762    2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="70275616-883f-4d70-9577-cd565c31733a" containerName="istio-proxy"
Jul 23 16:56:40.724002 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:56:40.723769    2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="70275616-883f-4d70-9577-cd565c31733a" containerName="istio-proxy"
Jul 23 16:56:40.724116 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:56:40.724103    2553 memory_manager.go:368] "RemoveStaleState removing state" podUID="70275616-883f-4d70-9577-cd565c31733a" containerName="istio-proxy"
Jul 23 16:56:40.728826 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:56:40.728801    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-6a0c6b-openshift-default-78f6bb967-8hn4k"
Jul 23 16:56:40.730525 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:56:40.730502    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-6a0c6b-openshift-default-78f6bb967-8hn4k"]
Jul 23 16:56:40.732400 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:56:40.732377    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-b-6a0c6b-openshift-default-dockercfg-bwd5v\""
Jul 23 16:56:40.741361 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:56:40.741327    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e0d49a76-8aff-4e5e-adde-8b3538f7508c-istio-envoy\") pod \"e2e-shared-b-6a0c6b-openshift-default-78f6bb967-8hn4k\" (UID: \"e0d49a76-8aff-4e5e-adde-8b3538f7508c\") " pod="openshift-ingress/e2e-shared-b-6a0c6b-openshift-default-78f6bb967-8hn4k"
Jul 23 16:56:40.741527 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:56:40.741384    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x4glg\" (UniqueName: \"kubernetes.io/projected/e0d49a76-8aff-4e5e-adde-8b3538f7508c-kube-api-access-x4glg\") pod \"e2e-shared-b-6a0c6b-openshift-default-78f6bb967-8hn4k\" (UID: \"e0d49a76-8aff-4e5e-adde-8b3538f7508c\") " pod="openshift-ingress/e2e-shared-b-6a0c6b-openshift-default-78f6bb967-8hn4k"
Jul 23 16:56:40.741527 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:56:40.741421    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e0d49a76-8aff-4e5e-adde-8b3538f7508c-workload-certs\") pod \"e2e-shared-b-6a0c6b-openshift-default-78f6bb967-8hn4k\" (UID: \"e0d49a76-8aff-4e5e-adde-8b3538f7508c\") " pod="openshift-ingress/e2e-shared-b-6a0c6b-openshift-default-78f6bb967-8hn4k"
Jul 23 16:56:40.741527 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:56:40.741465    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e0d49a76-8aff-4e5e-adde-8b3538f7508c-istiod-ca-cert\") pod \"e2e-shared-b-6a0c6b-openshift-default-78f6bb967-8hn4k\" (UID: \"e0d49a76-8aff-4e5e-adde-8b3538f7508c\") " pod="openshift-ingress/e2e-shared-b-6a0c6b-openshift-default-78f6bb967-8hn4k"
Jul 23 16:56:40.741527 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:56:40.741510    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e0d49a76-8aff-4e5e-adde-8b3538f7508c-credential-socket\") pod \"e2e-shared-b-6a0c6b-openshift-default-78f6bb967-8hn4k\" (UID: \"e0d49a76-8aff-4e5e-adde-8b3538f7508c\") " pod="openshift-ingress/e2e-shared-b-6a0c6b-openshift-default-78f6bb967-8hn4k"
Jul 23 16:56:40.741743 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:56:40.741534    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e0d49a76-8aff-4e5e-adde-8b3538f7508c-istio-data\") pod \"e2e-shared-b-6a0c6b-openshift-default-78f6bb967-8hn4k\" (UID: \"e0d49a76-8aff-4e5e-adde-8b3538f7508c\") " pod="openshift-ingress/e2e-shared-b-6a0c6b-openshift-default-78f6bb967-8hn4k"
Jul 23 16:56:40.741743 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:56:40.741578    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e0d49a76-8aff-4e5e-adde-8b3538f7508c-istio-podinfo\") pod \"e2e-shared-b-6a0c6b-openshift-default-78f6bb967-8hn4k\" (UID: \"e0d49a76-8aff-4e5e-adde-8b3538f7508c\") " pod="openshift-ingress/e2e-shared-b-6a0c6b-openshift-default-78f6bb967-8hn4k"
Jul 23 16:56:40.741743 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:56:40.741678    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e0d49a76-8aff-4e5e-adde-8b3538f7508c-istio-token\") pod \"e2e-shared-b-6a0c6b-openshift-default-78f6bb967-8hn4k\" (UID: \"e0d49a76-8aff-4e5e-adde-8b3538f7508c\") " pod="openshift-ingress/e2e-shared-b-6a0c6b-openshift-default-78f6bb967-8hn4k"
Jul 23 16:56:40.741903 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:56:40.741825    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e0d49a76-8aff-4e5e-adde-8b3538f7508c-workload-socket\") pod \"e2e-shared-b-6a0c6b-openshift-default-78f6bb967-8hn4k\" (UID: \"e0d49a76-8aff-4e5e-adde-8b3538f7508c\") " pod="openshift-ingress/e2e-shared-b-6a0c6b-openshift-default-78f6bb967-8hn4k"
Jul 23 16:56:40.843039 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:56:40.842988    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e0d49a76-8aff-4e5e-adde-8b3538f7508c-credential-socket\") pod \"e2e-shared-b-6a0c6b-openshift-default-78f6bb967-8hn4k\" (UID: \"e0d49a76-8aff-4e5e-adde-8b3538f7508c\") " pod="openshift-ingress/e2e-shared-b-6a0c6b-openshift-default-78f6bb967-8hn4k"
Jul 23 16:56:40.843350 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:56:40.843326    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e0d49a76-8aff-4e5e-adde-8b3538f7508c-istio-data\") pod \"e2e-shared-b-6a0c6b-openshift-default-78f6bb967-8hn4k\" (UID: \"e0d49a76-8aff-4e5e-adde-8b3538f7508c\") " pod="openshift-ingress/e2e-shared-b-6a0c6b-openshift-default-78f6bb967-8hn4k"
Jul 23 16:56:40.843518 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:56:40.843502    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e0d49a76-8aff-4e5e-adde-8b3538f7508c-istio-podinfo\") pod \"e2e-shared-b-6a0c6b-openshift-default-78f6bb967-8hn4k\" (UID: \"e0d49a76-8aff-4e5e-adde-8b3538f7508c\") " pod="openshift-ingress/e2e-shared-b-6a0c6b-openshift-default-78f6bb967-8hn4k"
Jul 23 16:56:40.843630 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:56:40.843616    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e0d49a76-8aff-4e5e-adde-8b3538f7508c-istio-token\") pod \"e2e-shared-b-6a0c6b-openshift-default-78f6bb967-8hn4k\" (UID: \"e0d49a76-8aff-4e5e-adde-8b3538f7508c\") " pod="openshift-ingress/e2e-shared-b-6a0c6b-openshift-default-78f6bb967-8hn4k"
Jul 23 16:56:40.843756 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:56:40.843740    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e0d49a76-8aff-4e5e-adde-8b3538f7508c-workload-socket\") pod \"e2e-shared-b-6a0c6b-openshift-default-78f6bb967-8hn4k\" (UID: \"e0d49a76-8aff-4e5e-adde-8b3538f7508c\") " pod="openshift-ingress/e2e-shared-b-6a0c6b-openshift-default-78f6bb967-8hn4k"
Jul 23 16:56:40.843920 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:56:40.843906    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e0d49a76-8aff-4e5e-adde-8b3538f7508c-istio-envoy\") pod \"e2e-shared-b-6a0c6b-openshift-default-78f6bb967-8hn4k\" (UID: \"e0d49a76-8aff-4e5e-adde-8b3538f7508c\") " pod="openshift-ingress/e2e-shared-b-6a0c6b-openshift-default-78f6bb967-8hn4k"
Jul 23 16:56:40.844049 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:56:40.844034    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x4glg\" (UniqueName: \"kubernetes.io/projected/e0d49a76-8aff-4e5e-adde-8b3538f7508c-kube-api-access-x4glg\") pod \"e2e-shared-b-6a0c6b-openshift-default-78f6bb967-8hn4k\" (UID: \"e0d49a76-8aff-4e5e-adde-8b3538f7508c\") " pod="openshift-ingress/e2e-shared-b-6a0c6b-openshift-default-78f6bb967-8hn4k"
Jul 23 16:56:40.844206 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:56:40.844159    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e0d49a76-8aff-4e5e-adde-8b3538f7508c-workload-certs\") pod \"e2e-shared-b-6a0c6b-openshift-default-78f6bb967-8hn4k\" (UID: \"e0d49a76-8aff-4e5e-adde-8b3538f7508c\") " pod="openshift-ingress/e2e-shared-b-6a0c6b-openshift-default-78f6bb967-8hn4k"
Jul 23 16:56:40.844357 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:56:40.843519    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e0d49a76-8aff-4e5e-adde-8b3538f7508c-credential-socket\") pod \"e2e-shared-b-6a0c6b-openshift-default-78f6bb967-8hn4k\" (UID: \"e0d49a76-8aff-4e5e-adde-8b3538f7508c\") " pod="openshift-ingress/e2e-shared-b-6a0c6b-openshift-default-78f6bb967-8hn4k"
Jul 23 16:56:40.844626 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:56:40.844345    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e0d49a76-8aff-4e5e-adde-8b3538f7508c-istiod-ca-cert\") pod \"e2e-shared-b-6a0c6b-openshift-default-78f6bb967-8hn4k\" (UID: \"e0d49a76-8aff-4e5e-adde-8b3538f7508c\") " pod="openshift-ingress/e2e-shared-b-6a0c6b-openshift-default-78f6bb967-8hn4k"
Jul 23 16:56:40.844793 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:56:40.844762    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e0d49a76-8aff-4e5e-adde-8b3538f7508c-workload-certs\") pod \"e2e-shared-b-6a0c6b-openshift-default-78f6bb967-8hn4k\" (UID: \"e0d49a76-8aff-4e5e-adde-8b3538f7508c\") " pod="openshift-ingress/e2e-shared-b-6a0c6b-openshift-default-78f6bb967-8hn4k"
Jul 23 16:56:40.844870 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:56:40.844250    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e0d49a76-8aff-4e5e-adde-8b3538f7508c-workload-socket\") pod \"e2e-shared-b-6a0c6b-openshift-default-78f6bb967-8hn4k\" (UID: \"e0d49a76-8aff-4e5e-adde-8b3538f7508c\") " pod="openshift-ingress/e2e-shared-b-6a0c6b-openshift-default-78f6bb967-8hn4k"
Jul 23 16:56:40.844928 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:56:40.843687    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e0d49a76-8aff-4e5e-adde-8b3538f7508c-istio-data\") pod \"e2e-shared-b-6a0c6b-openshift-default-78f6bb967-8hn4k\" (UID: \"e0d49a76-8aff-4e5e-adde-8b3538f7508c\") " pod="openshift-ingress/e2e-shared-b-6a0c6b-openshift-default-78f6bb967-8hn4k"
Jul 23 16:56:40.845016 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:56:40.844994    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e0d49a76-8aff-4e5e-adde-8b3538f7508c-istiod-ca-cert\") pod \"e2e-shared-b-6a0c6b-openshift-default-78f6bb967-8hn4k\" (UID: \"e0d49a76-8aff-4e5e-adde-8b3538f7508c\") " pod="openshift-ingress/e2e-shared-b-6a0c6b-openshift-default-78f6bb967-8hn4k"
Jul 23 16:56:40.846779 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:56:40.846756    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e0d49a76-8aff-4e5e-adde-8b3538f7508c-istio-envoy\") pod \"e2e-shared-b-6a0c6b-openshift-default-78f6bb967-8hn4k\" (UID: \"e0d49a76-8aff-4e5e-adde-8b3538f7508c\") " pod="openshift-ingress/e2e-shared-b-6a0c6b-openshift-default-78f6bb967-8hn4k"
Jul 23 16:56:40.850186 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:56:40.847210    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e0d49a76-8aff-4e5e-adde-8b3538f7508c-istio-podinfo\") pod \"e2e-shared-b-6a0c6b-openshift-default-78f6bb967-8hn4k\" (UID: \"e0d49a76-8aff-4e5e-adde-8b3538f7508c\") " pod="openshift-ingress/e2e-shared-b-6a0c6b-openshift-default-78f6bb967-8hn4k"
Jul 23 16:56:40.858159 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:56:40.858123    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x4glg\" (UniqueName: \"kubernetes.io/projected/e0d49a76-8aff-4e5e-adde-8b3538f7508c-kube-api-access-x4glg\") pod \"e2e-shared-b-6a0c6b-openshift-default-78f6bb967-8hn4k\" (UID: \"e0d49a76-8aff-4e5e-adde-8b3538f7508c\") " pod="openshift-ingress/e2e-shared-b-6a0c6b-openshift-default-78f6bb967-8hn4k"
Jul 23 16:56:40.858847 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:56:40.858648    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e0d49a76-8aff-4e5e-adde-8b3538f7508c-istio-token\") pod \"e2e-shared-b-6a0c6b-openshift-default-78f6bb967-8hn4k\" (UID: \"e0d49a76-8aff-4e5e-adde-8b3538f7508c\") " pod="openshift-ingress/e2e-shared-b-6a0c6b-openshift-default-78f6bb967-8hn4k"
Jul 23 16:56:41.041018 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:56:41.040904    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-6a0c6b-openshift-default-78f6bb967-8hn4k"
Jul 23 16:56:41.219139 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:56:41.219106    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-6a0c6b-openshift-default-78f6bb967-8hn4k"]
Jul 23 16:56:41.219310 ip-10-0-143-166 kubenswrapper[2553]: W0723 16:56:41.219286    2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode0d49a76_8aff_4e5e_adde_8b3538f7508c.slice/crio-e169dd00ef9e5dfbd1c90a8a3de948236e8da07c1e73d85c55184cc92a815a2b WatchSource:0}: Error finding container e169dd00ef9e5dfbd1c90a8a3de948236e8da07c1e73d85c55184cc92a815a2b: Status 404 returned error can't find the container with id e169dd00ef9e5dfbd1c90a8a3de948236e8da07c1e73d85c55184cc92a815a2b
Jul 23 16:56:41.221661 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:56:41.221626    2553 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 23 16:56:41.221748 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:56:41.221733    2553 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 23 16:56:41.221792 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:56:41.221778    2553 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 23 16:56:41.549288 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:56:41.549241    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-6a0c6b-openshift-default-78f6bb967-8hn4k" event={"ID":"e0d49a76-8aff-4e5e-adde-8b3538f7508c","Type":"ContainerStarted","Data":"01cfdad7009075023aa5ee5ac8a73069a12cfe8564164d207d23385d685eee8a"}
Jul 23 16:56:41.549506 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:56:41.549316    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-6a0c6b-openshift-default-78f6bb967-8hn4k" event={"ID":"e0d49a76-8aff-4e5e-adde-8b3538f7508c","Type":"ContainerStarted","Data":"e169dd00ef9e5dfbd1c90a8a3de948236e8da07c1e73d85c55184cc92a815a2b"}
Jul 23 16:56:41.571697 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:56:41.571591    2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-b-6a0c6b-openshift-default-78f6bb967-8hn4k" podStartSLOduration=1.571572761 podStartE2EDuration="1.571572761s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 16:56:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 16:56:41.569866201 +0000 UTC m=+2483.434472333" watchObservedRunningTime="2026-07-23 16:56:41.571572761 +0000 UTC m=+2483.436178889"
Jul 23 16:56:42.042603 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:56:42.042566    2553 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-6a0c6b-openshift-default-78f6bb967-8hn4k"
Jul 23 16:56:42.044119 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:56:42.043806    2553 patch_prober.go:28] interesting pod/e2e-shared-b-6a0c6b-openshift-default-78f6bb967-8hn4k container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.68:15021/healthz/ready\": dial tcp 10.132.0.68:15021: connect: connection refused" start-of-body=
Jul 23 16:56:42.044119 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:56:42.043862    2553 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-6a0c6b-openshift-default-78f6bb967-8hn4k" podUID="e0d49a76-8aff-4e5e-adde-8b3538f7508c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.68:15021/healthz/ready\": dial tcp 10.132.0.68:15021: connect: connection refused"
Jul 23 16:56:43.052589 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:56:43.052548    2553 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-6a0c6b-openshift-default-78f6bb967-8hn4k"
Jul 23 16:56:43.562702 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:56:43.562665    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-6a0c6b-openshift-default-78f6bb967-8hn4k"
Jul 23 16:56:43.563594 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:56:43.563576    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-6a0c6b-openshift-default-78f6bb967-8hn4k"
Jul 23 16:56:48.600282 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:56:48.600247    2553 generic.go:356] "Generic (PLEG): container finished" podID="af3ccc59-08a2-4099-acc3-b3a4291606ee" containerID="240c63be9aa00ba1b097a043b3a4c709808f3042c5e28272867d239db128f66d" exitCode=0
Jul 23 16:56:48.600715 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:56:48.600316    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-dc9a69-openshift-default-7cc8bdd9f5-dnk62" event={"ID":"af3ccc59-08a2-4099-acc3-b3a4291606ee","Type":"ContainerDied","Data":"240c63be9aa00ba1b097a043b3a4c709808f3042c5e28272867d239db128f66d"}
Jul 23 16:56:48.600766 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:56:48.600716    2553 scope.go:117] "RemoveContainer" containerID="240c63be9aa00ba1b097a043b3a4c709808f3042c5e28272867d239db128f66d"
Jul 23 16:56:48.601806 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:56:48.601779    2553 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 23 16:56:48.601866 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:56:48.601851    2553 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 23 16:56:48.601901 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:56:48.601883    2553 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 23 16:56:49.608831 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:56:49.608794    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-dc9a69-openshift-default-7cc8bdd9f5-dnk62" event={"ID":"af3ccc59-08a2-4099-acc3-b3a4291606ee","Type":"ContainerStarted","Data":"43c734a61d0a0cea6a9bdfeb9b1dcf91bd7172b83bb04e5346787b1b28cc5c89"}
Jul 23 16:56:49.908475 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:56:49.908440    2553 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-dc9a69-openshift-default-7cc8bdd9f5-dnk62"
Jul 23 16:56:49.909760 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:56:49.909727    2553 patch_prober.go:28] interesting pod/e2e-shared-a-dc9a69-openshift-default-7cc8bdd9f5-dnk62 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.67:15021/healthz/ready\": dial tcp 10.132.0.67:15021: connect: connection refused" start-of-body=
Jul 23 16:56:49.909911 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:56:49.909799    2553 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-dc9a69-openshift-default-7cc8bdd9f5-dnk62" podUID="af3ccc59-08a2-4099-acc3-b3a4291606ee" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.67:15021/healthz/ready\": dial tcp 10.132.0.67:15021: connect: connection refused"
Jul 23 16:56:50.506034 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:56:50.505996    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-dc9a69-openshift-default-7cc8bdd9f5-dnk62"
Jul 23 16:56:50.909006 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:56:50.908975    2553 patch_prober.go:28] interesting pod/e2e-shared-a-dc9a69-openshift-default-7cc8bdd9f5-dnk62 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.67:15021/healthz/ready\": dial tcp 10.132.0.67:15021: connect: connection refused" start-of-body=
Jul 23 16:56:50.909446 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:56:50.909034    2553 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-dc9a69-openshift-default-7cc8bdd9f5-dnk62" podUID="af3ccc59-08a2-4099-acc3-b3a4291606ee" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.67:15021/healthz/ready\": dial tcp 10.132.0.67:15021: connect: connection refused"
Jul 23 16:56:51.909062 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:56:51.909016    2553 patch_prober.go:28] interesting pod/e2e-shared-a-dc9a69-openshift-default-7cc8bdd9f5-dnk62 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.67:15021/healthz/ready\": dial tcp 10.132.0.67:15021: connect: connection refused" start-of-body=
Jul 23 16:56:51.909581 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:56:51.909081    2553 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-dc9a69-openshift-default-7cc8bdd9f5-dnk62" podUID="af3ccc59-08a2-4099-acc3-b3a4291606ee" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.67:15021/healthz/ready\": dial tcp 10.132.0.67:15021: connect: connection refused"
Jul 23 16:56:52.908818 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:56:52.908786    2553 patch_prober.go:28] interesting pod/e2e-shared-a-dc9a69-openshift-default-7cc8bdd9f5-dnk62 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.67:15021/healthz/ready\": dial tcp 10.132.0.67:15021: connect: connection refused" start-of-body=
Jul 23 16:56:52.908985 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:56:52.908841    2553 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-dc9a69-openshift-default-7cc8bdd9f5-dnk62" podUID="af3ccc59-08a2-4099-acc3-b3a4291606ee" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.67:15021/healthz/ready\": dial tcp 10.132.0.67:15021: connect: connection refused"
Jul 23 16:56:53.908738 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:56:53.908695    2553 patch_prober.go:28] interesting pod/e2e-shared-a-dc9a69-openshift-default-7cc8bdd9f5-dnk62 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.67:15021/healthz/ready\": dial tcp 10.132.0.67:15021: connect: connection refused" start-of-body=
Jul 23 16:56:53.909113 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:56:53.908762    2553 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-dc9a69-openshift-default-7cc8bdd9f5-dnk62" podUID="af3ccc59-08a2-4099-acc3-b3a4291606ee" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.67:15021/healthz/ready\": dial tcp 10.132.0.67:15021: connect: connection refused"
Jul 23 16:56:54.913490 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:56:54.913454    2553 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-dc9a69-openshift-default-7cc8bdd9f5-dnk62"
Jul 23 16:56:54.914477 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:56:54.914458    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-dc9a69-openshift-default-7cc8bdd9f5-dnk62"
Jul 23 16:56:56.649501 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:56:56.649469    2553 generic.go:356] "Generic (PLEG): container finished" podID="e0d49a76-8aff-4e5e-adde-8b3538f7508c" containerID="01cfdad7009075023aa5ee5ac8a73069a12cfe8564164d207d23385d685eee8a" exitCode=0
Jul 23 16:56:56.649501 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:56:56.649505    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-6a0c6b-openshift-default-78f6bb967-8hn4k" event={"ID":"e0d49a76-8aff-4e5e-adde-8b3538f7508c","Type":"ContainerDied","Data":"01cfdad7009075023aa5ee5ac8a73069a12cfe8564164d207d23385d685eee8a"}
Jul 23 16:56:56.649978 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:56:56.649907    2553 scope.go:117] "RemoveContainer" containerID="01cfdad7009075023aa5ee5ac8a73069a12cfe8564164d207d23385d685eee8a"
Jul 23 16:56:56.650907 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:56:56.650881    2553 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 23 16:56:56.650976 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:56:56.650963    2553 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 23 16:56:56.651012 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:56:56.650997    2553 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 23 16:56:57.661788 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:56:57.661756    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-6a0c6b-openshift-default-78f6bb967-8hn4k" event={"ID":"e0d49a76-8aff-4e5e-adde-8b3538f7508c","Type":"ContainerStarted","Data":"fe5d797bebd8fa9deb22e13cad9247732afdceaa7ddc7eaf386b1a1a5e7516f2"}
Jul 23 16:56:58.043808 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:56:58.043706    2553 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-6a0c6b-openshift-default-78f6bb967-8hn4k"
Jul 23 16:56:58.044070 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:56:58.044039    2553 patch_prober.go:28] interesting pod/e2e-shared-b-6a0c6b-openshift-default-78f6bb967-8hn4k container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.68:15021/healthz/ready\": dial tcp 10.132.0.68:15021: connect: connection refused" start-of-body=
Jul 23 16:56:58.044264 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:56:58.044237    2553 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-6a0c6b-openshift-default-78f6bb967-8hn4k" podUID="e0d49a76-8aff-4e5e-adde-8b3538f7508c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.68:15021/healthz/ready\": dial tcp 10.132.0.68:15021: connect: connection refused"
Jul 23 16:56:58.563522 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:56:58.563483    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-6a0c6b-openshift-default-78f6bb967-8hn4k"
Jul 23 16:56:59.042187 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:56:59.042124    2553 patch_prober.go:28] interesting pod/e2e-shared-b-6a0c6b-openshift-default-78f6bb967-8hn4k container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.68:15021/healthz/ready\": dial tcp 10.132.0.68:15021: connect: connection refused" start-of-body=
Jul 23 16:56:59.042808 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:56:59.042771    2553 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-6a0c6b-openshift-default-78f6bb967-8hn4k" podUID="e0d49a76-8aff-4e5e-adde-8b3538f7508c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.68:15021/healthz/ready\": dial tcp 10.132.0.68:15021: connect: connection refused"
Jul 23 16:57:00.042704 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:57:00.042663    2553 patch_prober.go:28] interesting pod/e2e-shared-b-6a0c6b-openshift-default-78f6bb967-8hn4k container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.68:15021/healthz/ready\": dial tcp 10.132.0.68:15021: connect: connection refused" start-of-body=
Jul 23 16:57:00.043363 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:57:00.043328    2553 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-6a0c6b-openshift-default-78f6bb967-8hn4k" podUID="e0d49a76-8aff-4e5e-adde-8b3538f7508c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.68:15021/healthz/ready\": dial tcp 10.132.0.68:15021: connect: connection refused"
Jul 23 16:57:01.041791 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:57:01.041744    2553 patch_prober.go:28] interesting pod/e2e-shared-b-6a0c6b-openshift-default-78f6bb967-8hn4k container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.68:15021/healthz/ready\": dial tcp 10.132.0.68:15021: connect: connection refused" start-of-body=
Jul 23 16:57:01.042019 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:57:01.041814    2553 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-6a0c6b-openshift-default-78f6bb967-8hn4k" podUID="e0d49a76-8aff-4e5e-adde-8b3538f7508c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.68:15021/healthz/ready\": dial tcp 10.132.0.68:15021: connect: connection refused"
Jul 23 16:57:02.046295 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:57:02.046264    2553 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-6a0c6b-openshift-default-78f6bb967-8hn4k"
Jul 23 16:57:02.047268 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:57:02.047248    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-6a0c6b-openshift-default-78f6bb967-8hn4k"
Jul 23 16:57:18.944822 ip-10-0-143-166 kubenswrapper[2553]: I0723 16:57:18.944741    2553 scope.go:117] "RemoveContainer" containerID="9a6ef756ccebcb0396fbd5c1ffca431062d77d2abd572a3c32b9745a10bd49a8"
Jul 23 17:00:00.140614 ip-10-0-143-166 kubenswrapper[2553]: I0723 17:00:00.140578    2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-6a0c6b-29747100-4dclf"]
Jul 23 17:00:00.141151 ip-10-0-143-166 kubenswrapper[2553]: I0723 17:00:00.140984    2553 memory_manager.go:368] "RemoveStaleState removing state" podUID="70275616-883f-4d70-9577-cd565c31733a" containerName="istio-proxy"
Jul 23 17:00:00.144121 ip-10-0-143-166 kubenswrapper[2553]: I0723 17:00:00.144103    2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29747100-2wsk7"]
Jul 23 17:00:00.144254 ip-10-0-143-166 kubenswrapper[2553]: I0723 17:00:00.144233    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-6a0c6b-29747100-4dclf"
Jul 23 17:00:00.147037 ip-10-0-143-166 kubenswrapper[2553]: I0723 17:00:00.147018    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-plqcf\""
Jul 23 17:00:00.147359 ip-10-0-143-166 kubenswrapper[2553]: I0723 17:00:00.147343    2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-dc9a69-29747100-rx5x2"]
Jul 23 17:00:00.147480 ip-10-0-143-166 kubenswrapper[2553]: I0723 17:00:00.147464    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29747100-2wsk7"
Jul 23 17:00:00.150434 ip-10-0-143-166 kubenswrapper[2553]: I0723 17:00:00.150413    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-dc9a69-29747100-rx5x2"
Jul 23 17:00:00.152747 ip-10-0-143-166 kubenswrapper[2553]: I0723 17:00:00.152725    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-6a0c6b-29747100-4dclf"]
Jul 23 17:00:00.156292 ip-10-0-143-166 kubenswrapper[2553]: I0723 17:00:00.156272    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-dc9a69-29747100-rx5x2"]
Jul 23 17:00:00.158755 ip-10-0-143-166 kubenswrapper[2553]: I0723 17:00:00.158733    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-6a0c6b-29747100-4dclf"
Jul 23 17:00:00.159506 ip-10-0-143-166 kubenswrapper[2553]: I0723 17:00:00.159483    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29747100-2wsk7"]
Jul 23 17:00:00.168037 ip-10-0-143-166 kubenswrapper[2553]: I0723 17:00:00.168018    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29747100-2wsk7"
Jul 23 17:00:00.200701 ip-10-0-143-166 kubenswrapper[2553]: I0723 17:00:00.200676    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-dc9a69-29747100-rx5x2"
Jul 23 17:00:00.324768 ip-10-0-143-166 kubenswrapper[2553]: I0723 17:00:00.324735    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-6a0c6b-29747100-4dclf"]
Jul 23 17:00:00.327592 ip-10-0-143-166 kubenswrapper[2553]: W0723 17:00:00.327558    2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod913ba62c_cc94_49e1_9c04_adff63d98207.slice/crio-ffe56db28004c318e60d38609e4e0fabb002c1b762f555816d66c9c3999cf314 WatchSource:0}: Error finding container ffe56db28004c318e60d38609e4e0fabb002c1b762f555816d66c9c3999cf314: Status 404 returned error can't find the container with id ffe56db28004c318e60d38609e4e0fabb002c1b762f555816d66c9c3999cf314
Jul 23 17:00:00.384820 ip-10-0-143-166 kubenswrapper[2553]: I0723 17:00:00.384797    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-dc9a69-29747100-rx5x2"]
Jul 23 17:00:00.386593 ip-10-0-143-166 kubenswrapper[2553]: W0723 17:00:00.386566    2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod58ab8ed0_db90_41cf_890a_891ae479dba6.slice/crio-7dcb22ca10eaedc33d52d1ceabbb8801483e02b990e9d7c7e21e53959d234c09 WatchSource:0}: Error finding container 7dcb22ca10eaedc33d52d1ceabbb8801483e02b990e9d7c7e21e53959d234c09: Status 404 returned error can't find the container with id 7dcb22ca10eaedc33d52d1ceabbb8801483e02b990e9d7c7e21e53959d234c09
Jul 23 17:00:00.564496 ip-10-0-143-166 kubenswrapper[2553]: I0723 17:00:00.564470    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29747100-2wsk7"]
Jul 23 17:00:00.566534 ip-10-0-143-166 kubenswrapper[2553]: W0723 17:00:00.566510    2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod242f30a8_9130_4dfb_81e9_e493485f1eac.slice/crio-4879210d2fa54b3c0030408e889e67d9311643c7b43d7e3a2f672c470b9fee38 WatchSource:0}: Error finding container 4879210d2fa54b3c0030408e889e67d9311643c7b43d7e3a2f672c470b9fee38: Status 404 returned error can't find the container with id 4879210d2fa54b3c0030408e889e67d9311643c7b43d7e3a2f672c470b9fee38
Jul 23 17:00:00.658678 ip-10-0-143-166 kubenswrapper[2553]: I0723 17:00:00.658602    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-6a0c6b-29747100-4dclf" event={"ID":"913ba62c-cc94-49e1-9c04-adff63d98207","Type":"ContainerStarted","Data":"f67a70e26d8e4a561c6c4c36e4929a6ff1b14905afdfcb72c4f40557b0b51a04"}
Jul 23 17:00:00.658678 ip-10-0-143-166 kubenswrapper[2553]: I0723 17:00:00.658657    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-6a0c6b-29747100-4dclf" event={"ID":"913ba62c-cc94-49e1-9c04-adff63d98207","Type":"ContainerStarted","Data":"ffe56db28004c318e60d38609e4e0fabb002c1b762f555816d66c9c3999cf314"}
Jul 23 17:00:00.659937 ip-10-0-143-166 kubenswrapper[2553]: I0723 17:00:00.659914    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29747100-2wsk7" event={"ID":"242f30a8-9130-4dfb-81e9-e493485f1eac","Type":"ContainerStarted","Data":"4879210d2fa54b3c0030408e889e67d9311643c7b43d7e3a2f672c470b9fee38"}
Jul 23 17:00:00.661342 ip-10-0-143-166 kubenswrapper[2553]: I0723 17:00:00.661322    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-dc9a69-29747100-rx5x2" event={"ID":"58ab8ed0-db90-41cf-890a-891ae479dba6","Type":"ContainerStarted","Data":"68c2f5b1f32ae09bb80e9442a171f5b2419bd1b7a560603ac4dcdbec8d75829a"}
Jul 23 17:00:00.661430 ip-10-0-143-166 kubenswrapper[2553]: I0723 17:00:00.661362    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-dc9a69-29747100-rx5x2" event={"ID":"58ab8ed0-db90-41cf-890a-891ae479dba6","Type":"ContainerStarted","Data":"7dcb22ca10eaedc33d52d1ceabbb8801483e02b990e9d7c7e21e53959d234c09"}
Jul 23 17:00:00.679070 ip-10-0-143-166 kubenswrapper[2553]: I0723 17:00:00.679012    2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-6a0c6b-29747100-4dclf" podStartSLOduration=0.678994473 podStartE2EDuration="678.994473ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 17:00:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 17:00:00.675126055 +0000 UTC m=+2682.539732185" watchObservedRunningTime="2026-07-23 17:00:00.678994473 +0000 UTC m=+2682.543600600"
Jul 23 17:00:00.691810 ip-10-0-143-166 kubenswrapper[2553]: I0723 17:00:00.691760    2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-dc9a69-29747100-rx5x2" podStartSLOduration=0.691746787 podStartE2EDuration="691.746787ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 17:00:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 17:00:00.690658674 +0000 UTC m=+2682.555264794" watchObservedRunningTime="2026-07-23 17:00:00.691746787 +0000 UTC m=+2682.556352893"
Jul 23 17:00:01.668619 ip-10-0-143-166 kubenswrapper[2553]: I0723 17:00:01.668585    2553 generic.go:356] "Generic (PLEG): container finished" podID="913ba62c-cc94-49e1-9c04-adff63d98207" containerID="f67a70e26d8e4a561c6c4c36e4929a6ff1b14905afdfcb72c4f40557b0b51a04" exitCode=0
Jul 23 17:00:01.669061 ip-10-0-143-166 kubenswrapper[2553]: I0723 17:00:01.668668    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-6a0c6b-29747100-4dclf" event={"ID":"913ba62c-cc94-49e1-9c04-adff63d98207","Type":"ContainerDied","Data":"f67a70e26d8e4a561c6c4c36e4929a6ff1b14905afdfcb72c4f40557b0b51a04"}
Jul 23 17:00:01.670126 ip-10-0-143-166 kubenswrapper[2553]: I0723 17:00:01.670103    2553 generic.go:356] "Generic (PLEG): container finished" podID="242f30a8-9130-4dfb-81e9-e493485f1eac" containerID="3defd4c8d420bfbcd799bdb665ee8de79028c7500df48d7d6a7ff5252671d621" exitCode=0
Jul 23 17:00:01.670278 ip-10-0-143-166 kubenswrapper[2553]: I0723 17:00:01.670186    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29747100-2wsk7" event={"ID":"242f30a8-9130-4dfb-81e9-e493485f1eac","Type":"ContainerDied","Data":"3defd4c8d420bfbcd799bdb665ee8de79028c7500df48d7d6a7ff5252671d621"}
Jul 23 17:00:01.671649 ip-10-0-143-166 kubenswrapper[2553]: I0723 17:00:01.671624    2553 generic.go:356] "Generic (PLEG): container finished" podID="58ab8ed0-db90-41cf-890a-891ae479dba6" containerID="68c2f5b1f32ae09bb80e9442a171f5b2419bd1b7a560603ac4dcdbec8d75829a" exitCode=0
Jul 23 17:00:01.671741 ip-10-0-143-166 kubenswrapper[2553]: I0723 17:00:01.671685    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-dc9a69-29747100-rx5x2" event={"ID":"58ab8ed0-db90-41cf-890a-891ae479dba6","Type":"ContainerDied","Data":"68c2f5b1f32ae09bb80e9442a171f5b2419bd1b7a560603ac4dcdbec8d75829a"}
Jul 23 17:00:02.839271 ip-10-0-143-166 kubenswrapper[2553]: I0723 17:00:02.839244    2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-dc9a69-29747100-rx5x2"
Jul 23 17:00:02.872674 ip-10-0-143-166 kubenswrapper[2553]: I0723 17:00:02.872647    2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29747100-2wsk7"
Jul 23 17:00:02.876344 ip-10-0-143-166 kubenswrapper[2553]: I0723 17:00:02.876314    2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-6a0c6b-29747100-4dclf"
Jul 23 17:00:03.684520 ip-10-0-143-166 kubenswrapper[2553]: I0723 17:00:03.684492    2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-dc9a69-29747100-rx5x2"
Jul 23 17:00:03.684714 ip-10-0-143-166 kubenswrapper[2553]: I0723 17:00:03.684537    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-dc9a69-29747100-rx5x2" event={"ID":"58ab8ed0-db90-41cf-890a-891ae479dba6","Type":"ContainerDied","Data":"7dcb22ca10eaedc33d52d1ceabbb8801483e02b990e9d7c7e21e53959d234c09"}
Jul 23 17:00:03.684714 ip-10-0-143-166 kubenswrapper[2553]: I0723 17:00:03.684580    2553 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="7dcb22ca10eaedc33d52d1ceabbb8801483e02b990e9d7c7e21e53959d234c09"
Jul 23 17:00:03.685977 ip-10-0-143-166 kubenswrapper[2553]: I0723 17:00:03.685955    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-6a0c6b-29747100-4dclf" event={"ID":"913ba62c-cc94-49e1-9c04-adff63d98207","Type":"ContainerDied","Data":"ffe56db28004c318e60d38609e4e0fabb002c1b762f555816d66c9c3999cf314"}
Jul 23 17:00:03.686082 ip-10-0-143-166 kubenswrapper[2553]: I0723 17:00:03.685999    2553 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="ffe56db28004c318e60d38609e4e0fabb002c1b762f555816d66c9c3999cf314"
Jul 23 17:00:03.686082 ip-10-0-143-166 kubenswrapper[2553]: I0723 17:00:03.685958    2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-6a0c6b-29747100-4dclf"
Jul 23 17:00:03.687291 ip-10-0-143-166 kubenswrapper[2553]: I0723 17:00:03.687269    2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29747100-2wsk7"
Jul 23 17:00:03.687291 ip-10-0-143-166 kubenswrapper[2553]: I0723 17:00:03.687271    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29747100-2wsk7" event={"ID":"242f30a8-9130-4dfb-81e9-e493485f1eac","Type":"ContainerDied","Data":"4879210d2fa54b3c0030408e889e67d9311643c7b43d7e3a2f672c470b9fee38"}
Jul 23 17:00:03.687479 ip-10-0-143-166 kubenswrapper[2553]: I0723 17:00:03.687311    2553 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="4879210d2fa54b3c0030408e889e67d9311643c7b43d7e3a2f672c470b9fee38"
Jul 23 17:00:18.796284 ip-10-0-143-166 kubenswrapper[2553]: I0723 17:00:18.796207    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-7rmrn_976a7198-cfd3-43d4-8c9f-b1f248d1f6d7/console-operator/1.log"
Jul 23 17:00:18.803147 ip-10-0-143-166 kubenswrapper[2553]: I0723 17:00:18.803121    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-7rmrn_976a7198-cfd3-43d4-8c9f-b1f248d1f6d7/console-operator/1.log"
Jul 23 17:01:18.996909 ip-10-0-143-166 kubenswrapper[2553]: I0723 17:01:18.996875    2553 scope.go:117] "RemoveContainer" containerID="9995e6496f226c2b5d3279e130b0bc8d4e05c93266a4245460b3880cde188df4"
Jul 23 17:01:19.005718 ip-10-0-143-166 kubenswrapper[2553]: I0723 17:01:19.005697    2553 scope.go:117] "RemoveContainer" containerID="d487fec327bff0524995191906d8deab4220cce8587d55707f8b83f1d8c511ed"
Jul 23 17:02:19.032060 ip-10-0-143-166 kubenswrapper[2553]: I0723 17:02:19.032026    2553 scope.go:117] "RemoveContainer" containerID="97b80822e1f3d7d35bc52cb5dbb3284b343cea9196bbffa7a2ecad368fd0b878"
Jul 23 17:02:19.040938 ip-10-0-143-166 kubenswrapper[2553]: I0723 17:02:19.040915    2553 scope.go:117] "RemoveContainer" containerID="d57ddd362adf0e0ec2bfd1efc394824361764a241e0a6a5685fcbb27756b1e05"
Jul 23 17:02:44.101598 ip-10-0-143-166 kubenswrapper[2553]: I0723 17:02:44.101565    2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7579-140666632396592"]
Jul 23 17:02:44.102079 ip-10-0-143-166 kubenswrapper[2553]: I0723 17:02:44.101910    2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="913ba62c-cc94-49e1-9c04-adff63d98207" containerName="cleanup"
Jul 23 17:02:44.102079 ip-10-0-143-166 kubenswrapper[2553]: I0723 17:02:44.101921    2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="913ba62c-cc94-49e1-9c04-adff63d98207" containerName="cleanup"
Jul 23 17:02:44.102079 ip-10-0-143-166 kubenswrapper[2553]: I0723 17:02:44.101937    2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="242f30a8-9130-4dfb-81e9-e493485f1eac" containerName="cleanup"
Jul 23 17:02:44.102079 ip-10-0-143-166 kubenswrapper[2553]: I0723 17:02:44.101943    2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="242f30a8-9130-4dfb-81e9-e493485f1eac" containerName="cleanup"
Jul 23 17:02:44.102079 ip-10-0-143-166 kubenswrapper[2553]: I0723 17:02:44.101956    2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="58ab8ed0-db90-41cf-890a-891ae479dba6" containerName="cleanup"
Jul 23 17:02:44.102079 ip-10-0-143-166 kubenswrapper[2553]: I0723 17:02:44.101962    2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="58ab8ed0-db90-41cf-890a-891ae479dba6" containerName="cleanup"
Jul 23 17:02:44.102079 ip-10-0-143-166 kubenswrapper[2553]: I0723 17:02:44.102018    2553 memory_manager.go:368] "RemoveStaleState removing state" podUID="242f30a8-9130-4dfb-81e9-e493485f1eac" containerName="cleanup"
Jul 23 17:02:44.102079 ip-10-0-143-166 kubenswrapper[2553]: I0723 17:02:44.102026    2553 memory_manager.go:368] "RemoveStaleState removing state" podUID="58ab8ed0-db90-41cf-890a-891ae479dba6" containerName="cleanup"
Jul 23 17:02:44.102079 ip-10-0-143-166 kubenswrapper[2553]: I0723 17:02:44.102036    2553 memory_manager.go:368] "RemoveStaleState removing state" podUID="913ba62c-cc94-49e1-9c04-adff63d98207" containerName="cleanup"
Jul 23 17:02:44.105134 ip-10-0-143-166 kubenswrapper[2553]: I0723 17:02:44.105116    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7579-140666632396592"
Jul 23 17:02:44.109319 ip-10-0-143-166 kubenswrapper[2553]: I0723 17:02:44.109300    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-fk4gd\""
Jul 23 17:02:44.117695 ip-10-0-143-166 kubenswrapper[2553]: I0723 17:02:44.117665    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7579-140666632396592"]
Jul 23 17:02:44.284117 ip-10-0-143-166 kubenswrapper[2553]: I0723 17:02:44.284076    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8x8jl\" (UniqueName: \"kubernetes.io/projected/9c6f0d44-da34-4a11-8d36-d9f95fbb7f11-kube-api-access-8x8jl\") pod \"test-curl-7579-140666632396592\" (UID: \"9c6f0d44-da34-4a11-8d36-d9f95fbb7f11\") " pod="opendatahub/test-curl-7579-140666632396592"
Jul 23 17:02:44.384632 ip-10-0-143-166 kubenswrapper[2553]: I0723 17:02:44.384528    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8x8jl\" (UniqueName: \"kubernetes.io/projected/9c6f0d44-da34-4a11-8d36-d9f95fbb7f11-kube-api-access-8x8jl\") pod \"test-curl-7579-140666632396592\" (UID: \"9c6f0d44-da34-4a11-8d36-d9f95fbb7f11\") " pod="opendatahub/test-curl-7579-140666632396592"
Jul 23 17:02:44.392869 ip-10-0-143-166 kubenswrapper[2553]: I0723 17:02:44.392836    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8x8jl\" (UniqueName: \"kubernetes.io/projected/9c6f0d44-da34-4a11-8d36-d9f95fbb7f11-kube-api-access-8x8jl\") pod \"test-curl-7579-140666632396592\" (UID: \"9c6f0d44-da34-4a11-8d36-d9f95fbb7f11\") " pod="opendatahub/test-curl-7579-140666632396592"
Jul 23 17:02:44.414614 ip-10-0-143-166 kubenswrapper[2553]: I0723 17:02:44.414583    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7579-140666632396592"
Jul 23 17:02:44.550552 ip-10-0-143-166 kubenswrapper[2553]: I0723 17:02:44.550527    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7579-140666632396592"]
Jul 23 17:02:44.552934 ip-10-0-143-166 kubenswrapper[2553]: W0723 17:02:44.552900    2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod9c6f0d44_da34_4a11_8d36_d9f95fbb7f11.slice/crio-d6df07b5e65f4fe81c318fdf8162eaf3e51455760afe24c72c5b910465904302 WatchSource:0}: Error finding container d6df07b5e65f4fe81c318fdf8162eaf3e51455760afe24c72c5b910465904302: Status 404 returned error can't find the container with id d6df07b5e65f4fe81c318fdf8162eaf3e51455760afe24c72c5b910465904302
Jul 23 17:02:44.554603 ip-10-0-143-166 kubenswrapper[2553]: I0723 17:02:44.554587    2553 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 23 17:02:44.591773 ip-10-0-143-166 kubenswrapper[2553]: I0723 17:02:44.591740    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7579-140666632396592" event={"ID":"9c6f0d44-da34-4a11-8d36-d9f95fbb7f11","Type":"ContainerStarted","Data":"d6df07b5e65f4fe81c318fdf8162eaf3e51455760afe24c72c5b910465904302"}
Jul 23 17:02:45.599337 ip-10-0-143-166 kubenswrapper[2553]: I0723 17:02:45.599247    2553 generic.go:356] "Generic (PLEG): container finished" podID="9c6f0d44-da34-4a11-8d36-d9f95fbb7f11" containerID="7019acd90c3793845f04109e819717ce7d85e23e553e00ee538f5a1925893e15" exitCode=0
Jul 23 17:02:45.599337 ip-10-0-143-166 kubenswrapper[2553]: I0723 17:02:45.599300    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7579-140666632396592" event={"ID":"9c6f0d44-da34-4a11-8d36-d9f95fbb7f11","Type":"ContainerDied","Data":"7019acd90c3793845f04109e819717ce7d85e23e553e00ee538f5a1925893e15"}
Jul 23 17:02:46.741288 ip-10-0-143-166 kubenswrapper[2553]: I0723 17:02:46.741262    2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7579-140666632396592"
Jul 23 17:02:46.778427 ip-10-0-143-166 kubenswrapper[2553]: I0723 17:02:46.778400    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7579-140666632396592_9c6f0d44-da34-4a11-8d36-d9f95fbb7f11/test-curl-7579-140666632396592/0.log"
Jul 23 17:02:46.802440 ip-10-0-143-166 kubenswrapper[2553]: I0723 17:02:46.802412    2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7579-140666632396592"]
Jul 23 17:02:46.806207 ip-10-0-143-166 kubenswrapper[2553]: I0723 17:02:46.806180    2553 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7579-140666632396592"]
Jul 23 17:02:46.906373 ip-10-0-143-166 kubenswrapper[2553]: I0723 17:02:46.906340    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8x8jl\" (UniqueName: \"kubernetes.io/projected/9c6f0d44-da34-4a11-8d36-d9f95fbb7f11-kube-api-access-8x8jl\") pod \"9c6f0d44-da34-4a11-8d36-d9f95fbb7f11\" (UID: \"9c6f0d44-da34-4a11-8d36-d9f95fbb7f11\") "
Jul 23 17:02:46.908670 ip-10-0-143-166 kubenswrapper[2553]: I0723 17:02:46.908638    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9c6f0d44-da34-4a11-8d36-d9f95fbb7f11-kube-api-access-8x8jl" (OuterVolumeSpecName: "kube-api-access-8x8jl") pod "9c6f0d44-da34-4a11-8d36-d9f95fbb7f11" (UID: "9c6f0d44-da34-4a11-8d36-d9f95fbb7f11"). InnerVolumeSpecName "kube-api-access-8x8jl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 17:02:46.932764 ip-10-0-143-166 kubenswrapper[2553]: I0723 17:02:46.932737    2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7579-140666632395568"]
Jul 23 17:02:46.933137 ip-10-0-143-166 kubenswrapper[2553]: I0723 17:02:46.933123    2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9c6f0d44-da34-4a11-8d36-d9f95fbb7f11" containerName="test-curl-7579-140666632396592"
Jul 23 17:02:46.933199 ip-10-0-143-166 kubenswrapper[2553]: I0723 17:02:46.933138    2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="9c6f0d44-da34-4a11-8d36-d9f95fbb7f11" containerName="test-curl-7579-140666632396592"
Jul 23 17:02:46.933248 ip-10-0-143-166 kubenswrapper[2553]: I0723 17:02:46.933219    2553 memory_manager.go:368] "RemoveStaleState removing state" podUID="9c6f0d44-da34-4a11-8d36-d9f95fbb7f11" containerName="test-curl-7579-140666632396592"
Jul 23 17:02:46.936321 ip-10-0-143-166 kubenswrapper[2553]: I0723 17:02:46.936305    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7579-140666632395568"
Jul 23 17:02:46.944216 ip-10-0-143-166 kubenswrapper[2553]: I0723 17:02:46.944189    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7579-140666632395568"]
Jul 23 17:02:47.007440 ip-10-0-143-166 kubenswrapper[2553]: I0723 17:02:47.007404    2553 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8x8jl\" (UniqueName: \"kubernetes.io/projected/9c6f0d44-da34-4a11-8d36-d9f95fbb7f11-kube-api-access-8x8jl\") on node \"ip-10-0-143-166.ec2.internal\" DevicePath \"\""
Jul 23 17:02:47.107892 ip-10-0-143-166 kubenswrapper[2553]: I0723 17:02:47.107855    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t9qsw\" (UniqueName: \"kubernetes.io/projected/c99b95c2-245c-4a0d-869c-c3be1d28e05f-kube-api-access-t9qsw\") pod \"test-curl-7579-140666632395568\" (UID: \"c99b95c2-245c-4a0d-869c-c3be1d28e05f\") " pod="opendatahub/test-curl-7579-140666632395568"
Jul 23 17:02:47.208787 ip-10-0-143-166 kubenswrapper[2553]: I0723 17:02:47.208687    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t9qsw\" (UniqueName: \"kubernetes.io/projected/c99b95c2-245c-4a0d-869c-c3be1d28e05f-kube-api-access-t9qsw\") pod \"test-curl-7579-140666632395568\" (UID: \"c99b95c2-245c-4a0d-869c-c3be1d28e05f\") " pod="opendatahub/test-curl-7579-140666632395568"
Jul 23 17:02:47.217187 ip-10-0-143-166 kubenswrapper[2553]: I0723 17:02:47.217131    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t9qsw\" (UniqueName: \"kubernetes.io/projected/c99b95c2-245c-4a0d-869c-c3be1d28e05f-kube-api-access-t9qsw\") pod \"test-curl-7579-140666632395568\" (UID: \"c99b95c2-245c-4a0d-869c-c3be1d28e05f\") " pod="opendatahub/test-curl-7579-140666632395568"
Jul 23 17:02:47.247252 ip-10-0-143-166 kubenswrapper[2553]: I0723 17:02:47.247216    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7579-140666632395568"
Jul 23 17:02:47.383949 ip-10-0-143-166 kubenswrapper[2553]: I0723 17:02:47.383919    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7579-140666632395568"]
Jul 23 17:02:47.385153 ip-10-0-143-166 kubenswrapper[2553]: W0723 17:02:47.385122    2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc99b95c2_245c_4a0d_869c_c3be1d28e05f.slice/crio-489246afbb166356d5c899fe97749cc266597797ef8223442ccbaeba8106f30a WatchSource:0}: Error finding container 489246afbb166356d5c899fe97749cc266597797ef8223442ccbaeba8106f30a: Status 404 returned error can't find the container with id 489246afbb166356d5c899fe97749cc266597797ef8223442ccbaeba8106f30a
Jul 23 17:02:47.611717 ip-10-0-143-166 kubenswrapper[2553]: I0723 17:02:47.611614    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7579-140666632395568" event={"ID":"c99b95c2-245c-4a0d-869c-c3be1d28e05f","Type":"ContainerStarted","Data":"489246afbb166356d5c899fe97749cc266597797ef8223442ccbaeba8106f30a"}
Jul 23 17:02:47.612937 ip-10-0-143-166 kubenswrapper[2553]: I0723 17:02:47.612915    2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7579-140666632396592"
Jul 23 17:02:47.613074 ip-10-0-143-166 kubenswrapper[2553]: I0723 17:02:47.612953    2553 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="d6df07b5e65f4fe81c318fdf8162eaf3e51455760afe24c72c5b910465904302"
Jul 23 17:02:47.623820 ip-10-0-143-166 kubenswrapper[2553]: E0723 17:02:47.623786    2553 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7579-140666632396592\" is forbidden: User \"system:node:ip-10-0-143-166.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-143-166.ec2.internal' and this object" podUID="9c6f0d44-da34-4a11-8d36-d9f95fbb7f11" pod="opendatahub/test-curl-7579-140666632396592"
Jul 23 17:02:48.620641 ip-10-0-143-166 kubenswrapper[2553]: I0723 17:02:48.620610    2553 generic.go:356] "Generic (PLEG): container finished" podID="c99b95c2-245c-4a0d-869c-c3be1d28e05f" containerID="5d1bdcae8a2b086362a481178142ce5185b6a909777773bdedc2e4a6a895e5f9" exitCode=0
Jul 23 17:02:48.621078 ip-10-0-143-166 kubenswrapper[2553]: I0723 17:02:48.620696    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7579-140666632395568" event={"ID":"c99b95c2-245c-4a0d-869c-c3be1d28e05f","Type":"ContainerDied","Data":"5d1bdcae8a2b086362a481178142ce5185b6a909777773bdedc2e4a6a895e5f9"}
Jul 23 17:02:48.637788 ip-10-0-143-166 kubenswrapper[2553]: E0723 17:02:48.637752    2553 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7579-140666632396592\" is forbidden: User \"system:node:ip-10-0-143-166.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-143-166.ec2.internal' and this object" podUID="9c6f0d44-da34-4a11-8d36-d9f95fbb7f11" pod="opendatahub/test-curl-7579-140666632396592"
Jul 23 17:02:48.675203 ip-10-0-143-166 kubenswrapper[2553]: I0723 17:02:48.675152    2553 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9c6f0d44-da34-4a11-8d36-d9f95fbb7f11" path="/var/lib/kubelet/pods/9c6f0d44-da34-4a11-8d36-d9f95fbb7f11/volumes"
Jul 23 17:02:48.678043 ip-10-0-143-166 kubenswrapper[2553]: E0723 17:02:48.678013    2553 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7579-140666632396592\" is forbidden: User \"system:node:ip-10-0-143-166.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-143-166.ec2.internal' and this object" podUID="9c6f0d44-da34-4a11-8d36-d9f95fbb7f11" pod="opendatahub/test-curl-7579-140666632396592"
Jul 23 17:02:49.762174 ip-10-0-143-166 kubenswrapper[2553]: I0723 17:02:49.762142    2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7579-140666632395568"
Jul 23 17:02:49.785199 ip-10-0-143-166 kubenswrapper[2553]: I0723 17:02:49.785174    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7579-140666632395568_c99b95c2-245c-4a0d-869c-c3be1d28e05f/test-curl-7579-140666632395568/0.log"
Jul 23 17:02:49.810983 ip-10-0-143-166 kubenswrapper[2553]: I0723 17:02:49.810951    2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7579-140666632395568"]
Jul 23 17:02:49.815265 ip-10-0-143-166 kubenswrapper[2553]: I0723 17:02:49.815241    2553 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7579-140666632395568"]
Jul 23 17:02:49.931073 ip-10-0-143-166 kubenswrapper[2553]: I0723 17:02:49.931042    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-t9qsw\" (UniqueName: \"kubernetes.io/projected/c99b95c2-245c-4a0d-869c-c3be1d28e05f-kube-api-access-t9qsw\") pod \"c99b95c2-245c-4a0d-869c-c3be1d28e05f\" (UID: \"c99b95c2-245c-4a0d-869c-c3be1d28e05f\") "
Jul 23 17:02:49.933255 ip-10-0-143-166 kubenswrapper[2553]: I0723 17:02:49.933229    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c99b95c2-245c-4a0d-869c-c3be1d28e05f-kube-api-access-t9qsw" (OuterVolumeSpecName: "kube-api-access-t9qsw") pod "c99b95c2-245c-4a0d-869c-c3be1d28e05f" (UID: "c99b95c2-245c-4a0d-869c-c3be1d28e05f"). InnerVolumeSpecName "kube-api-access-t9qsw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 17:02:49.987474 ip-10-0-143-166 kubenswrapper[2553]: I0723 17:02:49.987443    2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7579-140666632254496"]
Jul 23 17:02:49.987829 ip-10-0-143-166 kubenswrapper[2553]: I0723 17:02:49.987816    2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c99b95c2-245c-4a0d-869c-c3be1d28e05f" containerName="test-curl-7579-140666632395568"
Jul 23 17:02:49.987877 ip-10-0-143-166 kubenswrapper[2553]: I0723 17:02:49.987830    2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="c99b95c2-245c-4a0d-869c-c3be1d28e05f" containerName="test-curl-7579-140666632395568"
Jul 23 17:02:49.987917 ip-10-0-143-166 kubenswrapper[2553]: I0723 17:02:49.987912    2553 memory_manager.go:368] "RemoveStaleState removing state" podUID="c99b95c2-245c-4a0d-869c-c3be1d28e05f" containerName="test-curl-7579-140666632395568"
Jul 23 17:02:49.991297 ip-10-0-143-166 kubenswrapper[2553]: I0723 17:02:49.991279    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7579-140666632254496"
Jul 23 17:02:49.999112 ip-10-0-143-166 kubenswrapper[2553]: I0723 17:02:49.999086    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7579-140666632254496"]
Jul 23 17:02:50.032029 ip-10-0-143-166 kubenswrapper[2553]: I0723 17:02:50.031994    2553 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-t9qsw\" (UniqueName: \"kubernetes.io/projected/c99b95c2-245c-4a0d-869c-c3be1d28e05f-kube-api-access-t9qsw\") on node \"ip-10-0-143-166.ec2.internal\" DevicePath \"\""
Jul 23 17:02:50.133366 ip-10-0-143-166 kubenswrapper[2553]: I0723 17:02:50.133336    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lwppg\" (UniqueName: \"kubernetes.io/projected/31add6a2-9b7a-4e23-bc19-efb8d7e9639a-kube-api-access-lwppg\") pod \"test-curl-7579-140666632254496\" (UID: \"31add6a2-9b7a-4e23-bc19-efb8d7e9639a\") " pod="opendatahub/test-curl-7579-140666632254496"
Jul 23 17:02:50.234965 ip-10-0-143-166 kubenswrapper[2553]: I0723 17:02:50.234860    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lwppg\" (UniqueName: \"kubernetes.io/projected/31add6a2-9b7a-4e23-bc19-efb8d7e9639a-kube-api-access-lwppg\") pod \"test-curl-7579-140666632254496\" (UID: \"31add6a2-9b7a-4e23-bc19-efb8d7e9639a\") " pod="opendatahub/test-curl-7579-140666632254496"
Jul 23 17:02:50.243900 ip-10-0-143-166 kubenswrapper[2553]: I0723 17:02:50.243877    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lwppg\" (UniqueName: \"kubernetes.io/projected/31add6a2-9b7a-4e23-bc19-efb8d7e9639a-kube-api-access-lwppg\") pod \"test-curl-7579-140666632254496\" (UID: \"31add6a2-9b7a-4e23-bc19-efb8d7e9639a\") " pod="opendatahub/test-curl-7579-140666632254496"
Jul 23 17:02:50.301932 ip-10-0-143-166 kubenswrapper[2553]: I0723 17:02:50.301905    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7579-140666632254496"
Jul 23 17:02:50.436337 ip-10-0-143-166 kubenswrapper[2553]: I0723 17:02:50.436308    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7579-140666632254496"]
Jul 23 17:02:50.437604 ip-10-0-143-166 kubenswrapper[2553]: W0723 17:02:50.437578    2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod31add6a2_9b7a_4e23_bc19_efb8d7e9639a.slice/crio-010c6ab38b10a6d7b4d4227e45d7112b061b52ff1eaff2dc1f00cc47b7250a16 WatchSource:0}: Error finding container 010c6ab38b10a6d7b4d4227e45d7112b061b52ff1eaff2dc1f00cc47b7250a16: Status 404 returned error can't find the container with id 010c6ab38b10a6d7b4d4227e45d7112b061b52ff1eaff2dc1f00cc47b7250a16
Jul 23 17:02:50.632961 ip-10-0-143-166 kubenswrapper[2553]: I0723 17:02:50.632874    2553 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="489246afbb166356d5c899fe97749cc266597797ef8223442ccbaeba8106f30a"
Jul 23 17:02:50.632961 ip-10-0-143-166 kubenswrapper[2553]: I0723 17:02:50.632890    2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7579-140666632395568"
Jul 23 17:02:50.634446 ip-10-0-143-166 kubenswrapper[2553]: I0723 17:02:50.634422    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7579-140666632254496" event={"ID":"31add6a2-9b7a-4e23-bc19-efb8d7e9639a","Type":"ContainerStarted","Data":"010c6ab38b10a6d7b4d4227e45d7112b061b52ff1eaff2dc1f00cc47b7250a16"}
Jul 23 17:02:50.644304 ip-10-0-143-166 kubenswrapper[2553]: E0723 17:02:50.644272    2553 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7579-140666632395568\" is forbidden: User \"system:node:ip-10-0-143-166.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-143-166.ec2.internal' and this object" podUID="c99b95c2-245c-4a0d-869c-c3be1d28e05f" pod="opendatahub/test-curl-7579-140666632395568"
Jul 23 17:02:50.675128 ip-10-0-143-166 kubenswrapper[2553]: I0723 17:02:50.675095    2553 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c99b95c2-245c-4a0d-869c-c3be1d28e05f" path="/var/lib/kubelet/pods/c99b95c2-245c-4a0d-869c-c3be1d28e05f/volumes"
Jul 23 17:02:51.641901 ip-10-0-143-166 kubenswrapper[2553]: I0723 17:02:51.641866    2553 generic.go:356] "Generic (PLEG): container finished" podID="31add6a2-9b7a-4e23-bc19-efb8d7e9639a" containerID="b8a53a88ce38e096ec8d25c019480cf5c8f19a4d11ac0f3ff7513a4698557401" exitCode=0
Jul 23 17:02:51.642344 ip-10-0-143-166 kubenswrapper[2553]: I0723 17:02:51.641953    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7579-140666632254496" event={"ID":"31add6a2-9b7a-4e23-bc19-efb8d7e9639a","Type":"ContainerDied","Data":"b8a53a88ce38e096ec8d25c019480cf5c8f19a4d11ac0f3ff7513a4698557401"}
Jul 23 17:02:52.788387 ip-10-0-143-166 kubenswrapper[2553]: I0723 17:02:52.788359    2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7579-140666632254496"
Jul 23 17:02:52.809649 ip-10-0-143-166 kubenswrapper[2553]: I0723 17:02:52.809620    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7579-140666632254496_31add6a2-9b7a-4e23-bc19-efb8d7e9639a/test-curl-7579-140666632254496/0.log"
Jul 23 17:02:52.833129 ip-10-0-143-166 kubenswrapper[2553]: I0723 17:02:52.833094    2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7579-140666632254496"]
Jul 23 17:02:52.836998 ip-10-0-143-166 kubenswrapper[2553]: I0723 17:02:52.836971    2553 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7579-140666632254496"]
Jul 23 17:02:52.957319 ip-10-0-143-166 kubenswrapper[2553]: I0723 17:02:52.957211    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lwppg\" (UniqueName: \"kubernetes.io/projected/31add6a2-9b7a-4e23-bc19-efb8d7e9639a-kube-api-access-lwppg\") pod \"31add6a2-9b7a-4e23-bc19-efb8d7e9639a\" (UID: \"31add6a2-9b7a-4e23-bc19-efb8d7e9639a\") "
Jul 23 17:02:52.959454 ip-10-0-143-166 kubenswrapper[2553]: I0723 17:02:52.959425    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/31add6a2-9b7a-4e23-bc19-efb8d7e9639a-kube-api-access-lwppg" (OuterVolumeSpecName: "kube-api-access-lwppg") pod "31add6a2-9b7a-4e23-bc19-efb8d7e9639a" (UID: "31add6a2-9b7a-4e23-bc19-efb8d7e9639a"). InnerVolumeSpecName "kube-api-access-lwppg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 17:02:52.976408 ip-10-0-143-166 kubenswrapper[2553]: I0723 17:02:52.976380    2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7579-140666632254496"]
Jul 23 17:02:52.976799 ip-10-0-143-166 kubenswrapper[2553]: I0723 17:02:52.976782    2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="31add6a2-9b7a-4e23-bc19-efb8d7e9639a" containerName="test-curl-7579-140666632254496"
Jul 23 17:02:52.976876 ip-10-0-143-166 kubenswrapper[2553]: I0723 17:02:52.976802    2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="31add6a2-9b7a-4e23-bc19-efb8d7e9639a" containerName="test-curl-7579-140666632254496"
Jul 23 17:02:52.976941 ip-10-0-143-166 kubenswrapper[2553]: I0723 17:02:52.976922    2553 memory_manager.go:368] "RemoveStaleState removing state" podUID="31add6a2-9b7a-4e23-bc19-efb8d7e9639a" containerName="test-curl-7579-140666632254496"
Jul 23 17:02:52.979983 ip-10-0-143-166 kubenswrapper[2553]: I0723 17:02:52.979964    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7579-140666632254496"
Jul 23 17:02:52.986834 ip-10-0-143-166 kubenswrapper[2553]: I0723 17:02:52.986807    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7579-140666632254496"]
Jul 23 17:02:53.058182 ip-10-0-143-166 kubenswrapper[2553]: I0723 17:02:53.058135    2553 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lwppg\" (UniqueName: \"kubernetes.io/projected/31add6a2-9b7a-4e23-bc19-efb8d7e9639a-kube-api-access-lwppg\") on node \"ip-10-0-143-166.ec2.internal\" DevicePath \"\""
Jul 23 17:02:53.159309 ip-10-0-143-166 kubenswrapper[2553]: I0723 17:02:53.159269    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hz6ft\" (UniqueName: \"kubernetes.io/projected/19a090cc-0090-4523-ad87-83ba03abd43a-kube-api-access-hz6ft\") pod \"test-curl-7579-140666632254496\" (UID: \"19a090cc-0090-4523-ad87-83ba03abd43a\") " pod="opendatahub/test-curl-7579-140666632254496"
Jul 23 17:02:53.260327 ip-10-0-143-166 kubenswrapper[2553]: I0723 17:02:53.260232    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hz6ft\" (UniqueName: \"kubernetes.io/projected/19a090cc-0090-4523-ad87-83ba03abd43a-kube-api-access-hz6ft\") pod \"test-curl-7579-140666632254496\" (UID: \"19a090cc-0090-4523-ad87-83ba03abd43a\") " pod="opendatahub/test-curl-7579-140666632254496"
Jul 23 17:02:53.269276 ip-10-0-143-166 kubenswrapper[2553]: I0723 17:02:53.269243    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hz6ft\" (UniqueName: \"kubernetes.io/projected/19a090cc-0090-4523-ad87-83ba03abd43a-kube-api-access-hz6ft\") pod \"test-curl-7579-140666632254496\" (UID: \"19a090cc-0090-4523-ad87-83ba03abd43a\") " pod="opendatahub/test-curl-7579-140666632254496"
Jul 23 17:02:53.290878 ip-10-0-143-166 kubenswrapper[2553]: I0723 17:02:53.290850    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7579-140666632254496"
Jul 23 17:02:53.427387 ip-10-0-143-166 kubenswrapper[2553]: I0723 17:02:53.427360    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7579-140666632254496"]
Jul 23 17:02:53.429246 ip-10-0-143-166 kubenswrapper[2553]: W0723 17:02:53.429218    2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod19a090cc_0090_4523_ad87_83ba03abd43a.slice/crio-96da1276dea313a2638c20b32b09543586ec166e4b20cf0c3a703e6f9b51ac64 WatchSource:0}: Error finding container 96da1276dea313a2638c20b32b09543586ec166e4b20cf0c3a703e6f9b51ac64: Status 404 returned error can't find the container with id 96da1276dea313a2638c20b32b09543586ec166e4b20cf0c3a703e6f9b51ac64
Jul 23 17:02:53.653367 ip-10-0-143-166 kubenswrapper[2553]: I0723 17:02:53.653341    2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7579-140666632254496"
Jul 23 17:02:53.653543 ip-10-0-143-166 kubenswrapper[2553]: I0723 17:02:53.653390    2553 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="010c6ab38b10a6d7b4d4227e45d7112b061b52ff1eaff2dc1f00cc47b7250a16"
Jul 23 17:02:53.654541 ip-10-0-143-166 kubenswrapper[2553]: I0723 17:02:53.654516    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7579-140666632254496" event={"ID":"19a090cc-0090-4523-ad87-83ba03abd43a","Type":"ContainerStarted","Data":"96da1276dea313a2638c20b32b09543586ec166e4b20cf0c3a703e6f9b51ac64"}
Jul 23 17:02:53.665514 ip-10-0-143-166 kubenswrapper[2553]: I0723 17:02:53.665487    2553 status_manager.go:1027] "Pod was deleted and then recreated, skipping status update" pod="opendatahub/test-curl-7579-140666632254496" oldPodUID="31add6a2-9b7a-4e23-bc19-efb8d7e9639a" podUID="19a090cc-0090-4523-ad87-83ba03abd43a"
Jul 23 17:02:54.660819 ip-10-0-143-166 kubenswrapper[2553]: I0723 17:02:54.660786    2553 generic.go:356] "Generic (PLEG): container finished" podID="19a090cc-0090-4523-ad87-83ba03abd43a" containerID="72a2c5f8bb1c316f7a5abfca7315e03c569f606bc2e076e81a02bd1383cd7ab7" exitCode=0
Jul 23 17:02:54.661209 ip-10-0-143-166 kubenswrapper[2553]: I0723 17:02:54.660873    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7579-140666632254496" event={"ID":"19a090cc-0090-4523-ad87-83ba03abd43a","Type":"ContainerDied","Data":"72a2c5f8bb1c316f7a5abfca7315e03c569f606bc2e076e81a02bd1383cd7ab7"}
Jul 23 17:02:54.674942 ip-10-0-143-166 kubenswrapper[2553]: I0723 17:02:54.674911    2553 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="31add6a2-9b7a-4e23-bc19-efb8d7e9639a" path="/var/lib/kubelet/pods/31add6a2-9b7a-4e23-bc19-efb8d7e9639a/volumes"
Jul 23 17:02:55.810636 ip-10-0-143-166 kubenswrapper[2553]: I0723 17:02:55.810609    2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7579-140666632254496"
Jul 23 17:02:55.834396 ip-10-0-143-166 kubenswrapper[2553]: I0723 17:02:55.834360    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7579-140666632254496_19a090cc-0090-4523-ad87-83ba03abd43a/test-curl-7579-140666632254496/0.log"
Jul 23 17:02:55.862136 ip-10-0-143-166 kubenswrapper[2553]: I0723 17:02:55.862096    2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7579-140666632254496"]
Jul 23 17:02:55.865699 ip-10-0-143-166 kubenswrapper[2553]: I0723 17:02:55.865674    2553 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7579-140666632254496"]
Jul 23 17:02:55.982788 ip-10-0-143-166 kubenswrapper[2553]: I0723 17:02:55.982695    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hz6ft\" (UniqueName: \"kubernetes.io/projected/19a090cc-0090-4523-ad87-83ba03abd43a-kube-api-access-hz6ft\") pod \"19a090cc-0090-4523-ad87-83ba03abd43a\" (UID: \"19a090cc-0090-4523-ad87-83ba03abd43a\") "
Jul 23 17:02:55.984905 ip-10-0-143-166 kubenswrapper[2553]: I0723 17:02:55.984877    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/19a090cc-0090-4523-ad87-83ba03abd43a-kube-api-access-hz6ft" (OuterVolumeSpecName: "kube-api-access-hz6ft") pod "19a090cc-0090-4523-ad87-83ba03abd43a" (UID: "19a090cc-0090-4523-ad87-83ba03abd43a"). InnerVolumeSpecName "kube-api-access-hz6ft". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 17:02:55.994054 ip-10-0-143-166 kubenswrapper[2553]: I0723 17:02:55.994027    2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7579-140666632255504"]
Jul 23 17:02:55.994452 ip-10-0-143-166 kubenswrapper[2553]: I0723 17:02:55.994435    2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="19a090cc-0090-4523-ad87-83ba03abd43a" containerName="test-curl-7579-140666632254496"
Jul 23 17:02:55.994540 ip-10-0-143-166 kubenswrapper[2553]: I0723 17:02:55.994455    2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="19a090cc-0090-4523-ad87-83ba03abd43a" containerName="test-curl-7579-140666632254496"
Jul 23 17:02:55.994596 ip-10-0-143-166 kubenswrapper[2553]: I0723 17:02:55.994572    2553 memory_manager.go:368] "RemoveStaleState removing state" podUID="19a090cc-0090-4523-ad87-83ba03abd43a" containerName="test-curl-7579-140666632254496"
Jul 23 17:02:55.997519 ip-10-0-143-166 kubenswrapper[2553]: I0723 17:02:55.997499    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7579-140666632255504"
Jul 23 17:02:56.005100 ip-10-0-143-166 kubenswrapper[2553]: I0723 17:02:56.004929    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7579-140666632255504"]
Jul 23 17:02:56.084186 ip-10-0-143-166 kubenswrapper[2553]: I0723 17:02:56.084140    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lhrlj\" (UniqueName: \"kubernetes.io/projected/9210a54c-a00b-4c8b-b42f-bda39c69650c-kube-api-access-lhrlj\") pod \"test-curl-7579-140666632255504\" (UID: \"9210a54c-a00b-4c8b-b42f-bda39c69650c\") " pod="opendatahub/test-curl-7579-140666632255504"
Jul 23 17:02:56.084386 ip-10-0-143-166 kubenswrapper[2553]: I0723 17:02:56.084251    2553 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hz6ft\" (UniqueName: \"kubernetes.io/projected/19a090cc-0090-4523-ad87-83ba03abd43a-kube-api-access-hz6ft\") on node \"ip-10-0-143-166.ec2.internal\" DevicePath \"\""
Jul 23 17:02:56.184855 ip-10-0-143-166 kubenswrapper[2553]: I0723 17:02:56.184814    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lhrlj\" (UniqueName: \"kubernetes.io/projected/9210a54c-a00b-4c8b-b42f-bda39c69650c-kube-api-access-lhrlj\") pod \"test-curl-7579-140666632255504\" (UID: \"9210a54c-a00b-4c8b-b42f-bda39c69650c\") " pod="opendatahub/test-curl-7579-140666632255504"
Jul 23 17:02:56.192882 ip-10-0-143-166 kubenswrapper[2553]: I0723 17:02:56.192856    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lhrlj\" (UniqueName: \"kubernetes.io/projected/9210a54c-a00b-4c8b-b42f-bda39c69650c-kube-api-access-lhrlj\") pod \"test-curl-7579-140666632255504\" (UID: \"9210a54c-a00b-4c8b-b42f-bda39c69650c\") " pod="opendatahub/test-curl-7579-140666632255504"
Jul 23 17:02:56.307948 ip-10-0-143-166 kubenswrapper[2553]: I0723 17:02:56.307870    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7579-140666632255504"
Jul 23 17:02:56.441768 ip-10-0-143-166 kubenswrapper[2553]: I0723 17:02:56.441744    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7579-140666632255504"]
Jul 23 17:02:56.443029 ip-10-0-143-166 kubenswrapper[2553]: W0723 17:02:56.442998    2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod9210a54c_a00b_4c8b_b42f_bda39c69650c.slice/crio-564e8dd9a7728efbbe27f4436d362cb820971f3a703587eb7ccb24f583ce0165 WatchSource:0}: Error finding container 564e8dd9a7728efbbe27f4436d362cb820971f3a703587eb7ccb24f583ce0165: Status 404 returned error can't find the container with id 564e8dd9a7728efbbe27f4436d362cb820971f3a703587eb7ccb24f583ce0165
Jul 23 17:02:56.673532 ip-10-0-143-166 kubenswrapper[2553]: I0723 17:02:56.673502    2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7579-140666632254496"
Jul 23 17:02:56.674963 ip-10-0-143-166 kubenswrapper[2553]: I0723 17:02:56.674936    2553 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="19a090cc-0090-4523-ad87-83ba03abd43a" path="/var/lib/kubelet/pods/19a090cc-0090-4523-ad87-83ba03abd43a/volumes"
Jul 23 17:02:56.675386 ip-10-0-143-166 kubenswrapper[2553]: I0723 17:02:56.675364    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7579-140666632255504" event={"ID":"9210a54c-a00b-4c8b-b42f-bda39c69650c","Type":"ContainerStarted","Data":"564e8dd9a7728efbbe27f4436d362cb820971f3a703587eb7ccb24f583ce0165"}
Jul 23 17:02:56.675479 ip-10-0-143-166 kubenswrapper[2553]: I0723 17:02:56.675406    2553 scope.go:117] "RemoveContainer" containerID="72a2c5f8bb1c316f7a5abfca7315e03c569f606bc2e076e81a02bd1383cd7ab7"
Jul 23 17:02:57.684081 ip-10-0-143-166 kubenswrapper[2553]: I0723 17:02:57.684044    2553 generic.go:356] "Generic (PLEG): container finished" podID="9210a54c-a00b-4c8b-b42f-bda39c69650c" containerID="68037d00641775651d83d10c836b249f6e0bb1e8a94c5492fdc67774039cde18" exitCode=0
Jul 23 17:02:57.684556 ip-10-0-143-166 kubenswrapper[2553]: I0723 17:02:57.684110    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7579-140666632255504" event={"ID":"9210a54c-a00b-4c8b-b42f-bda39c69650c","Type":"ContainerDied","Data":"68037d00641775651d83d10c836b249f6e0bb1e8a94c5492fdc67774039cde18"}
Jul 23 17:02:58.823356 ip-10-0-143-166 kubenswrapper[2553]: I0723 17:02:58.823329    2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7579-140666632255504"
Jul 23 17:02:58.845344 ip-10-0-143-166 kubenswrapper[2553]: I0723 17:02:58.845311    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7579-140666632255504_9210a54c-a00b-4c8b-b42f-bda39c69650c/test-curl-7579-140666632255504/0.log"
Jul 23 17:02:58.870807 ip-10-0-143-166 kubenswrapper[2553]: I0723 17:02:58.870770    2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7579-140666632255504"]
Jul 23 17:02:58.875131 ip-10-0-143-166 kubenswrapper[2553]: I0723 17:02:58.875105    2553 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7579-140666632255504"]
Jul 23 17:02:58.907787 ip-10-0-143-166 kubenswrapper[2553]: I0723 17:02:58.907755    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lhrlj\" (UniqueName: \"kubernetes.io/projected/9210a54c-a00b-4c8b-b42f-bda39c69650c-kube-api-access-lhrlj\") pod \"9210a54c-a00b-4c8b-b42f-bda39c69650c\" (UID: \"9210a54c-a00b-4c8b-b42f-bda39c69650c\") "
Jul 23 17:02:58.909817 ip-10-0-143-166 kubenswrapper[2553]: I0723 17:02:58.909791    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9210a54c-a00b-4c8b-b42f-bda39c69650c-kube-api-access-lhrlj" (OuterVolumeSpecName: "kube-api-access-lhrlj") pod "9210a54c-a00b-4c8b-b42f-bda39c69650c" (UID: "9210a54c-a00b-4c8b-b42f-bda39c69650c"). InnerVolumeSpecName "kube-api-access-lhrlj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 17:02:59.000531 ip-10-0-143-166 kubenswrapper[2553]: I0723 17:02:59.000453    2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7579-140666632255504"]
Jul 23 17:02:59.000810 ip-10-0-143-166 kubenswrapper[2553]: I0723 17:02:59.000798    2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9210a54c-a00b-4c8b-b42f-bda39c69650c" containerName="test-curl-7579-140666632255504"
Jul 23 17:02:59.000852 ip-10-0-143-166 kubenswrapper[2553]: I0723 17:02:59.000813    2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="9210a54c-a00b-4c8b-b42f-bda39c69650c" containerName="test-curl-7579-140666632255504"
Jul 23 17:02:59.000886 ip-10-0-143-166 kubenswrapper[2553]: I0723 17:02:59.000878    2553 memory_manager.go:368] "RemoveStaleState removing state" podUID="9210a54c-a00b-4c8b-b42f-bda39c69650c" containerName="test-curl-7579-140666632255504"
Jul 23 17:02:59.003759 ip-10-0-143-166 kubenswrapper[2553]: I0723 17:02:59.003742    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7579-140666632255504"
Jul 23 17:02:59.008249 ip-10-0-143-166 kubenswrapper[2553]: I0723 17:02:59.008218    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7579-140666632255504"]
Jul 23 17:02:59.008566 ip-10-0-143-166 kubenswrapper[2553]: I0723 17:02:59.008546    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-79j4b\" (UniqueName: \"kubernetes.io/projected/cadd4cd2-a06d-4ab8-90a2-6e67a1d107d5-kube-api-access-79j4b\") pod \"test-curl-7579-140666632255504\" (UID: \"cadd4cd2-a06d-4ab8-90a2-6e67a1d107d5\") " pod="opendatahub/test-curl-7579-140666632255504"
Jul 23 17:02:59.008912 ip-10-0-143-166 kubenswrapper[2553]: I0723 17:02:59.008598    2553 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lhrlj\" (UniqueName: \"kubernetes.io/projected/9210a54c-a00b-4c8b-b42f-bda39c69650c-kube-api-access-lhrlj\") on node \"ip-10-0-143-166.ec2.internal\" DevicePath \"\""
Jul 23 17:02:59.109002 ip-10-0-143-166 kubenswrapper[2553]: I0723 17:02:59.108964    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-79j4b\" (UniqueName: \"kubernetes.io/projected/cadd4cd2-a06d-4ab8-90a2-6e67a1d107d5-kube-api-access-79j4b\") pod \"test-curl-7579-140666632255504\" (UID: \"cadd4cd2-a06d-4ab8-90a2-6e67a1d107d5\") " pod="opendatahub/test-curl-7579-140666632255504"
Jul 23 17:02:59.118940 ip-10-0-143-166 kubenswrapper[2553]: I0723 17:02:59.118911    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-79j4b\" (UniqueName: \"kubernetes.io/projected/cadd4cd2-a06d-4ab8-90a2-6e67a1d107d5-kube-api-access-79j4b\") pod \"test-curl-7579-140666632255504\" (UID: \"cadd4cd2-a06d-4ab8-90a2-6e67a1d107d5\") " pod="opendatahub/test-curl-7579-140666632255504"
Jul 23 17:02:59.314545 ip-10-0-143-166 kubenswrapper[2553]: I0723 17:02:59.314456    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7579-140666632255504"
Jul 23 17:02:59.453014 ip-10-0-143-166 kubenswrapper[2553]: I0723 17:02:59.452989    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7579-140666632255504"]
Jul 23 17:02:59.454851 ip-10-0-143-166 kubenswrapper[2553]: W0723 17:02:59.454819    2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podcadd4cd2_a06d_4ab8_90a2_6e67a1d107d5.slice/crio-f9d4b7f412a7a2475bea624d0ebc67b3a1d3041544d83571b9420c901aebae5e WatchSource:0}: Error finding container f9d4b7f412a7a2475bea624d0ebc67b3a1d3041544d83571b9420c901aebae5e: Status 404 returned error can't find the container with id f9d4b7f412a7a2475bea624d0ebc67b3a1d3041544d83571b9420c901aebae5e
Jul 23 17:02:59.696052 ip-10-0-143-166 kubenswrapper[2553]: I0723 17:02:59.696006    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7579-140666632255504" event={"ID":"cadd4cd2-a06d-4ab8-90a2-6e67a1d107d5","Type":"ContainerStarted","Data":"f9d4b7f412a7a2475bea624d0ebc67b3a1d3041544d83571b9420c901aebae5e"}
Jul 23 17:02:59.697275 ip-10-0-143-166 kubenswrapper[2553]: I0723 17:02:59.697255    2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7579-140666632255504"
Jul 23 17:02:59.697398 ip-10-0-143-166 kubenswrapper[2553]: I0723 17:02:59.697277    2553 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="564e8dd9a7728efbbe27f4436d362cb820971f3a703587eb7ccb24f583ce0165"
Jul 23 17:02:59.709718 ip-10-0-143-166 kubenswrapper[2553]: I0723 17:02:59.709690    2553 status_manager.go:1027] "Pod was deleted and then recreated, skipping status update" pod="opendatahub/test-curl-7579-140666632255504" oldPodUID="9210a54c-a00b-4c8b-b42f-bda39c69650c" podUID="cadd4cd2-a06d-4ab8-90a2-6e67a1d107d5"
Jul 23 17:03:00.674607 ip-10-0-143-166 kubenswrapper[2553]: I0723 17:03:00.674577    2553 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9210a54c-a00b-4c8b-b42f-bda39c69650c" path="/var/lib/kubelet/pods/9210a54c-a00b-4c8b-b42f-bda39c69650c/volumes"
Jul 23 17:03:00.705697 ip-10-0-143-166 kubenswrapper[2553]: I0723 17:03:00.705661    2553 generic.go:356] "Generic (PLEG): container finished" podID="cadd4cd2-a06d-4ab8-90a2-6e67a1d107d5" containerID="cf10fae24f8f35d0616de965ea450963cf89d9e7bbc9cb639311ab98491826d2" exitCode=0
Jul 23 17:03:00.705845 ip-10-0-143-166 kubenswrapper[2553]: I0723 17:03:00.705715    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7579-140666632255504" event={"ID":"cadd4cd2-a06d-4ab8-90a2-6e67a1d107d5","Type":"ContainerDied","Data":"cf10fae24f8f35d0616de965ea450963cf89d9e7bbc9cb639311ab98491826d2"}
Jul 23 17:03:01.852553 ip-10-0-143-166 kubenswrapper[2553]: I0723 17:03:01.852528    2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7579-140666632255504"
Jul 23 17:03:01.872925 ip-10-0-143-166 kubenswrapper[2553]: I0723 17:03:01.872897    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7579-140666632255504_cadd4cd2-a06d-4ab8-90a2-6e67a1d107d5/test-curl-7579-140666632255504/0.log"
Jul 23 17:03:01.900287 ip-10-0-143-166 kubenswrapper[2553]: I0723 17:03:01.900248    2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7579-140666632255504"]
Jul 23 17:03:01.902500 ip-10-0-143-166 kubenswrapper[2553]: I0723 17:03:01.902475    2553 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7579-140666632255504"]
Jul 23 17:03:01.934693 ip-10-0-143-166 kubenswrapper[2553]: I0723 17:03:01.934657    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-79j4b\" (UniqueName: \"kubernetes.io/projected/cadd4cd2-a06d-4ab8-90a2-6e67a1d107d5-kube-api-access-79j4b\") pod \"cadd4cd2-a06d-4ab8-90a2-6e67a1d107d5\" (UID: \"cadd4cd2-a06d-4ab8-90a2-6e67a1d107d5\") "
Jul 23 17:03:01.936820 ip-10-0-143-166 kubenswrapper[2553]: I0723 17:03:01.936792    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cadd4cd2-a06d-4ab8-90a2-6e67a1d107d5-kube-api-access-79j4b" (OuterVolumeSpecName: "kube-api-access-79j4b") pod "cadd4cd2-a06d-4ab8-90a2-6e67a1d107d5" (UID: "cadd4cd2-a06d-4ab8-90a2-6e67a1d107d5"). InnerVolumeSpecName "kube-api-access-79j4b". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 17:03:02.035993 ip-10-0-143-166 kubenswrapper[2553]: I0723 17:03:02.035899    2553 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-79j4b\" (UniqueName: \"kubernetes.io/projected/cadd4cd2-a06d-4ab8-90a2-6e67a1d107d5-kube-api-access-79j4b\") on node \"ip-10-0-143-166.ec2.internal\" DevicePath \"\""
Jul 23 17:03:02.095953 ip-10-0-143-166 kubenswrapper[2553]: I0723 17:03:02.095908    2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-dc9a69-6qz8q"]
Jul 23 17:03:02.096376 ip-10-0-143-166 kubenswrapper[2553]: I0723 17:03:02.096358    2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cadd4cd2-a06d-4ab8-90a2-6e67a1d107d5" containerName="test-curl-7579-140666632255504"
Jul 23 17:03:02.096376 ip-10-0-143-166 kubenswrapper[2553]: I0723 17:03:02.096377    2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="cadd4cd2-a06d-4ab8-90a2-6e67a1d107d5" containerName="test-curl-7579-140666632255504"
Jul 23 17:03:02.096537 ip-10-0-143-166 kubenswrapper[2553]: I0723 17:03:02.096468    2553 memory_manager.go:368] "RemoveStaleState removing state" podUID="cadd4cd2-a06d-4ab8-90a2-6e67a1d107d5" containerName="test-curl-7579-140666632255504"
Jul 23 17:03:02.099727 ip-10-0-143-166 kubenswrapper[2553]: I0723 17:03:02.099704    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-dc9a69-6qz8q"
Jul 23 17:03:02.102411 ip-10-0-143-166 kubenswrapper[2553]: I0723 17:03:02.102386    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 23 17:03:02.102521 ip-10-0-143-166 kubenswrapper[2553]: I0723 17:03:02.102386    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-plqcf\""
Jul 23 17:03:02.106699 ip-10-0-143-166 kubenswrapper[2553]: I0723 17:03:02.106637    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-dc9a69-6qz8q"]
Jul 23 17:03:02.136837 ip-10-0-143-166 kubenswrapper[2553]: I0723 17:03:02.136801    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/7efbffd3-8479-4139-8074-ea31f4e80647-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-dc9a69-6qz8q\" (UID: \"7efbffd3-8479-4139-8074-ea31f4e80647\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-dc9a69-6qz8q"
Jul 23 17:03:02.237710 ip-10-0-143-166 kubenswrapper[2553]: I0723 17:03:02.237675    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/7efbffd3-8479-4139-8074-ea31f4e80647-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-dc9a69-6qz8q\" (UID: \"7efbffd3-8479-4139-8074-ea31f4e80647\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-dc9a69-6qz8q"
Jul 23 17:03:02.238365 ip-10-0-143-166 kubenswrapper[2553]: I0723 17:03:02.238347    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/7efbffd3-8479-4139-8074-ea31f4e80647-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-dc9a69-6qz8q\" (UID: \"7efbffd3-8479-4139-8074-ea31f4e80647\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-dc9a69-6qz8q"
Jul 23 17:03:02.412001 ip-10-0-143-166 kubenswrapper[2553]: I0723 17:03:02.411965    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-dc9a69-6qz8q"
Jul 23 17:03:02.559780 ip-10-0-143-166 kubenswrapper[2553]: I0723 17:03:02.559747    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-dc9a69-6qz8q"]
Jul 23 17:03:02.562778 ip-10-0-143-166 kubenswrapper[2553]: W0723 17:03:02.562747    2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7efbffd3_8479_4139_8074_ea31f4e80647.slice/crio-fe3dca8c5dfad22d2901ac7b6c49befb9b16adaca8bdc74dde562696b2b0386e WatchSource:0}: Error finding container fe3dca8c5dfad22d2901ac7b6c49befb9b16adaca8bdc74dde562696b2b0386e: Status 404 returned error can't find the container with id fe3dca8c5dfad22d2901ac7b6c49befb9b16adaca8bdc74dde562696b2b0386e
Jul 23 17:03:02.676257 ip-10-0-143-166 kubenswrapper[2553]: I0723 17:03:02.676156    2553 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cadd4cd2-a06d-4ab8-90a2-6e67a1d107d5" path="/var/lib/kubelet/pods/cadd4cd2-a06d-4ab8-90a2-6e67a1d107d5/volumes"
Jul 23 17:03:02.718721 ip-10-0-143-166 kubenswrapper[2553]: I0723 17:03:02.718679    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-dc9a69-6qz8q" event={"ID":"7efbffd3-8479-4139-8074-ea31f4e80647","Type":"ContainerStarted","Data":"fe3dca8c5dfad22d2901ac7b6c49befb9b16adaca8bdc74dde562696b2b0386e"}
Jul 23 17:03:02.720237 ip-10-0-143-166 kubenswrapper[2553]: I0723 17:03:02.720201    2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7579-140666632255504"
Jul 23 17:03:02.720370 ip-10-0-143-166 kubenswrapper[2553]: I0723 17:03:02.720200    2553 scope.go:117] "RemoveContainer" containerID="cf10fae24f8f35d0616de965ea450963cf89d9e7bbc9cb639311ab98491826d2"
Jul 23 17:03:03.727582 ip-10-0-143-166 kubenswrapper[2553]: I0723 17:03:03.727547    2553 generic.go:356] "Generic (PLEG): container finished" podID="7efbffd3-8479-4139-8074-ea31f4e80647" containerID="e7c1a18df7f5eb310a75bac7bed70ab57a6ea0102f92f9d4bea5fb3e8d769f38" exitCode=0
Jul 23 17:03:03.727970 ip-10-0-143-166 kubenswrapper[2553]: I0723 17:03:03.727626    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-dc9a69-6qz8q" event={"ID":"7efbffd3-8479-4139-8074-ea31f4e80647","Type":"ContainerDied","Data":"e7c1a18df7f5eb310a75bac7bed70ab57a6ea0102f92f9d4bea5fb3e8d769f38"}
Jul 23 17:03:04.868616 ip-10-0-143-166 kubenswrapper[2553]: I0723 17:03:04.868583    2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-dc9a69-6qz8q"
Jul 23 17:03:04.964074 ip-10-0-143-166 kubenswrapper[2553]: I0723 17:03:04.964030    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/7efbffd3-8479-4139-8074-ea31f4e80647-maas-api-service-ca\") pod \"7efbffd3-8479-4139-8074-ea31f4e80647\" (UID: \"7efbffd3-8479-4139-8074-ea31f4e80647\") "
Jul 23 17:03:04.964470 ip-10-0-143-166 kubenswrapper[2553]: I0723 17:03:04.964449    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7efbffd3-8479-4139-8074-ea31f4e80647-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "7efbffd3-8479-4139-8074-ea31f4e80647" (UID: "7efbffd3-8479-4139-8074-ea31f4e80647"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 23 17:03:05.065575 ip-10-0-143-166 kubenswrapper[2553]: I0723 17:03:05.065480    2553 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/7efbffd3-8479-4139-8074-ea31f4e80647-maas-api-service-ca\") on node \"ip-10-0-143-166.ec2.internal\" DevicePath \"\""
Jul 23 17:03:05.740963 ip-10-0-143-166 kubenswrapper[2553]: I0723 17:03:05.740924    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-dc9a69-6qz8q" event={"ID":"7efbffd3-8479-4139-8074-ea31f4e80647","Type":"ContainerDied","Data":"fe3dca8c5dfad22d2901ac7b6c49befb9b16adaca8bdc74dde562696b2b0386e"}
Jul 23 17:03:05.741197 ip-10-0-143-166 kubenswrapper[2553]: I0723 17:03:05.740982    2553 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="fe3dca8c5dfad22d2901ac7b6c49befb9b16adaca8bdc74dde562696b2b0386e"
Jul 23 17:03:05.741197 ip-10-0-143-166 kubenswrapper[2553]: I0723 17:03:05.740941    2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-dc9a69-6qz8q"
Jul 23 17:03:12.548714 ip-10-0-143-166 kubenswrapper[2553]: I0723 17:03:12.548630    2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-dc9a69-29747100-rx5x2"]
Jul 23 17:03:12.550905 ip-10-0-143-166 kubenswrapper[2553]: I0723 17:03:12.550884    2553 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-dc9a69-29747100-rx5x2"]
Jul 23 17:03:12.674997 ip-10-0-143-166 kubenswrapper[2553]: I0723 17:03:12.674962    2553 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="58ab8ed0-db90-41cf-890a-891ae479dba6" path="/var/lib/kubelet/pods/58ab8ed0-db90-41cf-890a-891ae479dba6/volumes"
Jul 23 17:03:17.193446 ip-10-0-143-166 kubenswrapper[2553]: I0723 17:03:17.193410    2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-dc9a69-6qz8q"]
Jul 23 17:03:17.199307 ip-10-0-143-166 kubenswrapper[2553]: I0723 17:03:17.199278    2553 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-dc9a69-6qz8q"]
Jul 23 17:03:18.675353 ip-10-0-143-166 kubenswrapper[2553]: I0723 17:03:18.675317    2553 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7efbffd3-8479-4139-8074-ea31f4e80647" path="/var/lib/kubelet/pods/7efbffd3-8479-4139-8074-ea31f4e80647/volumes"
Jul 23 17:03:24.264961 ip-10-0-143-166 kubenswrapper[2553]: I0723 17:03:24.264921    2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-dc9a69-openshift-default-7cc8bdd9f5-dnk62"]
Jul 23 17:03:24.265608 ip-10-0-143-166 kubenswrapper[2553]: I0723 17:03:24.265128    2553 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-a-dc9a69-openshift-default-7cc8bdd9f5-dnk62" podUID="af3ccc59-08a2-4099-acc3-b3a4291606ee" containerName="istio-proxy" containerID="cri-o://43c734a61d0a0cea6a9bdfeb9b1dcf91bd7172b83bb04e5346787b1b28cc5c89" gracePeriod=30
Jul 23 17:03:24.652678 ip-10-0-143-166 kubenswrapper[2553]: I0723 17:03:24.652643    2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-6a0c6b-jg8kf"]
Jul 23 17:03:24.653041 ip-10-0-143-166 kubenswrapper[2553]: I0723 17:03:24.653028    2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7efbffd3-8479-4139-8074-ea31f4e80647" containerName="revoke-keys"
Jul 23 17:03:24.653086 ip-10-0-143-166 kubenswrapper[2553]: I0723 17:03:24.653042    2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="7efbffd3-8479-4139-8074-ea31f4e80647" containerName="revoke-keys"
Jul 23 17:03:24.653125 ip-10-0-143-166 kubenswrapper[2553]: I0723 17:03:24.653105    2553 memory_manager.go:368] "RemoveStaleState removing state" podUID="7efbffd3-8479-4139-8074-ea31f4e80647" containerName="revoke-keys"
Jul 23 17:03:24.657913 ip-10-0-143-166 kubenswrapper[2553]: I0723 17:03:24.657895    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-6a0c6b-jg8kf"
Jul 23 17:03:24.669302 ip-10-0-143-166 kubenswrapper[2553]: I0723 17:03:24.669273    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-plqcf\""
Jul 23 17:03:24.669463 ip-10-0-143-166 kubenswrapper[2553]: I0723 17:03:24.669283    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 23 17:03:24.676026 ip-10-0-143-166 kubenswrapper[2553]: I0723 17:03:24.675996    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-6a0c6b-jg8kf"]
Jul 23 17:03:24.747047 ip-10-0-143-166 kubenswrapper[2553]: I0723 17:03:24.747006    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/6d3d4cd2-292e-43cf-870f-18d5b9a11387-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-6a0c6b-jg8kf\" (UID: \"6d3d4cd2-292e-43cf-870f-18d5b9a11387\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-6a0c6b-jg8kf"
Jul 23 17:03:24.847993 ip-10-0-143-166 kubenswrapper[2553]: I0723 17:03:24.847960    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/6d3d4cd2-292e-43cf-870f-18d5b9a11387-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-6a0c6b-jg8kf\" (UID: \"6d3d4cd2-292e-43cf-870f-18d5b9a11387\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-6a0c6b-jg8kf"
Jul 23 17:03:24.848650 ip-10-0-143-166 kubenswrapper[2553]: I0723 17:03:24.848629    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/6d3d4cd2-292e-43cf-870f-18d5b9a11387-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-6a0c6b-jg8kf\" (UID: \"6d3d4cd2-292e-43cf-870f-18d5b9a11387\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-6a0c6b-jg8kf"
Jul 23 17:03:24.916699 ip-10-0-143-166 kubenswrapper[2553]: I0723 17:03:24.916603    2553 patch_prober.go:28] interesting pod/e2e-shared-a-dc9a69-openshift-default-7cc8bdd9f5-dnk62 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 23 17:03:24.916876 ip-10-0-143-166 kubenswrapper[2553]: I0723 17:03:24.916711    2553 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-a-dc9a69-openshift-default-7cc8bdd9f5-dnk62" podUID="af3ccc59-08a2-4099-acc3-b3a4291606ee" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 23 17:03:24.967851 ip-10-0-143-166 kubenswrapper[2553]: I0723 17:03:24.967818    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-6a0c6b-jg8kf"
Jul 23 17:03:25.108767 ip-10-0-143-166 kubenswrapper[2553]: I0723 17:03:25.108738    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-6a0c6b-jg8kf"]
Jul 23 17:03:25.109255 ip-10-0-143-166 kubenswrapper[2553]: W0723 17:03:25.109221    2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6d3d4cd2_292e_43cf_870f_18d5b9a11387.slice/crio-84739fe13219727a97b1f83d93c46266d02da1fce6171fd8b37338bfac48a8ef WatchSource:0}: Error finding container 84739fe13219727a97b1f83d93c46266d02da1fce6171fd8b37338bfac48a8ef: Status 404 returned error can't find the container with id 84739fe13219727a97b1f83d93c46266d02da1fce6171fd8b37338bfac48a8ef
Jul 23 17:03:25.855106 ip-10-0-143-166 kubenswrapper[2553]: I0723 17:03:25.855079    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-6a0c6b-jg8kf" event={"ID":"6d3d4cd2-292e-43cf-870f-18d5b9a11387","Type":"ContainerStarted","Data":"39042a770fb245b64a060790cb792135b92c06605a14d74d310d0148333853ea"}
Jul 23 17:03:25.855474 ip-10-0-143-166 kubenswrapper[2553]: I0723 17:03:25.855130    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-6a0c6b-jg8kf" event={"ID":"6d3d4cd2-292e-43cf-870f-18d5b9a11387","Type":"ContainerStarted","Data":"84739fe13219727a97b1f83d93c46266d02da1fce6171fd8b37338bfac48a8ef"}
Jul 23 17:03:26.862327 ip-10-0-143-166 kubenswrapper[2553]: I0723 17:03:26.862298    2553 generic.go:356] "Generic (PLEG): container finished" podID="6d3d4cd2-292e-43cf-870f-18d5b9a11387" containerID="39042a770fb245b64a060790cb792135b92c06605a14d74d310d0148333853ea" exitCode=0
Jul 23 17:03:26.862719 ip-10-0-143-166 kubenswrapper[2553]: I0723 17:03:26.862370    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-6a0c6b-jg8kf" event={"ID":"6d3d4cd2-292e-43cf-870f-18d5b9a11387","Type":"ContainerDied","Data":"39042a770fb245b64a060790cb792135b92c06605a14d74d310d0148333853ea"}
Jul 23 17:03:26.997828 ip-10-0-143-166 kubenswrapper[2553]: I0723 17:03:26.997804    2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-6a0c6b-jg8kf"
Jul 23 17:03:27.167550 ip-10-0-143-166 kubenswrapper[2553]: I0723 17:03:27.167514    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/6d3d4cd2-292e-43cf-870f-18d5b9a11387-maas-api-service-ca\") pod \"6d3d4cd2-292e-43cf-870f-18d5b9a11387\" (UID: \"6d3d4cd2-292e-43cf-870f-18d5b9a11387\") "
Jul 23 17:03:27.167913 ip-10-0-143-166 kubenswrapper[2553]: I0723 17:03:27.167888    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6d3d4cd2-292e-43cf-870f-18d5b9a11387-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "6d3d4cd2-292e-43cf-870f-18d5b9a11387" (UID: "6d3d4cd2-292e-43cf-870f-18d5b9a11387"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 23 17:03:27.268771 ip-10-0-143-166 kubenswrapper[2553]: I0723 17:03:27.268735    2553 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/6d3d4cd2-292e-43cf-870f-18d5b9a11387-maas-api-service-ca\") on node \"ip-10-0-143-166.ec2.internal\" DevicePath \"\""
Jul 23 17:03:27.869133 ip-10-0-143-166 kubenswrapper[2553]: I0723 17:03:27.869106    2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-6a0c6b-jg8kf"
Jul 23 17:03:27.869542 ip-10-0-143-166 kubenswrapper[2553]: I0723 17:03:27.869106    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-6a0c6b-jg8kf" event={"ID":"6d3d4cd2-292e-43cf-870f-18d5b9a11387","Type":"ContainerDied","Data":"84739fe13219727a97b1f83d93c46266d02da1fce6171fd8b37338bfac48a8ef"}
Jul 23 17:03:27.869542 ip-10-0-143-166 kubenswrapper[2553]: I0723 17:03:27.869220    2553 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="84739fe13219727a97b1f83d93c46266d02da1fce6171fd8b37338bfac48a8ef"
Jul 23 17:03:29.533211 ip-10-0-143-166 kubenswrapper[2553]: I0723 17:03:29.533131    2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-dc9a69-openshift-default-7cc8bdd9f5-dnk62"
Jul 23 17:03:29.689075 ip-10-0-143-166 kubenswrapper[2553]: I0723 17:03:29.689045    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/af3ccc59-08a2-4099-acc3-b3a4291606ee-istio-token\") pod \"af3ccc59-08a2-4099-acc3-b3a4291606ee\" (UID: \"af3ccc59-08a2-4099-acc3-b3a4291606ee\") "
Jul 23 17:03:29.689282 ip-10-0-143-166 kubenswrapper[2553]: I0723 17:03:29.689108    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6b697\" (UniqueName: \"kubernetes.io/projected/af3ccc59-08a2-4099-acc3-b3a4291606ee-kube-api-access-6b697\") pod \"af3ccc59-08a2-4099-acc3-b3a4291606ee\" (UID: \"af3ccc59-08a2-4099-acc3-b3a4291606ee\") "
Jul 23 17:03:29.689282 ip-10-0-143-166 kubenswrapper[2553]: I0723 17:03:29.689151    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/af3ccc59-08a2-4099-acc3-b3a4291606ee-istio-podinfo\") pod \"af3ccc59-08a2-4099-acc3-b3a4291606ee\" (UID: \"af3ccc59-08a2-4099-acc3-b3a4291606ee\") "
Jul 23 17:03:29.689282 ip-10-0-143-166 kubenswrapper[2553]: I0723 17:03:29.689201    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/af3ccc59-08a2-4099-acc3-b3a4291606ee-workload-socket\") pod \"af3ccc59-08a2-4099-acc3-b3a4291606ee\" (UID: \"af3ccc59-08a2-4099-acc3-b3a4291606ee\") "
Jul 23 17:03:29.689282 ip-10-0-143-166 kubenswrapper[2553]: I0723 17:03:29.689228    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/af3ccc59-08a2-4099-acc3-b3a4291606ee-workload-certs\") pod \"af3ccc59-08a2-4099-acc3-b3a4291606ee\" (UID: \"af3ccc59-08a2-4099-acc3-b3a4291606ee\") "
Jul 23 17:03:29.689282 ip-10-0-143-166 kubenswrapper[2553]: I0723 17:03:29.689258    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/af3ccc59-08a2-4099-acc3-b3a4291606ee-credential-socket\") pod \"af3ccc59-08a2-4099-acc3-b3a4291606ee\" (UID: \"af3ccc59-08a2-4099-acc3-b3a4291606ee\") "
Jul 23 17:03:29.689606 ip-10-0-143-166 kubenswrapper[2553]: I0723 17:03:29.689292    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/af3ccc59-08a2-4099-acc3-b3a4291606ee-istio-data\") pod \"af3ccc59-08a2-4099-acc3-b3a4291606ee\" (UID: \"af3ccc59-08a2-4099-acc3-b3a4291606ee\") "
Jul 23 17:03:29.689606 ip-10-0-143-166 kubenswrapper[2553]: I0723 17:03:29.689318    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/af3ccc59-08a2-4099-acc3-b3a4291606ee-istiod-ca-cert\") pod \"af3ccc59-08a2-4099-acc3-b3a4291606ee\" (UID: \"af3ccc59-08a2-4099-acc3-b3a4291606ee\") "
Jul 23 17:03:29.689606 ip-10-0-143-166 kubenswrapper[2553]: I0723 17:03:29.689348    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/af3ccc59-08a2-4099-acc3-b3a4291606ee-istio-envoy\") pod \"af3ccc59-08a2-4099-acc3-b3a4291606ee\" (UID: \"af3ccc59-08a2-4099-acc3-b3a4291606ee\") "
Jul 23 17:03:29.689606 ip-10-0-143-166 kubenswrapper[2553]: I0723 17:03:29.689561    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/af3ccc59-08a2-4099-acc3-b3a4291606ee-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "af3ccc59-08a2-4099-acc3-b3a4291606ee" (UID: "af3ccc59-08a2-4099-acc3-b3a4291606ee"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 17:03:29.689606 ip-10-0-143-166 kubenswrapper[2553]: I0723 17:03:29.689575    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/af3ccc59-08a2-4099-acc3-b3a4291606ee-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "af3ccc59-08a2-4099-acc3-b3a4291606ee" (UID: "af3ccc59-08a2-4099-acc3-b3a4291606ee"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 17:03:29.689606 ip-10-0-143-166 kubenswrapper[2553]: I0723 17:03:29.689587    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/af3ccc59-08a2-4099-acc3-b3a4291606ee-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "af3ccc59-08a2-4099-acc3-b3a4291606ee" (UID: "af3ccc59-08a2-4099-acc3-b3a4291606ee"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 17:03:29.689914 ip-10-0-143-166 kubenswrapper[2553]: I0723 17:03:29.689884    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/af3ccc59-08a2-4099-acc3-b3a4291606ee-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "af3ccc59-08a2-4099-acc3-b3a4291606ee" (UID: "af3ccc59-08a2-4099-acc3-b3a4291606ee"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 23 17:03:29.690397 ip-10-0-143-166 kubenswrapper[2553]: I0723 17:03:29.690369    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/af3ccc59-08a2-4099-acc3-b3a4291606ee-istio-data" (OuterVolumeSpecName: "istio-data") pod "af3ccc59-08a2-4099-acc3-b3a4291606ee" (UID: "af3ccc59-08a2-4099-acc3-b3a4291606ee"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 17:03:29.691587 ip-10-0-143-166 kubenswrapper[2553]: I0723 17:03:29.691568    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/af3ccc59-08a2-4099-acc3-b3a4291606ee-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "af3ccc59-08a2-4099-acc3-b3a4291606ee" (UID: "af3ccc59-08a2-4099-acc3-b3a4291606ee"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 17:03:29.691677 ip-10-0-143-166 kubenswrapper[2553]: I0723 17:03:29.691665    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/af3ccc59-08a2-4099-acc3-b3a4291606ee-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "af3ccc59-08a2-4099-acc3-b3a4291606ee" (UID: "af3ccc59-08a2-4099-acc3-b3a4291606ee"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 23 17:03:29.691846 ip-10-0-143-166 kubenswrapper[2553]: I0723 17:03:29.691822    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/af3ccc59-08a2-4099-acc3-b3a4291606ee-kube-api-access-6b697" (OuterVolumeSpecName: "kube-api-access-6b697") pod "af3ccc59-08a2-4099-acc3-b3a4291606ee" (UID: "af3ccc59-08a2-4099-acc3-b3a4291606ee"). InnerVolumeSpecName "kube-api-access-6b697". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 17:03:29.691951 ip-10-0-143-166 kubenswrapper[2553]: I0723 17:03:29.691842    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/af3ccc59-08a2-4099-acc3-b3a4291606ee-istio-token" (OuterVolumeSpecName: "istio-token") pod "af3ccc59-08a2-4099-acc3-b3a4291606ee" (UID: "af3ccc59-08a2-4099-acc3-b3a4291606ee"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 17:03:29.790889 ip-10-0-143-166 kubenswrapper[2553]: I0723 17:03:29.790782    2553 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/af3ccc59-08a2-4099-acc3-b3a4291606ee-istio-podinfo\") on node \"ip-10-0-143-166.ec2.internal\" DevicePath \"\""
Jul 23 17:03:29.790889 ip-10-0-143-166 kubenswrapper[2553]: I0723 17:03:29.790818    2553 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/af3ccc59-08a2-4099-acc3-b3a4291606ee-workload-socket\") on node \"ip-10-0-143-166.ec2.internal\" DevicePath \"\""
Jul 23 17:03:29.790889 ip-10-0-143-166 kubenswrapper[2553]: I0723 17:03:29.790830    2553 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/af3ccc59-08a2-4099-acc3-b3a4291606ee-workload-certs\") on node \"ip-10-0-143-166.ec2.internal\" DevicePath \"\""
Jul 23 17:03:29.790889 ip-10-0-143-166 kubenswrapper[2553]: I0723 17:03:29.790843    2553 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/af3ccc59-08a2-4099-acc3-b3a4291606ee-credential-socket\") on node \"ip-10-0-143-166.ec2.internal\" DevicePath \"\""
Jul 23 17:03:29.790889 ip-10-0-143-166 kubenswrapper[2553]: I0723 17:03:29.790855    2553 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/af3ccc59-08a2-4099-acc3-b3a4291606ee-istio-data\") on node \"ip-10-0-143-166.ec2.internal\" DevicePath \"\""
Jul 23 17:03:29.790889 ip-10-0-143-166 kubenswrapper[2553]: I0723 17:03:29.790867    2553 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/af3ccc59-08a2-4099-acc3-b3a4291606ee-istiod-ca-cert\") on node \"ip-10-0-143-166.ec2.internal\" DevicePath \"\""
Jul 23 17:03:29.790889 ip-10-0-143-166 kubenswrapper[2553]: I0723 17:03:29.790878    2553 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/af3ccc59-08a2-4099-acc3-b3a4291606ee-istio-envoy\") on node \"ip-10-0-143-166.ec2.internal\" DevicePath \"\""
Jul 23 17:03:29.790889 ip-10-0-143-166 kubenswrapper[2553]: I0723 17:03:29.790892    2553 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/af3ccc59-08a2-4099-acc3-b3a4291606ee-istio-token\") on node \"ip-10-0-143-166.ec2.internal\" DevicePath \"\""
Jul 23 17:03:29.791301 ip-10-0-143-166 kubenswrapper[2553]: I0723 17:03:29.790903    2553 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6b697\" (UniqueName: \"kubernetes.io/projected/af3ccc59-08a2-4099-acc3-b3a4291606ee-kube-api-access-6b697\") on node \"ip-10-0-143-166.ec2.internal\" DevicePath \"\""
Jul 23 17:03:29.881139 ip-10-0-143-166 kubenswrapper[2553]: I0723 17:03:29.881105    2553 generic.go:356] "Generic (PLEG): container finished" podID="af3ccc59-08a2-4099-acc3-b3a4291606ee" containerID="43c734a61d0a0cea6a9bdfeb9b1dcf91bd7172b83bb04e5346787b1b28cc5c89" exitCode=0
Jul 23 17:03:29.881355 ip-10-0-143-166 kubenswrapper[2553]: I0723 17:03:29.881157    2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-dc9a69-openshift-default-7cc8bdd9f5-dnk62"
Jul 23 17:03:29.881355 ip-10-0-143-166 kubenswrapper[2553]: I0723 17:03:29.881193    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-dc9a69-openshift-default-7cc8bdd9f5-dnk62" event={"ID":"af3ccc59-08a2-4099-acc3-b3a4291606ee","Type":"ContainerDied","Data":"43c734a61d0a0cea6a9bdfeb9b1dcf91bd7172b83bb04e5346787b1b28cc5c89"}
Jul 23 17:03:29.881355 ip-10-0-143-166 kubenswrapper[2553]: I0723 17:03:29.881254    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-dc9a69-openshift-default-7cc8bdd9f5-dnk62" event={"ID":"af3ccc59-08a2-4099-acc3-b3a4291606ee","Type":"ContainerDied","Data":"b8ceef2e3006fbf732904bdefd4436c0208effd5be4f62aefd90aca4993fe615"}
Jul 23 17:03:29.881355 ip-10-0-143-166 kubenswrapper[2553]: I0723 17:03:29.881277    2553 scope.go:117] "RemoveContainer" containerID="43c734a61d0a0cea6a9bdfeb9b1dcf91bd7172b83bb04e5346787b1b28cc5c89"
Jul 23 17:03:29.891258 ip-10-0-143-166 kubenswrapper[2553]: I0723 17:03:29.891236    2553 scope.go:117] "RemoveContainer" containerID="240c63be9aa00ba1b097a043b3a4c709808f3042c5e28272867d239db128f66d"
Jul 23 17:03:29.899715 ip-10-0-143-166 kubenswrapper[2553]: I0723 17:03:29.899694    2553 scope.go:117] "RemoveContainer" containerID="43c734a61d0a0cea6a9bdfeb9b1dcf91bd7172b83bb04e5346787b1b28cc5c89"
Jul 23 17:03:29.900004 ip-10-0-143-166 kubenswrapper[2553]: E0723 17:03:29.899985    2553 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"43c734a61d0a0cea6a9bdfeb9b1dcf91bd7172b83bb04e5346787b1b28cc5c89\": container with ID starting with 43c734a61d0a0cea6a9bdfeb9b1dcf91bd7172b83bb04e5346787b1b28cc5c89 not found: ID does not exist" containerID="43c734a61d0a0cea6a9bdfeb9b1dcf91bd7172b83bb04e5346787b1b28cc5c89"
Jul 23 17:03:29.900051 ip-10-0-143-166 kubenswrapper[2553]: I0723 17:03:29.900017    2553 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"43c734a61d0a0cea6a9bdfeb9b1dcf91bd7172b83bb04e5346787b1b28cc5c89"} err="failed to get container status \"43c734a61d0a0cea6a9bdfeb9b1dcf91bd7172b83bb04e5346787b1b28cc5c89\": rpc error: code = NotFound desc = could not find container \"43c734a61d0a0cea6a9bdfeb9b1dcf91bd7172b83bb04e5346787b1b28cc5c89\": container with ID starting with 43c734a61d0a0cea6a9bdfeb9b1dcf91bd7172b83bb04e5346787b1b28cc5c89 not found: ID does not exist"
Jul 23 17:03:29.900051 ip-10-0-143-166 kubenswrapper[2553]: I0723 17:03:29.900040    2553 scope.go:117] "RemoveContainer" containerID="240c63be9aa00ba1b097a043b3a4c709808f3042c5e28272867d239db128f66d"
Jul 23 17:03:29.900340 ip-10-0-143-166 kubenswrapper[2553]: E0723 17:03:29.900320    2553 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"240c63be9aa00ba1b097a043b3a4c709808f3042c5e28272867d239db128f66d\": container with ID starting with 240c63be9aa00ba1b097a043b3a4c709808f3042c5e28272867d239db128f66d not found: ID does not exist" containerID="240c63be9aa00ba1b097a043b3a4c709808f3042c5e28272867d239db128f66d"
Jul 23 17:03:29.900407 ip-10-0-143-166 kubenswrapper[2553]: I0723 17:03:29.900345    2553 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"240c63be9aa00ba1b097a043b3a4c709808f3042c5e28272867d239db128f66d"} err="failed to get container status \"240c63be9aa00ba1b097a043b3a4c709808f3042c5e28272867d239db128f66d\": rpc error: code = NotFound desc = could not find container \"240c63be9aa00ba1b097a043b3a4c709808f3042c5e28272867d239db128f66d\": container with ID starting with 240c63be9aa00ba1b097a043b3a4c709808f3042c5e28272867d239db128f66d not found: ID does not exist"
Jul 23 17:03:29.904543 ip-10-0-143-166 kubenswrapper[2553]: I0723 17:03:29.904504    2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-dc9a69-openshift-default-7cc8bdd9f5-dnk62"]
Jul 23 17:03:29.910844 ip-10-0-143-166 kubenswrapper[2553]: I0723 17:03:29.910817    2553 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-a-dc9a69-openshift-default-7cc8bdd9f5-dnk62"]
Jul 23 17:03:30.674624 ip-10-0-143-166 kubenswrapper[2553]: I0723 17:03:30.674594    2553 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="af3ccc59-08a2-4099-acc3-b3a4291606ee" path="/var/lib/kubelet/pods/af3ccc59-08a2-4099-acc3-b3a4291606ee/volumes"
Jul 23 17:03:35.150972 ip-10-0-143-166 kubenswrapper[2553]: I0723 17:03:35.150937    2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-6a0c6b-29747100-4dclf"]
Jul 23 17:03:35.157059 ip-10-0-143-166 kubenswrapper[2553]: I0723 17:03:35.157029    2553 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-6a0c6b-29747100-4dclf"]
Jul 23 17:03:36.675270 ip-10-0-143-166 kubenswrapper[2553]: I0723 17:03:36.675238    2553 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="913ba62c-cc94-49e1-9c04-adff63d98207" path="/var/lib/kubelet/pods/913ba62c-cc94-49e1-9c04-adff63d98207/volumes"
Jul 23 17:03:39.734808 ip-10-0-143-166 kubenswrapper[2553]: I0723 17:03:39.734769    2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-6a0c6b-jg8kf"]
Jul 23 17:03:39.740144 ip-10-0-143-166 kubenswrapper[2553]: I0723 17:03:39.740110    2553 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-6a0c6b-jg8kf"]
Jul 23 17:03:40.675096 ip-10-0-143-166 kubenswrapper[2553]: I0723 17:03:40.675065    2553 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6d3d4cd2-292e-43cf-870f-18d5b9a11387" path="/var/lib/kubelet/pods/6d3d4cd2-292e-43cf-870f-18d5b9a11387/volumes"
Jul 23 17:03:46.788957 ip-10-0-143-166 kubenswrapper[2553]: I0723 17:03:46.788926    2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-6a0c6b-openshift-default-78f6bb967-8hn4k"]
Jul 23 17:03:46.789526 ip-10-0-143-166 kubenswrapper[2553]: I0723 17:03:46.789132    2553 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-b-6a0c6b-openshift-default-78f6bb967-8hn4k" podUID="e0d49a76-8aff-4e5e-adde-8b3538f7508c" containerName="istio-proxy" containerID="cri-o://fe5d797bebd8fa9deb22e13cad9247732afdceaa7ddc7eaf386b1a1a5e7516f2" gracePeriod=30
Jul 23 17:03:47.049592 ip-10-0-143-166 kubenswrapper[2553]: I0723 17:03:47.049502    2553 patch_prober.go:28] interesting pod/e2e-shared-b-6a0c6b-openshift-default-78f6bb967-8hn4k container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 23 17:03:47.049592 ip-10-0-143-166 kubenswrapper[2553]: I0723 17:03:47.049555    2553 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-b-6a0c6b-openshift-default-78f6bb967-8hn4k" podUID="e0d49a76-8aff-4e5e-adde-8b3538f7508c" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 23 17:03:47.493155 ip-10-0-143-166 kubenswrapper[2553]: I0723 17:03:47.493120    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-795674df9c-xsm7j_6d2ed5f0-e198-49bc-b05b-4433565c26f4/authorino/0.log"
Jul 23 17:03:52.003553 ip-10-0-143-166 kubenswrapper[2553]: I0723 17:03:52.003518    2553 generic.go:356] "Generic (PLEG): container finished" podID="e0d49a76-8aff-4e5e-adde-8b3538f7508c" containerID="fe5d797bebd8fa9deb22e13cad9247732afdceaa7ddc7eaf386b1a1a5e7516f2" exitCode=0
Jul 23 17:03:52.003989 ip-10-0-143-166 kubenswrapper[2553]: I0723 17:03:52.003570    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-6a0c6b-openshift-default-78f6bb967-8hn4k" event={"ID":"e0d49a76-8aff-4e5e-adde-8b3538f7508c","Type":"ContainerDied","Data":"fe5d797bebd8fa9deb22e13cad9247732afdceaa7ddc7eaf386b1a1a5e7516f2"}
Jul 23 17:03:52.003989 ip-10-0-143-166 kubenswrapper[2553]: I0723 17:03:52.003617    2553 scope.go:117] "RemoveContainer" containerID="01cfdad7009075023aa5ee5ac8a73069a12cfe8564164d207d23385d685eee8a"
Jul 23 17:03:52.051834 ip-10-0-143-166 kubenswrapper[2553]: I0723 17:03:52.051811    2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-6a0c6b-openshift-default-78f6bb967-8hn4k"
Jul 23 17:03:52.080222 ip-10-0-143-166 kubenswrapper[2553]: I0723 17:03:52.080131    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e0d49a76-8aff-4e5e-adde-8b3538f7508c-istio-data\") pod \"e0d49a76-8aff-4e5e-adde-8b3538f7508c\" (UID: \"e0d49a76-8aff-4e5e-adde-8b3538f7508c\") "
Jul 23 17:03:52.080349 ip-10-0-143-166 kubenswrapper[2553]: I0723 17:03:52.080241    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e0d49a76-8aff-4e5e-adde-8b3538f7508c-workload-certs\") pod \"e0d49a76-8aff-4e5e-adde-8b3538f7508c\" (UID: \"e0d49a76-8aff-4e5e-adde-8b3538f7508c\") "
Jul 23 17:03:52.080349 ip-10-0-143-166 kubenswrapper[2553]: I0723 17:03:52.080278    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e0d49a76-8aff-4e5e-adde-8b3538f7508c-istio-token\") pod \"e0d49a76-8aff-4e5e-adde-8b3538f7508c\" (UID: \"e0d49a76-8aff-4e5e-adde-8b3538f7508c\") "
Jul 23 17:03:52.080349 ip-10-0-143-166 kubenswrapper[2553]: I0723 17:03:52.080299    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e0d49a76-8aff-4e5e-adde-8b3538f7508c-workload-socket\") pod \"e0d49a76-8aff-4e5e-adde-8b3538f7508c\" (UID: \"e0d49a76-8aff-4e5e-adde-8b3538f7508c\") "
Jul 23 17:03:52.080349 ip-10-0-143-166 kubenswrapper[2553]: I0723 17:03:52.080317    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e0d49a76-8aff-4e5e-adde-8b3538f7508c-istio-envoy\") pod \"e0d49a76-8aff-4e5e-adde-8b3538f7508c\" (UID: \"e0d49a76-8aff-4e5e-adde-8b3538f7508c\") "
Jul 23 17:03:52.080349 ip-10-0-143-166 kubenswrapper[2553]: I0723 17:03:52.080334    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e0d49a76-8aff-4e5e-adde-8b3538f7508c-istio-podinfo\") pod \"e0d49a76-8aff-4e5e-adde-8b3538f7508c\" (UID: \"e0d49a76-8aff-4e5e-adde-8b3538f7508c\") "
Jul 23 17:03:52.080605 ip-10-0-143-166 kubenswrapper[2553]: I0723 17:03:52.080437    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-x4glg\" (UniqueName: \"kubernetes.io/projected/e0d49a76-8aff-4e5e-adde-8b3538f7508c-kube-api-access-x4glg\") pod \"e0d49a76-8aff-4e5e-adde-8b3538f7508c\" (UID: \"e0d49a76-8aff-4e5e-adde-8b3538f7508c\") "
Jul 23 17:03:52.080605 ip-10-0-143-166 kubenswrapper[2553]: I0723 17:03:52.080470    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e0d49a76-8aff-4e5e-adde-8b3538f7508c-istiod-ca-cert\") pod \"e0d49a76-8aff-4e5e-adde-8b3538f7508c\" (UID: \"e0d49a76-8aff-4e5e-adde-8b3538f7508c\") "
Jul 23 17:03:52.080605 ip-10-0-143-166 kubenswrapper[2553]: I0723 17:03:52.080492    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e0d49a76-8aff-4e5e-adde-8b3538f7508c-credential-socket\") pod \"e0d49a76-8aff-4e5e-adde-8b3538f7508c\" (UID: \"e0d49a76-8aff-4e5e-adde-8b3538f7508c\") "
Jul 23 17:03:52.080605 ip-10-0-143-166 kubenswrapper[2553]: I0723 17:03:52.080520    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e0d49a76-8aff-4e5e-adde-8b3538f7508c-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "e0d49a76-8aff-4e5e-adde-8b3538f7508c" (UID: "e0d49a76-8aff-4e5e-adde-8b3538f7508c"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 17:03:52.080813 ip-10-0-143-166 kubenswrapper[2553]: I0723 17:03:52.080666    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e0d49a76-8aff-4e5e-adde-8b3538f7508c-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "e0d49a76-8aff-4e5e-adde-8b3538f7508c" (UID: "e0d49a76-8aff-4e5e-adde-8b3538f7508c"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 17:03:52.080813 ip-10-0-143-166 kubenswrapper[2553]: I0723 17:03:52.080733    2553 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e0d49a76-8aff-4e5e-adde-8b3538f7508c-workload-certs\") on node \"ip-10-0-143-166.ec2.internal\" DevicePath \"\""
Jul 23 17:03:52.080943 ip-10-0-143-166 kubenswrapper[2553]: I0723 17:03:52.080858    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e0d49a76-8aff-4e5e-adde-8b3538f7508c-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "e0d49a76-8aff-4e5e-adde-8b3538f7508c" (UID: "e0d49a76-8aff-4e5e-adde-8b3538f7508c"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 23 17:03:52.081002 ip-10-0-143-166 kubenswrapper[2553]: I0723 17:03:52.080948    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e0d49a76-8aff-4e5e-adde-8b3538f7508c-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "e0d49a76-8aff-4e5e-adde-8b3538f7508c" (UID: "e0d49a76-8aff-4e5e-adde-8b3538f7508c"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 17:03:52.081085 ip-10-0-143-166 kubenswrapper[2553]: I0723 17:03:52.081060    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e0d49a76-8aff-4e5e-adde-8b3538f7508c-istio-data" (OuterVolumeSpecName: "istio-data") pod "e0d49a76-8aff-4e5e-adde-8b3538f7508c" (UID: "e0d49a76-8aff-4e5e-adde-8b3538f7508c"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 17:03:52.082747 ip-10-0-143-166 kubenswrapper[2553]: I0723 17:03:52.082716    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e0d49a76-8aff-4e5e-adde-8b3538f7508c-istio-token" (OuterVolumeSpecName: "istio-token") pod "e0d49a76-8aff-4e5e-adde-8b3538f7508c" (UID: "e0d49a76-8aff-4e5e-adde-8b3538f7508c"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 17:03:52.083011 ip-10-0-143-166 kubenswrapper[2553]: I0723 17:03:52.082963    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e0d49a76-8aff-4e5e-adde-8b3538f7508c-kube-api-access-x4glg" (OuterVolumeSpecName: "kube-api-access-x4glg") pod "e0d49a76-8aff-4e5e-adde-8b3538f7508c" (UID: "e0d49a76-8aff-4e5e-adde-8b3538f7508c"). InnerVolumeSpecName "kube-api-access-x4glg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 17:03:52.083226 ip-10-0-143-166 kubenswrapper[2553]: I0723 17:03:52.083197    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e0d49a76-8aff-4e5e-adde-8b3538f7508c-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "e0d49a76-8aff-4e5e-adde-8b3538f7508c" (UID: "e0d49a76-8aff-4e5e-adde-8b3538f7508c"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 17:03:52.083356 ip-10-0-143-166 kubenswrapper[2553]: I0723 17:03:52.083336    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/e0d49a76-8aff-4e5e-adde-8b3538f7508c-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "e0d49a76-8aff-4e5e-adde-8b3538f7508c" (UID: "e0d49a76-8aff-4e5e-adde-8b3538f7508c"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 23 17:03:52.181911 ip-10-0-143-166 kubenswrapper[2553]: I0723 17:03:52.181871    2553 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e0d49a76-8aff-4e5e-adde-8b3538f7508c-istio-token\") on node \"ip-10-0-143-166.ec2.internal\" DevicePath \"\""
Jul 23 17:03:52.181911 ip-10-0-143-166 kubenswrapper[2553]: I0723 17:03:52.181905    2553 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e0d49a76-8aff-4e5e-adde-8b3538f7508c-workload-socket\") on node \"ip-10-0-143-166.ec2.internal\" DevicePath \"\""
Jul 23 17:03:52.181911 ip-10-0-143-166 kubenswrapper[2553]: I0723 17:03:52.181918    2553 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e0d49a76-8aff-4e5e-adde-8b3538f7508c-istio-envoy\") on node \"ip-10-0-143-166.ec2.internal\" DevicePath \"\""
Jul 23 17:03:52.182272 ip-10-0-143-166 kubenswrapper[2553]: I0723 17:03:52.181929    2553 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e0d49a76-8aff-4e5e-adde-8b3538f7508c-istio-podinfo\") on node \"ip-10-0-143-166.ec2.internal\" DevicePath \"\""
Jul 23 17:03:52.182272 ip-10-0-143-166 kubenswrapper[2553]: I0723 17:03:52.181941    2553 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-x4glg\" (UniqueName: \"kubernetes.io/projected/e0d49a76-8aff-4e5e-adde-8b3538f7508c-kube-api-access-x4glg\") on node \"ip-10-0-143-166.ec2.internal\" DevicePath \"\""
Jul 23 17:03:52.182272 ip-10-0-143-166 kubenswrapper[2553]: I0723 17:03:52.181952    2553 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e0d49a76-8aff-4e5e-adde-8b3538f7508c-istiod-ca-cert\") on node \"ip-10-0-143-166.ec2.internal\" DevicePath \"\""
Jul 23 17:03:52.182272 ip-10-0-143-166 kubenswrapper[2553]: I0723 17:03:52.181963    2553 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e0d49a76-8aff-4e5e-adde-8b3538f7508c-credential-socket\") on node \"ip-10-0-143-166.ec2.internal\" DevicePath \"\""
Jul 23 17:03:52.182272 ip-10-0-143-166 kubenswrapper[2553]: I0723 17:03:52.181974    2553 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e0d49a76-8aff-4e5e-adde-8b3538f7508c-istio-data\") on node \"ip-10-0-143-166.ec2.internal\" DevicePath \"\""
Jul 23 17:03:53.010535 ip-10-0-143-166 kubenswrapper[2553]: I0723 17:03:53.010454    2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-6a0c6b-openshift-default-78f6bb967-8hn4k"
Jul 23 17:03:53.010535 ip-10-0-143-166 kubenswrapper[2553]: I0723 17:03:53.010497    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-6a0c6b-openshift-default-78f6bb967-8hn4k" event={"ID":"e0d49a76-8aff-4e5e-adde-8b3538f7508c","Type":"ContainerDied","Data":"e169dd00ef9e5dfbd1c90a8a3de948236e8da07c1e73d85c55184cc92a815a2b"}
Jul 23 17:03:53.011020 ip-10-0-143-166 kubenswrapper[2553]: I0723 17:03:53.010555    2553 scope.go:117] "RemoveContainer" containerID="fe5d797bebd8fa9deb22e13cad9247732afdceaa7ddc7eaf386b1a1a5e7516f2"
Jul 23 17:03:53.035141 ip-10-0-143-166 kubenswrapper[2553]: I0723 17:03:53.035107    2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-6a0c6b-openshift-default-78f6bb967-8hn4k"]
Jul 23 17:03:53.041660 ip-10-0-143-166 kubenswrapper[2553]: I0723 17:03:53.041634    2553 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-b-6a0c6b-openshift-default-78f6bb967-8hn4k"]
Jul 23 17:03:53.808824 ip-10-0-143-166 kubenswrapper[2553]: I0723 17:03:53.808799    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-hw7h6_1dc8b88c-360e-483e-b896-6f0aa35b32fe/server/0.log"
Jul 23 17:03:53.939356 ip-10-0-143-166 kubenswrapper[2553]: I0723 17:03:53.939326    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-4gzgh_50c15f91-b24d-49ba-85af-4615ce9ab662/manager/0.log"
Jul 23 17:03:54.200607 ip-10-0-143-166 kubenswrapper[2553]: I0723 17:03:54.200583    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-678945769f-69jmp_a74ccce6-3ea9-4933-86e9-e2dbc5777b9a/copy-manifests/0.log"
Jul 23 17:03:54.208349 ip-10-0-143-166 kubenswrapper[2553]: I0723 17:03:54.208331    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-678945769f-69jmp_a74ccce6-3ea9-4933-86e9-e2dbc5777b9a/manager/0.log"
Jul 23 17:03:54.674729 ip-10-0-143-166 kubenswrapper[2553]: I0723 17:03:54.674697    2553 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e0d49a76-8aff-4e5e-adde-8b3538f7508c" path="/var/lib/kubelet/pods/e0d49a76-8aff-4e5e-adde-8b3538f7508c/volumes"
Jul 23 17:03:54.861303 ip-10-0-143-166 kubenswrapper[2553]: I0723 17:03:54.861276    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-29747070-v6j5j_b68a4008-7671-4c63-baba-8e1174052e9d/cleanup/0.log"
Jul 23 17:03:54.989398 ip-10-0-143-166 kubenswrapper[2553]: I0723 17:03:54.989318    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-29747085-ls6wn_a3ef3e11-4611-4573-9f9a-cb82067da938/cleanup/0.log"
Jul 23 17:03:55.114616 ip-10-0-143-166 kubenswrapper[2553]: I0723 17:03:55.114585    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-29747100-2wsk7_242f30a8-9130-4dfb-81e9-e493485f1eac/cleanup/0.log"
Jul 23 17:03:56.097775 ip-10-0-143-166 kubenswrapper[2553]: I0723 17:03:56.097742    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759bkr7t_fe997029-66c5-4d41-8efc-96d5b847af84/util/0.log"
Jul 23 17:03:56.105141 ip-10-0-143-166 kubenswrapper[2553]: I0723 17:03:56.105116    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759bkr7t_fe997029-66c5-4d41-8efc-96d5b847af84/pull/0.log"
Jul 23 17:03:56.112342 ip-10-0-143-166 kubenswrapper[2553]: I0723 17:03:56.112324    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759bkr7t_fe997029-66c5-4d41-8efc-96d5b847af84/extract/0.log"
Jul 23 17:03:56.233007 ip-10-0-143-166 kubenswrapper[2553]: I0723 17:03:56.232981    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0fw8x9_8de7a45c-439c-49fe-ab2e-80ad09d5dbc5/util/0.log"
Jul 23 17:03:56.239829 ip-10-0-143-166 kubenswrapper[2553]: I0723 17:03:56.239807    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0fw8x9_8de7a45c-439c-49fe-ab2e-80ad09d5dbc5/pull/0.log"
Jul 23 17:03:56.246791 ip-10-0-143-166 kubenswrapper[2553]: I0723 17:03:56.246773    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0fw8x9_8de7a45c-439c-49fe-ab2e-80ad09d5dbc5/extract/0.log"
Jul 23 17:03:56.371720 ip-10-0-143-166 kubenswrapper[2553]: I0723 17:03:56.371643    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7372f54_5bb96e52-7c69-43a2-a110-9d59c6a1f560/util/0.log"
Jul 23 17:03:56.379475 ip-10-0-143-166 kubenswrapper[2553]: I0723 17:03:56.379447    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7372f54_5bb96e52-7c69-43a2-a110-9d59c6a1f560/pull/0.log"
Jul 23 17:03:56.386220 ip-10-0-143-166 kubenswrapper[2553]: I0723 17:03:56.386193    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7372f54_5bb96e52-7c69-43a2-a110-9d59c6a1f560/extract/0.log"
Jul 23 17:03:56.509572 ip-10-0-143-166 kubenswrapper[2553]: I0723 17:03:56.509542    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1j2mxz_92310d06-adf5-4258-91a1-4d4f0185c1b0/util/0.log"
Jul 23 17:03:56.516612 ip-10-0-143-166 kubenswrapper[2553]: I0723 17:03:56.516585    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1j2mxz_92310d06-adf5-4258-91a1-4d4f0185c1b0/pull/0.log"
Jul 23 17:03:56.523121 ip-10-0-143-166 kubenswrapper[2553]: I0723 17:03:56.523100    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1j2mxz_92310d06-adf5-4258-91a1-4d4f0185c1b0/extract/0.log"
Jul 23 17:03:56.650149 ip-10-0-143-166 kubenswrapper[2553]: I0723 17:03:56.650119    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-795674df9c-xsm7j_6d2ed5f0-e198-49bc-b05b-4433565c26f4/authorino/0.log"
Jul 23 17:03:57.033872 ip-10-0-143-166 kubenswrapper[2553]: I0723 17:03:57.033786    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-hpsmb_aba9d5ae-8f09-4bcc-a6ca-2d5ff4944f0c/kuadrant-console-plugin/0.log"
Jul 23 17:03:58.175008 ip-10-0-143-166 kubenswrapper[2553]: I0723 17:03:58.174977    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-545d74bcdb-98x2h_38c05ca6-e42d-478d-afed-b773f76733d8/kube-auth-proxy/0.log"
Jul 23 17:03:58.822031 ip-10-0-143-166 kubenswrapper[2553]: I0723 17:03:58.822000    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-599b8db76d-sn7k4_b145abca-07cb-4345-9efc-2c03f950ac14/router/0.log"
Jul 23 17:03:59.194072 ip-10-0-143-166 kubenswrapper[2553]: I0723 17:03:59.194046    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-67d8d5d6d-2nk7c_0e180557-6ae4-4e82-bcdc-a52826ec9f66/main/0.log"
Jul 23 17:04:06.180684 ip-10-0-143-166 kubenswrapper[2553]: I0723 17:04:06.180648    2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-wvj2n/must-gather-2zl8c"]
Jul 23 17:04:06.181082 ip-10-0-143-166 kubenswrapper[2553]: I0723 17:04:06.180977    2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="af3ccc59-08a2-4099-acc3-b3a4291606ee" containerName="istio-proxy"
Jul 23 17:04:06.181082 ip-10-0-143-166 kubenswrapper[2553]: I0723 17:04:06.180989    2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="af3ccc59-08a2-4099-acc3-b3a4291606ee" containerName="istio-proxy"
Jul 23 17:04:06.181082 ip-10-0-143-166 kubenswrapper[2553]: I0723 17:04:06.181000    2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e0d49a76-8aff-4e5e-adde-8b3538f7508c" containerName="istio-proxy"
Jul 23 17:04:06.181082 ip-10-0-143-166 kubenswrapper[2553]: I0723 17:04:06.181005    2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="e0d49a76-8aff-4e5e-adde-8b3538f7508c" containerName="istio-proxy"
Jul 23 17:04:06.181082 ip-10-0-143-166 kubenswrapper[2553]: I0723 17:04:06.181027    2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6d3d4cd2-292e-43cf-870f-18d5b9a11387" containerName="revoke-keys"
Jul 23 17:04:06.181082 ip-10-0-143-166 kubenswrapper[2553]: I0723 17:04:06.181032    2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="6d3d4cd2-292e-43cf-870f-18d5b9a11387" containerName="revoke-keys"
Jul 23 17:04:06.181321 ip-10-0-143-166 kubenswrapper[2553]: I0723 17:04:06.181097    2553 memory_manager.go:368] "RemoveStaleState removing state" podUID="6d3d4cd2-292e-43cf-870f-18d5b9a11387" containerName="revoke-keys"
Jul 23 17:04:06.181321 ip-10-0-143-166 kubenswrapper[2553]: I0723 17:04:06.181111    2553 memory_manager.go:368] "RemoveStaleState removing state" podUID="e0d49a76-8aff-4e5e-adde-8b3538f7508c" containerName="istio-proxy"
Jul 23 17:04:06.181321 ip-10-0-143-166 kubenswrapper[2553]: I0723 17:04:06.181121    2553 memory_manager.go:368] "RemoveStaleState removing state" podUID="e0d49a76-8aff-4e5e-adde-8b3538f7508c" containerName="istio-proxy"
Jul 23 17:04:06.181321 ip-10-0-143-166 kubenswrapper[2553]: I0723 17:04:06.181129    2553 memory_manager.go:368] "RemoveStaleState removing state" podUID="af3ccc59-08a2-4099-acc3-b3a4291606ee" containerName="istio-proxy"
Jul 23 17:04:06.181321 ip-10-0-143-166 kubenswrapper[2553]: I0723 17:04:06.181140    2553 memory_manager.go:368] "RemoveStaleState removing state" podUID="af3ccc59-08a2-4099-acc3-b3a4291606ee" containerName="istio-proxy"
Jul 23 17:04:06.181321 ip-10-0-143-166 kubenswrapper[2553]: I0723 17:04:06.181244    2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="af3ccc59-08a2-4099-acc3-b3a4291606ee" containerName="istio-proxy"
Jul 23 17:04:06.181321 ip-10-0-143-166 kubenswrapper[2553]: I0723 17:04:06.181255    2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="af3ccc59-08a2-4099-acc3-b3a4291606ee" containerName="istio-proxy"
Jul 23 17:04:06.181321 ip-10-0-143-166 kubenswrapper[2553]: I0723 17:04:06.181264    2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e0d49a76-8aff-4e5e-adde-8b3538f7508c" containerName="istio-proxy"
Jul 23 17:04:06.181321 ip-10-0-143-166 kubenswrapper[2553]: I0723 17:04:06.181270    2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="e0d49a76-8aff-4e5e-adde-8b3538f7508c" containerName="istio-proxy"
Jul 23 17:04:06.184338 ip-10-0-143-166 kubenswrapper[2553]: I0723 17:04:06.184323    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-wvj2n/must-gather-2zl8c"
Jul 23 17:04:06.187289 ip-10-0-143-166 kubenswrapper[2553]: I0723 17:04:06.187264    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-wvj2n\"/\"default-dockercfg-9xm84\""
Jul 23 17:04:06.188438 ip-10-0-143-166 kubenswrapper[2553]: I0723 17:04:06.188410    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-wvj2n\"/\"kube-root-ca.crt\""
Jul 23 17:04:06.188543 ip-10-0-143-166 kubenswrapper[2553]: I0723 17:04:06.188419    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-wvj2n\"/\"openshift-service-ca.crt\""
Jul 23 17:04:06.204139 ip-10-0-143-166 kubenswrapper[2553]: I0723 17:04:06.204108    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-wvj2n/must-gather-2zl8c"]
Jul 23 17:04:06.302122 ip-10-0-143-166 kubenswrapper[2553]: I0723 17:04:06.302085    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/19456413-ff24-4bee-85e2-b7b80bc229fd-must-gather-output\") pod \"must-gather-2zl8c\" (UID: \"19456413-ff24-4bee-85e2-b7b80bc229fd\") " pod="openshift-must-gather-wvj2n/must-gather-2zl8c"
Jul 23 17:04:06.302327 ip-10-0-143-166 kubenswrapper[2553]: I0723 17:04:06.302187    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9bbpb\" (UniqueName: \"kubernetes.io/projected/19456413-ff24-4bee-85e2-b7b80bc229fd-kube-api-access-9bbpb\") pod \"must-gather-2zl8c\" (UID: \"19456413-ff24-4bee-85e2-b7b80bc229fd\") " pod="openshift-must-gather-wvj2n/must-gather-2zl8c"
Jul 23 17:04:06.403245 ip-10-0-143-166 kubenswrapper[2553]: I0723 17:04:06.403212    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/19456413-ff24-4bee-85e2-b7b80bc229fd-must-gather-output\") pod \"must-gather-2zl8c\" (UID: \"19456413-ff24-4bee-85e2-b7b80bc229fd\") " pod="openshift-must-gather-wvj2n/must-gather-2zl8c"
Jul 23 17:04:06.403423 ip-10-0-143-166 kubenswrapper[2553]: I0723 17:04:06.403296    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9bbpb\" (UniqueName: \"kubernetes.io/projected/19456413-ff24-4bee-85e2-b7b80bc229fd-kube-api-access-9bbpb\") pod \"must-gather-2zl8c\" (UID: \"19456413-ff24-4bee-85e2-b7b80bc229fd\") " pod="openshift-must-gather-wvj2n/must-gather-2zl8c"
Jul 23 17:04:06.403582 ip-10-0-143-166 kubenswrapper[2553]: I0723 17:04:06.403556    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/19456413-ff24-4bee-85e2-b7b80bc229fd-must-gather-output\") pod \"must-gather-2zl8c\" (UID: \"19456413-ff24-4bee-85e2-b7b80bc229fd\") " pod="openshift-must-gather-wvj2n/must-gather-2zl8c"
Jul 23 17:04:06.413084 ip-10-0-143-166 kubenswrapper[2553]: I0723 17:04:06.413061    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9bbpb\" (UniqueName: \"kubernetes.io/projected/19456413-ff24-4bee-85e2-b7b80bc229fd-kube-api-access-9bbpb\") pod \"must-gather-2zl8c\" (UID: \"19456413-ff24-4bee-85e2-b7b80bc229fd\") " pod="openshift-must-gather-wvj2n/must-gather-2zl8c"
Jul 23 17:04:06.494107 ip-10-0-143-166 kubenswrapper[2553]: I0723 17:04:06.494022    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-wvj2n/must-gather-2zl8c"
Jul 23 17:04:06.640198 ip-10-0-143-166 kubenswrapper[2553]: I0723 17:04:06.640159    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-wvj2n/must-gather-2zl8c"]
Jul 23 17:04:06.641299 ip-10-0-143-166 kubenswrapper[2553]: W0723 17:04:06.641273    2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod19456413_ff24_4bee_85e2_b7b80bc229fd.slice/crio-f985bc7fa5e7d18bc81c4e36ca57c0f89d8f6f7bb7f4b75ad9b808ca039b8b1c WatchSource:0}: Error finding container f985bc7fa5e7d18bc81c4e36ca57c0f89d8f6f7bb7f4b75ad9b808ca039b8b1c: Status 404 returned error can't find the container with id f985bc7fa5e7d18bc81c4e36ca57c0f89d8f6f7bb7f4b75ad9b808ca039b8b1c
Jul 23 17:04:07.088371 ip-10-0-143-166 kubenswrapper[2553]: I0723 17:04:07.088334    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-wvj2n/must-gather-2zl8c" event={"ID":"19456413-ff24-4bee-85e2-b7b80bc229fd","Type":"ContainerStarted","Data":"f985bc7fa5e7d18bc81c4e36ca57c0f89d8f6f7bb7f4b75ad9b808ca039b8b1c"}
Jul 23 17:04:08.096860 ip-10-0-143-166 kubenswrapper[2553]: I0723 17:04:08.096826    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-wvj2n/must-gather-2zl8c" event={"ID":"19456413-ff24-4bee-85e2-b7b80bc229fd","Type":"ContainerStarted","Data":"0567d510aa5d1967a7d8c9c031631b8f1f46173e7fb686feaac8d7ed4e5046c9"}
Jul 23 17:04:09.106446 ip-10-0-143-166 kubenswrapper[2553]: I0723 17:04:09.106401    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-wvj2n/must-gather-2zl8c" event={"ID":"19456413-ff24-4bee-85e2-b7b80bc229fd","Type":"ContainerStarted","Data":"fc802b373efa135aeeb3be421d213d9aa961370d129e430ecb2bf46094e45a1e"}
Jul 23 17:04:09.126253 ip-10-0-143-166 kubenswrapper[2553]: I0723 17:04:09.126191    2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-wvj2n/must-gather-2zl8c" podStartSLOduration=1.871253498 podStartE2EDuration="3.126157145s" totalImagesPullingTime="1.254903647s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 17:04:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 17:04:09.123007333 +0000 UTC m=+2930.987613465" watchObservedRunningTime="2026-07-23 17:04:09.126157145 +0000 UTC m=+2930.990763295"
Jul 23 17:04:09.530292 ip-10-0-143-166 kubenswrapper[2553]: I0723 17:04:09.530259    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-lqmct_c0d761bc-9c6e-4617-a75d-1811fc235f16/global-pull-secret-syncer/0.log"
Jul 23 17:04:09.655209 ip-10-0-143-166 kubenswrapper[2553]: I0723 17:04:09.655175    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-j892l_bba31e38-01db-45a0-8b60-9fc626237e01/konnectivity-agent/0.log"
Jul 23 17:04:09.756259 ip-10-0-143-166 kubenswrapper[2553]: I0723 17:04:09.756231    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-143-166.ec2.internal_90edd8487e9f34a3dfeb9db04264b82f/haproxy/0.log"
Jul 23 17:04:14.073620 ip-10-0-143-166 kubenswrapper[2553]: I0723 17:04:14.073570    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759bkr7t_fe997029-66c5-4d41-8efc-96d5b847af84/extract/0.log"
Jul 23 17:04:14.099122 ip-10-0-143-166 kubenswrapper[2553]: I0723 17:04:14.099085    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759bkr7t_fe997029-66c5-4d41-8efc-96d5b847af84/util/0.log"
Jul 23 17:04:14.123970 ip-10-0-143-166 kubenswrapper[2553]: I0723 17:04:14.123937    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759bkr7t_fe997029-66c5-4d41-8efc-96d5b847af84/pull/0.log"
Jul 23 17:04:14.154456 ip-10-0-143-166 kubenswrapper[2553]: I0723 17:04:14.154430    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0fw8x9_8de7a45c-439c-49fe-ab2e-80ad09d5dbc5/extract/0.log"
Jul 23 17:04:14.179705 ip-10-0-143-166 kubenswrapper[2553]: I0723 17:04:14.179679    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0fw8x9_8de7a45c-439c-49fe-ab2e-80ad09d5dbc5/util/0.log"
Jul 23 17:04:14.206151 ip-10-0-143-166 kubenswrapper[2553]: I0723 17:04:14.206045    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0fw8x9_8de7a45c-439c-49fe-ab2e-80ad09d5dbc5/pull/0.log"
Jul 23 17:04:14.237884 ip-10-0-143-166 kubenswrapper[2553]: I0723 17:04:14.237726    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7372f54_5bb96e52-7c69-43a2-a110-9d59c6a1f560/extract/0.log"
Jul 23 17:04:14.277009 ip-10-0-143-166 kubenswrapper[2553]: I0723 17:04:14.276977    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7372f54_5bb96e52-7c69-43a2-a110-9d59c6a1f560/util/0.log"
Jul 23 17:04:14.309071 ip-10-0-143-166 kubenswrapper[2553]: I0723 17:04:14.309013    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7372f54_5bb96e52-7c69-43a2-a110-9d59c6a1f560/pull/0.log"
Jul 23 17:04:14.347723 ip-10-0-143-166 kubenswrapper[2553]: I0723 17:04:14.347690    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1j2mxz_92310d06-adf5-4258-91a1-4d4f0185c1b0/extract/0.log"
Jul 23 17:04:14.373352 ip-10-0-143-166 kubenswrapper[2553]: I0723 17:04:14.373307    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1j2mxz_92310d06-adf5-4258-91a1-4d4f0185c1b0/util/0.log"
Jul 23 17:04:14.401814 ip-10-0-143-166 kubenswrapper[2553]: I0723 17:04:14.401742    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1j2mxz_92310d06-adf5-4258-91a1-4d4f0185c1b0/pull/0.log"
Jul 23 17:04:14.925113 ip-10-0-143-166 kubenswrapper[2553]: I0723 17:04:14.912617    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-795674df9c-xsm7j_6d2ed5f0-e198-49bc-b05b-4433565c26f4/authorino/0.log"
Jul 23 17:04:15.030418 ip-10-0-143-166 kubenswrapper[2553]: I0723 17:04:15.030392    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-hpsmb_aba9d5ae-8f09-4bcc-a6ca-2d5ff4944f0c/kuadrant-console-plugin/0.log"
Jul 23 17:04:17.227386 ip-10-0-143-166 kubenswrapper[2553]: I0723 17:04:17.227352    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-76cf8966f8-jrf9k_0167b7d7-8b10-4847-b5ea-5dc52d892bf0/cluster-monitoring-operator/0.log"
Jul 23 17:04:17.404613 ip-10-0-143-166 kubenswrapper[2553]: I0723 17:04:17.404586    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-shbmd_6dbae327-9634-451e-8554-dbd52547928a/node-exporter/0.log"
Jul 23 17:04:17.437248 ip-10-0-143-166 kubenswrapper[2553]: I0723 17:04:17.437219    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-shbmd_6dbae327-9634-451e-8554-dbd52547928a/kube-rbac-proxy/0.log"
Jul 23 17:04:17.464551 ip-10-0-143-166 kubenswrapper[2553]: I0723 17:04:17.464521    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-shbmd_6dbae327-9634-451e-8554-dbd52547928a/init-textfile/0.log"
Jul 23 17:04:19.395716 ip-10-0-143-166 kubenswrapper[2553]: I0723 17:04:19.395641    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-7bc7489cb5-pksrr_552a2881-1bbe-4a5e-b5fb-d245882c2933/networking-console-plugin/0.log"
Jul 23 17:04:19.656749 ip-10-0-143-166 kubenswrapper[2553]: I0723 17:04:19.656661    2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-wvj2n/perf-node-gather-daemonset-g9qvr"]
Jul 23 17:04:19.662504 ip-10-0-143-166 kubenswrapper[2553]: I0723 17:04:19.662475    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-wvj2n/perf-node-gather-daemonset-g9qvr"
Jul 23 17:04:19.670398 ip-10-0-143-166 kubenswrapper[2553]: I0723 17:04:19.670370    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-wvj2n/perf-node-gather-daemonset-g9qvr"]
Jul 23 17:04:19.857803 ip-10-0-143-166 kubenswrapper[2553]: I0723 17:04:19.857762    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4bx98\" (UniqueName: \"kubernetes.io/projected/a7d103e9-4214-4ff2-a140-96006342e62b-kube-api-access-4bx98\") pod \"perf-node-gather-daemonset-g9qvr\" (UID: \"a7d103e9-4214-4ff2-a140-96006342e62b\") " pod="openshift-must-gather-wvj2n/perf-node-gather-daemonset-g9qvr"
Jul 23 17:04:19.858090 ip-10-0-143-166 kubenswrapper[2553]: I0723 17:04:19.858068    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a7d103e9-4214-4ff2-a140-96006342e62b-sys\") pod \"perf-node-gather-daemonset-g9qvr\" (UID: \"a7d103e9-4214-4ff2-a140-96006342e62b\") " pod="openshift-must-gather-wvj2n/perf-node-gather-daemonset-g9qvr"
Jul 23 17:04:19.858326 ip-10-0-143-166 kubenswrapper[2553]: I0723 17:04:19.858302    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/a7d103e9-4214-4ff2-a140-96006342e62b-proc\") pod \"perf-node-gather-daemonset-g9qvr\" (UID: \"a7d103e9-4214-4ff2-a140-96006342e62b\") " pod="openshift-must-gather-wvj2n/perf-node-gather-daemonset-g9qvr"
Jul 23 17:04:19.858996 ip-10-0-143-166 kubenswrapper[2553]: I0723 17:04:19.858961    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/a7d103e9-4214-4ff2-a140-96006342e62b-lib-modules\") pod \"perf-node-gather-daemonset-g9qvr\" (UID: \"a7d103e9-4214-4ff2-a140-96006342e62b\") " pod="openshift-must-gather-wvj2n/perf-node-gather-daemonset-g9qvr"
Jul 23 17:04:19.859118 ip-10-0-143-166 kubenswrapper[2553]: I0723 17:04:19.859010    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/a7d103e9-4214-4ff2-a140-96006342e62b-podres\") pod \"perf-node-gather-daemonset-g9qvr\" (UID: \"a7d103e9-4214-4ff2-a140-96006342e62b\") " pod="openshift-must-gather-wvj2n/perf-node-gather-daemonset-g9qvr"
Jul 23 17:04:19.960310 ip-10-0-143-166 kubenswrapper[2553]: I0723 17:04:19.960222    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4bx98\" (UniqueName: \"kubernetes.io/projected/a7d103e9-4214-4ff2-a140-96006342e62b-kube-api-access-4bx98\") pod \"perf-node-gather-daemonset-g9qvr\" (UID: \"a7d103e9-4214-4ff2-a140-96006342e62b\") " pod="openshift-must-gather-wvj2n/perf-node-gather-daemonset-g9qvr"
Jul 23 17:04:19.960555 ip-10-0-143-166 kubenswrapper[2553]: I0723 17:04:19.960539    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a7d103e9-4214-4ff2-a140-96006342e62b-sys\") pod \"perf-node-gather-daemonset-g9qvr\" (UID: \"a7d103e9-4214-4ff2-a140-96006342e62b\") " pod="openshift-must-gather-wvj2n/perf-node-gather-daemonset-g9qvr"
Jul 23 17:04:19.960813 ip-10-0-143-166 kubenswrapper[2553]: I0723 17:04:19.960797    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/a7d103e9-4214-4ff2-a140-96006342e62b-proc\") pod \"perf-node-gather-daemonset-g9qvr\" (UID: \"a7d103e9-4214-4ff2-a140-96006342e62b\") " pod="openshift-must-gather-wvj2n/perf-node-gather-daemonset-g9qvr"
Jul 23 17:04:19.961030 ip-10-0-143-166 kubenswrapper[2553]: I0723 17:04:19.961017    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/a7d103e9-4214-4ff2-a140-96006342e62b-lib-modules\") pod \"perf-node-gather-daemonset-g9qvr\" (UID: \"a7d103e9-4214-4ff2-a140-96006342e62b\") " pod="openshift-must-gather-wvj2n/perf-node-gather-daemonset-g9qvr"
Jul 23 17:04:19.961289 ip-10-0-143-166 kubenswrapper[2553]: I0723 17:04:19.961275    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/a7d103e9-4214-4ff2-a140-96006342e62b-podres\") pod \"perf-node-gather-daemonset-g9qvr\" (UID: \"a7d103e9-4214-4ff2-a140-96006342e62b\") " pod="openshift-must-gather-wvj2n/perf-node-gather-daemonset-g9qvr"
Jul 23 17:04:19.961533 ip-10-0-143-166 kubenswrapper[2553]: I0723 17:04:19.960952    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/a7d103e9-4214-4ff2-a140-96006342e62b-proc\") pod \"perf-node-gather-daemonset-g9qvr\" (UID: \"a7d103e9-4214-4ff2-a140-96006342e62b\") " pod="openshift-must-gather-wvj2n/perf-node-gather-daemonset-g9qvr"
Jul 23 17:04:19.961637 ip-10-0-143-166 kubenswrapper[2553]: I0723 17:04:19.961231    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/a7d103e9-4214-4ff2-a140-96006342e62b-lib-modules\") pod \"perf-node-gather-daemonset-g9qvr\" (UID: \"a7d103e9-4214-4ff2-a140-96006342e62b\") " pod="openshift-must-gather-wvj2n/perf-node-gather-daemonset-g9qvr"
Jul 23 17:04:19.961718 ip-10-0-143-166 kubenswrapper[2553]: I0723 17:04:19.960701    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a7d103e9-4214-4ff2-a140-96006342e62b-sys\") pod \"perf-node-gather-daemonset-g9qvr\" (UID: \"a7d103e9-4214-4ff2-a140-96006342e62b\") " pod="openshift-must-gather-wvj2n/perf-node-gather-daemonset-g9qvr"
Jul 23 17:04:19.961797 ip-10-0-143-166 kubenswrapper[2553]: I0723 17:04:19.961447    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/a7d103e9-4214-4ff2-a140-96006342e62b-podres\") pod \"perf-node-gather-daemonset-g9qvr\" (UID: \"a7d103e9-4214-4ff2-a140-96006342e62b\") " pod="openshift-must-gather-wvj2n/perf-node-gather-daemonset-g9qvr"
Jul 23 17:04:19.970064 ip-10-0-143-166 kubenswrapper[2553]: I0723 17:04:19.970039    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4bx98\" (UniqueName: \"kubernetes.io/projected/a7d103e9-4214-4ff2-a140-96006342e62b-kube-api-access-4bx98\") pod \"perf-node-gather-daemonset-g9qvr\" (UID: \"a7d103e9-4214-4ff2-a140-96006342e62b\") " pod="openshift-must-gather-wvj2n/perf-node-gather-daemonset-g9qvr"
Jul 23 17:04:19.978052 ip-10-0-143-166 kubenswrapper[2553]: I0723 17:04:19.978019    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-wvj2n/perf-node-gather-daemonset-g9qvr"
Jul 23 17:04:20.057404 ip-10-0-143-166 kubenswrapper[2553]: I0723 17:04:20.057378    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-7rmrn_976a7198-cfd3-43d4-8c9f-b1f248d1f6d7/console-operator/1.log"
Jul 23 17:04:20.065409 ip-10-0-143-166 kubenswrapper[2553]: I0723 17:04:20.065357    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-7rmrn_976a7198-cfd3-43d4-8c9f-b1f248d1f6d7/console-operator/2.log"
Jul 23 17:04:20.181744 ip-10-0-143-166 kubenswrapper[2553]: I0723 17:04:20.181709    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-wvj2n/perf-node-gather-daemonset-g9qvr"]
Jul 23 17:04:20.207851 ip-10-0-143-166 kubenswrapper[2553]: I0723 17:04:20.207813    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-wvj2n/perf-node-gather-daemonset-g9qvr" event={"ID":"a7d103e9-4214-4ff2-a140-96006342e62b","Type":"ContainerStarted","Data":"1fa019b796bbc15d035404090e31f89e61ca126f2a2d71f29ca15556dcedae7b"}
Jul 23 17:04:20.656292 ip-10-0-143-166 kubenswrapper[2553]: I0723 17:04:20.656242    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-5bc67dcd46-h75zq_30db792c-cf16-411f-be26-7f278a96af89/download-server/0.log"
Jul 23 17:04:21.218049 ip-10-0-143-166 kubenswrapper[2553]: I0723 17:04:21.218013    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-wvj2n/perf-node-gather-daemonset-g9qvr" event={"ID":"a7d103e9-4214-4ff2-a140-96006342e62b","Type":"ContainerStarted","Data":"42295f424877dcb4c5225a767ab5db4016bd13488adabd63992ab6f51d631cfd"}
Jul 23 17:04:21.218251 ip-10-0-143-166 kubenswrapper[2553]: I0723 17:04:21.218190    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-wvj2n/perf-node-gather-daemonset-g9qvr"
Jul 23 17:04:21.236260 ip-10-0-143-166 kubenswrapper[2553]: I0723 17:04:21.236198    2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-wvj2n/perf-node-gather-daemonset-g9qvr" podStartSLOduration=2.236160409 podStartE2EDuration="2.236160409s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 17:04:19 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 17:04:21.233967682 +0000 UTC m=+2943.098573811" watchObservedRunningTime="2026-07-23 17:04:21.236160409 +0000 UTC m=+2943.100766538"
Jul 23 17:04:21.241797 ip-10-0-143-166 kubenswrapper[2553]: I0723 17:04:21.241771    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-78cf4c6f6-ddq85_c290c129-eea4-49d9-9ca5-56b4d600275b/volume-data-source-validator/0.log"
Jul 23 17:04:22.257146 ip-10-0-143-166 kubenswrapper[2553]: I0723 17:04:22.257116    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-jkc4g_7ca02cf0-ad65-46e4-a0bd-25a470519d68/dns/0.log"
Jul 23 17:04:22.285628 ip-10-0-143-166 kubenswrapper[2553]: I0723 17:04:22.285595    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-jkc4g_7ca02cf0-ad65-46e4-a0bd-25a470519d68/kube-rbac-proxy/0.log"
Jul 23 17:04:22.407183 ip-10-0-143-166 kubenswrapper[2553]: I0723 17:04:22.407150    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-qbjm4_f8e034fc-9e28-43ab-bd6e-a62848b2ac5d/dns-node-resolver/0.log"
Jul 23 17:04:22.939863 ip-10-0-143-166 kubenswrapper[2553]: I0723 17:04:22.939828    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-cnp2t_1af4cdcf-98b6-4aab-b234-3bed6566658b/node-ca/0.log"
Jul 23 17:04:24.096662 ip-10-0-143-166 kubenswrapper[2553]: I0723 17:04:24.096635    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-545d74bcdb-98x2h_38c05ca6-e42d-478d-afed-b773f76733d8/kube-auth-proxy/0.log"
Jul 23 17:04:24.260025 ip-10-0-143-166 kubenswrapper[2553]: I0723 17:04:24.259995    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-599b8db76d-sn7k4_b145abca-07cb-4345-9efc-2c03f950ac14/router/0.log"
Jul 23 17:04:24.944101 ip-10-0-143-166 kubenswrapper[2553]: I0723 17:04:24.944068    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-gcv6f_febad6e2-993e-4dd1-b043-33db2bdda4fe/serve-healthcheck-canary/0.log"
Jul 23 17:04:25.453492 ip-10-0-143-166 kubenswrapper[2553]: I0723 17:04:25.453433    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-555d9d7885-5hbck_93f725de-e1d8-4c9d-9491-494072eaadf4/insights-operator/0.log"
Jul 23 17:04:25.457840 ip-10-0-143-166 kubenswrapper[2553]: I0723 17:04:25.457817    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-555d9d7885-5hbck_93f725de-e1d8-4c9d-9491-494072eaadf4/insights-operator/1.log"
Jul 23 17:04:25.564711 ip-10-0-143-166 kubenswrapper[2553]: I0723 17:04:25.564681    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-klcmp_009e126d-9220-4759-b0ef-7a5b2fd70563/kube-rbac-proxy/0.log"
Jul 23 17:04:25.586110 ip-10-0-143-166 kubenswrapper[2553]: I0723 17:04:25.586087    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-klcmp_009e126d-9220-4759-b0ef-7a5b2fd70563/exporter/0.log"
Jul 23 17:04:25.607070 ip-10-0-143-166 kubenswrapper[2553]: I0723 17:04:25.607044    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-klcmp_009e126d-9220-4759-b0ef-7a5b2fd70563/extractor/0.log"
Jul 23 17:04:27.236237 ip-10-0-143-166 kubenswrapper[2553]: I0723 17:04:27.236211    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-wvj2n/perf-node-gather-daemonset-g9qvr"
Jul 23 17:04:28.155704 ip-10-0-143-166 kubenswrapper[2553]: I0723 17:04:28.155664    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-hw7h6_1dc8b88c-360e-483e-b896-6f0aa35b32fe/server/0.log"
Jul 23 17:04:28.301525 ip-10-0-143-166 kubenswrapper[2553]: I0723 17:04:28.301493    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-4gzgh_50c15f91-b24d-49ba-85af-4615ce9ab662/manager/0.log"
Jul 23 17:04:28.494366 ip-10-0-143-166 kubenswrapper[2553]: I0723 17:04:28.494276    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-678945769f-69jmp_a74ccce6-3ea9-4933-86e9-e2dbc5777b9a/manager/0.log"
Jul 23 17:04:28.516129 ip-10-0-143-166 kubenswrapper[2553]: I0723 17:04:28.516103    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-678945769f-69jmp_a74ccce6-3ea9-4933-86e9-e2dbc5777b9a/copy-manifests/0.log"
Jul 23 17:04:30.003386 ip-10-0-143-166 kubenswrapper[2553]: I0723 17:04:30.003310    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-598cd96689-4jxg8_cf7332fa-4994-433e-8ffa-eb1472f3ceba/manager/0.log"
Jul 23 17:04:30.331156 ip-10-0-143-166 kubenswrapper[2553]: I0723 17:04:30.331084    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-545d74bcdb-98x2h_38c05ca6-e42d-478d-afed-b773f76733d8/kube-auth-proxy/0.log"
Jul 23 17:04:30.470798 ip-10-0-143-166 kubenswrapper[2553]: I0723 17:04:30.470771    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-599b8db76d-sn7k4_b145abca-07cb-4345-9efc-2c03f950ac14/router/0.log"
Jul 23 17:04:31.829095 ip-10-0-143-166 kubenswrapper[2553]: I0723 17:04:31.829069    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-545d74bcdb-98x2h_38c05ca6-e42d-478d-afed-b773f76733d8/kube-auth-proxy/0.log"
Jul 23 17:04:31.988586 ip-10-0-143-166 kubenswrapper[2553]: I0723 17:04:31.988550    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-599b8db76d-sn7k4_b145abca-07cb-4345-9efc-2c03f950ac14/router/0.log"
Jul 23 17:04:35.244636 ip-10-0-143-166 kubenswrapper[2553]: I0723 17:04:35.244608    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-7cc9c7ffd7-22876_1642a853-7066-4741-b260-8d7dc9fbea36/migrator/0.log"
Jul 23 17:04:35.268374 ip-10-0-143-166 kubenswrapper[2553]: I0723 17:04:35.268339    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-7cc9c7ffd7-22876_1642a853-7066-4741-b260-8d7dc9fbea36/graceful-termination/0.log"
Jul 23 17:04:35.649443 ip-10-0-143-166 kubenswrapper[2553]: I0723 17:04:35.649415    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-7658d9b749-tlkw4_e4611a5f-b77b-469f-b29c-81ea53b65599/kube-storage-version-migrator-operator/1.log"
Jul 23 17:04:35.650326 ip-10-0-143-166 kubenswrapper[2553]: I0723 17:04:35.650304    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-7658d9b749-tlkw4_e4611a5f-b77b-469f-b29c-81ea53b65599/kube-storage-version-migrator-operator/0.log"
Jul 23 17:04:37.150556 ip-10-0-143-166 kubenswrapper[2553]: I0723 17:04:37.150525    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-jjtst_d033268a-14e3-44c6-a470-313654dc9a6e/kube-multus-additional-cni-plugins/0.log"
Jul 23 17:04:37.172304 ip-10-0-143-166 kubenswrapper[2553]: I0723 17:04:37.172272    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-jjtst_d033268a-14e3-44c6-a470-313654dc9a6e/egress-router-binary-copy/0.log"
Jul 23 17:04:37.201094 ip-10-0-143-166 kubenswrapper[2553]: I0723 17:04:37.201054    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-jjtst_d033268a-14e3-44c6-a470-313654dc9a6e/cni-plugins/0.log"
Jul 23 17:04:37.236246 ip-10-0-143-166 kubenswrapper[2553]: I0723 17:04:37.236160    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-jjtst_d033268a-14e3-44c6-a470-313654dc9a6e/bond-cni-plugin/0.log"
Jul 23 17:04:37.262687 ip-10-0-143-166 kubenswrapper[2553]: I0723 17:04:37.262658    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-jjtst_d033268a-14e3-44c6-a470-313654dc9a6e/routeoverride-cni/0.log"