Jul 14 19:51:40.157944 ip-10-0-140-201 systemd[1]: Starting Kubernetes Kubelet...
Jul 14 19:51:40.603997 ip-10-0-140-201 kubenswrapper[2579]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 14 19:51:40.603997 ip-10-0-140-201 kubenswrapper[2579]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jul 14 19:51:40.603997 ip-10-0-140-201 kubenswrapper[2579]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 14 19:51:40.603997 ip-10-0-140-201 kubenswrapper[2579]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jul 14 19:51:40.603997 ip-10-0-140-201 kubenswrapper[2579]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 14 19:51:40.606106 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:40.606014    2579 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jul 14 19:51:40.611082 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:51:40.611059    2579 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 14 19:51:40.611082 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:51:40.611082    2579 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 14 19:51:40.611162 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:51:40.611086    2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 14 19:51:40.611162 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:51:40.611089    2579 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 14 19:51:40.611162 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:51:40.611093    2579 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 14 19:51:40.611162 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:51:40.611096    2579 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 14 19:51:40.611162 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:51:40.611099    2579 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 14 19:51:40.611162 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:51:40.611102    2579 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 14 19:51:40.611162 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:51:40.611106    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 14 19:51:40.611162 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:51:40.611115    2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 14 19:51:40.611162 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:51:40.611118    2579 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 14 19:51:40.611162 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:51:40.611120    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 14 19:51:40.611162 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:51:40.611123    2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 14 19:51:40.611162 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:51:40.611125    2579 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 14 19:51:40.611162 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:51:40.611128    2579 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 14 19:51:40.611162 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:51:40.611130    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 14 19:51:40.611162 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:51:40.611133    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 14 19:51:40.611162 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:51:40.611136    2579 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 14 19:51:40.611162 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:51:40.611139    2579 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 14 19:51:40.611162 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:51:40.611141    2579 feature_gate.go:328] unrecognized feature gate: Example2
Jul 14 19:51:40.611162 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:51:40.611144    2579 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 14 19:51:40.611162 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:51:40.611146    2579 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 14 19:51:40.611661 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:51:40.611149    2579 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 14 19:51:40.611661 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:51:40.611151    2579 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 14 19:51:40.611661 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:51:40.611154    2579 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 14 19:51:40.611661 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:51:40.611156    2579 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 14 19:51:40.611661 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:51:40.611159    2579 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 14 19:51:40.611661 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:51:40.611161    2579 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 14 19:51:40.611661 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:51:40.611163    2579 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 14 19:51:40.611661 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:51:40.611166    2579 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 14 19:51:40.611661 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:51:40.611169    2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 14 19:51:40.611661 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:51:40.611172    2579 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 14 19:51:40.611661 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:51:40.611174    2579 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 14 19:51:40.611661 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:51:40.611177    2579 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 14 19:51:40.611661 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:51:40.611180    2579 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 14 19:51:40.611661 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:51:40.611183    2579 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 14 19:51:40.611661 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:51:40.611185    2579 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 14 19:51:40.611661 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:51:40.611187    2579 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 14 19:51:40.611661 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:51:40.611190    2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 14 19:51:40.611661 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:51:40.611192    2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 14 19:51:40.611661 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:51:40.611195    2579 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 14 19:51:40.611661 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:51:40.611197    2579 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 14 19:51:40.612139 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:51:40.611200    2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 14 19:51:40.612139 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:51:40.611202    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 14 19:51:40.612139 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:51:40.611204    2579 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 14 19:51:40.612139 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:51:40.611209    2579 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 14 19:51:40.612139 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:51:40.611219    2579 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 14 19:51:40.612139 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:51:40.611222    2579 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 14 19:51:40.612139 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:51:40.611224    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 14 19:51:40.612139 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:51:40.611227    2579 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 14 19:51:40.612139 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:51:40.611229    2579 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 14 19:51:40.612139 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:51:40.611232    2579 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 14 19:51:40.612139 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:51:40.611234    2579 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 14 19:51:40.612139 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:51:40.611236    2579 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 14 19:51:40.612139 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:51:40.611240    2579 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 14 19:51:40.612139 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:51:40.611243    2579 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 14 19:51:40.612139 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:51:40.611246    2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 14 19:51:40.612139 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:51:40.611248    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 14 19:51:40.612139 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:51:40.611250    2579 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 14 19:51:40.612139 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:51:40.611253    2579 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 14 19:51:40.612139 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:51:40.611256    2579 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 14 19:51:40.612613 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:51:40.611259    2579 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 14 19:51:40.612613 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:51:40.611261    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 14 19:51:40.612613 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:51:40.611264    2579 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 14 19:51:40.612613 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:51:40.611266    2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 14 19:51:40.612613 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:51:40.611269    2579 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 14 19:51:40.612613 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:51:40.611271    2579 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 14 19:51:40.612613 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:51:40.611274    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 14 19:51:40.612613 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:51:40.611276    2579 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 14 19:51:40.612613 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:51:40.611279    2579 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 14 19:51:40.612613 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:51:40.611282    2579 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 14 19:51:40.612613 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:51:40.611285    2579 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 14 19:51:40.612613 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:51:40.611288    2579 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 14 19:51:40.612613 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:51:40.611290    2579 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 14 19:51:40.612613 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:51:40.611293    2579 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 14 19:51:40.612613 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:51:40.611295    2579 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 14 19:51:40.612613 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:51:40.611299    2579 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 14 19:51:40.612613 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:51:40.611303    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 14 19:51:40.612613 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:51:40.611306    2579 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 14 19:51:40.612613 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:51:40.611309    2579 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 14 19:51:40.613098 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:51:40.611311    2579 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 14 19:51:40.613098 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:51:40.611314    2579 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 14 19:51:40.613098 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:51:40.611317    2579 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 14 19:51:40.613098 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:51:40.611319    2579 feature_gate.go:328] unrecognized feature gate: Example
Jul 14 19:51:40.613098 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:51:40.611322    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 14 19:51:40.613098 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:51:40.611324    2579 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 14 19:51:40.613098 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:51:40.611328    2579 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 14 19:51:40.613098 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:51:40.611332    2579 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 14 19:51:40.613098 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:51:40.611336    2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 14 19:51:40.613098 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:51:40.611339    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 14 19:51:40.613098 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:51:40.611342    2579 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 14 19:51:40.613098 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:51:40.611344    2579 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 14 19:51:40.613098 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:51:40.611347    2579 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 14 19:51:40.613098 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:51:40.611350    2579 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 14 19:51:40.613098 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:51:40.611353    2579 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 14 19:51:40.613098 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:51:40.611355    2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 14 19:51:40.613098 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:51:40.611358    2579 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 14 19:51:40.613098 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:51:40.611360    2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 14 19:51:40.613098 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:51:40.611362    2579 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 14 19:51:40.613098 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:51:40.612143    2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 14 19:51:40.613585 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:51:40.612150    2579 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 14 19:51:40.613585 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:51:40.612153    2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 14 19:51:40.613585 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:51:40.612155    2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 14 19:51:40.613585 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:51:40.612158    2579 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 14 19:51:40.613585 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:51:40.612162    2579 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 14 19:51:40.613585 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:51:40.612164    2579 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 14 19:51:40.613585 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:51:40.612167    2579 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 14 19:51:40.613585 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:51:40.612169    2579 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 14 19:51:40.613585 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:51:40.612172    2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 14 19:51:40.613585 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:51:40.612175    2579 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 14 19:51:40.613585 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:51:40.612177    2579 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 14 19:51:40.613585 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:51:40.612180    2579 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 14 19:51:40.613585 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:51:40.612182    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 14 19:51:40.613585 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:51:40.612184    2579 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 14 19:51:40.613585 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:51:40.612187    2579 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 14 19:51:40.613585 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:51:40.612189    2579 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 14 19:51:40.613585 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:51:40.612192    2579 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 14 19:51:40.613585 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:51:40.612194    2579 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 14 19:51:40.613585 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:51:40.612197    2579 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 14 19:51:40.613585 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:51:40.612200    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 14 19:51:40.614094 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:51:40.612203    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 14 19:51:40.614094 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:51:40.612205    2579 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 14 19:51:40.614094 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:51:40.612208    2579 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 14 19:51:40.614094 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:51:40.612210    2579 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 14 19:51:40.614094 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:51:40.612213    2579 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 14 19:51:40.614094 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:51:40.612215    2579 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 14 19:51:40.614094 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:51:40.612217    2579 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 14 19:51:40.614094 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:51:40.612219    2579 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 14 19:51:40.614094 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:51:40.612222    2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 14 19:51:40.614094 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:51:40.612224    2579 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 14 19:51:40.614094 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:51:40.612226    2579 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 14 19:51:40.614094 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:51:40.612229    2579 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 14 19:51:40.614094 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:51:40.612231    2579 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 14 19:51:40.614094 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:51:40.612235    2579 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 14 19:51:40.614094 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:51:40.612239    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 14 19:51:40.614094 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:51:40.612242    2579 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 14 19:51:40.614094 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:51:40.612245    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 14 19:51:40.614094 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:51:40.612249    2579 feature_gate.go:328] unrecognized feature gate: Example2
Jul 14 19:51:40.614094 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:51:40.612252    2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 14 19:51:40.614094 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:51:40.612255    2579 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 14 19:51:40.614603 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:51:40.612257    2579 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 14 19:51:40.614603 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:51:40.612260    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 14 19:51:40.614603 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:51:40.612262    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 14 19:51:40.614603 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:51:40.612265    2579 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 14 19:51:40.614603 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:51:40.612267    2579 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 14 19:51:40.614603 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:51:40.612270    2579 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 14 19:51:40.614603 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:51:40.612272    2579 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 14 19:51:40.614603 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:51:40.612275    2579 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 14 19:51:40.614603 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:51:40.612277    2579 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 14 19:51:40.614603 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:51:40.612280    2579 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 14 19:51:40.614603 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:51:40.612282    2579 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 14 19:51:40.614603 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:51:40.612285    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 14 19:51:40.614603 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:51:40.612288    2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 14 19:51:40.614603 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:51:40.612291    2579 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 14 19:51:40.614603 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:51:40.612293    2579 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 14 19:51:40.614603 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:51:40.612295    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 14 19:51:40.614603 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:51:40.612298    2579 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 14 19:51:40.614603 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:51:40.612300    2579 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 14 19:51:40.614603 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:51:40.612303    2579 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 14 19:51:40.614603 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:51:40.612305    2579 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 14 19:51:40.615171 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:51:40.612309    2579 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 14 19:51:40.615171 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:51:40.612313    2579 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 14 19:51:40.615171 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:51:40.612316    2579 feature_gate.go:328] unrecognized feature gate: Example
Jul 14 19:51:40.615171 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:51:40.612318    2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 14 19:51:40.615171 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:51:40.612321    2579 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 14 19:51:40.615171 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:51:40.612323    2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 14 19:51:40.615171 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:51:40.612326    2579 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 14 19:51:40.615171 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:51:40.612328    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 14 19:51:40.615171 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:51:40.612330    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 14 19:51:40.615171 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:51:40.612333    2579 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 14 19:51:40.615171 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:51:40.612336    2579 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 14 19:51:40.615171 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:51:40.612339    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 14 19:51:40.615171 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:51:40.612341    2579 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 14 19:51:40.615171 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:51:40.612344    2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 14 19:51:40.615171 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:51:40.612347    2579 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 14 19:51:40.615171 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:51:40.612351    2579 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 14 19:51:40.615171 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:51:40.612355    2579 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 14 19:51:40.615171 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:51:40.612358    2579 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 14 19:51:40.615171 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:51:40.612361    2579 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 14 19:51:40.615662 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:51:40.612364    2579 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 14 19:51:40.615662 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:51:40.612367    2579 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 14 19:51:40.615662 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:51:40.612369    2579 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 14 19:51:40.615662 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:51:40.612372    2579 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 14 19:51:40.615662 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:51:40.612375    2579 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 14 19:51:40.615662 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:51:40.612378    2579 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 14 19:51:40.615662 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:51:40.612381    2579 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 14 19:51:40.615662 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:51:40.612384    2579 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 14 19:51:40.615662 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:51:40.612386    2579 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 14 19:51:40.615662 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:51:40.612395    2579 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 14 19:51:40.615662 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:51:40.612398    2579 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 14 19:51:40.615662 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:51:40.612401    2579 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 14 19:51:40.615662 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:51:40.612403    2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 14 19:51:40.615662 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:51:40.612405    2579 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 14 19:51:40.615662 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:51:40.612408    2579 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 14 19:51:40.615662 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:51:40.612410    2579 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 14 19:51:40.615662 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:51:40.612413    2579 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 14 19:51:40.615662 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:51:40.612415    2579 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 14 19:51:40.615662 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:51:40.612418    2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 14 19:51:40.616134 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:51:40.612895    2579 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 14 19:51:40.616134 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:51:40.612900    2579 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 14 19:51:40.616134 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:51:40.612903    2579 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 14 19:51:40.616134 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:51:40.612906    2579 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 14 19:51:40.616134 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:51:40.612909    2579 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 14 19:51:40.616134 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:51:40.612913    2579 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 14 19:51:40.616134 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:51:40.612917    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 14 19:51:40.616134 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:51:40.612921    2579 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 14 19:51:40.616134 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:51:40.612923    2579 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 14 19:51:40.616134 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:51:40.612926    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 14 19:51:40.616134 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:51:40.612929    2579 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 14 19:51:40.616134 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:51:40.612932    2579 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 14 19:51:40.616134 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:51:40.612934    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 14 19:51:40.616134 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:51:40.612937    2579 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 14 19:51:40.616134 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:51:40.612939    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 14 19:51:40.616134 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:51:40.612942    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 14 19:51:40.616134 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:51:40.612944    2579 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 14 19:51:40.616134 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:51:40.612947    2579 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 14 19:51:40.616134 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:51:40.612950    2579 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 14 19:51:40.616613 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:51:40.612952    2579 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 14 19:51:40.616613 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:51:40.612955    2579 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 14 19:51:40.616613 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:51:40.612957    2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 14 19:51:40.616613 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:51:40.612960    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 14 19:51:40.616613 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:51:40.612962    2579 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 14 19:51:40.616613 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:51:40.612965    2579 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 14 19:51:40.616613 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:51:40.612968    2579 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 14 19:51:40.616613 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:51:40.612971    2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 14 19:51:40.616613 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:51:40.612974    2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 14 19:51:40.616613 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:51:40.612976    2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 14 19:51:40.616613 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:51:40.612980    2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 14 19:51:40.616613 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:51:40.612982    2579 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 14 19:51:40.616613 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:51:40.612985    2579 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 14 19:51:40.616613 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:51:40.612987    2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 14 19:51:40.616613 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:51:40.612990    2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 14 19:51:40.616613 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:51:40.612992    2579 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 14 19:51:40.616613 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:51:40.612995    2579 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 14 19:51:40.616613 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:51:40.612997    2579 feature_gate.go:328] unrecognized feature gate: Example
Jul 14 19:51:40.616613 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:51:40.613001    2579 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 14 19:51:40.616613 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:51:40.613003    2579 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 14 19:51:40.617084 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:51:40.613006    2579 feature_gate.go:328] unrecognized feature gate: Example2
Jul 14 19:51:40.617084 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:51:40.613009    2579 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 14 19:51:40.617084 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:51:40.613011    2579 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 14 19:51:40.617084 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:51:40.613014    2579 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 14 19:51:40.617084 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:51:40.613016    2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 14 19:51:40.617084 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:51:40.613018    2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 14 19:51:40.617084 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:51:40.613022    2579 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 14 19:51:40.617084 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:51:40.613025    2579 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 14 19:51:40.617084 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:51:40.613027    2579 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 14 19:51:40.617084 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:51:40.613029    2579 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 14 19:51:40.617084 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:51:40.613032    2579 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 14 19:51:40.617084 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:51:40.613035    2579 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 14 19:51:40.617084 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:51:40.613037    2579 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 14 19:51:40.617084 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:51:40.613040    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 14 19:51:40.617084 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:51:40.613042    2579 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 14 19:51:40.617084 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:51:40.613045    2579 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 14 19:51:40.617084 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:51:40.613047    2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 14 19:51:40.617084 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:51:40.613050    2579 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 14 19:51:40.617084 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:51:40.613052    2579 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 14 19:51:40.617084 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:51:40.613055    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 14 19:51:40.617581 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:51:40.613057    2579 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 14 19:51:40.617581 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:51:40.613060    2579 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 14 19:51:40.617581 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:51:40.613062    2579 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 14 19:51:40.617581 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:51:40.613066    2579 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 14 19:51:40.617581 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:51:40.613069    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 14 19:51:40.617581 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:51:40.613072    2579 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 14 19:51:40.617581 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:51:40.613075    2579 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 14 19:51:40.617581 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:51:40.613078    2579 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 14 19:51:40.617581 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:51:40.613081    2579 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 14 19:51:40.617581 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:51:40.613083    2579 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 14 19:51:40.617581 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:51:40.613086    2579 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 14 19:51:40.617581 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:51:40.613112    2579 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 14 19:51:40.617581 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:51:40.613115    2579 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 14 19:51:40.617581 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:51:40.613118    2579 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 14 19:51:40.617581 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:51:40.613120    2579 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 14 19:51:40.617581 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:51:40.613123    2579 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 14 19:51:40.617581 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:51:40.613126    2579 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 14 19:51:40.617581 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:51:40.613128    2579 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 14 19:51:40.617581 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:51:40.613130    2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 14 19:51:40.618093 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:51:40.613133    2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 14 19:51:40.618093 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:51:40.613135    2579 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 14 19:51:40.618093 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:51:40.613138    2579 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 14 19:51:40.618093 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:51:40.613143    2579 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 14 19:51:40.618093 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:51:40.613146    2579 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 14 19:51:40.618093 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:51:40.613148    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 14 19:51:40.618093 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:51:40.613151    2579 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 14 19:51:40.618093 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:51:40.613153    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 14 19:51:40.618093 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:51:40.613156    2579 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 14 19:51:40.618093 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:51:40.613158    2579 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 14 19:51:40.618093 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:51:40.613161    2579 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 14 19:51:40.618093 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:51:40.613163    2579 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 14 19:51:40.618093 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:51:40.613166    2579 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 14 19:51:40.618093 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:51:40.613169    2579 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 14 19:51:40.618093 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:51:40.613171    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 14 19:51:40.618093 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:51:40.613174    2579 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 14 19:51:40.618093 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:51:40.613176    2579 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 14 19:51:40.618093 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:51:40.613179    2579 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 14 19:51:40.618093 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:51:40.613181    2579 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 14 19:51:40.618093 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:51:40.613184    2579 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 14 19:51:40.618587 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:51:40.613187    2579 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 14 19:51:40.618587 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:40.613266    2579 flags.go:64] FLAG: --address="0.0.0.0"
Jul 14 19:51:40.618587 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:40.613274    2579 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jul 14 19:51:40.618587 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:40.613286    2579 flags.go:64] FLAG: --anonymous-auth="true"
Jul 14 19:51:40.618587 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:40.613290    2579 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jul 14 19:51:40.618587 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:40.613296    2579 flags.go:64] FLAG: --authentication-token-webhook="false"
Jul 14 19:51:40.618587 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:40.613299    2579 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jul 14 19:51:40.618587 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:40.613304    2579 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jul 14 19:51:40.618587 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:40.613308    2579 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jul 14 19:51:40.618587 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:40.613311    2579 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jul 14 19:51:40.618587 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:40.613314    2579 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jul 14 19:51:40.618587 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:40.613318    2579 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jul 14 19:51:40.618587 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:40.613321    2579 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jul 14 19:51:40.618587 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:40.613324    2579 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jul 14 19:51:40.618587 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:40.613327    2579 flags.go:64] FLAG: --cgroup-root=""
Jul 14 19:51:40.618587 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:40.613332    2579 flags.go:64] FLAG: --cgroups-per-qos="true"
Jul 14 19:51:40.618587 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:40.613335    2579 flags.go:64] FLAG: --client-ca-file=""
Jul 14 19:51:40.618587 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:40.613337    2579 flags.go:64] FLAG: --cloud-provider="external"
Jul 14 19:51:40.618587 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:40.613340    2579 flags.go:64] FLAG: --cluster-dns="[]"
Jul 14 19:51:40.618587 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:40.613345    2579 flags.go:64] FLAG: --cluster-domain=""
Jul 14 19:51:40.618587 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:40.613348    2579 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jul 14 19:51:40.618587 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:40.613351    2579 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jul 14 19:51:40.618587 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:40.613354    2579 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jul 14 19:51:40.618587 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:40.613357    2579 flags.go:64] FLAG: --container-log-max-files="5"
Jul 14 19:51:40.619153 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:40.613361    2579 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jul 14 19:51:40.619153 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:40.613364    2579 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jul 14 19:51:40.619153 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:40.613367    2579 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jul 14 19:51:40.619153 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:40.613371    2579 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jul 14 19:51:40.619153 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:40.613375    2579 flags.go:64] FLAG: --contention-profiling="false"
Jul 14 19:51:40.619153 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:40.613378    2579 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jul 14 19:51:40.619153 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:40.613381    2579 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jul 14 19:51:40.619153 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:40.613384    2579 flags.go:64] FLAG: --cpu-manager-policy="none"
Jul 14 19:51:40.619153 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:40.613387    2579 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jul 14 19:51:40.619153 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:40.613391    2579 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jul 14 19:51:40.619153 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:40.613394    2579 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jul 14 19:51:40.619153 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:40.613397    2579 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jul 14 19:51:40.619153 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:40.613400    2579 flags.go:64] FLAG: --enable-load-reader="false"
Jul 14 19:51:40.619153 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:40.613403    2579 flags.go:64] FLAG: --enable-server="true"
Jul 14 19:51:40.619153 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:40.613407    2579 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jul 14 19:51:40.619153 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:40.613411    2579 flags.go:64] FLAG: --event-burst="100"
Jul 14 19:51:40.619153 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:40.613414    2579 flags.go:64] FLAG: --event-qps="50"
Jul 14 19:51:40.619153 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:40.613417    2579 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jul 14 19:51:40.619153 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:40.613420    2579 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jul 14 19:51:40.619153 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:40.613422    2579 flags.go:64] FLAG: --eviction-hard=""
Jul 14 19:51:40.619153 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:40.613426    2579 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jul 14 19:51:40.619153 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:40.613429    2579 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jul 14 19:51:40.619153 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:40.613432    2579 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jul 14 19:51:40.619153 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:40.613436    2579 flags.go:64] FLAG: --eviction-soft=""
Jul 14 19:51:40.619153 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:40.613439    2579 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jul 14 19:51:40.619764 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:40.613442    2579 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jul 14 19:51:40.619764 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:40.613445    2579 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jul 14 19:51:40.619764 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:40.613448    2579 flags.go:64] FLAG: --experimental-mounter-path=""
Jul 14 19:51:40.619764 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:40.613450    2579 flags.go:64] FLAG: --fail-cgroupv1="false"
Jul 14 19:51:40.619764 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:40.613453    2579 flags.go:64] FLAG: --fail-swap-on="true"
Jul 14 19:51:40.619764 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:40.613456    2579 flags.go:64] FLAG: --feature-gates=""
Jul 14 19:51:40.619764 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:40.613460    2579 flags.go:64] FLAG: --file-check-frequency="20s"
Jul 14 19:51:40.619764 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:40.613463    2579 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jul 14 19:51:40.619764 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:40.613466    2579 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jul 14 19:51:40.619764 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:40.613469    2579 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jul 14 19:51:40.619764 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:40.613472    2579 flags.go:64] FLAG: --healthz-port="10248"
Jul 14 19:51:40.619764 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:40.613477    2579 flags.go:64] FLAG: --help="false"
Jul 14 19:51:40.619764 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:40.613480    2579 flags.go:64] FLAG: --hostname-override="ip-10-0-140-201.ec2.internal"
Jul 14 19:51:40.619764 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:40.613483    2579 flags.go:64] FLAG: --housekeeping-interval="10s"
Jul 14 19:51:40.619764 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:40.613485    2579 flags.go:64] FLAG: --http-check-frequency="20s"
Jul 14 19:51:40.619764 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:40.613488    2579 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jul 14 19:51:40.619764 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:40.613491    2579 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jul 14 19:51:40.619764 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:40.613495    2579 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jul 14 19:51:40.619764 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:40.613497    2579 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jul 14 19:51:40.619764 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:40.613500    2579 flags.go:64] FLAG: --image-service-endpoint=""
Jul 14 19:51:40.619764 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:40.613503    2579 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jul 14 19:51:40.619764 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:40.613506    2579 flags.go:64] FLAG: --kube-api-burst="100"
Jul 14 19:51:40.619764 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:40.613509    2579 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jul 14 19:51:40.620350 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:40.613512    2579 flags.go:64] FLAG: --kube-api-qps="50"
Jul 14 19:51:40.620350 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:40.613515    2579 flags.go:64] FLAG: --kube-reserved=""
Jul 14 19:51:40.620350 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:40.613517    2579 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jul 14 19:51:40.620350 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:40.613520    2579 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jul 14 19:51:40.620350 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:40.613523    2579 flags.go:64] FLAG: --kubelet-cgroups=""
Jul 14 19:51:40.620350 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:40.613526    2579 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jul 14 19:51:40.620350 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:40.613542    2579 flags.go:64] FLAG: --lock-file=""
Jul 14 19:51:40.620350 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:40.613547    2579 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jul 14 19:51:40.620350 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:40.613550    2579 flags.go:64] FLAG: --log-flush-frequency="5s"
Jul 14 19:51:40.620350 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:40.613553    2579 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jul 14 19:51:40.620350 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:40.613558    2579 flags.go:64] FLAG: --log-json-split-stream="false"
Jul 14 19:51:40.620350 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:40.613561    2579 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jul 14 19:51:40.620350 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:40.613564    2579 flags.go:64] FLAG: --log-text-split-stream="false"
Jul 14 19:51:40.620350 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:40.613566    2579 flags.go:64] FLAG: --logging-format="text"
Jul 14 19:51:40.620350 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:40.613569    2579 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jul 14 19:51:40.620350 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:40.613573    2579 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jul 14 19:51:40.620350 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:40.613576    2579 flags.go:64] FLAG: --manifest-url=""
Jul 14 19:51:40.620350 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:40.613579    2579 flags.go:64] FLAG: --manifest-url-header=""
Jul 14 19:51:40.620350 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:40.613583    2579 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jul 14 19:51:40.620350 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:40.613586    2579 flags.go:64] FLAG: --max-open-files="1000000"
Jul 14 19:51:40.620350 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:40.613592    2579 flags.go:64] FLAG: --max-pods="110"
Jul 14 19:51:40.620350 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:40.613595    2579 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jul 14 19:51:40.620350 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:40.613598    2579 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jul 14 19:51:40.620350 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:40.613601    2579 flags.go:64] FLAG: --memory-manager-policy="None"
Jul 14 19:51:40.620350 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:40.613604    2579 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jul 14 19:51:40.621030 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:40.613607    2579 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jul 14 19:51:40.621030 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:40.613610    2579 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jul 14 19:51:40.621030 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:40.613613    2579 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jul 14 19:51:40.621030 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:40.613625    2579 flags.go:64] FLAG: --node-status-max-images="50"
Jul 14 19:51:40.621030 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:40.613628    2579 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jul 14 19:51:40.621030 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:40.613631    2579 flags.go:64] FLAG: --oom-score-adj="-999"
Jul 14 19:51:40.621030 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:40.613634    2579 flags.go:64] FLAG: --pod-cidr=""
Jul 14 19:51:40.621030 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:40.613642    2579 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b04c0b1f73af4d021dd8f0b51bfeb302c24482c093de5f2c43654ab56c506926"
Jul 14 19:51:40.621030 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:40.613648    2579 flags.go:64] FLAG: --pod-manifest-path=""
Jul 14 19:51:40.621030 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:40.613651    2579 flags.go:64] FLAG: --pod-max-pids="-1"
Jul 14 19:51:40.621030 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:40.613654    2579 flags.go:64] FLAG: --pods-per-core="0"
Jul 14 19:51:40.621030 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:40.613657    2579 flags.go:64] FLAG: --port="10250"
Jul 14 19:51:40.621030 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:40.613659    2579 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jul 14 19:51:40.621030 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:40.613662    2579 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-09ded8e1d258b68da"
Jul 14 19:51:40.621030 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:40.613665    2579 flags.go:64] FLAG: --qos-reserved=""
Jul 14 19:51:40.621030 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:40.613670    2579 flags.go:64] FLAG: --read-only-port="10255"
Jul 14 19:51:40.621030 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:40.613673    2579 flags.go:64] FLAG: --register-node="true"
Jul 14 19:51:40.621030 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:40.613676    2579 flags.go:64] FLAG: --register-with-taints=""
Jul 14 19:51:40.621030 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:40.613680    2579 flags.go:64] FLAG: --registry-burst="10"
Jul 14 19:51:40.621030 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:40.613682    2579 flags.go:64] FLAG: --registry-qps="5"
Jul 14 19:51:40.621030 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:40.613685    2579 flags.go:64] FLAG: --reserved-cpus=""
Jul 14 19:51:40.621030 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:40.613688    2579 flags.go:64] FLAG: --reserved-memory=""
Jul 14 19:51:40.621030 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:40.613691    2579 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jul 14 19:51:40.621030 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:40.613694    2579 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jul 14 19:51:40.621030 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:40.613697    2579 flags.go:64] FLAG: --rotate-certificates="false"
Jul 14 19:51:40.621709 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:40.613700    2579 flags.go:64] FLAG: --rotate-server-certificates="false"
Jul 14 19:51:40.621709 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:40.613702    2579 flags.go:64] FLAG: --runonce="false"
Jul 14 19:51:40.621709 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:40.613707    2579 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jul 14 19:51:40.621709 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:40.613709    2579 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jul 14 19:51:40.621709 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:40.613712    2579 flags.go:64] FLAG: --seccomp-default="false"
Jul 14 19:51:40.621709 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:40.613715    2579 flags.go:64] FLAG: --serialize-image-pulls="true"
Jul 14 19:51:40.621709 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:40.613718    2579 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jul 14 19:51:40.621709 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:40.613721    2579 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jul 14 19:51:40.621709 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:40.613724    2579 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jul 14 19:51:40.621709 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:40.613727    2579 flags.go:64] FLAG: --storage-driver-password="root"
Jul 14 19:51:40.621709 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:40.613730    2579 flags.go:64] FLAG: --storage-driver-secure="false"
Jul 14 19:51:40.621709 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:40.613733    2579 flags.go:64] FLAG: --storage-driver-table="stats"
Jul 14 19:51:40.621709 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:40.613736    2579 flags.go:64] FLAG: --storage-driver-user="root"
Jul 14 19:51:40.621709 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:40.613739    2579 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jul 14 19:51:40.621709 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:40.613742    2579 flags.go:64] FLAG: --sync-frequency="1m0s"
Jul 14 19:51:40.621709 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:40.613751    2579 flags.go:64] FLAG: --system-cgroups=""
Jul 14 19:51:40.621709 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:40.613754    2579 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jul 14 19:51:40.621709 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:40.613759    2579 flags.go:64] FLAG: --system-reserved-cgroup=""
Jul 14 19:51:40.621709 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:40.613761    2579 flags.go:64] FLAG: --tls-cert-file=""
Jul 14 19:51:40.621709 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:40.613764    2579 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jul 14 19:51:40.621709 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:40.613768    2579 flags.go:64] FLAG: --tls-min-version=""
Jul 14 19:51:40.621709 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:40.613771    2579 flags.go:64] FLAG: --tls-private-key-file=""
Jul 14 19:51:40.621709 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:40.613775    2579 flags.go:64] FLAG: --topology-manager-policy="none"
Jul 14 19:51:40.621709 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:40.613777    2579 flags.go:64] FLAG: --topology-manager-policy-options=""
Jul 14 19:51:40.621709 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:40.613780    2579 flags.go:64] FLAG: --topology-manager-scope="container"
Jul 14 19:51:40.622320 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:40.613783    2579 flags.go:64] FLAG: --v="2"
Jul 14 19:51:40.622320 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:40.613787    2579 flags.go:64] FLAG: --version="false"
Jul 14 19:51:40.622320 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:40.613791    2579 flags.go:64] FLAG: --vmodule=""
Jul 14 19:51:40.622320 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:40.613795    2579 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jul 14 19:51:40.622320 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:40.613798    2579 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jul 14 19:51:40.622320 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:51:40.613935    2579 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 14 19:51:40.622320 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:51:40.613940    2579 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 14 19:51:40.622320 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:51:40.613942    2579 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 14 19:51:40.622320 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:51:40.613945    2579 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 14 19:51:40.622320 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:51:40.613950    2579 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 14 19:51:40.622320 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:51:40.613953    2579 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 14 19:51:40.622320 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:51:40.613955    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 14 19:51:40.622320 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:51:40.613958    2579 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 14 19:51:40.622320 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:51:40.613961    2579 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 14 19:51:40.622320 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:51:40.613963    2579 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 14 19:51:40.622320 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:51:40.613965    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 14 19:51:40.622320 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:51:40.613968    2579 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 14 19:51:40.622320 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:51:40.613970    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 14 19:51:40.622320 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:51:40.613973    2579 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 14 19:51:40.622320 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:51:40.613975    2579 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 14 19:51:40.622320 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:51:40.613978    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 14 19:51:40.622842 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:51:40.613980    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 14 19:51:40.622842 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:51:40.613983    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 14 19:51:40.622842 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:51:40.613985    2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 14 19:51:40.622842 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:51:40.613988    2579 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 14 19:51:40.622842 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:51:40.613990    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 14 19:51:40.622842 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:51:40.613993    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 14 19:51:40.622842 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:51:40.613995    2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 14 19:51:40.622842 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:51:40.613997    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 14 19:51:40.622842 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:51:40.614001    2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 14 19:51:40.622842 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:51:40.614004    2579 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 14 19:51:40.622842 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:51:40.614007    2579 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 14 19:51:40.622842 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:51:40.614009    2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 14 19:51:40.622842 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:51:40.614012    2579 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 14 19:51:40.622842 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:51:40.614014    2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 14 19:51:40.622842 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:51:40.614017    2579 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 14 19:51:40.622842 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:51:40.614019    2579 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 14 19:51:40.622842 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:51:40.614022    2579 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 14 19:51:40.622842 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:51:40.614025    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 14 19:51:40.622842 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:51:40.614027    2579 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 14 19:51:40.622842 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:51:40.614029    2579 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 14 19:51:40.623326 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:51:40.614033    2579 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 14 19:51:40.623326 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:51:40.614035    2579 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 14 19:51:40.623326 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:51:40.614038    2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 14 19:51:40.623326 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:51:40.614040    2579 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 14 19:51:40.623326 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:51:40.614042    2579 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 14 19:51:40.623326 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:51:40.614045    2579 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 14 19:51:40.623326 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:51:40.614048    2579 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 14 19:51:40.623326 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:51:40.614052    2579 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 14 19:51:40.623326 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:51:40.614055    2579 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 14 19:51:40.623326 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:51:40.614058    2579 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 14 19:51:40.623326 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:51:40.614060    2579 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 14 19:51:40.623326 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:51:40.614063    2579 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 14 19:51:40.623326 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:51:40.614066    2579 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 14 19:51:40.623326 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:51:40.614069    2579 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 14 19:51:40.623326 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:51:40.614073    2579 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 14 19:51:40.623326 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:51:40.614077    2579 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 14 19:51:40.623326 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:51:40.614080    2579 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 14 19:51:40.623326 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:51:40.614084    2579 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 14 19:51:40.623326 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:51:40.614087    2579 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 14 19:51:40.623852 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:51:40.614090    2579 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 14 19:51:40.623852 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:51:40.614095    2579 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 14 19:51:40.623852 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:51:40.614098    2579 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 14 19:51:40.623852 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:51:40.614100    2579 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 14 19:51:40.623852 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:51:40.614103    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 14 19:51:40.623852 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:51:40.614106    2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 14 19:51:40.623852 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:51:40.614108    2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 14 19:51:40.623852 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:51:40.614111    2579 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 14 19:51:40.623852 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:51:40.614114    2579 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 14 19:51:40.623852 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:51:40.614116    2579 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 14 19:51:40.623852 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:51:40.614119    2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 14 19:51:40.623852 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:51:40.614121    2579 feature_gate.go:328] unrecognized feature gate: Example2
Jul 14 19:51:40.623852 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:51:40.614125    2579 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 14 19:51:40.623852 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:51:40.614128    2579 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 14 19:51:40.623852 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:51:40.614131    2579 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 14 19:51:40.623852 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:51:40.614133    2579 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 14 19:51:40.623852 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:51:40.614136    2579 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 14 19:51:40.623852 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:51:40.614138    2579 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 14 19:51:40.623852 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:51:40.614141    2579 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 14 19:51:40.624325 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:51:40.614143    2579 feature_gate.go:328] unrecognized feature gate: Example
Jul 14 19:51:40.624325 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:51:40.614146    2579 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 14 19:51:40.624325 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:51:40.614148    2579 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 14 19:51:40.624325 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:51:40.614150    2579 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 14 19:51:40.624325 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:51:40.614152    2579 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 14 19:51:40.624325 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:51:40.614155    2579 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 14 19:51:40.624325 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:51:40.614157    2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 14 19:51:40.624325 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:51:40.614160    2579 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 14 19:51:40.624325 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:51:40.614162    2579 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 14 19:51:40.624325 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:51:40.614165    2579 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 14 19:51:40.624325 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:51:40.614167    2579 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 14 19:51:40.624325 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:51:40.614170    2579 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 14 19:51:40.624325 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:51:40.614173    2579 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 14 19:51:40.624325 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:51:40.614175    2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 14 19:51:40.624325 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:51:40.614179    2579 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 14 19:51:40.624325 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:51:40.614181    2579 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 14 19:51:40.624325 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:51:40.614184    2579 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 14 19:51:40.624325 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:51:40.614186    2579 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 14 19:51:40.624325 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:51:40.614189    2579 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 14 19:51:40.624325 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:51:40.614191    2579 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 14 19:51:40.624820 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:51:40.614194    2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 14 19:51:40.624820 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:51:40.614197    2579 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 14 19:51:40.624820 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:51:40.614199    2579 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 14 19:51:40.624820 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:51:40.614202    2579 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 14 19:51:40.624820 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:51:40.614204    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 14 19:51:40.624820 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:40.614882    2579 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 14 19:51:40.624820 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:40.622582    2579 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Jul 14 19:51:40.624820 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:40.622601    2579 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jul 14 19:51:40.624820 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:40.623442    2579 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jul 14 19:51:40.624820 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:40.623450    2579 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jul 14 19:51:40.624820 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:51:40.623513    2579 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 14 19:51:40.624820 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:51:40.623519    2579 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 14 19:51:40.624820 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:51:40.623522    2579 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 14 19:51:40.624820 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:51:40.623525    2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 14 19:51:40.624820 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:51:40.623545    2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 14 19:51:40.625191 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:51:40.623549    2579 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 14 19:51:40.625191 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:51:40.623554    2579 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 14 19:51:40.625191 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:51:40.623559    2579 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 14 19:51:40.625191 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:51:40.623562    2579 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 14 19:51:40.625191 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:51:40.623564    2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 14 19:51:40.625191 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:51:40.623567    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 14 19:51:40.625191 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:51:40.623570    2579 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 14 19:51:40.625191 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:51:40.623574    2579 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 14 19:51:40.625191 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:51:40.623577    2579 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 14 19:51:40.625191 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:51:40.623579    2579 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 14 19:51:40.625191 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:51:40.623583    2579 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 14 19:51:40.625191 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:51:40.623589    2579 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 14 19:51:40.625191 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:51:40.623592    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 14 19:51:40.625191 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:51:40.623595    2579 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 14 19:51:40.625191 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:51:40.623598    2579 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 14 19:51:40.625191 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:51:40.623601    2579 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 14 19:51:40.625191 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:51:40.623603    2579 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 14 19:51:40.625191 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:51:40.623623    2579 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 14 19:51:40.625191 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:51:40.623627    2579 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 14 19:51:40.625651 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:51:40.623630    2579 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 14 19:51:40.625651 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:51:40.623633    2579 feature_gate.go:328] unrecognized feature gate: Example2
Jul 14 19:51:40.625651 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:51:40.623636    2579 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 14 19:51:40.625651 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:51:40.623638    2579 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 14 19:51:40.625651 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:51:40.623642    2579 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 14 19:51:40.625651 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:51:40.623645    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 14 19:51:40.625651 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:51:40.623649    2579 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 14 19:51:40.625651 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:51:40.623653    2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 14 19:51:40.625651 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:51:40.623656    2579 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 14 19:51:40.625651 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:51:40.623659    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 14 19:51:40.625651 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:51:40.623662    2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 14 19:51:40.625651 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:51:40.623665    2579 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 14 19:51:40.625651 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:51:40.623668    2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 14 19:51:40.625651 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:51:40.623671    2579 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 14 19:51:40.625651 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:51:40.623674    2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 14 19:51:40.625651 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:51:40.623676    2579 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 14 19:51:40.625651 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:51:40.623679    2579 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 14 19:51:40.625651 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:51:40.623682    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 14 19:51:40.625651 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:51:40.623684    2579 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 14 19:51:40.626113 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:51:40.623687    2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 14 19:51:40.626113 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:51:40.623690    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 14 19:51:40.626113 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:51:40.623693    2579 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 14 19:51:40.626113 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:51:40.623695    2579 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 14 19:51:40.626113 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:51:40.623697    2579 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 14 19:51:40.626113 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:51:40.623700    2579 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 14 19:51:40.626113 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:51:40.623702    2579 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 14 19:51:40.626113 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:51:40.623704    2579 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 14 19:51:40.626113 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:51:40.623707    2579 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 14 19:51:40.626113 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:51:40.623709    2579 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 14 19:51:40.626113 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:51:40.623712    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 14 19:51:40.626113 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:51:40.623714    2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 14 19:51:40.626113 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:51:40.623717    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 14 19:51:40.626113 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:51:40.623719    2579 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 14 19:51:40.626113 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:51:40.623722    2579 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 14 19:51:40.626113 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:51:40.623724    2579 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 14 19:51:40.626113 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:51:40.623727    2579 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 14 19:51:40.626113 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:51:40.623729    2579 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 14 19:51:40.626113 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:51:40.623733    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 14 19:51:40.626113 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:51:40.623735    2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 14 19:51:40.626603 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:51:40.623738    2579 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 14 19:51:40.626603 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:51:40.623740    2579 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 14 19:51:40.626603 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:51:40.623743    2579 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 14 19:51:40.626603 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:51:40.623745    2579 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 14 19:51:40.626603 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:51:40.623748    2579 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 14 19:51:40.626603 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:51:40.623750    2579 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 14 19:51:40.626603 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:51:40.623752    2579 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 14 19:51:40.626603 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:51:40.623755    2579 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 14 19:51:40.626603 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:51:40.623757    2579 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 14 19:51:40.626603 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:51:40.623760    2579 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 14 19:51:40.626603 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:51:40.623763    2579 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 14 19:51:40.626603 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:51:40.623766    2579 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 14 19:51:40.626603 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:51:40.623768    2579 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 14 19:51:40.626603 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:51:40.623771    2579 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 14 19:51:40.626603 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:51:40.623773    2579 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 14 19:51:40.626603 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:51:40.623776    2579 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 14 19:51:40.626603 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:51:40.623778    2579 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 14 19:51:40.626603 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:51:40.623781    2579 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 14 19:51:40.626603 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:51:40.623783    2579 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 14 19:51:40.626603 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:51:40.623786    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 14 19:51:40.627118 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:51:40.623788    2579 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 14 19:51:40.627118 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:51:40.623790    2579 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 14 19:51:40.627118 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:51:40.623793    2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 14 19:51:40.627118 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:51:40.623796    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 14 19:51:40.627118 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:51:40.623798    2579 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 14 19:51:40.627118 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:51:40.623800    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 14 19:51:40.627118 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:51:40.623803    2579 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 14 19:51:40.627118 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:51:40.623805    2579 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 14 19:51:40.627118 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:51:40.623807    2579 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 14 19:51:40.627118 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:51:40.623810    2579 feature_gate.go:328] unrecognized feature gate: Example
Jul 14 19:51:40.627118 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:51:40.623813    2579 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 14 19:51:40.627118 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:51:40.623816    2579 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 14 19:51:40.627118 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:51:40.623820    2579 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 14 19:51:40.627118 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:51:40.623824    2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 14 19:51:40.627118 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:51:40.623827    2579 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 14 19:51:40.627118 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:51:40.623829    2579 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 14 19:51:40.627548 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:40.623835    2579 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 14 19:51:40.627548 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:51:40.623963    2579 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 14 19:51:40.627548 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:51:40.623969    2579 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 14 19:51:40.627548 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:51:40.623974    2579 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 14 19:51:40.627548 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:51:40.623977    2579 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 14 19:51:40.627548 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:51:40.623979    2579 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 14 19:51:40.627548 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:51:40.623982    2579 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 14 19:51:40.627548 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:51:40.623985    2579 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 14 19:51:40.627548 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:51:40.623988    2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 14 19:51:40.627548 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:51:40.623991    2579 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 14 19:51:40.627548 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:51:40.623993    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 14 19:51:40.627548 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:51:40.623996    2579 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 14 19:51:40.627548 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:51:40.623999    2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 14 19:51:40.627548 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:51:40.624001    2579 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 14 19:51:40.627915 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:51:40.624004    2579 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 14 19:51:40.627915 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:51:40.624006    2579 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 14 19:51:40.627915 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:51:40.624009    2579 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 14 19:51:40.627915 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:51:40.624011    2579 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 14 19:51:40.627915 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:51:40.624014    2579 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 14 19:51:40.627915 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:51:40.624016    2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 14 19:51:40.627915 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:51:40.624019    2579 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 14 19:51:40.627915 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:51:40.624021    2579 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 14 19:51:40.627915 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:51:40.624024    2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 14 19:51:40.627915 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:51:40.624026    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 14 19:51:40.627915 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:51:40.624029    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 14 19:51:40.627915 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:51:40.624032    2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 14 19:51:40.627915 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:51:40.624034    2579 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 14 19:51:40.627915 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:51:40.624037    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 14 19:51:40.627915 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:51:40.624040    2579 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 14 19:51:40.627915 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:51:40.624042    2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 14 19:51:40.627915 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:51:40.624045    2579 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 14 19:51:40.627915 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:51:40.624048    2579 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 14 19:51:40.627915 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:51:40.624050    2579 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 14 19:51:40.627915 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:51:40.624052    2579 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 14 19:51:40.628391 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:51:40.624055    2579 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 14 19:51:40.628391 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:51:40.624057    2579 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 14 19:51:40.628391 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:51:40.624060    2579 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 14 19:51:40.628391 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:51:40.624062    2579 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 14 19:51:40.628391 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:51:40.624065    2579 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 14 19:51:40.628391 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:51:40.624067    2579 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 14 19:51:40.628391 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:51:40.624069    2579 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 14 19:51:40.628391 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:51:40.624072    2579 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 14 19:51:40.628391 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:51:40.624075    2579 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 14 19:51:40.628391 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:51:40.624078    2579 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 14 19:51:40.628391 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:51:40.624081    2579 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 14 19:51:40.628391 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:51:40.624085    2579 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 14 19:51:40.628391 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:51:40.624088    2579 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 14 19:51:40.628391 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:51:40.624090    2579 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 14 19:51:40.628391 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:51:40.624093    2579 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 14 19:51:40.628391 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:51:40.624096    2579 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 14 19:51:40.628391 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:51:40.624098    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 14 19:51:40.628391 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:51:40.624101    2579 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 14 19:51:40.628391 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:51:40.624103    2579 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 14 19:51:40.628391 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:51:40.624106    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 14 19:51:40.629027 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:51:40.624108    2579 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 14 19:51:40.629027 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:51:40.624110    2579 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 14 19:51:40.629027 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:51:40.624113    2579 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 14 19:51:40.629027 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:51:40.624116    2579 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 14 19:51:40.629027 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:51:40.624118    2579 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 14 19:51:40.629027 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:51:40.624122    2579 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 14 19:51:40.629027 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:51:40.624126    2579 feature_gate.go:328] unrecognized feature gate: Example2
Jul 14 19:51:40.629027 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:51:40.624128    2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 14 19:51:40.629027 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:51:40.624131    2579 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 14 19:51:40.629027 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:51:40.624133    2579 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 14 19:51:40.629027 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:51:40.624136    2579 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 14 19:51:40.629027 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:51:40.624138    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 14 19:51:40.629027 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:51:40.624141    2579 feature_gate.go:328] unrecognized feature gate: Example
Jul 14 19:51:40.629027 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:51:40.624143    2579 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 14 19:51:40.629027 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:51:40.624146    2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 14 19:51:40.629027 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:51:40.624148    2579 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 14 19:51:40.629027 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:51:40.624150    2579 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 14 19:51:40.629027 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:51:40.624153    2579 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 14 19:51:40.629027 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:51:40.624155    2579 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 14 19:51:40.629027 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:51:40.624158    2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 14 19:51:40.629502 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:51:40.624160    2579 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 14 19:51:40.629502 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:51:40.624163    2579 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 14 19:51:40.629502 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:51:40.624165    2579 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 14 19:51:40.629502 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:51:40.624168    2579 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 14 19:51:40.629502 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:51:40.624170    2579 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 14 19:51:40.629502 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:51:40.624173    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 14 19:51:40.629502 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:51:40.624175    2579 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 14 19:51:40.629502 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:51:40.624178    2579 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 14 19:51:40.629502 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:51:40.624180    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 14 19:51:40.629502 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:51:40.624182    2579 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 14 19:51:40.629502 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:51:40.624185    2579 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 14 19:51:40.629502 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:51:40.624187    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 14 19:51:40.629502 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:51:40.624190    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 14 19:51:40.629502 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:51:40.624192    2579 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 14 19:51:40.629502 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:51:40.624195    2579 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 14 19:51:40.629502 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:51:40.624197    2579 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 14 19:51:40.629502 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:51:40.624200    2579 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 14 19:51:40.629502 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:51:40.624203    2579 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 14 19:51:40.629502 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:51:40.624206    2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 14 19:51:40.629502 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:51:40.624208    2579 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 14 19:51:40.630009 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:51:40.624211    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 14 19:51:40.630009 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:51:40.624213    2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 14 19:51:40.630009 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:51:40.624216    2579 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 14 19:51:40.630009 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:51:40.624218    2579 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 14 19:51:40.630009 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:51:40.624221    2579 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 14 19:51:40.630009 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:51:40.624223    2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 14 19:51:40.630009 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:40.624228    2579 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 14 19:51:40.630009 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:40.624365    2579 server.go:962] "Client rotation is on, will bootstrap in background"
Jul 14 19:51:40.630009 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:40.627006    2579 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jul 14 19:51:40.630009 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:40.629356    2579 server.go:1019] "Starting client certificate rotation"
Jul 14 19:51:40.630009 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:40.629466    2579 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 14 19:51:40.630009 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:40.629502    2579 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 14 19:51:40.632131 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:40.632115    2579 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 14 19:51:40.637495 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:40.637466    2579 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 14 19:51:40.647739 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:40.647717    2579 log.go:25] "Validated CRI v1 runtime API"
Jul 14 19:51:40.650170 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:40.650154    2579 log.go:25] "Validated CRI v1 image API"
Jul 14 19:51:40.651842 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:40.651825    2579 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jul 14 19:51:40.654601 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:40.654578    2579 fs.go:135] Filesystem UUIDs: map[0c14fcae-527c-42b6-aab2-3631abaaaf74:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 7aafd3df-e9ec-4166-8ce2-97238c5fb7e3:/dev/nvme0n1p4]
Jul 14 19:51:40.654711 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:40.654598    2579 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jul 14 19:51:40.658616 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:40.658593    2579 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 14 19:51:40.660062 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:40.659952    2579 manager.go:216] Machine: {Timestamp:2026-07-14 19:51:40.658504163 +0000 UTC m=+0.370099698 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3101666 MemoryCapacity:32812175360 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2868e5110df674f155e9af8833c725 SystemUUID:ec2868e5-110d-f674-f155-e9af8833c725 BootID:dfed7561-0cdf-4cb7-88fe-aefcfca5daeb Filesystems:[{Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406089728 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406085632 Type:vfs Inodes:4005392 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562435072 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:ac:d6:e1:e5:1f Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:ac:d6:e1:e5:1f Speed:0 Mtu:9001} {Name:ovs-system MacAddress:4a:c7:27:c1:a4:65 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812175360 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jul 14 19:51:40.660062 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:40.660061    2579 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jul 14 19:51:40.660213 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:40.660201    2579 manager.go:232] Version: {KernelVersion:5.14.0-570.126.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260702-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jul 14 19:51:40.664076 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:40.664040    2579 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jul 14 19:51:40.664227 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:40.664079    2579 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-140-201.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jul 14 19:51:40.664913 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:40.664902    2579 topology_manager.go:138] "Creating topology manager with none policy"
Jul 14 19:51:40.664946 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:40.664916    2579 container_manager_linux.go:309] "Creating device plugin manager"
Jul 14 19:51:40.664946 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:40.664924    2579 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 14 19:51:40.664946 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:40.664938    2579 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 14 19:51:40.666823 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:40.666810    2579 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jul 14 19:51:40.671576 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:40.671562    2579 state_mem.go:36] "Initialized new in-memory state store"
Jul 14 19:51:40.671699 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:40.671689    2579 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jul 14 19:51:40.671742 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:40.671722    2579 kubelet.go:486] "Attempting to sync node with API server"
Jul 14 19:51:40.671742 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:40.671740    2579 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jul 14 19:51:40.671823 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:40.671759    2579 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jul 14 19:51:40.671823 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:40.671772    2579 kubelet.go:398] "Adding apiserver pod source"
Jul 14 19:51:40.671823 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:40.671783    2579 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jul 14 19:51:40.672202 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:40.672190    2579 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 14 19:51:40.672238 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:40.672209    2579 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 14 19:51:40.674643 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:40.674621    2579 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1"
Jul 14 19:51:40.677188 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:40.677173    2579 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jul 14 19:51:40.677259 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:40.677204    2579 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jul 14 19:51:40.677374 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:40.677364    2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jul 14 19:51:40.677409 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:40.677379    2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jul 14 19:51:40.677409 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:40.677386    2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jul 14 19:51:40.677409 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:40.677392    2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jul 14 19:51:40.677409 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:40.677400    2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jul 14 19:51:40.677409 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:40.677406    2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jul 14 19:51:40.678003 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:40.677991    2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jul 14 19:51:40.678003 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:40.678004    2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jul 14 19:51:40.678074 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:40.678012    2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jul 14 19:51:40.678074 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:40.678018    2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jul 14 19:51:40.678074 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:40.678028    2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jul 14 19:51:40.678074 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:40.678036    2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jul 14 19:51:40.679684 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:40.679664    2579 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-gw6p7"
Jul 14 19:51:40.679815 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:40.679799    2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jul 14 19:51:40.679815 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:40.679815    2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jul 14 19:51:40.684073 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:40.684020    2579 server.go:1268] "Started kubelet"
Jul 14 19:51:40.686105 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:40.684679    2579 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jul 14 19:51:40.686105 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:40.685104    2579 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jul 14 19:51:40.686105 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:40.685175    2579 server_v1.go:49] "podresources" method="list" useActivePods=true
Jul 14 19:51:40.686105 ip-10-0-140-201 kubenswrapper[2579]: E0714 19:51:40.685852    2579 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-140-201.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 14 19:51:40.686105 ip-10-0-140-201 kubenswrapper[2579]: E0714 19:51:40.685959    2579 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 14 19:51:40.686105 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:40.686018    2579 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-140-201.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 14 19:51:40.685091 ip-10-0-140-201 systemd[1]: Started Kubernetes Kubelet.
Jul 14 19:51:40.686960 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:40.686911    2579 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jul 14 19:51:40.687741 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:40.687726    2579 server.go:310] "Adding debug handlers to kubelet server"
Jul 14 19:51:40.691802 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:40.691780    2579 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-gw6p7"
Jul 14 19:51:40.692421 ip-10-0-140-201 kubenswrapper[2579]: E0714 19:51:40.692401    2579 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jul 14 19:51:40.693947 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:40.693930    2579 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jul 14 19:51:40.694020 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:40.693945    2579 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jul 14 19:51:40.694070 ip-10-0-140-201 kubenswrapper[2579]: E0714 19:51:40.694055    2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-201.ec2.internal\" not found"
Jul 14 19:51:40.694705 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:40.694691    2579 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jul 14 19:51:40.694776 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:40.694693    2579 volume_manager.go:311] "The desired_state_of_world populator starts"
Jul 14 19:51:40.694776 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:40.694720    2579 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jul 14 19:51:40.694871 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:40.694859    2579 reconstruct.go:97] "Volume reconstruction finished"
Jul 14 19:51:40.694969 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:40.694958    2579 reconciler.go:29] "Reconciler: start to sync state"
Jul 14 19:51:40.695035 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:40.694918    2579 factory.go:55] Registering systemd factory
Jul 14 19:51:40.695035 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:40.694985    2579 factory.go:223] Registration of the systemd container factory successfully
Jul 14 19:51:40.695231 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:40.695218    2579 factory.go:153] Registering CRI-O factory
Jul 14 19:51:40.695282 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:40.695234    2579 factory.go:223] Registration of the crio container factory successfully
Jul 14 19:51:40.695282 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:40.695277    2579 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jul 14 19:51:40.695346 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:40.695303    2579 factory.go:103] Registering Raw factory
Jul 14 19:51:40.695346 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:40.695318    2579 manager.go:1196] Started watching for new ooms in manager
Jul 14 19:51:40.695655 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:40.695644    2579 manager.go:349] Starting recovery of all containers
Jul 14 19:51:40.695737 ip-10-0-140-201 kubenswrapper[2579]: E0714 19:51:40.694601    2579 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-140-201.ec2.internal.18c23fef98b2661a  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-140-201.ec2.internal,UID:ip-10-0-140-201.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-140-201.ec2.internal,},FirstTimestamp:2026-07-14 19:51:40.683699738 +0000 UTC m=+0.395295276,LastTimestamp:2026-07-14 19:51:40.683699738 +0000 UTC m=+0.395295276,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-140-201.ec2.internal,}"
Jul 14 19:51:40.705265 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:40.705233    2579 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 14 19:51:40.705453 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:40.705354    2579 manager.go:354] Recovery completed
Jul 14 19:51:40.709740 ip-10-0-140-201 kubenswrapper[2579]: E0714 19:51:40.709714    2579 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-140-201.ec2.internal\" not found" node="ip-10-0-140-201.ec2.internal"
Jul 14 19:51:40.710502 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:40.710485    2579 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 14 19:51:40.712503 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:40.712483    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-201.ec2.internal" event="NodeHasSufficientMemory"
Jul 14 19:51:40.712613 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:40.712517    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-201.ec2.internal" event="NodeHasNoDiskPressure"
Jul 14 19:51:40.712613 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:40.712549    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-201.ec2.internal" event="NodeHasSufficientPID"
Jul 14 19:51:40.713171 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:40.713157    2579 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jul 14 19:51:40.713171 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:40.713171    2579 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jul 14 19:51:40.713267 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:40.713188    2579 state_mem.go:36] "Initialized new in-memory state store"
Jul 14 19:51:40.713267 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:40.713196    2579 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 14 19:51:40.715475 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:40.714167    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-201.ec2.internal" event="NodeHasSufficientMemory"
Jul 14 19:51:40.715475 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:40.714193    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-201.ec2.internal" event="NodeHasNoDiskPressure"
Jul 14 19:51:40.715475 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:40.714220    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-201.ec2.internal" event="NodeHasSufficientPID"
Jul 14 19:51:40.715813 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:40.715801    2579 policy_none.go:49] "None policy: Start"
Jul 14 19:51:40.715850 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:40.715819    2579 memory_manager.go:187] "Starting memorymanager" policy="None"
Jul 14 19:51:40.715850 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:40.715830    2579 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jul 14 19:51:40.717830 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:40.717817    2579 policy_none.go:47] "Start"
Jul 14 19:51:40.767615 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:40.767350    2579 manager.go:337] "Starting Device Plugin manager"
Jul 14 19:51:40.784498 ip-10-0-140-201 kubenswrapper[2579]: E0714 19:51:40.767645    2579 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jul 14 19:51:40.784498 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:40.767661    2579 server.go:87] "Starting device plugin registration server"
Jul 14 19:51:40.784498 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:40.767938    2579 eviction_manager.go:189] "Eviction manager: starting control loop"
Jul 14 19:51:40.784498 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:40.767950    2579 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jul 14 19:51:40.784498 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:40.768046    2579 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jul 14 19:51:40.784498 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:40.768140    2579 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jul 14 19:51:40.784498 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:40.768150    2579 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jul 14 19:51:40.784498 ip-10-0-140-201 kubenswrapper[2579]: E0714 19:51:40.768743    2579 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jul 14 19:51:40.784498 ip-10-0-140-201 kubenswrapper[2579]: E0714 19:51:40.768789    2579 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-140-201.ec2.internal\" not found"
Jul 14 19:51:40.839566 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:40.839516    2579 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jul 14 19:51:40.840963 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:40.840941    2579 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jul 14 19:51:40.841035 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:40.840990    2579 status_manager.go:244] "Starting to sync pod status with apiserver"
Jul 14 19:51:40.841035 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:40.841019    2579 kubelet.go:2448] "Starting kubelet main sync loop"
Jul 14 19:51:40.841123 ip-10-0-140-201 kubenswrapper[2579]: E0714 19:51:40.841061    2579 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jul 14 19:51:40.843146 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:40.843125    2579 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 14 19:51:40.868285 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:40.868199    2579 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 14 19:51:40.869600 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:40.869572    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-201.ec2.internal" event="NodeHasSufficientMemory"
Jul 14 19:51:40.869712 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:40.869607    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-201.ec2.internal" event="NodeHasNoDiskPressure"
Jul 14 19:51:40.869712 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:40.869620    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-201.ec2.internal" event="NodeHasSufficientPID"
Jul 14 19:51:40.869712 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:40.869643    2579 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-140-201.ec2.internal"
Jul 14 19:51:40.878055 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:40.878028    2579 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-140-201.ec2.internal"
Jul 14 19:51:40.878144 ip-10-0-140-201 kubenswrapper[2579]: E0714 19:51:40.878063    2579 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-140-201.ec2.internal\": node \"ip-10-0-140-201.ec2.internal\" not found"
Jul 14 19:51:40.888739 ip-10-0-140-201 kubenswrapper[2579]: E0714 19:51:40.888711    2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-201.ec2.internal\" not found"
Jul 14 19:51:40.941590 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:40.941555    2579 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-201.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-140-201.ec2.internal"]
Jul 14 19:51:40.941709 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:40.941636    2579 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 14 19:51:40.943900 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:40.943881    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-201.ec2.internal" event="NodeHasSufficientMemory"
Jul 14 19:51:40.943992 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:40.943916    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-201.ec2.internal" event="NodeHasNoDiskPressure"
Jul 14 19:51:40.943992 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:40.943926    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-201.ec2.internal" event="NodeHasSufficientPID"
Jul 14 19:51:40.946266 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:40.946253    2579 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 14 19:51:40.946384 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:40.946372    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-201.ec2.internal"
Jul 14 19:51:40.946418 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:40.946406    2579 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 14 19:51:40.947138 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:40.947124    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-201.ec2.internal" event="NodeHasSufficientMemory"
Jul 14 19:51:40.947197 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:40.947155    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-201.ec2.internal" event="NodeHasNoDiskPressure"
Jul 14 19:51:40.947197 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:40.947166    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-201.ec2.internal" event="NodeHasSufficientPID"
Jul 14 19:51:40.947260 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:40.947124    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-201.ec2.internal" event="NodeHasSufficientMemory"
Jul 14 19:51:40.947260 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:40.947224    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-201.ec2.internal" event="NodeHasNoDiskPressure"
Jul 14 19:51:40.947260 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:40.947235    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-201.ec2.internal" event="NodeHasSufficientPID"
Jul 14 19:51:40.949449 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:40.949432    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-201.ec2.internal"
Jul 14 19:51:40.949574 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:40.949458    2579 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 14 19:51:40.950295 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:40.950279    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-201.ec2.internal" event="NodeHasSufficientMemory"
Jul 14 19:51:40.950420 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:40.950310    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-201.ec2.internal" event="NodeHasNoDiskPressure"
Jul 14 19:51:40.950420 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:40.950324    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-201.ec2.internal" event="NodeHasSufficientPID"
Jul 14 19:51:40.978495 ip-10-0-140-201 kubenswrapper[2579]: E0714 19:51:40.978470    2579 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-140-201.ec2.internal\" not found" node="ip-10-0-140-201.ec2.internal"
Jul 14 19:51:40.983258 ip-10-0-140-201 kubenswrapper[2579]: E0714 19:51:40.983237    2579 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-140-201.ec2.internal\" not found" node="ip-10-0-140-201.ec2.internal"
Jul 14 19:51:40.989301 ip-10-0-140-201 kubenswrapper[2579]: E0714 19:51:40.989276    2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-201.ec2.internal\" not found"
Jul 14 19:51:40.996507 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:40.996478    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/cad5cdd785a831695970fe0c85e16af0-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-140-201.ec2.internal\" (UID: \"cad5cdd785a831695970fe0c85e16af0\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-201.ec2.internal"
Jul 14 19:51:40.996632 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:40.996514    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/cad5cdd785a831695970fe0c85e16af0-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-140-201.ec2.internal\" (UID: \"cad5cdd785a831695970fe0c85e16af0\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-201.ec2.internal"
Jul 14 19:51:40.996632 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:40.996553    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/f7485cdaac307b25b08583eb8c5cef91-config\") pod \"kube-apiserver-proxy-ip-10-0-140-201.ec2.internal\" (UID: \"f7485cdaac307b25b08583eb8c5cef91\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-140-201.ec2.internal"
Jul 14 19:51:41.090242 ip-10-0-140-201 kubenswrapper[2579]: E0714 19:51:41.090200    2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-201.ec2.internal\" not found"
Jul 14 19:51:41.097656 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:41.097627    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/cad5cdd785a831695970fe0c85e16af0-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-140-201.ec2.internal\" (UID: \"cad5cdd785a831695970fe0c85e16af0\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-201.ec2.internal"
Jul 14 19:51:41.097706 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:41.097679    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/cad5cdd785a831695970fe0c85e16af0-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-140-201.ec2.internal\" (UID: \"cad5cdd785a831695970fe0c85e16af0\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-201.ec2.internal"
Jul 14 19:51:41.097706 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:41.097699    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/f7485cdaac307b25b08583eb8c5cef91-config\") pod \"kube-apiserver-proxy-ip-10-0-140-201.ec2.internal\" (UID: \"f7485cdaac307b25b08583eb8c5cef91\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-140-201.ec2.internal"
Jul 14 19:51:41.097807 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:41.097740    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/f7485cdaac307b25b08583eb8c5cef91-config\") pod \"kube-apiserver-proxy-ip-10-0-140-201.ec2.internal\" (UID: \"f7485cdaac307b25b08583eb8c5cef91\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-140-201.ec2.internal"
Jul 14 19:51:41.097807 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:41.097754    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/cad5cdd785a831695970fe0c85e16af0-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-140-201.ec2.internal\" (UID: \"cad5cdd785a831695970fe0c85e16af0\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-201.ec2.internal"
Jul 14 19:51:41.097807 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:41.097761    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/cad5cdd785a831695970fe0c85e16af0-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-140-201.ec2.internal\" (UID: \"cad5cdd785a831695970fe0c85e16af0\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-201.ec2.internal"
Jul 14 19:51:41.191168 ip-10-0-140-201 kubenswrapper[2579]: E0714 19:51:41.191093    2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-201.ec2.internal\" not found"
Jul 14 19:51:41.280689 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:41.280663    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-201.ec2.internal"
Jul 14 19:51:41.286916 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:41.286890    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-201.ec2.internal"
Jul 14 19:51:41.292165 ip-10-0-140-201 kubenswrapper[2579]: E0714 19:51:41.292142    2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-201.ec2.internal\" not found"
Jul 14 19:51:41.392767 ip-10-0-140-201 kubenswrapper[2579]: E0714 19:51:41.392716    2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-201.ec2.internal\" not found"
Jul 14 19:51:41.493313 ip-10-0-140-201 kubenswrapper[2579]: E0714 19:51:41.493232    2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-201.ec2.internal\" not found"
Jul 14 19:51:41.593746 ip-10-0-140-201 kubenswrapper[2579]: E0714 19:51:41.593721    2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-201.ec2.internal\" not found"
Jul 14 19:51:41.628178 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:41.628147    2579 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jul 14 19:51:41.628580 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:41.628306    2579 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 14 19:51:41.628580 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:41.628343    2579 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 14 19:51:41.694421 ip-10-0-140-201 kubenswrapper[2579]: E0714 19:51:41.694388    2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-201.ec2.internal\" not found"
Jul 14 19:51:41.699902 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:41.699866    2579 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-13 19:46:41 +0000 UTC" deadline="2027-12-31 12:26:58.852365952 +0000 UTC"
Jul 14 19:51:41.699902 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:41.699898    2579 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="12832h35m17.152471946s"
Jul 14 19:51:41.713161 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:41.713123    2579 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 14 19:51:41.719473 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:41.719450    2579 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 14 19:51:41.794680 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:41.794615    2579 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-201.ec2.internal"
Jul 14 19:51:41.806292 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:41.806260    2579 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 14 19:51:41.807255 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:41.807237    2579 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-201.ec2.internal"
Jul 14 19:51:41.814511 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:41.814489    2579 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 14 19:51:42.576216 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:42.576187    2579 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 14 19:51:42.578905 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:42.578885    2579 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 14 19:51:42.659055 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:42.659021    2579 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 14 19:51:42.672976 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:42.672939    2579 apiserver.go:52] "Watching apiserver"
Jul 14 19:51:42.680044 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:42.680022    2579 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 14 19:51:42.680450 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:42.680429    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-multus/multus-additional-cni-plugins-ks4zn","openshift-network-operator/iptables-alerter-8ss2c","openshift-ovn-kubernetes/ovnkube-node-q4xzw","kube-system/global-pull-secret-syncer-d8x6z","kube-system/kube-apiserver-proxy-ip-10-0-140-201.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fkcxq","openshift-dns/node-resolver-4qscd","openshift-image-registry/node-ca-gb26w","openshift-multus/multus-4g2lc","openshift-multus/network-metrics-daemon-f52k9","openshift-network-diagnostics/network-check-target-xk8l4","kube-system/konnectivity-agent-nb29m","openshift-cluster-node-tuning-operator/tuned-sdxvb","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-201.ec2.internal"]
Jul 14 19:51:42.684459 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:42.684439    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-4qscd"
Jul 14 19:51:42.686735 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:42.686711    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xk8l4"
Jul 14 19:51:42.686882 ip-10-0-140-201 kubenswrapper[2579]: E0714 19:51:42.686853    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xk8l4" podUID="48340033-b0f1-4d8d-b7fd-b6bb6ddddd8b"
Jul 14 19:51:42.687002 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:42.686988    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-8bk8j\""
Jul 14 19:51:42.687116 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:42.687102    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 14 19:51:42.687173 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:42.687161    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 14 19:51:42.689162 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:42.689145    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-q4xzw"
Jul 14 19:51:42.691426 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:42.691406    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 14 19:51:42.691563 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:42.691530    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-d8x6z"
Jul 14 19:51:42.691657 ip-10-0-140-201 kubenswrapper[2579]: E0714 19:51:42.691623    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-d8x6z" podUID="1993baf5-1337-4873-acf4-fd40ade89975"
Jul 14 19:51:42.691990 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:42.691881    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-bd22j\""
Jul 14 19:51:42.692300 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:42.692127    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 14 19:51:42.692300 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:42.692163    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 14 19:51:42.692300 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:42.692172    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 14 19:51:42.692300 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:42.692223    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 14 19:51:42.692300 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:42.692294    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 14 19:51:42.694009 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:42.693990    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-gb26w"
Jul 14 19:51:42.694426 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:42.694406    2579 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jul 14 19:51:42.696258 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:42.696238    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 14 19:51:42.696343 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:42.696243    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 14 19:51:42.698182 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:42.696839    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fkcxq"
Jul 14 19:51:42.698182 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:42.696998    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-flzlz\""
Jul 14 19:51:42.699750 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:42.699723    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jul 14 19:51:42.700269 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:42.700028    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 14 19:51:42.700379 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:42.700357    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-4g2lc"
Jul 14 19:51:42.703283 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:42.703263    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-sdxvb"
Jul 14 19:51:42.703416 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:42.703393    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 14 19:51:42.703806 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:42.703787    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 14 19:51:42.703900 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:42.703850    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 14 19:51:42.703962 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:42.703921    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 14 19:51:42.703962 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:42.703921    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 14 19:51:42.704093 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:42.704067    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-f7m2c\""
Jul 14 19:51:42.704192 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:42.704138    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 14 19:51:42.704192 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:42.704152    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-84864\""
Jul 14 19:51:42.705556 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:42.705535    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 14 19:51:42.705869 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:42.705845    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-8ss2c"
Jul 14 19:51:42.706009 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:42.705991    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 14 19:51:42.706278 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:42.706262    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-gkdmp\""
Jul 14 19:51:42.706516 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:42.706492    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/ef54193c-7659-4e47-87ac-4d129d22a268-run-ovn\") pod \"ovnkube-node-q4xzw\" (UID: \"ef54193c-7659-4e47-87ac-4d129d22a268\") " pod="openshift-ovn-kubernetes/ovnkube-node-q4xzw"
Jul 14 19:51:42.706679 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:42.706529    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/ef54193c-7659-4e47-87ac-4d129d22a268-ovn-node-metrics-cert\") pod \"ovnkube-node-q4xzw\" (UID: \"ef54193c-7659-4e47-87ac-4d129d22a268\") " pod="openshift-ovn-kubernetes/ovnkube-node-q4xzw"
Jul 14 19:51:42.706679 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:42.706564    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1993baf5-1337-4873-acf4-fd40ade89975-original-pull-secret\") pod \"global-pull-secret-syncer-d8x6z\" (UID: \"1993baf5-1337-4873-acf4-fd40ade89975\") " pod="kube-system/global-pull-secret-syncer-d8x6z"
Jul 14 19:51:42.706679 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:42.706590    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/1ea2bd9d-b2c3-42ce-a0ee-c3719d4f048e-serviceca\") pod \"node-ca-gb26w\" (UID: \"1ea2bd9d-b2c3-42ce-a0ee-c3719d4f048e\") " pod="openshift-image-registry/node-ca-gb26w"
Jul 14 19:51:42.706679 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:42.706617    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/2d58ec38-5f18-4d79-9df1-06c13bd595c3-registration-dir\") pod \"aws-ebs-csi-driver-node-fkcxq\" (UID: \"2d58ec38-5f18-4d79-9df1-06c13bd595c3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fkcxq"
Jul 14 19:51:42.706679 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:42.706641    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/2d58ec38-5f18-4d79-9df1-06c13bd595c3-device-dir\") pod \"aws-ebs-csi-driver-node-fkcxq\" (UID: \"2d58ec38-5f18-4d79-9df1-06c13bd595c3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fkcxq"
Jul 14 19:51:42.706679 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:42.706664    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/209b5a52-9d80-45ca-9c92-63578a945220-hosts-file\") pod \"node-resolver-4qscd\" (UID: \"209b5a52-9d80-45ca-9c92-63578a945220\") " pod="openshift-dns/node-resolver-4qscd"
Jul 14 19:51:42.706987 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:42.706693    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vcnzp\" (UniqueName: \"kubernetes.io/projected/48340033-b0f1-4d8d-b7fd-b6bb6ddddd8b-kube-api-access-vcnzp\") pod \"network-check-target-xk8l4\" (UID: \"48340033-b0f1-4d8d-b7fd-b6bb6ddddd8b\") " pod="openshift-network-diagnostics/network-check-target-xk8l4"
Jul 14 19:51:42.706987 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:42.706724    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/ef54193c-7659-4e47-87ac-4d129d22a268-host-cni-netd\") pod \"ovnkube-node-q4xzw\" (UID: \"ef54193c-7659-4e47-87ac-4d129d22a268\") " pod="openshift-ovn-kubernetes/ovnkube-node-q4xzw"
Jul 14 19:51:42.706987 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:42.706768    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/1993baf5-1337-4873-acf4-fd40ade89975-dbus\") pod \"global-pull-secret-syncer-d8x6z\" (UID: \"1993baf5-1337-4873-acf4-fd40ade89975\") " pod="kube-system/global-pull-secret-syncer-d8x6z"
Jul 14 19:51:42.706987 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:42.706793    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/1ea2bd9d-b2c3-42ce-a0ee-c3719d4f048e-host\") pod \"node-ca-gb26w\" (UID: \"1ea2bd9d-b2c3-42ce-a0ee-c3719d4f048e\") " pod="openshift-image-registry/node-ca-gb26w"
Jul 14 19:51:42.706987 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:42.706825    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bwf6f\" (UniqueName: \"kubernetes.io/projected/1ea2bd9d-b2c3-42ce-a0ee-c3719d4f048e-kube-api-access-bwf6f\") pod \"node-ca-gb26w\" (UID: \"1ea2bd9d-b2c3-42ce-a0ee-c3719d4f048e\") " pod="openshift-image-registry/node-ca-gb26w"
Jul 14 19:51:42.706987 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:42.706852    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/209b5a52-9d80-45ca-9c92-63578a945220-tmp-dir\") pod \"node-resolver-4qscd\" (UID: \"209b5a52-9d80-45ca-9c92-63578a945220\") " pod="openshift-dns/node-resolver-4qscd"
Jul 14 19:51:42.706987 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:42.706886    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/ef54193c-7659-4e47-87ac-4d129d22a268-host-kubelet\") pod \"ovnkube-node-q4xzw\" (UID: \"ef54193c-7659-4e47-87ac-4d129d22a268\") " pod="openshift-ovn-kubernetes/ovnkube-node-q4xzw"
Jul 14 19:51:42.706987 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:42.706944    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/ef54193c-7659-4e47-87ac-4d129d22a268-systemd-units\") pod \"ovnkube-node-q4xzw\" (UID: \"ef54193c-7659-4e47-87ac-4d129d22a268\") " pod="openshift-ovn-kubernetes/ovnkube-node-q4xzw"
Jul 14 19:51:42.707283 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:42.706997    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ef54193c-7659-4e47-87ac-4d129d22a268-var-lib-openvswitch\") pod \"ovnkube-node-q4xzw\" (UID: \"ef54193c-7659-4e47-87ac-4d129d22a268\") " pod="openshift-ovn-kubernetes/ovnkube-node-q4xzw"
Jul 14 19:51:42.707283 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:42.707019    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/ef54193c-7659-4e47-87ac-4d129d22a268-node-log\") pod \"ovnkube-node-q4xzw\" (UID: \"ef54193c-7659-4e47-87ac-4d129d22a268\") " pod="openshift-ovn-kubernetes/ovnkube-node-q4xzw"
Jul 14 19:51:42.707283 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:42.707037    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ef54193c-7659-4e47-87ac-4d129d22a268-host-cni-bin\") pod \"ovnkube-node-q4xzw\" (UID: \"ef54193c-7659-4e47-87ac-4d129d22a268\") " pod="openshift-ovn-kubernetes/ovnkube-node-q4xzw"
Jul 14 19:51:42.707283 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:42.707078    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ef54193c-7659-4e47-87ac-4d129d22a268-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-q4xzw\" (UID: \"ef54193c-7659-4e47-87ac-4d129d22a268\") " pod="openshift-ovn-kubernetes/ovnkube-node-q4xzw"
Jul 14 19:51:42.707283 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:42.707112    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/2d58ec38-5f18-4d79-9df1-06c13bd595c3-socket-dir\") pod \"aws-ebs-csi-driver-node-fkcxq\" (UID: \"2d58ec38-5f18-4d79-9df1-06c13bd595c3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fkcxq"
Jul 14 19:51:42.707283 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:42.707138    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kz7fn\" (UniqueName: \"kubernetes.io/projected/2d58ec38-5f18-4d79-9df1-06c13bd595c3-kube-api-access-kz7fn\") pod \"aws-ebs-csi-driver-node-fkcxq\" (UID: \"2d58ec38-5f18-4d79-9df1-06c13bd595c3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fkcxq"
Jul 14 19:51:42.707283 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:42.707167    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/ef54193c-7659-4e47-87ac-4d129d22a268-env-overrides\") pod \"ovnkube-node-q4xzw\" (UID: \"ef54193c-7659-4e47-87ac-4d129d22a268\") " pod="openshift-ovn-kubernetes/ovnkube-node-q4xzw"
Jul 14 19:51:42.707283 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:42.707217    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6g9fs\" (UniqueName: \"kubernetes.io/projected/209b5a52-9d80-45ca-9c92-63578a945220-kube-api-access-6g9fs\") pod \"node-resolver-4qscd\" (UID: \"209b5a52-9d80-45ca-9c92-63578a945220\") " pod="openshift-dns/node-resolver-4qscd"
Jul 14 19:51:42.707283 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:42.707250    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ef54193c-7659-4e47-87ac-4d129d22a268-host-slash\") pod \"ovnkube-node-q4xzw\" (UID: \"ef54193c-7659-4e47-87ac-4d129d22a268\") " pod="openshift-ovn-kubernetes/ovnkube-node-q4xzw"
Jul 14 19:51:42.707685 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:42.707272    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ef54193c-7659-4e47-87ac-4d129d22a268-host-run-netns\") pod \"ovnkube-node-q4xzw\" (UID: \"ef54193c-7659-4e47-87ac-4d129d22a268\") " pod="openshift-ovn-kubernetes/ovnkube-node-q4xzw"
Jul 14 19:51:42.707685 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:42.707314    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/ef54193c-7659-4e47-87ac-4d129d22a268-log-socket\") pod \"ovnkube-node-q4xzw\" (UID: \"ef54193c-7659-4e47-87ac-4d129d22a268\") " pod="openshift-ovn-kubernetes/ovnkube-node-q4xzw"
Jul 14 19:51:42.707685 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:42.707338    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/ef54193c-7659-4e47-87ac-4d129d22a268-ovnkube-config\") pod \"ovnkube-node-q4xzw\" (UID: \"ef54193c-7659-4e47-87ac-4d129d22a268\") " pod="openshift-ovn-kubernetes/ovnkube-node-q4xzw"
Jul 14 19:51:42.707685 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:42.707355    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2gmsh\" (UniqueName: \"kubernetes.io/projected/ef54193c-7659-4e47-87ac-4d129d22a268-kube-api-access-2gmsh\") pod \"ovnkube-node-q4xzw\" (UID: \"ef54193c-7659-4e47-87ac-4d129d22a268\") " pod="openshift-ovn-kubernetes/ovnkube-node-q4xzw"
Jul 14 19:51:42.707685 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:42.707380    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/2d58ec38-5f18-4d79-9df1-06c13bd595c3-etc-selinux\") pod \"aws-ebs-csi-driver-node-fkcxq\" (UID: \"2d58ec38-5f18-4d79-9df1-06c13bd595c3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fkcxq"
Jul 14 19:51:42.707685 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:42.707402    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ef54193c-7659-4e47-87ac-4d129d22a268-run-openvswitch\") pod \"ovnkube-node-q4xzw\" (UID: \"ef54193c-7659-4e47-87ac-4d129d22a268\") " pod="openshift-ovn-kubernetes/ovnkube-node-q4xzw"
Jul 14 19:51:42.707685 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:42.707444    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/2d58ec38-5f18-4d79-9df1-06c13bd595c3-kubelet-dir\") pod \"aws-ebs-csi-driver-node-fkcxq\" (UID: \"2d58ec38-5f18-4d79-9df1-06c13bd595c3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fkcxq"
Jul 14 19:51:42.707685 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:42.707471    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/ef54193c-7659-4e47-87ac-4d129d22a268-run-systemd\") pod \"ovnkube-node-q4xzw\" (UID: \"ef54193c-7659-4e47-87ac-4d129d22a268\") " pod="openshift-ovn-kubernetes/ovnkube-node-q4xzw"
Jul 14 19:51:42.707685 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:42.707496    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ef54193c-7659-4e47-87ac-4d129d22a268-etc-openvswitch\") pod \"ovnkube-node-q4xzw\" (UID: \"ef54193c-7659-4e47-87ac-4d129d22a268\") " pod="openshift-ovn-kubernetes/ovnkube-node-q4xzw"
Jul 14 19:51:42.707685 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:42.707520    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ef54193c-7659-4e47-87ac-4d129d22a268-host-run-ovn-kubernetes\") pod \"ovnkube-node-q4xzw\" (UID: \"ef54193c-7659-4e47-87ac-4d129d22a268\") " pod="openshift-ovn-kubernetes/ovnkube-node-q4xzw"
Jul 14 19:51:42.707685 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:42.707538    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/ef54193c-7659-4e47-87ac-4d129d22a268-ovnkube-script-lib\") pod \"ovnkube-node-q4xzw\" (UID: \"ef54193c-7659-4e47-87ac-4d129d22a268\") " pod="openshift-ovn-kubernetes/ovnkube-node-q4xzw"
Jul 14 19:51:42.707685 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:42.707576    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/1993baf5-1337-4873-acf4-fd40ade89975-kubelet-config\") pod \"global-pull-secret-syncer-d8x6z\" (UID: \"1993baf5-1337-4873-acf4-fd40ade89975\") " pod="kube-system/global-pull-secret-syncer-d8x6z"
Jul 14 19:51:42.707685 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:42.707594    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/2d58ec38-5f18-4d79-9df1-06c13bd595c3-sys-fs\") pod \"aws-ebs-csi-driver-node-fkcxq\" (UID: \"2d58ec38-5f18-4d79-9df1-06c13bd595c3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fkcxq"
Jul 14 19:51:42.708325 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:42.708308    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 14 19:51:42.708401 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:42.708316    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 14 19:51:42.708487 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:42.708472    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 14 19:51:42.708536 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:42.708515    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-d7cqw\""
Jul 14 19:51:42.708900 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:42.708884    2579 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 14 19:51:42.709877 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:42.709860    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-f52k9"
Jul 14 19:51:42.709975 ip-10-0-140-201 kubenswrapper[2579]: E0714 19:51:42.709919    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-f52k9" podUID="9aa72835-977f-4b04-9858-7d623eda0254"
Jul 14 19:51:42.712544 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:42.712520    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-ks4zn"
Jul 14 19:51:42.715026 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:42.714993    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 14 19:51:42.715181 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:42.715028    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 14 19:51:42.715181 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:42.715054    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-z8cng\""
Jul 14 19:51:42.715181 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:42.715074    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-nb29m"
Jul 14 19:51:42.717625 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:42.717596    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-58ltv\""
Jul 14 19:51:42.717625 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:42.717595    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 14 19:51:42.717749 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:42.717596    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 14 19:51:42.738448 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:42.738409    2579 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-sjk2r"
Jul 14 19:51:42.747329 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:42.747308    2579 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-sjk2r"
Jul 14 19:51:42.796154 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:42.796117    2579 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jul 14 19:51:42.807993 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:42.807955    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/ef54193c-7659-4e47-87ac-4d129d22a268-ovnkube-script-lib\") pod \"ovnkube-node-q4xzw\" (UID: \"ef54193c-7659-4e47-87ac-4d129d22a268\") " pod="openshift-ovn-kubernetes/ovnkube-node-q4xzw"
Jul 14 19:51:42.808094 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:42.808002    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/2d58ec38-5f18-4d79-9df1-06c13bd595c3-sys-fs\") pod \"aws-ebs-csi-driver-node-fkcxq\" (UID: \"2d58ec38-5f18-4d79-9df1-06c13bd595c3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fkcxq"
Jul 14 19:51:42.808094 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:42.808027    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/47390bed-f864-4a3b-ac65-960f504af7f1-lib-modules\") pod \"tuned-sdxvb\" (UID: \"47390bed-f864-4a3b-ac65-960f504af7f1\") " pod="openshift-cluster-node-tuning-operator/tuned-sdxvb"
Jul 14 19:51:42.808094 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:42.808046    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/b0492caa-150a-47bd-b74d-60fa9de0c173-cni-binary-copy\") pod \"multus-additional-cni-plugins-ks4zn\" (UID: \"b0492caa-150a-47bd-b74d-60fa9de0c173\") " pod="openshift-multus/multus-additional-cni-plugins-ks4zn"
Jul 14 19:51:42.808094 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:42.808069    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/ef54193c-7659-4e47-87ac-4d129d22a268-run-ovn\") pod \"ovnkube-node-q4xzw\" (UID: \"ef54193c-7659-4e47-87ac-4d129d22a268\") " pod="openshift-ovn-kubernetes/ovnkube-node-q4xzw"
Jul 14 19:51:42.808094 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:42.808089    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/ef54193c-7659-4e47-87ac-4d129d22a268-ovn-node-metrics-cert\") pod \"ovnkube-node-q4xzw\" (UID: \"ef54193c-7659-4e47-87ac-4d129d22a268\") " pod="openshift-ovn-kubernetes/ovnkube-node-q4xzw"
Jul 14 19:51:42.808316 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:42.808115    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1993baf5-1337-4873-acf4-fd40ade89975-original-pull-secret\") pod \"global-pull-secret-syncer-d8x6z\" (UID: \"1993baf5-1337-4873-acf4-fd40ade89975\") " pod="kube-system/global-pull-secret-syncer-d8x6z"
Jul 14 19:51:42.808316 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:42.808142    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/b0492caa-150a-47bd-b74d-60fa9de0c173-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-ks4zn\" (UID: \"b0492caa-150a-47bd-b74d-60fa9de0c173\") " pod="openshift-multus/multus-additional-cni-plugins-ks4zn"
Jul 14 19:51:42.808316 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:42.808167    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/b0492caa-150a-47bd-b74d-60fa9de0c173-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-ks4zn\" (UID: \"b0492caa-150a-47bd-b74d-60fa9de0c173\") " pod="openshift-multus/multus-additional-cni-plugins-ks4zn"
Jul 14 19:51:42.808316 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:42.808170    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/ef54193c-7659-4e47-87ac-4d129d22a268-run-ovn\") pod \"ovnkube-node-q4xzw\" (UID: \"ef54193c-7659-4e47-87ac-4d129d22a268\") " pod="openshift-ovn-kubernetes/ovnkube-node-q4xzw"
Jul 14 19:51:42.808316 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:42.808195    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/1a276f3b-de2d-4f24-8335-2c66e01d0bf7-multus-conf-dir\") pod \"multus-4g2lc\" (UID: \"1a276f3b-de2d-4f24-8335-2c66e01d0bf7\") " pod="openshift-multus/multus-4g2lc"
Jul 14 19:51:42.808316 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:42.808172    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/2d58ec38-5f18-4d79-9df1-06c13bd595c3-sys-fs\") pod \"aws-ebs-csi-driver-node-fkcxq\" (UID: \"2d58ec38-5f18-4d79-9df1-06c13bd595c3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fkcxq"
Jul 14 19:51:42.808316 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:42.808240    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/2d58ec38-5f18-4d79-9df1-06c13bd595c3-registration-dir\") pod \"aws-ebs-csi-driver-node-fkcxq\" (UID: \"2d58ec38-5f18-4d79-9df1-06c13bd595c3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fkcxq"
Jul 14 19:51:42.808316 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:42.808276    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/209b5a52-9d80-45ca-9c92-63578a945220-hosts-file\") pod \"node-resolver-4qscd\" (UID: \"209b5a52-9d80-45ca-9c92-63578a945220\") " pod="openshift-dns/node-resolver-4qscd"
Jul 14 19:51:42.808316 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:42.808309    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vcnzp\" (UniqueName: \"kubernetes.io/projected/48340033-b0f1-4d8d-b7fd-b6bb6ddddd8b-kube-api-access-vcnzp\") pod \"network-check-target-xk8l4\" (UID: \"48340033-b0f1-4d8d-b7fd-b6bb6ddddd8b\") " pod="openshift-network-diagnostics/network-check-target-xk8l4"
Jul 14 19:51:42.808729 ip-10-0-140-201 kubenswrapper[2579]: E0714 19:51:42.808337    2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 14 19:51:42.808729 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:42.808396    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/209b5a52-9d80-45ca-9c92-63578a945220-hosts-file\") pod \"node-resolver-4qscd\" (UID: \"209b5a52-9d80-45ca-9c92-63578a945220\") " pod="openshift-dns/node-resolver-4qscd"
Jul 14 19:51:42.808729 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:42.808340    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/f18327eb-f774-4f26-b798-5628c0dd01ad-konnectivity-ca\") pod \"konnectivity-agent-nb29m\" (UID: \"f18327eb-f774-4f26-b798-5628c0dd01ad\") " pod="kube-system/konnectivity-agent-nb29m"
Jul 14 19:51:42.808729 ip-10-0-140-201 kubenswrapper[2579]: E0714 19:51:42.808446    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1993baf5-1337-4873-acf4-fd40ade89975-original-pull-secret podName:1993baf5-1337-4873-acf4-fd40ade89975 nodeName:}" failed. No retries permitted until 2026-07-14 19:51:43.308397011 +0000 UTC m=+3.019992560 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/1993baf5-1337-4873-acf4-fd40ade89975-original-pull-secret") pod "global-pull-secret-syncer-d8x6z" (UID: "1993baf5-1337-4873-acf4-fd40ade89975") : object "kube-system"/"original-pull-secret" not registered
Jul 14 19:51:42.808729 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:42.808502    2579 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jul 14 19:51:42.808729 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:42.808510    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/1a276f3b-de2d-4f24-8335-2c66e01d0bf7-host-var-lib-cni-bin\") pod \"multus-4g2lc\" (UID: \"1a276f3b-de2d-4f24-8335-2c66e01d0bf7\") " pod="openshift-multus/multus-4g2lc"
Jul 14 19:51:42.808729 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:42.808557    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/47390bed-f864-4a3b-ac65-960f504af7f1-etc-sysctl-conf\") pod \"tuned-sdxvb\" (UID: \"47390bed-f864-4a3b-ac65-960f504af7f1\") " pod="openshift-cluster-node-tuning-operator/tuned-sdxvb"
Jul 14 19:51:42.808729 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:42.808582    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/47390bed-f864-4a3b-ac65-960f504af7f1-sys\") pod \"tuned-sdxvb\" (UID: \"47390bed-f864-4a3b-ac65-960f504af7f1\") " pod="openshift-cluster-node-tuning-operator/tuned-sdxvb"
Jul 14 19:51:42.808729 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:42.808606    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/1a276f3b-de2d-4f24-8335-2c66e01d0bf7-multus-daemon-config\") pod \"multus-4g2lc\" (UID: \"1a276f3b-de2d-4f24-8335-2c66e01d0bf7\") " pod="openshift-multus/multus-4g2lc"
Jul 14 19:51:42.808729 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:42.808637    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/1993baf5-1337-4873-acf4-fd40ade89975-dbus\") pod \"global-pull-secret-syncer-d8x6z\" (UID: \"1993baf5-1337-4873-acf4-fd40ade89975\") " pod="kube-system/global-pull-secret-syncer-d8x6z"
Jul 14 19:51:42.808729 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:42.808675    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/1ea2bd9d-b2c3-42ce-a0ee-c3719d4f048e-host\") pod \"node-ca-gb26w\" (UID: \"1ea2bd9d-b2c3-42ce-a0ee-c3719d4f048e\") " pod="openshift-image-registry/node-ca-gb26w"
Jul 14 19:51:42.808729 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:42.808701    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bwf6f\" (UniqueName: \"kubernetes.io/projected/1ea2bd9d-b2c3-42ce-a0ee-c3719d4f048e-kube-api-access-bwf6f\") pod \"node-ca-gb26w\" (UID: \"1ea2bd9d-b2c3-42ce-a0ee-c3719d4f048e\") " pod="openshift-image-registry/node-ca-gb26w"
Jul 14 19:51:42.808729 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:42.808707    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/ef54193c-7659-4e47-87ac-4d129d22a268-ovnkube-script-lib\") pod \"ovnkube-node-q4xzw\" (UID: \"ef54193c-7659-4e47-87ac-4d129d22a268\") " pod="openshift-ovn-kubernetes/ovnkube-node-q4xzw"
Jul 14 19:51:42.808729 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:42.808729    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/209b5a52-9d80-45ca-9c92-63578a945220-tmp-dir\") pod \"node-resolver-4qscd\" (UID: \"209b5a52-9d80-45ca-9c92-63578a945220\") " pod="openshift-dns/node-resolver-4qscd"
Jul 14 19:51:42.809448 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:42.808758    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/47390bed-f864-4a3b-ac65-960f504af7f1-etc-kubernetes\") pod \"tuned-sdxvb\" (UID: \"47390bed-f864-4a3b-ac65-960f504af7f1\") " pod="openshift-cluster-node-tuning-operator/tuned-sdxvb"
Jul 14 19:51:42.809448 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:42.808796    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9aa72835-977f-4b04-9858-7d623eda0254-metrics-certs\") pod \"network-metrics-daemon-f52k9\" (UID: \"9aa72835-977f-4b04-9858-7d623eda0254\") " pod="openshift-multus/network-metrics-daemon-f52k9"
Jul 14 19:51:42.809448 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:42.808849    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/1ea2bd9d-b2c3-42ce-a0ee-c3719d4f048e-host\") pod \"node-ca-gb26w\" (UID: \"1ea2bd9d-b2c3-42ce-a0ee-c3719d4f048e\") " pod="openshift-image-registry/node-ca-gb26w"
Jul 14 19:51:42.809448 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:42.808857    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/1993baf5-1337-4873-acf4-fd40ade89975-dbus\") pod \"global-pull-secret-syncer-d8x6z\" (UID: \"1993baf5-1337-4873-acf4-fd40ade89975\") " pod="kube-system/global-pull-secret-syncer-d8x6z"
Jul 14 19:51:42.809448 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:42.808901    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ef54193c-7659-4e47-87ac-4d129d22a268-var-lib-openvswitch\") pod \"ovnkube-node-q4xzw\" (UID: \"ef54193c-7659-4e47-87ac-4d129d22a268\") " pod="openshift-ovn-kubernetes/ovnkube-node-q4xzw"
Jul 14 19:51:42.809448 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:42.808385    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/2d58ec38-5f18-4d79-9df1-06c13bd595c3-registration-dir\") pod \"aws-ebs-csi-driver-node-fkcxq\" (UID: \"2d58ec38-5f18-4d79-9df1-06c13bd595c3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fkcxq"
Jul 14 19:51:42.809448 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:42.808938    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ef54193c-7659-4e47-87ac-4d129d22a268-host-cni-bin\") pod \"ovnkube-node-q4xzw\" (UID: \"ef54193c-7659-4e47-87ac-4d129d22a268\") " pod="openshift-ovn-kubernetes/ovnkube-node-q4xzw"
Jul 14 19:51:42.809448 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:42.808978    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ef54193c-7659-4e47-87ac-4d129d22a268-host-cni-bin\") pod \"ovnkube-node-q4xzw\" (UID: \"ef54193c-7659-4e47-87ac-4d129d22a268\") " pod="openshift-ovn-kubernetes/ovnkube-node-q4xzw"
Jul 14 19:51:42.809448 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:42.808982    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ef54193c-7659-4e47-87ac-4d129d22a268-var-lib-openvswitch\") pod \"ovnkube-node-q4xzw\" (UID: \"ef54193c-7659-4e47-87ac-4d129d22a268\") " pod="openshift-ovn-kubernetes/ovnkube-node-q4xzw"
Jul 14 19:51:42.809448 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:42.809030    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kz7fn\" (UniqueName: \"kubernetes.io/projected/2d58ec38-5f18-4d79-9df1-06c13bd595c3-kube-api-access-kz7fn\") pod \"aws-ebs-csi-driver-node-fkcxq\" (UID: \"2d58ec38-5f18-4d79-9df1-06c13bd595c3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fkcxq"
Jul 14 19:51:42.809448 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:42.809065    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/209b5a52-9d80-45ca-9c92-63578a945220-tmp-dir\") pod \"node-resolver-4qscd\" (UID: \"209b5a52-9d80-45ca-9c92-63578a945220\") " pod="openshift-dns/node-resolver-4qscd"
Jul 14 19:51:42.809448 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:42.809086    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6g9fs\" (UniqueName: \"kubernetes.io/projected/209b5a52-9d80-45ca-9c92-63578a945220-kube-api-access-6g9fs\") pod \"node-resolver-4qscd\" (UID: \"209b5a52-9d80-45ca-9c92-63578a945220\") " pod="openshift-dns/node-resolver-4qscd"
Jul 14 19:51:42.809448 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:42.809124    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/47390bed-f864-4a3b-ac65-960f504af7f1-etc-modprobe-d\") pod \"tuned-sdxvb\" (UID: \"47390bed-f864-4a3b-ac65-960f504af7f1\") " pod="openshift-cluster-node-tuning-operator/tuned-sdxvb"
Jul 14 19:51:42.809448 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:42.809150    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/1f7b0ae1-bc82-4d4a-b9ae-63de08fd2d96-host-slash\") pod \"iptables-alerter-8ss2c\" (UID: \"1f7b0ae1-bc82-4d4a-b9ae-63de08fd2d96\") " pod="openshift-network-operator/iptables-alerter-8ss2c"
Jul 14 19:51:42.809448 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:42.809176    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/b0492caa-150a-47bd-b74d-60fa9de0c173-os-release\") pod \"multus-additional-cni-plugins-ks4zn\" (UID: \"b0492caa-150a-47bd-b74d-60fa9de0c173\") " pod="openshift-multus/multus-additional-cni-plugins-ks4zn"
Jul 14 19:51:42.809448 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:42.809208    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/ef54193c-7659-4e47-87ac-4d129d22a268-env-overrides\") pod \"ovnkube-node-q4xzw\" (UID: \"ef54193c-7659-4e47-87ac-4d129d22a268\") " pod="openshift-ovn-kubernetes/ovnkube-node-q4xzw"
Jul 14 19:51:42.809448 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:42.809233    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/1a276f3b-de2d-4f24-8335-2c66e01d0bf7-os-release\") pod \"multus-4g2lc\" (UID: \"1a276f3b-de2d-4f24-8335-2c66e01d0bf7\") " pod="openshift-multus/multus-4g2lc"
Jul 14 19:51:42.810264 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:42.809258    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/1a276f3b-de2d-4f24-8335-2c66e01d0bf7-multus-socket-dir-parent\") pod \"multus-4g2lc\" (UID: \"1a276f3b-de2d-4f24-8335-2c66e01d0bf7\") " pod="openshift-multus/multus-4g2lc"
Jul 14 19:51:42.810264 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:42.809285    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/1a276f3b-de2d-4f24-8335-2c66e01d0bf7-host-var-lib-cni-multus\") pod \"multus-4g2lc\" (UID: \"1a276f3b-de2d-4f24-8335-2c66e01d0bf7\") " pod="openshift-multus/multus-4g2lc"
Jul 14 19:51:42.810264 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:42.809312    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/1a276f3b-de2d-4f24-8335-2c66e01d0bf7-host-run-multus-certs\") pod \"multus-4g2lc\" (UID: \"1a276f3b-de2d-4f24-8335-2c66e01d0bf7\") " pod="openshift-multus/multus-4g2lc"
Jul 14 19:51:42.810264 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:42.809337    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/47390bed-f864-4a3b-ac65-960f504af7f1-etc-systemd\") pod \"tuned-sdxvb\" (UID: \"47390bed-f864-4a3b-ac65-960f504af7f1\") " pod="openshift-cluster-node-tuning-operator/tuned-sdxvb"
Jul 14 19:51:42.810264 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:42.809362    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ef54193c-7659-4e47-87ac-4d129d22a268-host-slash\") pod \"ovnkube-node-q4xzw\" (UID: \"ef54193c-7659-4e47-87ac-4d129d22a268\") " pod="openshift-ovn-kubernetes/ovnkube-node-q4xzw"
Jul 14 19:51:42.810264 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:42.809398    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ef54193c-7659-4e47-87ac-4d129d22a268-host-run-netns\") pod \"ovnkube-node-q4xzw\" (UID: \"ef54193c-7659-4e47-87ac-4d129d22a268\") " pod="openshift-ovn-kubernetes/ovnkube-node-q4xzw"
Jul 14 19:51:42.810264 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:42.809407    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ef54193c-7659-4e47-87ac-4d129d22a268-host-slash\") pod \"ovnkube-node-q4xzw\" (UID: \"ef54193c-7659-4e47-87ac-4d129d22a268\") " pod="openshift-ovn-kubernetes/ovnkube-node-q4xzw"
Jul 14 19:51:42.810264 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:42.809422    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nfpvb\" (UniqueName: \"kubernetes.io/projected/1a276f3b-de2d-4f24-8335-2c66e01d0bf7-kube-api-access-nfpvb\") pod \"multus-4g2lc\" (UID: \"1a276f3b-de2d-4f24-8335-2c66e01d0bf7\") " pod="openshift-multus/multus-4g2lc"
Jul 14 19:51:42.810264 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:42.809460    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/47390bed-f864-4a3b-ac65-960f504af7f1-etc-tuned\") pod \"tuned-sdxvb\" (UID: \"47390bed-f864-4a3b-ac65-960f504af7f1\") " pod="openshift-cluster-node-tuning-operator/tuned-sdxvb"
Jul 14 19:51:42.810264 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:42.809461    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ef54193c-7659-4e47-87ac-4d129d22a268-host-run-netns\") pod \"ovnkube-node-q4xzw\" (UID: \"ef54193c-7659-4e47-87ac-4d129d22a268\") " pod="openshift-ovn-kubernetes/ovnkube-node-q4xzw"
Jul 14 19:51:42.810264 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:42.809485    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zstwf\" (UniqueName: \"kubernetes.io/projected/9aa72835-977f-4b04-9858-7d623eda0254-kube-api-access-zstwf\") pod \"network-metrics-daemon-f52k9\" (UID: \"9aa72835-977f-4b04-9858-7d623eda0254\") " pod="openshift-multus/network-metrics-daemon-f52k9"
Jul 14 19:51:42.810264 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:42.809513    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-66lv4\" (UniqueName: \"kubernetes.io/projected/b0492caa-150a-47bd-b74d-60fa9de0c173-kube-api-access-66lv4\") pod \"multus-additional-cni-plugins-ks4zn\" (UID: \"b0492caa-150a-47bd-b74d-60fa9de0c173\") " pod="openshift-multus/multus-additional-cni-plugins-ks4zn"
Jul 14 19:51:42.810264 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:42.809542    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ef54193c-7659-4e47-87ac-4d129d22a268-etc-openvswitch\") pod \"ovnkube-node-q4xzw\" (UID: \"ef54193c-7659-4e47-87ac-4d129d22a268\") " pod="openshift-ovn-kubernetes/ovnkube-node-q4xzw"
Jul 14 19:51:42.810264 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:42.809575    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/ef54193c-7659-4e47-87ac-4d129d22a268-env-overrides\") pod \"ovnkube-node-q4xzw\" (UID: \"ef54193c-7659-4e47-87ac-4d129d22a268\") " pod="openshift-ovn-kubernetes/ovnkube-node-q4xzw"
Jul 14 19:51:42.810264 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:42.809597    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ef54193c-7659-4e47-87ac-4d129d22a268-host-run-ovn-kubernetes\") pod \"ovnkube-node-q4xzw\" (UID: \"ef54193c-7659-4e47-87ac-4d129d22a268\") " pod="openshift-ovn-kubernetes/ovnkube-node-q4xzw"
Jul 14 19:51:42.810264 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:42.809627    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/1993baf5-1337-4873-acf4-fd40ade89975-kubelet-config\") pod \"global-pull-secret-syncer-d8x6z\" (UID: \"1993baf5-1337-4873-acf4-fd40ade89975\") " pod="kube-system/global-pull-secret-syncer-d8x6z"
Jul 14 19:51:42.810264 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:42.809577    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ef54193c-7659-4e47-87ac-4d129d22a268-etc-openvswitch\") pod \"ovnkube-node-q4xzw\" (UID: \"ef54193c-7659-4e47-87ac-4d129d22a268\") " pod="openshift-ovn-kubernetes/ovnkube-node-q4xzw"
Jul 14 19:51:42.811012 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:42.809652    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/f18327eb-f774-4f26-b798-5628c0dd01ad-agent-certs\") pod \"konnectivity-agent-nb29m\" (UID: \"f18327eb-f774-4f26-b798-5628c0dd01ad\") " pod="kube-system/konnectivity-agent-nb29m"
Jul 14 19:51:42.811012 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:42.809675    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ef54193c-7659-4e47-87ac-4d129d22a268-host-run-ovn-kubernetes\") pod \"ovnkube-node-q4xzw\" (UID: \"ef54193c-7659-4e47-87ac-4d129d22a268\") " pod="openshift-ovn-kubernetes/ovnkube-node-q4xzw"
Jul 14 19:51:42.811012 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:42.809677    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1a276f3b-de2d-4f24-8335-2c66e01d0bf7-host-var-lib-kubelet\") pod \"multus-4g2lc\" (UID: \"1a276f3b-de2d-4f24-8335-2c66e01d0bf7\") " pod="openshift-multus/multus-4g2lc"
Jul 14 19:51:42.811012 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:42.809710    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/1993baf5-1337-4873-acf4-fd40ade89975-kubelet-config\") pod \"global-pull-secret-syncer-d8x6z\" (UID: \"1993baf5-1337-4873-acf4-fd40ade89975\") " pod="kube-system/global-pull-secret-syncer-d8x6z"
Jul 14 19:51:42.811012 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:42.809717    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/b0492caa-150a-47bd-b74d-60fa9de0c173-cnibin\") pod \"multus-additional-cni-plugins-ks4zn\" (UID: \"b0492caa-150a-47bd-b74d-60fa9de0c173\") " pod="openshift-multus/multus-additional-cni-plugins-ks4zn"
Jul 14 19:51:42.811012 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:42.809742    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-npj8p\" (UniqueName: \"kubernetes.io/projected/1f7b0ae1-bc82-4d4a-b9ae-63de08fd2d96-kube-api-access-npj8p\") pod \"iptables-alerter-8ss2c\" (UID: \"1f7b0ae1-bc82-4d4a-b9ae-63de08fd2d96\") " pod="openshift-network-operator/iptables-alerter-8ss2c"
Jul 14 19:51:42.811012 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:42.809768    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/1ea2bd9d-b2c3-42ce-a0ee-c3719d4f048e-serviceca\") pod \"node-ca-gb26w\" (UID: \"1ea2bd9d-b2c3-42ce-a0ee-c3719d4f048e\") " pod="openshift-image-registry/node-ca-gb26w"
Jul 14 19:51:42.811012 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:42.809792    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/2d58ec38-5f18-4d79-9df1-06c13bd595c3-device-dir\") pod \"aws-ebs-csi-driver-node-fkcxq\" (UID: \"2d58ec38-5f18-4d79-9df1-06c13bd595c3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fkcxq"
Jul 14 19:51:42.811012 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:42.809819    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/1a276f3b-de2d-4f24-8335-2c66e01d0bf7-host-run-netns\") pod \"multus-4g2lc\" (UID: \"1a276f3b-de2d-4f24-8335-2c66e01d0bf7\") " pod="openshift-multus/multus-4g2lc"
Jul 14 19:51:42.811012 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:42.809844    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/47390bed-f864-4a3b-ac65-960f504af7f1-run\") pod \"tuned-sdxvb\" (UID: \"47390bed-f864-4a3b-ac65-960f504af7f1\") " pod="openshift-cluster-node-tuning-operator/tuned-sdxvb"
Jul 14 19:51:42.811012 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:42.809869    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/47390bed-f864-4a3b-ac65-960f504af7f1-var-lib-kubelet\") pod \"tuned-sdxvb\" (UID: \"47390bed-f864-4a3b-ac65-960f504af7f1\") " pod="openshift-cluster-node-tuning-operator/tuned-sdxvb"
Jul 14 19:51:42.811012 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:42.809921    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/2d58ec38-5f18-4d79-9df1-06c13bd595c3-device-dir\") pod \"aws-ebs-csi-driver-node-fkcxq\" (UID: \"2d58ec38-5f18-4d79-9df1-06c13bd595c3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fkcxq"
Jul 14 19:51:42.811012 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:42.809917    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/47390bed-f864-4a3b-ac65-960f504af7f1-tmp\") pod \"tuned-sdxvb\" (UID: \"47390bed-f864-4a3b-ac65-960f504af7f1\") " pod="openshift-cluster-node-tuning-operator/tuned-sdxvb"
Jul 14 19:51:42.811012 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:42.809991    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/1a276f3b-de2d-4f24-8335-2c66e01d0bf7-host-run-k8s-cni-cncf-io\") pod \"multus-4g2lc\" (UID: \"1a276f3b-de2d-4f24-8335-2c66e01d0bf7\") " pod="openshift-multus/multus-4g2lc"
Jul 14 19:51:42.811012 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:42.810017    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/ef54193c-7659-4e47-87ac-4d129d22a268-host-cni-netd\") pod \"ovnkube-node-q4xzw\" (UID: \"ef54193c-7659-4e47-87ac-4d129d22a268\") " pod="openshift-ovn-kubernetes/ovnkube-node-q4xzw"
Jul 14 19:51:42.811012 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:42.810041    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/1a276f3b-de2d-4f24-8335-2c66e01d0bf7-system-cni-dir\") pod \"multus-4g2lc\" (UID: \"1a276f3b-de2d-4f24-8335-2c66e01d0bf7\") " pod="openshift-multus/multus-4g2lc"
Jul 14 19:51:42.811012 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:42.810065    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/1a276f3b-de2d-4f24-8335-2c66e01d0bf7-cni-binary-copy\") pod \"multus-4g2lc\" (UID: \"1a276f3b-de2d-4f24-8335-2c66e01d0bf7\") " pod="openshift-multus/multus-4g2lc"
Jul 14 19:51:42.811539 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:42.810078    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/ef54193c-7659-4e47-87ac-4d129d22a268-host-cni-netd\") pod \"ovnkube-node-q4xzw\" (UID: \"ef54193c-7659-4e47-87ac-4d129d22a268\") " pod="openshift-ovn-kubernetes/ovnkube-node-q4xzw"
Jul 14 19:51:42.811539 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:42.810090    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/1f7b0ae1-bc82-4d4a-b9ae-63de08fd2d96-iptables-alerter-script\") pod \"iptables-alerter-8ss2c\" (UID: \"1f7b0ae1-bc82-4d4a-b9ae-63de08fd2d96\") " pod="openshift-network-operator/iptables-alerter-8ss2c"
Jul 14 19:51:42.811539 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:42.810112    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/ef54193c-7659-4e47-87ac-4d129d22a268-host-kubelet\") pod \"ovnkube-node-q4xzw\" (UID: \"ef54193c-7659-4e47-87ac-4d129d22a268\") " pod="openshift-ovn-kubernetes/ovnkube-node-q4xzw"
Jul 14 19:51:42.811539 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:42.810128    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/ef54193c-7659-4e47-87ac-4d129d22a268-systemd-units\") pod \"ovnkube-node-q4xzw\" (UID: \"ef54193c-7659-4e47-87ac-4d129d22a268\") " pod="openshift-ovn-kubernetes/ovnkube-node-q4xzw"
Jul 14 19:51:42.811539 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:42.810144    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/ef54193c-7659-4e47-87ac-4d129d22a268-node-log\") pod \"ovnkube-node-q4xzw\" (UID: \"ef54193c-7659-4e47-87ac-4d129d22a268\") " pod="openshift-ovn-kubernetes/ovnkube-node-q4xzw"
Jul 14 19:51:42.811539 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:42.810160    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ef54193c-7659-4e47-87ac-4d129d22a268-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-q4xzw\" (UID: \"ef54193c-7659-4e47-87ac-4d129d22a268\") " pod="openshift-ovn-kubernetes/ovnkube-node-q4xzw"
Jul 14 19:51:42.811539 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:42.810176    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/2d58ec38-5f18-4d79-9df1-06c13bd595c3-socket-dir\") pod \"aws-ebs-csi-driver-node-fkcxq\" (UID: \"2d58ec38-5f18-4d79-9df1-06c13bd595c3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fkcxq"
Jul 14 19:51:42.811539 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:42.810217    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/ef54193c-7659-4e47-87ac-4d129d22a268-systemd-units\") pod \"ovnkube-node-q4xzw\" (UID: \"ef54193c-7659-4e47-87ac-4d129d22a268\") " pod="openshift-ovn-kubernetes/ovnkube-node-q4xzw"
Jul 14 19:51:42.811539 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:42.810223    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/ef54193c-7659-4e47-87ac-4d129d22a268-node-log\") pod \"ovnkube-node-q4xzw\" (UID: \"ef54193c-7659-4e47-87ac-4d129d22a268\") " pod="openshift-ovn-kubernetes/ovnkube-node-q4xzw"
Jul 14 19:51:42.811539 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:42.810234    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ef54193c-7659-4e47-87ac-4d129d22a268-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-q4xzw\" (UID: \"ef54193c-7659-4e47-87ac-4d129d22a268\") " pod="openshift-ovn-kubernetes/ovnkube-node-q4xzw"
Jul 14 19:51:42.811539 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:42.810225    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/1ea2bd9d-b2c3-42ce-a0ee-c3719d4f048e-serviceca\") pod \"node-ca-gb26w\" (UID: \"1ea2bd9d-b2c3-42ce-a0ee-c3719d4f048e\") " pod="openshift-image-registry/node-ca-gb26w"
Jul 14 19:51:42.811539 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:42.810258    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/ef54193c-7659-4e47-87ac-4d129d22a268-host-kubelet\") pod \"ovnkube-node-q4xzw\" (UID: \"ef54193c-7659-4e47-87ac-4d129d22a268\") " pod="openshift-ovn-kubernetes/ovnkube-node-q4xzw"
Jul 14 19:51:42.811539 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:42.810253    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/1a276f3b-de2d-4f24-8335-2c66e01d0bf7-cnibin\") pod \"multus-4g2lc\" (UID: \"1a276f3b-de2d-4f24-8335-2c66e01d0bf7\") " pod="openshift-multus/multus-4g2lc"
Jul 14 19:51:42.811539 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:42.810290    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/2d58ec38-5f18-4d79-9df1-06c13bd595c3-socket-dir\") pod \"aws-ebs-csi-driver-node-fkcxq\" (UID: \"2d58ec38-5f18-4d79-9df1-06c13bd595c3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fkcxq"
Jul 14 19:51:42.811539 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:42.810303    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/47390bed-f864-4a3b-ac65-960f504af7f1-host\") pod \"tuned-sdxvb\" (UID: \"47390bed-f864-4a3b-ac65-960f504af7f1\") " pod="openshift-cluster-node-tuning-operator/tuned-sdxvb"
Jul 14 19:51:42.811539 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:42.810325    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/47390bed-f864-4a3b-ac65-960f504af7f1-etc-sysconfig\") pod \"tuned-sdxvb\" (UID: \"47390bed-f864-4a3b-ac65-960f504af7f1\") " pod="openshift-cluster-node-tuning-operator/tuned-sdxvb"
Jul 14 19:51:42.811539 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:42.810363    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-859nr\" (UniqueName: \"kubernetes.io/projected/47390bed-f864-4a3b-ac65-960f504af7f1-kube-api-access-859nr\") pod \"tuned-sdxvb\" (UID: \"47390bed-f864-4a3b-ac65-960f504af7f1\") " pod="openshift-cluster-node-tuning-operator/tuned-sdxvb"
Jul 14 19:51:42.812060 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:42.810380    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/b0492caa-150a-47bd-b74d-60fa9de0c173-tuning-conf-dir\") pod \"multus-additional-cni-plugins-ks4zn\" (UID: \"b0492caa-150a-47bd-b74d-60fa9de0c173\") " pod="openshift-multus/multus-additional-cni-plugins-ks4zn"
Jul 14 19:51:42.812060 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:42.810422    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/ef54193c-7659-4e47-87ac-4d129d22a268-log-socket\") pod \"ovnkube-node-q4xzw\" (UID: \"ef54193c-7659-4e47-87ac-4d129d22a268\") " pod="openshift-ovn-kubernetes/ovnkube-node-q4xzw"
Jul 14 19:51:42.812060 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:42.810446    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/ef54193c-7659-4e47-87ac-4d129d22a268-ovnkube-config\") pod \"ovnkube-node-q4xzw\" (UID: \"ef54193c-7659-4e47-87ac-4d129d22a268\") " pod="openshift-ovn-kubernetes/ovnkube-node-q4xzw"
Jul 14 19:51:42.812060 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:42.810467    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/ef54193c-7659-4e47-87ac-4d129d22a268-log-socket\") pod \"ovnkube-node-q4xzw\" (UID: \"ef54193c-7659-4e47-87ac-4d129d22a268\") " pod="openshift-ovn-kubernetes/ovnkube-node-q4xzw"
Jul 14 19:51:42.812060 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:42.810469    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2gmsh\" (UniqueName: \"kubernetes.io/projected/ef54193c-7659-4e47-87ac-4d129d22a268-kube-api-access-2gmsh\") pod \"ovnkube-node-q4xzw\" (UID: \"ef54193c-7659-4e47-87ac-4d129d22a268\") " pod="openshift-ovn-kubernetes/ovnkube-node-q4xzw"
Jul 14 19:51:42.812060 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:42.810493    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/2d58ec38-5f18-4d79-9df1-06c13bd595c3-etc-selinux\") pod \"aws-ebs-csi-driver-node-fkcxq\" (UID: \"2d58ec38-5f18-4d79-9df1-06c13bd595c3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fkcxq"
Jul 14 19:51:42.812060 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:42.810518    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/1a276f3b-de2d-4f24-8335-2c66e01d0bf7-multus-cni-dir\") pod \"multus-4g2lc\" (UID: \"1a276f3b-de2d-4f24-8335-2c66e01d0bf7\") " pod="openshift-multus/multus-4g2lc"
Jul 14 19:51:42.812060 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:42.810544    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/1a276f3b-de2d-4f24-8335-2c66e01d0bf7-hostroot\") pod \"multus-4g2lc\" (UID: \"1a276f3b-de2d-4f24-8335-2c66e01d0bf7\") " pod="openshift-multus/multus-4g2lc"
Jul 14 19:51:42.812060 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:42.810588    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1a276f3b-de2d-4f24-8335-2c66e01d0bf7-etc-kubernetes\") pod \"multus-4g2lc\" (UID: \"1a276f3b-de2d-4f24-8335-2c66e01d0bf7\") " pod="openshift-multus/multus-4g2lc"
Jul 14 19:51:42.812060 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:42.810631    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/47390bed-f864-4a3b-ac65-960f504af7f1-etc-sysctl-d\") pod \"tuned-sdxvb\" (UID: \"47390bed-f864-4a3b-ac65-960f504af7f1\") " pod="openshift-cluster-node-tuning-operator/tuned-sdxvb"
Jul 14 19:51:42.812060 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:42.810642    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/2d58ec38-5f18-4d79-9df1-06c13bd595c3-etc-selinux\") pod \"aws-ebs-csi-driver-node-fkcxq\" (UID: \"2d58ec38-5f18-4d79-9df1-06c13bd595c3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fkcxq"
Jul 14 19:51:42.812060 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:42.810729    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ef54193c-7659-4e47-87ac-4d129d22a268-run-openvswitch\") pod \"ovnkube-node-q4xzw\" (UID: \"ef54193c-7659-4e47-87ac-4d129d22a268\") " pod="openshift-ovn-kubernetes/ovnkube-node-q4xzw"
Jul 14 19:51:42.812060 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:42.810763    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/2d58ec38-5f18-4d79-9df1-06c13bd595c3-kubelet-dir\") pod \"aws-ebs-csi-driver-node-fkcxq\" (UID: \"2d58ec38-5f18-4d79-9df1-06c13bd595c3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fkcxq"
Jul 14 19:51:42.812060 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:42.810775    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ef54193c-7659-4e47-87ac-4d129d22a268-run-openvswitch\") pod \"ovnkube-node-q4xzw\" (UID: \"ef54193c-7659-4e47-87ac-4d129d22a268\") " pod="openshift-ovn-kubernetes/ovnkube-node-q4xzw"
Jul 14 19:51:42.812060 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:42.810793    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b0492caa-150a-47bd-b74d-60fa9de0c173-system-cni-dir\") pod \"multus-additional-cni-plugins-ks4zn\" (UID: \"b0492caa-150a-47bd-b74d-60fa9de0c173\") " pod="openshift-multus/multus-additional-cni-plugins-ks4zn"
Jul 14 19:51:42.812060 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:42.810823    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/ef54193c-7659-4e47-87ac-4d129d22a268-run-systemd\") pod \"ovnkube-node-q4xzw\" (UID: \"ef54193c-7659-4e47-87ac-4d129d22a268\") " pod="openshift-ovn-kubernetes/ovnkube-node-q4xzw"
Jul 14 19:51:42.812060 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:42.810831    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/2d58ec38-5f18-4d79-9df1-06c13bd595c3-kubelet-dir\") pod \"aws-ebs-csi-driver-node-fkcxq\" (UID: \"2d58ec38-5f18-4d79-9df1-06c13bd595c3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fkcxq"
Jul 14 19:51:42.812626 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:42.810943    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/ef54193c-7659-4e47-87ac-4d129d22a268-run-systemd\") pod \"ovnkube-node-q4xzw\" (UID: \"ef54193c-7659-4e47-87ac-4d129d22a268\") " pod="openshift-ovn-kubernetes/ovnkube-node-q4xzw"
Jul 14 19:51:42.812626 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:42.810993    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/ef54193c-7659-4e47-87ac-4d129d22a268-ovnkube-config\") pod \"ovnkube-node-q4xzw\" (UID: \"ef54193c-7659-4e47-87ac-4d129d22a268\") " pod="openshift-ovn-kubernetes/ovnkube-node-q4xzw"
Jul 14 19:51:42.812731 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:42.812674    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/ef54193c-7659-4e47-87ac-4d129d22a268-ovn-node-metrics-cert\") pod \"ovnkube-node-q4xzw\" (UID: \"ef54193c-7659-4e47-87ac-4d129d22a268\") " pod="openshift-ovn-kubernetes/ovnkube-node-q4xzw"
Jul 14 19:51:42.816513 ip-10-0-140-201 kubenswrapper[2579]: E0714 19:51:42.816491    2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 14 19:51:42.816513 ip-10-0-140-201 kubenswrapper[2579]: E0714 19:51:42.816517    2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 14 19:51:42.816721 ip-10-0-140-201 kubenswrapper[2579]: E0714 19:51:42.816530    2579 projected.go:196] Error preparing data for projected volume kube-api-access-vcnzp for pod openshift-network-diagnostics/network-check-target-xk8l4: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 14 19:51:42.816721 ip-10-0-140-201 kubenswrapper[2579]: E0714 19:51:42.816596    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/48340033-b0f1-4d8d-b7fd-b6bb6ddddd8b-kube-api-access-vcnzp podName:48340033-b0f1-4d8d-b7fd-b6bb6ddddd8b nodeName:}" failed. No retries permitted until 2026-07-14 19:51:43.316577761 +0000 UTC m=+3.028173284 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-vcnzp" (UniqueName: "kubernetes.io/projected/48340033-b0f1-4d8d-b7fd-b6bb6ddddd8b-kube-api-access-vcnzp") pod "network-check-target-xk8l4" (UID: "48340033-b0f1-4d8d-b7fd-b6bb6ddddd8b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 14 19:51:42.819163 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:42.819131    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bwf6f\" (UniqueName: \"kubernetes.io/projected/1ea2bd9d-b2c3-42ce-a0ee-c3719d4f048e-kube-api-access-bwf6f\") pod \"node-ca-gb26w\" (UID: \"1ea2bd9d-b2c3-42ce-a0ee-c3719d4f048e\") " pod="openshift-image-registry/node-ca-gb26w"
Jul 14 19:51:42.819163 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:42.819158    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6g9fs\" (UniqueName: \"kubernetes.io/projected/209b5a52-9d80-45ca-9c92-63578a945220-kube-api-access-6g9fs\") pod \"node-resolver-4qscd\" (UID: \"209b5a52-9d80-45ca-9c92-63578a945220\") " pod="openshift-dns/node-resolver-4qscd"
Jul 14 19:51:42.819696 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:42.819676    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kz7fn\" (UniqueName: \"kubernetes.io/projected/2d58ec38-5f18-4d79-9df1-06c13bd595c3-kube-api-access-kz7fn\") pod \"aws-ebs-csi-driver-node-fkcxq\" (UID: \"2d58ec38-5f18-4d79-9df1-06c13bd595c3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fkcxq"
Jul 14 19:51:42.819889 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:42.819872    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2gmsh\" (UniqueName: \"kubernetes.io/projected/ef54193c-7659-4e47-87ac-4d129d22a268-kube-api-access-2gmsh\") pod \"ovnkube-node-q4xzw\" (UID: \"ef54193c-7659-4e47-87ac-4d129d22a268\") " pod="openshift-ovn-kubernetes/ovnkube-node-q4xzw"
Jul 14 19:51:42.845315 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:42.845252    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-201.ec2.internal" event={"ID":"cad5cdd785a831695970fe0c85e16af0","Type":"ContainerStarted","Data":"bbfb6810d58fd2a104337ef30c021d49e04d9b813be16805b3e1f0caa1565c16"}
Jul 14 19:51:42.911078 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:42.911047    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zstwf\" (UniqueName: \"kubernetes.io/projected/9aa72835-977f-4b04-9858-7d623eda0254-kube-api-access-zstwf\") pod \"network-metrics-daemon-f52k9\" (UID: \"9aa72835-977f-4b04-9858-7d623eda0254\") " pod="openshift-multus/network-metrics-daemon-f52k9"
Jul 14 19:51:42.911078 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:42.911082    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-66lv4\" (UniqueName: \"kubernetes.io/projected/b0492caa-150a-47bd-b74d-60fa9de0c173-kube-api-access-66lv4\") pod \"multus-additional-cni-plugins-ks4zn\" (UID: \"b0492caa-150a-47bd-b74d-60fa9de0c173\") " pod="openshift-multus/multus-additional-cni-plugins-ks4zn"
Jul 14 19:51:42.911322 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:42.911109    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/f18327eb-f774-4f26-b798-5628c0dd01ad-agent-certs\") pod \"konnectivity-agent-nb29m\" (UID: \"f18327eb-f774-4f26-b798-5628c0dd01ad\") " pod="kube-system/konnectivity-agent-nb29m"
Jul 14 19:51:42.911322 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:42.911135    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1a276f3b-de2d-4f24-8335-2c66e01d0bf7-host-var-lib-kubelet\") pod \"multus-4g2lc\" (UID: \"1a276f3b-de2d-4f24-8335-2c66e01d0bf7\") " pod="openshift-multus/multus-4g2lc"
Jul 14 19:51:42.911322 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:42.911193    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1a276f3b-de2d-4f24-8335-2c66e01d0bf7-host-var-lib-kubelet\") pod \"multus-4g2lc\" (UID: \"1a276f3b-de2d-4f24-8335-2c66e01d0bf7\") " pod="openshift-multus/multus-4g2lc"
Jul 14 19:51:42.911322 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:42.911307    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/b0492caa-150a-47bd-b74d-60fa9de0c173-cnibin\") pod \"multus-additional-cni-plugins-ks4zn\" (UID: \"b0492caa-150a-47bd-b74d-60fa9de0c173\") " pod="openshift-multus/multus-additional-cni-plugins-ks4zn"
Jul 14 19:51:42.911542 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:42.911348    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-npj8p\" (UniqueName: \"kubernetes.io/projected/1f7b0ae1-bc82-4d4a-b9ae-63de08fd2d96-kube-api-access-npj8p\") pod \"iptables-alerter-8ss2c\" (UID: \"1f7b0ae1-bc82-4d4a-b9ae-63de08fd2d96\") " pod="openshift-network-operator/iptables-alerter-8ss2c"
Jul 14 19:51:42.911542 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:42.911409    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/1a276f3b-de2d-4f24-8335-2c66e01d0bf7-host-run-netns\") pod \"multus-4g2lc\" (UID: \"1a276f3b-de2d-4f24-8335-2c66e01d0bf7\") " pod="openshift-multus/multus-4g2lc"
Jul 14 19:51:42.911542 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:42.911437    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/47390bed-f864-4a3b-ac65-960f504af7f1-run\") pod \"tuned-sdxvb\" (UID: \"47390bed-f864-4a3b-ac65-960f504af7f1\") " pod="openshift-cluster-node-tuning-operator/tuned-sdxvb"
Jul 14 19:51:42.911542 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:42.911465    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/47390bed-f864-4a3b-ac65-960f504af7f1-var-lib-kubelet\") pod \"tuned-sdxvb\" (UID: \"47390bed-f864-4a3b-ac65-960f504af7f1\") " pod="openshift-cluster-node-tuning-operator/tuned-sdxvb"
Jul 14 19:51:42.911542 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:42.911409    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/b0492caa-150a-47bd-b74d-60fa9de0c173-cnibin\") pod \"multus-additional-cni-plugins-ks4zn\" (UID: \"b0492caa-150a-47bd-b74d-60fa9de0c173\") " pod="openshift-multus/multus-additional-cni-plugins-ks4zn"
Jul 14 19:51:42.911542 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:42.911474    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/1a276f3b-de2d-4f24-8335-2c66e01d0bf7-host-run-netns\") pod \"multus-4g2lc\" (UID: \"1a276f3b-de2d-4f24-8335-2c66e01d0bf7\") " pod="openshift-multus/multus-4g2lc"
Jul 14 19:51:42.911542 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:42.911489    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/47390bed-f864-4a3b-ac65-960f504af7f1-tmp\") pod \"tuned-sdxvb\" (UID: \"47390bed-f864-4a3b-ac65-960f504af7f1\") " pod="openshift-cluster-node-tuning-operator/tuned-sdxvb"
Jul 14 19:51:42.911542 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:42.911515    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/1a276f3b-de2d-4f24-8335-2c66e01d0bf7-host-run-k8s-cni-cncf-io\") pod \"multus-4g2lc\" (UID: \"1a276f3b-de2d-4f24-8335-2c66e01d0bf7\") " pod="openshift-multus/multus-4g2lc"
Jul 14 19:51:42.911881 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:42.911541    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/1a276f3b-de2d-4f24-8335-2c66e01d0bf7-system-cni-dir\") pod \"multus-4g2lc\" (UID: \"1a276f3b-de2d-4f24-8335-2c66e01d0bf7\") " pod="openshift-multus/multus-4g2lc"
Jul 14 19:51:42.911881 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:42.911565    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/47390bed-f864-4a3b-ac65-960f504af7f1-var-lib-kubelet\") pod \"tuned-sdxvb\" (UID: \"47390bed-f864-4a3b-ac65-960f504af7f1\") " pod="openshift-cluster-node-tuning-operator/tuned-sdxvb"
Jul 14 19:51:42.911881 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:42.911557    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/47390bed-f864-4a3b-ac65-960f504af7f1-run\") pod \"tuned-sdxvb\" (UID: \"47390bed-f864-4a3b-ac65-960f504af7f1\") " pod="openshift-cluster-node-tuning-operator/tuned-sdxvb"
Jul 14 19:51:42.911881 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:42.911590    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/1a276f3b-de2d-4f24-8335-2c66e01d0bf7-host-run-k8s-cni-cncf-io\") pod \"multus-4g2lc\" (UID: \"1a276f3b-de2d-4f24-8335-2c66e01d0bf7\") " pod="openshift-multus/multus-4g2lc"
Jul 14 19:51:42.911881 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:42.911663    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/1a276f3b-de2d-4f24-8335-2c66e01d0bf7-cni-binary-copy\") pod \"multus-4g2lc\" (UID: \"1a276f3b-de2d-4f24-8335-2c66e01d0bf7\") " pod="openshift-multus/multus-4g2lc"
Jul 14 19:51:42.912102 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:42.911990    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/1a276f3b-de2d-4f24-8335-2c66e01d0bf7-system-cni-dir\") pod \"multus-4g2lc\" (UID: \"1a276f3b-de2d-4f24-8335-2c66e01d0bf7\") " pod="openshift-multus/multus-4g2lc"
Jul 14 19:51:42.912102 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:42.912012    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/1f7b0ae1-bc82-4d4a-b9ae-63de08fd2d96-iptables-alerter-script\") pod \"iptables-alerter-8ss2c\" (UID: \"1f7b0ae1-bc82-4d4a-b9ae-63de08fd2d96\") " pod="openshift-network-operator/iptables-alerter-8ss2c"
Jul 14 19:51:42.912102 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:42.912070    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/1a276f3b-de2d-4f24-8335-2c66e01d0bf7-cnibin\") pod \"multus-4g2lc\" (UID: \"1a276f3b-de2d-4f24-8335-2c66e01d0bf7\") " pod="openshift-multus/multus-4g2lc"
Jul 14 19:51:42.912246 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:42.912117    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/47390bed-f864-4a3b-ac65-960f504af7f1-host\") pod \"tuned-sdxvb\" (UID: \"47390bed-f864-4a3b-ac65-960f504af7f1\") " pod="openshift-cluster-node-tuning-operator/tuned-sdxvb"
Jul 14 19:51:42.912246 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:42.912151    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/47390bed-f864-4a3b-ac65-960f504af7f1-etc-sysconfig\") pod \"tuned-sdxvb\" (UID: \"47390bed-f864-4a3b-ac65-960f504af7f1\") " pod="openshift-cluster-node-tuning-operator/tuned-sdxvb"
Jul 14 19:51:42.912246 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:42.912186    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-859nr\" (UniqueName: \"kubernetes.io/projected/47390bed-f864-4a3b-ac65-960f504af7f1-kube-api-access-859nr\") pod \"tuned-sdxvb\" (UID: \"47390bed-f864-4a3b-ac65-960f504af7f1\") " pod="openshift-cluster-node-tuning-operator/tuned-sdxvb"
Jul 14 19:51:42.912246 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:42.912218    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/1a276f3b-de2d-4f24-8335-2c66e01d0bf7-cnibin\") pod \"multus-4g2lc\" (UID: \"1a276f3b-de2d-4f24-8335-2c66e01d0bf7\") " pod="openshift-multus/multus-4g2lc"
Jul 14 19:51:42.912429 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:42.912225    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/b0492caa-150a-47bd-b74d-60fa9de0c173-tuning-conf-dir\") pod \"multus-additional-cni-plugins-ks4zn\" (UID: \"b0492caa-150a-47bd-b74d-60fa9de0c173\") " pod="openshift-multus/multus-additional-cni-plugins-ks4zn"
Jul 14 19:51:42.912429 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:42.912299    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/1a276f3b-de2d-4f24-8335-2c66e01d0bf7-multus-cni-dir\") pod \"multus-4g2lc\" (UID: \"1a276f3b-de2d-4f24-8335-2c66e01d0bf7\") " pod="openshift-multus/multus-4g2lc"
Jul 14 19:51:42.912429 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:42.912347    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/1a276f3b-de2d-4f24-8335-2c66e01d0bf7-hostroot\") pod \"multus-4g2lc\" (UID: \"1a276f3b-de2d-4f24-8335-2c66e01d0bf7\") " pod="openshift-multus/multus-4g2lc"
Jul 14 19:51:42.912429 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:42.912380    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1a276f3b-de2d-4f24-8335-2c66e01d0bf7-etc-kubernetes\") pod \"multus-4g2lc\" (UID: \"1a276f3b-de2d-4f24-8335-2c66e01d0bf7\") " pod="openshift-multus/multus-4g2lc"
Jul 14 19:51:42.912429 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:42.912418    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/47390bed-f864-4a3b-ac65-960f504af7f1-etc-sysctl-d\") pod \"tuned-sdxvb\" (UID: \"47390bed-f864-4a3b-ac65-960f504af7f1\") " pod="openshift-cluster-node-tuning-operator/tuned-sdxvb"
Jul 14 19:51:42.912737 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:42.912464    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b0492caa-150a-47bd-b74d-60fa9de0c173-system-cni-dir\") pod \"multus-additional-cni-plugins-ks4zn\" (UID: \"b0492caa-150a-47bd-b74d-60fa9de0c173\") " pod="openshift-multus/multus-additional-cni-plugins-ks4zn"
Jul 14 19:51:42.912737 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:42.912514    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/47390bed-f864-4a3b-ac65-960f504af7f1-lib-modules\") pod \"tuned-sdxvb\" (UID: \"47390bed-f864-4a3b-ac65-960f504af7f1\") " pod="openshift-cluster-node-tuning-operator/tuned-sdxvb"
Jul 14 19:51:42.912737 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:42.912518    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/1a276f3b-de2d-4f24-8335-2c66e01d0bf7-hostroot\") pod \"multus-4g2lc\" (UID: \"1a276f3b-de2d-4f24-8335-2c66e01d0bf7\") " pod="openshift-multus/multus-4g2lc"
Jul 14 19:51:42.912737 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:42.912551    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/b0492caa-150a-47bd-b74d-60fa9de0c173-cni-binary-copy\") pod \"multus-additional-cni-plugins-ks4zn\" (UID: \"b0492caa-150a-47bd-b74d-60fa9de0c173\") " pod="openshift-multus/multus-additional-cni-plugins-ks4zn"
Jul 14 19:51:42.912737 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:42.912616    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/1a276f3b-de2d-4f24-8335-2c66e01d0bf7-multus-cni-dir\") pod \"multus-4g2lc\" (UID: \"1a276f3b-de2d-4f24-8335-2c66e01d0bf7\") " pod="openshift-multus/multus-4g2lc"
Jul 14 19:51:42.912737 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:42.912629    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b0492caa-150a-47bd-b74d-60fa9de0c173-system-cni-dir\") pod \"multus-additional-cni-plugins-ks4zn\" (UID: \"b0492caa-150a-47bd-b74d-60fa9de0c173\") " pod="openshift-multus/multus-additional-cni-plugins-ks4zn"
Jul 14 19:51:42.912737 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:42.912725    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/47390bed-f864-4a3b-ac65-960f504af7f1-host\") pod \"tuned-sdxvb\" (UID: \"47390bed-f864-4a3b-ac65-960f504af7f1\") " pod="openshift-cluster-node-tuning-operator/tuned-sdxvb"
Jul 14 19:51:42.913214 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:42.913190    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/b0492caa-150a-47bd-b74d-60fa9de0c173-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-ks4zn\" (UID: \"b0492caa-150a-47bd-b74d-60fa9de0c173\") " pod="openshift-multus/multus-additional-cni-plugins-ks4zn"
Jul 14 19:51:42.913282 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:42.913239    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/b0492caa-150a-47bd-b74d-60fa9de0c173-tuning-conf-dir\") pod \"multus-additional-cni-plugins-ks4zn\" (UID: \"b0492caa-150a-47bd-b74d-60fa9de0c173\") " pod="openshift-multus/multus-additional-cni-plugins-ks4zn"
Jul 14 19:51:42.915063 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:42.913325    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/b0492caa-150a-47bd-b74d-60fa9de0c173-cni-binary-copy\") pod \"multus-additional-cni-plugins-ks4zn\" (UID: \"b0492caa-150a-47bd-b74d-60fa9de0c173\") " pod="openshift-multus/multus-additional-cni-plugins-ks4zn"
Jul 14 19:51:42.915063 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:42.913410    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/47390bed-f864-4a3b-ac65-960f504af7f1-etc-sysconfig\") pod \"tuned-sdxvb\" (UID: \"47390bed-f864-4a3b-ac65-960f504af7f1\") " pod="openshift-cluster-node-tuning-operator/tuned-sdxvb"
Jul 14 19:51:42.915063 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:42.913498    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/47390bed-f864-4a3b-ac65-960f504af7f1-etc-sysctl-d\") pod \"tuned-sdxvb\" (UID: \"47390bed-f864-4a3b-ac65-960f504af7f1\") " pod="openshift-cluster-node-tuning-operator/tuned-sdxvb"
Jul 14 19:51:42.915063 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:42.913531    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/47390bed-f864-4a3b-ac65-960f504af7f1-lib-modules\") pod \"tuned-sdxvb\" (UID: \"47390bed-f864-4a3b-ac65-960f504af7f1\") " pod="openshift-cluster-node-tuning-operator/tuned-sdxvb"
Jul 14 19:51:42.915063 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:42.913578    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1a276f3b-de2d-4f24-8335-2c66e01d0bf7-etc-kubernetes\") pod \"multus-4g2lc\" (UID: \"1a276f3b-de2d-4f24-8335-2c66e01d0bf7\") " pod="openshift-multus/multus-4g2lc"
Jul 14 19:51:42.915063 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:42.913644    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/b0492caa-150a-47bd-b74d-60fa9de0c173-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-ks4zn\" (UID: \"b0492caa-150a-47bd-b74d-60fa9de0c173\") " pod="openshift-multus/multus-additional-cni-plugins-ks4zn"
Jul 14 19:51:42.915063 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:42.913717    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/1a276f3b-de2d-4f24-8335-2c66e01d0bf7-multus-conf-dir\") pod \"multus-4g2lc\" (UID: \"1a276f3b-de2d-4f24-8335-2c66e01d0bf7\") " pod="openshift-multus/multus-4g2lc"
Jul 14 19:51:42.915063 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:42.913770    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/f18327eb-f774-4f26-b798-5628c0dd01ad-konnectivity-ca\") pod \"konnectivity-agent-nb29m\" (UID: \"f18327eb-f774-4f26-b798-5628c0dd01ad\") " pod="kube-system/konnectivity-agent-nb29m"
Jul 14 19:51:42.915063 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:42.913800    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/1a276f3b-de2d-4f24-8335-2c66e01d0bf7-host-var-lib-cni-bin\") pod \"multus-4g2lc\" (UID: \"1a276f3b-de2d-4f24-8335-2c66e01d0bf7\") " pod="openshift-multus/multus-4g2lc"
Jul 14 19:51:42.915063 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:42.913860    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/47390bed-f864-4a3b-ac65-960f504af7f1-etc-sysctl-conf\") pod \"tuned-sdxvb\" (UID: \"47390bed-f864-4a3b-ac65-960f504af7f1\") " pod="openshift-cluster-node-tuning-operator/tuned-sdxvb"
Jul 14 19:51:42.915063 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:42.913905    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/47390bed-f864-4a3b-ac65-960f504af7f1-sys\") pod \"tuned-sdxvb\" (UID: \"47390bed-f864-4a3b-ac65-960f504af7f1\") " pod="openshift-cluster-node-tuning-operator/tuned-sdxvb"
Jul 14 19:51:42.915063 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:42.913930    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/1a276f3b-de2d-4f24-8335-2c66e01d0bf7-multus-daemon-config\") pod \"multus-4g2lc\" (UID: \"1a276f3b-de2d-4f24-8335-2c66e01d0bf7\") " pod="openshift-multus/multus-4g2lc"
Jul 14 19:51:42.915063 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:42.913969    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/47390bed-f864-4a3b-ac65-960f504af7f1-etc-kubernetes\") pod \"tuned-sdxvb\" (UID: \"47390bed-f864-4a3b-ac65-960f504af7f1\") " pod="openshift-cluster-node-tuning-operator/tuned-sdxvb"
Jul 14 19:51:42.915063 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:42.913999    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9aa72835-977f-4b04-9858-7d623eda0254-metrics-certs\") pod \"network-metrics-daemon-f52k9\" (UID: \"9aa72835-977f-4b04-9858-7d623eda0254\") " pod="openshift-multus/network-metrics-daemon-f52k9"
Jul 14 19:51:42.915063 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:42.914151    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/47390bed-f864-4a3b-ac65-960f504af7f1-etc-modprobe-d\") pod \"tuned-sdxvb\" (UID: \"47390bed-f864-4a3b-ac65-960f504af7f1\") " pod="openshift-cluster-node-tuning-operator/tuned-sdxvb"
Jul 14 19:51:42.915063 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:42.914182    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/1f7b0ae1-bc82-4d4a-b9ae-63de08fd2d96-host-slash\") pod \"iptables-alerter-8ss2c\" (UID: \"1f7b0ae1-bc82-4d4a-b9ae-63de08fd2d96\") " pod="openshift-network-operator/iptables-alerter-8ss2c"
Jul 14 19:51:42.915063 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:42.914195    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/b0492caa-150a-47bd-b74d-60fa9de0c173-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-ks4zn\" (UID: \"b0492caa-150a-47bd-b74d-60fa9de0c173\") " pod="openshift-multus/multus-additional-cni-plugins-ks4zn"
Jul 14 19:51:42.916018 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:42.914205    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/b0492caa-150a-47bd-b74d-60fa9de0c173-os-release\") pod \"multus-additional-cni-plugins-ks4zn\" (UID: \"b0492caa-150a-47bd-b74d-60fa9de0c173\") " pod="openshift-multus/multus-additional-cni-plugins-ks4zn"
Jul 14 19:51:42.916018 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:42.914253    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/47390bed-f864-4a3b-ac65-960f504af7f1-etc-sysctl-conf\") pod \"tuned-sdxvb\" (UID: \"47390bed-f864-4a3b-ac65-960f504af7f1\") " pod="openshift-cluster-node-tuning-operator/tuned-sdxvb"
Jul 14 19:51:42.916018 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:42.914280    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/47390bed-f864-4a3b-ac65-960f504af7f1-etc-kubernetes\") pod \"tuned-sdxvb\" (UID: \"47390bed-f864-4a3b-ac65-960f504af7f1\") " pod="openshift-cluster-node-tuning-operator/tuned-sdxvb"
Jul 14 19:51:42.916018 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:42.914312    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/b0492caa-150a-47bd-b74d-60fa9de0c173-os-release\") pod \"multus-additional-cni-plugins-ks4zn\" (UID: \"b0492caa-150a-47bd-b74d-60fa9de0c173\") " pod="openshift-multus/multus-additional-cni-plugins-ks4zn"
Jul 14 19:51:42.916018 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:42.914337    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/1a276f3b-de2d-4f24-8335-2c66e01d0bf7-host-var-lib-cni-bin\") pod \"multus-4g2lc\" (UID: \"1a276f3b-de2d-4f24-8335-2c66e01d0bf7\") " pod="openshift-multus/multus-4g2lc"
Jul 14 19:51:42.916018 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:42.914434    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/47390bed-f864-4a3b-ac65-960f504af7f1-etc-modprobe-d\") pod \"tuned-sdxvb\" (UID: \"47390bed-f864-4a3b-ac65-960f504af7f1\") " pod="openshift-cluster-node-tuning-operator/tuned-sdxvb"
Jul 14 19:51:42.916018 ip-10-0-140-201 kubenswrapper[2579]: E0714 19:51:42.914461    2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 14 19:51:42.916018 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:42.914481    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/1a276f3b-de2d-4f24-8335-2c66e01d0bf7-cni-binary-copy\") pod \"multus-4g2lc\" (UID: \"1a276f3b-de2d-4f24-8335-2c66e01d0bf7\") " pod="openshift-multus/multus-4g2lc"
Jul 14 19:51:42.916018 ip-10-0-140-201 kubenswrapper[2579]: E0714 19:51:42.914630    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9aa72835-977f-4b04-9858-7d623eda0254-metrics-certs podName:9aa72835-977f-4b04-9858-7d623eda0254 nodeName:}" failed. No retries permitted until 2026-07-14 19:51:43.414591577 +0000 UTC m=+3.126187105 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9aa72835-977f-4b04-9858-7d623eda0254-metrics-certs") pod "network-metrics-daemon-f52k9" (UID: "9aa72835-977f-4b04-9858-7d623eda0254") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 14 19:51:42.916018 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:42.914668    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/1a276f3b-de2d-4f24-8335-2c66e01d0bf7-multus-conf-dir\") pod \"multus-4g2lc\" (UID: \"1a276f3b-de2d-4f24-8335-2c66e01d0bf7\") " pod="openshift-multus/multus-4g2lc"
Jul 14 19:51:42.916018 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:42.914674    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/1a276f3b-de2d-4f24-8335-2c66e01d0bf7-os-release\") pod \"multus-4g2lc\" (UID: \"1a276f3b-de2d-4f24-8335-2c66e01d0bf7\") " pod="openshift-multus/multus-4g2lc"
Jul 14 19:51:42.916018 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:42.914746    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/1a276f3b-de2d-4f24-8335-2c66e01d0bf7-os-release\") pod \"multus-4g2lc\" (UID: \"1a276f3b-de2d-4f24-8335-2c66e01d0bf7\") " pod="openshift-multus/multus-4g2lc"
Jul 14 19:51:42.916018 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:42.914772    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/1a276f3b-de2d-4f24-8335-2c66e01d0bf7-multus-socket-dir-parent\") pod \"multus-4g2lc\" (UID: \"1a276f3b-de2d-4f24-8335-2c66e01d0bf7\") " pod="openshift-multus/multus-4g2lc"
Jul 14 19:51:42.916018 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:42.914804    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/47390bed-f864-4a3b-ac65-960f504af7f1-sys\") pod \"tuned-sdxvb\" (UID: \"47390bed-f864-4a3b-ac65-960f504af7f1\") " pod="openshift-cluster-node-tuning-operator/tuned-sdxvb"
Jul 14 19:51:42.916018 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:42.914815    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/1a276f3b-de2d-4f24-8335-2c66e01d0bf7-multus-daemon-config\") pod \"multus-4g2lc\" (UID: \"1a276f3b-de2d-4f24-8335-2c66e01d0bf7\") " pod="openshift-multus/multus-4g2lc"
Jul 14 19:51:42.916018 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:42.914471    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/1f7b0ae1-bc82-4d4a-b9ae-63de08fd2d96-host-slash\") pod \"iptables-alerter-8ss2c\" (UID: \"1f7b0ae1-bc82-4d4a-b9ae-63de08fd2d96\") " pod="openshift-network-operator/iptables-alerter-8ss2c"
Jul 14 19:51:42.916018 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:42.914820    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/1a276f3b-de2d-4f24-8335-2c66e01d0bf7-host-var-lib-cni-multus\") pod \"multus-4g2lc\" (UID: \"1a276f3b-de2d-4f24-8335-2c66e01d0bf7\") " pod="openshift-multus/multus-4g2lc"
Jul 14 19:51:42.916018 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:42.914874    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/1a276f3b-de2d-4f24-8335-2c66e01d0bf7-host-run-multus-certs\") pod \"multus-4g2lc\" (UID: \"1a276f3b-de2d-4f24-8335-2c66e01d0bf7\") " pod="openshift-multus/multus-4g2lc"
Jul 14 19:51:42.916839 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:42.914944    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/1a276f3b-de2d-4f24-8335-2c66e01d0bf7-host-var-lib-cni-multus\") pod \"multus-4g2lc\" (UID: \"1a276f3b-de2d-4f24-8335-2c66e01d0bf7\") " pod="openshift-multus/multus-4g2lc"
Jul 14 19:51:42.916839 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:42.914955    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/47390bed-f864-4a3b-ac65-960f504af7f1-etc-systemd\") pod \"tuned-sdxvb\" (UID: \"47390bed-f864-4a3b-ac65-960f504af7f1\") " pod="openshift-cluster-node-tuning-operator/tuned-sdxvb"
Jul 14 19:51:42.916839 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:42.914969    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/1a276f3b-de2d-4f24-8335-2c66e01d0bf7-host-run-multus-certs\") pod \"multus-4g2lc\" (UID: \"1a276f3b-de2d-4f24-8335-2c66e01d0bf7\") " pod="openshift-multus/multus-4g2lc"
Jul 14 19:51:42.916839 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:42.914984    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nfpvb\" (UniqueName: \"kubernetes.io/projected/1a276f3b-de2d-4f24-8335-2c66e01d0bf7-kube-api-access-nfpvb\") pod \"multus-4g2lc\" (UID: \"1a276f3b-de2d-4f24-8335-2c66e01d0bf7\") " pod="openshift-multus/multus-4g2lc"
Jul 14 19:51:42.916839 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:42.914991    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/b0492caa-150a-47bd-b74d-60fa9de0c173-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-ks4zn\" (UID: \"b0492caa-150a-47bd-b74d-60fa9de0c173\") " pod="openshift-multus/multus-additional-cni-plugins-ks4zn"
Jul 14 19:51:42.916839 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:42.915008    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/47390bed-f864-4a3b-ac65-960f504af7f1-etc-tuned\") pod \"tuned-sdxvb\" (UID: \"47390bed-f864-4a3b-ac65-960f504af7f1\") " pod="openshift-cluster-node-tuning-operator/tuned-sdxvb"
Jul 14 19:51:42.916839 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:42.915023    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/1a276f3b-de2d-4f24-8335-2c66e01d0bf7-multus-socket-dir-parent\") pod \"multus-4g2lc\" (UID: \"1a276f3b-de2d-4f24-8335-2c66e01d0bf7\") " pod="openshift-multus/multus-4g2lc"
Jul 14 19:51:42.916839 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:42.915031    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/47390bed-f864-4a3b-ac65-960f504af7f1-etc-systemd\") pod \"tuned-sdxvb\" (UID: \"47390bed-f864-4a3b-ac65-960f504af7f1\") " pod="openshift-cluster-node-tuning-operator/tuned-sdxvb"
Jul 14 19:51:42.916839 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:42.915417    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/f18327eb-f774-4f26-b798-5628c0dd01ad-konnectivity-ca\") pod \"konnectivity-agent-nb29m\" (UID: \"f18327eb-f774-4f26-b798-5628c0dd01ad\") " pod="kube-system/konnectivity-agent-nb29m"
Jul 14 19:51:42.916839 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:42.915552    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/1f7b0ae1-bc82-4d4a-b9ae-63de08fd2d96-iptables-alerter-script\") pod \"iptables-alerter-8ss2c\" (UID: \"1f7b0ae1-bc82-4d4a-b9ae-63de08fd2d96\") " pod="openshift-network-operator/iptables-alerter-8ss2c"
Jul 14 19:51:42.917211 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:42.917197    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/47390bed-f864-4a3b-ac65-960f504af7f1-tmp\") pod \"tuned-sdxvb\" (UID: \"47390bed-f864-4a3b-ac65-960f504af7f1\") " pod="openshift-cluster-node-tuning-operator/tuned-sdxvb"
Jul 14 19:51:42.917764 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:42.917742    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/f18327eb-f774-4f26-b798-5628c0dd01ad-agent-certs\") pod \"konnectivity-agent-nb29m\" (UID: \"f18327eb-f774-4f26-b798-5628c0dd01ad\") " pod="kube-system/konnectivity-agent-nb29m"
Jul 14 19:51:42.917848 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:42.917817    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/47390bed-f864-4a3b-ac65-960f504af7f1-etc-tuned\") pod \"tuned-sdxvb\" (UID: \"47390bed-f864-4a3b-ac65-960f504af7f1\") " pod="openshift-cluster-node-tuning-operator/tuned-sdxvb"
Jul 14 19:51:42.924278 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:42.924239    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nfpvb\" (UniqueName: \"kubernetes.io/projected/1a276f3b-de2d-4f24-8335-2c66e01d0bf7-kube-api-access-nfpvb\") pod \"multus-4g2lc\" (UID: \"1a276f3b-de2d-4f24-8335-2c66e01d0bf7\") " pod="openshift-multus/multus-4g2lc"
Jul 14 19:51:42.924408 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:42.924333    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-859nr\" (UniqueName: \"kubernetes.io/projected/47390bed-f864-4a3b-ac65-960f504af7f1-kube-api-access-859nr\") pod \"tuned-sdxvb\" (UID: \"47390bed-f864-4a3b-ac65-960f504af7f1\") " pod="openshift-cluster-node-tuning-operator/tuned-sdxvb"
Jul 14 19:51:42.924628 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:42.924593    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zstwf\" (UniqueName: \"kubernetes.io/projected/9aa72835-977f-4b04-9858-7d623eda0254-kube-api-access-zstwf\") pod \"network-metrics-daemon-f52k9\" (UID: \"9aa72835-977f-4b04-9858-7d623eda0254\") " pod="openshift-multus/network-metrics-daemon-f52k9"
Jul 14 19:51:42.924711 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:42.924665    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-npj8p\" (UniqueName: \"kubernetes.io/projected/1f7b0ae1-bc82-4d4a-b9ae-63de08fd2d96-kube-api-access-npj8p\") pod \"iptables-alerter-8ss2c\" (UID: \"1f7b0ae1-bc82-4d4a-b9ae-63de08fd2d96\") " pod="openshift-network-operator/iptables-alerter-8ss2c"
Jul 14 19:51:42.924991 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:42.924973    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-66lv4\" (UniqueName: \"kubernetes.io/projected/b0492caa-150a-47bd-b74d-60fa9de0c173-kube-api-access-66lv4\") pod \"multus-additional-cni-plugins-ks4zn\" (UID: \"b0492caa-150a-47bd-b74d-60fa9de0c173\") " pod="openshift-multus/multus-additional-cni-plugins-ks4zn"
Jul 14 19:51:42.996436 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:42.996329    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-4qscd"
Jul 14 19:51:43.002418 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:43.002397    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-q4xzw"
Jul 14 19:51:43.009387 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:51:43.009336    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod209b5a52_9d80_45ca_9c92_63578a945220.slice/crio-250330039f6103cd6638828822b7310661832a7f0ff209173494dd1de21c5684 WatchSource:0}: Error finding container 250330039f6103cd6638828822b7310661832a7f0ff209173494dd1de21c5684: Status 404 returned error can't find the container with id 250330039f6103cd6638828822b7310661832a7f0ff209173494dd1de21c5684
Jul 14 19:51:43.010630 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:43.010605    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-gb26w"
Jul 14 19:51:43.013442 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:51:43.013418    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podef54193c_7659_4e47_87ac_4d129d22a268.slice/crio-6125e0611ef73ed3c7100800f99fa04f36bcca6d750e4dd2b897d9e2fbe2be4f WatchSource:0}: Error finding container 6125e0611ef73ed3c7100800f99fa04f36bcca6d750e4dd2b897d9e2fbe2be4f: Status 404 returned error can't find the container with id 6125e0611ef73ed3c7100800f99fa04f36bcca6d750e4dd2b897d9e2fbe2be4f
Jul 14 19:51:43.015045 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:43.015024    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fkcxq"
Jul 14 19:51:43.019815 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:51:43.019786    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1ea2bd9d_b2c3_42ce_a0ee_c3719d4f048e.slice/crio-7600f5500aaab828edc9db822fe2ec1c438f5ec5b9ff9672eaf84124092a3b4d WatchSource:0}: Error finding container 7600f5500aaab828edc9db822fe2ec1c438f5ec5b9ff9672eaf84124092a3b4d: Status 404 returned error can't find the container with id 7600f5500aaab828edc9db822fe2ec1c438f5ec5b9ff9672eaf84124092a3b4d
Jul 14 19:51:43.020964 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:43.020942    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-4g2lc"
Jul 14 19:51:43.025167 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:51:43.025142    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2d58ec38_5f18_4d79_9df1_06c13bd595c3.slice/crio-2e8502db070dfc34ff000b75e1f7fe5050615b0fa3793f0758389402cb299e79 WatchSource:0}: Error finding container 2e8502db070dfc34ff000b75e1f7fe5050615b0fa3793f0758389402cb299e79: Status 404 returned error can't find the container with id 2e8502db070dfc34ff000b75e1f7fe5050615b0fa3793f0758389402cb299e79
Jul 14 19:51:43.026739 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:43.026644    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-sdxvb"
Jul 14 19:51:43.031527 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:51:43.031494    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1a276f3b_de2d_4f24_8335_2c66e01d0bf7.slice/crio-f31154d94ecb5034fb4b58a9dfe4b54d389a805f0dc87ac6304e498ee8be8217 WatchSource:0}: Error finding container f31154d94ecb5034fb4b58a9dfe4b54d389a805f0dc87ac6304e498ee8be8217: Status 404 returned error can't find the container with id f31154d94ecb5034fb4b58a9dfe4b54d389a805f0dc87ac6304e498ee8be8217
Jul 14 19:51:43.033086 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:43.033067    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-8ss2c"
Jul 14 19:51:43.038622 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:43.038598    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-ks4zn"
Jul 14 19:51:43.039394 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:51:43.039369    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod47390bed_f864_4a3b_ac65_960f504af7f1.slice/crio-e78b0c4c17335c53870dcf0e81ea71556b6b083c17effe2f96c0d469443a20aa WatchSource:0}: Error finding container e78b0c4c17335c53870dcf0e81ea71556b6b083c17effe2f96c0d469443a20aa: Status 404 returned error can't find the container with id e78b0c4c17335c53870dcf0e81ea71556b6b083c17effe2f96c0d469443a20aa
Jul 14 19:51:43.043722 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:43.043695    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-nb29m"
Jul 14 19:51:43.043984 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:51:43.043961    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1f7b0ae1_bc82_4d4a_b9ae_63de08fd2d96.slice/crio-d0a880b2a91304a31cd5fe19372bb023c500a11b3cfa86edc08e214c6041f6cf WatchSource:0}: Error finding container d0a880b2a91304a31cd5fe19372bb023c500a11b3cfa86edc08e214c6041f6cf: Status 404 returned error can't find the container with id d0a880b2a91304a31cd5fe19372bb023c500a11b3cfa86edc08e214c6041f6cf
Jul 14 19:51:43.049432 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:51:43.049410    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb0492caa_150a_47bd_b74d_60fa9de0c173.slice/crio-39de83ca373a18dda624f61da0b7add7e1f70f3928238ba75ebae042f9f44796 WatchSource:0}: Error finding container 39de83ca373a18dda624f61da0b7add7e1f70f3928238ba75ebae042f9f44796: Status 404 returned error can't find the container with id 39de83ca373a18dda624f61da0b7add7e1f70f3928238ba75ebae042f9f44796
Jul 14 19:51:43.057013 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:51:43.056983    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf18327eb_f774_4f26_b798_5628c0dd01ad.slice/crio-054b35211e62e95ed14ec0c9e74f8cfe5491647848e837558f7bfa238d5a4e23 WatchSource:0}: Error finding container 054b35211e62e95ed14ec0c9e74f8cfe5491647848e837558f7bfa238d5a4e23: Status 404 returned error can't find the container with id 054b35211e62e95ed14ec0c9e74f8cfe5491647848e837558f7bfa238d5a4e23
Jul 14 19:51:43.317123 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:43.317012    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vcnzp\" (UniqueName: \"kubernetes.io/projected/48340033-b0f1-4d8d-b7fd-b6bb6ddddd8b-kube-api-access-vcnzp\") pod \"network-check-target-xk8l4\" (UID: \"48340033-b0f1-4d8d-b7fd-b6bb6ddddd8b\") " pod="openshift-network-diagnostics/network-check-target-xk8l4"
Jul 14 19:51:43.317274 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:43.317126    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1993baf5-1337-4873-acf4-fd40ade89975-original-pull-secret\") pod \"global-pull-secret-syncer-d8x6z\" (UID: \"1993baf5-1337-4873-acf4-fd40ade89975\") " pod="kube-system/global-pull-secret-syncer-d8x6z"
Jul 14 19:51:43.317274 ip-10-0-140-201 kubenswrapper[2579]: E0714 19:51:43.317188    2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 14 19:51:43.317274 ip-10-0-140-201 kubenswrapper[2579]: E0714 19:51:43.317218    2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 14 19:51:43.317274 ip-10-0-140-201 kubenswrapper[2579]: E0714 19:51:43.317233    2579 projected.go:196] Error preparing data for projected volume kube-api-access-vcnzp for pod openshift-network-diagnostics/network-check-target-xk8l4: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 14 19:51:43.317274 ip-10-0-140-201 kubenswrapper[2579]: E0714 19:51:43.317243    2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 14 19:51:43.317445 ip-10-0-140-201 kubenswrapper[2579]: E0714 19:51:43.317292    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/48340033-b0f1-4d8d-b7fd-b6bb6ddddd8b-kube-api-access-vcnzp podName:48340033-b0f1-4d8d-b7fd-b6bb6ddddd8b nodeName:}" failed. No retries permitted until 2026-07-14 19:51:44.317277061 +0000 UTC m=+4.028872588 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-vcnzp" (UniqueName: "kubernetes.io/projected/48340033-b0f1-4d8d-b7fd-b6bb6ddddd8b-kube-api-access-vcnzp") pod "network-check-target-xk8l4" (UID: "48340033-b0f1-4d8d-b7fd-b6bb6ddddd8b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 14 19:51:43.317445 ip-10-0-140-201 kubenswrapper[2579]: E0714 19:51:43.317311    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1993baf5-1337-4873-acf4-fd40ade89975-original-pull-secret podName:1993baf5-1337-4873-acf4-fd40ade89975 nodeName:}" failed. No retries permitted until 2026-07-14 19:51:44.317301579 +0000 UTC m=+4.028897107 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/1993baf5-1337-4873-acf4-fd40ade89975-original-pull-secret") pod "global-pull-secret-syncer-d8x6z" (UID: "1993baf5-1337-4873-acf4-fd40ade89975") : object "kube-system"/"original-pull-secret" not registered
Jul 14 19:51:43.418125 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:43.418074    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9aa72835-977f-4b04-9858-7d623eda0254-metrics-certs\") pod \"network-metrics-daemon-f52k9\" (UID: \"9aa72835-977f-4b04-9858-7d623eda0254\") " pod="openshift-multus/network-metrics-daemon-f52k9"
Jul 14 19:51:43.418308 ip-10-0-140-201 kubenswrapper[2579]: E0714 19:51:43.418245    2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 14 19:51:43.418361 ip-10-0-140-201 kubenswrapper[2579]: E0714 19:51:43.418332    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9aa72835-977f-4b04-9858-7d623eda0254-metrics-certs podName:9aa72835-977f-4b04-9858-7d623eda0254 nodeName:}" failed. No retries permitted until 2026-07-14 19:51:44.418310463 +0000 UTC m=+4.129906006 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9aa72835-977f-4b04-9858-7d623eda0254-metrics-certs") pod "network-metrics-daemon-f52k9" (UID: "9aa72835-977f-4b04-9858-7d623eda0254") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 14 19:51:43.750492 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:43.750368    2579 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-13 19:46:43 +0000 UTC" deadline="2028-01-14 13:23:27.639169001 +0000 UTC"
Jul 14 19:51:43.750492 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:43.750440    2579 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13169h31m43.888733566s"
Jul 14 19:51:43.841798 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:43.841762    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-f52k9"
Jul 14 19:51:43.841985 ip-10-0-140-201 kubenswrapper[2579]: E0714 19:51:43.841917    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-f52k9" podUID="9aa72835-977f-4b04-9858-7d623eda0254"
Jul 14 19:51:43.854548 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:43.854500    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-nb29m" event={"ID":"f18327eb-f774-4f26-b798-5628c0dd01ad","Type":"ContainerStarted","Data":"054b35211e62e95ed14ec0c9e74f8cfe5491647848e837558f7bfa238d5a4e23"}
Jul 14 19:51:43.856478 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:43.856442    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-ks4zn" event={"ID":"b0492caa-150a-47bd-b74d-60fa9de0c173","Type":"ContainerStarted","Data":"39de83ca373a18dda624f61da0b7add7e1f70f3928238ba75ebae042f9f44796"}
Jul 14 19:51:43.861164 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:43.861091    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fkcxq" event={"ID":"2d58ec38-5f18-4d79-9df1-06c13bd595c3","Type":"ContainerStarted","Data":"2e8502db070dfc34ff000b75e1f7fe5050615b0fa3793f0758389402cb299e79"}
Jul 14 19:51:43.863112 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:43.863051    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-4qscd" event={"ID":"209b5a52-9d80-45ca-9c92-63578a945220","Type":"ContainerStarted","Data":"250330039f6103cd6638828822b7310661832a7f0ff209173494dd1de21c5684"}
Jul 14 19:51:43.864712 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:43.864685    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-8ss2c" event={"ID":"1f7b0ae1-bc82-4d4a-b9ae-63de08fd2d96","Type":"ContainerStarted","Data":"d0a880b2a91304a31cd5fe19372bb023c500a11b3cfa86edc08e214c6041f6cf"}
Jul 14 19:51:43.866431 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:43.866405    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-sdxvb" event={"ID":"47390bed-f864-4a3b-ac65-960f504af7f1","Type":"ContainerStarted","Data":"e78b0c4c17335c53870dcf0e81ea71556b6b083c17effe2f96c0d469443a20aa"}
Jul 14 19:51:43.871419 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:43.871383    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-4g2lc" event={"ID":"1a276f3b-de2d-4f24-8335-2c66e01d0bf7","Type":"ContainerStarted","Data":"f31154d94ecb5034fb4b58a9dfe4b54d389a805f0dc87ac6304e498ee8be8217"}
Jul 14 19:51:43.873833 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:43.873805    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-gb26w" event={"ID":"1ea2bd9d-b2c3-42ce-a0ee-c3719d4f048e","Type":"ContainerStarted","Data":"7600f5500aaab828edc9db822fe2ec1c438f5ec5b9ff9672eaf84124092a3b4d"}
Jul 14 19:51:43.875226 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:43.875200    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-q4xzw" event={"ID":"ef54193c-7659-4e47-87ac-4d129d22a268","Type":"ContainerStarted","Data":"6125e0611ef73ed3c7100800f99fa04f36bcca6d750e4dd2b897d9e2fbe2be4f"}
Jul 14 19:51:44.227675 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:51:44.227622    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf7485cdaac307b25b08583eb8c5cef91.slice/crio-66a0c713e06933fa2ceef91597a87816fc2203f56f197493d5b86eff0dd07e33 WatchSource:0}: Error finding container 66a0c713e06933fa2ceef91597a87816fc2203f56f197493d5b86eff0dd07e33: Status 404 returned error can't find the container with id 66a0c713e06933fa2ceef91597a87816fc2203f56f197493d5b86eff0dd07e33
Jul 14 19:51:44.327900 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:44.326977    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1993baf5-1337-4873-acf4-fd40ade89975-original-pull-secret\") pod \"global-pull-secret-syncer-d8x6z\" (UID: \"1993baf5-1337-4873-acf4-fd40ade89975\") " pod="kube-system/global-pull-secret-syncer-d8x6z"
Jul 14 19:51:44.327900 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:44.327049    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vcnzp\" (UniqueName: \"kubernetes.io/projected/48340033-b0f1-4d8d-b7fd-b6bb6ddddd8b-kube-api-access-vcnzp\") pod \"network-check-target-xk8l4\" (UID: \"48340033-b0f1-4d8d-b7fd-b6bb6ddddd8b\") " pod="openshift-network-diagnostics/network-check-target-xk8l4"
Jul 14 19:51:44.327900 ip-10-0-140-201 kubenswrapper[2579]: E0714 19:51:44.327226    2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 14 19:51:44.327900 ip-10-0-140-201 kubenswrapper[2579]: E0714 19:51:44.327247    2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 14 19:51:44.327900 ip-10-0-140-201 kubenswrapper[2579]: E0714 19:51:44.327261    2579 projected.go:196] Error preparing data for projected volume kube-api-access-vcnzp for pod openshift-network-diagnostics/network-check-target-xk8l4: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 14 19:51:44.327900 ip-10-0-140-201 kubenswrapper[2579]: E0714 19:51:44.327335    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/48340033-b0f1-4d8d-b7fd-b6bb6ddddd8b-kube-api-access-vcnzp podName:48340033-b0f1-4d8d-b7fd-b6bb6ddddd8b nodeName:}" failed. No retries permitted until 2026-07-14 19:51:46.327314071 +0000 UTC m=+6.038909611 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-vcnzp" (UniqueName: "kubernetes.io/projected/48340033-b0f1-4d8d-b7fd-b6bb6ddddd8b-kube-api-access-vcnzp") pod "network-check-target-xk8l4" (UID: "48340033-b0f1-4d8d-b7fd-b6bb6ddddd8b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 14 19:51:44.327900 ip-10-0-140-201 kubenswrapper[2579]: E0714 19:51:44.327785    2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 14 19:51:44.327900 ip-10-0-140-201 kubenswrapper[2579]: E0714 19:51:44.327854    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1993baf5-1337-4873-acf4-fd40ade89975-original-pull-secret podName:1993baf5-1337-4873-acf4-fd40ade89975 nodeName:}" failed. No retries permitted until 2026-07-14 19:51:46.327825562 +0000 UTC m=+6.039421100 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/1993baf5-1337-4873-acf4-fd40ade89975-original-pull-secret") pod "global-pull-secret-syncer-d8x6z" (UID: "1993baf5-1337-4873-acf4-fd40ade89975") : object "kube-system"/"original-pull-secret" not registered
Jul 14 19:51:44.428209 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:44.428176    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9aa72835-977f-4b04-9858-7d623eda0254-metrics-certs\") pod \"network-metrics-daemon-f52k9\" (UID: \"9aa72835-977f-4b04-9858-7d623eda0254\") " pod="openshift-multus/network-metrics-daemon-f52k9"
Jul 14 19:51:44.428391 ip-10-0-140-201 kubenswrapper[2579]: E0714 19:51:44.428304    2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 14 19:51:44.428391 ip-10-0-140-201 kubenswrapper[2579]: E0714 19:51:44.428358    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9aa72835-977f-4b04-9858-7d623eda0254-metrics-certs podName:9aa72835-977f-4b04-9858-7d623eda0254 nodeName:}" failed. No retries permitted until 2026-07-14 19:51:46.42834348 +0000 UTC m=+6.139939003 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9aa72835-977f-4b04-9858-7d623eda0254-metrics-certs") pod "network-metrics-daemon-f52k9" (UID: "9aa72835-977f-4b04-9858-7d623eda0254") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 14 19:51:44.751053 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:44.750994    2579 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-13 19:46:43 +0000 UTC" deadline="2028-02-14 19:54:18.741195813 +0000 UTC"
Jul 14 19:51:44.751053 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:44.751035    2579 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13920h2m33.990165976s"
Jul 14 19:51:44.844746 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:44.844716    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xk8l4"
Jul 14 19:51:44.844927 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:44.844723    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-d8x6z"
Jul 14 19:51:44.844927 ip-10-0-140-201 kubenswrapper[2579]: E0714 19:51:44.844862    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xk8l4" podUID="48340033-b0f1-4d8d-b7fd-b6bb6ddddd8b"
Jul 14 19:51:44.844927 ip-10-0-140-201 kubenswrapper[2579]: E0714 19:51:44.844909    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-d8x6z" podUID="1993baf5-1337-4873-acf4-fd40ade89975"
Jul 14 19:51:44.880835 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:44.880786    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-201.ec2.internal" event={"ID":"f7485cdaac307b25b08583eb8c5cef91","Type":"ContainerStarted","Data":"66a0c713e06933fa2ceef91597a87816fc2203f56f197493d5b86eff0dd07e33"}
Jul 14 19:51:45.842031 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:45.841996    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-f52k9"
Jul 14 19:51:45.842420 ip-10-0-140-201 kubenswrapper[2579]: E0714 19:51:45.842168    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-f52k9" podUID="9aa72835-977f-4b04-9858-7d623eda0254"
Jul 14 19:51:46.347099 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:46.347056    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1993baf5-1337-4873-acf4-fd40ade89975-original-pull-secret\") pod \"global-pull-secret-syncer-d8x6z\" (UID: \"1993baf5-1337-4873-acf4-fd40ade89975\") " pod="kube-system/global-pull-secret-syncer-d8x6z"
Jul 14 19:51:46.347280 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:46.347116    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vcnzp\" (UniqueName: \"kubernetes.io/projected/48340033-b0f1-4d8d-b7fd-b6bb6ddddd8b-kube-api-access-vcnzp\") pod \"network-check-target-xk8l4\" (UID: \"48340033-b0f1-4d8d-b7fd-b6bb6ddddd8b\") " pod="openshift-network-diagnostics/network-check-target-xk8l4"
Jul 14 19:51:46.347348 ip-10-0-140-201 kubenswrapper[2579]: E0714 19:51:46.347321    2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 14 19:51:46.347441 ip-10-0-140-201 kubenswrapper[2579]: E0714 19:51:46.347424    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1993baf5-1337-4873-acf4-fd40ade89975-original-pull-secret podName:1993baf5-1337-4873-acf4-fd40ade89975 nodeName:}" failed. No retries permitted until 2026-07-14 19:51:50.347385047 +0000 UTC m=+10.058980577 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/1993baf5-1337-4873-acf4-fd40ade89975-original-pull-secret") pod "global-pull-secret-syncer-d8x6z" (UID: "1993baf5-1337-4873-acf4-fd40ade89975") : object "kube-system"/"original-pull-secret" not registered
Jul 14 19:51:46.347627 ip-10-0-140-201 kubenswrapper[2579]: E0714 19:51:46.347610    2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 14 19:51:46.347712 ip-10-0-140-201 kubenswrapper[2579]: E0714 19:51:46.347630    2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 14 19:51:46.347712 ip-10-0-140-201 kubenswrapper[2579]: E0714 19:51:46.347644    2579 projected.go:196] Error preparing data for projected volume kube-api-access-vcnzp for pod openshift-network-diagnostics/network-check-target-xk8l4: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 14 19:51:46.347712 ip-10-0-140-201 kubenswrapper[2579]: E0714 19:51:46.347689    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/48340033-b0f1-4d8d-b7fd-b6bb6ddddd8b-kube-api-access-vcnzp podName:48340033-b0f1-4d8d-b7fd-b6bb6ddddd8b nodeName:}" failed. No retries permitted until 2026-07-14 19:51:50.347675893 +0000 UTC m=+10.059271419 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-vcnzp" (UniqueName: "kubernetes.io/projected/48340033-b0f1-4d8d-b7fd-b6bb6ddddd8b-kube-api-access-vcnzp") pod "network-check-target-xk8l4" (UID: "48340033-b0f1-4d8d-b7fd-b6bb6ddddd8b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 14 19:51:46.449540 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:46.448842    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9aa72835-977f-4b04-9858-7d623eda0254-metrics-certs\") pod \"network-metrics-daemon-f52k9\" (UID: \"9aa72835-977f-4b04-9858-7d623eda0254\") " pod="openshift-multus/network-metrics-daemon-f52k9"
Jul 14 19:51:46.449540 ip-10-0-140-201 kubenswrapper[2579]: E0714 19:51:46.449045    2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 14 19:51:46.449540 ip-10-0-140-201 kubenswrapper[2579]: E0714 19:51:46.449112    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9aa72835-977f-4b04-9858-7d623eda0254-metrics-certs podName:9aa72835-977f-4b04-9858-7d623eda0254 nodeName:}" failed. No retries permitted until 2026-07-14 19:51:50.449090375 +0000 UTC m=+10.160685902 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9aa72835-977f-4b04-9858-7d623eda0254-metrics-certs") pod "network-metrics-daemon-f52k9" (UID: "9aa72835-977f-4b04-9858-7d623eda0254") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 14 19:51:46.842232 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:46.841645    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xk8l4"
Jul 14 19:51:46.842232 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:46.841665    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-d8x6z"
Jul 14 19:51:46.842232 ip-10-0-140-201 kubenswrapper[2579]: E0714 19:51:46.841789    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xk8l4" podUID="48340033-b0f1-4d8d-b7fd-b6bb6ddddd8b"
Jul 14 19:51:46.842232 ip-10-0-140-201 kubenswrapper[2579]: E0714 19:51:46.841971    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-d8x6z" podUID="1993baf5-1337-4873-acf4-fd40ade89975"
Jul 14 19:51:47.842783 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:47.842231    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-f52k9"
Jul 14 19:51:47.842783 ip-10-0-140-201 kubenswrapper[2579]: E0714 19:51:47.842381    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-f52k9" podUID="9aa72835-977f-4b04-9858-7d623eda0254"
Jul 14 19:51:48.842830 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:48.842791    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xk8l4"
Jul 14 19:51:48.842830 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:48.842832    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-d8x6z"
Jul 14 19:51:48.843334 ip-10-0-140-201 kubenswrapper[2579]: E0714 19:51:48.842941    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xk8l4" podUID="48340033-b0f1-4d8d-b7fd-b6bb6ddddd8b"
Jul 14 19:51:48.843334 ip-10-0-140-201 kubenswrapper[2579]: E0714 19:51:48.843256    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-d8x6z" podUID="1993baf5-1337-4873-acf4-fd40ade89975"
Jul 14 19:51:49.842235 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:49.842140    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-f52k9"
Jul 14 19:51:49.842436 ip-10-0-140-201 kubenswrapper[2579]: E0714 19:51:49.842291    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-f52k9" podUID="9aa72835-977f-4b04-9858-7d623eda0254"
Jul 14 19:51:50.384760 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:50.384728    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1993baf5-1337-4873-acf4-fd40ade89975-original-pull-secret\") pod \"global-pull-secret-syncer-d8x6z\" (UID: \"1993baf5-1337-4873-acf4-fd40ade89975\") " pod="kube-system/global-pull-secret-syncer-d8x6z"
Jul 14 19:51:50.385175 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:50.384778    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vcnzp\" (UniqueName: \"kubernetes.io/projected/48340033-b0f1-4d8d-b7fd-b6bb6ddddd8b-kube-api-access-vcnzp\") pod \"network-check-target-xk8l4\" (UID: \"48340033-b0f1-4d8d-b7fd-b6bb6ddddd8b\") " pod="openshift-network-diagnostics/network-check-target-xk8l4"
Jul 14 19:51:50.385175 ip-10-0-140-201 kubenswrapper[2579]: E0714 19:51:50.384940    2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 14 19:51:50.385175 ip-10-0-140-201 kubenswrapper[2579]: E0714 19:51:50.384960    2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 14 19:51:50.385175 ip-10-0-140-201 kubenswrapper[2579]: E0714 19:51:50.384971    2579 projected.go:196] Error preparing data for projected volume kube-api-access-vcnzp for pod openshift-network-diagnostics/network-check-target-xk8l4: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 14 19:51:50.385175 ip-10-0-140-201 kubenswrapper[2579]: E0714 19:51:50.385025    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/48340033-b0f1-4d8d-b7fd-b6bb6ddddd8b-kube-api-access-vcnzp podName:48340033-b0f1-4d8d-b7fd-b6bb6ddddd8b nodeName:}" failed. No retries permitted until 2026-07-14 19:51:58.385006837 +0000 UTC m=+18.096602363 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-vcnzp" (UniqueName: "kubernetes.io/projected/48340033-b0f1-4d8d-b7fd-b6bb6ddddd8b-kube-api-access-vcnzp") pod "network-check-target-xk8l4" (UID: "48340033-b0f1-4d8d-b7fd-b6bb6ddddd8b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 14 19:51:50.385509 ip-10-0-140-201 kubenswrapper[2579]: E0714 19:51:50.385392    2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 14 19:51:50.385509 ip-10-0-140-201 kubenswrapper[2579]: E0714 19:51:50.385442    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1993baf5-1337-4873-acf4-fd40ade89975-original-pull-secret podName:1993baf5-1337-4873-acf4-fd40ade89975 nodeName:}" failed. No retries permitted until 2026-07-14 19:51:58.385425245 +0000 UTC m=+18.097020771 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/1993baf5-1337-4873-acf4-fd40ade89975-original-pull-secret") pod "global-pull-secret-syncer-d8x6z" (UID: "1993baf5-1337-4873-acf4-fd40ade89975") : object "kube-system"/"original-pull-secret" not registered
Jul 14 19:51:50.485165 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:50.485129    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9aa72835-977f-4b04-9858-7d623eda0254-metrics-certs\") pod \"network-metrics-daemon-f52k9\" (UID: \"9aa72835-977f-4b04-9858-7d623eda0254\") " pod="openshift-multus/network-metrics-daemon-f52k9"
Jul 14 19:51:50.485349 ip-10-0-140-201 kubenswrapper[2579]: E0714 19:51:50.485316    2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 14 19:51:50.485417 ip-10-0-140-201 kubenswrapper[2579]: E0714 19:51:50.485381    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9aa72835-977f-4b04-9858-7d623eda0254-metrics-certs podName:9aa72835-977f-4b04-9858-7d623eda0254 nodeName:}" failed. No retries permitted until 2026-07-14 19:51:58.485360897 +0000 UTC m=+18.196956422 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9aa72835-977f-4b04-9858-7d623eda0254-metrics-certs") pod "network-metrics-daemon-f52k9" (UID: "9aa72835-977f-4b04-9858-7d623eda0254") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 14 19:51:50.842942 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:50.842849    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xk8l4"
Jul 14 19:51:50.843083 ip-10-0-140-201 kubenswrapper[2579]: E0714 19:51:50.842995    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xk8l4" podUID="48340033-b0f1-4d8d-b7fd-b6bb6ddddd8b"
Jul 14 19:51:50.843550 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:50.843508    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-d8x6z"
Jul 14 19:51:50.843812 ip-10-0-140-201 kubenswrapper[2579]: E0714 19:51:50.843783    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-d8x6z" podUID="1993baf5-1337-4873-acf4-fd40ade89975"
Jul 14 19:51:51.841417 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:51.841381    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-f52k9"
Jul 14 19:51:51.841962 ip-10-0-140-201 kubenswrapper[2579]: E0714 19:51:51.841550    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-f52k9" podUID="9aa72835-977f-4b04-9858-7d623eda0254"
Jul 14 19:51:52.841611 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:52.841564    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xk8l4"
Jul 14 19:51:52.842079 ip-10-0-140-201 kubenswrapper[2579]: E0714 19:51:52.841718    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xk8l4" podUID="48340033-b0f1-4d8d-b7fd-b6bb6ddddd8b"
Jul 14 19:51:52.842079 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:52.841847    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-d8x6z"
Jul 14 19:51:52.842079 ip-10-0-140-201 kubenswrapper[2579]: E0714 19:51:52.841947    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-d8x6z" podUID="1993baf5-1337-4873-acf4-fd40ade89975"
Jul 14 19:51:53.841726 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:53.841692    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-f52k9"
Jul 14 19:51:53.842172 ip-10-0-140-201 kubenswrapper[2579]: E0714 19:51:53.841858    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-f52k9" podUID="9aa72835-977f-4b04-9858-7d623eda0254"
Jul 14 19:51:54.842028 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:54.841993    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-d8x6z"
Jul 14 19:51:54.842491 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:54.841993    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xk8l4"
Jul 14 19:51:54.842491 ip-10-0-140-201 kubenswrapper[2579]: E0714 19:51:54.842138    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-d8x6z" podUID="1993baf5-1337-4873-acf4-fd40ade89975"
Jul 14 19:51:54.842491 ip-10-0-140-201 kubenswrapper[2579]: E0714 19:51:54.842208    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xk8l4" podUID="48340033-b0f1-4d8d-b7fd-b6bb6ddddd8b"
Jul 14 19:51:55.842022 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:55.841978    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-f52k9"
Jul 14 19:51:55.842189 ip-10-0-140-201 kubenswrapper[2579]: E0714 19:51:55.842134    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-f52k9" podUID="9aa72835-977f-4b04-9858-7d623eda0254"
Jul 14 19:51:56.841670 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:56.841578    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xk8l4"
Jul 14 19:51:56.841670 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:56.841616    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-d8x6z"
Jul 14 19:51:56.841873 ip-10-0-140-201 kubenswrapper[2579]: E0714 19:51:56.841713    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xk8l4" podUID="48340033-b0f1-4d8d-b7fd-b6bb6ddddd8b"
Jul 14 19:51:56.841873 ip-10-0-140-201 kubenswrapper[2579]: E0714 19:51:56.841832    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-d8x6z" podUID="1993baf5-1337-4873-acf4-fd40ade89975"
Jul 14 19:51:57.841907 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:57.841649    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-f52k9"
Jul 14 19:51:57.842279 ip-10-0-140-201 kubenswrapper[2579]: E0714 19:51:57.842034    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-f52k9" podUID="9aa72835-977f-4b04-9858-7d623eda0254"
Jul 14 19:51:58.454203 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:58.454165    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1993baf5-1337-4873-acf4-fd40ade89975-original-pull-secret\") pod \"global-pull-secret-syncer-d8x6z\" (UID: \"1993baf5-1337-4873-acf4-fd40ade89975\") " pod="kube-system/global-pull-secret-syncer-d8x6z"
Jul 14 19:51:58.454394 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:58.454218    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vcnzp\" (UniqueName: \"kubernetes.io/projected/48340033-b0f1-4d8d-b7fd-b6bb6ddddd8b-kube-api-access-vcnzp\") pod \"network-check-target-xk8l4\" (UID: \"48340033-b0f1-4d8d-b7fd-b6bb6ddddd8b\") " pod="openshift-network-diagnostics/network-check-target-xk8l4"
Jul 14 19:51:58.454394 ip-10-0-140-201 kubenswrapper[2579]: E0714 19:51:58.454344    2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 14 19:51:58.454394 ip-10-0-140-201 kubenswrapper[2579]: E0714 19:51:58.454359    2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 14 19:51:58.454394 ip-10-0-140-201 kubenswrapper[2579]: E0714 19:51:58.454376    2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 14 19:51:58.454394 ip-10-0-140-201 kubenswrapper[2579]: E0714 19:51:58.454389    2579 projected.go:196] Error preparing data for projected volume kube-api-access-vcnzp for pod openshift-network-diagnostics/network-check-target-xk8l4: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 14 19:51:58.454650 ip-10-0-140-201 kubenswrapper[2579]: E0714 19:51:58.454418    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1993baf5-1337-4873-acf4-fd40ade89975-original-pull-secret podName:1993baf5-1337-4873-acf4-fd40ade89975 nodeName:}" failed. No retries permitted until 2026-07-14 19:52:14.454401158 +0000 UTC m=+34.165996680 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/1993baf5-1337-4873-acf4-fd40ade89975-original-pull-secret") pod "global-pull-secret-syncer-d8x6z" (UID: "1993baf5-1337-4873-acf4-fd40ade89975") : object "kube-system"/"original-pull-secret" not registered
Jul 14 19:51:58.454650 ip-10-0-140-201 kubenswrapper[2579]: E0714 19:51:58.454439    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/48340033-b0f1-4d8d-b7fd-b6bb6ddddd8b-kube-api-access-vcnzp podName:48340033-b0f1-4d8d-b7fd-b6bb6ddddd8b nodeName:}" failed. No retries permitted until 2026-07-14 19:52:14.454423511 +0000 UTC m=+34.166019034 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-vcnzp" (UniqueName: "kubernetes.io/projected/48340033-b0f1-4d8d-b7fd-b6bb6ddddd8b-kube-api-access-vcnzp") pod "network-check-target-xk8l4" (UID: "48340033-b0f1-4d8d-b7fd-b6bb6ddddd8b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 14 19:51:58.555202 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:58.555120    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9aa72835-977f-4b04-9858-7d623eda0254-metrics-certs\") pod \"network-metrics-daemon-f52k9\" (UID: \"9aa72835-977f-4b04-9858-7d623eda0254\") " pod="openshift-multus/network-metrics-daemon-f52k9"
Jul 14 19:51:58.555352 ip-10-0-140-201 kubenswrapper[2579]: E0714 19:51:58.555234    2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 14 19:51:58.555352 ip-10-0-140-201 kubenswrapper[2579]: E0714 19:51:58.555287    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9aa72835-977f-4b04-9858-7d623eda0254-metrics-certs podName:9aa72835-977f-4b04-9858-7d623eda0254 nodeName:}" failed. No retries permitted until 2026-07-14 19:52:14.555273778 +0000 UTC m=+34.266869300 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9aa72835-977f-4b04-9858-7d623eda0254-metrics-certs") pod "network-metrics-daemon-f52k9" (UID: "9aa72835-977f-4b04-9858-7d623eda0254") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 14 19:51:58.845018 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:58.844937    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-d8x6z"
Jul 14 19:51:58.845474 ip-10-0-140-201 kubenswrapper[2579]: E0714 19:51:58.845053    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-d8x6z" podUID="1993baf5-1337-4873-acf4-fd40ade89975"
Jul 14 19:51:58.845474 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:58.845111    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xk8l4"
Jul 14 19:51:58.845474 ip-10-0-140-201 kubenswrapper[2579]: E0714 19:51:58.845204    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xk8l4" podUID="48340033-b0f1-4d8d-b7fd-b6bb6ddddd8b"
Jul 14 19:51:59.842067 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:51:59.842028    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-f52k9"
Jul 14 19:51:59.842299 ip-10-0-140-201 kubenswrapper[2579]: E0714 19:51:59.842170    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-f52k9" podUID="9aa72835-977f-4b04-9858-7d623eda0254"
Jul 14 19:52:00.844647 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:52:00.844612    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-d8x6z"
Jul 14 19:52:00.845067 ip-10-0-140-201 kubenswrapper[2579]: E0714 19:52:00.844731    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-d8x6z" podUID="1993baf5-1337-4873-acf4-fd40ade89975"
Jul 14 19:52:00.845067 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:52:00.844759    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xk8l4"
Jul 14 19:52:00.845067 ip-10-0-140-201 kubenswrapper[2579]: E0714 19:52:00.844817    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xk8l4" podUID="48340033-b0f1-4d8d-b7fd-b6bb6ddddd8b"
Jul 14 19:52:01.842017 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:52:01.841974    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-f52k9"
Jul 14 19:52:01.842210 ip-10-0-140-201 kubenswrapper[2579]: E0714 19:52:01.842123    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-f52k9" podUID="9aa72835-977f-4b04-9858-7d623eda0254"
Jul 14 19:52:02.844829 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:52:02.844795    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-d8x6z"
Jul 14 19:52:02.845286 ip-10-0-140-201 kubenswrapper[2579]: E0714 19:52:02.844919    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-d8x6z" podUID="1993baf5-1337-4873-acf4-fd40ade89975"
Jul 14 19:52:02.845286 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:52:02.844969    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xk8l4"
Jul 14 19:52:02.845286 ip-10-0-140-201 kubenswrapper[2579]: E0714 19:52:02.845070    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xk8l4" podUID="48340033-b0f1-4d8d-b7fd-b6bb6ddddd8b"
Jul 14 19:52:03.842388 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:52:03.842216    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-f52k9"
Jul 14 19:52:03.842388 ip-10-0-140-201 kubenswrapper[2579]: E0714 19:52:03.842340    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-f52k9" podUID="9aa72835-977f-4b04-9858-7d623eda0254"
Jul 14 19:52:03.932039 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:52:03.931970    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-201.ec2.internal" event={"ID":"f7485cdaac307b25b08583eb8c5cef91","Type":"ContainerStarted","Data":"c482e3984b402268326847a6efdae7843afda80a34f20d40984dc62c8e4d647d"}
Jul 14 19:52:03.943674 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:52:03.943600    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-sdxvb" event={"ID":"47390bed-f864-4a3b-ac65-960f504af7f1","Type":"ContainerStarted","Data":"b7145bbac5ae368a5dff4c950d76c2343bd02430a4eb952bac88d388c6f35ee2"}
Jul 14 19:52:03.948823 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:52:03.947198    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-4g2lc" event={"ID":"1a276f3b-de2d-4f24-8335-2c66e01d0bf7","Type":"ContainerStarted","Data":"1113164acba0701a12b4d43243a41b614cdc0d4615e5b972bbe7cac2719b0f47"}
Jul 14 19:52:03.959688 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:52:03.959386    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-201.ec2.internal" podStartSLOduration=21.959365675 podStartE2EDuration="21.959365675s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-14 19:51:42 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 19:52:03.958892732 +0000 UTC m=+23.670488275" watchObservedRunningTime="2026-07-14 19:52:03.959365675 +0000 UTC m=+23.670961218"
Jul 14 19:52:03.961068 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:52:03.961041    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-q4xzw_ef54193c-7659-4e47-87ac-4d129d22a268/ovn-acl-logging/0.log"
Jul 14 19:52:03.961710 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:52:03.961681    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-q4xzw" event={"ID":"ef54193c-7659-4e47-87ac-4d129d22a268","Type":"ContainerStarted","Data":"ac1743980569a13b7d38abaca7840905dcb2242425c71a4d341c3e4530ce555e"}
Jul 14 19:52:03.988632 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:52:03.988584    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-4g2lc" podStartSLOduration=2.341029471 podStartE2EDuration="22.988568432s" totalImagesPullingTime="20.647538961s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-14 19:51:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 19:52:03.987705671 +0000 UTC m=+23.699301213" watchObservedRunningTime="2026-07-14 19:52:03.988568432 +0000 UTC m=+23.700163974"
Jul 14 19:52:04.017348 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:52:04.017283    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-sdxvb" podStartSLOduration=2.375730276 podStartE2EDuration="23.017265999s" totalImagesPullingTime="20.641535723s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-14 19:51:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 19:52:04.017058862 +0000 UTC m=+23.728654417" watchObservedRunningTime="2026-07-14 19:52:04.017265999 +0000 UTC m=+23.728861542"
Jul 14 19:52:04.842354 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:52:04.842171    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xk8l4"
Jul 14 19:52:04.842577 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:52:04.842176    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-d8x6z"
Jul 14 19:52:04.842577 ip-10-0-140-201 kubenswrapper[2579]: E0714 19:52:04.842448    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xk8l4" podUID="48340033-b0f1-4d8d-b7fd-b6bb6ddddd8b"
Jul 14 19:52:04.842577 ip-10-0-140-201 kubenswrapper[2579]: E0714 19:52:04.842488    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-d8x6z" podUID="1993baf5-1337-4873-acf4-fd40ade89975"
Jul 14 19:52:04.967159 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:52:04.967119    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-q4xzw_ef54193c-7659-4e47-87ac-4d129d22a268/ovn-acl-logging/0.log"
Jul 14 19:52:04.968042 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:52:04.967470    2579 generic.go:356] "Generic (PLEG): container finished" podID="ef54193c-7659-4e47-87ac-4d129d22a268" containerID="88cc5d49e06d26c4f64379c539688ab98c5dec0aff68ca7cf9cdd0d8e22430da" exitCode=1
Jul 14 19:52:04.968042 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:52:04.967553    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-q4xzw" event={"ID":"ef54193c-7659-4e47-87ac-4d129d22a268","Type":"ContainerStarted","Data":"05e83b2511f8d43284ff83777ebc028c8064cc14fcd92a81920661c4eb2e8324"}
Jul 14 19:52:04.968042 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:52:04.967620    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-q4xzw" event={"ID":"ef54193c-7659-4e47-87ac-4d129d22a268","Type":"ContainerStarted","Data":"69456ad9ed34b4836aa2a36ca76b5c315e03c6145c38cea0d86c2697b2e26d20"}
Jul 14 19:52:04.968042 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:52:04.967650    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-q4xzw" event={"ID":"ef54193c-7659-4e47-87ac-4d129d22a268","Type":"ContainerStarted","Data":"fb07f10cb8594e946811c7b1edd81ec103f0c15ed9f19c5ecef13e16815e4cfa"}
Jul 14 19:52:04.968042 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:52:04.967676    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-q4xzw" event={"ID":"ef54193c-7659-4e47-87ac-4d129d22a268","Type":"ContainerStarted","Data":"6d03f62513f43017be3be438c12358d936366d32ea19286863eb17e5fc003412"}
Jul 14 19:52:04.968042 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:52:04.967719    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-q4xzw" event={"ID":"ef54193c-7659-4e47-87ac-4d129d22a268","Type":"ContainerDied","Data":"88cc5d49e06d26c4f64379c539688ab98c5dec0aff68ca7cf9cdd0d8e22430da"}
Jul 14 19:52:04.969127 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:52:04.969100    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-nb29m" event={"ID":"f18327eb-f774-4f26-b798-5628c0dd01ad","Type":"ContainerStarted","Data":"1f890dd3a16cf6c87388dd5dfd389765457e9f3ebe483cad2628032971417c44"}
Jul 14 19:52:04.970546 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:52:04.970506    2579 generic.go:356] "Generic (PLEG): container finished" podID="b0492caa-150a-47bd-b74d-60fa9de0c173" containerID="30a55d1547a0d87a96b53c382f762a6f7dfe033b1e171775f43e70025a2dee74" exitCode=0
Jul 14 19:52:04.970658 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:52:04.970590    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-ks4zn" event={"ID":"b0492caa-150a-47bd-b74d-60fa9de0c173","Type":"ContainerDied","Data":"30a55d1547a0d87a96b53c382f762a6f7dfe033b1e171775f43e70025a2dee74"}
Jul 14 19:52:04.972355 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:52:04.972323    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fkcxq" event={"ID":"2d58ec38-5f18-4d79-9df1-06c13bd595c3","Type":"ContainerStarted","Data":"6bf9a07e92a23939b1696d98f936c3f3f3acbaecadd3e95d09287a31a2ef7597"}
Jul 14 19:52:04.974572 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:52:04.974187    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-4qscd" event={"ID":"209b5a52-9d80-45ca-9c92-63578a945220","Type":"ContainerStarted","Data":"c28069a2ae9af6551f1961e6a1c05e6fe5badc9a7af6fdb28ab6684641cf258f"}
Jul 14 19:52:04.975931 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:52:04.975901    2579 generic.go:356] "Generic (PLEG): container finished" podID="cad5cdd785a831695970fe0c85e16af0" containerID="8f293054215c1661c339fe7dc4a173fd959a04aabd6916e4d071a0c9f5aea058" exitCode=0
Jul 14 19:52:04.976141 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:52:04.976124    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-201.ec2.internal" event={"ID":"cad5cdd785a831695970fe0c85e16af0","Type":"ContainerDied","Data":"8f293054215c1661c339fe7dc4a173fd959a04aabd6916e4d071a0c9f5aea058"}
Jul 14 19:52:04.978254 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:52:04.977874    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-gb26w" event={"ID":"1ea2bd9d-b2c3-42ce-a0ee-c3719d4f048e","Type":"ContainerStarted","Data":"95f807384975c12f500c35f06316b86fa7d0ca3aa3d377ff112b1f0b54b0164f"}
Jul 14 19:52:04.987839 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:52:04.987804    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-nb29m" podStartSLOduration=3.355185446 podStartE2EDuration="23.987790449s" totalImagesPullingTime="20.632605003s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 19:51:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 19:52:04.986973956 +0000 UTC m=+24.698569500" watchObservedRunningTime="2026-07-14 19:52:04.987790449 +0000 UTC m=+24.699385992"
Jul 14 19:52:05.063438 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:52:05.063391    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-gb26w" podStartSLOduration=3.394129812 podStartE2EDuration="24.063373416s" totalImagesPullingTime="20.669243604s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-14 19:51:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 19:52:05.047955081 +0000 UTC m=+24.759550624" watchObservedRunningTime="2026-07-14 19:52:05.063373416 +0000 UTC m=+24.774969001"
Jul 14 19:52:05.841907 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:52:05.841875    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-f52k9"
Jul 14 19:52:05.842126 ip-10-0-140-201 kubenswrapper[2579]: E0714 19:52:05.842011    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-f52k9" podUID="9aa72835-977f-4b04-9858-7d623eda0254"
Jul 14 19:52:05.864143 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:52:05.864105    2579 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jul 14 19:52:05.982350 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:52:05.982249    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-201.ec2.internal" event={"ID":"cad5cdd785a831695970fe0c85e16af0","Type":"ContainerStarted","Data":"6483c87c1080b52b8cc1c37cf0e0452d6dd58609629d31369edf1a0c84d5d648"}
Jul 14 19:52:05.983943 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:52:05.983915    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-8ss2c" event={"ID":"1f7b0ae1-bc82-4d4a-b9ae-63de08fd2d96","Type":"ContainerStarted","Data":"08a5263f467203e2567429ce2fd656d921742d7b9643d2be7140f12aec87b645"}
Jul 14 19:52:05.986368 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:52:05.986338    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fkcxq" event={"ID":"2d58ec38-5f18-4d79-9df1-06c13bd595c3","Type":"ContainerStarted","Data":"e2ced1c9c7042a1959087478acd6e6e983502ae270c8b5757b6dffd3fa38076f"}
Jul 14 19:52:05.997370 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:52:05.997310    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-201.ec2.internal" podStartSLOduration=23.997291093 podStartE2EDuration="23.997291093s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-14 19:51:42 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 19:52:05.997187762 +0000 UTC m=+25.708783305" watchObservedRunningTime="2026-07-14 19:52:05.997291093 +0000 UTC m=+25.708886636"
Jul 14 19:52:05.997778 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:52:05.997752    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-4qscd" podStartSLOduration=9.449420887 podStartE2EDuration="24.997744086s" totalImagesPullingTime="15.548323199s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-14 19:51:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 19:52:05.064423721 +0000 UTC m=+24.776019264" watchObservedRunningTime="2026-07-14 19:52:05.997744086 +0000 UTC m=+25.709339693"
Jul 14 19:52:06.784300 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:52:06.784189    2579 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-14T19:52:05.864124901Z","UUID":"27dcf066-f14e-431c-b5d9-d0a2a3fed898","Handler":null,"Name":"","Endpoint":""}
Jul 14 19:52:06.785838 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:52:06.785810    2579 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jul 14 19:52:06.785985 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:52:06.785856    2579 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jul 14 19:52:06.842894 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:52:06.841260    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xk8l4"
Jul 14 19:52:06.842894 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:52:06.841258    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-d8x6z"
Jul 14 19:52:06.842894 ip-10-0-140-201 kubenswrapper[2579]: E0714 19:52:06.841389    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xk8l4" podUID="48340033-b0f1-4d8d-b7fd-b6bb6ddddd8b"
Jul 14 19:52:06.842894 ip-10-0-140-201 kubenswrapper[2579]: E0714 19:52:06.841520    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-d8x6z" podUID="1993baf5-1337-4873-acf4-fd40ade89975"
Jul 14 19:52:06.992077 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:52:06.992048    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-q4xzw_ef54193c-7659-4e47-87ac-4d129d22a268/ovn-acl-logging/0.log"
Jul 14 19:52:06.992552 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:52:06.992484    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-q4xzw" event={"ID":"ef54193c-7659-4e47-87ac-4d129d22a268","Type":"ContainerStarted","Data":"39a6379cfc58586c742abb1cb4b3e9bbd59a6af516b0cf1481c9fb7abc059cea"}
Jul 14 19:52:07.198054 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:52:07.197965    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-nb29m"
Jul 14 19:52:07.198985 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:52:07.198964    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-nb29m"
Jul 14 19:52:07.215800 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:52:07.215741    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-8ss2c" podStartSLOduration=12.869606407 podStartE2EDuration="26.215717563s" totalImagesPullingTime="13.346111156s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-14 19:51:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 19:52:06.013417122 +0000 UTC m=+25.725012664" watchObservedRunningTime="2026-07-14 19:52:07.215717563 +0000 UTC m=+26.927313109"
Jul 14 19:52:07.841878 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:52:07.841843    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-f52k9"
Jul 14 19:52:07.842061 ip-10-0-140-201 kubenswrapper[2579]: E0714 19:52:07.841989    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-f52k9" podUID="9aa72835-977f-4b04-9858-7d623eda0254"
Jul 14 19:52:07.994463 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:52:07.994429    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-nb29m"
Jul 14 19:52:07.995016 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:52:07.994997    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-nb29m"
Jul 14 19:52:08.841447 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:52:08.841368    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xk8l4"
Jul 14 19:52:08.841636 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:52:08.841368    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-d8x6z"
Jul 14 19:52:08.841636 ip-10-0-140-201 kubenswrapper[2579]: E0714 19:52:08.841478    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xk8l4" podUID="48340033-b0f1-4d8d-b7fd-b6bb6ddddd8b"
Jul 14 19:52:08.841636 ip-10-0-140-201 kubenswrapper[2579]: E0714 19:52:08.841603    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-d8x6z" podUID="1993baf5-1337-4873-acf4-fd40ade89975"
Jul 14 19:52:09.841685 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:52:09.841653    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-f52k9"
Jul 14 19:52:09.842289 ip-10-0-140-201 kubenswrapper[2579]: E0714 19:52:09.841759    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-f52k9" podUID="9aa72835-977f-4b04-9858-7d623eda0254"
Jul 14 19:52:10.003523 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:52:10.003484    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-q4xzw_ef54193c-7659-4e47-87ac-4d129d22a268/ovn-acl-logging/0.log"
Jul 14 19:52:10.003932 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:52:10.003897    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-q4xzw" event={"ID":"ef54193c-7659-4e47-87ac-4d129d22a268","Type":"ContainerStarted","Data":"2c785f4678d87b9502a1eac0af9a637d78f2465b06fb506170b3402003fb9fd7"}
Jul 14 19:52:10.004270 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:52:10.004176    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-q4xzw"
Jul 14 19:52:10.004393 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:52:10.004355    2579 scope.go:117] "RemoveContainer" containerID="88cc5d49e06d26c4f64379c539688ab98c5dec0aff68ca7cf9cdd0d8e22430da"
Jul 14 19:52:10.006281 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:52:10.006257    2579 generic.go:356] "Generic (PLEG): container finished" podID="b0492caa-150a-47bd-b74d-60fa9de0c173" containerID="a242c043481f0ccfc65e4c282c459ff0ba4f84a023ec0f7aa11630138c1729a1" exitCode=0
Jul 14 19:52:10.006383 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:52:10.006353    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-ks4zn" event={"ID":"b0492caa-150a-47bd-b74d-60fa9de0c173","Type":"ContainerDied","Data":"a242c043481f0ccfc65e4c282c459ff0ba4f84a023ec0f7aa11630138c1729a1"}
Jul 14 19:52:10.021695 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:52:10.021672    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-q4xzw"
Jul 14 19:52:10.842350 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:52:10.842149    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xk8l4"
Jul 14 19:52:10.842727 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:52:10.842210    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-d8x6z"
Jul 14 19:52:10.842727 ip-10-0-140-201 kubenswrapper[2579]: E0714 19:52:10.842424    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xk8l4" podUID="48340033-b0f1-4d8d-b7fd-b6bb6ddddd8b"
Jul 14 19:52:10.842727 ip-10-0-140-201 kubenswrapper[2579]: E0714 19:52:10.842485    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-d8x6z" podUID="1993baf5-1337-4873-acf4-fd40ade89975"
Jul 14 19:52:11.012763 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:52:11.012723    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-q4xzw_ef54193c-7659-4e47-87ac-4d129d22a268/ovn-acl-logging/0.log"
Jul 14 19:52:11.013139 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:52:11.013110    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-q4xzw" event={"ID":"ef54193c-7659-4e47-87ac-4d129d22a268","Type":"ContainerStarted","Data":"2007a61d9e5e0fda2a4f7abc53f0996bf9c407d4c179cb2f491b13da1ae813d3"}
Jul 14 19:52:11.013479 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:52:11.013458    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-q4xzw"
Jul 14 19:52:11.013590 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:52:11.013577    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-q4xzw"
Jul 14 19:52:11.015545 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:52:11.015503    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fkcxq" event={"ID":"2d58ec38-5f18-4d79-9df1-06c13bd595c3","Type":"ContainerStarted","Data":"61501948f99b2d2efb907d0a75342eaa875c88ef0d02029627487845e5ba5363"}
Jul 14 19:52:11.031817 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:52:11.031786    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-q4xzw"
Jul 14 19:52:11.042633 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:52:11.042563    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-q4xzw" podStartSLOduration=9.307491754 podStartE2EDuration="30.042522317s" totalImagesPullingTime="20.735030563s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-14 19:51:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 19:52:11.041740045 +0000 UTC m=+30.753335589" watchObservedRunningTime="2026-07-14 19:52:11.042522317 +0000 UTC m=+30.754117862"
Jul 14 19:52:11.059210 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:52:11.059161    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fkcxq" podStartSLOduration=8.792118518 podStartE2EDuration="30.059144241s" totalImagesPullingTime="21.267025723s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-14 19:51:41 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 19:52:11.058859219 +0000 UTC m=+30.770454761" watchObservedRunningTime="2026-07-14 19:52:11.059144241 +0000 UTC m=+30.770739783"
Jul 14 19:52:11.401410 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:52:11.401332    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-xk8l4"]
Jul 14 19:52:11.401634 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:52:11.401459    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xk8l4"
Jul 14 19:52:11.401634 ip-10-0-140-201 kubenswrapper[2579]: E0714 19:52:11.401570    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xk8l4" podUID="48340033-b0f1-4d8d-b7fd-b6bb6ddddd8b"
Jul 14 19:52:11.404506 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:52:11.404472    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-f52k9"]
Jul 14 19:52:11.404670 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:52:11.404656    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-f52k9"
Jul 14 19:52:11.404792 ip-10-0-140-201 kubenswrapper[2579]: E0714 19:52:11.404773    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-f52k9" podUID="9aa72835-977f-4b04-9858-7d623eda0254"
Jul 14 19:52:11.405257 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:52:11.405235    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-d8x6z"]
Jul 14 19:52:11.405336 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:52:11.405327    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-d8x6z"
Jul 14 19:52:11.405432 ip-10-0-140-201 kubenswrapper[2579]: E0714 19:52:11.405414    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-d8x6z" podUID="1993baf5-1337-4873-acf4-fd40ade89975"
Jul 14 19:52:12.019398 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:52:12.019362    2579 generic.go:356] "Generic (PLEG): container finished" podID="b0492caa-150a-47bd-b74d-60fa9de0c173" containerID="9e87562c742e451d085f351b11179ce22745e0d5cf2950ccf0c660b5c4b3287b" exitCode=0
Jul 14 19:52:12.019851 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:52:12.019445    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-ks4zn" event={"ID":"b0492caa-150a-47bd-b74d-60fa9de0c173","Type":"ContainerDied","Data":"9e87562c742e451d085f351b11179ce22745e0d5cf2950ccf0c660b5c4b3287b"}
Jul 14 19:52:12.841786 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:52:12.841760    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-f52k9"
Jul 14 19:52:12.841927 ip-10-0-140-201 kubenswrapper[2579]: E0714 19:52:12.841904    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-f52k9" podUID="9aa72835-977f-4b04-9858-7d623eda0254"
Jul 14 19:52:12.841992 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:52:12.841946    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xk8l4"
Jul 14 19:52:12.842049 ip-10-0-140-201 kubenswrapper[2579]: E0714 19:52:12.842030    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xk8l4" podUID="48340033-b0f1-4d8d-b7fd-b6bb6ddddd8b"
Jul 14 19:52:13.024321 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:52:13.024286    2579 generic.go:356] "Generic (PLEG): container finished" podID="b0492caa-150a-47bd-b74d-60fa9de0c173" containerID="b65405fde6d85f72e10d55e91c92501f34782da0f4023348d5487c08c0b7f691" exitCode=0
Jul 14 19:52:13.024710 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:52:13.024376    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-ks4zn" event={"ID":"b0492caa-150a-47bd-b74d-60fa9de0c173","Type":"ContainerDied","Data":"b65405fde6d85f72e10d55e91c92501f34782da0f4023348d5487c08c0b7f691"}
Jul 14 19:52:13.841548 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:52:13.841471    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-d8x6z"
Jul 14 19:52:13.841734 ip-10-0-140-201 kubenswrapper[2579]: E0714 19:52:13.841677    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-d8x6z" podUID="1993baf5-1337-4873-acf4-fd40ade89975"
Jul 14 19:52:14.472281 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:52:14.472066    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1993baf5-1337-4873-acf4-fd40ade89975-original-pull-secret\") pod \"global-pull-secret-syncer-d8x6z\" (UID: \"1993baf5-1337-4873-acf4-fd40ade89975\") " pod="kube-system/global-pull-secret-syncer-d8x6z"
Jul 14 19:52:14.472760 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:52:14.472300    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vcnzp\" (UniqueName: \"kubernetes.io/projected/48340033-b0f1-4d8d-b7fd-b6bb6ddddd8b-kube-api-access-vcnzp\") pod \"network-check-target-xk8l4\" (UID: \"48340033-b0f1-4d8d-b7fd-b6bb6ddddd8b\") " pod="openshift-network-diagnostics/network-check-target-xk8l4"
Jul 14 19:52:14.472760 ip-10-0-140-201 kubenswrapper[2579]: E0714 19:52:14.472216    2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 14 19:52:14.472760 ip-10-0-140-201 kubenswrapper[2579]: E0714 19:52:14.472423    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1993baf5-1337-4873-acf4-fd40ade89975-original-pull-secret podName:1993baf5-1337-4873-acf4-fd40ade89975 nodeName:}" failed. No retries permitted until 2026-07-14 19:52:46.472403568 +0000 UTC m=+66.183999108 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/1993baf5-1337-4873-acf4-fd40ade89975-original-pull-secret") pod "global-pull-secret-syncer-d8x6z" (UID: "1993baf5-1337-4873-acf4-fd40ade89975") : object "kube-system"/"original-pull-secret" not registered
Jul 14 19:52:14.472760 ip-10-0-140-201 kubenswrapper[2579]: E0714 19:52:14.472445    2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 14 19:52:14.472760 ip-10-0-140-201 kubenswrapper[2579]: E0714 19:52:14.472460    2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 14 19:52:14.472760 ip-10-0-140-201 kubenswrapper[2579]: E0714 19:52:14.472471    2579 projected.go:196] Error preparing data for projected volume kube-api-access-vcnzp for pod openshift-network-diagnostics/network-check-target-xk8l4: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 14 19:52:14.472760 ip-10-0-140-201 kubenswrapper[2579]: E0714 19:52:14.472503    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/48340033-b0f1-4d8d-b7fd-b6bb6ddddd8b-kube-api-access-vcnzp podName:48340033-b0f1-4d8d-b7fd-b6bb6ddddd8b nodeName:}" failed. No retries permitted until 2026-07-14 19:52:46.472493297 +0000 UTC m=+66.184088834 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-vcnzp" (UniqueName: "kubernetes.io/projected/48340033-b0f1-4d8d-b7fd-b6bb6ddddd8b-kube-api-access-vcnzp") pod "network-check-target-xk8l4" (UID: "48340033-b0f1-4d8d-b7fd-b6bb6ddddd8b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 14 19:52:14.572998 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:52:14.572956    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9aa72835-977f-4b04-9858-7d623eda0254-metrics-certs\") pod \"network-metrics-daemon-f52k9\" (UID: \"9aa72835-977f-4b04-9858-7d623eda0254\") " pod="openshift-multus/network-metrics-daemon-f52k9"
Jul 14 19:52:14.573140 ip-10-0-140-201 kubenswrapper[2579]: E0714 19:52:14.573086    2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 14 19:52:14.573200 ip-10-0-140-201 kubenswrapper[2579]: E0714 19:52:14.573144    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9aa72835-977f-4b04-9858-7d623eda0254-metrics-certs podName:9aa72835-977f-4b04-9858-7d623eda0254 nodeName:}" failed. No retries permitted until 2026-07-14 19:52:46.573129842 +0000 UTC m=+66.284725364 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9aa72835-977f-4b04-9858-7d623eda0254-metrics-certs") pod "network-metrics-daemon-f52k9" (UID: "9aa72835-977f-4b04-9858-7d623eda0254") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 14 19:52:14.841873 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:52:14.841834    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-f52k9"
Jul 14 19:52:14.842045 ip-10-0-140-201 kubenswrapper[2579]: E0714 19:52:14.841983    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-f52k9" podUID="9aa72835-977f-4b04-9858-7d623eda0254"
Jul 14 19:52:14.842098 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:52:14.842041    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xk8l4"
Jul 14 19:52:14.842170 ip-10-0-140-201 kubenswrapper[2579]: E0714 19:52:14.842149    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xk8l4" podUID="48340033-b0f1-4d8d-b7fd-b6bb6ddddd8b"
Jul 14 19:52:15.841435 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:52:15.841398    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-d8x6z"
Jul 14 19:52:15.841882 ip-10-0-140-201 kubenswrapper[2579]: E0714 19:52:15.841581    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-d8x6z" podUID="1993baf5-1337-4873-acf4-fd40ade89975"
Jul 14 19:52:16.623961 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:52:16.623927    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-201.ec2.internal" event="NodeReady"
Jul 14 19:52:16.624118 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:52:16.624078    2579 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jul 14 19:52:16.670548 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:52:16.670508    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-cpzqc"]
Jul 14 19:52:16.686862 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:52:16.686829    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-nrkrb"]
Jul 14 19:52:16.687033 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:52:16.686946    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-cpzqc"
Jul 14 19:52:16.691157 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:52:16.691134    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-wc26t\""
Jul 14 19:52:16.691299 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:52:16.691134    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 14 19:52:16.692879 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:52:16.692858    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 14 19:52:16.698886 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:52:16.698862    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-cpzqc"]
Jul 14 19:52:16.699020 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:52:16.698911    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-nrkrb"]
Jul 14 19:52:16.699020 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:52:16.698980    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-nrkrb"
Jul 14 19:52:16.715815 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:52:16.715784    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 14 19:52:16.716009 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:52:16.715793    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 14 19:52:16.716009 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:52:16.715980    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 14 19:52:16.716330 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:52:16.716304    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-gm85k\""
Jul 14 19:52:16.789703 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:52:16.789663    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/0360d8bf-1d2a-43c4-8638-6766128ff3d4-config-volume\") pod \"dns-default-cpzqc\" (UID: \"0360d8bf-1d2a-43c4-8638-6766128ff3d4\") " pod="openshift-dns/dns-default-cpzqc"
Jul 14 19:52:16.789870 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:52:16.789711    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/0360d8bf-1d2a-43c4-8638-6766128ff3d4-metrics-tls\") pod \"dns-default-cpzqc\" (UID: \"0360d8bf-1d2a-43c4-8638-6766128ff3d4\") " pod="openshift-dns/dns-default-cpzqc"
Jul 14 19:52:16.789870 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:52:16.789743    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ab40987e-7e6f-4346-9c28-b565e00402d5-cert\") pod \"ingress-canary-nrkrb\" (UID: \"ab40987e-7e6f-4346-9c28-b565e00402d5\") " pod="openshift-ingress-canary/ingress-canary-nrkrb"
Jul 14 19:52:16.789870 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:52:16.789780    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n95rh\" (UniqueName: \"kubernetes.io/projected/0360d8bf-1d2a-43c4-8638-6766128ff3d4-kube-api-access-n95rh\") pod \"dns-default-cpzqc\" (UID: \"0360d8bf-1d2a-43c4-8638-6766128ff3d4\") " pod="openshift-dns/dns-default-cpzqc"
Jul 14 19:52:16.789870 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:52:16.789817    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jznfz\" (UniqueName: \"kubernetes.io/projected/ab40987e-7e6f-4346-9c28-b565e00402d5-kube-api-access-jznfz\") pod \"ingress-canary-nrkrb\" (UID: \"ab40987e-7e6f-4346-9c28-b565e00402d5\") " pod="openshift-ingress-canary/ingress-canary-nrkrb"
Jul 14 19:52:16.790124 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:52:16.789908    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0360d8bf-1d2a-43c4-8638-6766128ff3d4-tmp-dir\") pod \"dns-default-cpzqc\" (UID: \"0360d8bf-1d2a-43c4-8638-6766128ff3d4\") " pod="openshift-dns/dns-default-cpzqc"
Jul 14 19:52:16.842034 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:52:16.842002    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xk8l4"
Jul 14 19:52:16.842466 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:52:16.842002    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-f52k9"
Jul 14 19:52:16.846852 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:52:16.846816    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-78ljl\""
Jul 14 19:52:16.847026 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:52:16.846855    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 14 19:52:16.847026 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:52:16.846941    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 14 19:52:16.847026 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:52:16.846992    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 14 19:52:16.847222 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:52:16.847206    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-fkvzh\""
Jul 14 19:52:16.890734 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:52:16.890651    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0360d8bf-1d2a-43c4-8638-6766128ff3d4-tmp-dir\") pod \"dns-default-cpzqc\" (UID: \"0360d8bf-1d2a-43c4-8638-6766128ff3d4\") " pod="openshift-dns/dns-default-cpzqc"
Jul 14 19:52:16.890734 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:52:16.890690    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/0360d8bf-1d2a-43c4-8638-6766128ff3d4-config-volume\") pod \"dns-default-cpzqc\" (UID: \"0360d8bf-1d2a-43c4-8638-6766128ff3d4\") " pod="openshift-dns/dns-default-cpzqc"
Jul 14 19:52:16.890734 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:52:16.890707    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/0360d8bf-1d2a-43c4-8638-6766128ff3d4-metrics-tls\") pod \"dns-default-cpzqc\" (UID: \"0360d8bf-1d2a-43c4-8638-6766128ff3d4\") " pod="openshift-dns/dns-default-cpzqc"
Jul 14 19:52:16.890734 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:52:16.890725    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ab40987e-7e6f-4346-9c28-b565e00402d5-cert\") pod \"ingress-canary-nrkrb\" (UID: \"ab40987e-7e6f-4346-9c28-b565e00402d5\") " pod="openshift-ingress-canary/ingress-canary-nrkrb"
Jul 14 19:52:16.891006 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:52:16.890746    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n95rh\" (UniqueName: \"kubernetes.io/projected/0360d8bf-1d2a-43c4-8638-6766128ff3d4-kube-api-access-n95rh\") pod \"dns-default-cpzqc\" (UID: \"0360d8bf-1d2a-43c4-8638-6766128ff3d4\") " pod="openshift-dns/dns-default-cpzqc"
Jul 14 19:52:16.891006 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:52:16.890771    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jznfz\" (UniqueName: \"kubernetes.io/projected/ab40987e-7e6f-4346-9c28-b565e00402d5-kube-api-access-jznfz\") pod \"ingress-canary-nrkrb\" (UID: \"ab40987e-7e6f-4346-9c28-b565e00402d5\") " pod="openshift-ingress-canary/ingress-canary-nrkrb"
Jul 14 19:52:16.891006 ip-10-0-140-201 kubenswrapper[2579]: E0714 19:52:16.890850    2579 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 14 19:52:16.891006 ip-10-0-140-201 kubenswrapper[2579]: E0714 19:52:16.890948    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0360d8bf-1d2a-43c4-8638-6766128ff3d4-metrics-tls podName:0360d8bf-1d2a-43c4-8638-6766128ff3d4 nodeName:}" failed. No retries permitted until 2026-07-14 19:52:17.390926626 +0000 UTC m=+37.102522148 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/0360d8bf-1d2a-43c4-8638-6766128ff3d4-metrics-tls") pod "dns-default-cpzqc" (UID: "0360d8bf-1d2a-43c4-8638-6766128ff3d4") : secret "dns-default-metrics-tls" not found
Jul 14 19:52:16.891146 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:52:16.891066    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0360d8bf-1d2a-43c4-8638-6766128ff3d4-tmp-dir\") pod \"dns-default-cpzqc\" (UID: \"0360d8bf-1d2a-43c4-8638-6766128ff3d4\") " pod="openshift-dns/dns-default-cpzqc"
Jul 14 19:52:16.891293 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:52:16.891276    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/0360d8bf-1d2a-43c4-8638-6766128ff3d4-config-volume\") pod \"dns-default-cpzqc\" (UID: \"0360d8bf-1d2a-43c4-8638-6766128ff3d4\") " pod="openshift-dns/dns-default-cpzqc"
Jul 14 19:52:16.895191 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:52:16.895162    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ab40987e-7e6f-4346-9c28-b565e00402d5-cert\") pod \"ingress-canary-nrkrb\" (UID: \"ab40987e-7e6f-4346-9c28-b565e00402d5\") " pod="openshift-ingress-canary/ingress-canary-nrkrb"
Jul 14 19:52:16.899414 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:52:16.899381    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n95rh\" (UniqueName: \"kubernetes.io/projected/0360d8bf-1d2a-43c4-8638-6766128ff3d4-kube-api-access-n95rh\") pod \"dns-default-cpzqc\" (UID: \"0360d8bf-1d2a-43c4-8638-6766128ff3d4\") " pod="openshift-dns/dns-default-cpzqc"
Jul 14 19:52:16.899632 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:52:16.899610    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jznfz\" (UniqueName: \"kubernetes.io/projected/ab40987e-7e6f-4346-9c28-b565e00402d5-kube-api-access-jznfz\") pod \"ingress-canary-nrkrb\" (UID: \"ab40987e-7e6f-4346-9c28-b565e00402d5\") " pod="openshift-ingress-canary/ingress-canary-nrkrb"
Jul 14 19:52:17.007861 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:52:17.007817    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-nrkrb"
Jul 14 19:52:17.292728 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:52:17.292430    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-nrkrb"]
Jul 14 19:52:17.296481 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:52:17.296455    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podab40987e_7e6f_4346_9c28_b565e00402d5.slice/crio-428b5d849356a927254e68a5cc15a3bd90492f6b81cd63bc95ebe4d4551d2efd WatchSource:0}: Error finding container 428b5d849356a927254e68a5cc15a3bd90492f6b81cd63bc95ebe4d4551d2efd: Status 404 returned error can't find the container with id 428b5d849356a927254e68a5cc15a3bd90492f6b81cd63bc95ebe4d4551d2efd
Jul 14 19:52:17.396332 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:52:17.396300    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/0360d8bf-1d2a-43c4-8638-6766128ff3d4-metrics-tls\") pod \"dns-default-cpzqc\" (UID: \"0360d8bf-1d2a-43c4-8638-6766128ff3d4\") " pod="openshift-dns/dns-default-cpzqc"
Jul 14 19:52:17.396471 ip-10-0-140-201 kubenswrapper[2579]: E0714 19:52:17.396444    2579 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 14 19:52:17.396518 ip-10-0-140-201 kubenswrapper[2579]: E0714 19:52:17.396507    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0360d8bf-1d2a-43c4-8638-6766128ff3d4-metrics-tls podName:0360d8bf-1d2a-43c4-8638-6766128ff3d4 nodeName:}" failed. No retries permitted until 2026-07-14 19:52:18.396493324 +0000 UTC m=+38.108088848 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/0360d8bf-1d2a-43c4-8638-6766128ff3d4-metrics-tls") pod "dns-default-cpzqc" (UID: "0360d8bf-1d2a-43c4-8638-6766128ff3d4") : secret "dns-default-metrics-tls" not found
Jul 14 19:52:17.841383 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:52:17.841345    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-d8x6z"
Jul 14 19:52:17.846149 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:52:17.846121    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 14 19:52:18.038114 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:52:18.038075    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-nrkrb" event={"ID":"ab40987e-7e6f-4346-9c28-b565e00402d5","Type":"ContainerStarted","Data":"428b5d849356a927254e68a5cc15a3bd90492f6b81cd63bc95ebe4d4551d2efd"}
Jul 14 19:52:18.041176 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:52:18.041130    2579 generic.go:356] "Generic (PLEG): container finished" podID="b0492caa-150a-47bd-b74d-60fa9de0c173" containerID="c79a061b12add178792daaebc818497f72b2af12bf7ed93874514181f15a0346" exitCode=0
Jul 14 19:52:18.041334 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:52:18.041184    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-ks4zn" event={"ID":"b0492caa-150a-47bd-b74d-60fa9de0c173","Type":"ContainerDied","Data":"c79a061b12add178792daaebc818497f72b2af12bf7ed93874514181f15a0346"}
Jul 14 19:52:18.405871 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:52:18.405786    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/0360d8bf-1d2a-43c4-8638-6766128ff3d4-metrics-tls\") pod \"dns-default-cpzqc\" (UID: \"0360d8bf-1d2a-43c4-8638-6766128ff3d4\") " pod="openshift-dns/dns-default-cpzqc"
Jul 14 19:52:18.406007 ip-10-0-140-201 kubenswrapper[2579]: E0714 19:52:18.405923    2579 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 14 19:52:18.406007 ip-10-0-140-201 kubenswrapper[2579]: E0714 19:52:18.405976    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0360d8bf-1d2a-43c4-8638-6766128ff3d4-metrics-tls podName:0360d8bf-1d2a-43c4-8638-6766128ff3d4 nodeName:}" failed. No retries permitted until 2026-07-14 19:52:20.405963178 +0000 UTC m=+40.117558703 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/0360d8bf-1d2a-43c4-8638-6766128ff3d4-metrics-tls") pod "dns-default-cpzqc" (UID: "0360d8bf-1d2a-43c4-8638-6766128ff3d4") : secret "dns-default-metrics-tls" not found
Jul 14 19:52:19.047522 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:52:19.047485    2579 generic.go:356] "Generic (PLEG): container finished" podID="b0492caa-150a-47bd-b74d-60fa9de0c173" containerID="d07428f80e35ef4798e72ae148a91847166cf37d2a068dec2e3f2426e8084f85" exitCode=0
Jul 14 19:52:19.047968 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:52:19.047569    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-ks4zn" event={"ID":"b0492caa-150a-47bd-b74d-60fa9de0c173","Type":"ContainerDied","Data":"d07428f80e35ef4798e72ae148a91847166cf37d2a068dec2e3f2426e8084f85"}
Jul 14 19:52:20.051125 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:52:20.051026    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-nrkrb" event={"ID":"ab40987e-7e6f-4346-9c28-b565e00402d5","Type":"ContainerStarted","Data":"bee31a86a402dcda4fed8320fa0b69298cecae6d047e6012e4598744b73dbcc2"}
Jul 14 19:52:20.054408 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:52:20.054380    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-ks4zn" event={"ID":"b0492caa-150a-47bd-b74d-60fa9de0c173","Type":"ContainerStarted","Data":"89986ac8c59f96f349c256ccc8cb20f2264db7f02db5ab180cc8abcc89b17f00"}
Jul 14 19:52:20.067741 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:52:20.067690    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-nrkrb" podStartSLOduration=1.6309068820000001 podStartE2EDuration="4.06767179s" totalImagesPullingTime="2.436764908s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 19:52:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 19:52:20.067625295 +0000 UTC m=+39.779220842" watchObservedRunningTime="2026-07-14 19:52:20.06767179 +0000 UTC m=+39.779267335"
Jul 14 19:52:20.090650 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:52:20.090579    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-ks4zn" podStartSLOduration=13.282644531 podStartE2EDuration="39.090562213s" totalImagesPullingTime="25.807917682s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-14 19:51:41 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 19:52:20.089467561 +0000 UTC m=+39.801063105" watchObservedRunningTime="2026-07-14 19:52:20.090562213 +0000 UTC m=+39.802157755"
Jul 14 19:52:20.420838 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:52:20.420746    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/0360d8bf-1d2a-43c4-8638-6766128ff3d4-metrics-tls\") pod \"dns-default-cpzqc\" (UID: \"0360d8bf-1d2a-43c4-8638-6766128ff3d4\") " pod="openshift-dns/dns-default-cpzqc"
Jul 14 19:52:20.420999 ip-10-0-140-201 kubenswrapper[2579]: E0714 19:52:20.420918    2579 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 14 19:52:20.420999 ip-10-0-140-201 kubenswrapper[2579]: E0714 19:52:20.420996    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0360d8bf-1d2a-43c4-8638-6766128ff3d4-metrics-tls podName:0360d8bf-1d2a-43c4-8638-6766128ff3d4 nodeName:}" failed. No retries permitted until 2026-07-14 19:52:24.420977176 +0000 UTC m=+44.132572697 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/0360d8bf-1d2a-43c4-8638-6766128ff3d4-metrics-tls") pod "dns-default-cpzqc" (UID: "0360d8bf-1d2a-43c4-8638-6766128ff3d4") : secret "dns-default-metrics-tls" not found
Jul 14 19:52:24.450953 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:52:24.450709    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/0360d8bf-1d2a-43c4-8638-6766128ff3d4-metrics-tls\") pod \"dns-default-cpzqc\" (UID: \"0360d8bf-1d2a-43c4-8638-6766128ff3d4\") " pod="openshift-dns/dns-default-cpzqc"
Jul 14 19:52:24.451338 ip-10-0-140-201 kubenswrapper[2579]: E0714 19:52:24.450870    2579 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 14 19:52:24.451338 ip-10-0-140-201 kubenswrapper[2579]: E0714 19:52:24.451025    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0360d8bf-1d2a-43c4-8638-6766128ff3d4-metrics-tls podName:0360d8bf-1d2a-43c4-8638-6766128ff3d4 nodeName:}" failed. No retries permitted until 2026-07-14 19:52:32.451005194 +0000 UTC m=+52.162600716 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/0360d8bf-1d2a-43c4-8638-6766128ff3d4-metrics-tls") pod "dns-default-cpzqc" (UID: "0360d8bf-1d2a-43c4-8638-6766128ff3d4") : secret "dns-default-metrics-tls" not found
Jul 14 19:52:30.595059 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:52:30.595032    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-2fgqz"]
Jul 14 19:52:30.605800 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:52:30.605762    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-l85f2"]
Jul 14 19:52:30.605955 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:52:30.605897    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-2fgqz"
Jul 14 19:52:30.611107 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:52:30.611082    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 14 19:52:30.611338 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:52:30.611177    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\""
Jul 14 19:52:30.611338 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:52:30.611090    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\""
Jul 14 19:52:30.611338 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:52:30.611118    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 14 19:52:30.612036 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:52:30.612014    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-2c62b\""
Jul 14 19:52:30.614387 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:52:30.614366    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-2fgqz"]
Jul 14 19:52:30.614500 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:52:30.614401    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-l85f2"]
Jul 14 19:52:30.614500 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:52:30.614480    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-l85f2"
Jul 14 19:52:30.617042 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:52:30.617019    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\""
Jul 14 19:52:30.617144 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:52:30.617127    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-gnsqd\""
Jul 14 19:52:30.617691 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:52:30.617521    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\""
Jul 14 19:52:30.695159 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:52:30.695128    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hzsjh\" (UniqueName: \"kubernetes.io/projected/ccc17280-3650-447f-a954-c075c7cc06d8-kube-api-access-hzsjh\") pod \"volume-data-source-validator-78495597f6-l85f2\" (UID: \"ccc17280-3650-447f-a954-c075c7cc06d8\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-l85f2"
Jul 14 19:52:30.695321 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:52:30.695174    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/44512305-0548-44ec-a1f5-9ae26bd2cf8d-telemetry-config\") pod \"cluster-monitoring-operator-5f7f494dd4-2fgqz\" (UID: \"44512305-0548-44ec-a1f5-9ae26bd2cf8d\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-2fgqz"
Jul 14 19:52:30.695321 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:52:30.695228    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ttgm4\" (UniqueName: \"kubernetes.io/projected/44512305-0548-44ec-a1f5-9ae26bd2cf8d-kube-api-access-ttgm4\") pod \"cluster-monitoring-operator-5f7f494dd4-2fgqz\" (UID: \"44512305-0548-44ec-a1f5-9ae26bd2cf8d\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-2fgqz"
Jul 14 19:52:30.695321 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:52:30.695256    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/44512305-0548-44ec-a1f5-9ae26bd2cf8d-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-2fgqz\" (UID: \"44512305-0548-44ec-a1f5-9ae26bd2cf8d\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-2fgqz"
Jul 14 19:52:30.785258 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:52:30.785229    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-gm5zm"]
Jul 14 19:52:30.795812 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:52:30.795778    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hzsjh\" (UniqueName: \"kubernetes.io/projected/ccc17280-3650-447f-a954-c075c7cc06d8-kube-api-access-hzsjh\") pod \"volume-data-source-validator-78495597f6-l85f2\" (UID: \"ccc17280-3650-447f-a954-c075c7cc06d8\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-l85f2"
Jul 14 19:52:30.795976 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:52:30.795836    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/44512305-0548-44ec-a1f5-9ae26bd2cf8d-telemetry-config\") pod \"cluster-monitoring-operator-5f7f494dd4-2fgqz\" (UID: \"44512305-0548-44ec-a1f5-9ae26bd2cf8d\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-2fgqz"
Jul 14 19:52:30.795976 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:52:30.795900    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ttgm4\" (UniqueName: \"kubernetes.io/projected/44512305-0548-44ec-a1f5-9ae26bd2cf8d-kube-api-access-ttgm4\") pod \"cluster-monitoring-operator-5f7f494dd4-2fgqz\" (UID: \"44512305-0548-44ec-a1f5-9ae26bd2cf8d\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-2fgqz"
Jul 14 19:52:30.795976 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:52:30.795941    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/44512305-0548-44ec-a1f5-9ae26bd2cf8d-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-2fgqz\" (UID: \"44512305-0548-44ec-a1f5-9ae26bd2cf8d\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-2fgqz"
Jul 14 19:52:30.796121 ip-10-0-140-201 kubenswrapper[2579]: E0714 19:52:30.796070    2579 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 14 19:52:30.796173 ip-10-0-140-201 kubenswrapper[2579]: E0714 19:52:30.796137    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/44512305-0548-44ec-a1f5-9ae26bd2cf8d-cluster-monitoring-operator-tls podName:44512305-0548-44ec-a1f5-9ae26bd2cf8d nodeName:}" failed. No retries permitted until 2026-07-14 19:52:31.296119899 +0000 UTC m=+51.007715422 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/44512305-0548-44ec-a1f5-9ae26bd2cf8d-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-2fgqz" (UID: "44512305-0548-44ec-a1f5-9ae26bd2cf8d") : secret "cluster-monitoring-operator-tls" not found
Jul 14 19:52:30.796472 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:52:30.796451    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/44512305-0548-44ec-a1f5-9ae26bd2cf8d-telemetry-config\") pod \"cluster-monitoring-operator-5f7f494dd4-2fgqz\" (UID: \"44512305-0548-44ec-a1f5-9ae26bd2cf8d\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-2fgqz"
Jul 14 19:52:30.797343 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:52:30.797327    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-7c8667c5fb-mb2v5"]
Jul 14 19:52:30.797441 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:52:30.797429    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-gm5zm"
Jul 14 19:52:30.812771 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:52:30.812744    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7c8667c5fb-mb2v5"
Jul 14 19:52:30.822967 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:52:30.822943    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\""
Jul 14 19:52:30.822967 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:52:30.822959    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\""
Jul 14 19:52:30.823196 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:52:30.822983    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\""
Jul 14 19:52:30.823196 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:52:30.823015    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\""
Jul 14 19:52:30.823483 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:52:30.823464    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-txn8s\""
Jul 14 19:52:30.823617 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:52:30.823545    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Jul 14 19:52:30.823945 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:52:30.823928    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-gm5zm"]
Jul 14 19:52:30.824486 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:52:30.824469    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-6cf856758c-67qv6"]
Jul 14 19:52:30.824575 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:52:30.824561    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-pm29c\""
Jul 14 19:52:30.828002 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:52:30.827988    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Jul 14 19:52:30.828092 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:52:30.828068    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Jul 14 19:52:30.832327 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:52:30.832299    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ttgm4\" (UniqueName: \"kubernetes.io/projected/44512305-0548-44ec-a1f5-9ae26bd2cf8d-kube-api-access-ttgm4\") pod \"cluster-monitoring-operator-5f7f494dd4-2fgqz\" (UID: \"44512305-0548-44ec-a1f5-9ae26bd2cf8d\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-2fgqz"
Jul 14 19:52:30.835566 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:52:30.835545    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hzsjh\" (UniqueName: \"kubernetes.io/projected/ccc17280-3650-447f-a954-c075c7cc06d8-kube-api-access-hzsjh\") pod \"volume-data-source-validator-78495597f6-l85f2\" (UID: \"ccc17280-3650-447f-a954-c075c7cc06d8\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-l85f2"
Jul 14 19:52:30.839006 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:52:30.838846    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-7c8667c5fb-mb2v5"]
Jul 14 19:52:30.839006 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:52:30.838967    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6cf856758c-67qv6"
Jul 14 19:52:30.845364 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:52:30.845235    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-dbvzp\""
Jul 14 19:52:30.845629 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:52:30.845613    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-6cf856758c-67qv6"]
Jul 14 19:52:30.845823 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:52:30.845804    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\""
Jul 14 19:52:30.849138 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:52:30.849123    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\""
Jul 14 19:52:30.866729 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:52:30.866272    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Jul 14 19:52:30.896995 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:52:30.896957    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/8eec2471-b3c8-4541-b413-c356b5ed9782-trusted-ca\") pod \"image-registry-7c8667c5fb-mb2v5\" (UID: \"8eec2471-b3c8-4541-b413-c356b5ed9782\") " pod="openshift-image-registry/image-registry-7c8667c5fb-mb2v5"
Jul 14 19:52:30.896995 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:52:30.896992    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/8eec2471-b3c8-4541-b413-c356b5ed9782-bound-sa-token\") pod \"image-registry-7c8667c5fb-mb2v5\" (UID: \"8eec2471-b3c8-4541-b413-c356b5ed9782\") " pod="openshift-image-registry/image-registry-7c8667c5fb-mb2v5"
Jul 14 19:52:30.897245 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:52:30.897016    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/8eec2471-b3c8-4541-b413-c356b5ed9782-image-registry-private-configuration\") pod \"image-registry-7c8667c5fb-mb2v5\" (UID: \"8eec2471-b3c8-4541-b413-c356b5ed9782\") " pod="openshift-image-registry/image-registry-7c8667c5fb-mb2v5"
Jul 14 19:52:30.897245 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:52:30.897033    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qppzs\" (UniqueName: \"kubernetes.io/projected/71c07105-14b6-4c70-967c-22fe858bea59-kube-api-access-qppzs\") pod \"kube-storage-version-migrator-operator-799cb7f958-gm5zm\" (UID: \"71c07105-14b6-4c70-967c-22fe858bea59\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-gm5zm"
Jul 14 19:52:30.897245 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:52:30.897052    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/8eec2471-b3c8-4541-b413-c356b5ed9782-installation-pull-secrets\") pod \"image-registry-7c8667c5fb-mb2v5\" (UID: \"8eec2471-b3c8-4541-b413-c356b5ed9782\") " pod="openshift-image-registry/image-registry-7c8667c5fb-mb2v5"
Jul 14 19:52:30.897245 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:52:30.897109    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bvkxt\" (UniqueName: \"kubernetes.io/projected/8eec2471-b3c8-4541-b413-c356b5ed9782-kube-api-access-bvkxt\") pod \"image-registry-7c8667c5fb-mb2v5\" (UID: \"8eec2471-b3c8-4541-b413-c356b5ed9782\") " pod="openshift-image-registry/image-registry-7c8667c5fb-mb2v5"
Jul 14 19:52:30.897245 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:52:30.897152    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/8eec2471-b3c8-4541-b413-c356b5ed9782-registry-certificates\") pod \"image-registry-7c8667c5fb-mb2v5\" (UID: \"8eec2471-b3c8-4541-b413-c356b5ed9782\") " pod="openshift-image-registry/image-registry-7c8667c5fb-mb2v5"
Jul 14 19:52:30.897245 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:52:30.897175    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/52346b15-5bc4-4abc-8ecf-d52e688f2541-nginx-conf\") pod \"networking-console-plugin-6cf856758c-67qv6\" (UID: \"52346b15-5bc4-4abc-8ecf-d52e688f2541\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-67qv6"
Jul 14 19:52:30.897245 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:52:30.897198    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/52346b15-5bc4-4abc-8ecf-d52e688f2541-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-67qv6\" (UID: \"52346b15-5bc4-4abc-8ecf-d52e688f2541\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-67qv6"
Jul 14 19:52:30.897558 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:52:30.897248    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/8eec2471-b3c8-4541-b413-c356b5ed9782-registry-tls\") pod \"image-registry-7c8667c5fb-mb2v5\" (UID: \"8eec2471-b3c8-4541-b413-c356b5ed9782\") " pod="openshift-image-registry/image-registry-7c8667c5fb-mb2v5"
Jul 14 19:52:30.897558 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:52:30.897280    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/71c07105-14b6-4c70-967c-22fe858bea59-serving-cert\") pod \"kube-storage-version-migrator-operator-799cb7f958-gm5zm\" (UID: \"71c07105-14b6-4c70-967c-22fe858bea59\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-gm5zm"
Jul 14 19:52:30.897558 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:52:30.897309    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/71c07105-14b6-4c70-967c-22fe858bea59-config\") pod \"kube-storage-version-migrator-operator-799cb7f958-gm5zm\" (UID: \"71c07105-14b6-4c70-967c-22fe858bea59\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-gm5zm"
Jul 14 19:52:30.897558 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:52:30.897398    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/8eec2471-b3c8-4541-b413-c356b5ed9782-ca-trust-extracted\") pod \"image-registry-7c8667c5fb-mb2v5\" (UID: \"8eec2471-b3c8-4541-b413-c356b5ed9782\") " pod="openshift-image-registry/image-registry-7c8667c5fb-mb2v5"
Jul 14 19:52:30.923709 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:52:30.923673    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-l85f2"
Jul 14 19:52:30.997755 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:52:30.997712    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/8eec2471-b3c8-4541-b413-c356b5ed9782-trusted-ca\") pod \"image-registry-7c8667c5fb-mb2v5\" (UID: \"8eec2471-b3c8-4541-b413-c356b5ed9782\") " pod="openshift-image-registry/image-registry-7c8667c5fb-mb2v5"
Jul 14 19:52:30.997755 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:52:30.997763    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/8eec2471-b3c8-4541-b413-c356b5ed9782-bound-sa-token\") pod \"image-registry-7c8667c5fb-mb2v5\" (UID: \"8eec2471-b3c8-4541-b413-c356b5ed9782\") " pod="openshift-image-registry/image-registry-7c8667c5fb-mb2v5"
Jul 14 19:52:30.998030 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:52:30.997796    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/8eec2471-b3c8-4541-b413-c356b5ed9782-image-registry-private-configuration\") pod \"image-registry-7c8667c5fb-mb2v5\" (UID: \"8eec2471-b3c8-4541-b413-c356b5ed9782\") " pod="openshift-image-registry/image-registry-7c8667c5fb-mb2v5"
Jul 14 19:52:30.998030 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:52:30.997823    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qppzs\" (UniqueName: \"kubernetes.io/projected/71c07105-14b6-4c70-967c-22fe858bea59-kube-api-access-qppzs\") pod \"kube-storage-version-migrator-operator-799cb7f958-gm5zm\" (UID: \"71c07105-14b6-4c70-967c-22fe858bea59\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-gm5zm"
Jul 14 19:52:30.998030 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:52:30.997854    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/8eec2471-b3c8-4541-b413-c356b5ed9782-installation-pull-secrets\") pod \"image-registry-7c8667c5fb-mb2v5\" (UID: \"8eec2471-b3c8-4541-b413-c356b5ed9782\") " pod="openshift-image-registry/image-registry-7c8667c5fb-mb2v5"
Jul 14 19:52:30.998030 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:52:30.997878    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bvkxt\" (UniqueName: \"kubernetes.io/projected/8eec2471-b3c8-4541-b413-c356b5ed9782-kube-api-access-bvkxt\") pod \"image-registry-7c8667c5fb-mb2v5\" (UID: \"8eec2471-b3c8-4541-b413-c356b5ed9782\") " pod="openshift-image-registry/image-registry-7c8667c5fb-mb2v5"
Jul 14 19:52:30.998030 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:52:30.997907    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/8eec2471-b3c8-4541-b413-c356b5ed9782-registry-certificates\") pod \"image-registry-7c8667c5fb-mb2v5\" (UID: \"8eec2471-b3c8-4541-b413-c356b5ed9782\") " pod="openshift-image-registry/image-registry-7c8667c5fb-mb2v5"
Jul 14 19:52:30.998030 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:52:30.997934    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/52346b15-5bc4-4abc-8ecf-d52e688f2541-nginx-conf\") pod \"networking-console-plugin-6cf856758c-67qv6\" (UID: \"52346b15-5bc4-4abc-8ecf-d52e688f2541\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-67qv6"
Jul 14 19:52:30.998030 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:52:30.997959    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/52346b15-5bc4-4abc-8ecf-d52e688f2541-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-67qv6\" (UID: \"52346b15-5bc4-4abc-8ecf-d52e688f2541\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-67qv6"
Jul 14 19:52:30.998030 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:52:30.998019    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/8eec2471-b3c8-4541-b413-c356b5ed9782-registry-tls\") pod \"image-registry-7c8667c5fb-mb2v5\" (UID: \"8eec2471-b3c8-4541-b413-c356b5ed9782\") " pod="openshift-image-registry/image-registry-7c8667c5fb-mb2v5"
Jul 14 19:52:30.998401 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:52:30.998043    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/71c07105-14b6-4c70-967c-22fe858bea59-serving-cert\") pod \"kube-storage-version-migrator-operator-799cb7f958-gm5zm\" (UID: \"71c07105-14b6-4c70-967c-22fe858bea59\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-gm5zm"
Jul 14 19:52:30.998401 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:52:30.998066    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/71c07105-14b6-4c70-967c-22fe858bea59-config\") pod \"kube-storage-version-migrator-operator-799cb7f958-gm5zm\" (UID: \"71c07105-14b6-4c70-967c-22fe858bea59\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-gm5zm"
Jul 14 19:52:30.998401 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:52:30.998160    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/8eec2471-b3c8-4541-b413-c356b5ed9782-ca-trust-extracted\") pod \"image-registry-7c8667c5fb-mb2v5\" (UID: \"8eec2471-b3c8-4541-b413-c356b5ed9782\") " pod="openshift-image-registry/image-registry-7c8667c5fb-mb2v5"
Jul 14 19:52:30.998687 ip-10-0-140-201 kubenswrapper[2579]: E0714 19:52:30.998666    2579 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 14 19:52:30.998852 ip-10-0-140-201 kubenswrapper[2579]: E0714 19:52:30.998832    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/52346b15-5bc4-4abc-8ecf-d52e688f2541-networking-console-plugin-cert podName:52346b15-5bc4-4abc-8ecf-d52e688f2541 nodeName:}" failed. No retries permitted until 2026-07-14 19:52:31.498809641 +0000 UTC m=+51.210405182 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/52346b15-5bc4-4abc-8ecf-d52e688f2541-networking-console-plugin-cert") pod "networking-console-plugin-6cf856758c-67qv6" (UID: "52346b15-5bc4-4abc-8ecf-d52e688f2541") : secret "networking-console-plugin-cert" not found
Jul 14 19:52:30.999042 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:52:30.999021    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/8eec2471-b3c8-4541-b413-c356b5ed9782-ca-trust-extracted\") pod \"image-registry-7c8667c5fb-mb2v5\" (UID: \"8eec2471-b3c8-4541-b413-c356b5ed9782\") " pod="openshift-image-registry/image-registry-7c8667c5fb-mb2v5"
Jul 14 19:52:30.999158 ip-10-0-140-201 kubenswrapper[2579]: E0714 19:52:30.999137    2579 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 14 19:52:30.999158 ip-10-0-140-201 kubenswrapper[2579]: E0714 19:52:30.999156    2579 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7c8667c5fb-mb2v5: secret "image-registry-tls" not found
Jul 14 19:52:30.999323 ip-10-0-140-201 kubenswrapper[2579]: E0714 19:52:30.999204    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8eec2471-b3c8-4541-b413-c356b5ed9782-registry-tls podName:8eec2471-b3c8-4541-b413-c356b5ed9782 nodeName:}" failed. No retries permitted until 2026-07-14 19:52:31.499190079 +0000 UTC m=+51.210785603 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/8eec2471-b3c8-4541-b413-c356b5ed9782-registry-tls") pod "image-registry-7c8667c5fb-mb2v5" (UID: "8eec2471-b3c8-4541-b413-c356b5ed9782") : secret "image-registry-tls" not found
Jul 14 19:52:30.999518 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:52:30.999494    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/8eec2471-b3c8-4541-b413-c356b5ed9782-registry-certificates\") pod \"image-registry-7c8667c5fb-mb2v5\" (UID: \"8eec2471-b3c8-4541-b413-c356b5ed9782\") " pod="openshift-image-registry/image-registry-7c8667c5fb-mb2v5"
Jul 14 19:52:31.000513 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:52:30.999747    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/71c07105-14b6-4c70-967c-22fe858bea59-config\") pod \"kube-storage-version-migrator-operator-799cb7f958-gm5zm\" (UID: \"71c07105-14b6-4c70-967c-22fe858bea59\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-gm5zm"
Jul 14 19:52:31.000513 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:52:31.000187    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/8eec2471-b3c8-4541-b413-c356b5ed9782-trusted-ca\") pod \"image-registry-7c8667c5fb-mb2v5\" (UID: \"8eec2471-b3c8-4541-b413-c356b5ed9782\") " pod="openshift-image-registry/image-registry-7c8667c5fb-mb2v5"
Jul 14 19:52:31.000513 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:52:31.000304    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/52346b15-5bc4-4abc-8ecf-d52e688f2541-nginx-conf\") pod \"networking-console-plugin-6cf856758c-67qv6\" (UID: \"52346b15-5bc4-4abc-8ecf-d52e688f2541\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-67qv6"
Jul 14 19:52:31.001754 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:52:31.001726    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/71c07105-14b6-4c70-967c-22fe858bea59-serving-cert\") pod \"kube-storage-version-migrator-operator-799cb7f958-gm5zm\" (UID: \"71c07105-14b6-4c70-967c-22fe858bea59\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-gm5zm"
Jul 14 19:52:31.001846 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:52:31.001831    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/8eec2471-b3c8-4541-b413-c356b5ed9782-image-registry-private-configuration\") pod \"image-registry-7c8667c5fb-mb2v5\" (UID: \"8eec2471-b3c8-4541-b413-c356b5ed9782\") " pod="openshift-image-registry/image-registry-7c8667c5fb-mb2v5"
Jul 14 19:52:31.001922 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:52:31.001898    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/8eec2471-b3c8-4541-b413-c356b5ed9782-installation-pull-secrets\") pod \"image-registry-7c8667c5fb-mb2v5\" (UID: \"8eec2471-b3c8-4541-b413-c356b5ed9782\") " pod="openshift-image-registry/image-registry-7c8667c5fb-mb2v5"
Jul 14 19:52:31.010329 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:52:31.010294    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bvkxt\" (UniqueName: \"kubernetes.io/projected/8eec2471-b3c8-4541-b413-c356b5ed9782-kube-api-access-bvkxt\") pod \"image-registry-7c8667c5fb-mb2v5\" (UID: \"8eec2471-b3c8-4541-b413-c356b5ed9782\") " pod="openshift-image-registry/image-registry-7c8667c5fb-mb2v5"
Jul 14 19:52:31.010468 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:52:31.010337    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qppzs\" (UniqueName: \"kubernetes.io/projected/71c07105-14b6-4c70-967c-22fe858bea59-kube-api-access-qppzs\") pod \"kube-storage-version-migrator-operator-799cb7f958-gm5zm\" (UID: \"71c07105-14b6-4c70-967c-22fe858bea59\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-gm5zm"
Jul 14 19:52:31.011240 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:52:31.010788    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/8eec2471-b3c8-4541-b413-c356b5ed9782-bound-sa-token\") pod \"image-registry-7c8667c5fb-mb2v5\" (UID: \"8eec2471-b3c8-4541-b413-c356b5ed9782\") " pod="openshift-image-registry/image-registry-7c8667c5fb-mb2v5"
Jul 14 19:52:31.087583 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:52:31.087552    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-l85f2"]
Jul 14 19:52:31.090334 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:52:31.090308    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podccc17280_3650_447f_a954_c075c7cc06d8.slice/crio-662fc578c7513333b12d6f457bfa4d30d3e8d223261a97c846b2eea5bcd82374 WatchSource:0}: Error finding container 662fc578c7513333b12d6f457bfa4d30d3e8d223261a97c846b2eea5bcd82374: Status 404 returned error can't find the container with id 662fc578c7513333b12d6f457bfa4d30d3e8d223261a97c846b2eea5bcd82374
Jul 14 19:52:31.105701 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:52:31.105633    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-gm5zm"
Jul 14 19:52:31.257670 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:52:31.257640    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-gm5zm"]
Jul 14 19:52:31.260934 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:52:31.260910    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod71c07105_14b6_4c70_967c_22fe858bea59.slice/crio-29370288d82f6a61507dc95b9045423560be215c9d68a85c2a92e0eef514fb25 WatchSource:0}: Error finding container 29370288d82f6a61507dc95b9045423560be215c9d68a85c2a92e0eef514fb25: Status 404 returned error can't find the container with id 29370288d82f6a61507dc95b9045423560be215c9d68a85c2a92e0eef514fb25
Jul 14 19:52:31.300290 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:52:31.300245    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/44512305-0548-44ec-a1f5-9ae26bd2cf8d-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-2fgqz\" (UID: \"44512305-0548-44ec-a1f5-9ae26bd2cf8d\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-2fgqz"
Jul 14 19:52:31.300480 ip-10-0-140-201 kubenswrapper[2579]: E0714 19:52:31.300396    2579 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 14 19:52:31.300480 ip-10-0-140-201 kubenswrapper[2579]: E0714 19:52:31.300464    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/44512305-0548-44ec-a1f5-9ae26bd2cf8d-cluster-monitoring-operator-tls podName:44512305-0548-44ec-a1f5-9ae26bd2cf8d nodeName:}" failed. No retries permitted until 2026-07-14 19:52:32.300448936 +0000 UTC m=+52.012044461 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/44512305-0548-44ec-a1f5-9ae26bd2cf8d-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-2fgqz" (UID: "44512305-0548-44ec-a1f5-9ae26bd2cf8d") : secret "cluster-monitoring-operator-tls" not found
Jul 14 19:52:31.502157 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:52:31.502115    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/52346b15-5bc4-4abc-8ecf-d52e688f2541-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-67qv6\" (UID: \"52346b15-5bc4-4abc-8ecf-d52e688f2541\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-67qv6"
Jul 14 19:52:31.502351 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:52:31.502170    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/8eec2471-b3c8-4541-b413-c356b5ed9782-registry-tls\") pod \"image-registry-7c8667c5fb-mb2v5\" (UID: \"8eec2471-b3c8-4541-b413-c356b5ed9782\") " pod="openshift-image-registry/image-registry-7c8667c5fb-mb2v5"
Jul 14 19:52:31.502351 ip-10-0-140-201 kubenswrapper[2579]: E0714 19:52:31.502264    2579 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 14 19:52:31.502351 ip-10-0-140-201 kubenswrapper[2579]: E0714 19:52:31.502287    2579 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 14 19:52:31.502351 ip-10-0-140-201 kubenswrapper[2579]: E0714 19:52:31.502301    2579 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7c8667c5fb-mb2v5: secret "image-registry-tls" not found
Jul 14 19:52:31.502351 ip-10-0-140-201 kubenswrapper[2579]: E0714 19:52:31.502329    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/52346b15-5bc4-4abc-8ecf-d52e688f2541-networking-console-plugin-cert podName:52346b15-5bc4-4abc-8ecf-d52e688f2541 nodeName:}" failed. No retries permitted until 2026-07-14 19:52:32.502314556 +0000 UTC m=+52.213910077 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/52346b15-5bc4-4abc-8ecf-d52e688f2541-networking-console-plugin-cert") pod "networking-console-plugin-6cf856758c-67qv6" (UID: "52346b15-5bc4-4abc-8ecf-d52e688f2541") : secret "networking-console-plugin-cert" not found
Jul 14 19:52:31.502351 ip-10-0-140-201 kubenswrapper[2579]: E0714 19:52:31.502351    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8eec2471-b3c8-4541-b413-c356b5ed9782-registry-tls podName:8eec2471-b3c8-4541-b413-c356b5ed9782 nodeName:}" failed. No retries permitted until 2026-07-14 19:52:32.502336428 +0000 UTC m=+52.213931969 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/8eec2471-b3c8-4541-b413-c356b5ed9782-registry-tls") pod "image-registry-7c8667c5fb-mb2v5" (UID: "8eec2471-b3c8-4541-b413-c356b5ed9782") : secret "image-registry-tls" not found
Jul 14 19:52:32.082024 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:52:32.081984    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-gm5zm" event={"ID":"71c07105-14b6-4c70-967c-22fe858bea59","Type":"ContainerStarted","Data":"29370288d82f6a61507dc95b9045423560be215c9d68a85c2a92e0eef514fb25"}
Jul 14 19:52:32.083246 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:52:32.083219    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-l85f2" event={"ID":"ccc17280-3650-447f-a954-c075c7cc06d8","Type":"ContainerStarted","Data":"662fc578c7513333b12d6f457bfa4d30d3e8d223261a97c846b2eea5bcd82374"}
Jul 14 19:52:32.309302 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:52:32.309259    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/44512305-0548-44ec-a1f5-9ae26bd2cf8d-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-2fgqz\" (UID: \"44512305-0548-44ec-a1f5-9ae26bd2cf8d\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-2fgqz"
Jul 14 19:52:32.309480 ip-10-0-140-201 kubenswrapper[2579]: E0714 19:52:32.309463    2579 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 14 19:52:32.309525 ip-10-0-140-201 kubenswrapper[2579]: E0714 19:52:32.309515    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/44512305-0548-44ec-a1f5-9ae26bd2cf8d-cluster-monitoring-operator-tls podName:44512305-0548-44ec-a1f5-9ae26bd2cf8d nodeName:}" failed. No retries permitted until 2026-07-14 19:52:34.309502137 +0000 UTC m=+54.021097659 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/44512305-0548-44ec-a1f5-9ae26bd2cf8d-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-2fgqz" (UID: "44512305-0548-44ec-a1f5-9ae26bd2cf8d") : secret "cluster-monitoring-operator-tls" not found
Jul 14 19:52:32.511044 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:52:32.510998    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/52346b15-5bc4-4abc-8ecf-d52e688f2541-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-67qv6\" (UID: \"52346b15-5bc4-4abc-8ecf-d52e688f2541\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-67qv6"
Jul 14 19:52:32.511233 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:52:32.511073    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/8eec2471-b3c8-4541-b413-c356b5ed9782-registry-tls\") pod \"image-registry-7c8667c5fb-mb2v5\" (UID: \"8eec2471-b3c8-4541-b413-c356b5ed9782\") " pod="openshift-image-registry/image-registry-7c8667c5fb-mb2v5"
Jul 14 19:52:32.511233 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:52:32.511173    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/0360d8bf-1d2a-43c4-8638-6766128ff3d4-metrics-tls\") pod \"dns-default-cpzqc\" (UID: \"0360d8bf-1d2a-43c4-8638-6766128ff3d4\") " pod="openshift-dns/dns-default-cpzqc"
Jul 14 19:52:32.511345 ip-10-0-140-201 kubenswrapper[2579]: E0714 19:52:32.511319    2579 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 14 19:52:32.511392 ip-10-0-140-201 kubenswrapper[2579]: E0714 19:52:32.511376    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0360d8bf-1d2a-43c4-8638-6766128ff3d4-metrics-tls podName:0360d8bf-1d2a-43c4-8638-6766128ff3d4 nodeName:}" failed. No retries permitted until 2026-07-14 19:52:48.511360258 +0000 UTC m=+68.222955783 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/0360d8bf-1d2a-43c4-8638-6766128ff3d4-metrics-tls") pod "dns-default-cpzqc" (UID: "0360d8bf-1d2a-43c4-8638-6766128ff3d4") : secret "dns-default-metrics-tls" not found
Jul 14 19:52:32.511449 ip-10-0-140-201 kubenswrapper[2579]: E0714 19:52:32.511434    2579 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 14 19:52:32.511502 ip-10-0-140-201 kubenswrapper[2579]: E0714 19:52:32.511467    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/52346b15-5bc4-4abc-8ecf-d52e688f2541-networking-console-plugin-cert podName:52346b15-5bc4-4abc-8ecf-d52e688f2541 nodeName:}" failed. No retries permitted until 2026-07-14 19:52:34.511455401 +0000 UTC m=+54.223050922 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/52346b15-5bc4-4abc-8ecf-d52e688f2541-networking-console-plugin-cert") pod "networking-console-plugin-6cf856758c-67qv6" (UID: "52346b15-5bc4-4abc-8ecf-d52e688f2541") : secret "networking-console-plugin-cert" not found
Jul 14 19:52:32.511581 ip-10-0-140-201 kubenswrapper[2579]: E0714 19:52:32.511511    2579 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 14 19:52:32.511581 ip-10-0-140-201 kubenswrapper[2579]: E0714 19:52:32.511519    2579 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7c8667c5fb-mb2v5: secret "image-registry-tls" not found
Jul 14 19:52:32.511581 ip-10-0-140-201 kubenswrapper[2579]: E0714 19:52:32.511553    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8eec2471-b3c8-4541-b413-c356b5ed9782-registry-tls podName:8eec2471-b3c8-4541-b413-c356b5ed9782 nodeName:}" failed. No retries permitted until 2026-07-14 19:52:34.511546181 +0000 UTC m=+54.223141702 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/8eec2471-b3c8-4541-b413-c356b5ed9782-registry-tls") pod "image-registry-7c8667c5fb-mb2v5" (UID: "8eec2471-b3c8-4541-b413-c356b5ed9782") : secret "image-registry-tls" not found
Jul 14 19:52:34.089799 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:52:34.089765    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-gm5zm" event={"ID":"71c07105-14b6-4c70-967c-22fe858bea59","Type":"ContainerStarted","Data":"e0eb1c40419d8b335b049af9688c8a5b7baec1932c6f562280224099dbb83b1e"}
Jul 14 19:52:34.091358 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:52:34.091284    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-l85f2" event={"ID":"ccc17280-3650-447f-a954-c075c7cc06d8","Type":"ContainerStarted","Data":"4abbd08e730d27d2bf897c7be275898db5b91ef42fceae8d83e81d5ddf00f460"}
Jul 14 19:52:34.107339 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:52:34.107285    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-gm5zm" podStartSLOduration=1.3538449350000001 podStartE2EDuration="4.107267703s" totalImagesPullingTime="2.753422768s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 19:52:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 19:52:34.105468613 +0000 UTC m=+53.817064155" watchObservedRunningTime="2026-07-14 19:52:34.107267703 +0000 UTC m=+53.818863247"
Jul 14 19:52:34.123351 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:52:34.123261    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-l85f2" podStartSLOduration=1.433988647 podStartE2EDuration="4.123240979s" totalImagesPullingTime="2.689252332s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 19:52:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 19:52:34.121891824 +0000 UTC m=+53.833487367" watchObservedRunningTime="2026-07-14 19:52:34.123240979 +0000 UTC m=+53.834836523"
Jul 14 19:52:34.327457 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:52:34.327353    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/44512305-0548-44ec-a1f5-9ae26bd2cf8d-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-2fgqz\" (UID: \"44512305-0548-44ec-a1f5-9ae26bd2cf8d\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-2fgqz"
Jul 14 19:52:34.327647 ip-10-0-140-201 kubenswrapper[2579]: E0714 19:52:34.327585    2579 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 14 19:52:34.327712 ip-10-0-140-201 kubenswrapper[2579]: E0714 19:52:34.327676    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/44512305-0548-44ec-a1f5-9ae26bd2cf8d-cluster-monitoring-operator-tls podName:44512305-0548-44ec-a1f5-9ae26bd2cf8d nodeName:}" failed. No retries permitted until 2026-07-14 19:52:38.327653638 +0000 UTC m=+58.039249176 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/44512305-0548-44ec-a1f5-9ae26bd2cf8d-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-2fgqz" (UID: "44512305-0548-44ec-a1f5-9ae26bd2cf8d") : secret "cluster-monitoring-operator-tls" not found
Jul 14 19:52:34.529019 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:52:34.528981    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/52346b15-5bc4-4abc-8ecf-d52e688f2541-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-67qv6\" (UID: \"52346b15-5bc4-4abc-8ecf-d52e688f2541\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-67qv6"
Jul 14 19:52:34.529171 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:52:34.529027    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/8eec2471-b3c8-4541-b413-c356b5ed9782-registry-tls\") pod \"image-registry-7c8667c5fb-mb2v5\" (UID: \"8eec2471-b3c8-4541-b413-c356b5ed9782\") " pod="openshift-image-registry/image-registry-7c8667c5fb-mb2v5"
Jul 14 19:52:34.529171 ip-10-0-140-201 kubenswrapper[2579]: E0714 19:52:34.529143    2579 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 14 19:52:34.529171 ip-10-0-140-201 kubenswrapper[2579]: E0714 19:52:34.529140    2579 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 14 19:52:34.529171 ip-10-0-140-201 kubenswrapper[2579]: E0714 19:52:34.529155    2579 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7c8667c5fb-mb2v5: secret "image-registry-tls" not found
Jul 14 19:52:34.529296 ip-10-0-140-201 kubenswrapper[2579]: E0714 19:52:34.529215    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8eec2471-b3c8-4541-b413-c356b5ed9782-registry-tls podName:8eec2471-b3c8-4541-b413-c356b5ed9782 nodeName:}" failed. No retries permitted until 2026-07-14 19:52:38.529201996 +0000 UTC m=+58.240797517 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/8eec2471-b3c8-4541-b413-c356b5ed9782-registry-tls") pod "image-registry-7c8667c5fb-mb2v5" (UID: "8eec2471-b3c8-4541-b413-c356b5ed9782") : secret "image-registry-tls" not found
Jul 14 19:52:34.529296 ip-10-0-140-201 kubenswrapper[2579]: E0714 19:52:34.529229    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/52346b15-5bc4-4abc-8ecf-d52e688f2541-networking-console-plugin-cert podName:52346b15-5bc4-4abc-8ecf-d52e688f2541 nodeName:}" failed. No retries permitted until 2026-07-14 19:52:38.529224199 +0000 UTC m=+58.240819720 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/52346b15-5bc4-4abc-8ecf-d52e688f2541-networking-console-plugin-cert") pod "networking-console-plugin-6cf856758c-67qv6" (UID: "52346b15-5bc4-4abc-8ecf-d52e688f2541") : secret "networking-console-plugin-cert" not found
Jul 14 19:52:35.019741 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:52:35.019703    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-wg62n"]
Jul 14 19:52:35.023072 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:52:35.023044    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-wg62n"
Jul 14 19:52:35.027619 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:52:35.027594    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 14 19:52:35.028626 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:52:35.028604    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-mlhmv\""
Jul 14 19:52:35.028744 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:52:35.028625    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 14 19:52:35.028893 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:52:35.028872    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 14 19:52:35.029020 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:52:35.029007    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 14 19:52:35.033194 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:52:35.033172    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/eaa66e64-34f1-417d-ad95-884ac468df21-data-volume\") pod \"insights-runtime-extractor-wg62n\" (UID: \"eaa66e64-34f1-417d-ad95-884ac468df21\") " pod="openshift-insights/insights-runtime-extractor-wg62n"
Jul 14 19:52:35.033307 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:52:35.033234    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/eaa66e64-34f1-417d-ad95-884ac468df21-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-wg62n\" (UID: \"eaa66e64-34f1-417d-ad95-884ac468df21\") " pod="openshift-insights/insights-runtime-extractor-wg62n"
Jul 14 19:52:35.033307 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:52:35.033266    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/eaa66e64-34f1-417d-ad95-884ac468df21-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-wg62n\" (UID: \"eaa66e64-34f1-417d-ad95-884ac468df21\") " pod="openshift-insights/insights-runtime-extractor-wg62n"
Jul 14 19:52:35.033307 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:52:35.033295    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p8hn9\" (UniqueName: \"kubernetes.io/projected/eaa66e64-34f1-417d-ad95-884ac468df21-kube-api-access-p8hn9\") pod \"insights-runtime-extractor-wg62n\" (UID: \"eaa66e64-34f1-417d-ad95-884ac468df21\") " pod="openshift-insights/insights-runtime-extractor-wg62n"
Jul 14 19:52:35.033462 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:52:35.033384    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/eaa66e64-34f1-417d-ad95-884ac468df21-crio-socket\") pod \"insights-runtime-extractor-wg62n\" (UID: \"eaa66e64-34f1-417d-ad95-884ac468df21\") " pod="openshift-insights/insights-runtime-extractor-wg62n"
Jul 14 19:52:35.053851 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:52:35.053822    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-wg62n"]
Jul 14 19:52:35.133939 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:52:35.133898    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/eaa66e64-34f1-417d-ad95-884ac468df21-crio-socket\") pod \"insights-runtime-extractor-wg62n\" (UID: \"eaa66e64-34f1-417d-ad95-884ac468df21\") " pod="openshift-insights/insights-runtime-extractor-wg62n"
Jul 14 19:52:35.133939 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:52:35.133943    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/eaa66e64-34f1-417d-ad95-884ac468df21-data-volume\") pod \"insights-runtime-extractor-wg62n\" (UID: \"eaa66e64-34f1-417d-ad95-884ac468df21\") " pod="openshift-insights/insights-runtime-extractor-wg62n"
Jul 14 19:52:35.134461 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:52:35.134021    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/eaa66e64-34f1-417d-ad95-884ac468df21-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-wg62n\" (UID: \"eaa66e64-34f1-417d-ad95-884ac468df21\") " pod="openshift-insights/insights-runtime-extractor-wg62n"
Jul 14 19:52:35.134461 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:52:35.134062    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/eaa66e64-34f1-417d-ad95-884ac468df21-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-wg62n\" (UID: \"eaa66e64-34f1-417d-ad95-884ac468df21\") " pod="openshift-insights/insights-runtime-extractor-wg62n"
Jul 14 19:52:35.134461 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:52:35.134118    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/eaa66e64-34f1-417d-ad95-884ac468df21-crio-socket\") pod \"insights-runtime-extractor-wg62n\" (UID: \"eaa66e64-34f1-417d-ad95-884ac468df21\") " pod="openshift-insights/insights-runtime-extractor-wg62n"
Jul 14 19:52:35.134461 ip-10-0-140-201 kubenswrapper[2579]: E0714 19:52:35.134132    2579 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 14 19:52:35.134461 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:52:35.134123    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p8hn9\" (UniqueName: \"kubernetes.io/projected/eaa66e64-34f1-417d-ad95-884ac468df21-kube-api-access-p8hn9\") pod \"insights-runtime-extractor-wg62n\" (UID: \"eaa66e64-34f1-417d-ad95-884ac468df21\") " pod="openshift-insights/insights-runtime-extractor-wg62n"
Jul 14 19:52:35.134461 ip-10-0-140-201 kubenswrapper[2579]: E0714 19:52:35.134211    2579 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 14 19:52:35.134461 ip-10-0-140-201 kubenswrapper[2579]: E0714 19:52:35.134216    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/eaa66e64-34f1-417d-ad95-884ac468df21-kube-rbac-proxy-cm podName:eaa66e64-34f1-417d-ad95-884ac468df21 nodeName:}" failed. No retries permitted until 2026-07-14 19:52:35.634195457 +0000 UTC m=+55.345790995 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/eaa66e64-34f1-417d-ad95-884ac468df21-kube-rbac-proxy-cm") pod "insights-runtime-extractor-wg62n" (UID: "eaa66e64-34f1-417d-ad95-884ac468df21") : configmap "kube-rbac-proxy" not found
Jul 14 19:52:35.134461 ip-10-0-140-201 kubenswrapper[2579]: E0714 19:52:35.134299    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/eaa66e64-34f1-417d-ad95-884ac468df21-insights-runtime-extractor-tls podName:eaa66e64-34f1-417d-ad95-884ac468df21 nodeName:}" failed. No retries permitted until 2026-07-14 19:52:35.634280717 +0000 UTC m=+55.345876243 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/eaa66e64-34f1-417d-ad95-884ac468df21-insights-runtime-extractor-tls") pod "insights-runtime-extractor-wg62n" (UID: "eaa66e64-34f1-417d-ad95-884ac468df21") : secret "insights-runtime-extractor-tls" not found
Jul 14 19:52:35.134461 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:52:35.134336    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/eaa66e64-34f1-417d-ad95-884ac468df21-data-volume\") pod \"insights-runtime-extractor-wg62n\" (UID: \"eaa66e64-34f1-417d-ad95-884ac468df21\") " pod="openshift-insights/insights-runtime-extractor-wg62n"
Jul 14 19:52:35.142547 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:52:35.142503    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p8hn9\" (UniqueName: \"kubernetes.io/projected/eaa66e64-34f1-417d-ad95-884ac468df21-kube-api-access-p8hn9\") pod \"insights-runtime-extractor-wg62n\" (UID: \"eaa66e64-34f1-417d-ad95-884ac468df21\") " pod="openshift-insights/insights-runtime-extractor-wg62n"
Jul 14 19:52:35.638966 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:52:35.638927    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/eaa66e64-34f1-417d-ad95-884ac468df21-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-wg62n\" (UID: \"eaa66e64-34f1-417d-ad95-884ac468df21\") " pod="openshift-insights/insights-runtime-extractor-wg62n"
Jul 14 19:52:35.639155 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:52:35.638977    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/eaa66e64-34f1-417d-ad95-884ac468df21-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-wg62n\" (UID: \"eaa66e64-34f1-417d-ad95-884ac468df21\") " pod="openshift-insights/insights-runtime-extractor-wg62n"
Jul 14 19:52:35.639155 ip-10-0-140-201 kubenswrapper[2579]: E0714 19:52:35.639047    2579 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 14 19:52:35.639155 ip-10-0-140-201 kubenswrapper[2579]: E0714 19:52:35.639115    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/eaa66e64-34f1-417d-ad95-884ac468df21-kube-rbac-proxy-cm podName:eaa66e64-34f1-417d-ad95-884ac468df21 nodeName:}" failed. No retries permitted until 2026-07-14 19:52:36.639099338 +0000 UTC m=+56.350694864 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/eaa66e64-34f1-417d-ad95-884ac468df21-kube-rbac-proxy-cm") pod "insights-runtime-extractor-wg62n" (UID: "eaa66e64-34f1-417d-ad95-884ac468df21") : configmap "kube-rbac-proxy" not found
Jul 14 19:52:35.639155 ip-10-0-140-201 kubenswrapper[2579]: E0714 19:52:35.639121    2579 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 14 19:52:35.639155 ip-10-0-140-201 kubenswrapper[2579]: E0714 19:52:35.639160    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/eaa66e64-34f1-417d-ad95-884ac468df21-insights-runtime-extractor-tls podName:eaa66e64-34f1-417d-ad95-884ac468df21 nodeName:}" failed. No retries permitted until 2026-07-14 19:52:36.639150245 +0000 UTC m=+56.350745767 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/eaa66e64-34f1-417d-ad95-884ac468df21-insights-runtime-extractor-tls") pod "insights-runtime-extractor-wg62n" (UID: "eaa66e64-34f1-417d-ad95-884ac468df21") : secret "insights-runtime-extractor-tls" not found
Jul 14 19:52:36.645917 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:52:36.645878    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/eaa66e64-34f1-417d-ad95-884ac468df21-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-wg62n\" (UID: \"eaa66e64-34f1-417d-ad95-884ac468df21\") " pod="openshift-insights/insights-runtime-extractor-wg62n"
Jul 14 19:52:36.645917 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:52:36.645929    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/eaa66e64-34f1-417d-ad95-884ac468df21-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-wg62n\" (UID: \"eaa66e64-34f1-417d-ad95-884ac468df21\") " pod="openshift-insights/insights-runtime-extractor-wg62n"
Jul 14 19:52:36.646377 ip-10-0-140-201 kubenswrapper[2579]: E0714 19:52:36.646012    2579 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 14 19:52:36.646377 ip-10-0-140-201 kubenswrapper[2579]: E0714 19:52:36.646020    2579 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 14 19:52:36.646377 ip-10-0-140-201 kubenswrapper[2579]: E0714 19:52:36.646092    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/eaa66e64-34f1-417d-ad95-884ac468df21-kube-rbac-proxy-cm podName:eaa66e64-34f1-417d-ad95-884ac468df21 nodeName:}" failed. No retries permitted until 2026-07-14 19:52:38.646070896 +0000 UTC m=+58.357666432 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/eaa66e64-34f1-417d-ad95-884ac468df21-kube-rbac-proxy-cm") pod "insights-runtime-extractor-wg62n" (UID: "eaa66e64-34f1-417d-ad95-884ac468df21") : configmap "kube-rbac-proxy" not found
Jul 14 19:52:36.646377 ip-10-0-140-201 kubenswrapper[2579]: E0714 19:52:36.646127    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/eaa66e64-34f1-417d-ad95-884ac468df21-insights-runtime-extractor-tls podName:eaa66e64-34f1-417d-ad95-884ac468df21 nodeName:}" failed. No retries permitted until 2026-07-14 19:52:38.646114169 +0000 UTC m=+58.357709693 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/eaa66e64-34f1-417d-ad95-884ac468df21-insights-runtime-extractor-tls") pod "insights-runtime-extractor-wg62n" (UID: "eaa66e64-34f1-417d-ad95-884ac468df21") : secret "insights-runtime-extractor-tls" not found
Jul 14 19:52:36.807940 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:52:36.807912    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-4qscd_209b5a52-9d80-45ca-9c92-63578a945220/dns-node-resolver/0.log"
Jul 14 19:52:38.007762 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:52:38.007737    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-gb26w_1ea2bd9d-b2c3-42ce-a0ee-c3719d4f048e/node-ca/0.log"
Jul 14 19:52:38.222943 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:52:38.222904    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-79f68b9f4f-57g5q"]
Jul 14 19:52:38.226199 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:52:38.226183    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-79f68b9f4f-57g5q"
Jul 14 19:52:38.228978 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:52:38.228960    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\""
Jul 14 19:52:38.229825 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:52:38.229807    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\""
Jul 14 19:52:38.229906 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:52:38.229808    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-spfkh\""
Jul 14 19:52:38.229955 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:52:38.229808    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\""
Jul 14 19:52:38.229955 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:52:38.229817    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\""
Jul 14 19:52:38.242169 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:52:38.242135    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-79f68b9f4f-57g5q"]
Jul 14 19:52:38.258930 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:52:38.258848    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5xlh5\" (UniqueName: \"kubernetes.io/projected/9311da0b-0174-4c45-a0a8-4c0574f3446e-kube-api-access-5xlh5\") pod \"service-ca-79f68b9f4f-57g5q\" (UID: \"9311da0b-0174-4c45-a0a8-4c0574f3446e\") " pod="openshift-service-ca/service-ca-79f68b9f4f-57g5q"
Jul 14 19:52:38.258930 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:52:38.258885    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/9311da0b-0174-4c45-a0a8-4c0574f3446e-signing-cabundle\") pod \"service-ca-79f68b9f4f-57g5q\" (UID: \"9311da0b-0174-4c45-a0a8-4c0574f3446e\") " pod="openshift-service-ca/service-ca-79f68b9f4f-57g5q"
Jul 14 19:52:38.259116 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:52:38.258963    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/9311da0b-0174-4c45-a0a8-4c0574f3446e-signing-key\") pod \"service-ca-79f68b9f4f-57g5q\" (UID: \"9311da0b-0174-4c45-a0a8-4c0574f3446e\") " pod="openshift-service-ca/service-ca-79f68b9f4f-57g5q"
Jul 14 19:52:38.360233 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:52:38.360188    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/9311da0b-0174-4c45-a0a8-4c0574f3446e-signing-cabundle\") pod \"service-ca-79f68b9f4f-57g5q\" (UID: \"9311da0b-0174-4c45-a0a8-4c0574f3446e\") " pod="openshift-service-ca/service-ca-79f68b9f4f-57g5q"
Jul 14 19:52:38.360420 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:52:38.360281    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/9311da0b-0174-4c45-a0a8-4c0574f3446e-signing-key\") pod \"service-ca-79f68b9f4f-57g5q\" (UID: \"9311da0b-0174-4c45-a0a8-4c0574f3446e\") " pod="openshift-service-ca/service-ca-79f68b9f4f-57g5q"
Jul 14 19:52:38.360420 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:52:38.360332    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/44512305-0548-44ec-a1f5-9ae26bd2cf8d-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-2fgqz\" (UID: \"44512305-0548-44ec-a1f5-9ae26bd2cf8d\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-2fgqz"
Jul 14 19:52:38.360420 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:52:38.360379    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5xlh5\" (UniqueName: \"kubernetes.io/projected/9311da0b-0174-4c45-a0a8-4c0574f3446e-kube-api-access-5xlh5\") pod \"service-ca-79f68b9f4f-57g5q\" (UID: \"9311da0b-0174-4c45-a0a8-4c0574f3446e\") " pod="openshift-service-ca/service-ca-79f68b9f4f-57g5q"
Jul 14 19:52:38.360562 ip-10-0-140-201 kubenswrapper[2579]: E0714 19:52:38.360518    2579 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 14 19:52:38.360618 ip-10-0-140-201 kubenswrapper[2579]: E0714 19:52:38.360608    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/44512305-0548-44ec-a1f5-9ae26bd2cf8d-cluster-monitoring-operator-tls podName:44512305-0548-44ec-a1f5-9ae26bd2cf8d nodeName:}" failed. No retries permitted until 2026-07-14 19:52:46.360592575 +0000 UTC m=+66.072188096 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/44512305-0548-44ec-a1f5-9ae26bd2cf8d-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-2fgqz" (UID: "44512305-0548-44ec-a1f5-9ae26bd2cf8d") : secret "cluster-monitoring-operator-tls" not found
Jul 14 19:52:38.361004 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:52:38.360983    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/9311da0b-0174-4c45-a0a8-4c0574f3446e-signing-cabundle\") pod \"service-ca-79f68b9f4f-57g5q\" (UID: \"9311da0b-0174-4c45-a0a8-4c0574f3446e\") " pod="openshift-service-ca/service-ca-79f68b9f4f-57g5q"
Jul 14 19:52:38.362834 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:52:38.362810    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/9311da0b-0174-4c45-a0a8-4c0574f3446e-signing-key\") pod \"service-ca-79f68b9f4f-57g5q\" (UID: \"9311da0b-0174-4c45-a0a8-4c0574f3446e\") " pod="openshift-service-ca/service-ca-79f68b9f4f-57g5q"
Jul 14 19:52:38.369558 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:52:38.369516    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5xlh5\" (UniqueName: \"kubernetes.io/projected/9311da0b-0174-4c45-a0a8-4c0574f3446e-kube-api-access-5xlh5\") pod \"service-ca-79f68b9f4f-57g5q\" (UID: \"9311da0b-0174-4c45-a0a8-4c0574f3446e\") " pod="openshift-service-ca/service-ca-79f68b9f4f-57g5q"
Jul 14 19:52:38.534725 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:52:38.534640    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-79f68b9f4f-57g5q"
Jul 14 19:52:38.562211 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:52:38.562175    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/52346b15-5bc4-4abc-8ecf-d52e688f2541-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-67qv6\" (UID: \"52346b15-5bc4-4abc-8ecf-d52e688f2541\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-67qv6"
Jul 14 19:52:38.562376 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:52:38.562302    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/8eec2471-b3c8-4541-b413-c356b5ed9782-registry-tls\") pod \"image-registry-7c8667c5fb-mb2v5\" (UID: \"8eec2471-b3c8-4541-b413-c356b5ed9782\") " pod="openshift-image-registry/image-registry-7c8667c5fb-mb2v5"
Jul 14 19:52:38.562376 ip-10-0-140-201 kubenswrapper[2579]: E0714 19:52:38.562345    2579 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 14 19:52:38.562451 ip-10-0-140-201 kubenswrapper[2579]: E0714 19:52:38.562410    2579 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 14 19:52:38.562451 ip-10-0-140-201 kubenswrapper[2579]: E0714 19:52:38.562420    2579 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7c8667c5fb-mb2v5: secret "image-registry-tls" not found
Jul 14 19:52:38.562451 ip-10-0-140-201 kubenswrapper[2579]: E0714 19:52:38.562427    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/52346b15-5bc4-4abc-8ecf-d52e688f2541-networking-console-plugin-cert podName:52346b15-5bc4-4abc-8ecf-d52e688f2541 nodeName:}" failed. No retries permitted until 2026-07-14 19:52:46.562406595 +0000 UTC m=+66.274002118 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/52346b15-5bc4-4abc-8ecf-d52e688f2541-networking-console-plugin-cert") pod "networking-console-plugin-6cf856758c-67qv6" (UID: "52346b15-5bc4-4abc-8ecf-d52e688f2541") : secret "networking-console-plugin-cert" not found
Jul 14 19:52:38.562581 ip-10-0-140-201 kubenswrapper[2579]: E0714 19:52:38.562460    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8eec2471-b3c8-4541-b413-c356b5ed9782-registry-tls podName:8eec2471-b3c8-4541-b413-c356b5ed9782 nodeName:}" failed. No retries permitted until 2026-07-14 19:52:46.562444922 +0000 UTC m=+66.274040461 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/8eec2471-b3c8-4541-b413-c356b5ed9782-registry-tls") pod "image-registry-7c8667c5fb-mb2v5" (UID: "8eec2471-b3c8-4541-b413-c356b5ed9782") : secret "image-registry-tls" not found
Jul 14 19:52:38.659699 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:52:38.659669    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-79f68b9f4f-57g5q"]
Jul 14 19:52:38.662394 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:52:38.662366    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9311da0b_0174_4c45_a0a8_4c0574f3446e.slice/crio-248b2ca71fe41af2e1b4688b4cea24ed08f332bb05b5173ef88741e94bf5a3d2 WatchSource:0}: Error finding container 248b2ca71fe41af2e1b4688b4cea24ed08f332bb05b5173ef88741e94bf5a3d2: Status 404 returned error can't find the container with id 248b2ca71fe41af2e1b4688b4cea24ed08f332bb05b5173ef88741e94bf5a3d2
Jul 14 19:52:38.662753 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:52:38.662729    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/eaa66e64-34f1-417d-ad95-884ac468df21-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-wg62n\" (UID: \"eaa66e64-34f1-417d-ad95-884ac468df21\") " pod="openshift-insights/insights-runtime-extractor-wg62n"
Jul 14 19:52:38.662809 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:52:38.662785    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/eaa66e64-34f1-417d-ad95-884ac468df21-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-wg62n\" (UID: \"eaa66e64-34f1-417d-ad95-884ac468df21\") " pod="openshift-insights/insights-runtime-extractor-wg62n"
Jul 14 19:52:38.662849 ip-10-0-140-201 kubenswrapper[2579]: E0714 19:52:38.662830    2579 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 14 19:52:38.662897 ip-10-0-140-201 kubenswrapper[2579]: E0714 19:52:38.662883    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/eaa66e64-34f1-417d-ad95-884ac468df21-kube-rbac-proxy-cm podName:eaa66e64-34f1-417d-ad95-884ac468df21 nodeName:}" failed. No retries permitted until 2026-07-14 19:52:42.662869261 +0000 UTC m=+62.374464782 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/eaa66e64-34f1-417d-ad95-884ac468df21-kube-rbac-proxy-cm") pod "insights-runtime-extractor-wg62n" (UID: "eaa66e64-34f1-417d-ad95-884ac468df21") : configmap "kube-rbac-proxy" not found
Jul 14 19:52:38.662979 ip-10-0-140-201 kubenswrapper[2579]: E0714 19:52:38.662959    2579 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 14 19:52:38.663080 ip-10-0-140-201 kubenswrapper[2579]: E0714 19:52:38.663029    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/eaa66e64-34f1-417d-ad95-884ac468df21-insights-runtime-extractor-tls podName:eaa66e64-34f1-417d-ad95-884ac468df21 nodeName:}" failed. No retries permitted until 2026-07-14 19:52:42.663011481 +0000 UTC m=+62.374607019 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/eaa66e64-34f1-417d-ad95-884ac468df21-insights-runtime-extractor-tls") pod "insights-runtime-extractor-wg62n" (UID: "eaa66e64-34f1-417d-ad95-884ac468df21") : secret "insights-runtime-extractor-tls" not found
Jul 14 19:52:38.810452 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:52:38.810370    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-nrkrb_ab40987e-7e6f-4346-9c28-b565e00402d5/serve-healthcheck-canary/0.log"
Jul 14 19:52:39.104790 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:52:39.104699    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-79f68b9f4f-57g5q" event={"ID":"9311da0b-0174-4c45-a0a8-4c0574f3446e","Type":"ContainerStarted","Data":"248b2ca71fe41af2e1b4688b4cea24ed08f332bb05b5173ef88741e94bf5a3d2"}
Jul 14 19:52:42.695129 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:52:42.695086    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/eaa66e64-34f1-417d-ad95-884ac468df21-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-wg62n\" (UID: \"eaa66e64-34f1-417d-ad95-884ac468df21\") " pod="openshift-insights/insights-runtime-extractor-wg62n"
Jul 14 19:52:42.695561 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:52:42.695148    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/eaa66e64-34f1-417d-ad95-884ac468df21-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-wg62n\" (UID: \"eaa66e64-34f1-417d-ad95-884ac468df21\") " pod="openshift-insights/insights-runtime-extractor-wg62n"
Jul 14 19:52:42.695561 ip-10-0-140-201 kubenswrapper[2579]: E0714 19:52:42.695229    2579 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 14 19:52:42.695561 ip-10-0-140-201 kubenswrapper[2579]: E0714 19:52:42.695291    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/eaa66e64-34f1-417d-ad95-884ac468df21-kube-rbac-proxy-cm podName:eaa66e64-34f1-417d-ad95-884ac468df21 nodeName:}" failed. No retries permitted until 2026-07-14 19:52:50.695275488 +0000 UTC m=+70.406871010 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/eaa66e64-34f1-417d-ad95-884ac468df21-kube-rbac-proxy-cm") pod "insights-runtime-extractor-wg62n" (UID: "eaa66e64-34f1-417d-ad95-884ac468df21") : configmap "kube-rbac-proxy" not found
Jul 14 19:52:42.695561 ip-10-0-140-201 kubenswrapper[2579]: E0714 19:52:42.695328    2579 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 14 19:52:42.695561 ip-10-0-140-201 kubenswrapper[2579]: E0714 19:52:42.695386    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/eaa66e64-34f1-417d-ad95-884ac468df21-insights-runtime-extractor-tls podName:eaa66e64-34f1-417d-ad95-884ac468df21 nodeName:}" failed. No retries permitted until 2026-07-14 19:52:50.695372052 +0000 UTC m=+70.406967595 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/eaa66e64-34f1-417d-ad95-884ac468df21-insights-runtime-extractor-tls") pod "insights-runtime-extractor-wg62n" (UID: "eaa66e64-34f1-417d-ad95-884ac468df21") : secret "insights-runtime-extractor-tls" not found
Jul 14 19:52:43.036469 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:52:43.036436    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-q4xzw"
Jul 14 19:52:44.118989 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:52:44.118926    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-79f68b9f4f-57g5q" event={"ID":"9311da0b-0174-4c45-a0a8-4c0574f3446e","Type":"ContainerStarted","Data":"ba46567f6486899102c4edcdd001929aac0450fedd6cf40a196be8eb37c279b9"}
Jul 14 19:52:44.138075 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:52:44.138018    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-79f68b9f4f-57g5q" podStartSLOduration=1.332378616 podStartE2EDuration="6.137999933s" totalImagesPullingTime="4.805621317s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 19:52:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 19:52:44.136634256 +0000 UTC m=+63.848229800" watchObservedRunningTime="2026-07-14 19:52:44.137999933 +0000 UTC m=+63.849595510"
Jul 14 19:52:46.425919 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:52:46.425881    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/44512305-0548-44ec-a1f5-9ae26bd2cf8d-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-2fgqz\" (UID: \"44512305-0548-44ec-a1f5-9ae26bd2cf8d\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-2fgqz"
Jul 14 19:52:46.426330 ip-10-0-140-201 kubenswrapper[2579]: E0714 19:52:46.426006    2579 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 14 19:52:46.426330 ip-10-0-140-201 kubenswrapper[2579]: E0714 19:52:46.426078    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/44512305-0548-44ec-a1f5-9ae26bd2cf8d-cluster-monitoring-operator-tls podName:44512305-0548-44ec-a1f5-9ae26bd2cf8d nodeName:}" failed. No retries permitted until 2026-07-14 19:53:02.426062559 +0000 UTC m=+82.137658080 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/44512305-0548-44ec-a1f5-9ae26bd2cf8d-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-2fgqz" (UID: "44512305-0548-44ec-a1f5-9ae26bd2cf8d") : secret "cluster-monitoring-operator-tls" not found
Jul 14 19:52:46.526941 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:52:46.526901    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1993baf5-1337-4873-acf4-fd40ade89975-original-pull-secret\") pod \"global-pull-secret-syncer-d8x6z\" (UID: \"1993baf5-1337-4873-acf4-fd40ade89975\") " pod="kube-system/global-pull-secret-syncer-d8x6z"
Jul 14 19:52:46.526941 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:52:46.526948    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vcnzp\" (UniqueName: \"kubernetes.io/projected/48340033-b0f1-4d8d-b7fd-b6bb6ddddd8b-kube-api-access-vcnzp\") pod \"network-check-target-xk8l4\" (UID: \"48340033-b0f1-4d8d-b7fd-b6bb6ddddd8b\") " pod="openshift-network-diagnostics/network-check-target-xk8l4"
Jul 14 19:52:46.531242 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:52:46.531193    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 14 19:52:46.531360 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:52:46.531214    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 14 19:52:46.540258 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:52:46.540229    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1993baf5-1337-4873-acf4-fd40ade89975-original-pull-secret\") pod \"global-pull-secret-syncer-d8x6z\" (UID: \"1993baf5-1337-4873-acf4-fd40ade89975\") " pod="kube-system/global-pull-secret-syncer-d8x6z"
Jul 14 19:52:46.541019 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:52:46.541000    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 14 19:52:46.550775 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:52:46.550745    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vcnzp\" (UniqueName: \"kubernetes.io/projected/48340033-b0f1-4d8d-b7fd-b6bb6ddddd8b-kube-api-access-vcnzp\") pod \"network-check-target-xk8l4\" (UID: \"48340033-b0f1-4d8d-b7fd-b6bb6ddddd8b\") " pod="openshift-network-diagnostics/network-check-target-xk8l4"
Jul 14 19:52:46.557263 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:52:46.557236    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-fkvzh\""
Jul 14 19:52:46.565616 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:52:46.565595    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xk8l4"
Jul 14 19:52:46.628019 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:52:46.627971    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/52346b15-5bc4-4abc-8ecf-d52e688f2541-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-67qv6\" (UID: \"52346b15-5bc4-4abc-8ecf-d52e688f2541\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-67qv6"
Jul 14 19:52:46.628181 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:52:46.628071    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9aa72835-977f-4b04-9858-7d623eda0254-metrics-certs\") pod \"network-metrics-daemon-f52k9\" (UID: \"9aa72835-977f-4b04-9858-7d623eda0254\") " pod="openshift-multus/network-metrics-daemon-f52k9"
Jul 14 19:52:46.628181 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:52:46.628143    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/8eec2471-b3c8-4541-b413-c356b5ed9782-registry-tls\") pod \"image-registry-7c8667c5fb-mb2v5\" (UID: \"8eec2471-b3c8-4541-b413-c356b5ed9782\") " pod="openshift-image-registry/image-registry-7c8667c5fb-mb2v5"
Jul 14 19:52:46.628285 ip-10-0-140-201 kubenswrapper[2579]: E0714 19:52:46.628253    2579 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 14 19:52:46.628285 ip-10-0-140-201 kubenswrapper[2579]: E0714 19:52:46.628271    2579 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 14 19:52:46.628285 ip-10-0-140-201 kubenswrapper[2579]: E0714 19:52:46.628283    2579 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7c8667c5fb-mb2v5: secret "image-registry-tls" not found
Jul 14 19:52:46.628424 ip-10-0-140-201 kubenswrapper[2579]: E0714 19:52:46.628329    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/52346b15-5bc4-4abc-8ecf-d52e688f2541-networking-console-plugin-cert podName:52346b15-5bc4-4abc-8ecf-d52e688f2541 nodeName:}" failed. No retries permitted until 2026-07-14 19:53:02.628309225 +0000 UTC m=+82.339904769 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/52346b15-5bc4-4abc-8ecf-d52e688f2541-networking-console-plugin-cert") pod "networking-console-plugin-6cf856758c-67qv6" (UID: "52346b15-5bc4-4abc-8ecf-d52e688f2541") : secret "networking-console-plugin-cert" not found
Jul 14 19:52:46.628424 ip-10-0-140-201 kubenswrapper[2579]: E0714 19:52:46.628348    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8eec2471-b3c8-4541-b413-c356b5ed9782-registry-tls podName:8eec2471-b3c8-4541-b413-c356b5ed9782 nodeName:}" failed. No retries permitted until 2026-07-14 19:53:02.628338627 +0000 UTC m=+82.339934151 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/8eec2471-b3c8-4541-b413-c356b5ed9782-registry-tls") pod "image-registry-7c8667c5fb-mb2v5" (UID: "8eec2471-b3c8-4541-b413-c356b5ed9782") : secret "image-registry-tls" not found
Jul 14 19:52:46.631196 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:52:46.630956    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 14 19:52:46.639383 ip-10-0-140-201 kubenswrapper[2579]: E0714 19:52:46.639347    2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Jul 14 19:52:46.639507 ip-10-0-140-201 kubenswrapper[2579]: E0714 19:52:46.639429    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9aa72835-977f-4b04-9858-7d623eda0254-metrics-certs podName:9aa72835-977f-4b04-9858-7d623eda0254 nodeName:}" failed. No retries permitted until 2026-07-14 19:53:50.639408993 +0000 UTC m=+130.351004514 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9aa72835-977f-4b04-9858-7d623eda0254-metrics-certs") pod "network-metrics-daemon-f52k9" (UID: "9aa72835-977f-4b04-9858-7d623eda0254") : secret "metrics-daemon-secret" not found
Jul 14 19:52:46.653153 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:52:46.653116    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-d8x6z"
Jul 14 19:52:46.705828 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:52:46.705745    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-xk8l4"]
Jul 14 19:52:46.710255 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:52:46.710206    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod48340033_b0f1_4d8d_b7fd_b6bb6ddddd8b.slice/crio-5d6f515420f66a91a9e12205147b69ba0f1fb7781d2dd52cc8b1bc3e553a2ac4 WatchSource:0}: Error finding container 5d6f515420f66a91a9e12205147b69ba0f1fb7781d2dd52cc8b1bc3e553a2ac4: Status 404 returned error can't find the container with id 5d6f515420f66a91a9e12205147b69ba0f1fb7781d2dd52cc8b1bc3e553a2ac4
Jul 14 19:52:46.800884 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:52:46.800850    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-d8x6z"]
Jul 14 19:52:46.804561 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:52:46.804517    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1993baf5_1337_4873_acf4_fd40ade89975.slice/crio-f0c265ec6ea04adf9c4fd3ecb75654c4f186affa25214e340b04b0605d907171 WatchSource:0}: Error finding container f0c265ec6ea04adf9c4fd3ecb75654c4f186affa25214e340b04b0605d907171: Status 404 returned error can't find the container with id f0c265ec6ea04adf9c4fd3ecb75654c4f186affa25214e340b04b0605d907171
Jul 14 19:52:47.129033 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:52:47.128994    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-xk8l4" event={"ID":"48340033-b0f1-4d8d-b7fd-b6bb6ddddd8b","Type":"ContainerStarted","Data":"5d6f515420f66a91a9e12205147b69ba0f1fb7781d2dd52cc8b1bc3e553a2ac4"}
Jul 14 19:52:47.130231 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:52:47.130201    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-d8x6z" event={"ID":"1993baf5-1337-4873-acf4-fd40ade89975","Type":"ContainerStarted","Data":"f0c265ec6ea04adf9c4fd3ecb75654c4f186affa25214e340b04b0605d907171"}
Jul 14 19:52:48.546152 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:52:48.546114    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/0360d8bf-1d2a-43c4-8638-6766128ff3d4-metrics-tls\") pod \"dns-default-cpzqc\" (UID: \"0360d8bf-1d2a-43c4-8638-6766128ff3d4\") " pod="openshift-dns/dns-default-cpzqc"
Jul 14 19:52:48.549380 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:52:48.549353    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/0360d8bf-1d2a-43c4-8638-6766128ff3d4-metrics-tls\") pod \"dns-default-cpzqc\" (UID: \"0360d8bf-1d2a-43c4-8638-6766128ff3d4\") " pod="openshift-dns/dns-default-cpzqc"
Jul 14 19:52:48.801815 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:52:48.801732    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-wc26t\""
Jul 14 19:52:48.808973 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:52:48.808939    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-cpzqc"
Jul 14 19:52:50.769695 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:52:50.769658    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/eaa66e64-34f1-417d-ad95-884ac468df21-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-wg62n\" (UID: \"eaa66e64-34f1-417d-ad95-884ac468df21\") " pod="openshift-insights/insights-runtime-extractor-wg62n"
Jul 14 19:52:50.769695 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:52:50.769702    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/eaa66e64-34f1-417d-ad95-884ac468df21-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-wg62n\" (UID: \"eaa66e64-34f1-417d-ad95-884ac468df21\") " pod="openshift-insights/insights-runtime-extractor-wg62n"
Jul 14 19:52:50.770348 ip-10-0-140-201 kubenswrapper[2579]: E0714 19:52:50.769818    2579 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 14 19:52:50.770348 ip-10-0-140-201 kubenswrapper[2579]: E0714 19:52:50.769880    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/eaa66e64-34f1-417d-ad95-884ac468df21-insights-runtime-extractor-tls podName:eaa66e64-34f1-417d-ad95-884ac468df21 nodeName:}" failed. No retries permitted until 2026-07-14 19:53:06.769859508 +0000 UTC m=+86.481455030 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/eaa66e64-34f1-417d-ad95-884ac468df21-insights-runtime-extractor-tls") pod "insights-runtime-extractor-wg62n" (UID: "eaa66e64-34f1-417d-ad95-884ac468df21") : secret "insights-runtime-extractor-tls" not found
Jul 14 19:52:50.770348 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:52:50.770323    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/eaa66e64-34f1-417d-ad95-884ac468df21-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-wg62n\" (UID: \"eaa66e64-34f1-417d-ad95-884ac468df21\") " pod="openshift-insights/insights-runtime-extractor-wg62n"
Jul 14 19:52:51.374237 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:52:51.374202    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-cpzqc"]
Jul 14 19:52:51.377172 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:52:51.377139    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0360d8bf_1d2a_43c4_8638_6766128ff3d4.slice/crio-1700d3f448689317092cc8346bac3ef897cc609700352883c5f3d4b0dd66b328 WatchSource:0}: Error finding container 1700d3f448689317092cc8346bac3ef897cc609700352883c5f3d4b0dd66b328: Status 404 returned error can't find the container with id 1700d3f448689317092cc8346bac3ef897cc609700352883c5f3d4b0dd66b328
Jul 14 19:52:52.146824 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:52:52.146784    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-cpzqc" event={"ID":"0360d8bf-1d2a-43c4-8638-6766128ff3d4","Type":"ContainerStarted","Data":"1700d3f448689317092cc8346bac3ef897cc609700352883c5f3d4b0dd66b328"}
Jul 14 19:52:52.148343 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:52:52.148312    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-xk8l4" event={"ID":"48340033-b0f1-4d8d-b7fd-b6bb6ddddd8b","Type":"ContainerStarted","Data":"b991d0608e1567904b81b9ca4cf40230c4cd9961879fd0f0063e66ed45b5b03a"}
Jul 14 19:52:52.148477 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:52:52.148414    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-xk8l4"
Jul 14 19:52:52.149788 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:52:52.149765    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-d8x6z" event={"ID":"1993baf5-1337-4873-acf4-fd40ade89975","Type":"ContainerStarted","Data":"c557ca2fea5c1b7c3dc7a27d4dd7fb8c6cd1cb4a8909a5a2ece01fbb507c1942"}
Jul 14 19:52:52.163658 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:52:52.163607    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-xk8l4" podStartSLOduration=66.632870161 podStartE2EDuration="1m11.163587051s" totalImagesPullingTime="4.53071689s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 19:51:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 19:52:52.163398867 +0000 UTC m=+71.874994410" watchObservedRunningTime="2026-07-14 19:52:52.163587051 +0000 UTC m=+71.875182586"
Jul 14 19:52:52.178638 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:52:52.178583    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-d8x6z" podStartSLOduration=66.737053538 podStartE2EDuration="1m11.17856508s" totalImagesPullingTime="4.441511542s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-14 19:51:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 19:52:52.177862982 +0000 UTC m=+71.889458525" watchObservedRunningTime="2026-07-14 19:52:52.17856508 +0000 UTC m=+71.890160623"
Jul 14 19:52:55.163295 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:52:55.163254    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-cpzqc" event={"ID":"0360d8bf-1d2a-43c4-8638-6766128ff3d4","Type":"ContainerStarted","Data":"1f81bcb7a7f8c7f1e416fa9bd5b616d27e9aea94e330cd710315beb9c1258718"}
Jul 14 19:52:55.163681 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:52:55.163312    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-cpzqc" event={"ID":"0360d8bf-1d2a-43c4-8638-6766128ff3d4","Type":"ContainerStarted","Data":"d3d22a5a689387271cedcfdb2897207b6501f98724adf4ed3ec8660acab16138"}
Jul 14 19:52:55.163681 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:52:55.163344    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-cpzqc"
Jul 14 19:52:55.182741 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:52:55.182691    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-cpzqc" podStartSLOduration=36.323234738 podStartE2EDuration="39.182676343s" totalImagesPullingTime="2.859441605s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 19:52:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 19:52:55.181003517 +0000 UTC m=+74.892599061" watchObservedRunningTime="2026-07-14 19:52:55.182676343 +0000 UTC m=+74.894271886"
Jul 14 19:52:59.278736 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:52:59.278700    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5b8884ff7b-gp4p2"]
Jul 14 19:52:59.281893 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:52:59.281868    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5b8884ff7b-gp4p2"
Jul 14 19:52:59.285502 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:52:59.285464    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
Jul 14 19:52:59.285502 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:52:59.285465    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
Jul 14 19:52:59.285717 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:52:59.285553    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-dnswp\""
Jul 14 19:52:59.285717 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:52:59.285465    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\""
Jul 14 19:52:59.286927 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:52:59.286909    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
Jul 14 19:52:59.295794 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:52:59.295769    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5b8884ff7b-gp4p2"]
Jul 14 19:52:59.338696 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:52:59.338660    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-7c8667c5fb-mb2v5"]
Jul 14 19:52:59.338881 ip-10-0-140-201 kubenswrapper[2579]: E0714 19:52:59.338862    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context canceled" pod="openshift-image-registry/image-registry-7c8667c5fb-mb2v5" podUID="8eec2471-b3c8-4541-b413-c356b5ed9782"
Jul 14 19:52:59.381044 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:52:59.381011    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-d5ff7d578-dfw7q"]
Jul 14 19:52:59.384060 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:52:59.384044    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-d5ff7d578-dfw7q"
Jul 14 19:52:59.407233 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:52:59.407205    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-d5ff7d578-dfw7q"]
Jul 14 19:52:59.445474 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:52:59.445436    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5t6jj\" (UniqueName: \"kubernetes.io/projected/8668a3bd-cdbd-4c93-b0fd-9f03b07ec843-kube-api-access-5t6jj\") pod \"managed-serviceaccount-addon-agent-5b8884ff7b-gp4p2\" (UID: \"8668a3bd-cdbd-4c93-b0fd-9f03b07ec843\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5b8884ff7b-gp4p2"
Jul 14 19:52:59.445658 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:52:59.445509    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/8668a3bd-cdbd-4c93-b0fd-9f03b07ec843-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-5b8884ff7b-gp4p2\" (UID: \"8668a3bd-cdbd-4c93-b0fd-9f03b07ec843\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5b8884ff7b-gp4p2"
Jul 14 19:52:59.546272 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:52:59.546189    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/0e41ffb7-ed18-49ef-8d0d-d31257dbcba7-registry-certificates\") pod \"image-registry-d5ff7d578-dfw7q\" (UID: \"0e41ffb7-ed18-49ef-8d0d-d31257dbcba7\") " pod="openshift-image-registry/image-registry-d5ff7d578-dfw7q"
Jul 14 19:52:59.546272 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:52:59.546227    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/0e41ffb7-ed18-49ef-8d0d-d31257dbcba7-ca-trust-extracted\") pod \"image-registry-d5ff7d578-dfw7q\" (UID: \"0e41ffb7-ed18-49ef-8d0d-d31257dbcba7\") " pod="openshift-image-registry/image-registry-d5ff7d578-dfw7q"
Jul 14 19:52:59.546442 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:52:59.546282    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6dnpc\" (UniqueName: \"kubernetes.io/projected/0e41ffb7-ed18-49ef-8d0d-d31257dbcba7-kube-api-access-6dnpc\") pod \"image-registry-d5ff7d578-dfw7q\" (UID: \"0e41ffb7-ed18-49ef-8d0d-d31257dbcba7\") " pod="openshift-image-registry/image-registry-d5ff7d578-dfw7q"
Jul 14 19:52:59.546442 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:52:59.546301    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/0e41ffb7-ed18-49ef-8d0d-d31257dbcba7-installation-pull-secrets\") pod \"image-registry-d5ff7d578-dfw7q\" (UID: \"0e41ffb7-ed18-49ef-8d0d-d31257dbcba7\") " pod="openshift-image-registry/image-registry-d5ff7d578-dfw7q"
Jul 14 19:52:59.546442 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:52:59.546338    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5t6jj\" (UniqueName: \"kubernetes.io/projected/8668a3bd-cdbd-4c93-b0fd-9f03b07ec843-kube-api-access-5t6jj\") pod \"managed-serviceaccount-addon-agent-5b8884ff7b-gp4p2\" (UID: \"8668a3bd-cdbd-4c93-b0fd-9f03b07ec843\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5b8884ff7b-gp4p2"
Jul 14 19:52:59.546442 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:52:59.546394    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/0e41ffb7-ed18-49ef-8d0d-d31257dbcba7-trusted-ca\") pod \"image-registry-d5ff7d578-dfw7q\" (UID: \"0e41ffb7-ed18-49ef-8d0d-d31257dbcba7\") " pod="openshift-image-registry/image-registry-d5ff7d578-dfw7q"
Jul 14 19:52:59.546442 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:52:59.546423    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/0e41ffb7-ed18-49ef-8d0d-d31257dbcba7-bound-sa-token\") pod \"image-registry-d5ff7d578-dfw7q\" (UID: \"0e41ffb7-ed18-49ef-8d0d-d31257dbcba7\") " pod="openshift-image-registry/image-registry-d5ff7d578-dfw7q"
Jul 14 19:52:59.546642 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:52:59.546475    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/0e41ffb7-ed18-49ef-8d0d-d31257dbcba7-image-registry-private-configuration\") pod \"image-registry-d5ff7d578-dfw7q\" (UID: \"0e41ffb7-ed18-49ef-8d0d-d31257dbcba7\") " pod="openshift-image-registry/image-registry-d5ff7d578-dfw7q"
Jul 14 19:52:59.546642 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:52:59.546502    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/8668a3bd-cdbd-4c93-b0fd-9f03b07ec843-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-5b8884ff7b-gp4p2\" (UID: \"8668a3bd-cdbd-4c93-b0fd-9f03b07ec843\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5b8884ff7b-gp4p2"
Jul 14 19:52:59.546642 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:52:59.546522    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0e41ffb7-ed18-49ef-8d0d-d31257dbcba7-registry-tls\") pod \"image-registry-d5ff7d578-dfw7q\" (UID: \"0e41ffb7-ed18-49ef-8d0d-d31257dbcba7\") " pod="openshift-image-registry/image-registry-d5ff7d578-dfw7q"
Jul 14 19:52:59.548969 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:52:59.548951    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/8668a3bd-cdbd-4c93-b0fd-9f03b07ec843-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-5b8884ff7b-gp4p2\" (UID: \"8668a3bd-cdbd-4c93-b0fd-9f03b07ec843\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5b8884ff7b-gp4p2"
Jul 14 19:52:59.555515 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:52:59.555493    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5t6jj\" (UniqueName: \"kubernetes.io/projected/8668a3bd-cdbd-4c93-b0fd-9f03b07ec843-kube-api-access-5t6jj\") pod \"managed-serviceaccount-addon-agent-5b8884ff7b-gp4p2\" (UID: \"8668a3bd-cdbd-4c93-b0fd-9f03b07ec843\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5b8884ff7b-gp4p2"
Jul 14 19:52:59.602566 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:52:59.602514    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5b8884ff7b-gp4p2"
Jul 14 19:52:59.647863 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:52:59.647820    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6dnpc\" (UniqueName: \"kubernetes.io/projected/0e41ffb7-ed18-49ef-8d0d-d31257dbcba7-kube-api-access-6dnpc\") pod \"image-registry-d5ff7d578-dfw7q\" (UID: \"0e41ffb7-ed18-49ef-8d0d-d31257dbcba7\") " pod="openshift-image-registry/image-registry-d5ff7d578-dfw7q"
Jul 14 19:52:59.647863 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:52:59.647857    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/0e41ffb7-ed18-49ef-8d0d-d31257dbcba7-installation-pull-secrets\") pod \"image-registry-d5ff7d578-dfw7q\" (UID: \"0e41ffb7-ed18-49ef-8d0d-d31257dbcba7\") " pod="openshift-image-registry/image-registry-d5ff7d578-dfw7q"
Jul 14 19:52:59.648102 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:52:59.648040    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/0e41ffb7-ed18-49ef-8d0d-d31257dbcba7-trusted-ca\") pod \"image-registry-d5ff7d578-dfw7q\" (UID: \"0e41ffb7-ed18-49ef-8d0d-d31257dbcba7\") " pod="openshift-image-registry/image-registry-d5ff7d578-dfw7q"
Jul 14 19:52:59.648102 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:52:59.648076    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/0e41ffb7-ed18-49ef-8d0d-d31257dbcba7-bound-sa-token\") pod \"image-registry-d5ff7d578-dfw7q\" (UID: \"0e41ffb7-ed18-49ef-8d0d-d31257dbcba7\") " pod="openshift-image-registry/image-registry-d5ff7d578-dfw7q"
Jul 14 19:52:59.648216 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:52:59.648144    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/0e41ffb7-ed18-49ef-8d0d-d31257dbcba7-image-registry-private-configuration\") pod \"image-registry-d5ff7d578-dfw7q\" (UID: \"0e41ffb7-ed18-49ef-8d0d-d31257dbcba7\") " pod="openshift-image-registry/image-registry-d5ff7d578-dfw7q"
Jul 14 19:52:59.648216 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:52:59.648184    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0e41ffb7-ed18-49ef-8d0d-d31257dbcba7-registry-tls\") pod \"image-registry-d5ff7d578-dfw7q\" (UID: \"0e41ffb7-ed18-49ef-8d0d-d31257dbcba7\") " pod="openshift-image-registry/image-registry-d5ff7d578-dfw7q"
Jul 14 19:52:59.648323 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:52:59.648239    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/0e41ffb7-ed18-49ef-8d0d-d31257dbcba7-registry-certificates\") pod \"image-registry-d5ff7d578-dfw7q\" (UID: \"0e41ffb7-ed18-49ef-8d0d-d31257dbcba7\") " pod="openshift-image-registry/image-registry-d5ff7d578-dfw7q"
Jul 14 19:52:59.648323 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:52:59.648272    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/0e41ffb7-ed18-49ef-8d0d-d31257dbcba7-ca-trust-extracted\") pod \"image-registry-d5ff7d578-dfw7q\" (UID: \"0e41ffb7-ed18-49ef-8d0d-d31257dbcba7\") " pod="openshift-image-registry/image-registry-d5ff7d578-dfw7q"
Jul 14 19:52:59.649590 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:52:59.649560    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/0e41ffb7-ed18-49ef-8d0d-d31257dbcba7-ca-trust-extracted\") pod \"image-registry-d5ff7d578-dfw7q\" (UID: \"0e41ffb7-ed18-49ef-8d0d-d31257dbcba7\") " pod="openshift-image-registry/image-registry-d5ff7d578-dfw7q"
Jul 14 19:52:59.649888 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:52:59.649861    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/0e41ffb7-ed18-49ef-8d0d-d31257dbcba7-registry-certificates\") pod \"image-registry-d5ff7d578-dfw7q\" (UID: \"0e41ffb7-ed18-49ef-8d0d-d31257dbcba7\") " pod="openshift-image-registry/image-registry-d5ff7d578-dfw7q"
Jul 14 19:52:59.650907 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:52:59.650866    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/0e41ffb7-ed18-49ef-8d0d-d31257dbcba7-trusted-ca\") pod \"image-registry-d5ff7d578-dfw7q\" (UID: \"0e41ffb7-ed18-49ef-8d0d-d31257dbcba7\") " pod="openshift-image-registry/image-registry-d5ff7d578-dfw7q"
Jul 14 19:52:59.651250 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:52:59.651226    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/0e41ffb7-ed18-49ef-8d0d-d31257dbcba7-installation-pull-secrets\") pod \"image-registry-d5ff7d578-dfw7q\" (UID: \"0e41ffb7-ed18-49ef-8d0d-d31257dbcba7\") " pod="openshift-image-registry/image-registry-d5ff7d578-dfw7q"
Jul 14 19:52:59.651683 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:52:59.651641    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0e41ffb7-ed18-49ef-8d0d-d31257dbcba7-registry-tls\") pod \"image-registry-d5ff7d578-dfw7q\" (UID: \"0e41ffb7-ed18-49ef-8d0d-d31257dbcba7\") " pod="openshift-image-registry/image-registry-d5ff7d578-dfw7q"
Jul 14 19:52:59.652021 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:52:59.651995    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/0e41ffb7-ed18-49ef-8d0d-d31257dbcba7-image-registry-private-configuration\") pod \"image-registry-d5ff7d578-dfw7q\" (UID: \"0e41ffb7-ed18-49ef-8d0d-d31257dbcba7\") " pod="openshift-image-registry/image-registry-d5ff7d578-dfw7q"
Jul 14 19:52:59.660367 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:52:59.660333    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/0e41ffb7-ed18-49ef-8d0d-d31257dbcba7-bound-sa-token\") pod \"image-registry-d5ff7d578-dfw7q\" (UID: \"0e41ffb7-ed18-49ef-8d0d-d31257dbcba7\") " pod="openshift-image-registry/image-registry-d5ff7d578-dfw7q"
Jul 14 19:52:59.660507 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:52:59.660393    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6dnpc\" (UniqueName: \"kubernetes.io/projected/0e41ffb7-ed18-49ef-8d0d-d31257dbcba7-kube-api-access-6dnpc\") pod \"image-registry-d5ff7d578-dfw7q\" (UID: \"0e41ffb7-ed18-49ef-8d0d-d31257dbcba7\") " pod="openshift-image-registry/image-registry-d5ff7d578-dfw7q"
Jul 14 19:52:59.695235 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:52:59.695200    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-pm29c\""
Jul 14 19:52:59.703649 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:52:59.703617    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-d5ff7d578-dfw7q"
Jul 14 19:52:59.739634 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:52:59.739601    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5b8884ff7b-gp4p2"]
Jul 14 19:52:59.745586 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:52:59.745555    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod8668a3bd_cdbd_4c93_b0fd_9f03b07ec843.slice/crio-a79dd6336c5e7ec92018d6bb8388aeba740d22f458c6f580b52a2171ce602a89 WatchSource:0}: Error finding container a79dd6336c5e7ec92018d6bb8388aeba740d22f458c6f580b52a2171ce602a89: Status 404 returned error can't find the container with id a79dd6336c5e7ec92018d6bb8388aeba740d22f458c6f580b52a2171ce602a89
Jul 14 19:52:59.839484 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:52:59.839401    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-d5ff7d578-dfw7q"]
Jul 14 19:52:59.842032 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:52:59.842003    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0e41ffb7_ed18_49ef_8d0d_d31257dbcba7.slice/crio-e7ed493d1abbe4c9512fdcc87446850acbd68cebf046358a5b09b5b5740c8488 WatchSource:0}: Error finding container e7ed493d1abbe4c9512fdcc87446850acbd68cebf046358a5b09b5b5740c8488: Status 404 returned error can't find the container with id e7ed493d1abbe4c9512fdcc87446850acbd68cebf046358a5b09b5b5740c8488
Jul 14 19:53:00.181016 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:53:00.180922    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-d5ff7d578-dfw7q" event={"ID":"0e41ffb7-ed18-49ef-8d0d-d31257dbcba7","Type":"ContainerStarted","Data":"b135b148afd1bb8e603146f71ba6fb365eff3b89f70381c7cfe43ed5548614e2"}
Jul 14 19:53:00.181016 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:53:00.180984    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-d5ff7d578-dfw7q" event={"ID":"0e41ffb7-ed18-49ef-8d0d-d31257dbcba7","Type":"ContainerStarted","Data":"e7ed493d1abbe4c9512fdcc87446850acbd68cebf046358a5b09b5b5740c8488"}
Jul 14 19:53:00.181237 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:53:00.181045    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-d5ff7d578-dfw7q"
Jul 14 19:53:00.182247 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:53:00.182221    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5b8884ff7b-gp4p2" event={"ID":"8668a3bd-cdbd-4c93-b0fd-9f03b07ec843","Type":"ContainerStarted","Data":"a79dd6336c5e7ec92018d6bb8388aeba740d22f458c6f580b52a2171ce602a89"}
Jul 14 19:53:00.182247 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:53:00.182243    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7c8667c5fb-mb2v5"
Jul 14 19:53:00.189987 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:53:00.189961    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7c8667c5fb-mb2v5"
Jul 14 19:53:00.201852 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:53:00.201804    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-d5ff7d578-dfw7q" podStartSLOduration=1.201789652 podStartE2EDuration="1.201789652s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 19:52:59 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 19:53:00.200633142 +0000 UTC m=+79.912228687" watchObservedRunningTime="2026-07-14 19:53:00.201789652 +0000 UTC m=+79.913385173"
Jul 14 19:53:00.353117 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:53:00.353084    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/8eec2471-b3c8-4541-b413-c356b5ed9782-trusted-ca\") pod \"8eec2471-b3c8-4541-b413-c356b5ed9782\" (UID: \"8eec2471-b3c8-4541-b413-c356b5ed9782\") "
Jul 14 19:53:00.353576 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:53:00.353141    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/8eec2471-b3c8-4541-b413-c356b5ed9782-ca-trust-extracted\") pod \"8eec2471-b3c8-4541-b413-c356b5ed9782\" (UID: \"8eec2471-b3c8-4541-b413-c356b5ed9782\") "
Jul 14 19:53:00.353576 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:53:00.353252    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/8eec2471-b3c8-4541-b413-c356b5ed9782-registry-certificates\") pod \"8eec2471-b3c8-4541-b413-c356b5ed9782\" (UID: \"8eec2471-b3c8-4541-b413-c356b5ed9782\") "
Jul 14 19:53:00.353576 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:53:00.353291    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bvkxt\" (UniqueName: \"kubernetes.io/projected/8eec2471-b3c8-4541-b413-c356b5ed9782-kube-api-access-bvkxt\") pod \"8eec2471-b3c8-4541-b413-c356b5ed9782\" (UID: \"8eec2471-b3c8-4541-b413-c356b5ed9782\") "
Jul 14 19:53:00.353576 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:53:00.353322    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/8eec2471-b3c8-4541-b413-c356b5ed9782-bound-sa-token\") pod \"8eec2471-b3c8-4541-b413-c356b5ed9782\" (UID: \"8eec2471-b3c8-4541-b413-c356b5ed9782\") "
Jul 14 19:53:00.353576 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:53:00.353350    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/8eec2471-b3c8-4541-b413-c356b5ed9782-image-registry-private-configuration\") pod \"8eec2471-b3c8-4541-b413-c356b5ed9782\" (UID: \"8eec2471-b3c8-4541-b413-c356b5ed9782\") "
Jul 14 19:53:00.353576 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:53:00.353381    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/8eec2471-b3c8-4541-b413-c356b5ed9782-installation-pull-secrets\") pod \"8eec2471-b3c8-4541-b413-c356b5ed9782\" (UID: \"8eec2471-b3c8-4541-b413-c356b5ed9782\") "
Jul 14 19:53:00.353576 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:53:00.353419    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8eec2471-b3c8-4541-b413-c356b5ed9782-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "8eec2471-b3c8-4541-b413-c356b5ed9782" (UID: "8eec2471-b3c8-4541-b413-c356b5ed9782"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 19:53:00.353576 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:53:00.353475    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8eec2471-b3c8-4541-b413-c356b5ed9782-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "8eec2471-b3c8-4541-b413-c356b5ed9782" (UID: "8eec2471-b3c8-4541-b413-c356b5ed9782"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 14 19:53:00.353919 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:53:00.353585    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8eec2471-b3c8-4541-b413-c356b5ed9782-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "8eec2471-b3c8-4541-b413-c356b5ed9782" (UID: "8eec2471-b3c8-4541-b413-c356b5ed9782"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 14 19:53:00.353919 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:53:00.353712    2579 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/8eec2471-b3c8-4541-b413-c356b5ed9782-registry-certificates\") on node \"ip-10-0-140-201.ec2.internal\" DevicePath \"\""
Jul 14 19:53:00.353919 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:53:00.353730    2579 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/8eec2471-b3c8-4541-b413-c356b5ed9782-trusted-ca\") on node \"ip-10-0-140-201.ec2.internal\" DevicePath \"\""
Jul 14 19:53:00.353919 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:53:00.353740    2579 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/8eec2471-b3c8-4541-b413-c356b5ed9782-ca-trust-extracted\") on node \"ip-10-0-140-201.ec2.internal\" DevicePath \"\""
Jul 14 19:53:00.355805 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:53:00.355773    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8eec2471-b3c8-4541-b413-c356b5ed9782-kube-api-access-bvkxt" (OuterVolumeSpecName: "kube-api-access-bvkxt") pod "8eec2471-b3c8-4541-b413-c356b5ed9782" (UID: "8eec2471-b3c8-4541-b413-c356b5ed9782"). InnerVolumeSpecName "kube-api-access-bvkxt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 14 19:53:00.355805 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:53:00.355795    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8eec2471-b3c8-4541-b413-c356b5ed9782-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "8eec2471-b3c8-4541-b413-c356b5ed9782" (UID: "8eec2471-b3c8-4541-b413-c356b5ed9782"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 14 19:53:00.355930 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:53:00.355834    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8eec2471-b3c8-4541-b413-c356b5ed9782-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "8eec2471-b3c8-4541-b413-c356b5ed9782" (UID: "8eec2471-b3c8-4541-b413-c356b5ed9782"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 14 19:53:00.355930 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:53:00.355894    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8eec2471-b3c8-4541-b413-c356b5ed9782-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "8eec2471-b3c8-4541-b413-c356b5ed9782" (UID: "8eec2471-b3c8-4541-b413-c356b5ed9782"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 14 19:53:00.454601 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:53:00.454497    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bvkxt\" (UniqueName: \"kubernetes.io/projected/8eec2471-b3c8-4541-b413-c356b5ed9782-kube-api-access-bvkxt\") on node \"ip-10-0-140-201.ec2.internal\" DevicePath \"\""
Jul 14 19:53:00.454601 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:53:00.454566    2579 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/8eec2471-b3c8-4541-b413-c356b5ed9782-bound-sa-token\") on node \"ip-10-0-140-201.ec2.internal\" DevicePath \"\""
Jul 14 19:53:00.454601 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:53:00.454581    2579 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/8eec2471-b3c8-4541-b413-c356b5ed9782-image-registry-private-configuration\") on node \"ip-10-0-140-201.ec2.internal\" DevicePath \"\""
Jul 14 19:53:00.454601 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:53:00.454595    2579 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/8eec2471-b3c8-4541-b413-c356b5ed9782-installation-pull-secrets\") on node \"ip-10-0-140-201.ec2.internal\" DevicePath \"\""
Jul 14 19:53:01.185349 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:53:01.185270    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7c8667c5fb-mb2v5"
Jul 14 19:53:01.227703 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:53:01.227663    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-7c8667c5fb-mb2v5"]
Jul 14 19:53:01.233299 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:53:01.233270    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-7c8667c5fb-mb2v5"]
Jul 14 19:53:01.363737 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:53:01.363699    2579 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/8eec2471-b3c8-4541-b413-c356b5ed9782-registry-tls\") on node \"ip-10-0-140-201.ec2.internal\" DevicePath \"\""
Jul 14 19:53:02.475479 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:53:02.475329    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/44512305-0548-44ec-a1f5-9ae26bd2cf8d-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-2fgqz\" (UID: \"44512305-0548-44ec-a1f5-9ae26bd2cf8d\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-2fgqz"
Jul 14 19:53:02.478311 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:53:02.478280    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/44512305-0548-44ec-a1f5-9ae26bd2cf8d-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-2fgqz\" (UID: \"44512305-0548-44ec-a1f5-9ae26bd2cf8d\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-2fgqz"
Jul 14 19:53:02.677492 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:53:02.677450    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/52346b15-5bc4-4abc-8ecf-d52e688f2541-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-67qv6\" (UID: \"52346b15-5bc4-4abc-8ecf-d52e688f2541\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-67qv6"
Jul 14 19:53:02.680232 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:53:02.680206    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/52346b15-5bc4-4abc-8ecf-d52e688f2541-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-67qv6\" (UID: \"52346b15-5bc4-4abc-8ecf-d52e688f2541\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-67qv6"
Jul 14 19:53:02.719449 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:53:02.719412    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-2c62b\""
Jul 14 19:53:02.727700 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:53:02.727622    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-2fgqz"
Jul 14 19:53:02.845951 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:53:02.845914    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8eec2471-b3c8-4541-b413-c356b5ed9782" path="/var/lib/kubelet/pods/8eec2471-b3c8-4541-b413-c356b5ed9782/volumes"
Jul 14 19:53:02.953714 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:53:02.953687    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-dbvzp\""
Jul 14 19:53:02.961363 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:53:02.961155    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6cf856758c-67qv6"
Jul 14 19:53:03.069470 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:53:03.069447    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-2fgqz"]
Jul 14 19:53:03.074143 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:53:03.074120    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod44512305_0548_44ec_a1f5_9ae26bd2cf8d.slice/crio-cf0877aa2e346d44087db43e49e3ee1a8b04be301382ec49086a61f5785d4a7d WatchSource:0}: Error finding container cf0877aa2e346d44087db43e49e3ee1a8b04be301382ec49086a61f5785d4a7d: Status 404 returned error can't find the container with id cf0877aa2e346d44087db43e49e3ee1a8b04be301382ec49086a61f5785d4a7d
Jul 14 19:53:03.142466 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:53:03.142149    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-6cf856758c-67qv6"]
Jul 14 19:53:03.144713 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:53:03.144669    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod52346b15_5bc4_4abc_8ecf_d52e688f2541.slice/crio-5fa0514d0f4551aec243540d7069bb4adfc67bc021b4a0c4f7d9bb7bf8443973 WatchSource:0}: Error finding container 5fa0514d0f4551aec243540d7069bb4adfc67bc021b4a0c4f7d9bb7bf8443973: Status 404 returned error can't find the container with id 5fa0514d0f4551aec243540d7069bb4adfc67bc021b4a0c4f7d9bb7bf8443973
Jul 14 19:53:03.193124 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:53:03.193083    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-6cf856758c-67qv6" event={"ID":"52346b15-5bc4-4abc-8ecf-d52e688f2541","Type":"ContainerStarted","Data":"5fa0514d0f4551aec243540d7069bb4adfc67bc021b4a0c4f7d9bb7bf8443973"}
Jul 14 19:53:03.194404 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:53:03.194372    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5b8884ff7b-gp4p2" event={"ID":"8668a3bd-cdbd-4c93-b0fd-9f03b07ec843","Type":"ContainerStarted","Data":"7b1976288c31f3dcb57c3b2d8e8086d65398aab4b0c07d5ab9b4c0f315116d5e"}
Jul 14 19:53:03.195521 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:53:03.195499    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-2fgqz" event={"ID":"44512305-0548-44ec-a1f5-9ae26bd2cf8d","Type":"ContainerStarted","Data":"cf0877aa2e346d44087db43e49e3ee1a8b04be301382ec49086a61f5785d4a7d"}
Jul 14 19:53:03.211312 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:53:03.211237    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5b8884ff7b-gp4p2" podStartSLOduration=0.943258881 podStartE2EDuration="4.211218267s" totalImagesPullingTime="3.267959386s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 19:52:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 19:53:03.21071801 +0000 UTC m=+82.922313553" watchObservedRunningTime="2026-07-14 19:53:03.211218267 +0000 UTC m=+82.922813809"
Jul 14 19:53:05.168577 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:53:05.168545    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-cpzqc"
Jul 14 19:53:05.206249 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:53:05.206214    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-2fgqz" event={"ID":"44512305-0548-44ec-a1f5-9ae26bd2cf8d","Type":"ContainerStarted","Data":"2da260f96fa3d43e3d5104de80352d7ae95e11ad7bea777abe5051d48cd5d485"}
Jul 14 19:53:05.208261 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:53:05.208229    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-6cf856758c-67qv6" event={"ID":"52346b15-5bc4-4abc-8ecf-d52e688f2541","Type":"ContainerStarted","Data":"35030ce084585d0100649215a24138ed0dccd662bc2abd91bd4a276195b42802"}
Jul 14 19:53:05.223785 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:53:05.223731    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-2fgqz" podStartSLOduration=33.312698141 podStartE2EDuration="35.223713883s" totalImagesPullingTime="1.911015742s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 19:52:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 19:53:05.222761784 +0000 UTC m=+84.934357350" watchObservedRunningTime="2026-07-14 19:53:05.223713883 +0000 UTC m=+84.935309426"
Jul 14 19:53:05.243034 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:53:05.242920    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-6cf856758c-67qv6" podStartSLOduration=34.023775278 podStartE2EDuration="35.242896977s" totalImagesPullingTime="1.219121699s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 19:52:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 19:53:05.242266227 +0000 UTC m=+84.953861769" watchObservedRunningTime="2026-07-14 19:53:05.242896977 +0000 UTC m=+84.954492519"
Jul 14 19:53:05.496557 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:53:05.496454    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-v22lt"]
Jul 14 19:53:05.500286 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:53:05.500267    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-v22lt"
Jul 14 19:53:05.502821 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:53:05.502796    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\""
Jul 14 19:53:05.502954 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:53:05.502887    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-lrxhr\""
Jul 14 19:53:05.507798 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:53:05.507507    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-v22lt"]
Jul 14 19:53:05.604128 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:53:05.604089    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/c43d150d-fac8-470e-9fe8-7727cf74bbef-tls-certificates\") pod \"prometheus-operator-admission-webhook-77d98bc786-v22lt\" (UID: \"c43d150d-fac8-470e-9fe8-7727cf74bbef\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-v22lt"
Jul 14 19:53:05.704884 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:53:05.704841    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/c43d150d-fac8-470e-9fe8-7727cf74bbef-tls-certificates\") pod \"prometheus-operator-admission-webhook-77d98bc786-v22lt\" (UID: \"c43d150d-fac8-470e-9fe8-7727cf74bbef\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-v22lt"
Jul 14 19:53:05.707425 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:53:05.707395    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/c43d150d-fac8-470e-9fe8-7727cf74bbef-tls-certificates\") pod \"prometheus-operator-admission-webhook-77d98bc786-v22lt\" (UID: \"c43d150d-fac8-470e-9fe8-7727cf74bbef\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-v22lt"
Jul 14 19:53:05.811098 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:53:05.810991    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-v22lt"
Jul 14 19:53:05.940771 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:53:05.940736    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-v22lt"]
Jul 14 19:53:05.943613 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:53:05.943583    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc43d150d_fac8_470e_9fe8_7727cf74bbef.slice/crio-8e33c0261aeb4c3e3cd59a6d3660d89f334e3d00c0d4e547f6f5f6019df51154 WatchSource:0}: Error finding container 8e33c0261aeb4c3e3cd59a6d3660d89f334e3d00c0d4e547f6f5f6019df51154: Status 404 returned error can't find the container with id 8e33c0261aeb4c3e3cd59a6d3660d89f334e3d00c0d4e547f6f5f6019df51154
Jul 14 19:53:06.212564 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:53:06.212517    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-v22lt" event={"ID":"c43d150d-fac8-470e-9fe8-7727cf74bbef","Type":"ContainerStarted","Data":"8e33c0261aeb4c3e3cd59a6d3660d89f334e3d00c0d4e547f6f5f6019df51154"}
Jul 14 19:53:06.814015 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:53:06.813961    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/eaa66e64-34f1-417d-ad95-884ac468df21-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-wg62n\" (UID: \"eaa66e64-34f1-417d-ad95-884ac468df21\") " pod="openshift-insights/insights-runtime-extractor-wg62n"
Jul 14 19:53:06.816815 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:53:06.816786    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/eaa66e64-34f1-417d-ad95-884ac468df21-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-wg62n\" (UID: \"eaa66e64-34f1-417d-ad95-884ac468df21\") " pod="openshift-insights/insights-runtime-extractor-wg62n"
Jul 14 19:53:06.834692 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:53:06.834665    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-mlhmv\""
Jul 14 19:53:06.841956 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:53:06.841920    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-wg62n"
Jul 14 19:53:07.217967 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:53:07.217925    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-v22lt" event={"ID":"c43d150d-fac8-470e-9fe8-7727cf74bbef","Type":"ContainerStarted","Data":"e8e444e437acd93e9d07c6017da08575ea7ff239d6c94601e7699669c296f39b"}
Jul 14 19:53:07.218428 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:53:07.218069    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-v22lt"
Jul 14 19:53:07.219523 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:53:07.219494    2579 patch_prober.go:28] interesting pod/prometheus-operator-admission-webhook-77d98bc786-v22lt container/prometheus-operator-admission-webhook namespace/openshift-monitoring: Readiness probe status=failure output="Get \"https://10.133.0.17:8443/healthz\": dial tcp 10.133.0.17:8443: connect: connection refused" start-of-body=
Jul 14 19:53:07.219684 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:53:07.219566    2579 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-v22lt" podUID="c43d150d-fac8-470e-9fe8-7727cf74bbef" containerName="prometheus-operator-admission-webhook" probeResult="failure" output="Get \"https://10.133.0.17:8443/healthz\": dial tcp 10.133.0.17:8443: connect: connection refused"
Jul 14 19:53:07.225070 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:53:07.224905    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-wg62n"]
Jul 14 19:53:07.227809 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:53:07.227784    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeaa66e64_34f1_417d_ad95_884ac468df21.slice/crio-c70bdd7016d1fd246f7e58c590e2b0de601e2375c783c5ead490528b24fa28b8 WatchSource:0}: Error finding container c70bdd7016d1fd246f7e58c590e2b0de601e2375c783c5ead490528b24fa28b8: Status 404 returned error can't find the container with id c70bdd7016d1fd246f7e58c590e2b0de601e2375c783c5ead490528b24fa28b8
Jul 14 19:53:07.236649 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:53:07.236599    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-v22lt" podStartSLOduration=1.045240969 podStartE2EDuration="2.236581302s" totalImagesPullingTime="1.191340333s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 19:53:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 19:53:07.235884617 +0000 UTC m=+86.947480161" watchObservedRunningTime="2026-07-14 19:53:07.236581302 +0000 UTC m=+86.948176845"
Jul 14 19:53:08.223415 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:53:08.223374    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-wg62n" event={"ID":"eaa66e64-34f1-417d-ad95-884ac468df21","Type":"ContainerStarted","Data":"c70bdd7016d1fd246f7e58c590e2b0de601e2375c783c5ead490528b24fa28b8"}
Jul 14 19:53:08.227628 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:53:08.227596    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-v22lt"
Jul 14 19:53:08.580062 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:53:08.579977    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-64785b6675-crkt9"]
Jul 14 19:53:08.583360 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:53:08.583334    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-64785b6675-crkt9"
Jul 14 19:53:08.586880 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:53:08.586719    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\""
Jul 14 19:53:08.586880 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:53:08.586747    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-hpd5n\""
Jul 14 19:53:08.587081 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:53:08.586884    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 14 19:53:08.587288 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:53:08.587266    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\""
Jul 14 19:53:08.593943 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:53:08.593905    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-64785b6675-crkt9"]
Jul 14 19:53:08.735367 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:53:08.735329    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1d6cb096-03e9-4a1d-93a7-013081f3344a-metrics-client-ca\") pod \"prometheus-operator-64785b6675-crkt9\" (UID: \"1d6cb096-03e9-4a1d-93a7-013081f3344a\") " pod="openshift-monitoring/prometheus-operator-64785b6675-crkt9"
Jul 14 19:53:08.735553 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:53:08.735388    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/1d6cb096-03e9-4a1d-93a7-013081f3344a-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-64785b6675-crkt9\" (UID: \"1d6cb096-03e9-4a1d-93a7-013081f3344a\") " pod="openshift-monitoring/prometheus-operator-64785b6675-crkt9"
Jul 14 19:53:08.735553 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:53:08.735455    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/1d6cb096-03e9-4a1d-93a7-013081f3344a-prometheus-operator-tls\") pod \"prometheus-operator-64785b6675-crkt9\" (UID: \"1d6cb096-03e9-4a1d-93a7-013081f3344a\") " pod="openshift-monitoring/prometheus-operator-64785b6675-crkt9"
Jul 14 19:53:08.735553 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:53:08.735486    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tc2mj\" (UniqueName: \"kubernetes.io/projected/1d6cb096-03e9-4a1d-93a7-013081f3344a-kube-api-access-tc2mj\") pod \"prometheus-operator-64785b6675-crkt9\" (UID: \"1d6cb096-03e9-4a1d-93a7-013081f3344a\") " pod="openshift-monitoring/prometheus-operator-64785b6675-crkt9"
Jul 14 19:53:08.836869 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:53:08.836770    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/1d6cb096-03e9-4a1d-93a7-013081f3344a-prometheus-operator-tls\") pod \"prometheus-operator-64785b6675-crkt9\" (UID: \"1d6cb096-03e9-4a1d-93a7-013081f3344a\") " pod="openshift-monitoring/prometheus-operator-64785b6675-crkt9"
Jul 14 19:53:08.836869 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:53:08.836815    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tc2mj\" (UniqueName: \"kubernetes.io/projected/1d6cb096-03e9-4a1d-93a7-013081f3344a-kube-api-access-tc2mj\") pod \"prometheus-operator-64785b6675-crkt9\" (UID: \"1d6cb096-03e9-4a1d-93a7-013081f3344a\") " pod="openshift-monitoring/prometheus-operator-64785b6675-crkt9"
Jul 14 19:53:08.837093 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:53:08.836873    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1d6cb096-03e9-4a1d-93a7-013081f3344a-metrics-client-ca\") pod \"prometheus-operator-64785b6675-crkt9\" (UID: \"1d6cb096-03e9-4a1d-93a7-013081f3344a\") " pod="openshift-monitoring/prometheus-operator-64785b6675-crkt9"
Jul 14 19:53:08.837093 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:53:08.837039    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/1d6cb096-03e9-4a1d-93a7-013081f3344a-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-64785b6675-crkt9\" (UID: \"1d6cb096-03e9-4a1d-93a7-013081f3344a\") " pod="openshift-monitoring/prometheus-operator-64785b6675-crkt9"
Jul 14 19:53:08.837730 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:53:08.837705    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1d6cb096-03e9-4a1d-93a7-013081f3344a-metrics-client-ca\") pod \"prometheus-operator-64785b6675-crkt9\" (UID: \"1d6cb096-03e9-4a1d-93a7-013081f3344a\") " pod="openshift-monitoring/prometheus-operator-64785b6675-crkt9"
Jul 14 19:53:08.839628 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:53:08.839590    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/1d6cb096-03e9-4a1d-93a7-013081f3344a-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-64785b6675-crkt9\" (UID: \"1d6cb096-03e9-4a1d-93a7-013081f3344a\") " pod="openshift-monitoring/prometheus-operator-64785b6675-crkt9"
Jul 14 19:53:08.839628 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:53:08.839618    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/1d6cb096-03e9-4a1d-93a7-013081f3344a-prometheus-operator-tls\") pod \"prometheus-operator-64785b6675-crkt9\" (UID: \"1d6cb096-03e9-4a1d-93a7-013081f3344a\") " pod="openshift-monitoring/prometheus-operator-64785b6675-crkt9"
Jul 14 19:53:08.846428 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:53:08.846407    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tc2mj\" (UniqueName: \"kubernetes.io/projected/1d6cb096-03e9-4a1d-93a7-013081f3344a-kube-api-access-tc2mj\") pod \"prometheus-operator-64785b6675-crkt9\" (UID: \"1d6cb096-03e9-4a1d-93a7-013081f3344a\") " pod="openshift-monitoring/prometheus-operator-64785b6675-crkt9"
Jul 14 19:53:08.896294 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:53:08.896253    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-64785b6675-crkt9"
Jul 14 19:53:10.953126 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:53:10.953091    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-64785b6675-crkt9"]
Jul 14 19:53:10.956512 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:53:10.956479    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1d6cb096_03e9_4a1d_93a7_013081f3344a.slice/crio-9ca387d28fc278484acd2f70ff9d05f1658a222483501cccb7f4ba4ea9768197 WatchSource:0}: Error finding container 9ca387d28fc278484acd2f70ff9d05f1658a222483501cccb7f4ba4ea9768197: Status 404 returned error can't find the container with id 9ca387d28fc278484acd2f70ff9d05f1658a222483501cccb7f4ba4ea9768197
Jul 14 19:53:11.235361 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:53:11.235327    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-wg62n" event={"ID":"eaa66e64-34f1-417d-ad95-884ac468df21","Type":"ContainerStarted","Data":"5bab8dc818fa5994b1bf8fba092f8a086692adf8916f958c5b8c4e72c72946ca"}
Jul 14 19:53:11.236472 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:53:11.236449    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-64785b6675-crkt9" event={"ID":"1d6cb096-03e9-4a1d-93a7-013081f3344a","Type":"ContainerStarted","Data":"9ca387d28fc278484acd2f70ff9d05f1658a222483501cccb7f4ba4ea9768197"}
Jul 14 19:53:12.246879 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:53:12.246836    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-wg62n" event={"ID":"eaa66e64-34f1-417d-ad95-884ac468df21","Type":"ContainerStarted","Data":"5ecd0bad4183d47149fc7ab4f0f8b77fc32dc84bd4251c28331be778bae9374b"}
Jul 14 19:53:13.253475 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:53:13.253438    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-64785b6675-crkt9" event={"ID":"1d6cb096-03e9-4a1d-93a7-013081f3344a","Type":"ContainerStarted","Data":"e3fd01e0f35634bf650a09eaf6a8d50b652f3f17d6ac19e21f6126d387caee38"}
Jul 14 19:53:13.253901 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:53:13.253502    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-64785b6675-crkt9" event={"ID":"1d6cb096-03e9-4a1d-93a7-013081f3344a","Type":"ContainerStarted","Data":"bf2b4cfc4c98c73d0137a2f72173a9166ec4807f22d5af6c157a005cd60544eb"}
Jul 14 19:53:15.041852 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:53:15.041786    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-64785b6675-crkt9" podStartSLOduration=5.432071987 podStartE2EDuration="7.041758705s" totalImagesPullingTime="1.609686718s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 19:53:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 19:53:13.271294562 +0000 UTC m=+92.982890106" watchObservedRunningTime="2026-07-14 19:53:15.041758705 +0000 UTC m=+94.753354247"
Jul 14 19:53:15.043408 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:53:15.043377    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-pxxbg"]
Jul 14 19:53:15.046718 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:53:15.046698    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-pxxbg"
Jul 14 19:53:15.050291 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:53:15.050271    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 14 19:53:15.050635 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:53:15.050616    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 14 19:53:15.051247 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:53:15.051229    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 14 19:53:15.052498 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:53:15.052478    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-pq5qb\""
Jul 14 19:53:15.086828 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:53:15.086793    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/a2bc32ea-0717-4ef1-ba8c-5dd724f8c830-node-exporter-tls\") pod \"node-exporter-pxxbg\" (UID: \"a2bc32ea-0717-4ef1-ba8c-5dd724f8c830\") " pod="openshift-monitoring/node-exporter-pxxbg"
Jul 14 19:53:15.087036 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:53:15.086836    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a2bc32ea-0717-4ef1-ba8c-5dd724f8c830-metrics-client-ca\") pod \"node-exporter-pxxbg\" (UID: \"a2bc32ea-0717-4ef1-ba8c-5dd724f8c830\") " pod="openshift-monitoring/node-exporter-pxxbg"
Jul 14 19:53:15.087036 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:53:15.086863    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a2bc32ea-0717-4ef1-ba8c-5dd724f8c830-sys\") pod \"node-exporter-pxxbg\" (UID: \"a2bc32ea-0717-4ef1-ba8c-5dd724f8c830\") " pod="openshift-monitoring/node-exporter-pxxbg"
Jul 14 19:53:15.087036 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:53:15.086919    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2brv4\" (UniqueName: \"kubernetes.io/projected/a2bc32ea-0717-4ef1-ba8c-5dd724f8c830-kube-api-access-2brv4\") pod \"node-exporter-pxxbg\" (UID: \"a2bc32ea-0717-4ef1-ba8c-5dd724f8c830\") " pod="openshift-monitoring/node-exporter-pxxbg"
Jul 14 19:53:15.087036 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:53:15.086972    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a2bc32ea-0717-4ef1-ba8c-5dd724f8c830-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-pxxbg\" (UID: \"a2bc32ea-0717-4ef1-ba8c-5dd724f8c830\") " pod="openshift-monitoring/node-exporter-pxxbg"
Jul 14 19:53:15.087036 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:53:15.086999    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/a2bc32ea-0717-4ef1-ba8c-5dd724f8c830-node-exporter-textfile\") pod \"node-exporter-pxxbg\" (UID: \"a2bc32ea-0717-4ef1-ba8c-5dd724f8c830\") " pod="openshift-monitoring/node-exporter-pxxbg"
Jul 14 19:53:15.087278 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:53:15.087056    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/a2bc32ea-0717-4ef1-ba8c-5dd724f8c830-node-exporter-wtmp\") pod \"node-exporter-pxxbg\" (UID: \"a2bc32ea-0717-4ef1-ba8c-5dd724f8c830\") " pod="openshift-monitoring/node-exporter-pxxbg"
Jul 14 19:53:15.087278 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:53:15.087138    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/a2bc32ea-0717-4ef1-ba8c-5dd724f8c830-node-exporter-accelerators-collector-config\") pod \"node-exporter-pxxbg\" (UID: \"a2bc32ea-0717-4ef1-ba8c-5dd724f8c830\") " pod="openshift-monitoring/node-exporter-pxxbg"
Jul 14 19:53:15.087278 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:53:15.087168    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/a2bc32ea-0717-4ef1-ba8c-5dd724f8c830-root\") pod \"node-exporter-pxxbg\" (UID: \"a2bc32ea-0717-4ef1-ba8c-5dd724f8c830\") " pod="openshift-monitoring/node-exporter-pxxbg"
Jul 14 19:53:15.188491 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:53:15.188450    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a2bc32ea-0717-4ef1-ba8c-5dd724f8c830-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-pxxbg\" (UID: \"a2bc32ea-0717-4ef1-ba8c-5dd724f8c830\") " pod="openshift-monitoring/node-exporter-pxxbg"
Jul 14 19:53:15.188491 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:53:15.188493    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/a2bc32ea-0717-4ef1-ba8c-5dd724f8c830-node-exporter-textfile\") pod \"node-exporter-pxxbg\" (UID: \"a2bc32ea-0717-4ef1-ba8c-5dd724f8c830\") " pod="openshift-monitoring/node-exporter-pxxbg"
Jul 14 19:53:15.188740 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:53:15.188525    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/a2bc32ea-0717-4ef1-ba8c-5dd724f8c830-node-exporter-wtmp\") pod \"node-exporter-pxxbg\" (UID: \"a2bc32ea-0717-4ef1-ba8c-5dd724f8c830\") " pod="openshift-monitoring/node-exporter-pxxbg"
Jul 14 19:53:15.188740 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:53:15.188582    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/a2bc32ea-0717-4ef1-ba8c-5dd724f8c830-node-exporter-accelerators-collector-config\") pod \"node-exporter-pxxbg\" (UID: \"a2bc32ea-0717-4ef1-ba8c-5dd724f8c830\") " pod="openshift-monitoring/node-exporter-pxxbg"
Jul 14 19:53:15.188740 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:53:15.188601    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/a2bc32ea-0717-4ef1-ba8c-5dd724f8c830-root\") pod \"node-exporter-pxxbg\" (UID: \"a2bc32ea-0717-4ef1-ba8c-5dd724f8c830\") " pod="openshift-monitoring/node-exporter-pxxbg"
Jul 14 19:53:15.188740 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:53:15.188627    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/a2bc32ea-0717-4ef1-ba8c-5dd724f8c830-node-exporter-tls\") pod \"node-exporter-pxxbg\" (UID: \"a2bc32ea-0717-4ef1-ba8c-5dd724f8c830\") " pod="openshift-monitoring/node-exporter-pxxbg"
Jul 14 19:53:15.188740 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:53:15.188687    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a2bc32ea-0717-4ef1-ba8c-5dd724f8c830-metrics-client-ca\") pod \"node-exporter-pxxbg\" (UID: \"a2bc32ea-0717-4ef1-ba8c-5dd724f8c830\") " pod="openshift-monitoring/node-exporter-pxxbg"
Jul 14 19:53:15.188740 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:53:15.188704    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/a2bc32ea-0717-4ef1-ba8c-5dd724f8c830-root\") pod \"node-exporter-pxxbg\" (UID: \"a2bc32ea-0717-4ef1-ba8c-5dd724f8c830\") " pod="openshift-monitoring/node-exporter-pxxbg"
Jul 14 19:53:15.188740 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:53:15.188722    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a2bc32ea-0717-4ef1-ba8c-5dd724f8c830-sys\") pod \"node-exporter-pxxbg\" (UID: \"a2bc32ea-0717-4ef1-ba8c-5dd724f8c830\") " pod="openshift-monitoring/node-exporter-pxxbg"
Jul 14 19:53:15.189084 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:53:15.188752    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/a2bc32ea-0717-4ef1-ba8c-5dd724f8c830-node-exporter-wtmp\") pod \"node-exporter-pxxbg\" (UID: \"a2bc32ea-0717-4ef1-ba8c-5dd724f8c830\") " pod="openshift-monitoring/node-exporter-pxxbg"
Jul 14 19:53:15.189084 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:53:15.188768    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a2bc32ea-0717-4ef1-ba8c-5dd724f8c830-sys\") pod \"node-exporter-pxxbg\" (UID: \"a2bc32ea-0717-4ef1-ba8c-5dd724f8c830\") " pod="openshift-monitoring/node-exporter-pxxbg"
Jul 14 19:53:15.189084 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:53:15.188827    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2brv4\" (UniqueName: \"kubernetes.io/projected/a2bc32ea-0717-4ef1-ba8c-5dd724f8c830-kube-api-access-2brv4\") pod \"node-exporter-pxxbg\" (UID: \"a2bc32ea-0717-4ef1-ba8c-5dd724f8c830\") " pod="openshift-monitoring/node-exporter-pxxbg"
Jul 14 19:53:15.189084 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:53:15.188872    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/a2bc32ea-0717-4ef1-ba8c-5dd724f8c830-node-exporter-textfile\") pod \"node-exporter-pxxbg\" (UID: \"a2bc32ea-0717-4ef1-ba8c-5dd724f8c830\") " pod="openshift-monitoring/node-exporter-pxxbg"
Jul 14 19:53:15.189326 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:53:15.189303    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/a2bc32ea-0717-4ef1-ba8c-5dd724f8c830-node-exporter-accelerators-collector-config\") pod \"node-exporter-pxxbg\" (UID: \"a2bc32ea-0717-4ef1-ba8c-5dd724f8c830\") " pod="openshift-monitoring/node-exporter-pxxbg"
Jul 14 19:53:15.189514 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:53:15.189402    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a2bc32ea-0717-4ef1-ba8c-5dd724f8c830-metrics-client-ca\") pod \"node-exporter-pxxbg\" (UID: \"a2bc32ea-0717-4ef1-ba8c-5dd724f8c830\") " pod="openshift-monitoring/node-exporter-pxxbg"
Jul 14 19:53:15.191165 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:53:15.191144    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a2bc32ea-0717-4ef1-ba8c-5dd724f8c830-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-pxxbg\" (UID: \"a2bc32ea-0717-4ef1-ba8c-5dd724f8c830\") " pod="openshift-monitoring/node-exporter-pxxbg"
Jul 14 19:53:15.191289 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:53:15.191273    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/a2bc32ea-0717-4ef1-ba8c-5dd724f8c830-node-exporter-tls\") pod \"node-exporter-pxxbg\" (UID: \"a2bc32ea-0717-4ef1-ba8c-5dd724f8c830\") " pod="openshift-monitoring/node-exporter-pxxbg"
Jul 14 19:53:15.202222 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:53:15.202158    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2brv4\" (UniqueName: \"kubernetes.io/projected/a2bc32ea-0717-4ef1-ba8c-5dd724f8c830-kube-api-access-2brv4\") pod \"node-exporter-pxxbg\" (UID: \"a2bc32ea-0717-4ef1-ba8c-5dd724f8c830\") " pod="openshift-monitoring/node-exporter-pxxbg"
Jul 14 19:53:15.263809 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:53:15.263771    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-wg62n" event={"ID":"eaa66e64-34f1-417d-ad95-884ac468df21","Type":"ContainerStarted","Data":"b9835c00fc602285eecf336748144537510cfb4caadba60ee4adaf3edcc7a812"}
Jul 14 19:53:15.284765 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:53:15.284700    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-wg62n" podStartSLOduration=34.024249634 podStartE2EDuration="41.284680742s" totalImagesPullingTime="7.260431108s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-14 19:52:34 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 19:53:15.284260928 +0000 UTC m=+94.995856474" watchObservedRunningTime="2026-07-14 19:53:15.284680742 +0000 UTC m=+94.996276288"
Jul 14 19:53:15.357043 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:53:15.356947    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-pxxbg"
Jul 14 19:53:15.370623 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:53:15.370583    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda2bc32ea_0717_4ef1_ba8c_5dd724f8c830.slice/crio-9b0e907afb67951dbb2f8b5ed7fe2b20243fd2999525d9414d44cb0bfb94aeae WatchSource:0}: Error finding container 9b0e907afb67951dbb2f8b5ed7fe2b20243fd2999525d9414d44cb0bfb94aeae: Status 404 returned error can't find the container with id 9b0e907afb67951dbb2f8b5ed7fe2b20243fd2999525d9414d44cb0bfb94aeae
Jul 14 19:53:16.089663 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:53:16.089629    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 14 19:53:16.097715 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:53:16.096834    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 14 19:53:16.100630 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:53:16.100588    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
Jul 14 19:53:16.100630 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:53:16.100609    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
Jul 14 19:53:16.100824 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:53:16.100740    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
Jul 14 19:53:16.100824 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:53:16.100783    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
Jul 14 19:53:16.100915 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:53:16.100866    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-qjpc5\""
Jul 14 19:53:16.100915 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:53:16.100897    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
Jul 14 19:53:16.101029 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:53:16.101007    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
Jul 14 19:53:16.101140 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:53:16.101063    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
Jul 14 19:53:16.101140 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:53:16.101124    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
Jul 14 19:53:16.101254 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:53:16.101007    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
Jul 14 19:53:16.114911 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:53:16.114797    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 14 19:53:16.197766 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:53:16.197723    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/cfb08590-fee2-4c07-bbc0-54f3b749e417-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"cfb08590-fee2-4c07-bbc0-54f3b749e417\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 14 19:53:16.197952 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:53:16.197785    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/cfb08590-fee2-4c07-bbc0-54f3b749e417-tls-assets\") pod \"alertmanager-main-0\" (UID: \"cfb08590-fee2-4c07-bbc0-54f3b749e417\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 14 19:53:16.197952 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:53:16.197815    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-788nw\" (UniqueName: \"kubernetes.io/projected/cfb08590-fee2-4c07-bbc0-54f3b749e417-kube-api-access-788nw\") pod \"alertmanager-main-0\" (UID: \"cfb08590-fee2-4c07-bbc0-54f3b749e417\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 14 19:53:16.197952 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:53:16.197852    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/cfb08590-fee2-4c07-bbc0-54f3b749e417-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"cfb08590-fee2-4c07-bbc0-54f3b749e417\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 14 19:53:16.197952 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:53:16.197877    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/cfb08590-fee2-4c07-bbc0-54f3b749e417-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"cfb08590-fee2-4c07-bbc0-54f3b749e417\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 14 19:53:16.197952 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:53:16.197901    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cfb08590-fee2-4c07-bbc0-54f3b749e417-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"cfb08590-fee2-4c07-bbc0-54f3b749e417\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 14 19:53:16.197952 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:53:16.197933    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/cfb08590-fee2-4c07-bbc0-54f3b749e417-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"cfb08590-fee2-4c07-bbc0-54f3b749e417\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 14 19:53:16.198234 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:53:16.197970    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/cfb08590-fee2-4c07-bbc0-54f3b749e417-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"cfb08590-fee2-4c07-bbc0-54f3b749e417\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 14 19:53:16.198234 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:53:16.197995    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/cfb08590-fee2-4c07-bbc0-54f3b749e417-config-volume\") pod \"alertmanager-main-0\" (UID: \"cfb08590-fee2-4c07-bbc0-54f3b749e417\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 14 19:53:16.198234 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:53:16.198022    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/cfb08590-fee2-4c07-bbc0-54f3b749e417-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"cfb08590-fee2-4c07-bbc0-54f3b749e417\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 14 19:53:16.198234 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:53:16.198059    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/cfb08590-fee2-4c07-bbc0-54f3b749e417-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"cfb08590-fee2-4c07-bbc0-54f3b749e417\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 14 19:53:16.198234 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:53:16.198112    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/cfb08590-fee2-4c07-bbc0-54f3b749e417-config-out\") pod \"alertmanager-main-0\" (UID: \"cfb08590-fee2-4c07-bbc0-54f3b749e417\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 14 19:53:16.198234 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:53:16.198147    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/cfb08590-fee2-4c07-bbc0-54f3b749e417-web-config\") pod \"alertmanager-main-0\" (UID: \"cfb08590-fee2-4c07-bbc0-54f3b749e417\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 14 19:53:16.270639 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:53:16.270606    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-pxxbg" event={"ID":"a2bc32ea-0717-4ef1-ba8c-5dd724f8c830","Type":"ContainerStarted","Data":"9b0e907afb67951dbb2f8b5ed7fe2b20243fd2999525d9414d44cb0bfb94aeae"}
Jul 14 19:53:16.298595 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:53:16.298552    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-788nw\" (UniqueName: \"kubernetes.io/projected/cfb08590-fee2-4c07-bbc0-54f3b749e417-kube-api-access-788nw\") pod \"alertmanager-main-0\" (UID: \"cfb08590-fee2-4c07-bbc0-54f3b749e417\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 14 19:53:16.298776 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:53:16.298610    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/cfb08590-fee2-4c07-bbc0-54f3b749e417-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"cfb08590-fee2-4c07-bbc0-54f3b749e417\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 14 19:53:16.298776 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:53:16.298640    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/cfb08590-fee2-4c07-bbc0-54f3b749e417-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"cfb08590-fee2-4c07-bbc0-54f3b749e417\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 14 19:53:16.298776 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:53:16.298664    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cfb08590-fee2-4c07-bbc0-54f3b749e417-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"cfb08590-fee2-4c07-bbc0-54f3b749e417\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 14 19:53:16.298776 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:53:16.298697    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/cfb08590-fee2-4c07-bbc0-54f3b749e417-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"cfb08590-fee2-4c07-bbc0-54f3b749e417\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 14 19:53:16.298776 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:53:16.298732    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/cfb08590-fee2-4c07-bbc0-54f3b749e417-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"cfb08590-fee2-4c07-bbc0-54f3b749e417\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 14 19:53:16.298776 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:53:16.298758    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/cfb08590-fee2-4c07-bbc0-54f3b749e417-config-volume\") pod \"alertmanager-main-0\" (UID: \"cfb08590-fee2-4c07-bbc0-54f3b749e417\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 14 19:53:16.298962 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:53:16.298784    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/cfb08590-fee2-4c07-bbc0-54f3b749e417-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"cfb08590-fee2-4c07-bbc0-54f3b749e417\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 14 19:53:16.298962 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:53:16.298831    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/cfb08590-fee2-4c07-bbc0-54f3b749e417-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"cfb08590-fee2-4c07-bbc0-54f3b749e417\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 14 19:53:16.298962 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:53:16.298903    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/cfb08590-fee2-4c07-bbc0-54f3b749e417-config-out\") pod \"alertmanager-main-0\" (UID: \"cfb08590-fee2-4c07-bbc0-54f3b749e417\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 14 19:53:16.298962 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:53:16.298935    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/cfb08590-fee2-4c07-bbc0-54f3b749e417-web-config\") pod \"alertmanager-main-0\" (UID: \"cfb08590-fee2-4c07-bbc0-54f3b749e417\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 14 19:53:16.299156 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:53:16.298964    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/cfb08590-fee2-4c07-bbc0-54f3b749e417-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"cfb08590-fee2-4c07-bbc0-54f3b749e417\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 14 19:53:16.299156 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:53:16.299007    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/cfb08590-fee2-4c07-bbc0-54f3b749e417-tls-assets\") pod \"alertmanager-main-0\" (UID: \"cfb08590-fee2-4c07-bbc0-54f3b749e417\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 14 19:53:16.299443 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:53:16.299409    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/cfb08590-fee2-4c07-bbc0-54f3b749e417-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"cfb08590-fee2-4c07-bbc0-54f3b749e417\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 14 19:53:16.301179 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:53:16.299729    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/cfb08590-fee2-4c07-bbc0-54f3b749e417-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"cfb08590-fee2-4c07-bbc0-54f3b749e417\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 14 19:53:16.301179 ip-10-0-140-201 kubenswrapper[2579]: E0714 19:53:16.300307    2579 secret.go:189] Couldn't get secret openshift-monitoring/alertmanager-main-tls: secret "alertmanager-main-tls" not found
Jul 14 19:53:16.301179 ip-10-0-140-201 kubenswrapper[2579]: E0714 19:53:16.300367    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cfb08590-fee2-4c07-bbc0-54f3b749e417-secret-alertmanager-main-tls podName:cfb08590-fee2-4c07-bbc0-54f3b749e417 nodeName:}" failed. No retries permitted until 2026-07-14 19:53:16.800348152 +0000 UTC m=+96.511943680 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "secret-alertmanager-main-tls" (UniqueName: "kubernetes.io/secret/cfb08590-fee2-4c07-bbc0-54f3b749e417-secret-alertmanager-main-tls") pod "alertmanager-main-0" (UID: "cfb08590-fee2-4c07-bbc0-54f3b749e417") : secret "alertmanager-main-tls" not found
Jul 14 19:53:16.304295 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:53:16.303769    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/cfb08590-fee2-4c07-bbc0-54f3b749e417-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"cfb08590-fee2-4c07-bbc0-54f3b749e417\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 14 19:53:16.304295 ip-10-0-140-201 kubenswrapper[2579]: E0714 19:53:16.304061    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/cfb08590-fee2-4c07-bbc0-54f3b749e417-alertmanager-trusted-ca-bundle podName:cfb08590-fee2-4c07-bbc0-54f3b749e417 nodeName:}" failed. No retries permitted until 2026-07-14 19:53:16.804037974 +0000 UTC m=+96.515633505 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "alertmanager-trusted-ca-bundle" (UniqueName: "kubernetes.io/configmap/cfb08590-fee2-4c07-bbc0-54f3b749e417-alertmanager-trusted-ca-bundle") pod "alertmanager-main-0" (UID: "cfb08590-fee2-4c07-bbc0-54f3b749e417") : configmap references non-existent config key: ca-bundle.crt
Jul 14 19:53:16.309697 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:53:16.304420    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/cfb08590-fee2-4c07-bbc0-54f3b749e417-tls-assets\") pod \"alertmanager-main-0\" (UID: \"cfb08590-fee2-4c07-bbc0-54f3b749e417\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 14 19:53:16.309697 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:53:16.304964    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/cfb08590-fee2-4c07-bbc0-54f3b749e417-config-volume\") pod \"alertmanager-main-0\" (UID: \"cfb08590-fee2-4c07-bbc0-54f3b749e417\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 14 19:53:16.309697 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:53:16.305406    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/cfb08590-fee2-4c07-bbc0-54f3b749e417-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"cfb08590-fee2-4c07-bbc0-54f3b749e417\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 14 19:53:16.309697 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:53:16.306038    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/cfb08590-fee2-4c07-bbc0-54f3b749e417-config-out\") pod \"alertmanager-main-0\" (UID: \"cfb08590-fee2-4c07-bbc0-54f3b749e417\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 14 19:53:16.309697 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:53:16.306149    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/cfb08590-fee2-4c07-bbc0-54f3b749e417-web-config\") pod \"alertmanager-main-0\" (UID: \"cfb08590-fee2-4c07-bbc0-54f3b749e417\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 14 19:53:16.309697 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:53:16.308838    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/cfb08590-fee2-4c07-bbc0-54f3b749e417-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"cfb08590-fee2-4c07-bbc0-54f3b749e417\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 14 19:53:16.309697 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:53:16.308929    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/cfb08590-fee2-4c07-bbc0-54f3b749e417-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"cfb08590-fee2-4c07-bbc0-54f3b749e417\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 14 19:53:16.309697 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:53:16.309639    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-788nw\" (UniqueName: \"kubernetes.io/projected/cfb08590-fee2-4c07-bbc0-54f3b749e417-kube-api-access-788nw\") pod \"alertmanager-main-0\" (UID: \"cfb08590-fee2-4c07-bbc0-54f3b749e417\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 14 19:53:16.802222 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:53:16.802186    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/cfb08590-fee2-4c07-bbc0-54f3b749e417-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"cfb08590-fee2-4c07-bbc0-54f3b749e417\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 14 19:53:16.804805 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:53:16.804777    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/cfb08590-fee2-4c07-bbc0-54f3b749e417-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"cfb08590-fee2-4c07-bbc0-54f3b749e417\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 14 19:53:16.903177 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:53:16.903093    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cfb08590-fee2-4c07-bbc0-54f3b749e417-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"cfb08590-fee2-4c07-bbc0-54f3b749e417\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 14 19:53:16.904044 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:53:16.904022    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cfb08590-fee2-4c07-bbc0-54f3b749e417-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"cfb08590-fee2-4c07-bbc0-54f3b749e417\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 14 19:53:17.017958 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:53:17.017923    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 14 19:53:17.167354 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:53:17.167323    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 14 19:53:17.169756 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:53:17.169729    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcfb08590_fee2_4c07_bbc0_54f3b749e417.slice/crio-05fd803cafafddac5033b1666c4945fe921d8d9450a482a8e8683176120e54f6 WatchSource:0}: Error finding container 05fd803cafafddac5033b1666c4945fe921d8d9450a482a8e8683176120e54f6: Status 404 returned error can't find the container with id 05fd803cafafddac5033b1666c4945fe921d8d9450a482a8e8683176120e54f6
Jul 14 19:53:17.275900 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:53:17.275860    2579 generic.go:356] "Generic (PLEG): container finished" podID="a2bc32ea-0717-4ef1-ba8c-5dd724f8c830" containerID="b663d0e444993cc2eec75030204dec7185e5c025a66d17352aa7a42e0ccc80eb" exitCode=0
Jul 14 19:53:17.276057 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:53:17.275955    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-pxxbg" event={"ID":"a2bc32ea-0717-4ef1-ba8c-5dd724f8c830","Type":"ContainerDied","Data":"b663d0e444993cc2eec75030204dec7185e5c025a66d17352aa7a42e0ccc80eb"}
Jul 14 19:53:17.277153 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:53:17.277132    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"cfb08590-fee2-4c07-bbc0-54f3b749e417","Type":"ContainerStarted","Data":"05fd803cafafddac5033b1666c4945fe921d8d9450a482a8e8683176120e54f6"}
Jul 14 19:53:18.284907 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:53:18.284852    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-pxxbg" event={"ID":"a2bc32ea-0717-4ef1-ba8c-5dd724f8c830","Type":"ContainerStarted","Data":"83a8025f72f1ac8a72c501e3f624ea90813259691df1f31f84f7a359de4bf8da"}
Jul 14 19:53:18.285376 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:53:18.284921    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-pxxbg" event={"ID":"a2bc32ea-0717-4ef1-ba8c-5dd724f8c830","Type":"ContainerStarted","Data":"b342051a5513601042c18f1fc4ed1ba0b323d58102969d15230ffb21adc6e08c"}
Jul 14 19:53:18.312100 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:53:18.312041    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-pxxbg" podStartSLOduration=2.006839165 podStartE2EDuration="3.312025876s" totalImagesPullingTime="1.229781336s" totalInitContainerRuntime="75.405375ms" isStatefulPod=true podCreationTimestamp="2026-07-14 19:53:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 19:53:18.310473017 +0000 UTC m=+98.022068562" watchObservedRunningTime="2026-07-14 19:53:18.312025876 +0000 UTC m=+98.023621419"
Jul 14 19:53:19.290049 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:53:19.290009    2579 generic.go:356] "Generic (PLEG): container finished" podID="cfb08590-fee2-4c07-bbc0-54f3b749e417" containerID="100cc08c9c754207e8420038f7d2d9e518248a59871ebf270dc9016831ed259a" exitCode=0
Jul 14 19:53:19.290481 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:53:19.290100    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"cfb08590-fee2-4c07-bbc0-54f3b749e417","Type":"ContainerDied","Data":"100cc08c9c754207e8420038f7d2d9e518248a59871ebf270dc9016831ed259a"}
Jul 14 19:53:20.140738 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:53:20.140704    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-5b59fbc5b4-tzkst"]
Jul 14 19:53:20.143932 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:53:20.143900    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5b59fbc5b4-tzkst"
Jul 14 19:53:20.146770 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:53:20.146673    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Jul 14 19:53:20.146770 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:53:20.146714    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-hzzg9\""
Jul 14 19:53:20.146948 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:53:20.146823    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Jul 14 19:53:20.148015 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:53:20.147944    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Jul 14 19:53:20.148015 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:53:20.147954    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Jul 14 19:53:20.148015 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:53:20.148015    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Jul 14 19:53:20.148297 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:53:20.148034    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Jul 14 19:53:20.148297 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:53:20.148231    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Jul 14 19:53:20.154483 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:53:20.153870    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5b59fbc5b4-tzkst"]
Jul 14 19:53:20.154483 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:53:20.153925    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Jul 14 19:53:20.231548 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:53:20.231508    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c7936dc8-1c55-4192-984f-d9af25834b34-console-serving-cert\") pod \"console-5b59fbc5b4-tzkst\" (UID: \"c7936dc8-1c55-4192-984f-d9af25834b34\") " pod="openshift-console/console-5b59fbc5b4-tzkst"
Jul 14 19:53:20.231743 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:53:20.231604    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c7936dc8-1c55-4192-984f-d9af25834b34-console-config\") pod \"console-5b59fbc5b4-tzkst\" (UID: \"c7936dc8-1c55-4192-984f-d9af25834b34\") " pod="openshift-console/console-5b59fbc5b4-tzkst"
Jul 14 19:53:20.231743 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:53:20.231660    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t25ml\" (UniqueName: \"kubernetes.io/projected/c7936dc8-1c55-4192-984f-d9af25834b34-kube-api-access-t25ml\") pod \"console-5b59fbc5b4-tzkst\" (UID: \"c7936dc8-1c55-4192-984f-d9af25834b34\") " pod="openshift-console/console-5b59fbc5b4-tzkst"
Jul 14 19:53:20.231743 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:53:20.231685    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c7936dc8-1c55-4192-984f-d9af25834b34-service-ca\") pod \"console-5b59fbc5b4-tzkst\" (UID: \"c7936dc8-1c55-4192-984f-d9af25834b34\") " pod="openshift-console/console-5b59fbc5b4-tzkst"
Jul 14 19:53:20.231743 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:53:20.231708    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c7936dc8-1c55-4192-984f-d9af25834b34-trusted-ca-bundle\") pod \"console-5b59fbc5b4-tzkst\" (UID: \"c7936dc8-1c55-4192-984f-d9af25834b34\") " pod="openshift-console/console-5b59fbc5b4-tzkst"
Jul 14 19:53:20.231907 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:53:20.231748    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c7936dc8-1c55-4192-984f-d9af25834b34-console-oauth-config\") pod \"console-5b59fbc5b4-tzkst\" (UID: \"c7936dc8-1c55-4192-984f-d9af25834b34\") " pod="openshift-console/console-5b59fbc5b4-tzkst"
Jul 14 19:53:20.231907 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:53:20.231781    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c7936dc8-1c55-4192-984f-d9af25834b34-oauth-serving-cert\") pod \"console-5b59fbc5b4-tzkst\" (UID: \"c7936dc8-1c55-4192-984f-d9af25834b34\") " pod="openshift-console/console-5b59fbc5b4-tzkst"
Jul 14 19:53:20.333328 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:53:20.333285    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c7936dc8-1c55-4192-984f-d9af25834b34-console-config\") pod \"console-5b59fbc5b4-tzkst\" (UID: \"c7936dc8-1c55-4192-984f-d9af25834b34\") " pod="openshift-console/console-5b59fbc5b4-tzkst"
Jul 14 19:53:20.333860 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:53:20.333352    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t25ml\" (UniqueName: \"kubernetes.io/projected/c7936dc8-1c55-4192-984f-d9af25834b34-kube-api-access-t25ml\") pod \"console-5b59fbc5b4-tzkst\" (UID: \"c7936dc8-1c55-4192-984f-d9af25834b34\") " pod="openshift-console/console-5b59fbc5b4-tzkst"
Jul 14 19:53:20.333860 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:53:20.333377    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c7936dc8-1c55-4192-984f-d9af25834b34-service-ca\") pod \"console-5b59fbc5b4-tzkst\" (UID: \"c7936dc8-1c55-4192-984f-d9af25834b34\") " pod="openshift-console/console-5b59fbc5b4-tzkst"
Jul 14 19:53:20.333860 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:53:20.333409    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c7936dc8-1c55-4192-984f-d9af25834b34-trusted-ca-bundle\") pod \"console-5b59fbc5b4-tzkst\" (UID: \"c7936dc8-1c55-4192-984f-d9af25834b34\") " pod="openshift-console/console-5b59fbc5b4-tzkst"
Jul 14 19:53:20.333860 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:53:20.333446    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c7936dc8-1c55-4192-984f-d9af25834b34-console-oauth-config\") pod \"console-5b59fbc5b4-tzkst\" (UID: \"c7936dc8-1c55-4192-984f-d9af25834b34\") " pod="openshift-console/console-5b59fbc5b4-tzkst"
Jul 14 19:53:20.333860 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:53:20.333474    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c7936dc8-1c55-4192-984f-d9af25834b34-oauth-serving-cert\") pod \"console-5b59fbc5b4-tzkst\" (UID: \"c7936dc8-1c55-4192-984f-d9af25834b34\") " pod="openshift-console/console-5b59fbc5b4-tzkst"
Jul 14 19:53:20.333860 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:53:20.333516    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c7936dc8-1c55-4192-984f-d9af25834b34-console-serving-cert\") pod \"console-5b59fbc5b4-tzkst\" (UID: \"c7936dc8-1c55-4192-984f-d9af25834b34\") " pod="openshift-console/console-5b59fbc5b4-tzkst"
Jul 14 19:53:20.334205 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:53:20.334183    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c7936dc8-1c55-4192-984f-d9af25834b34-console-config\") pod \"console-5b59fbc5b4-tzkst\" (UID: \"c7936dc8-1c55-4192-984f-d9af25834b34\") " pod="openshift-console/console-5b59fbc5b4-tzkst"
Jul 14 19:53:20.334476 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:53:20.334440    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c7936dc8-1c55-4192-984f-d9af25834b34-trusted-ca-bundle\") pod \"console-5b59fbc5b4-tzkst\" (UID: \"c7936dc8-1c55-4192-984f-d9af25834b34\") " pod="openshift-console/console-5b59fbc5b4-tzkst"
Jul 14 19:53:20.334775 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:53:20.334483    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c7936dc8-1c55-4192-984f-d9af25834b34-service-ca\") pod \"console-5b59fbc5b4-tzkst\" (UID: \"c7936dc8-1c55-4192-984f-d9af25834b34\") " pod="openshift-console/console-5b59fbc5b4-tzkst"
Jul 14 19:53:20.334775 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:53:20.334575    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c7936dc8-1c55-4192-984f-d9af25834b34-oauth-serving-cert\") pod \"console-5b59fbc5b4-tzkst\" (UID: \"c7936dc8-1c55-4192-984f-d9af25834b34\") " pod="openshift-console/console-5b59fbc5b4-tzkst"
Jul 14 19:53:20.336487 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:53:20.336465    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c7936dc8-1c55-4192-984f-d9af25834b34-console-serving-cert\") pod \"console-5b59fbc5b4-tzkst\" (UID: \"c7936dc8-1c55-4192-984f-d9af25834b34\") " pod="openshift-console/console-5b59fbc5b4-tzkst"
Jul 14 19:53:20.336622 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:53:20.336601    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c7936dc8-1c55-4192-984f-d9af25834b34-console-oauth-config\") pod \"console-5b59fbc5b4-tzkst\" (UID: \"c7936dc8-1c55-4192-984f-d9af25834b34\") " pod="openshift-console/console-5b59fbc5b4-tzkst"
Jul 14 19:53:20.342458 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:53:20.342429    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t25ml\" (UniqueName: \"kubernetes.io/projected/c7936dc8-1c55-4192-984f-d9af25834b34-kube-api-access-t25ml\") pod \"console-5b59fbc5b4-tzkst\" (UID: \"c7936dc8-1c55-4192-984f-d9af25834b34\") " pod="openshift-console/console-5b59fbc5b4-tzkst"
Jul 14 19:53:20.457287 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:53:20.457196    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5b59fbc5b4-tzkst"
Jul 14 19:53:20.618004 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:53:20.617968    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5b59fbc5b4-tzkst"]
Jul 14 19:53:20.622285 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:53:20.622257    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc7936dc8_1c55_4192_984f_d9af25834b34.slice/crio-dc982ac11cc977da50a5ec52c9a3793e88bc8240276180609de0672cf7d7d716 WatchSource:0}: Error finding container dc982ac11cc977da50a5ec52c9a3793e88bc8240276180609de0672cf7d7d716: Status 404 returned error can't find the container with id dc982ac11cc977da50a5ec52c9a3793e88bc8240276180609de0672cf7d7d716
Jul 14 19:53:21.190451 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:53:21.190375    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-d5ff7d578-dfw7q"
Jul 14 19:53:21.301098 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:53:21.301054    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5b59fbc5b4-tzkst" event={"ID":"c7936dc8-1c55-4192-984f-d9af25834b34","Type":"ContainerStarted","Data":"dc982ac11cc977da50a5ec52c9a3793e88bc8240276180609de0672cf7d7d716"}
Jul 14 19:53:22.308130 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:53:22.308097    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"cfb08590-fee2-4c07-bbc0-54f3b749e417","Type":"ContainerStarted","Data":"97557c764a72637b8771495222ec39669815004b2d84e1e35e9c80e6c497d977"}
Jul 14 19:53:22.308508 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:53:22.308165    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"cfb08590-fee2-4c07-bbc0-54f3b749e417","Type":"ContainerStarted","Data":"4258a9b62926b20308ff04faae1993fe3d1a8c4ce3d2acf53c868b8f65ab72ca"}
Jul 14 19:53:22.308508 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:53:22.308192    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"cfb08590-fee2-4c07-bbc0-54f3b749e417","Type":"ContainerStarted","Data":"68d3f9f6570dd36349282f93598412df72797e303690c6e71f56283f11e28aaa"}
Jul 14 19:53:22.308508 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:53:22.308217    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"cfb08590-fee2-4c07-bbc0-54f3b749e417","Type":"ContainerStarted","Data":"67f0a22293cde04300c4f0be85c09689a586e74426be9c11e89e25baf2b2d223"}
Jul 14 19:53:22.308508 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:53:22.308241    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"cfb08590-fee2-4c07-bbc0-54f3b749e417","Type":"ContainerStarted","Data":"a2d752c8504d8cbd9c5d1b702c2d89b08cf03187557c3a6292457a3c00699419"}
Jul 14 19:53:23.158983 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:53:23.158948    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-xk8l4"
Jul 14 19:53:25.323390 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:53:25.323360    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5b59fbc5b4-tzkst" event={"ID":"c7936dc8-1c55-4192-984f-d9af25834b34","Type":"ContainerStarted","Data":"3e37deb210b33a40d0c51e94e7813f73cb4c65f15d2ee6c94f85196d86103be0"}
Jul 14 19:53:25.351028 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:53:25.350443    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-5b59fbc5b4-tzkst" podStartSLOduration=1.430575733 podStartE2EDuration="5.350415618s" totalImagesPullingTime="3.919839885s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 19:53:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 19:53:25.344675324 +0000 UTC m=+105.056270865" watchObservedRunningTime="2026-07-14 19:53:25.350415618 +0000 UTC m=+105.062011163"
Jul 14 19:53:26.330918 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:53:26.330876    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"cfb08590-fee2-4c07-bbc0-54f3b749e417","Type":"ContainerStarted","Data":"ab64df4da93e3fd23315400211264f2ed85cf7187c2fb807f88e8bddcf47dd50"}
Jul 14 19:53:26.369046 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:53:26.368984    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=3.52476983 podStartE2EDuration="10.368964193s" totalImagesPullingTime="6.828302655s" totalInitContainerRuntime="15.891708ms" isStatefulPod=false podCreationTimestamp="2026-07-14 19:53:16 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 19:53:26.36698776 +0000 UTC m=+106.078583303" watchObservedRunningTime="2026-07-14 19:53:26.368964193 +0000 UTC m=+106.080559737"
Jul 14 19:53:30.457568 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:53:30.457489    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-5b59fbc5b4-tzkst"
Jul 14 19:53:30.458057 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:53:30.457599    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-5b59fbc5b4-tzkst"
Jul 14 19:53:30.462447 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:53:30.462424    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-5b59fbc5b4-tzkst"
Jul 14 19:53:31.356158 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:53:31.356129    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-5b59fbc5b4-tzkst"
Jul 14 19:53:50.517763 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:53:50.517730    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-nrkrb_ab40987e-7e6f-4346-9c28-b565e00402d5/serve-healthcheck-canary/0.log"
Jul 14 19:53:50.711148 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:53:50.711108    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9aa72835-977f-4b04-9858-7d623eda0254-metrics-certs\") pod \"network-metrics-daemon-f52k9\" (UID: \"9aa72835-977f-4b04-9858-7d623eda0254\") " pod="openshift-multus/network-metrics-daemon-f52k9"
Jul 14 19:53:50.713762 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:53:50.713734    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9aa72835-977f-4b04-9858-7d623eda0254-metrics-certs\") pod \"network-metrics-daemon-f52k9\" (UID: \"9aa72835-977f-4b04-9858-7d623eda0254\") " pod="openshift-multus/network-metrics-daemon-f52k9"
Jul 14 19:53:50.761357 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:53:50.761326    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-78ljl\""
Jul 14 19:53:50.769558 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:53:50.769477    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-f52k9"
Jul 14 19:53:50.932334 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:53:50.932305    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-f52k9"]
Jul 14 19:53:50.934981 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:53:50.934951    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9aa72835_977f_4b04_9858_7d623eda0254.slice/crio-41fcb76dc1f609311ef043b6e88448b3a2df7641b9518b30d1736448859e6d7a WatchSource:0}: Error finding container 41fcb76dc1f609311ef043b6e88448b3a2df7641b9518b30d1736448859e6d7a: Status 404 returned error can't find the container with id 41fcb76dc1f609311ef043b6e88448b3a2df7641b9518b30d1736448859e6d7a
Jul 14 19:53:51.424717 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:53:51.424683    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-f52k9" event={"ID":"9aa72835-977f-4b04-9858-7d623eda0254","Type":"ContainerStarted","Data":"41fcb76dc1f609311ef043b6e88448b3a2df7641b9518b30d1736448859e6d7a"}
Jul 14 19:53:52.429732 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:53:52.429690    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-f52k9" event={"ID":"9aa72835-977f-4b04-9858-7d623eda0254","Type":"ContainerStarted","Data":"4f8905fdb96695ce1dc2f430e87cbaa2d6c6efe70c8dd27556b9ff474cb5f01e"}
Jul 14 19:53:52.430199 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:53:52.429747    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-f52k9" event={"ID":"9aa72835-977f-4b04-9858-7d623eda0254","Type":"ContainerStarted","Data":"37e3ff58bb42626bd78101ea66066d3b15c800e3d4b4636c103ae0b620006303"}
Jul 14 19:53:52.450302 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:53:52.450252    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-f52k9" podStartSLOduration=130.448562331 podStartE2EDuration="2m11.450233886s" totalImagesPullingTime="1.001671555s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 19:51:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 19:53:52.449402475 +0000 UTC m=+132.160998019" watchObservedRunningTime="2026-07-14 19:53:52.450233886 +0000 UTC m=+132.161829430"
Jul 14 19:54:00.464023 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:54:00.463987    2579 generic.go:356] "Generic (PLEG): container finished" podID="71c07105-14b6-4c70-967c-22fe858bea59" containerID="e0eb1c40419d8b335b049af9688c8a5b7baec1932c6f562280224099dbb83b1e" exitCode=0
Jul 14 19:54:00.464558 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:54:00.464144    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-gm5zm" event={"ID":"71c07105-14b6-4c70-967c-22fe858bea59","Type":"ContainerDied","Data":"e0eb1c40419d8b335b049af9688c8a5b7baec1932c6f562280224099dbb83b1e"}
Jul 14 19:54:00.464727 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:54:00.464711    2579 scope.go:117] "RemoveContainer" containerID="e0eb1c40419d8b335b049af9688c8a5b7baec1932c6f562280224099dbb83b1e"
Jul 14 19:54:01.470452 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:54:01.470418    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-gm5zm" event={"ID":"71c07105-14b6-4c70-967c-22fe858bea59","Type":"ContainerStarted","Data":"6eb964fdc28f5957772ba1cd5cea58e4c9a7e92dbc826f364a1b74248b6433e2"}
Jul 14 19:54:39.303353 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:54:39.303270    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-6cb54594f6-7jsqp"]
Jul 14 19:54:39.306916 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:54:39.306896    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-6cb54594f6-7jsqp"
Jul 14 19:54:39.309770 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:54:39.309710    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\""
Jul 14 19:54:39.309938 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:54:39.309866    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\""
Jul 14 19:54:39.309938 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:54:39.309843    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\""
Jul 14 19:54:39.312670 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:54:39.312647    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-95pv7\""
Jul 14 19:54:39.312853 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:54:39.312746    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\""
Jul 14 19:54:39.312926 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:54:39.312656    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\""
Jul 14 19:54:39.315176 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:54:39.315152    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\""
Jul 14 19:54:39.323049 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:54:39.323025    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-6cb54594f6-7jsqp"]
Jul 14 19:54:39.426409 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:54:39.426376    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bj75m\" (UniqueName: \"kubernetes.io/projected/e92d9339-2d28-400f-94b0-db49f85ed4c7-kube-api-access-bj75m\") pod \"telemeter-client-6cb54594f6-7jsqp\" (UID: \"e92d9339-2d28-400f-94b0-db49f85ed4c7\") " pod="openshift-monitoring/telemeter-client-6cb54594f6-7jsqp"
Jul 14 19:54:39.426597 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:54:39.426427    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/e92d9339-2d28-400f-94b0-db49f85ed4c7-secret-telemeter-client\") pod \"telemeter-client-6cb54594f6-7jsqp\" (UID: \"e92d9339-2d28-400f-94b0-db49f85ed4c7\") " pod="openshift-monitoring/telemeter-client-6cb54594f6-7jsqp"
Jul 14 19:54:39.426597 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:54:39.426502    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/e92d9339-2d28-400f-94b0-db49f85ed4c7-federate-client-tls\") pod \"telemeter-client-6cb54594f6-7jsqp\" (UID: \"e92d9339-2d28-400f-94b0-db49f85ed4c7\") " pod="openshift-monitoring/telemeter-client-6cb54594f6-7jsqp"
Jul 14 19:54:39.426597 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:54:39.426562    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e92d9339-2d28-400f-94b0-db49f85ed4c7-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-6cb54594f6-7jsqp\" (UID: \"e92d9339-2d28-400f-94b0-db49f85ed4c7\") " pod="openshift-monitoring/telemeter-client-6cb54594f6-7jsqp"
Jul 14 19:54:39.426732 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:54:39.426606    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/e92d9339-2d28-400f-94b0-db49f85ed4c7-telemeter-client-tls\") pod \"telemeter-client-6cb54594f6-7jsqp\" (UID: \"e92d9339-2d28-400f-94b0-db49f85ed4c7\") " pod="openshift-monitoring/telemeter-client-6cb54594f6-7jsqp"
Jul 14 19:54:39.426732 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:54:39.426626    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e92d9339-2d28-400f-94b0-db49f85ed4c7-telemeter-trusted-ca-bundle\") pod \"telemeter-client-6cb54594f6-7jsqp\" (UID: \"e92d9339-2d28-400f-94b0-db49f85ed4c7\") " pod="openshift-monitoring/telemeter-client-6cb54594f6-7jsqp"
Jul 14 19:54:39.426732 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:54:39.426654    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e92d9339-2d28-400f-94b0-db49f85ed4c7-metrics-client-ca\") pod \"telemeter-client-6cb54594f6-7jsqp\" (UID: \"e92d9339-2d28-400f-94b0-db49f85ed4c7\") " pod="openshift-monitoring/telemeter-client-6cb54594f6-7jsqp"
Jul 14 19:54:39.426732 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:54:39.426674    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e92d9339-2d28-400f-94b0-db49f85ed4c7-serving-certs-ca-bundle\") pod \"telemeter-client-6cb54594f6-7jsqp\" (UID: \"e92d9339-2d28-400f-94b0-db49f85ed4c7\") " pod="openshift-monitoring/telemeter-client-6cb54594f6-7jsqp"
Jul 14 19:54:39.527351 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:54:39.527308    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/e92d9339-2d28-400f-94b0-db49f85ed4c7-secret-telemeter-client\") pod \"telemeter-client-6cb54594f6-7jsqp\" (UID: \"e92d9339-2d28-400f-94b0-db49f85ed4c7\") " pod="openshift-monitoring/telemeter-client-6cb54594f6-7jsqp"
Jul 14 19:54:39.527589 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:54:39.527367    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/e92d9339-2d28-400f-94b0-db49f85ed4c7-federate-client-tls\") pod \"telemeter-client-6cb54594f6-7jsqp\" (UID: \"e92d9339-2d28-400f-94b0-db49f85ed4c7\") " pod="openshift-monitoring/telemeter-client-6cb54594f6-7jsqp"
Jul 14 19:54:39.527589 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:54:39.527485    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e92d9339-2d28-400f-94b0-db49f85ed4c7-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-6cb54594f6-7jsqp\" (UID: \"e92d9339-2d28-400f-94b0-db49f85ed4c7\") " pod="openshift-monitoring/telemeter-client-6cb54594f6-7jsqp"
Jul 14 19:54:39.527718 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:54:39.527595    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/e92d9339-2d28-400f-94b0-db49f85ed4c7-telemeter-client-tls\") pod \"telemeter-client-6cb54594f6-7jsqp\" (UID: \"e92d9339-2d28-400f-94b0-db49f85ed4c7\") " pod="openshift-monitoring/telemeter-client-6cb54594f6-7jsqp"
Jul 14 19:54:39.527718 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:54:39.527625    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e92d9339-2d28-400f-94b0-db49f85ed4c7-telemeter-trusted-ca-bundle\") pod \"telemeter-client-6cb54594f6-7jsqp\" (UID: \"e92d9339-2d28-400f-94b0-db49f85ed4c7\") " pod="openshift-monitoring/telemeter-client-6cb54594f6-7jsqp"
Jul 14 19:54:39.527718 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:54:39.527650    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e92d9339-2d28-400f-94b0-db49f85ed4c7-metrics-client-ca\") pod \"telemeter-client-6cb54594f6-7jsqp\" (UID: \"e92d9339-2d28-400f-94b0-db49f85ed4c7\") " pod="openshift-monitoring/telemeter-client-6cb54594f6-7jsqp"
Jul 14 19:54:39.527718 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:54:39.527681    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e92d9339-2d28-400f-94b0-db49f85ed4c7-serving-certs-ca-bundle\") pod \"telemeter-client-6cb54594f6-7jsqp\" (UID: \"e92d9339-2d28-400f-94b0-db49f85ed4c7\") " pod="openshift-monitoring/telemeter-client-6cb54594f6-7jsqp"
Jul 14 19:54:39.527718 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:54:39.527706    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bj75m\" (UniqueName: \"kubernetes.io/projected/e92d9339-2d28-400f-94b0-db49f85ed4c7-kube-api-access-bj75m\") pod \"telemeter-client-6cb54594f6-7jsqp\" (UID: \"e92d9339-2d28-400f-94b0-db49f85ed4c7\") " pod="openshift-monitoring/telemeter-client-6cb54594f6-7jsqp"
Jul 14 19:54:39.528434 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:54:39.528403    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e92d9339-2d28-400f-94b0-db49f85ed4c7-serving-certs-ca-bundle\") pod \"telemeter-client-6cb54594f6-7jsqp\" (UID: \"e92d9339-2d28-400f-94b0-db49f85ed4c7\") " pod="openshift-monitoring/telemeter-client-6cb54594f6-7jsqp"
Jul 14 19:54:39.528627 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:54:39.528569    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e92d9339-2d28-400f-94b0-db49f85ed4c7-telemeter-trusted-ca-bundle\") pod \"telemeter-client-6cb54594f6-7jsqp\" (UID: \"e92d9339-2d28-400f-94b0-db49f85ed4c7\") " pod="openshift-monitoring/telemeter-client-6cb54594f6-7jsqp"
Jul 14 19:54:39.529014 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:54:39.528993    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e92d9339-2d28-400f-94b0-db49f85ed4c7-metrics-client-ca\") pod \"telemeter-client-6cb54594f6-7jsqp\" (UID: \"e92d9339-2d28-400f-94b0-db49f85ed4c7\") " pod="openshift-monitoring/telemeter-client-6cb54594f6-7jsqp"
Jul 14 19:54:39.530230 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:54:39.530200    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/e92d9339-2d28-400f-94b0-db49f85ed4c7-federate-client-tls\") pod \"telemeter-client-6cb54594f6-7jsqp\" (UID: \"e92d9339-2d28-400f-94b0-db49f85ed4c7\") " pod="openshift-monitoring/telemeter-client-6cb54594f6-7jsqp"
Jul 14 19:54:39.530353 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:54:39.530330    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/e92d9339-2d28-400f-94b0-db49f85ed4c7-telemeter-client-tls\") pod \"telemeter-client-6cb54594f6-7jsqp\" (UID: \"e92d9339-2d28-400f-94b0-db49f85ed4c7\") " pod="openshift-monitoring/telemeter-client-6cb54594f6-7jsqp"
Jul 14 19:54:39.530606 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:54:39.530591    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/e92d9339-2d28-400f-94b0-db49f85ed4c7-secret-telemeter-client\") pod \"telemeter-client-6cb54594f6-7jsqp\" (UID: \"e92d9339-2d28-400f-94b0-db49f85ed4c7\") " pod="openshift-monitoring/telemeter-client-6cb54594f6-7jsqp"
Jul 14 19:54:39.530704 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:54:39.530682    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e92d9339-2d28-400f-94b0-db49f85ed4c7-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-6cb54594f6-7jsqp\" (UID: \"e92d9339-2d28-400f-94b0-db49f85ed4c7\") " pod="openshift-monitoring/telemeter-client-6cb54594f6-7jsqp"
Jul 14 19:54:39.537500 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:54:39.537470    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bj75m\" (UniqueName: \"kubernetes.io/projected/e92d9339-2d28-400f-94b0-db49f85ed4c7-kube-api-access-bj75m\") pod \"telemeter-client-6cb54594f6-7jsqp\" (UID: \"e92d9339-2d28-400f-94b0-db49f85ed4c7\") " pod="openshift-monitoring/telemeter-client-6cb54594f6-7jsqp"
Jul 14 19:54:39.620593 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:54:39.620509    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-6cb54594f6-7jsqp"
Jul 14 19:54:39.764136 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:54:39.764103    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-6cb54594f6-7jsqp"]
Jul 14 19:54:39.768642 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:54:39.768616    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode92d9339_2d28_400f_94b0_db49f85ed4c7.slice/crio-a11f91774f4477f5678613990cbe2177b60a405a1cbfaee47f64159d0f0eecbc WatchSource:0}: Error finding container a11f91774f4477f5678613990cbe2177b60a405a1cbfaee47f64159d0f0eecbc: Status 404 returned error can't find the container with id a11f91774f4477f5678613990cbe2177b60a405a1cbfaee47f64159d0f0eecbc
Jul 14 19:54:40.616241 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:54:40.616202    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-6cb54594f6-7jsqp" event={"ID":"e92d9339-2d28-400f-94b0-db49f85ed4c7","Type":"ContainerStarted","Data":"a11f91774f4477f5678613990cbe2177b60a405a1cbfaee47f64159d0f0eecbc"}
Jul 14 19:54:42.626254 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:54:42.626161    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-6cb54594f6-7jsqp" event={"ID":"e92d9339-2d28-400f-94b0-db49f85ed4c7","Type":"ContainerStarted","Data":"09cd4a5e20ca9b2627cd10e5cdfc63e410a56591e03e1cd33372cc0f3d817558"}
Jul 14 19:54:42.626657 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:54:42.626276    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-6cb54594f6-7jsqp" event={"ID":"e92d9339-2d28-400f-94b0-db49f85ed4c7","Type":"ContainerStarted","Data":"da841c3b60612e1ab51ade3f078f421f70c23d5b57de0f1a5260ea42ec8e0340"}
Jul 14 19:54:42.626657 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:54:42.626302    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-6cb54594f6-7jsqp" event={"ID":"e92d9339-2d28-400f-94b0-db49f85ed4c7","Type":"ContainerStarted","Data":"61e36d42c187d7262ca14c911300f6366f18e3bd7bfc969b493283e82ccc0f00"}
Jul 14 19:54:42.648920 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:54:42.648857    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-6cb54594f6-7jsqp" podStartSLOduration=1.092870839 podStartE2EDuration="3.648835994s" totalImagesPullingTime="2.555965155s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 19:54:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 19:54:42.648481705 +0000 UTC m=+182.360077249" watchObservedRunningTime="2026-07-14 19:54:42.648835994 +0000 UTC m=+182.360431538"
Jul 14 19:54:43.381180 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:54:43.381143    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-668bc5b675-4f584"]
Jul 14 19:54:43.384483 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:54:43.384456    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-668bc5b675-4f584"
Jul 14 19:54:43.394843 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:54:43.394810    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-668bc5b675-4f584"]
Jul 14 19:54:43.566683 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:54:43.566637    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/820be733-b20f-4872-b0e7-a0a2bae3181a-service-ca\") pod \"console-668bc5b675-4f584\" (UID: \"820be733-b20f-4872-b0e7-a0a2bae3181a\") " pod="openshift-console/console-668bc5b675-4f584"
Jul 14 19:54:43.566909 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:54:43.566719    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/820be733-b20f-4872-b0e7-a0a2bae3181a-trusted-ca-bundle\") pod \"console-668bc5b675-4f584\" (UID: \"820be733-b20f-4872-b0e7-a0a2bae3181a\") " pod="openshift-console/console-668bc5b675-4f584"
Jul 14 19:54:43.566909 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:54:43.566745    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/820be733-b20f-4872-b0e7-a0a2bae3181a-oauth-serving-cert\") pod \"console-668bc5b675-4f584\" (UID: \"820be733-b20f-4872-b0e7-a0a2bae3181a\") " pod="openshift-console/console-668bc5b675-4f584"
Jul 14 19:54:43.566909 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:54:43.566842    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ldwpn\" (UniqueName: \"kubernetes.io/projected/820be733-b20f-4872-b0e7-a0a2bae3181a-kube-api-access-ldwpn\") pod \"console-668bc5b675-4f584\" (UID: \"820be733-b20f-4872-b0e7-a0a2bae3181a\") " pod="openshift-console/console-668bc5b675-4f584"
Jul 14 19:54:43.567076 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:54:43.566907    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/820be733-b20f-4872-b0e7-a0a2bae3181a-console-serving-cert\") pod \"console-668bc5b675-4f584\" (UID: \"820be733-b20f-4872-b0e7-a0a2bae3181a\") " pod="openshift-console/console-668bc5b675-4f584"
Jul 14 19:54:43.567076 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:54:43.566960    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/820be733-b20f-4872-b0e7-a0a2bae3181a-console-config\") pod \"console-668bc5b675-4f584\" (UID: \"820be733-b20f-4872-b0e7-a0a2bae3181a\") " pod="openshift-console/console-668bc5b675-4f584"
Jul 14 19:54:43.567076 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:54:43.567033    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/820be733-b20f-4872-b0e7-a0a2bae3181a-console-oauth-config\") pod \"console-668bc5b675-4f584\" (UID: \"820be733-b20f-4872-b0e7-a0a2bae3181a\") " pod="openshift-console/console-668bc5b675-4f584"
Jul 14 19:54:43.667757 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:54:43.667662    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/820be733-b20f-4872-b0e7-a0a2bae3181a-service-ca\") pod \"console-668bc5b675-4f584\" (UID: \"820be733-b20f-4872-b0e7-a0a2bae3181a\") " pod="openshift-console/console-668bc5b675-4f584"
Jul 14 19:54:43.667757 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:54:43.667732    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/820be733-b20f-4872-b0e7-a0a2bae3181a-trusted-ca-bundle\") pod \"console-668bc5b675-4f584\" (UID: \"820be733-b20f-4872-b0e7-a0a2bae3181a\") " pod="openshift-console/console-668bc5b675-4f584"
Jul 14 19:54:43.667757 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:54:43.667751    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/820be733-b20f-4872-b0e7-a0a2bae3181a-oauth-serving-cert\") pod \"console-668bc5b675-4f584\" (UID: \"820be733-b20f-4872-b0e7-a0a2bae3181a\") " pod="openshift-console/console-668bc5b675-4f584"
Jul 14 19:54:43.668331 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:54:43.667799    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ldwpn\" (UniqueName: \"kubernetes.io/projected/820be733-b20f-4872-b0e7-a0a2bae3181a-kube-api-access-ldwpn\") pod \"console-668bc5b675-4f584\" (UID: \"820be733-b20f-4872-b0e7-a0a2bae3181a\") " pod="openshift-console/console-668bc5b675-4f584"
Jul 14 19:54:43.668331 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:54:43.667955    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/820be733-b20f-4872-b0e7-a0a2bae3181a-console-serving-cert\") pod \"console-668bc5b675-4f584\" (UID: \"820be733-b20f-4872-b0e7-a0a2bae3181a\") " pod="openshift-console/console-668bc5b675-4f584"
Jul 14 19:54:43.668331 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:54:43.668014    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/820be733-b20f-4872-b0e7-a0a2bae3181a-console-config\") pod \"console-668bc5b675-4f584\" (UID: \"820be733-b20f-4872-b0e7-a0a2bae3181a\") " pod="openshift-console/console-668bc5b675-4f584"
Jul 14 19:54:43.668331 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:54:43.668064    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/820be733-b20f-4872-b0e7-a0a2bae3181a-console-oauth-config\") pod \"console-668bc5b675-4f584\" (UID: \"820be733-b20f-4872-b0e7-a0a2bae3181a\") " pod="openshift-console/console-668bc5b675-4f584"
Jul 14 19:54:43.668578 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:54:43.668525    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/820be733-b20f-4872-b0e7-a0a2bae3181a-service-ca\") pod \"console-668bc5b675-4f584\" (UID: \"820be733-b20f-4872-b0e7-a0a2bae3181a\") " pod="openshift-console/console-668bc5b675-4f584"
Jul 14 19:54:43.668811 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:54:43.668775    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/820be733-b20f-4872-b0e7-a0a2bae3181a-trusted-ca-bundle\") pod \"console-668bc5b675-4f584\" (UID: \"820be733-b20f-4872-b0e7-a0a2bae3181a\") " pod="openshift-console/console-668bc5b675-4f584"
Jul 14 19:54:43.668909 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:54:43.668878    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/820be733-b20f-4872-b0e7-a0a2bae3181a-oauth-serving-cert\") pod \"console-668bc5b675-4f584\" (UID: \"820be733-b20f-4872-b0e7-a0a2bae3181a\") " pod="openshift-console/console-668bc5b675-4f584"
Jul 14 19:54:43.669054 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:54:43.669029    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/820be733-b20f-4872-b0e7-a0a2bae3181a-console-config\") pod \"console-668bc5b675-4f584\" (UID: \"820be733-b20f-4872-b0e7-a0a2bae3181a\") " pod="openshift-console/console-668bc5b675-4f584"
Jul 14 19:54:43.671757 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:54:43.671250    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/820be733-b20f-4872-b0e7-a0a2bae3181a-console-oauth-config\") pod \"console-668bc5b675-4f584\" (UID: \"820be733-b20f-4872-b0e7-a0a2bae3181a\") " pod="openshift-console/console-668bc5b675-4f584"
Jul 14 19:54:43.671757 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:54:43.671255    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/820be733-b20f-4872-b0e7-a0a2bae3181a-console-serving-cert\") pod \"console-668bc5b675-4f584\" (UID: \"820be733-b20f-4872-b0e7-a0a2bae3181a\") " pod="openshift-console/console-668bc5b675-4f584"
Jul 14 19:54:43.677139 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:54:43.677108    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ldwpn\" (UniqueName: \"kubernetes.io/projected/820be733-b20f-4872-b0e7-a0a2bae3181a-kube-api-access-ldwpn\") pod \"console-668bc5b675-4f584\" (UID: \"820be733-b20f-4872-b0e7-a0a2bae3181a\") " pod="openshift-console/console-668bc5b675-4f584"
Jul 14 19:54:43.694905 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:54:43.694856    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-668bc5b675-4f584"
Jul 14 19:54:43.846822 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:54:43.846793    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-668bc5b675-4f584"]
Jul 14 19:54:43.848713 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:54:43.848675    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod820be733_b20f_4872_b0e7_a0a2bae3181a.slice/crio-2dcc83366f86c4216d3cda215ff67dd6e939b9931a39cdf8d5522e77c638eb2b WatchSource:0}: Error finding container 2dcc83366f86c4216d3cda215ff67dd6e939b9931a39cdf8d5522e77c638eb2b: Status 404 returned error can't find the container with id 2dcc83366f86c4216d3cda215ff67dd6e939b9931a39cdf8d5522e77c638eb2b
Jul 14 19:54:44.637524 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:54:44.637484    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-668bc5b675-4f584" event={"ID":"820be733-b20f-4872-b0e7-a0a2bae3181a","Type":"ContainerStarted","Data":"a23431835632f64c151b77402cddcb0a6e52632cec14390b7ef8085bc1bbcd7b"}
Jul 14 19:54:44.637750 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:54:44.637583    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-668bc5b675-4f584" event={"ID":"820be733-b20f-4872-b0e7-a0a2bae3181a","Type":"ContainerStarted","Data":"2dcc83366f86c4216d3cda215ff67dd6e939b9931a39cdf8d5522e77c638eb2b"}
Jul 14 19:54:44.657133 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:54:44.657082    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-668bc5b675-4f584" podStartSLOduration=1.657064014 podStartE2EDuration="1.657064014s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 19:54:43 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 19:54:44.655642736 +0000 UTC m=+184.367238280" watchObservedRunningTime="2026-07-14 19:54:44.657064014 +0000 UTC m=+184.368659615"
Jul 14 19:54:53.695682 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:54:53.695641    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-668bc5b675-4f584"
Jul 14 19:54:53.696183 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:54:53.695716    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-668bc5b675-4f584"
Jul 14 19:54:53.701310 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:54:53.701281    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-668bc5b675-4f584"
Jul 14 19:54:54.683340 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:54:54.683309    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-668bc5b675-4f584"
Jul 14 19:54:54.737775 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:54:54.737743    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5b59fbc5b4-tzkst"]
Jul 14 19:54:54.816989 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:54:54.816943    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-57657645cd-ftk5j"]
Jul 14 19:54:54.821758 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:54:54.821725    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-57657645cd-ftk5j"
Jul 14 19:54:54.832218 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:54:54.832192    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-57657645cd-ftk5j"]
Jul 14 19:54:54.855970 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:54:54.855931    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/16395ab3-5219-4209-9dfb-701ea71c37e0-oauth-serving-cert\") pod \"console-57657645cd-ftk5j\" (UID: \"16395ab3-5219-4209-9dfb-701ea71c37e0\") " pod="openshift-console/console-57657645cd-ftk5j"
Jul 14 19:54:54.856148 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:54:54.855982    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/16395ab3-5219-4209-9dfb-701ea71c37e0-console-config\") pod \"console-57657645cd-ftk5j\" (UID: \"16395ab3-5219-4209-9dfb-701ea71c37e0\") " pod="openshift-console/console-57657645cd-ftk5j"
Jul 14 19:54:54.856148 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:54:54.855999    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/16395ab3-5219-4209-9dfb-701ea71c37e0-trusted-ca-bundle\") pod \"console-57657645cd-ftk5j\" (UID: \"16395ab3-5219-4209-9dfb-701ea71c37e0\") " pod="openshift-console/console-57657645cd-ftk5j"
Jul 14 19:54:54.856148 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:54:54.856056    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/16395ab3-5219-4209-9dfb-701ea71c37e0-service-ca\") pod \"console-57657645cd-ftk5j\" (UID: \"16395ab3-5219-4209-9dfb-701ea71c37e0\") " pod="openshift-console/console-57657645cd-ftk5j"
Jul 14 19:54:54.856148 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:54:54.856073    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/16395ab3-5219-4209-9dfb-701ea71c37e0-console-oauth-config\") pod \"console-57657645cd-ftk5j\" (UID: \"16395ab3-5219-4209-9dfb-701ea71c37e0\") " pod="openshift-console/console-57657645cd-ftk5j"
Jul 14 19:54:54.856148 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:54:54.856095    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-82f6q\" (UniqueName: \"kubernetes.io/projected/16395ab3-5219-4209-9dfb-701ea71c37e0-kube-api-access-82f6q\") pod \"console-57657645cd-ftk5j\" (UID: \"16395ab3-5219-4209-9dfb-701ea71c37e0\") " pod="openshift-console/console-57657645cd-ftk5j"
Jul 14 19:54:54.856148 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:54:54.856117    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/16395ab3-5219-4209-9dfb-701ea71c37e0-console-serving-cert\") pod \"console-57657645cd-ftk5j\" (UID: \"16395ab3-5219-4209-9dfb-701ea71c37e0\") " pod="openshift-console/console-57657645cd-ftk5j"
Jul 14 19:54:54.956948 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:54:54.956846    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/16395ab3-5219-4209-9dfb-701ea71c37e0-service-ca\") pod \"console-57657645cd-ftk5j\" (UID: \"16395ab3-5219-4209-9dfb-701ea71c37e0\") " pod="openshift-console/console-57657645cd-ftk5j"
Jul 14 19:54:54.956948 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:54:54.956900    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/16395ab3-5219-4209-9dfb-701ea71c37e0-console-oauth-config\") pod \"console-57657645cd-ftk5j\" (UID: \"16395ab3-5219-4209-9dfb-701ea71c37e0\") " pod="openshift-console/console-57657645cd-ftk5j"
Jul 14 19:54:54.956948 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:54:54.956933    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-82f6q\" (UniqueName: \"kubernetes.io/projected/16395ab3-5219-4209-9dfb-701ea71c37e0-kube-api-access-82f6q\") pod \"console-57657645cd-ftk5j\" (UID: \"16395ab3-5219-4209-9dfb-701ea71c37e0\") " pod="openshift-console/console-57657645cd-ftk5j"
Jul 14 19:54:54.956948 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:54:54.956957    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/16395ab3-5219-4209-9dfb-701ea71c37e0-console-serving-cert\") pod \"console-57657645cd-ftk5j\" (UID: \"16395ab3-5219-4209-9dfb-701ea71c37e0\") " pod="openshift-console/console-57657645cd-ftk5j"
Jul 14 19:54:54.957207 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:54:54.956997    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/16395ab3-5219-4209-9dfb-701ea71c37e0-oauth-serving-cert\") pod \"console-57657645cd-ftk5j\" (UID: \"16395ab3-5219-4209-9dfb-701ea71c37e0\") " pod="openshift-console/console-57657645cd-ftk5j"
Jul 14 19:54:54.957207 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:54:54.957064    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/16395ab3-5219-4209-9dfb-701ea71c37e0-console-config\") pod \"console-57657645cd-ftk5j\" (UID: \"16395ab3-5219-4209-9dfb-701ea71c37e0\") " pod="openshift-console/console-57657645cd-ftk5j"
Jul 14 19:54:54.957207 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:54:54.957085    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/16395ab3-5219-4209-9dfb-701ea71c37e0-trusted-ca-bundle\") pod \"console-57657645cd-ftk5j\" (UID: \"16395ab3-5219-4209-9dfb-701ea71c37e0\") " pod="openshift-console/console-57657645cd-ftk5j"
Jul 14 19:54:54.957751 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:54:54.957719    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/16395ab3-5219-4209-9dfb-701ea71c37e0-service-ca\") pod \"console-57657645cd-ftk5j\" (UID: \"16395ab3-5219-4209-9dfb-701ea71c37e0\") " pod="openshift-console/console-57657645cd-ftk5j"
Jul 14 19:54:54.958106 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:54:54.957787    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/16395ab3-5219-4209-9dfb-701ea71c37e0-oauth-serving-cert\") pod \"console-57657645cd-ftk5j\" (UID: \"16395ab3-5219-4209-9dfb-701ea71c37e0\") " pod="openshift-console/console-57657645cd-ftk5j"
Jul 14 19:54:54.958106 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:54:54.957832    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/16395ab3-5219-4209-9dfb-701ea71c37e0-console-config\") pod \"console-57657645cd-ftk5j\" (UID: \"16395ab3-5219-4209-9dfb-701ea71c37e0\") " pod="openshift-console/console-57657645cd-ftk5j"
Jul 14 19:54:54.958227 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:54:54.957908    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/16395ab3-5219-4209-9dfb-701ea71c37e0-trusted-ca-bundle\") pod \"console-57657645cd-ftk5j\" (UID: \"16395ab3-5219-4209-9dfb-701ea71c37e0\") " pod="openshift-console/console-57657645cd-ftk5j"
Jul 14 19:54:54.959666 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:54:54.959647    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/16395ab3-5219-4209-9dfb-701ea71c37e0-console-serving-cert\") pod \"console-57657645cd-ftk5j\" (UID: \"16395ab3-5219-4209-9dfb-701ea71c37e0\") " pod="openshift-console/console-57657645cd-ftk5j"
Jul 14 19:54:54.959794 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:54:54.959775    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/16395ab3-5219-4209-9dfb-701ea71c37e0-console-oauth-config\") pod \"console-57657645cd-ftk5j\" (UID: \"16395ab3-5219-4209-9dfb-701ea71c37e0\") " pod="openshift-console/console-57657645cd-ftk5j"
Jul 14 19:54:54.968329 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:54:54.968299    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-82f6q\" (UniqueName: \"kubernetes.io/projected/16395ab3-5219-4209-9dfb-701ea71c37e0-kube-api-access-82f6q\") pod \"console-57657645cd-ftk5j\" (UID: \"16395ab3-5219-4209-9dfb-701ea71c37e0\") " pod="openshift-console/console-57657645cd-ftk5j"
Jul 14 19:54:55.133070 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:54:55.133036    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-57657645cd-ftk5j"
Jul 14 19:54:55.272463 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:54:55.272436    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-57657645cd-ftk5j"]
Jul 14 19:54:55.274098 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:54:55.274062    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod16395ab3_5219_4209_9dfb_701ea71c37e0.slice/crio-819306d97712b4b4b53f564e074fe1bfac74070901c213d88e65b75be2e052e5 WatchSource:0}: Error finding container 819306d97712b4b4b53f564e074fe1bfac74070901c213d88e65b75be2e052e5: Status 404 returned error can't find the container with id 819306d97712b4b4b53f564e074fe1bfac74070901c213d88e65b75be2e052e5
Jul 14 19:54:55.685230 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:54:55.685132    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-57657645cd-ftk5j" event={"ID":"16395ab3-5219-4209-9dfb-701ea71c37e0","Type":"ContainerStarted","Data":"4d9630949f45a61b8ad736c0010d2b99a2362dc14c490d27ae9f3acc19982286"}
Jul 14 19:54:55.685230 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:54:55.685187    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-57657645cd-ftk5j" event={"ID":"16395ab3-5219-4209-9dfb-701ea71c37e0","Type":"ContainerStarted","Data":"819306d97712b4b4b53f564e074fe1bfac74070901c213d88e65b75be2e052e5"}
Jul 14 19:54:55.706123 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:54:55.706043    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-57657645cd-ftk5j" podStartSLOduration=1.706026362 podStartE2EDuration="1.706026362s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 19:54:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 19:54:55.705108469 +0000 UTC m=+195.416704020" watchObservedRunningTime="2026-07-14 19:54:55.706026362 +0000 UTC m=+195.417621906"
Jul 14 19:55:05.133400 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:55:05.133358    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-57657645cd-ftk5j"
Jul 14 19:55:05.133850 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:55:05.133666    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-57657645cd-ftk5j"
Jul 14 19:55:05.138284 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:55:05.138257    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-57657645cd-ftk5j"
Jul 14 19:55:05.729062 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:55:05.729030    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-57657645cd-ftk5j"
Jul 14 19:55:05.782947 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:55:05.782912    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-668bc5b675-4f584"]
Jul 14 19:55:19.763612 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:55:19.763524    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-5b59fbc5b4-tzkst" podUID="c7936dc8-1c55-4192-984f-d9af25834b34" containerName="console" containerID="cri-o://3e37deb210b33a40d0c51e94e7813f73cb4c65f15d2ee6c94f85196d86103be0" gracePeriod=15
Jul 14 19:55:20.014836 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:55:20.014752    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5b59fbc5b4-tzkst"
Jul 14 19:55:20.067509 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:55:20.067474    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c7936dc8-1c55-4192-984f-d9af25834b34-trusted-ca-bundle\") pod \"c7936dc8-1c55-4192-984f-d9af25834b34\" (UID: \"c7936dc8-1c55-4192-984f-d9af25834b34\") "
Jul 14 19:55:20.067704 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:55:20.067553    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c7936dc8-1c55-4192-984f-d9af25834b34-console-serving-cert\") pod \"c7936dc8-1c55-4192-984f-d9af25834b34\" (UID: \"c7936dc8-1c55-4192-984f-d9af25834b34\") "
Jul 14 19:55:20.067704 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:55:20.067580    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c7936dc8-1c55-4192-984f-d9af25834b34-oauth-serving-cert\") pod \"c7936dc8-1c55-4192-984f-d9af25834b34\" (UID: \"c7936dc8-1c55-4192-984f-d9af25834b34\") "
Jul 14 19:55:20.067704 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:55:20.067600    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c7936dc8-1c55-4192-984f-d9af25834b34-service-ca\") pod \"c7936dc8-1c55-4192-984f-d9af25834b34\" (UID: \"c7936dc8-1c55-4192-984f-d9af25834b34\") "
Jul 14 19:55:20.067704 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:55:20.067627    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-t25ml\" (UniqueName: \"kubernetes.io/projected/c7936dc8-1c55-4192-984f-d9af25834b34-kube-api-access-t25ml\") pod \"c7936dc8-1c55-4192-984f-d9af25834b34\" (UID: \"c7936dc8-1c55-4192-984f-d9af25834b34\") "
Jul 14 19:55:20.067704 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:55:20.067689    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c7936dc8-1c55-4192-984f-d9af25834b34-console-config\") pod \"c7936dc8-1c55-4192-984f-d9af25834b34\" (UID: \"c7936dc8-1c55-4192-984f-d9af25834b34\") "
Jul 14 19:55:20.067942 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:55:20.067754    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c7936dc8-1c55-4192-984f-d9af25834b34-console-oauth-config\") pod \"c7936dc8-1c55-4192-984f-d9af25834b34\" (UID: \"c7936dc8-1c55-4192-984f-d9af25834b34\") "
Jul 14 19:55:20.068022 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:55:20.067992    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c7936dc8-1c55-4192-984f-d9af25834b34-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "c7936dc8-1c55-4192-984f-d9af25834b34" (UID: "c7936dc8-1c55-4192-984f-d9af25834b34"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 14 19:55:20.068082 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:55:20.067998    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c7936dc8-1c55-4192-984f-d9af25834b34-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "c7936dc8-1c55-4192-984f-d9af25834b34" (UID: "c7936dc8-1c55-4192-984f-d9af25834b34"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 14 19:55:20.068136 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:55:20.068085    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c7936dc8-1c55-4192-984f-d9af25834b34-service-ca" (OuterVolumeSpecName: "service-ca") pod "c7936dc8-1c55-4192-984f-d9af25834b34" (UID: "c7936dc8-1c55-4192-984f-d9af25834b34"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 14 19:55:20.068346 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:55:20.068320    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c7936dc8-1c55-4192-984f-d9af25834b34-console-config" (OuterVolumeSpecName: "console-config") pod "c7936dc8-1c55-4192-984f-d9af25834b34" (UID: "c7936dc8-1c55-4192-984f-d9af25834b34"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 14 19:55:20.070187 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:55:20.070156    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c7936dc8-1c55-4192-984f-d9af25834b34-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "c7936dc8-1c55-4192-984f-d9af25834b34" (UID: "c7936dc8-1c55-4192-984f-d9af25834b34"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 14 19:55:20.070296 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:55:20.070227    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c7936dc8-1c55-4192-984f-d9af25834b34-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "c7936dc8-1c55-4192-984f-d9af25834b34" (UID: "c7936dc8-1c55-4192-984f-d9af25834b34"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 14 19:55:20.070296 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:55:20.070235    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c7936dc8-1c55-4192-984f-d9af25834b34-kube-api-access-t25ml" (OuterVolumeSpecName: "kube-api-access-t25ml") pod "c7936dc8-1c55-4192-984f-d9af25834b34" (UID: "c7936dc8-1c55-4192-984f-d9af25834b34"). InnerVolumeSpecName "kube-api-access-t25ml". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 14 19:55:20.168482 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:55:20.168451    2579 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c7936dc8-1c55-4192-984f-d9af25834b34-trusted-ca-bundle\") on node \"ip-10-0-140-201.ec2.internal\" DevicePath \"\""
Jul 14 19:55:20.168482 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:55:20.168477    2579 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c7936dc8-1c55-4192-984f-d9af25834b34-console-serving-cert\") on node \"ip-10-0-140-201.ec2.internal\" DevicePath \"\""
Jul 14 19:55:20.168482 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:55:20.168486    2579 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c7936dc8-1c55-4192-984f-d9af25834b34-oauth-serving-cert\") on node \"ip-10-0-140-201.ec2.internal\" DevicePath \"\""
Jul 14 19:55:20.168735 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:55:20.168496    2579 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c7936dc8-1c55-4192-984f-d9af25834b34-service-ca\") on node \"ip-10-0-140-201.ec2.internal\" DevicePath \"\""
Jul 14 19:55:20.168735 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:55:20.168505    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-t25ml\" (UniqueName: \"kubernetes.io/projected/c7936dc8-1c55-4192-984f-d9af25834b34-kube-api-access-t25ml\") on node \"ip-10-0-140-201.ec2.internal\" DevicePath \"\""
Jul 14 19:55:20.168735 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:55:20.168514    2579 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c7936dc8-1c55-4192-984f-d9af25834b34-console-config\") on node \"ip-10-0-140-201.ec2.internal\" DevicePath \"\""
Jul 14 19:55:20.168735 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:55:20.168524    2579 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c7936dc8-1c55-4192-984f-d9af25834b34-console-oauth-config\") on node \"ip-10-0-140-201.ec2.internal\" DevicePath \"\""
Jul 14 19:55:20.789138 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:55:20.789097    2579 generic.go:356] "Generic (PLEG): container finished" podID="c7936dc8-1c55-4192-984f-d9af25834b34" containerID="3e37deb210b33a40d0c51e94e7813f73cb4c65f15d2ee6c94f85196d86103be0" exitCode=0
Jul 14 19:55:20.789572 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:55:20.789150    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5b59fbc5b4-tzkst"
Jul 14 19:55:20.789572 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:55:20.789156    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5b59fbc5b4-tzkst" event={"ID":"c7936dc8-1c55-4192-984f-d9af25834b34","Type":"ContainerDied","Data":"3e37deb210b33a40d0c51e94e7813f73cb4c65f15d2ee6c94f85196d86103be0"}
Jul 14 19:55:20.789572 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:55:20.789204    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5b59fbc5b4-tzkst" event={"ID":"c7936dc8-1c55-4192-984f-d9af25834b34","Type":"ContainerDied","Data":"dc982ac11cc977da50a5ec52c9a3793e88bc8240276180609de0672cf7d7d716"}
Jul 14 19:55:20.789572 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:55:20.789234    2579 scope.go:117] "RemoveContainer" containerID="3e37deb210b33a40d0c51e94e7813f73cb4c65f15d2ee6c94f85196d86103be0"
Jul 14 19:55:20.798079 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:55:20.798063    2579 scope.go:117] "RemoveContainer" containerID="3e37deb210b33a40d0c51e94e7813f73cb4c65f15d2ee6c94f85196d86103be0"
Jul 14 19:55:20.798347 ip-10-0-140-201 kubenswrapper[2579]: E0714 19:55:20.798325    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3e37deb210b33a40d0c51e94e7813f73cb4c65f15d2ee6c94f85196d86103be0\": container with ID starting with 3e37deb210b33a40d0c51e94e7813f73cb4c65f15d2ee6c94f85196d86103be0 not found: ID does not exist" containerID="3e37deb210b33a40d0c51e94e7813f73cb4c65f15d2ee6c94f85196d86103be0"
Jul 14 19:55:20.798413 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:55:20.798355    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3e37deb210b33a40d0c51e94e7813f73cb4c65f15d2ee6c94f85196d86103be0"} err="failed to get container status \"3e37deb210b33a40d0c51e94e7813f73cb4c65f15d2ee6c94f85196d86103be0\": rpc error: code = NotFound desc = could not find container \"3e37deb210b33a40d0c51e94e7813f73cb4c65f15d2ee6c94f85196d86103be0\": container with ID starting with 3e37deb210b33a40d0c51e94e7813f73cb4c65f15d2ee6c94f85196d86103be0 not found: ID does not exist"
Jul 14 19:55:20.810399 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:55:20.810377    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5b59fbc5b4-tzkst"]
Jul 14 19:55:20.814340 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:55:20.814318    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-5b59fbc5b4-tzkst"]
Jul 14 19:55:20.847942 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:55:20.847908    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c7936dc8-1c55-4192-984f-d9af25834b34" path="/var/lib/kubelet/pods/c7936dc8-1c55-4192-984f-d9af25834b34/volumes"
Jul 14 19:55:30.803777 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:55:30.803715    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-668bc5b675-4f584" podUID="820be733-b20f-4872-b0e7-a0a2bae3181a" containerName="console" containerID="cri-o://a23431835632f64c151b77402cddcb0a6e52632cec14390b7ef8085bc1bbcd7b" gracePeriod=15
Jul 14 19:55:31.045762 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:55:31.045737    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-668bc5b675-4f584"
Jul 14 19:55:31.172849 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:55:31.172742    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/820be733-b20f-4872-b0e7-a0a2bae3181a-trusted-ca-bundle\") pod \"820be733-b20f-4872-b0e7-a0a2bae3181a\" (UID: \"820be733-b20f-4872-b0e7-a0a2bae3181a\") "
Jul 14 19:55:31.172849 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:55:31.172802    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/820be733-b20f-4872-b0e7-a0a2bae3181a-oauth-serving-cert\") pod \"820be733-b20f-4872-b0e7-a0a2bae3181a\" (UID: \"820be733-b20f-4872-b0e7-a0a2bae3181a\") "
Jul 14 19:55:31.172849 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:55:31.172831    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ldwpn\" (UniqueName: \"kubernetes.io/projected/820be733-b20f-4872-b0e7-a0a2bae3181a-kube-api-access-ldwpn\") pod \"820be733-b20f-4872-b0e7-a0a2bae3181a\" (UID: \"820be733-b20f-4872-b0e7-a0a2bae3181a\") "
Jul 14 19:55:31.172849 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:55:31.172856    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/820be733-b20f-4872-b0e7-a0a2bae3181a-console-oauth-config\") pod \"820be733-b20f-4872-b0e7-a0a2bae3181a\" (UID: \"820be733-b20f-4872-b0e7-a0a2bae3181a\") "
Jul 14 19:55:31.173168 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:55:31.172905    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/820be733-b20f-4872-b0e7-a0a2bae3181a-service-ca\") pod \"820be733-b20f-4872-b0e7-a0a2bae3181a\" (UID: \"820be733-b20f-4872-b0e7-a0a2bae3181a\") "
Jul 14 19:55:31.173168 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:55:31.172936    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/820be733-b20f-4872-b0e7-a0a2bae3181a-console-serving-cert\") pod \"820be733-b20f-4872-b0e7-a0a2bae3181a\" (UID: \"820be733-b20f-4872-b0e7-a0a2bae3181a\") "
Jul 14 19:55:31.173168 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:55:31.172995    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/820be733-b20f-4872-b0e7-a0a2bae3181a-console-config\") pod \"820be733-b20f-4872-b0e7-a0a2bae3181a\" (UID: \"820be733-b20f-4872-b0e7-a0a2bae3181a\") "
Jul 14 19:55:31.173324 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:55:31.173194    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/820be733-b20f-4872-b0e7-a0a2bae3181a-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "820be733-b20f-4872-b0e7-a0a2bae3181a" (UID: "820be733-b20f-4872-b0e7-a0a2bae3181a"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 14 19:55:31.173375 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:55:31.173318    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/820be733-b20f-4872-b0e7-a0a2bae3181a-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "820be733-b20f-4872-b0e7-a0a2bae3181a" (UID: "820be733-b20f-4872-b0e7-a0a2bae3181a"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 14 19:55:31.173448 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:55:31.173421    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/820be733-b20f-4872-b0e7-a0a2bae3181a-service-ca" (OuterVolumeSpecName: "service-ca") pod "820be733-b20f-4872-b0e7-a0a2bae3181a" (UID: "820be733-b20f-4872-b0e7-a0a2bae3181a"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 14 19:55:31.173508 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:55:31.173490    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/820be733-b20f-4872-b0e7-a0a2bae3181a-console-config" (OuterVolumeSpecName: "console-config") pod "820be733-b20f-4872-b0e7-a0a2bae3181a" (UID: "820be733-b20f-4872-b0e7-a0a2bae3181a"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 14 19:55:31.175159 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:55:31.175136    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/820be733-b20f-4872-b0e7-a0a2bae3181a-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "820be733-b20f-4872-b0e7-a0a2bae3181a" (UID: "820be733-b20f-4872-b0e7-a0a2bae3181a"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 14 19:55:31.175717 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:55:31.175688    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/820be733-b20f-4872-b0e7-a0a2bae3181a-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "820be733-b20f-4872-b0e7-a0a2bae3181a" (UID: "820be733-b20f-4872-b0e7-a0a2bae3181a"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 14 19:55:31.175717 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:55:31.175699    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/820be733-b20f-4872-b0e7-a0a2bae3181a-kube-api-access-ldwpn" (OuterVolumeSpecName: "kube-api-access-ldwpn") pod "820be733-b20f-4872-b0e7-a0a2bae3181a" (UID: "820be733-b20f-4872-b0e7-a0a2bae3181a"). InnerVolumeSpecName "kube-api-access-ldwpn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 14 19:55:31.274141 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:55:31.274090    2579 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/820be733-b20f-4872-b0e7-a0a2bae3181a-console-config\") on node \"ip-10-0-140-201.ec2.internal\" DevicePath \"\""
Jul 14 19:55:31.274141 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:55:31.274134    2579 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/820be733-b20f-4872-b0e7-a0a2bae3181a-trusted-ca-bundle\") on node \"ip-10-0-140-201.ec2.internal\" DevicePath \"\""
Jul 14 19:55:31.274141 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:55:31.274144    2579 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/820be733-b20f-4872-b0e7-a0a2bae3181a-oauth-serving-cert\") on node \"ip-10-0-140-201.ec2.internal\" DevicePath \"\""
Jul 14 19:55:31.274141 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:55:31.274153    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ldwpn\" (UniqueName: \"kubernetes.io/projected/820be733-b20f-4872-b0e7-a0a2bae3181a-kube-api-access-ldwpn\") on node \"ip-10-0-140-201.ec2.internal\" DevicePath \"\""
Jul 14 19:55:31.274141 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:55:31.274161    2579 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/820be733-b20f-4872-b0e7-a0a2bae3181a-console-oauth-config\") on node \"ip-10-0-140-201.ec2.internal\" DevicePath \"\""
Jul 14 19:55:31.274429 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:55:31.274169    2579 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/820be733-b20f-4872-b0e7-a0a2bae3181a-service-ca\") on node \"ip-10-0-140-201.ec2.internal\" DevicePath \"\""
Jul 14 19:55:31.274429 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:55:31.274177    2579 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/820be733-b20f-4872-b0e7-a0a2bae3181a-console-serving-cert\") on node \"ip-10-0-140-201.ec2.internal\" DevicePath \"\""
Jul 14 19:55:31.836916 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:55:31.836877    2579 generic.go:356] "Generic (PLEG): container finished" podID="820be733-b20f-4872-b0e7-a0a2bae3181a" containerID="a23431835632f64c151b77402cddcb0a6e52632cec14390b7ef8085bc1bbcd7b" exitCode=0
Jul 14 19:55:31.837295 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:55:31.836929    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-668bc5b675-4f584"
Jul 14 19:55:31.837295 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:55:31.836967    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-668bc5b675-4f584" event={"ID":"820be733-b20f-4872-b0e7-a0a2bae3181a","Type":"ContainerDied","Data":"a23431835632f64c151b77402cddcb0a6e52632cec14390b7ef8085bc1bbcd7b"}
Jul 14 19:55:31.837295 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:55:31.837019    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-668bc5b675-4f584" event={"ID":"820be733-b20f-4872-b0e7-a0a2bae3181a","Type":"ContainerDied","Data":"2dcc83366f86c4216d3cda215ff67dd6e939b9931a39cdf8d5522e77c638eb2b"}
Jul 14 19:55:31.837295 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:55:31.837042    2579 scope.go:117] "RemoveContainer" containerID="a23431835632f64c151b77402cddcb0a6e52632cec14390b7ef8085bc1bbcd7b"
Jul 14 19:55:31.845459 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:55:31.845439    2579 scope.go:117] "RemoveContainer" containerID="a23431835632f64c151b77402cddcb0a6e52632cec14390b7ef8085bc1bbcd7b"
Jul 14 19:55:31.845741 ip-10-0-140-201 kubenswrapper[2579]: E0714 19:55:31.845722    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a23431835632f64c151b77402cddcb0a6e52632cec14390b7ef8085bc1bbcd7b\": container with ID starting with a23431835632f64c151b77402cddcb0a6e52632cec14390b7ef8085bc1bbcd7b not found: ID does not exist" containerID="a23431835632f64c151b77402cddcb0a6e52632cec14390b7ef8085bc1bbcd7b"
Jul 14 19:55:31.845793 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:55:31.845751    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a23431835632f64c151b77402cddcb0a6e52632cec14390b7ef8085bc1bbcd7b"} err="failed to get container status \"a23431835632f64c151b77402cddcb0a6e52632cec14390b7ef8085bc1bbcd7b\": rpc error: code = NotFound desc = could not find container \"a23431835632f64c151b77402cddcb0a6e52632cec14390b7ef8085bc1bbcd7b\": container with ID starting with a23431835632f64c151b77402cddcb0a6e52632cec14390b7ef8085bc1bbcd7b not found: ID does not exist"
Jul 14 19:55:31.858955 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:55:31.858927    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-668bc5b675-4f584"]
Jul 14 19:55:31.863643 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:55:31.863608    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-668bc5b675-4f584"]
Jul 14 19:55:32.845837 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:55:32.845803    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="820be733-b20f-4872-b0e7-a0a2bae3181a" path="/var/lib/kubelet/pods/820be733-b20f-4872-b0e7-a0a2bae3181a/volumes"
Jul 14 19:55:46.550490 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:55:46.550450    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540wbxvk"]
Jul 14 19:55:46.550982 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:55:46.550925    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="820be733-b20f-4872-b0e7-a0a2bae3181a" containerName="console"
Jul 14 19:55:46.550982 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:55:46.550944    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="820be733-b20f-4872-b0e7-a0a2bae3181a" containerName="console"
Jul 14 19:55:46.550982 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:55:46.550960    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c7936dc8-1c55-4192-984f-d9af25834b34" containerName="console"
Jul 14 19:55:46.550982 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:55:46.550967    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="c7936dc8-1c55-4192-984f-d9af25834b34" containerName="console"
Jul 14 19:55:46.551177 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:55:46.551059    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="820be733-b20f-4872-b0e7-a0a2bae3181a" containerName="console"
Jul 14 19:55:46.551177 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:55:46.551074    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="c7936dc8-1c55-4192-984f-d9af25834b34" containerName="console"
Jul 14 19:55:46.555636 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:55:46.555613    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540wbxvk"
Jul 14 19:55:46.558383 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:55:46.558352    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Jul 14 19:55:46.559238 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:55:46.559221    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-l9tp5\""
Jul 14 19:55:46.559348 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:55:46.559227    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Jul 14 19:55:46.563365 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:55:46.563343    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540wbxvk"]
Jul 14 19:55:46.599891 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:55:46.599849    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vq7wg\" (UniqueName: \"kubernetes.io/projected/9fcf0250-78f8-4533-96cc-d37a3cbd13be-kube-api-access-vq7wg\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540wbxvk\" (UID: \"9fcf0250-78f8-4533-96cc-d37a3cbd13be\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540wbxvk"
Jul 14 19:55:46.600072 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:55:46.599913    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9fcf0250-78f8-4533-96cc-d37a3cbd13be-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540wbxvk\" (UID: \"9fcf0250-78f8-4533-96cc-d37a3cbd13be\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540wbxvk"
Jul 14 19:55:46.600072 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:55:46.599962    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9fcf0250-78f8-4533-96cc-d37a3cbd13be-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540wbxvk\" (UID: \"9fcf0250-78f8-4533-96cc-d37a3cbd13be\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540wbxvk"
Jul 14 19:55:46.701179 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:55:46.701141    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9fcf0250-78f8-4533-96cc-d37a3cbd13be-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540wbxvk\" (UID: \"9fcf0250-78f8-4533-96cc-d37a3cbd13be\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540wbxvk"
Jul 14 19:55:46.701179 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:55:46.701179    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9fcf0250-78f8-4533-96cc-d37a3cbd13be-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540wbxvk\" (UID: \"9fcf0250-78f8-4533-96cc-d37a3cbd13be\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540wbxvk"
Jul 14 19:55:46.701402 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:55:46.701235    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vq7wg\" (UniqueName: \"kubernetes.io/projected/9fcf0250-78f8-4533-96cc-d37a3cbd13be-kube-api-access-vq7wg\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540wbxvk\" (UID: \"9fcf0250-78f8-4533-96cc-d37a3cbd13be\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540wbxvk"
Jul 14 19:55:46.701588 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:55:46.701520    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9fcf0250-78f8-4533-96cc-d37a3cbd13be-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540wbxvk\" (UID: \"9fcf0250-78f8-4533-96cc-d37a3cbd13be\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540wbxvk"
Jul 14 19:55:46.701663 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:55:46.701645    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9fcf0250-78f8-4533-96cc-d37a3cbd13be-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540wbxvk\" (UID: \"9fcf0250-78f8-4533-96cc-d37a3cbd13be\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540wbxvk"
Jul 14 19:55:46.710932 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:55:46.710905    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vq7wg\" (UniqueName: \"kubernetes.io/projected/9fcf0250-78f8-4533-96cc-d37a3cbd13be-kube-api-access-vq7wg\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540wbxvk\" (UID: \"9fcf0250-78f8-4533-96cc-d37a3cbd13be\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540wbxvk"
Jul 14 19:55:46.865579 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:55:46.865464    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540wbxvk"
Jul 14 19:55:47.010550 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:55:47.010456    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540wbxvk"]
Jul 14 19:55:47.013276 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:55:47.013248    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9fcf0250_78f8_4533_96cc_d37a3cbd13be.slice/crio-07d5332efabad937ae5cb2d40200c01a494bbbba74b2895d62f076f0259b114d WatchSource:0}: Error finding container 07d5332efabad937ae5cb2d40200c01a494bbbba74b2895d62f076f0259b114d: Status 404 returned error can't find the container with id 07d5332efabad937ae5cb2d40200c01a494bbbba74b2895d62f076f0259b114d
Jul 14 19:55:47.899833 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:55:47.899801    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540wbxvk" event={"ID":"9fcf0250-78f8-4533-96cc-d37a3cbd13be","Type":"ContainerStarted","Data":"07d5332efabad937ae5cb2d40200c01a494bbbba74b2895d62f076f0259b114d"}
Jul 14 19:55:54.929197 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:55:54.929163    2579 generic.go:356] "Generic (PLEG): container finished" podID="9fcf0250-78f8-4533-96cc-d37a3cbd13be" containerID="ba4177291ff615bc59963b3b81854f4e5f1f89cda8283f443af5191c02078477" exitCode=0
Jul 14 19:55:54.929624 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:55:54.929251    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540wbxvk" event={"ID":"9fcf0250-78f8-4533-96cc-d37a3cbd13be","Type":"ContainerDied","Data":"ba4177291ff615bc59963b3b81854f4e5f1f89cda8283f443af5191c02078477"}
Jul 14 19:55:56.940184 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:55:56.940144    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540wbxvk" event={"ID":"9fcf0250-78f8-4533-96cc-d37a3cbd13be","Type":"ContainerStarted","Data":"4c92fabc0e74fc6e0b79f49d028b89139e6681e77437e74304bf6b3dd5131248"}
Jul 14 19:55:57.945984 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:55:57.945951    2579 generic.go:356] "Generic (PLEG): container finished" podID="9fcf0250-78f8-4533-96cc-d37a3cbd13be" containerID="4c92fabc0e74fc6e0b79f49d028b89139e6681e77437e74304bf6b3dd5131248" exitCode=0
Jul 14 19:55:57.946357 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:55:57.946051    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540wbxvk" event={"ID":"9fcf0250-78f8-4533-96cc-d37a3cbd13be","Type":"ContainerDied","Data":"4c92fabc0e74fc6e0b79f49d028b89139e6681e77437e74304bf6b3dd5131248"}
Jul 14 19:56:04.976518 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:56:04.976481    2579 generic.go:356] "Generic (PLEG): container finished" podID="9fcf0250-78f8-4533-96cc-d37a3cbd13be" containerID="9d3ad836605b511b04440c6be86dfb8dd52511553a888f7c79b9627dc268516b" exitCode=0
Jul 14 19:56:04.976908 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:56:04.976561    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540wbxvk" event={"ID":"9fcf0250-78f8-4533-96cc-d37a3cbd13be","Type":"ContainerDied","Data":"9d3ad836605b511b04440c6be86dfb8dd52511553a888f7c79b9627dc268516b"}
Jul 14 19:56:06.112986 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:56:06.112958    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540wbxvk"
Jul 14 19:56:06.179422 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:56:06.179385    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vq7wg\" (UniqueName: \"kubernetes.io/projected/9fcf0250-78f8-4533-96cc-d37a3cbd13be-kube-api-access-vq7wg\") pod \"9fcf0250-78f8-4533-96cc-d37a3cbd13be\" (UID: \"9fcf0250-78f8-4533-96cc-d37a3cbd13be\") "
Jul 14 19:56:06.179619 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:56:06.179437    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9fcf0250-78f8-4533-96cc-d37a3cbd13be-bundle\") pod \"9fcf0250-78f8-4533-96cc-d37a3cbd13be\" (UID: \"9fcf0250-78f8-4533-96cc-d37a3cbd13be\") "
Jul 14 19:56:06.179619 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:56:06.179470    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9fcf0250-78f8-4533-96cc-d37a3cbd13be-util\") pod \"9fcf0250-78f8-4533-96cc-d37a3cbd13be\" (UID: \"9fcf0250-78f8-4533-96cc-d37a3cbd13be\") "
Jul 14 19:56:06.180303 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:56:06.180276    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9fcf0250-78f8-4533-96cc-d37a3cbd13be-bundle" (OuterVolumeSpecName: "bundle") pod "9fcf0250-78f8-4533-96cc-d37a3cbd13be" (UID: "9fcf0250-78f8-4533-96cc-d37a3cbd13be"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 19:56:06.181820 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:56:06.181796    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9fcf0250-78f8-4533-96cc-d37a3cbd13be-kube-api-access-vq7wg" (OuterVolumeSpecName: "kube-api-access-vq7wg") pod "9fcf0250-78f8-4533-96cc-d37a3cbd13be" (UID: "9fcf0250-78f8-4533-96cc-d37a3cbd13be"). InnerVolumeSpecName "kube-api-access-vq7wg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 14 19:56:06.184484 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:56:06.184463    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9fcf0250-78f8-4533-96cc-d37a3cbd13be-util" (OuterVolumeSpecName: "util") pod "9fcf0250-78f8-4533-96cc-d37a3cbd13be" (UID: "9fcf0250-78f8-4533-96cc-d37a3cbd13be"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 19:56:06.280928 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:56:06.280844    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vq7wg\" (UniqueName: \"kubernetes.io/projected/9fcf0250-78f8-4533-96cc-d37a3cbd13be-kube-api-access-vq7wg\") on node \"ip-10-0-140-201.ec2.internal\" DevicePath \"\""
Jul 14 19:56:06.280928 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:56:06.280875    2579 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9fcf0250-78f8-4533-96cc-d37a3cbd13be-bundle\") on node \"ip-10-0-140-201.ec2.internal\" DevicePath \"\""
Jul 14 19:56:06.280928 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:56:06.280884    2579 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9fcf0250-78f8-4533-96cc-d37a3cbd13be-util\") on node \"ip-10-0-140-201.ec2.internal\" DevicePath \"\""
Jul 14 19:56:06.986384 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:56:06.986343    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540wbxvk" event={"ID":"9fcf0250-78f8-4533-96cc-d37a3cbd13be","Type":"ContainerDied","Data":"07d5332efabad937ae5cb2d40200c01a494bbbba74b2895d62f076f0259b114d"}
Jul 14 19:56:06.986613 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:56:06.986397    2579 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="07d5332efabad937ae5cb2d40200c01a494bbbba74b2895d62f076f0259b114d"
Jul 14 19:56:06.986613 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:56:06.986409    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540wbxvk"
Jul 14 19:56:14.351766 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:56:14.351732    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-8cvzn"]
Jul 14 19:56:14.352230 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:56:14.352034    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9fcf0250-78f8-4533-96cc-d37a3cbd13be" containerName="extract"
Jul 14 19:56:14.352230 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:56:14.352044    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="9fcf0250-78f8-4533-96cc-d37a3cbd13be" containerName="extract"
Jul 14 19:56:14.352230 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:56:14.352056    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9fcf0250-78f8-4533-96cc-d37a3cbd13be" containerName="pull"
Jul 14 19:56:14.352230 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:56:14.352061    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="9fcf0250-78f8-4533-96cc-d37a3cbd13be" containerName="pull"
Jul 14 19:56:14.352230 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:56:14.352069    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9fcf0250-78f8-4533-96cc-d37a3cbd13be" containerName="util"
Jul 14 19:56:14.352230 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:56:14.352074    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="9fcf0250-78f8-4533-96cc-d37a3cbd13be" containerName="util"
Jul 14 19:56:14.352230 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:56:14.352128    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="9fcf0250-78f8-4533-96cc-d37a3cbd13be" containerName="extract"
Jul 14 19:56:14.356325 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:56:14.356308    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-8cvzn"
Jul 14 19:56:14.359059 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:56:14.359035    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\""
Jul 14 19:56:14.359186 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:56:14.359175    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\""
Jul 14 19:56:14.359186 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:56:14.359182    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-rrqqw\""
Jul 14 19:56:14.370047 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:56:14.370027    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-8cvzn"]
Jul 14 19:56:14.446919 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:56:14.446878    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nghnh\" (UniqueName: \"kubernetes.io/projected/3143a881-7a3c-4409-a145-6a200c3790cb-kube-api-access-nghnh\") pod \"cert-manager-operator-controller-manager-55c444bf86-8cvzn\" (UID: \"3143a881-7a3c-4409-a145-6a200c3790cb\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-8cvzn"
Jul 14 19:56:14.447100 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:56:14.446938    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3143a881-7a3c-4409-a145-6a200c3790cb-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-8cvzn\" (UID: \"3143a881-7a3c-4409-a145-6a200c3790cb\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-8cvzn"
Jul 14 19:56:14.548448 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:56:14.548386    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nghnh\" (UniqueName: \"kubernetes.io/projected/3143a881-7a3c-4409-a145-6a200c3790cb-kube-api-access-nghnh\") pod \"cert-manager-operator-controller-manager-55c444bf86-8cvzn\" (UID: \"3143a881-7a3c-4409-a145-6a200c3790cb\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-8cvzn"
Jul 14 19:56:14.548661 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:56:14.548482    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3143a881-7a3c-4409-a145-6a200c3790cb-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-8cvzn\" (UID: \"3143a881-7a3c-4409-a145-6a200c3790cb\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-8cvzn"
Jul 14 19:56:14.548875 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:56:14.548854    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3143a881-7a3c-4409-a145-6a200c3790cb-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-8cvzn\" (UID: \"3143a881-7a3c-4409-a145-6a200c3790cb\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-8cvzn"
Jul 14 19:56:14.566025 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:56:14.565994    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nghnh\" (UniqueName: \"kubernetes.io/projected/3143a881-7a3c-4409-a145-6a200c3790cb-kube-api-access-nghnh\") pod \"cert-manager-operator-controller-manager-55c444bf86-8cvzn\" (UID: \"3143a881-7a3c-4409-a145-6a200c3790cb\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-8cvzn"
Jul 14 19:56:14.665485 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:56:14.665386    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-8cvzn"
Jul 14 19:56:14.802987 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:56:14.802958    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-8cvzn"]
Jul 14 19:56:14.805567 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:56:14.805521    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3143a881_7a3c_4409_a145_6a200c3790cb.slice/crio-3c324c41ea94ad94710acc4d1473e2c118f2107875f16c30693528179dc79198 WatchSource:0}: Error finding container 3c324c41ea94ad94710acc4d1473e2c118f2107875f16c30693528179dc79198: Status 404 returned error can't find the container with id 3c324c41ea94ad94710acc4d1473e2c118f2107875f16c30693528179dc79198
Jul 14 19:56:15.018316 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:56:15.018283    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-8cvzn" event={"ID":"3143a881-7a3c-4409-a145-6a200c3790cb","Type":"ContainerStarted","Data":"3c324c41ea94ad94710acc4d1473e2c118f2107875f16c30693528179dc79198"}
Jul 14 19:56:17.029011 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:56:17.028972    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-8cvzn" event={"ID":"3143a881-7a3c-4409-a145-6a200c3790cb","Type":"ContainerStarted","Data":"4a1b77cb6b10d2bc0a1fb43d01fc3b12819589557b2c9a2c077fe62ee1a22769"}
Jul 14 19:56:17.063859 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:56:17.063792    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-8cvzn" podStartSLOduration=1.571926399 podStartE2EDuration="3.063770187s" totalImagesPullingTime="1.491843788s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 19:56:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 19:56:17.062170814 +0000 UTC m=+276.773766357" watchObservedRunningTime="2026-07-14 19:56:17.063770187 +0000 UTC m=+276.775365731"
Jul 14 19:56:18.538549 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:56:18.538506    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f4b75m"]
Jul 14 19:56:18.542016 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:56:18.541998    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f4b75m"
Jul 14 19:56:18.544575 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:56:18.544554    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Jul 14 19:56:18.544801 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:56:18.544785    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-l9tp5\""
Jul 14 19:56:18.545631 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:56:18.545608    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Jul 14 19:56:18.552196 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:56:18.552170    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f4b75m"]
Jul 14 19:56:18.684751 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:56:18.684705    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4d4f9807-ca53-4555-bd9c-eec87e7bfe14-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f4b75m\" (UID: \"4d4f9807-ca53-4555-bd9c-eec87e7bfe14\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f4b75m"
Jul 14 19:56:18.684929 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:56:18.684771    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rch58\" (UniqueName: \"kubernetes.io/projected/4d4f9807-ca53-4555-bd9c-eec87e7bfe14-kube-api-access-rch58\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f4b75m\" (UID: \"4d4f9807-ca53-4555-bd9c-eec87e7bfe14\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f4b75m"
Jul 14 19:56:18.684929 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:56:18.684820    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4d4f9807-ca53-4555-bd9c-eec87e7bfe14-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f4b75m\" (UID: \"4d4f9807-ca53-4555-bd9c-eec87e7bfe14\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f4b75m"
Jul 14 19:56:18.785786 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:56:18.785736    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4d4f9807-ca53-4555-bd9c-eec87e7bfe14-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f4b75m\" (UID: \"4d4f9807-ca53-4555-bd9c-eec87e7bfe14\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f4b75m"
Jul 14 19:56:18.785960 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:56:18.785812    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rch58\" (UniqueName: \"kubernetes.io/projected/4d4f9807-ca53-4555-bd9c-eec87e7bfe14-kube-api-access-rch58\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f4b75m\" (UID: \"4d4f9807-ca53-4555-bd9c-eec87e7bfe14\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f4b75m"
Jul 14 19:56:18.785960 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:56:18.785842    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4d4f9807-ca53-4555-bd9c-eec87e7bfe14-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f4b75m\" (UID: \"4d4f9807-ca53-4555-bd9c-eec87e7bfe14\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f4b75m"
Jul 14 19:56:18.786167 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:56:18.786144    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4d4f9807-ca53-4555-bd9c-eec87e7bfe14-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f4b75m\" (UID: \"4d4f9807-ca53-4555-bd9c-eec87e7bfe14\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f4b75m"
Jul 14 19:56:18.786218 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:56:18.786197    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4d4f9807-ca53-4555-bd9c-eec87e7bfe14-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f4b75m\" (UID: \"4d4f9807-ca53-4555-bd9c-eec87e7bfe14\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f4b75m"
Jul 14 19:56:18.796989 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:56:18.796921    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rch58\" (UniqueName: \"kubernetes.io/projected/4d4f9807-ca53-4555-bd9c-eec87e7bfe14-kube-api-access-rch58\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f4b75m\" (UID: \"4d4f9807-ca53-4555-bd9c-eec87e7bfe14\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f4b75m"
Jul 14 19:56:18.851022 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:56:18.850989    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f4b75m"
Jul 14 19:56:18.992980 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:56:18.992951    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f4b75m"]
Jul 14 19:56:18.995508 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:56:18.995471    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4d4f9807_ca53_4555_bd9c_eec87e7bfe14.slice/crio-063d492022f9aed1a98bbaf7a314df0690605d1fed051f2356b372efa66fa501 WatchSource:0}: Error finding container 063d492022f9aed1a98bbaf7a314df0690605d1fed051f2356b372efa66fa501: Status 404 returned error can't find the container with id 063d492022f9aed1a98bbaf7a314df0690605d1fed051f2356b372efa66fa501
Jul 14 19:56:19.038946 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:56:19.038910    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f4b75m" event={"ID":"4d4f9807-ca53-4555-bd9c-eec87e7bfe14","Type":"ContainerStarted","Data":"063d492022f9aed1a98bbaf7a314df0690605d1fed051f2356b372efa66fa501"}
Jul 14 19:56:20.044103 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:56:20.044066    2579 generic.go:356] "Generic (PLEG): container finished" podID="4d4f9807-ca53-4555-bd9c-eec87e7bfe14" containerID="5911eb2031546d69fd3b9f18cdb85671d584f32be288c54ec8ec288181fd866e" exitCode=0
Jul 14 19:56:20.044475 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:56:20.044145    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f4b75m" event={"ID":"4d4f9807-ca53-4555-bd9c-eec87e7bfe14","Type":"ContainerDied","Data":"5911eb2031546d69fd3b9f18cdb85671d584f32be288c54ec8ec288181fd866e"}
Jul 14 19:56:23.059758 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:56:23.059724    2579 generic.go:356] "Generic (PLEG): container finished" podID="4d4f9807-ca53-4555-bd9c-eec87e7bfe14" containerID="a528f76903b6b840b5ed430f86375a5027aaec573576887050592b6ed2ff37a2" exitCode=0
Jul 14 19:56:23.060150 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:56:23.059766    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f4b75m" event={"ID":"4d4f9807-ca53-4555-bd9c-eec87e7bfe14","Type":"ContainerDied","Data":"a528f76903b6b840b5ed430f86375a5027aaec573576887050592b6ed2ff37a2"}
Jul 14 19:56:24.065974 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:56:24.065934    2579 generic.go:356] "Generic (PLEG): container finished" podID="4d4f9807-ca53-4555-bd9c-eec87e7bfe14" containerID="0ab1690229855e9eb6f64ffcc01bef3c5edbd5a51e1d3bcb418f7e717edc4b39" exitCode=0
Jul 14 19:56:24.066364 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:56:24.066063    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f4b75m" event={"ID":"4d4f9807-ca53-4555-bd9c-eec87e7bfe14","Type":"ContainerDied","Data":"0ab1690229855e9eb6f64ffcc01bef3c5edbd5a51e1d3bcb418f7e717edc4b39"}
Jul 14 19:56:25.201638 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:56:25.201611    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f4b75m"
Jul 14 19:56:25.347674 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:56:25.347576    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4d4f9807-ca53-4555-bd9c-eec87e7bfe14-util\") pod \"4d4f9807-ca53-4555-bd9c-eec87e7bfe14\" (UID: \"4d4f9807-ca53-4555-bd9c-eec87e7bfe14\") "
Jul 14 19:56:25.347674 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:56:25.347619    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4d4f9807-ca53-4555-bd9c-eec87e7bfe14-bundle\") pod \"4d4f9807-ca53-4555-bd9c-eec87e7bfe14\" (UID: \"4d4f9807-ca53-4555-bd9c-eec87e7bfe14\") "
Jul 14 19:56:25.347674 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:56:25.347672    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rch58\" (UniqueName: \"kubernetes.io/projected/4d4f9807-ca53-4555-bd9c-eec87e7bfe14-kube-api-access-rch58\") pod \"4d4f9807-ca53-4555-bd9c-eec87e7bfe14\" (UID: \"4d4f9807-ca53-4555-bd9c-eec87e7bfe14\") "
Jul 14 19:56:25.348027 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:56:25.348000    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4d4f9807-ca53-4555-bd9c-eec87e7bfe14-bundle" (OuterVolumeSpecName: "bundle") pod "4d4f9807-ca53-4555-bd9c-eec87e7bfe14" (UID: "4d4f9807-ca53-4555-bd9c-eec87e7bfe14"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 19:56:25.349866 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:56:25.349840    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4d4f9807-ca53-4555-bd9c-eec87e7bfe14-kube-api-access-rch58" (OuterVolumeSpecName: "kube-api-access-rch58") pod "4d4f9807-ca53-4555-bd9c-eec87e7bfe14" (UID: "4d4f9807-ca53-4555-bd9c-eec87e7bfe14"). InnerVolumeSpecName "kube-api-access-rch58". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 14 19:56:25.353950 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:56:25.353922    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4d4f9807-ca53-4555-bd9c-eec87e7bfe14-util" (OuterVolumeSpecName: "util") pod "4d4f9807-ca53-4555-bd9c-eec87e7bfe14" (UID: "4d4f9807-ca53-4555-bd9c-eec87e7bfe14"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 19:56:25.448896 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:56:25.448858    2579 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4d4f9807-ca53-4555-bd9c-eec87e7bfe14-util\") on node \"ip-10-0-140-201.ec2.internal\" DevicePath \"\""
Jul 14 19:56:25.448896 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:56:25.448886    2579 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4d4f9807-ca53-4555-bd9c-eec87e7bfe14-bundle\") on node \"ip-10-0-140-201.ec2.internal\" DevicePath \"\""
Jul 14 19:56:25.448896 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:56:25.448895    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rch58\" (UniqueName: \"kubernetes.io/projected/4d4f9807-ca53-4555-bd9c-eec87e7bfe14-kube-api-access-rch58\") on node \"ip-10-0-140-201.ec2.internal\" DevicePath \"\""
Jul 14 19:56:25.859449 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:56:25.859412    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-hm9ln"]
Jul 14 19:56:25.859875 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:56:25.859849    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4d4f9807-ca53-4555-bd9c-eec87e7bfe14" containerName="util"
Jul 14 19:56:25.859875 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:56:25.859870    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="4d4f9807-ca53-4555-bd9c-eec87e7bfe14" containerName="util"
Jul 14 19:56:25.859875 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:56:25.859882    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4d4f9807-ca53-4555-bd9c-eec87e7bfe14" containerName="extract"
Jul 14 19:56:25.860087 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:56:25.859887    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="4d4f9807-ca53-4555-bd9c-eec87e7bfe14" containerName="extract"
Jul 14 19:56:25.860087 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:56:25.859898    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4d4f9807-ca53-4555-bd9c-eec87e7bfe14" containerName="pull"
Jul 14 19:56:25.860087 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:56:25.859904    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="4d4f9807-ca53-4555-bd9c-eec87e7bfe14" containerName="pull"
Jul 14 19:56:25.860087 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:56:25.859964    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="4d4f9807-ca53-4555-bd9c-eec87e7bfe14" containerName="extract"
Jul 14 19:56:25.864422 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:56:25.864401    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-hm9ln"
Jul 14 19:56:25.867289 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:56:25.867248    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
Jul 14 19:56:25.867435 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:56:25.867267    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
Jul 14 19:56:25.868074 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:56:25.868058    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-lgwsl\""
Jul 14 19:56:25.871945 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:56:25.871924    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-hm9ln"]
Jul 14 19:56:26.056023 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:56:26.055973    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j8gts\" (UniqueName: \"kubernetes.io/projected/47f6f3f3-e455-4e2f-a0e1-cbab98ba0862-kube-api-access-j8gts\") pod \"cert-manager-cainjector-559cdd8c87-hm9ln\" (UID: \"47f6f3f3-e455-4e2f-a0e1-cbab98ba0862\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-hm9ln"
Jul 14 19:56:26.056023 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:56:26.056025    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/47f6f3f3-e455-4e2f-a0e1-cbab98ba0862-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-hm9ln\" (UID: \"47f6f3f3-e455-4e2f-a0e1-cbab98ba0862\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-hm9ln"
Jul 14 19:56:26.076810 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:56:26.076784    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f4b75m"
Jul 14 19:56:26.076810 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:56:26.076804    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f4b75m" event={"ID":"4d4f9807-ca53-4555-bd9c-eec87e7bfe14","Type":"ContainerDied","Data":"063d492022f9aed1a98bbaf7a314df0690605d1fed051f2356b372efa66fa501"}
Jul 14 19:56:26.077007 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:56:26.076846    2579 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="063d492022f9aed1a98bbaf7a314df0690605d1fed051f2356b372efa66fa501"
Jul 14 19:56:26.157099 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:56:26.156983    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j8gts\" (UniqueName: \"kubernetes.io/projected/47f6f3f3-e455-4e2f-a0e1-cbab98ba0862-kube-api-access-j8gts\") pod \"cert-manager-cainjector-559cdd8c87-hm9ln\" (UID: \"47f6f3f3-e455-4e2f-a0e1-cbab98ba0862\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-hm9ln"
Jul 14 19:56:26.157099 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:56:26.157047    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/47f6f3f3-e455-4e2f-a0e1-cbab98ba0862-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-hm9ln\" (UID: \"47f6f3f3-e455-4e2f-a0e1-cbab98ba0862\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-hm9ln"
Jul 14 19:56:26.170304 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:56:26.170270    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/47f6f3f3-e455-4e2f-a0e1-cbab98ba0862-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-hm9ln\" (UID: \"47f6f3f3-e455-4e2f-a0e1-cbab98ba0862\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-hm9ln"
Jul 14 19:56:26.170439 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:56:26.170383    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j8gts\" (UniqueName: \"kubernetes.io/projected/47f6f3f3-e455-4e2f-a0e1-cbab98ba0862-kube-api-access-j8gts\") pod \"cert-manager-cainjector-559cdd8c87-hm9ln\" (UID: \"47f6f3f3-e455-4e2f-a0e1-cbab98ba0862\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-hm9ln"
Jul 14 19:56:26.174078 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:56:26.174064    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-hm9ln"
Jul 14 19:56:26.315615 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:56:26.315588    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-hm9ln"]
Jul 14 19:56:26.317627 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:56:26.317601    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod47f6f3f3_e455_4e2f_a0e1_cbab98ba0862.slice/crio-8603de8baa0e72e8af610ed7f91af4fd57a90c21d89faf2cad24a06a6658372e WatchSource:0}: Error finding container 8603de8baa0e72e8af610ed7f91af4fd57a90c21d89faf2cad24a06a6658372e: Status 404 returned error can't find the container with id 8603de8baa0e72e8af610ed7f91af4fd57a90c21d89faf2cad24a06a6658372e
Jul 14 19:56:27.082777 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:56:27.082737    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-hm9ln" event={"ID":"47f6f3f3-e455-4e2f-a0e1-cbab98ba0862","Type":"ContainerStarted","Data":"8603de8baa0e72e8af610ed7f91af4fd57a90c21d89faf2cad24a06a6658372e"}
Jul 14 19:56:28.773772 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:56:28.773731    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-55b4d954d5-pg2jc"]
Jul 14 19:56:28.777714 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:56:28.777687    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-pg2jc"
Jul 14 19:56:28.780581 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:56:28.780557    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-qvkhc\""
Jul 14 19:56:28.787301 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:56:28.787250    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-pg2jc"]
Jul 14 19:56:28.880082 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:56:28.880053    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/0ca919a7-58f4-4312-b32e-555aa35008ee-bound-sa-token\") pod \"cert-manager-55b4d954d5-pg2jc\" (UID: \"0ca919a7-58f4-4312-b32e-555aa35008ee\") " pod="cert-manager/cert-manager-55b4d954d5-pg2jc"
Jul 14 19:56:28.880196 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:56:28.880127    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gbg7c\" (UniqueName: \"kubernetes.io/projected/0ca919a7-58f4-4312-b32e-555aa35008ee-kube-api-access-gbg7c\") pod \"cert-manager-55b4d954d5-pg2jc\" (UID: \"0ca919a7-58f4-4312-b32e-555aa35008ee\") " pod="cert-manager/cert-manager-55b4d954d5-pg2jc"
Jul 14 19:56:28.980661 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:56:28.980629    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/0ca919a7-58f4-4312-b32e-555aa35008ee-bound-sa-token\") pod \"cert-manager-55b4d954d5-pg2jc\" (UID: \"0ca919a7-58f4-4312-b32e-555aa35008ee\") " pod="cert-manager/cert-manager-55b4d954d5-pg2jc"
Jul 14 19:56:28.980824 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:56:28.980682    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gbg7c\" (UniqueName: \"kubernetes.io/projected/0ca919a7-58f4-4312-b32e-555aa35008ee-kube-api-access-gbg7c\") pod \"cert-manager-55b4d954d5-pg2jc\" (UID: \"0ca919a7-58f4-4312-b32e-555aa35008ee\") " pod="cert-manager/cert-manager-55b4d954d5-pg2jc"
Jul 14 19:56:28.989287 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:56:28.989225    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gbg7c\" (UniqueName: \"kubernetes.io/projected/0ca919a7-58f4-4312-b32e-555aa35008ee-kube-api-access-gbg7c\") pod \"cert-manager-55b4d954d5-pg2jc\" (UID: \"0ca919a7-58f4-4312-b32e-555aa35008ee\") " pod="cert-manager/cert-manager-55b4d954d5-pg2jc"
Jul 14 19:56:28.989436 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:56:28.989390    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/0ca919a7-58f4-4312-b32e-555aa35008ee-bound-sa-token\") pod \"cert-manager-55b4d954d5-pg2jc\" (UID: \"0ca919a7-58f4-4312-b32e-555aa35008ee\") " pod="cert-manager/cert-manager-55b4d954d5-pg2jc"
Jul 14 19:56:29.089448 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:56:29.089359    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-pg2jc"
Jul 14 19:56:29.093142 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:56:29.093117    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-hm9ln" event={"ID":"47f6f3f3-e455-4e2f-a0e1-cbab98ba0862","Type":"ContainerStarted","Data":"d76fdbd0c8e0b52a0625ef605f11ed0e6535e335ad93984a23e4a7f3e221dedb"}
Jul 14 19:56:29.139358 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:56:29.139285    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-559cdd8c87-hm9ln" podStartSLOduration=1.593406383 podStartE2EDuration="4.139261688s" totalImagesPullingTime="2.545855305s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 19:56:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 19:56:29.13822442 +0000 UTC m=+288.849819965" watchObservedRunningTime="2026-07-14 19:56:29.139261688 +0000 UTC m=+288.850857233"
Jul 14 19:56:29.232841 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:56:29.232817    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-pg2jc"]
Jul 14 19:56:29.235109 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:56:29.235082    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod0ca919a7_58f4_4312_b32e_555aa35008ee.slice/crio-a8bacf4ff1b0f77ccd0f09e53c2442683fe68d76ba9cb466378475ce0d93b154 WatchSource:0}: Error finding container a8bacf4ff1b0f77ccd0f09e53c2442683fe68d76ba9cb466378475ce0d93b154: Status 404 returned error can't find the container with id a8bacf4ff1b0f77ccd0f09e53c2442683fe68d76ba9cb466378475ce0d93b154
Jul 14 19:56:30.098787 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:56:30.098752    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-pg2jc" event={"ID":"0ca919a7-58f4-4312-b32e-555aa35008ee","Type":"ContainerStarted","Data":"2a3dd2c37dcb95c6fb696f4d25340dbada45fbf41ab3bad0b0577b1075225c4e"}
Jul 14 19:56:30.099175 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:56:30.098794    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-pg2jc" event={"ID":"0ca919a7-58f4-4312-b32e-555aa35008ee","Type":"ContainerStarted","Data":"a8bacf4ff1b0f77ccd0f09e53c2442683fe68d76ba9cb466378475ce0d93b154"}
Jul 14 19:56:30.116514 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:56:30.116463    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-55b4d954d5-pg2jc" podStartSLOduration=2.116446772 podStartE2EDuration="2.116446772s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 19:56:28 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 19:56:30.11569221 +0000 UTC m=+289.827287758" watchObservedRunningTime="2026-07-14 19:56:30.116446772 +0000 UTC m=+289.828042316"
Jul 14 19:56:40.730584 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:56:40.730551    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-q4xzw_ef54193c-7659-4e47-87ac-4d129d22a268/ovn-acl-logging/0.log"
Jul 14 19:56:40.731355 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:56:40.731340    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-q4xzw_ef54193c-7659-4e47-87ac-4d129d22a268/ovn-acl-logging/0.log"
Jul 14 19:56:40.733641 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:56:40.733623    2579 kubelet.go:1648] "Image garbage collection succeeded"
Jul 14 19:56:44.066015 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:56:44.065972    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afggftl"]
Jul 14 19:56:44.069445 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:56:44.069423    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afggftl"
Jul 14 19:56:44.072275 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:56:44.072251    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Jul 14 19:56:44.072387 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:56:44.072312    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-l9tp5\""
Jul 14 19:56:44.073446 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:56:44.073430    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Jul 14 19:56:44.078433 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:56:44.078410    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afggftl"]
Jul 14 19:56:44.117315 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:56:44.117272    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/08103373-87ef-4dc2-bbcc-f17df3316204-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afggftl\" (UID: \"08103373-87ef-4dc2-bbcc-f17df3316204\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afggftl"
Jul 14 19:56:44.117481 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:56:44.117333    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/08103373-87ef-4dc2-bbcc-f17df3316204-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afggftl\" (UID: \"08103373-87ef-4dc2-bbcc-f17df3316204\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afggftl"
Jul 14 19:56:44.117481 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:56:44.117399    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-47pxx\" (UniqueName: \"kubernetes.io/projected/08103373-87ef-4dc2-bbcc-f17df3316204-kube-api-access-47pxx\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afggftl\" (UID: \"08103373-87ef-4dc2-bbcc-f17df3316204\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afggftl"
Jul 14 19:56:44.218156 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:56:44.218106    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-47pxx\" (UniqueName: \"kubernetes.io/projected/08103373-87ef-4dc2-bbcc-f17df3316204-kube-api-access-47pxx\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afggftl\" (UID: \"08103373-87ef-4dc2-bbcc-f17df3316204\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afggftl"
Jul 14 19:56:44.218375 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:56:44.218226    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/08103373-87ef-4dc2-bbcc-f17df3316204-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afggftl\" (UID: \"08103373-87ef-4dc2-bbcc-f17df3316204\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afggftl"
Jul 14 19:56:44.218375 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:56:44.218265    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/08103373-87ef-4dc2-bbcc-f17df3316204-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afggftl\" (UID: \"08103373-87ef-4dc2-bbcc-f17df3316204\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afggftl"
Jul 14 19:56:44.218699 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:56:44.218678    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/08103373-87ef-4dc2-bbcc-f17df3316204-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afggftl\" (UID: \"08103373-87ef-4dc2-bbcc-f17df3316204\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afggftl"
Jul 14 19:56:44.218770 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:56:44.218711    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/08103373-87ef-4dc2-bbcc-f17df3316204-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afggftl\" (UID: \"08103373-87ef-4dc2-bbcc-f17df3316204\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afggftl"
Jul 14 19:56:44.227670 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:56:44.227633    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-47pxx\" (UniqueName: \"kubernetes.io/projected/08103373-87ef-4dc2-bbcc-f17df3316204-kube-api-access-47pxx\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afggftl\" (UID: \"08103373-87ef-4dc2-bbcc-f17df3316204\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afggftl"
Jul 14 19:56:44.379508 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:56:44.379409    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afggftl"
Jul 14 19:56:44.522590 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:56:44.522557    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afggftl"]
Jul 14 19:56:44.524623 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:56:44.524585    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod08103373_87ef_4dc2_bbcc_f17df3316204.slice/crio-704c45feb73c1c16aee724246c58c63ee27bddcac2e1d8759ffb9d11a8d2f0f5 WatchSource:0}: Error finding container 704c45feb73c1c16aee724246c58c63ee27bddcac2e1d8759ffb9d11a8d2f0f5: Status 404 returned error can't find the container with id 704c45feb73c1c16aee724246c58c63ee27bddcac2e1d8759ffb9d11a8d2f0f5
Jul 14 19:56:45.170953 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:56:45.170913    2579 generic.go:356] "Generic (PLEG): container finished" podID="08103373-87ef-4dc2-bbcc-f17df3316204" containerID="9c36dfff4c2ac0136a8ff0a1a8bdafe633ad2ca76c3fbfa66385236caee39cd7" exitCode=0
Jul 14 19:56:45.171346 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:56:45.170978    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afggftl" event={"ID":"08103373-87ef-4dc2-bbcc-f17df3316204","Type":"ContainerDied","Data":"9c36dfff4c2ac0136a8ff0a1a8bdafe633ad2ca76c3fbfa66385236caee39cd7"}
Jul 14 19:56:45.171346 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:56:45.171027    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afggftl" event={"ID":"08103373-87ef-4dc2-bbcc-f17df3316204","Type":"ContainerStarted","Data":"704c45feb73c1c16aee724246c58c63ee27bddcac2e1d8759ffb9d11a8d2f0f5"}
Jul 14 19:56:45.171508 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:56:45.171491    2579 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 14 19:56:46.176990 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:56:46.176900    2579 generic.go:356] "Generic (PLEG): container finished" podID="08103373-87ef-4dc2-bbcc-f17df3316204" containerID="1051355a5b4dacb33748e6f07a6e6b1ffa5229c3c6edae04b9514782b9e59fea" exitCode=0
Jul 14 19:56:46.177351 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:56:46.176986    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afggftl" event={"ID":"08103373-87ef-4dc2-bbcc-f17df3316204","Type":"ContainerDied","Data":"1051355a5b4dacb33748e6f07a6e6b1ffa5229c3c6edae04b9514782b9e59fea"}
Jul 14 19:56:47.184256 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:56:47.184222    2579 generic.go:356] "Generic (PLEG): container finished" podID="08103373-87ef-4dc2-bbcc-f17df3316204" containerID="957346e23c9166fac2d510864df8544dcf8fd7d029d1453221cce3c7cec6b7b8" exitCode=0
Jul 14 19:56:47.184633 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:56:47.184304    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afggftl" event={"ID":"08103373-87ef-4dc2-bbcc-f17df3316204","Type":"ContainerDied","Data":"957346e23c9166fac2d510864df8544dcf8fd7d029d1453221cce3c7cec6b7b8"}
Jul 14 19:56:48.315946 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:56:48.315912    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afggftl"
Jul 14 19:56:48.457638 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:56:48.457553    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-47pxx\" (UniqueName: \"kubernetes.io/projected/08103373-87ef-4dc2-bbcc-f17df3316204-kube-api-access-47pxx\") pod \"08103373-87ef-4dc2-bbcc-f17df3316204\" (UID: \"08103373-87ef-4dc2-bbcc-f17df3316204\") "
Jul 14 19:56:48.457638 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:56:48.457613    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/08103373-87ef-4dc2-bbcc-f17df3316204-util\") pod \"08103373-87ef-4dc2-bbcc-f17df3316204\" (UID: \"08103373-87ef-4dc2-bbcc-f17df3316204\") "
Jul 14 19:56:48.457815 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:56:48.457673    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/08103373-87ef-4dc2-bbcc-f17df3316204-bundle\") pod \"08103373-87ef-4dc2-bbcc-f17df3316204\" (UID: \"08103373-87ef-4dc2-bbcc-f17df3316204\") "
Jul 14 19:56:48.458372 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:56:48.458342    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/08103373-87ef-4dc2-bbcc-f17df3316204-bundle" (OuterVolumeSpecName: "bundle") pod "08103373-87ef-4dc2-bbcc-f17df3316204" (UID: "08103373-87ef-4dc2-bbcc-f17df3316204"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 19:56:48.459855 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:56:48.459827    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/08103373-87ef-4dc2-bbcc-f17df3316204-kube-api-access-47pxx" (OuterVolumeSpecName: "kube-api-access-47pxx") pod "08103373-87ef-4dc2-bbcc-f17df3316204" (UID: "08103373-87ef-4dc2-bbcc-f17df3316204"). InnerVolumeSpecName "kube-api-access-47pxx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 14 19:56:48.463346 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:56:48.463322    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/08103373-87ef-4dc2-bbcc-f17df3316204-util" (OuterVolumeSpecName: "util") pod "08103373-87ef-4dc2-bbcc-f17df3316204" (UID: "08103373-87ef-4dc2-bbcc-f17df3316204"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 19:56:48.558491 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:56:48.558438    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-47pxx\" (UniqueName: \"kubernetes.io/projected/08103373-87ef-4dc2-bbcc-f17df3316204-kube-api-access-47pxx\") on node \"ip-10-0-140-201.ec2.internal\" DevicePath \"\""
Jul 14 19:56:48.558491 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:56:48.558482    2579 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/08103373-87ef-4dc2-bbcc-f17df3316204-util\") on node \"ip-10-0-140-201.ec2.internal\" DevicePath \"\""
Jul 14 19:56:48.558491 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:56:48.558494    2579 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/08103373-87ef-4dc2-bbcc-f17df3316204-bundle\") on node \"ip-10-0-140-201.ec2.internal\" DevicePath \"\""
Jul 14 19:56:49.195377 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:56:49.195290    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afggftl"
Jul 14 19:56:49.195377 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:56:49.195319    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afggftl" event={"ID":"08103373-87ef-4dc2-bbcc-f17df3316204","Type":"ContainerDied","Data":"704c45feb73c1c16aee724246c58c63ee27bddcac2e1d8759ffb9d11a8d2f0f5"}
Jul 14 19:56:49.195575 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:56:49.195393    2579 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="704c45feb73c1c16aee724246c58c63ee27bddcac2e1d8759ffb9d11a8d2f0f5"
Jul 14 19:56:56.824118 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:56:56.824084    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-786799b55c-fp9kv"]
Jul 14 19:56:56.824598 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:56:56.824579    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="08103373-87ef-4dc2-bbcc-f17df3316204" containerName="pull"
Jul 14 19:56:56.824682 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:56:56.824599    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="08103373-87ef-4dc2-bbcc-f17df3316204" containerName="pull"
Jul 14 19:56:56.824682 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:56:56.824616    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="08103373-87ef-4dc2-bbcc-f17df3316204" containerName="util"
Jul 14 19:56:56.824682 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:56:56.824624    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="08103373-87ef-4dc2-bbcc-f17df3316204" containerName="util"
Jul 14 19:56:56.824682 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:56:56.824642    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="08103373-87ef-4dc2-bbcc-f17df3316204" containerName="extract"
Jul 14 19:56:56.824682 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:56:56.824653    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="08103373-87ef-4dc2-bbcc-f17df3316204" containerName="extract"
Jul 14 19:56:56.824920 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:56:56.824769    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="08103373-87ef-4dc2-bbcc-f17df3316204" containerName="extract"
Jul 14 19:56:56.831361 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:56:56.831333    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-786799b55c-fp9kv"
Jul 14 19:56:56.835499 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:56:56.835474    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Jul 14 19:56:56.835499 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:56:56.835489    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Jul 14 19:56:56.835851 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:56:56.835838    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Jul 14 19:56:56.836989 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:56:56.836969    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Jul 14 19:56:56.837084 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:56:56.837068    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-6vqlw\""
Jul 14 19:56:56.858465 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:56:56.858432    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-786799b55c-fp9kv"]
Jul 14 19:56:56.934082 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:56:56.934041    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/1aeb97e7-5de4-4638-bf83-02f922e5b286-apiservice-cert\") pod \"opendatahub-operator-controller-manager-786799b55c-fp9kv\" (UID: \"1aeb97e7-5de4-4638-bf83-02f922e5b286\") " pod="opendatahub/opendatahub-operator-controller-manager-786799b55c-fp9kv"
Jul 14 19:56:56.934295 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:56:56.934111    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t2jlb\" (UniqueName: \"kubernetes.io/projected/1aeb97e7-5de4-4638-bf83-02f922e5b286-kube-api-access-t2jlb\") pod \"opendatahub-operator-controller-manager-786799b55c-fp9kv\" (UID: \"1aeb97e7-5de4-4638-bf83-02f922e5b286\") " pod="opendatahub/opendatahub-operator-controller-manager-786799b55c-fp9kv"
Jul 14 19:56:56.934295 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:56:56.934147    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1aeb97e7-5de4-4638-bf83-02f922e5b286-tmp\") pod \"opendatahub-operator-controller-manager-786799b55c-fp9kv\" (UID: \"1aeb97e7-5de4-4638-bf83-02f922e5b286\") " pod="opendatahub/opendatahub-operator-controller-manager-786799b55c-fp9kv"
Jul 14 19:56:56.934295 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:56:56.934173    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/1aeb97e7-5de4-4638-bf83-02f922e5b286-manifests\") pod \"opendatahub-operator-controller-manager-786799b55c-fp9kv\" (UID: \"1aeb97e7-5de4-4638-bf83-02f922e5b286\") " pod="opendatahub/opendatahub-operator-controller-manager-786799b55c-fp9kv"
Jul 14 19:56:56.934295 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:56:56.934246    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/1aeb97e7-5de4-4638-bf83-02f922e5b286-webhook-cert\") pod \"opendatahub-operator-controller-manager-786799b55c-fp9kv\" (UID: \"1aeb97e7-5de4-4638-bf83-02f922e5b286\") " pod="opendatahub/opendatahub-operator-controller-manager-786799b55c-fp9kv"
Jul 14 19:56:57.034946 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:56:57.034896    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t2jlb\" (UniqueName: \"kubernetes.io/projected/1aeb97e7-5de4-4638-bf83-02f922e5b286-kube-api-access-t2jlb\") pod \"opendatahub-operator-controller-manager-786799b55c-fp9kv\" (UID: \"1aeb97e7-5de4-4638-bf83-02f922e5b286\") " pod="opendatahub/opendatahub-operator-controller-manager-786799b55c-fp9kv"
Jul 14 19:56:57.035151 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:56:57.034954    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1aeb97e7-5de4-4638-bf83-02f922e5b286-tmp\") pod \"opendatahub-operator-controller-manager-786799b55c-fp9kv\" (UID: \"1aeb97e7-5de4-4638-bf83-02f922e5b286\") " pod="opendatahub/opendatahub-operator-controller-manager-786799b55c-fp9kv"
Jul 14 19:56:57.035151 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:56:57.034996    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/1aeb97e7-5de4-4638-bf83-02f922e5b286-manifests\") pod \"opendatahub-operator-controller-manager-786799b55c-fp9kv\" (UID: \"1aeb97e7-5de4-4638-bf83-02f922e5b286\") " pod="opendatahub/opendatahub-operator-controller-manager-786799b55c-fp9kv"
Jul 14 19:56:57.035151 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:56:57.035034    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/1aeb97e7-5de4-4638-bf83-02f922e5b286-webhook-cert\") pod \"opendatahub-operator-controller-manager-786799b55c-fp9kv\" (UID: \"1aeb97e7-5de4-4638-bf83-02f922e5b286\") " pod="opendatahub/opendatahub-operator-controller-manager-786799b55c-fp9kv"
Jul 14 19:56:57.035151 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:56:57.035075    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/1aeb97e7-5de4-4638-bf83-02f922e5b286-apiservice-cert\") pod \"opendatahub-operator-controller-manager-786799b55c-fp9kv\" (UID: \"1aeb97e7-5de4-4638-bf83-02f922e5b286\") " pod="opendatahub/opendatahub-operator-controller-manager-786799b55c-fp9kv"
Jul 14 19:56:57.035599 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:56:57.035526    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/1aeb97e7-5de4-4638-bf83-02f922e5b286-manifests\") pod \"opendatahub-operator-controller-manager-786799b55c-fp9kv\" (UID: \"1aeb97e7-5de4-4638-bf83-02f922e5b286\") " pod="opendatahub/opendatahub-operator-controller-manager-786799b55c-fp9kv"
Jul 14 19:56:57.037585 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:56:57.037522    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1aeb97e7-5de4-4638-bf83-02f922e5b286-tmp\") pod \"opendatahub-operator-controller-manager-786799b55c-fp9kv\" (UID: \"1aeb97e7-5de4-4638-bf83-02f922e5b286\") " pod="opendatahub/opendatahub-operator-controller-manager-786799b55c-fp9kv"
Jul 14 19:56:57.037712 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:56:57.037693    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/1aeb97e7-5de4-4638-bf83-02f922e5b286-webhook-cert\") pod \"opendatahub-operator-controller-manager-786799b55c-fp9kv\" (UID: \"1aeb97e7-5de4-4638-bf83-02f922e5b286\") " pod="opendatahub/opendatahub-operator-controller-manager-786799b55c-fp9kv"
Jul 14 19:56:57.037782 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:56:57.037732    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/1aeb97e7-5de4-4638-bf83-02f922e5b286-apiservice-cert\") pod \"opendatahub-operator-controller-manager-786799b55c-fp9kv\" (UID: \"1aeb97e7-5de4-4638-bf83-02f922e5b286\") " pod="opendatahub/opendatahub-operator-controller-manager-786799b55c-fp9kv"
Jul 14 19:56:57.046336 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:56:57.046310    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t2jlb\" (UniqueName: \"kubernetes.io/projected/1aeb97e7-5de4-4638-bf83-02f922e5b286-kube-api-access-t2jlb\") pod \"opendatahub-operator-controller-manager-786799b55c-fp9kv\" (UID: \"1aeb97e7-5de4-4638-bf83-02f922e5b286\") " pod="opendatahub/opendatahub-operator-controller-manager-786799b55c-fp9kv"
Jul 14 19:56:57.142394 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:56:57.142310    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-786799b55c-fp9kv"
Jul 14 19:56:57.268079 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:56:57.268049    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-7fb95d5d68-7t22d"]
Jul 14 19:56:57.273145 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:56:57.273119    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-7fb95d5d68-7t22d"
Jul 14 19:56:57.275817 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:56:57.275789    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Jul 14 19:56:57.276041 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:56:57.276024    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\""
Jul 14 19:56:57.276103 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:56:57.276028    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-ghbhg\""
Jul 14 19:56:57.276309 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:56:57.276292    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\""
Jul 14 19:56:57.276373 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:56:57.276292    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\""
Jul 14 19:56:57.276373 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:56:57.276346    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Jul 14 19:56:57.284918 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:56:57.284883    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-7fb95d5d68-7t22d"]
Jul 14 19:56:57.304847 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:56:57.304815    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-786799b55c-fp9kv"]
Jul 14 19:56:57.305083 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:56:57.305063    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1aeb97e7_5de4_4638_bf83_02f922e5b286.slice/crio-59e383a5a0b994c62efc1dfa3b9aec4acff165445c71b25d2c65a5229f68f7f1 WatchSource:0}: Error finding container 59e383a5a0b994c62efc1dfa3b9aec4acff165445c71b25d2c65a5229f68f7f1: Status 404 returned error can't find the container with id 59e383a5a0b994c62efc1dfa3b9aec4acff165445c71b25d2c65a5229f68f7f1
Jul 14 19:56:57.439510 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:56:57.439422    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/cdc24711-28ef-4845-9cca-90cce025f645-manager-config\") pod \"lws-controller-manager-7fb95d5d68-7t22d\" (UID: \"cdc24711-28ef-4845-9cca-90cce025f645\") " pod="openshift-lws-operator/lws-controller-manager-7fb95d5d68-7t22d"
Jul 14 19:56:57.439510 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:56:57.439457    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/cdc24711-28ef-4845-9cca-90cce025f645-cert\") pod \"lws-controller-manager-7fb95d5d68-7t22d\" (UID: \"cdc24711-28ef-4845-9cca-90cce025f645\") " pod="openshift-lws-operator/lws-controller-manager-7fb95d5d68-7t22d"
Jul 14 19:56:57.439510 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:56:57.439478    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rzffm\" (UniqueName: \"kubernetes.io/projected/cdc24711-28ef-4845-9cca-90cce025f645-kube-api-access-rzffm\") pod \"lws-controller-manager-7fb95d5d68-7t22d\" (UID: \"cdc24711-28ef-4845-9cca-90cce025f645\") " pod="openshift-lws-operator/lws-controller-manager-7fb95d5d68-7t22d"
Jul 14 19:56:57.439747 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:56:57.439654    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/cdc24711-28ef-4845-9cca-90cce025f645-metrics-cert\") pod \"lws-controller-manager-7fb95d5d68-7t22d\" (UID: \"cdc24711-28ef-4845-9cca-90cce025f645\") " pod="openshift-lws-operator/lws-controller-manager-7fb95d5d68-7t22d"
Jul 14 19:56:57.540638 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:56:57.540593    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/cdc24711-28ef-4845-9cca-90cce025f645-manager-config\") pod \"lws-controller-manager-7fb95d5d68-7t22d\" (UID: \"cdc24711-28ef-4845-9cca-90cce025f645\") " pod="openshift-lws-operator/lws-controller-manager-7fb95d5d68-7t22d"
Jul 14 19:56:57.540638 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:56:57.540639    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/cdc24711-28ef-4845-9cca-90cce025f645-cert\") pod \"lws-controller-manager-7fb95d5d68-7t22d\" (UID: \"cdc24711-28ef-4845-9cca-90cce025f645\") " pod="openshift-lws-operator/lws-controller-manager-7fb95d5d68-7t22d"
Jul 14 19:56:57.540854 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:56:57.540669    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rzffm\" (UniqueName: \"kubernetes.io/projected/cdc24711-28ef-4845-9cca-90cce025f645-kube-api-access-rzffm\") pod \"lws-controller-manager-7fb95d5d68-7t22d\" (UID: \"cdc24711-28ef-4845-9cca-90cce025f645\") " pod="openshift-lws-operator/lws-controller-manager-7fb95d5d68-7t22d"
Jul 14 19:56:57.540854 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:56:57.540713    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/cdc24711-28ef-4845-9cca-90cce025f645-metrics-cert\") pod \"lws-controller-manager-7fb95d5d68-7t22d\" (UID: \"cdc24711-28ef-4845-9cca-90cce025f645\") " pod="openshift-lws-operator/lws-controller-manager-7fb95d5d68-7t22d"
Jul 14 19:56:57.541255 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:56:57.541229    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/cdc24711-28ef-4845-9cca-90cce025f645-manager-config\") pod \"lws-controller-manager-7fb95d5d68-7t22d\" (UID: \"cdc24711-28ef-4845-9cca-90cce025f645\") " pod="openshift-lws-operator/lws-controller-manager-7fb95d5d68-7t22d"
Jul 14 19:56:57.543359 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:56:57.543338    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/cdc24711-28ef-4845-9cca-90cce025f645-cert\") pod \"lws-controller-manager-7fb95d5d68-7t22d\" (UID: \"cdc24711-28ef-4845-9cca-90cce025f645\") " pod="openshift-lws-operator/lws-controller-manager-7fb95d5d68-7t22d"
Jul 14 19:56:57.543439 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:56:57.543412    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/cdc24711-28ef-4845-9cca-90cce025f645-metrics-cert\") pod \"lws-controller-manager-7fb95d5d68-7t22d\" (UID: \"cdc24711-28ef-4845-9cca-90cce025f645\") " pod="openshift-lws-operator/lws-controller-manager-7fb95d5d68-7t22d"
Jul 14 19:56:57.549886 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:56:57.549866    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rzffm\" (UniqueName: \"kubernetes.io/projected/cdc24711-28ef-4845-9cca-90cce025f645-kube-api-access-rzffm\") pod \"lws-controller-manager-7fb95d5d68-7t22d\" (UID: \"cdc24711-28ef-4845-9cca-90cce025f645\") " pod="openshift-lws-operator/lws-controller-manager-7fb95d5d68-7t22d"
Jul 14 19:56:57.583966 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:56:57.583924    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-7fb95d5d68-7t22d"
Jul 14 19:56:57.735552 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:56:57.735501    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-7fb95d5d68-7t22d"]
Jul 14 19:56:57.738122 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:56:57.738096    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcdc24711_28ef_4845_9cca_90cce025f645.slice/crio-85aa7738e5cde082aeb75472c053384bf755c263daef7dc38cf2b39c114bbfb8 WatchSource:0}: Error finding container 85aa7738e5cde082aeb75472c053384bf755c263daef7dc38cf2b39c114bbfb8: Status 404 returned error can't find the container with id 85aa7738e5cde082aeb75472c053384bf755c263daef7dc38cf2b39c114bbfb8
Jul 14 19:56:58.238686 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:56:58.238642    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-786799b55c-fp9kv" event={"ID":"1aeb97e7-5de4-4638-bf83-02f922e5b286","Type":"ContainerStarted","Data":"59e383a5a0b994c62efc1dfa3b9aec4acff165445c71b25d2c65a5229f68f7f1"}
Jul 14 19:56:58.240235 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:56:58.240198    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-7fb95d5d68-7t22d" event={"ID":"cdc24711-28ef-4845-9cca-90cce025f645","Type":"ContainerStarted","Data":"85aa7738e5cde082aeb75472c053384bf755c263daef7dc38cf2b39c114bbfb8"}
Jul 14 19:57:01.260153 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:57:01.260118    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-7fb95d5d68-7t22d" event={"ID":"cdc24711-28ef-4845-9cca-90cce025f645","Type":"ContainerStarted","Data":"9474a06ac709a0061a232f554e4012fe4c02e8b2d749a479f3cf2f3084549911"}
Jul 14 19:57:01.260607 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:57:01.260325    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-7fb95d5d68-7t22d"
Jul 14 19:57:01.261900 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:57:01.261877    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-786799b55c-fp9kv" event={"ID":"1aeb97e7-5de4-4638-bf83-02f922e5b286","Type":"ContainerStarted","Data":"01029a8de5e5a848d9b4d26059c5081405ae5686fd22db7b941065df03ff0867"}
Jul 14 19:57:01.284499 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:57:01.284442    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-7fb95d5d68-7t22d" podStartSLOduration=0.90194205 podStartE2EDuration="4.284425288s" totalImagesPullingTime="3.382483238s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 19:56:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 19:57:01.283131716 +0000 UTC m=+320.994727257" watchObservedRunningTime="2026-07-14 19:57:01.284425288 +0000 UTC m=+320.996020825"
Jul 14 19:57:02.268045 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:57:02.268001    2579 generic.go:356] "Generic (PLEG): container finished" podID="1aeb97e7-5de4-4638-bf83-02f922e5b286" containerID="01029a8de5e5a848d9b4d26059c5081405ae5686fd22db7b941065df03ff0867" exitCode=0
Jul 14 19:57:02.268573 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:57:02.268086    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-786799b55c-fp9kv" event={"ID":"1aeb97e7-5de4-4638-bf83-02f922e5b286","Type":"ContainerDied","Data":"01029a8de5e5a848d9b4d26059c5081405ae5686fd22db7b941065df03ff0867"}
Jul 14 19:57:03.274624 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:57:03.274585    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-786799b55c-fp9kv" event={"ID":"1aeb97e7-5de4-4638-bf83-02f922e5b286","Type":"ContainerStarted","Data":"b2b4d6eeda71bdb36dbd0b2bc1c9969bd6a471e4cf41301225162d6b5d2bb1b2"}
Jul 14 19:57:03.275046 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:57:03.274691    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-786799b55c-fp9kv"
Jul 14 19:57:03.298988 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:57:03.298934    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-786799b55c-fp9kv" podStartSLOduration=2.699338044 podStartE2EDuration="7.298915791s" totalImagesPullingTime="3.394615915s" totalInitContainerRuntime="1.204961832s" isStatefulPod=false podCreationTimestamp="2026-07-14 19:56:56 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 19:57:03.298555468 +0000 UTC m=+323.010151006" watchObservedRunningTime="2026-07-14 19:57:03.298915791 +0000 UTC m=+323.010511408"
Jul 14 19:57:12.270683 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:57:12.270648    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-7fb95d5d68-7t22d"
Jul 14 19:57:14.281637 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:57:14.281606    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-786799b55c-fp9kv"
Jul 14 19:57:25.441176 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:57:25.441138    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4l54tt"]
Jul 14 19:57:25.449204 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:57:25.449173    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4l54tt"
Jul 14 19:57:25.465417 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:57:25.465388    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-cd5xc\""
Jul 14 19:57:25.465604 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:57:25.465524    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jul 14 19:57:25.465810 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:57:25.465787    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jul 14 19:57:25.465937 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:57:25.465871    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Jul 14 19:57:25.474482 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:57:25.474456    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/89814b01-3939-46c2-8f01-159989e0233d-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4l54tt\" (UID: \"89814b01-3939-46c2-8f01-159989e0233d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4l54tt"
Jul 14 19:57:25.474634 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:57:25.474490    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/89814b01-3939-46c2-8f01-159989e0233d-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4l54tt\" (UID: \"89814b01-3939-46c2-8f01-159989e0233d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4l54tt"
Jul 14 19:57:25.474634 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:57:25.474524    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kqd9m\" (UniqueName: \"kubernetes.io/projected/89814b01-3939-46c2-8f01-159989e0233d-kube-api-access-kqd9m\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4l54tt\" (UID: \"89814b01-3939-46c2-8f01-159989e0233d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4l54tt"
Jul 14 19:57:25.474634 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:57:25.474580    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/89814b01-3939-46c2-8f01-159989e0233d-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4l54tt\" (UID: \"89814b01-3939-46c2-8f01-159989e0233d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4l54tt"
Jul 14 19:57:25.474634 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:57:25.474607    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/89814b01-3939-46c2-8f01-159989e0233d-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4l54tt\" (UID: \"89814b01-3939-46c2-8f01-159989e0233d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4l54tt"
Jul 14 19:57:25.474793 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:57:25.474637    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/89814b01-3939-46c2-8f01-159989e0233d-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4l54tt\" (UID: \"89814b01-3939-46c2-8f01-159989e0233d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4l54tt"
Jul 14 19:57:25.474793 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:57:25.474684    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/89814b01-3939-46c2-8f01-159989e0233d-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4l54tt\" (UID: \"89814b01-3939-46c2-8f01-159989e0233d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4l54tt"
Jul 14 19:57:25.474793 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:57:25.474720    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/89814b01-3939-46c2-8f01-159989e0233d-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4l54tt\" (UID: \"89814b01-3939-46c2-8f01-159989e0233d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4l54tt"
Jul 14 19:57:25.474793 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:57:25.474742    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/89814b01-3939-46c2-8f01-159989e0233d-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4l54tt\" (UID: \"89814b01-3939-46c2-8f01-159989e0233d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4l54tt"
Jul 14 19:57:25.479865 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:57:25.479840    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4l54tt"]
Jul 14 19:57:25.575497 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:57:25.575452    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/89814b01-3939-46c2-8f01-159989e0233d-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4l54tt\" (UID: \"89814b01-3939-46c2-8f01-159989e0233d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4l54tt"
Jul 14 19:57:25.575497 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:57:25.575498    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/89814b01-3939-46c2-8f01-159989e0233d-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4l54tt\" (UID: \"89814b01-3939-46c2-8f01-159989e0233d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4l54tt"
Jul 14 19:57:25.575790 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:57:25.575589    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/89814b01-3939-46c2-8f01-159989e0233d-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4l54tt\" (UID: \"89814b01-3939-46c2-8f01-159989e0233d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4l54tt"
Jul 14 19:57:25.575790 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:57:25.575659    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kqd9m\" (UniqueName: \"kubernetes.io/projected/89814b01-3939-46c2-8f01-159989e0233d-kube-api-access-kqd9m\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4l54tt\" (UID: \"89814b01-3939-46c2-8f01-159989e0233d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4l54tt"
Jul 14 19:57:25.575790 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:57:25.575694    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/89814b01-3939-46c2-8f01-159989e0233d-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4l54tt\" (UID: \"89814b01-3939-46c2-8f01-159989e0233d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4l54tt"
Jul 14 19:57:25.575790 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:57:25.575729    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/89814b01-3939-46c2-8f01-159989e0233d-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4l54tt\" (UID: \"89814b01-3939-46c2-8f01-159989e0233d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4l54tt"
Jul 14 19:57:25.575790 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:57:25.575781    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/89814b01-3939-46c2-8f01-159989e0233d-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4l54tt\" (UID: \"89814b01-3939-46c2-8f01-159989e0233d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4l54tt"
Jul 14 19:57:25.576040 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:57:25.575829    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/89814b01-3939-46c2-8f01-159989e0233d-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4l54tt\" (UID: \"89814b01-3939-46c2-8f01-159989e0233d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4l54tt"
Jul 14 19:57:25.576040 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:57:25.575896    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/89814b01-3939-46c2-8f01-159989e0233d-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4l54tt\" (UID: \"89814b01-3939-46c2-8f01-159989e0233d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4l54tt"
Jul 14 19:57:25.576040 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:57:25.576020    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/89814b01-3939-46c2-8f01-159989e0233d-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4l54tt\" (UID: \"89814b01-3939-46c2-8f01-159989e0233d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4l54tt"
Jul 14 19:57:25.576191 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:57:25.576046    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/89814b01-3939-46c2-8f01-159989e0233d-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4l54tt\" (UID: \"89814b01-3939-46c2-8f01-159989e0233d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4l54tt"
Jul 14 19:57:25.576191 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:57:25.576103    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/89814b01-3939-46c2-8f01-159989e0233d-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4l54tt\" (UID: \"89814b01-3939-46c2-8f01-159989e0233d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4l54tt"
Jul 14 19:57:25.576302 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:57:25.576280    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/89814b01-3939-46c2-8f01-159989e0233d-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4l54tt\" (UID: \"89814b01-3939-46c2-8f01-159989e0233d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4l54tt"
Jul 14 19:57:25.576649 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:57:25.576626    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/89814b01-3939-46c2-8f01-159989e0233d-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4l54tt\" (UID: \"89814b01-3939-46c2-8f01-159989e0233d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4l54tt"
Jul 14 19:57:25.578077 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:57:25.578057    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/89814b01-3939-46c2-8f01-159989e0233d-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4l54tt\" (UID: \"89814b01-3939-46c2-8f01-159989e0233d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4l54tt"
Jul 14 19:57:25.578207 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:57:25.578191    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/89814b01-3939-46c2-8f01-159989e0233d-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4l54tt\" (UID: \"89814b01-3939-46c2-8f01-159989e0233d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4l54tt"
Jul 14 19:57:25.586111 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:57:25.586081    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kqd9m\" (UniqueName: \"kubernetes.io/projected/89814b01-3939-46c2-8f01-159989e0233d-kube-api-access-kqd9m\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4l54tt\" (UID: \"89814b01-3939-46c2-8f01-159989e0233d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4l54tt"
Jul 14 19:57:25.588070 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:57:25.588032    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/89814b01-3939-46c2-8f01-159989e0233d-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4l54tt\" (UID: \"89814b01-3939-46c2-8f01-159989e0233d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4l54tt"
Jul 14 19:57:25.758824 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:57:25.758782    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4l54tt"
Jul 14 19:57:25.912908 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:57:25.912885    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4l54tt"]
Jul 14 19:57:25.915116 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:57:25.915090    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod89814b01_3939_46c2_8f01_159989e0233d.slice/crio-dba1d398205f44ce84215e10dcb2fadc81b6097889512893ef21e87fc44ef768 WatchSource:0}: Error finding container dba1d398205f44ce84215e10dcb2fadc81b6097889512893ef21e87fc44ef768: Status 404 returned error can't find the container with id dba1d398205f44ce84215e10dcb2fadc81b6097889512893ef21e87fc44ef768
Jul 14 19:57:26.383615 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:57:26.383575    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4l54tt" event={"ID":"89814b01-3939-46c2-8f01-159989e0233d","Type":"ContainerStarted","Data":"dba1d398205f44ce84215e10dcb2fadc81b6097889512893ef21e87fc44ef768"}
Jul 14 19:57:27.870895 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:57:27.870659    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-zr2sx"]
Jul 14 19:57:27.877942 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:57:27.877907    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-zr2sx"
Jul 14 19:57:27.881916 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:57:27.881884    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\""
Jul 14 19:57:27.882132 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:57:27.881885    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-vchq6\""
Jul 14 19:57:27.882132 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:57:27.882069    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\""
Jul 14 19:57:27.882829 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:57:27.882800    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\""
Jul 14 19:57:27.895508 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:57:27.894763    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4qk9l\" (UniqueName: \"kubernetes.io/projected/8045a177-9e0f-4acf-9167-effd12177e0c-kube-api-access-4qk9l\") pod \"istiod-openshift-gateway-94bb8fbfd-zr2sx\" (UID: \"8045a177-9e0f-4acf-9167-effd12177e0c\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-zr2sx"
Jul 14 19:57:27.895508 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:57:27.894884    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/8045a177-9e0f-4acf-9167-effd12177e0c-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-zr2sx\" (UID: \"8045a177-9e0f-4acf-9167-effd12177e0c\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-zr2sx"
Jul 14 19:57:27.895508 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:57:27.894933    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/8045a177-9e0f-4acf-9167-effd12177e0c-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-zr2sx\" (UID: \"8045a177-9e0f-4acf-9167-effd12177e0c\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-zr2sx"
Jul 14 19:57:27.895508 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:57:27.895021    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8045a177-9e0f-4acf-9167-effd12177e0c-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-zr2sx\" (UID: \"8045a177-9e0f-4acf-9167-effd12177e0c\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-zr2sx"
Jul 14 19:57:27.895508 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:57:27.895049    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/8045a177-9e0f-4acf-9167-effd12177e0c-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-zr2sx\" (UID: \"8045a177-9e0f-4acf-9167-effd12177e0c\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-zr2sx"
Jul 14 19:57:27.895508 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:57:27.895072    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/8045a177-9e0f-4acf-9167-effd12177e0c-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-zr2sx\" (UID: \"8045a177-9e0f-4acf-9167-effd12177e0c\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-zr2sx"
Jul 14 19:57:27.895508 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:57:27.895127    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/8045a177-9e0f-4acf-9167-effd12177e0c-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-zr2sx\" (UID: \"8045a177-9e0f-4acf-9167-effd12177e0c\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-zr2sx"
Jul 14 19:57:27.898919 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:57:27.898891    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-zr2sx"]
Jul 14 19:57:27.995756 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:57:27.995718    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4qk9l\" (UniqueName: \"kubernetes.io/projected/8045a177-9e0f-4acf-9167-effd12177e0c-kube-api-access-4qk9l\") pod \"istiod-openshift-gateway-94bb8fbfd-zr2sx\" (UID: \"8045a177-9e0f-4acf-9167-effd12177e0c\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-zr2sx"
Jul 14 19:57:27.995960 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:57:27.995780    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/8045a177-9e0f-4acf-9167-effd12177e0c-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-zr2sx\" (UID: \"8045a177-9e0f-4acf-9167-effd12177e0c\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-zr2sx"
Jul 14 19:57:27.995960 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:57:27.995817    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/8045a177-9e0f-4acf-9167-effd12177e0c-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-zr2sx\" (UID: \"8045a177-9e0f-4acf-9167-effd12177e0c\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-zr2sx"
Jul 14 19:57:27.995960 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:57:27.995848    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8045a177-9e0f-4acf-9167-effd12177e0c-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-zr2sx\" (UID: \"8045a177-9e0f-4acf-9167-effd12177e0c\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-zr2sx"
Jul 14 19:57:27.995960 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:57:27.995875    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/8045a177-9e0f-4acf-9167-effd12177e0c-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-zr2sx\" (UID: \"8045a177-9e0f-4acf-9167-effd12177e0c\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-zr2sx"
Jul 14 19:57:27.996168 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:57:27.995992    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/8045a177-9e0f-4acf-9167-effd12177e0c-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-zr2sx\" (UID: \"8045a177-9e0f-4acf-9167-effd12177e0c\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-zr2sx"
Jul 14 19:57:27.996168 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:57:27.996046    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/8045a177-9e0f-4acf-9167-effd12177e0c-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-zr2sx\" (UID: \"8045a177-9e0f-4acf-9167-effd12177e0c\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-zr2sx"
Jul 14 19:57:27.996774 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:57:27.996710    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/8045a177-9e0f-4acf-9167-effd12177e0c-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-zr2sx\" (UID: \"8045a177-9e0f-4acf-9167-effd12177e0c\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-zr2sx"
Jul 14 19:57:27.999373 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:57:27.999346    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/8045a177-9e0f-4acf-9167-effd12177e0c-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-zr2sx\" (UID: \"8045a177-9e0f-4acf-9167-effd12177e0c\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-zr2sx"
Jul 14 19:57:27.999522 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:57:27.999501    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/8045a177-9e0f-4acf-9167-effd12177e0c-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-zr2sx\" (UID: \"8045a177-9e0f-4acf-9167-effd12177e0c\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-zr2sx"
Jul 14 19:57:27.999611 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:57:27.999567    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/8045a177-9e0f-4acf-9167-effd12177e0c-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-zr2sx\" (UID: \"8045a177-9e0f-4acf-9167-effd12177e0c\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-zr2sx"
Jul 14 19:57:27.999611 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:57:27.999576    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/8045a177-9e0f-4acf-9167-effd12177e0c-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-zr2sx\" (UID: \"8045a177-9e0f-4acf-9167-effd12177e0c\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-zr2sx"
Jul 14 19:57:28.005498 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:57:28.005473    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8045a177-9e0f-4acf-9167-effd12177e0c-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-zr2sx\" (UID: \"8045a177-9e0f-4acf-9167-effd12177e0c\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-zr2sx"
Jul 14 19:57:28.005613 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:57:28.005511    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4qk9l\" (UniqueName: \"kubernetes.io/projected/8045a177-9e0f-4acf-9167-effd12177e0c-kube-api-access-4qk9l\") pod \"istiod-openshift-gateway-94bb8fbfd-zr2sx\" (UID: \"8045a177-9e0f-4acf-9167-effd12177e0c\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-zr2sx"
Jul 14 19:57:28.196492 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:57:28.196035    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-zr2sx"
Jul 14 19:57:28.414011 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:57:28.413972    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8045a177_9e0f_4acf_9167_effd12177e0c.slice/crio-7250442cc33dfbd093312a525962fb84c8139350f8794af3e7ee43ff61c31a73 WatchSource:0}: Error finding container 7250442cc33dfbd093312a525962fb84c8139350f8794af3e7ee43ff61c31a73: Status 404 returned error can't find the container with id 7250442cc33dfbd093312a525962fb84c8139350f8794af3e7ee43ff61c31a73
Jul 14 19:57:28.415072 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:57:28.415048    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-zr2sx"]
Jul 14 19:57:29.400654 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:57:29.400582    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-zr2sx" event={"ID":"8045a177-9e0f-4acf-9167-effd12177e0c","Type":"ContainerStarted","Data":"7250442cc33dfbd093312a525962fb84c8139350f8794af3e7ee43ff61c31a73"}
Jul 14 19:57:29.541661 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:57:29.541567    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 14 19:57:29.541775 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:57:29.541747    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 14 19:57:29.541844 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:57:29.541823    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 14 19:57:30.407750 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:57:30.407705    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4l54tt" event={"ID":"89814b01-3939-46c2-8f01-159989e0233d","Type":"ContainerStarted","Data":"09f6f5b183ea9448d654d75f0ec7eb8501f2d5ecdb641af835db94ae966c2bc3"}
Jul 14 19:57:30.450018 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:57:30.449960    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4l54tt" podStartSLOduration=1.8261663750000001 podStartE2EDuration="5.449941855s" totalImagesPullingTime="3.62377548s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 19:57:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 19:57:30.438950693 +0000 UTC m=+350.150546238" watchObservedRunningTime="2026-07-14 19:57:30.449941855 +0000 UTC m=+350.161537398"
Jul 14 19:57:30.759081 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:57:30.759026    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4l54tt"
Jul 14 19:57:30.765257 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:57:30.765226    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4l54tt"
Jul 14 19:57:31.337761 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:57:31.337726    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 14 19:57:31.337886 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:57:31.337799    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 14 19:57:31.414096 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:57:31.414075    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4l54tt"
Jul 14 19:57:31.415117 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:57:31.415096    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4l54tt"
Jul 14 19:57:32.420204 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:57:32.420170    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-zr2sx" event={"ID":"8045a177-9e0f-4acf-9167-effd12177e0c","Type":"ContainerStarted","Data":"2111b4a5f2c21817a9bee4418739cb5cc2730ad141773d97ca102689f3f33731"}
Jul 14 19:57:32.420662 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:57:32.420378    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-zr2sx"
Jul 14 19:57:32.421902 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:57:32.421875    2579 patch_prober.go:28] interesting pod/istiod-openshift-gateway-94bb8fbfd-zr2sx container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 14 19:57:32.422026 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:57:32.421924    2579 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-zr2sx" podUID="8045a177-9e0f-4acf-9167-effd12177e0c" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 14 19:57:33.426204 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:57:33.426171    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-zr2sx"
Jul 14 19:57:33.455119 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:57:33.455058    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-zr2sx" podStartSLOduration=3.534114008 podStartE2EDuration="6.455041558s" totalImagesPullingTime="2.92092755s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 19:57:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 19:57:32.447322842 +0000 UTC m=+352.158918386" watchObservedRunningTime="2026-07-14 19:57:33.455041558 +0000 UTC m=+353.166637102"
Jul 14 19:58:35.633662 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:58:35.633618    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759tdh89"]
Jul 14 19:58:35.637411 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:58:35.637385    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759tdh89"
Jul 14 19:58:35.640073 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:58:35.640051    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 14 19:58:35.641033 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:58:35.641017    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-mpbkm\""
Jul 14 19:58:35.641133 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:58:35.641021    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 14 19:58:35.645969 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:58:35.645945    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759tdh89"]
Jul 14 19:58:35.740277 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:58:35.740246    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rq7mk"]
Jul 14 19:58:35.741958 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:58:35.741926    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4ba1b4c2-f21c-45ff-a603-677f80d40c5c-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759tdh89\" (UID: \"4ba1b4c2-f21c-45ff-a603-677f80d40c5c\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759tdh89"
Jul 14 19:58:35.742015 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:58:35.741961    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8s8gq\" (UniqueName: \"kubernetes.io/projected/4ba1b4c2-f21c-45ff-a603-677f80d40c5c-kube-api-access-8s8gq\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759tdh89\" (UID: \"4ba1b4c2-f21c-45ff-a603-677f80d40c5c\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759tdh89"
Jul 14 19:58:35.742015 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:58:35.741997    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4ba1b4c2-f21c-45ff-a603-677f80d40c5c-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759tdh89\" (UID: \"4ba1b4c2-f21c-45ff-a603-677f80d40c5c\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759tdh89"
Jul 14 19:58:35.743878 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:58:35.743862    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rq7mk"
Jul 14 19:58:35.753688 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:58:35.753664    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rq7mk"]
Jul 14 19:58:35.842628 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:58:35.842588    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4ba1b4c2-f21c-45ff-a603-677f80d40c5c-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759tdh89\" (UID: \"4ba1b4c2-f21c-45ff-a603-677f80d40c5c\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759tdh89"
Jul 14 19:58:35.842628 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:58:35.842631    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8s8gq\" (UniqueName: \"kubernetes.io/projected/4ba1b4c2-f21c-45ff-a603-677f80d40c5c-kube-api-access-8s8gq\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759tdh89\" (UID: \"4ba1b4c2-f21c-45ff-a603-677f80d40c5c\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759tdh89"
Jul 14 19:58:35.842866 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:58:35.842660    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/721784e8-cbc4-4542-9a67-3a6b3cf8057b-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rq7mk\" (UID: \"721784e8-cbc4-4542-9a67-3a6b3cf8057b\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rq7mk"
Jul 14 19:58:35.842866 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:58:35.842677    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b7qpq\" (UniqueName: \"kubernetes.io/projected/721784e8-cbc4-4542-9a67-3a6b3cf8057b-kube-api-access-b7qpq\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rq7mk\" (UID: \"721784e8-cbc4-4542-9a67-3a6b3cf8057b\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rq7mk"
Jul 14 19:58:35.842866 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:58:35.842698    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/721784e8-cbc4-4542-9a67-3a6b3cf8057b-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rq7mk\" (UID: \"721784e8-cbc4-4542-9a67-3a6b3cf8057b\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rq7mk"
Jul 14 19:58:35.842866 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:58:35.842715    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4ba1b4c2-f21c-45ff-a603-677f80d40c5c-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759tdh89\" (UID: \"4ba1b4c2-f21c-45ff-a603-677f80d40c5c\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759tdh89"
Jul 14 19:58:35.843011 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:58:35.842963    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4ba1b4c2-f21c-45ff-a603-677f80d40c5c-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759tdh89\" (UID: \"4ba1b4c2-f21c-45ff-a603-677f80d40c5c\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759tdh89"
Jul 14 19:58:35.843116 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:58:35.843095    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4ba1b4c2-f21c-45ff-a603-677f80d40c5c-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759tdh89\" (UID: \"4ba1b4c2-f21c-45ff-a603-677f80d40c5c\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759tdh89"
Jul 14 19:58:35.852857 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:58:35.852827    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8s8gq\" (UniqueName: \"kubernetes.io/projected/4ba1b4c2-f21c-45ff-a603-677f80d40c5c-kube-api-access-8s8gq\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759tdh89\" (UID: \"4ba1b4c2-f21c-45ff-a603-677f80d40c5c\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759tdh89"
Jul 14 19:58:35.944213 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:58:35.944106    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/721784e8-cbc4-4542-9a67-3a6b3cf8057b-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rq7mk\" (UID: \"721784e8-cbc4-4542-9a67-3a6b3cf8057b\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rq7mk"
Jul 14 19:58:35.944213 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:58:35.944156    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b7qpq\" (UniqueName: \"kubernetes.io/projected/721784e8-cbc4-4542-9a67-3a6b3cf8057b-kube-api-access-b7qpq\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rq7mk\" (UID: \"721784e8-cbc4-4542-9a67-3a6b3cf8057b\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rq7mk"
Jul 14 19:58:35.944213 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:58:35.944182    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/721784e8-cbc4-4542-9a67-3a6b3cf8057b-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rq7mk\" (UID: \"721784e8-cbc4-4542-9a67-3a6b3cf8057b\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rq7mk"
Jul 14 19:58:35.944521 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:58:35.944503    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/721784e8-cbc4-4542-9a67-3a6b3cf8057b-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rq7mk\" (UID: \"721784e8-cbc4-4542-9a67-3a6b3cf8057b\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rq7mk"
Jul 14 19:58:35.944656 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:58:35.944636    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/721784e8-cbc4-4542-9a67-3a6b3cf8057b-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rq7mk\" (UID: \"721784e8-cbc4-4542-9a67-3a6b3cf8057b\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rq7mk"
Jul 14 19:58:35.948062 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:58:35.948046    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759tdh89"
Jul 14 19:58:35.954585 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:58:35.954559    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b7qpq\" (UniqueName: \"kubernetes.io/projected/721784e8-cbc4-4542-9a67-3a6b3cf8057b-kube-api-access-b7qpq\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rq7mk\" (UID: \"721784e8-cbc4-4542-9a67-3a6b3cf8057b\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rq7mk"
Jul 14 19:58:36.009589 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:58:36.009553    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737xnnb"]
Jul 14 19:58:36.015839 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:58:36.015810    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737xnnb"
Jul 14 19:58:36.025895 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:58:36.025820    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737xnnb"]
Jul 14 19:58:36.054119 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:58:36.054087    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rq7mk"
Jul 14 19:58:36.100673 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:58:36.100052    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759tdh89"]
Jul 14 19:58:36.102358 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:58:36.102332    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4ba1b4c2_f21c_45ff_a603_677f80d40c5c.slice/crio-dbaefa69f857adfd5f1e7b93f0862b100789a50a98cf249ce5f4fe481a8bbd97 WatchSource:0}: Error finding container dbaefa69f857adfd5f1e7b93f0862b100789a50a98cf249ce5f4fe481a8bbd97: Status 404 returned error can't find the container with id dbaefa69f857adfd5f1e7b93f0862b100789a50a98cf249ce5f4fe481a8bbd97
Jul 14 19:58:36.145687 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:58:36.145656    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d632af5e-2745-4a30-9039-195015c27632-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737xnnb\" (UID: \"d632af5e-2745-4a30-9039-195015c27632\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737xnnb"
Jul 14 19:58:36.145850 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:58:36.145720    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d632af5e-2745-4a30-9039-195015c27632-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737xnnb\" (UID: \"d632af5e-2745-4a30-9039-195015c27632\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737xnnb"
Jul 14 19:58:36.145850 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:58:36.145831    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2wpqt\" (UniqueName: \"kubernetes.io/projected/d632af5e-2745-4a30-9039-195015c27632-kube-api-access-2wpqt\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737xnnb\" (UID: \"d632af5e-2745-4a30-9039-195015c27632\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737xnnb"
Jul 14 19:58:36.201621 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:58:36.201595    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rq7mk"]
Jul 14 19:58:36.203298 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:58:36.203274    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod721784e8_cbc4_4542_9a67_3a6b3cf8057b.slice/crio-826f9c51863a6a9a4bea4fa9e7082e0b2763fc8b4225ad0575815e869774735b WatchSource:0}: Error finding container 826f9c51863a6a9a4bea4fa9e7082e0b2763fc8b4225ad0575815e869774735b: Status 404 returned error can't find the container with id 826f9c51863a6a9a4bea4fa9e7082e0b2763fc8b4225ad0575815e869774735b
Jul 14 19:58:36.246633 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:58:36.246604    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d632af5e-2745-4a30-9039-195015c27632-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737xnnb\" (UID: \"d632af5e-2745-4a30-9039-195015c27632\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737xnnb"
Jul 14 19:58:36.246769 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:58:36.246671    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2wpqt\" (UniqueName: \"kubernetes.io/projected/d632af5e-2745-4a30-9039-195015c27632-kube-api-access-2wpqt\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737xnnb\" (UID: \"d632af5e-2745-4a30-9039-195015c27632\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737xnnb"
Jul 14 19:58:36.246838 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:58:36.246779    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d632af5e-2745-4a30-9039-195015c27632-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737xnnb\" (UID: \"d632af5e-2745-4a30-9039-195015c27632\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737xnnb"
Jul 14 19:58:36.247048 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:58:36.247024    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d632af5e-2745-4a30-9039-195015c27632-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737xnnb\" (UID: \"d632af5e-2745-4a30-9039-195015c27632\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737xnnb"
Jul 14 19:58:36.247115 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:58:36.247061    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d632af5e-2745-4a30-9039-195015c27632-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737xnnb\" (UID: \"d632af5e-2745-4a30-9039-195015c27632\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737xnnb"
Jul 14 19:58:36.256156 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:58:36.256127    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2wpqt\" (UniqueName: \"kubernetes.io/projected/d632af5e-2745-4a30-9039-195015c27632-kube-api-access-2wpqt\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737xnnb\" (UID: \"d632af5e-2745-4a30-9039-195015c27632\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737xnnb"
Jul 14 19:58:36.330332 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:58:36.330286    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737xnnb"
Jul 14 19:58:36.409614 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:58:36.409582    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0vfwkc"]
Jul 14 19:58:36.413086 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:58:36.413064    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0vfwkc"
Jul 14 19:58:36.431092 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:58:36.431060    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0vfwkc"]
Jul 14 19:58:36.448505 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:58:36.448472    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f4cf1772-b226-41c9-9172-4cde84bf2501-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0vfwkc\" (UID: \"f4cf1772-b226-41c9-9172-4cde84bf2501\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0vfwkc"
Jul 14 19:58:36.448690 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:58:36.448612    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f4cf1772-b226-41c9-9172-4cde84bf2501-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0vfwkc\" (UID: \"f4cf1772-b226-41c9-9172-4cde84bf2501\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0vfwkc"
Jul 14 19:58:36.448690 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:58:36.448657    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mpwn4\" (UniqueName: \"kubernetes.io/projected/f4cf1772-b226-41c9-9172-4cde84bf2501-kube-api-access-mpwn4\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0vfwkc\" (UID: \"f4cf1772-b226-41c9-9172-4cde84bf2501\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0vfwkc"
Jul 14 19:58:36.475741 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:58:36.475712    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737xnnb"]
Jul 14 19:58:36.477163 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:58:36.477139    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd632af5e_2745_4a30_9039_195015c27632.slice/crio-5cb7e0a3a1fc668c9a4cdc2347a2e0a088e51181192a7fee31900a78aa69dab5 WatchSource:0}: Error finding container 5cb7e0a3a1fc668c9a4cdc2347a2e0a088e51181192a7fee31900a78aa69dab5: Status 404 returned error can't find the container with id 5cb7e0a3a1fc668c9a4cdc2347a2e0a088e51181192a7fee31900a78aa69dab5
Jul 14 19:58:36.549596 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:58:36.549517    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f4cf1772-b226-41c9-9172-4cde84bf2501-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0vfwkc\" (UID: \"f4cf1772-b226-41c9-9172-4cde84bf2501\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0vfwkc"
Jul 14 19:58:36.549793 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:58:36.549607    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mpwn4\" (UniqueName: \"kubernetes.io/projected/f4cf1772-b226-41c9-9172-4cde84bf2501-kube-api-access-mpwn4\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0vfwkc\" (UID: \"f4cf1772-b226-41c9-9172-4cde84bf2501\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0vfwkc"
Jul 14 19:58:36.549793 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:58:36.549649    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f4cf1772-b226-41c9-9172-4cde84bf2501-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0vfwkc\" (UID: \"f4cf1772-b226-41c9-9172-4cde84bf2501\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0vfwkc"
Jul 14 19:58:36.549947 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:58:36.549916    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f4cf1772-b226-41c9-9172-4cde84bf2501-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0vfwkc\" (UID: \"f4cf1772-b226-41c9-9172-4cde84bf2501\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0vfwkc"
Jul 14 19:58:36.550014 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:58:36.549968    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f4cf1772-b226-41c9-9172-4cde84bf2501-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0vfwkc\" (UID: \"f4cf1772-b226-41c9-9172-4cde84bf2501\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0vfwkc"
Jul 14 19:58:36.558650 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:58:36.558614    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mpwn4\" (UniqueName: \"kubernetes.io/projected/f4cf1772-b226-41c9-9172-4cde84bf2501-kube-api-access-mpwn4\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0vfwkc\" (UID: \"f4cf1772-b226-41c9-9172-4cde84bf2501\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0vfwkc"
Jul 14 19:58:36.727994 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:58:36.727900    2579 generic.go:356] "Generic (PLEG): container finished" podID="4ba1b4c2-f21c-45ff-a603-677f80d40c5c" containerID="f1aa55abfe2f54117ad2c6e437486781bbb74ca11cbfb581adc11c7b0807d65d" exitCode=0
Jul 14 19:58:36.728409 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:58:36.728000    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759tdh89" event={"ID":"4ba1b4c2-f21c-45ff-a603-677f80d40c5c","Type":"ContainerDied","Data":"f1aa55abfe2f54117ad2c6e437486781bbb74ca11cbfb581adc11c7b0807d65d"}
Jul 14 19:58:36.728409 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:58:36.728059    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759tdh89" event={"ID":"4ba1b4c2-f21c-45ff-a603-677f80d40c5c","Type":"ContainerStarted","Data":"dbaefa69f857adfd5f1e7b93f0862b100789a50a98cf249ce5f4fe481a8bbd97"}
Jul 14 19:58:36.728409 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:58:36.728117    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0vfwkc"
Jul 14 19:58:36.729652 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:58:36.729628    2579 generic.go:356] "Generic (PLEG): container finished" podID="721784e8-cbc4-4542-9a67-3a6b3cf8057b" containerID="2e990a859efb04bf467b69a61129d0ad04074bce1bd889486bf113f992068a76" exitCode=0
Jul 14 19:58:36.729828 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:58:36.729725    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rq7mk" event={"ID":"721784e8-cbc4-4542-9a67-3a6b3cf8057b","Type":"ContainerDied","Data":"2e990a859efb04bf467b69a61129d0ad04074bce1bd889486bf113f992068a76"}
Jul 14 19:58:36.729828 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:58:36.729773    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rq7mk" event={"ID":"721784e8-cbc4-4542-9a67-3a6b3cf8057b","Type":"ContainerStarted","Data":"826f9c51863a6a9a4bea4fa9e7082e0b2763fc8b4225ad0575815e869774735b"}
Jul 14 19:58:36.731321 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:58:36.731297    2579 generic.go:356] "Generic (PLEG): container finished" podID="d632af5e-2745-4a30-9039-195015c27632" containerID="672bb39708c3c7bcdb321d5d87631200748ccf0de02d89608461a9d48a5b0705" exitCode=0
Jul 14 19:58:36.731406 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:58:36.731334    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737xnnb" event={"ID":"d632af5e-2745-4a30-9039-195015c27632","Type":"ContainerDied","Data":"672bb39708c3c7bcdb321d5d87631200748ccf0de02d89608461a9d48a5b0705"}
Jul 14 19:58:36.731406 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:58:36.731395    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737xnnb" event={"ID":"d632af5e-2745-4a30-9039-195015c27632","Type":"ContainerStarted","Data":"5cb7e0a3a1fc668c9a4cdc2347a2e0a088e51181192a7fee31900a78aa69dab5"}
Jul 14 19:58:36.872090 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:58:36.872060    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0vfwkc"]
Jul 14 19:58:36.873106 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:58:36.873079    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf4cf1772_b226_41c9_9172_4cde84bf2501.slice/crio-b0fc7ae310e26f4372883f5da4716e12d007ff984548bea2ec25046084332d2c WatchSource:0}: Error finding container b0fc7ae310e26f4372883f5da4716e12d007ff984548bea2ec25046084332d2c: Status 404 returned error can't find the container with id b0fc7ae310e26f4372883f5da4716e12d007ff984548bea2ec25046084332d2c
Jul 14 19:58:37.738182 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:58:37.738150    2579 generic.go:356] "Generic (PLEG): container finished" podID="f4cf1772-b226-41c9-9172-4cde84bf2501" containerID="48a92c92056afb658a10739c583f609ae764ebeb19f895c99a47cc54415ecdc7" exitCode=0
Jul 14 19:58:37.738640 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:58:37.738220    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0vfwkc" event={"ID":"f4cf1772-b226-41c9-9172-4cde84bf2501","Type":"ContainerDied","Data":"48a92c92056afb658a10739c583f609ae764ebeb19f895c99a47cc54415ecdc7"}
Jul 14 19:58:37.738640 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:58:37.738281    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0vfwkc" event={"ID":"f4cf1772-b226-41c9-9172-4cde84bf2501","Type":"ContainerStarted","Data":"b0fc7ae310e26f4372883f5da4716e12d007ff984548bea2ec25046084332d2c"}
Jul 14 19:58:38.745141 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:58:38.745045    2579 generic.go:356] "Generic (PLEG): container finished" podID="4ba1b4c2-f21c-45ff-a603-677f80d40c5c" containerID="f8f4a661a73d09072a74d2495fa3e7b2aceae58b16ac7453c716eb78923beaf7" exitCode=0
Jul 14 19:58:38.745141 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:58:38.745129    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759tdh89" event={"ID":"4ba1b4c2-f21c-45ff-a603-677f80d40c5c","Type":"ContainerDied","Data":"f8f4a661a73d09072a74d2495fa3e7b2aceae58b16ac7453c716eb78923beaf7"}
Jul 14 19:58:38.747144 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:58:38.747116    2579 generic.go:356] "Generic (PLEG): container finished" podID="721784e8-cbc4-4542-9a67-3a6b3cf8057b" containerID="14d85760998f83f88b2c47e3ed2d2ab71f34d7bff2596e5f77e3d5667c40c786" exitCode=0
Jul 14 19:58:38.747242 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:58:38.747152    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rq7mk" event={"ID":"721784e8-cbc4-4542-9a67-3a6b3cf8057b","Type":"ContainerDied","Data":"14d85760998f83f88b2c47e3ed2d2ab71f34d7bff2596e5f77e3d5667c40c786"}
Jul 14 19:58:38.749007 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:58:38.748987    2579 generic.go:356] "Generic (PLEG): container finished" podID="d632af5e-2745-4a30-9039-195015c27632" containerID="d4f95677e708cb82836101e21b47f91ca8511f94d1177c8fe079c726902fff60" exitCode=0
Jul 14 19:58:38.749082 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:58:38.749046    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737xnnb" event={"ID":"d632af5e-2745-4a30-9039-195015c27632","Type":"ContainerDied","Data":"d4f95677e708cb82836101e21b47f91ca8511f94d1177c8fe079c726902fff60"}
Jul 14 19:58:38.751077 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:58:38.751054    2579 generic.go:356] "Generic (PLEG): container finished" podID="f4cf1772-b226-41c9-9172-4cde84bf2501" containerID="92576db17a0b38b941b00d07f1ce982b995e942d10f49a0c131bd348c2aa5b16" exitCode=0
Jul 14 19:58:38.751151 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:58:38.751113    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0vfwkc" event={"ID":"f4cf1772-b226-41c9-9172-4cde84bf2501","Type":"ContainerDied","Data":"92576db17a0b38b941b00d07f1ce982b995e942d10f49a0c131bd348c2aa5b16"}
Jul 14 19:58:39.758321 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:58:39.758285    2579 generic.go:356] "Generic (PLEG): container finished" podID="721784e8-cbc4-4542-9a67-3a6b3cf8057b" containerID="3024e4b5c246a10a2ce0e0d129faad816b3a3f720475dd7265355416b6cc61ee" exitCode=0
Jul 14 19:58:39.758812 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:58:39.758377    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rq7mk" event={"ID":"721784e8-cbc4-4542-9a67-3a6b3cf8057b","Type":"ContainerDied","Data":"3024e4b5c246a10a2ce0e0d129faad816b3a3f720475dd7265355416b6cc61ee"}
Jul 14 19:58:39.760394 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:58:39.760371    2579 generic.go:356] "Generic (PLEG): container finished" podID="d632af5e-2745-4a30-9039-195015c27632" containerID="0c78fa231d6596c1cdf70d3ef465c8e276c01ce69f1a935ef797b21babbd9d48" exitCode=0
Jul 14 19:58:39.760525 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:58:39.760458    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737xnnb" event={"ID":"d632af5e-2745-4a30-9039-195015c27632","Type":"ContainerDied","Data":"0c78fa231d6596c1cdf70d3ef465c8e276c01ce69f1a935ef797b21babbd9d48"}
Jul 14 19:58:39.762431 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:58:39.762385    2579 generic.go:356] "Generic (PLEG): container finished" podID="f4cf1772-b226-41c9-9172-4cde84bf2501" containerID="4e286e9b224605bc823615bf375f2515c14f0daf618a54a507be293e9f648eea" exitCode=0
Jul 14 19:58:39.762585 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:58:39.762474    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0vfwkc" event={"ID":"f4cf1772-b226-41c9-9172-4cde84bf2501","Type":"ContainerDied","Data":"4e286e9b224605bc823615bf375f2515c14f0daf618a54a507be293e9f648eea"}
Jul 14 19:58:39.764557 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:58:39.764516    2579 generic.go:356] "Generic (PLEG): container finished" podID="4ba1b4c2-f21c-45ff-a603-677f80d40c5c" containerID="15a9ccf7ddac8d29ec7bfdd3bc46d9c05efa4e61a75d617c510dcfd94e8ac103" exitCode=0
Jul 14 19:58:39.764654 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:58:39.764559    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759tdh89" event={"ID":"4ba1b4c2-f21c-45ff-a603-677f80d40c5c","Type":"ContainerDied","Data":"15a9ccf7ddac8d29ec7bfdd3bc46d9c05efa4e61a75d617c510dcfd94e8ac103"}
Jul 14 19:58:40.932753 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:58:40.932691    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737xnnb"
Jul 14 19:58:40.983073 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:58:40.983048    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759tdh89"
Jul 14 19:58:40.986464 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:58:40.986435    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rq7mk"
Jul 14 19:58:40.989712 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:58:40.989691    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0vfwkc"
Jul 14 19:58:40.993043 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:58:40.993023    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2wpqt\" (UniqueName: \"kubernetes.io/projected/d632af5e-2745-4a30-9039-195015c27632-kube-api-access-2wpqt\") pod \"d632af5e-2745-4a30-9039-195015c27632\" (UID: \"d632af5e-2745-4a30-9039-195015c27632\") "
Jul 14 19:58:40.993141 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:58:40.993075    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d632af5e-2745-4a30-9039-195015c27632-bundle\") pod \"d632af5e-2745-4a30-9039-195015c27632\" (UID: \"d632af5e-2745-4a30-9039-195015c27632\") "
Jul 14 19:58:40.993141 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:58:40.993127    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d632af5e-2745-4a30-9039-195015c27632-util\") pod \"d632af5e-2745-4a30-9039-195015c27632\" (UID: \"d632af5e-2745-4a30-9039-195015c27632\") "
Jul 14 19:58:40.993694 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:58:40.993664    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d632af5e-2745-4a30-9039-195015c27632-bundle" (OuterVolumeSpecName: "bundle") pod "d632af5e-2745-4a30-9039-195015c27632" (UID: "d632af5e-2745-4a30-9039-195015c27632"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 19:58:40.995356 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:58:40.995330    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d632af5e-2745-4a30-9039-195015c27632-kube-api-access-2wpqt" (OuterVolumeSpecName: "kube-api-access-2wpqt") pod "d632af5e-2745-4a30-9039-195015c27632" (UID: "d632af5e-2745-4a30-9039-195015c27632"). InnerVolumeSpecName "kube-api-access-2wpqt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 14 19:58:40.998515 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:58:40.998485    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d632af5e-2745-4a30-9039-195015c27632-util" (OuterVolumeSpecName: "util") pod "d632af5e-2745-4a30-9039-195015c27632" (UID: "d632af5e-2745-4a30-9039-195015c27632"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 19:58:41.094347 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:58:41.094253    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/721784e8-cbc4-4542-9a67-3a6b3cf8057b-bundle\") pod \"721784e8-cbc4-4542-9a67-3a6b3cf8057b\" (UID: \"721784e8-cbc4-4542-9a67-3a6b3cf8057b\") "
Jul 14 19:58:41.094347 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:58:41.094300    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f4cf1772-b226-41c9-9172-4cde84bf2501-util\") pod \"f4cf1772-b226-41c9-9172-4cde84bf2501\" (UID: \"f4cf1772-b226-41c9-9172-4cde84bf2501\") "
Jul 14 19:58:41.094347 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:58:41.094331    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f4cf1772-b226-41c9-9172-4cde84bf2501-bundle\") pod \"f4cf1772-b226-41c9-9172-4cde84bf2501\" (UID: \"f4cf1772-b226-41c9-9172-4cde84bf2501\") "
Jul 14 19:58:41.094665 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:58:41.094354    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-b7qpq\" (UniqueName: \"kubernetes.io/projected/721784e8-cbc4-4542-9a67-3a6b3cf8057b-kube-api-access-b7qpq\") pod \"721784e8-cbc4-4542-9a67-3a6b3cf8057b\" (UID: \"721784e8-cbc4-4542-9a67-3a6b3cf8057b\") "
Jul 14 19:58:41.094665 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:58:41.094466    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4ba1b4c2-f21c-45ff-a603-677f80d40c5c-util\") pod \"4ba1b4c2-f21c-45ff-a603-677f80d40c5c\" (UID: \"4ba1b4c2-f21c-45ff-a603-677f80d40c5c\") "
Jul 14 19:58:41.094665 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:58:41.094494    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/721784e8-cbc4-4542-9a67-3a6b3cf8057b-util\") pod \"721784e8-cbc4-4542-9a67-3a6b3cf8057b\" (UID: \"721784e8-cbc4-4542-9a67-3a6b3cf8057b\") "
Jul 14 19:58:41.094665 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:58:41.094600    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4ba1b4c2-f21c-45ff-a603-677f80d40c5c-bundle\") pod \"4ba1b4c2-f21c-45ff-a603-677f80d40c5c\" (UID: \"4ba1b4c2-f21c-45ff-a603-677f80d40c5c\") "
Jul 14 19:58:41.094665 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:58:41.094641    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mpwn4\" (UniqueName: \"kubernetes.io/projected/f4cf1772-b226-41c9-9172-4cde84bf2501-kube-api-access-mpwn4\") pod \"f4cf1772-b226-41c9-9172-4cde84bf2501\" (UID: \"f4cf1772-b226-41c9-9172-4cde84bf2501\") "
Jul 14 19:58:41.094907 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:58:41.094708    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8s8gq\" (UniqueName: \"kubernetes.io/projected/4ba1b4c2-f21c-45ff-a603-677f80d40c5c-kube-api-access-8s8gq\") pod \"4ba1b4c2-f21c-45ff-a603-677f80d40c5c\" (UID: \"4ba1b4c2-f21c-45ff-a603-677f80d40c5c\") "
Jul 14 19:58:41.095301 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:58:41.094961    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f4cf1772-b226-41c9-9172-4cde84bf2501-bundle" (OuterVolumeSpecName: "bundle") pod "f4cf1772-b226-41c9-9172-4cde84bf2501" (UID: "f4cf1772-b226-41c9-9172-4cde84bf2501"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 19:58:41.095301 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:58:41.095028    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/721784e8-cbc4-4542-9a67-3a6b3cf8057b-bundle" (OuterVolumeSpecName: "bundle") pod "721784e8-cbc4-4542-9a67-3a6b3cf8057b" (UID: "721784e8-cbc4-4542-9a67-3a6b3cf8057b"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 19:58:41.095301 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:58:41.095083    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2wpqt\" (UniqueName: \"kubernetes.io/projected/d632af5e-2745-4a30-9039-195015c27632-kube-api-access-2wpqt\") on node \"ip-10-0-140-201.ec2.internal\" DevicePath \"\""
Jul 14 19:58:41.095301 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:58:41.095103    2579 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d632af5e-2745-4a30-9039-195015c27632-bundle\") on node \"ip-10-0-140-201.ec2.internal\" DevicePath \"\""
Jul 14 19:58:41.095301 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:58:41.095119    2579 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f4cf1772-b226-41c9-9172-4cde84bf2501-bundle\") on node \"ip-10-0-140-201.ec2.internal\" DevicePath \"\""
Jul 14 19:58:41.095301 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:58:41.095131    2579 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d632af5e-2745-4a30-9039-195015c27632-util\") on node \"ip-10-0-140-201.ec2.internal\" DevicePath \"\""
Jul 14 19:58:41.095301 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:58:41.095147    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4ba1b4c2-f21c-45ff-a603-677f80d40c5c-bundle" (OuterVolumeSpecName: "bundle") pod "4ba1b4c2-f21c-45ff-a603-677f80d40c5c" (UID: "4ba1b4c2-f21c-45ff-a603-677f80d40c5c"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 19:58:41.097197 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:58:41.097168    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4ba1b4c2-f21c-45ff-a603-677f80d40c5c-kube-api-access-8s8gq" (OuterVolumeSpecName: "kube-api-access-8s8gq") pod "4ba1b4c2-f21c-45ff-a603-677f80d40c5c" (UID: "4ba1b4c2-f21c-45ff-a603-677f80d40c5c"). InnerVolumeSpecName "kube-api-access-8s8gq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 14 19:58:41.097741 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:58:41.097709    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/721784e8-cbc4-4542-9a67-3a6b3cf8057b-kube-api-access-b7qpq" (OuterVolumeSpecName: "kube-api-access-b7qpq") pod "721784e8-cbc4-4542-9a67-3a6b3cf8057b" (UID: "721784e8-cbc4-4542-9a67-3a6b3cf8057b"). InnerVolumeSpecName "kube-api-access-b7qpq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 14 19:58:41.097741 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:58:41.097719    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f4cf1772-b226-41c9-9172-4cde84bf2501-kube-api-access-mpwn4" (OuterVolumeSpecName: "kube-api-access-mpwn4") pod "f4cf1772-b226-41c9-9172-4cde84bf2501" (UID: "f4cf1772-b226-41c9-9172-4cde84bf2501"). InnerVolumeSpecName "kube-api-access-mpwn4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 14 19:58:41.100903 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:58:41.100882    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4ba1b4c2-f21c-45ff-a603-677f80d40c5c-util" (OuterVolumeSpecName: "util") pod "4ba1b4c2-f21c-45ff-a603-677f80d40c5c" (UID: "4ba1b4c2-f21c-45ff-a603-677f80d40c5c"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 19:58:41.102300 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:58:41.102275    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f4cf1772-b226-41c9-9172-4cde84bf2501-util" (OuterVolumeSpecName: "util") pod "f4cf1772-b226-41c9-9172-4cde84bf2501" (UID: "f4cf1772-b226-41c9-9172-4cde84bf2501"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 19:58:41.103400 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:58:41.103382    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/721784e8-cbc4-4542-9a67-3a6b3cf8057b-util" (OuterVolumeSpecName: "util") pod "721784e8-cbc4-4542-9a67-3a6b3cf8057b" (UID: "721784e8-cbc4-4542-9a67-3a6b3cf8057b"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 19:58:41.195857 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:58:41.195817    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8s8gq\" (UniqueName: \"kubernetes.io/projected/4ba1b4c2-f21c-45ff-a603-677f80d40c5c-kube-api-access-8s8gq\") on node \"ip-10-0-140-201.ec2.internal\" DevicePath \"\""
Jul 14 19:58:41.195857 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:58:41.195850    2579 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/721784e8-cbc4-4542-9a67-3a6b3cf8057b-bundle\") on node \"ip-10-0-140-201.ec2.internal\" DevicePath \"\""
Jul 14 19:58:41.195857 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:58:41.195862    2579 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f4cf1772-b226-41c9-9172-4cde84bf2501-util\") on node \"ip-10-0-140-201.ec2.internal\" DevicePath \"\""
Jul 14 19:58:41.196089 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:58:41.195874    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-b7qpq\" (UniqueName: \"kubernetes.io/projected/721784e8-cbc4-4542-9a67-3a6b3cf8057b-kube-api-access-b7qpq\") on node \"ip-10-0-140-201.ec2.internal\" DevicePath \"\""
Jul 14 19:58:41.196089 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:58:41.195886    2579 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4ba1b4c2-f21c-45ff-a603-677f80d40c5c-util\") on node \"ip-10-0-140-201.ec2.internal\" DevicePath \"\""
Jul 14 19:58:41.196089 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:58:41.195897    2579 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/721784e8-cbc4-4542-9a67-3a6b3cf8057b-util\") on node \"ip-10-0-140-201.ec2.internal\" DevicePath \"\""
Jul 14 19:58:41.196089 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:58:41.195906    2579 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4ba1b4c2-f21c-45ff-a603-677f80d40c5c-bundle\") on node \"ip-10-0-140-201.ec2.internal\" DevicePath \"\""
Jul 14 19:58:41.196089 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:58:41.195918    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mpwn4\" (UniqueName: \"kubernetes.io/projected/f4cf1772-b226-41c9-9172-4cde84bf2501-kube-api-access-mpwn4\") on node \"ip-10-0-140-201.ec2.internal\" DevicePath \"\""
Jul 14 19:58:41.776493 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:58:41.776459    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rq7mk"
Jul 14 19:58:41.776493 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:58:41.776482    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rq7mk" event={"ID":"721784e8-cbc4-4542-9a67-3a6b3cf8057b","Type":"ContainerDied","Data":"826f9c51863a6a9a4bea4fa9e7082e0b2763fc8b4225ad0575815e869774735b"}
Jul 14 19:58:41.776723 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:58:41.776555    2579 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="826f9c51863a6a9a4bea4fa9e7082e0b2763fc8b4225ad0575815e869774735b"
Jul 14 19:58:41.785283 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:58:41.785249    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737xnnb"
Jul 14 19:58:41.785283 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:58:41.785255    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737xnnb" event={"ID":"d632af5e-2745-4a30-9039-195015c27632","Type":"ContainerDied","Data":"5cb7e0a3a1fc668c9a4cdc2347a2e0a088e51181192a7fee31900a78aa69dab5"}
Jul 14 19:58:41.785517 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:58:41.785341    2579 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="5cb7e0a3a1fc668c9a4cdc2347a2e0a088e51181192a7fee31900a78aa69dab5"
Jul 14 19:58:41.787875 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:58:41.787848    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0vfwkc"
Jul 14 19:58:41.788228 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:58:41.787854    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0vfwkc" event={"ID":"f4cf1772-b226-41c9-9172-4cde84bf2501","Type":"ContainerDied","Data":"b0fc7ae310e26f4372883f5da4716e12d007ff984548bea2ec25046084332d2c"}
Jul 14 19:58:41.788329 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:58:41.788253    2579 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="b0fc7ae310e26f4372883f5da4716e12d007ff984548bea2ec25046084332d2c"
Jul 14 19:58:41.791576 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:58:41.790565    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759tdh89" event={"ID":"4ba1b4c2-f21c-45ff-a603-677f80d40c5c","Type":"ContainerDied","Data":"dbaefa69f857adfd5f1e7b93f0862b100789a50a98cf249ce5f4fe481a8bbd97"}
Jul 14 19:58:41.791576 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:58:41.790601    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759tdh89"
Jul 14 19:58:41.791576 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:58:41.790604    2579 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="dbaefa69f857adfd5f1e7b93f0862b100789a50a98cf249ce5f4fe481a8bbd97"
Jul 14 19:59:51.492822 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:59:51.492788    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-rj6cq"]
Jul 14 19:59:51.493295 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:59:51.493134    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="721784e8-cbc4-4542-9a67-3a6b3cf8057b" containerName="pull"
Jul 14 19:59:51.493295 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:59:51.493146    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="721784e8-cbc4-4542-9a67-3a6b3cf8057b" containerName="pull"
Jul 14 19:59:51.493295 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:59:51.493156    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f4cf1772-b226-41c9-9172-4cde84bf2501" containerName="util"
Jul 14 19:59:51.493295 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:59:51.493161    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="f4cf1772-b226-41c9-9172-4cde84bf2501" containerName="util"
Jul 14 19:59:51.493295 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:59:51.493169    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4ba1b4c2-f21c-45ff-a603-677f80d40c5c" containerName="util"
Jul 14 19:59:51.493295 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:59:51.493175    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="4ba1b4c2-f21c-45ff-a603-677f80d40c5c" containerName="util"
Jul 14 19:59:51.493295 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:59:51.493183    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f4cf1772-b226-41c9-9172-4cde84bf2501" containerName="pull"
Jul 14 19:59:51.493295 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:59:51.493188    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="f4cf1772-b226-41c9-9172-4cde84bf2501" containerName="pull"
Jul 14 19:59:51.493295 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:59:51.493196    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f4cf1772-b226-41c9-9172-4cde84bf2501" containerName="extract"
Jul 14 19:59:51.493295 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:59:51.493201    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="f4cf1772-b226-41c9-9172-4cde84bf2501" containerName="extract"
Jul 14 19:59:51.493295 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:59:51.493215    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d632af5e-2745-4a30-9039-195015c27632" containerName="util"
Jul 14 19:59:51.493295 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:59:51.493220    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="d632af5e-2745-4a30-9039-195015c27632" containerName="util"
Jul 14 19:59:51.493295 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:59:51.493228    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d632af5e-2745-4a30-9039-195015c27632" containerName="pull"
Jul 14 19:59:51.493295 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:59:51.493232    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="d632af5e-2745-4a30-9039-195015c27632" containerName="pull"
Jul 14 19:59:51.493295 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:59:51.493238    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d632af5e-2745-4a30-9039-195015c27632" containerName="extract"
Jul 14 19:59:51.493295 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:59:51.493243    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="d632af5e-2745-4a30-9039-195015c27632" containerName="extract"
Jul 14 19:59:51.493295 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:59:51.493248    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="721784e8-cbc4-4542-9a67-3a6b3cf8057b" containerName="extract"
Jul 14 19:59:51.493295 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:59:51.493253    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="721784e8-cbc4-4542-9a67-3a6b3cf8057b" containerName="extract"
Jul 14 19:59:51.493295 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:59:51.493262    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4ba1b4c2-f21c-45ff-a603-677f80d40c5c" containerName="pull"
Jul 14 19:59:51.493295 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:59:51.493267    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="4ba1b4c2-f21c-45ff-a603-677f80d40c5c" containerName="pull"
Jul 14 19:59:51.493295 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:59:51.493274    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="721784e8-cbc4-4542-9a67-3a6b3cf8057b" containerName="util"
Jul 14 19:59:51.493295 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:59:51.493279    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="721784e8-cbc4-4542-9a67-3a6b3cf8057b" containerName="util"
Jul 14 19:59:51.493295 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:59:51.493285    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4ba1b4c2-f21c-45ff-a603-677f80d40c5c" containerName="extract"
Jul 14 19:59:51.493295 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:59:51.493290    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="4ba1b4c2-f21c-45ff-a603-677f80d40c5c" containerName="extract"
Jul 14 19:59:51.494056 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:59:51.493346    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="4ba1b4c2-f21c-45ff-a603-677f80d40c5c" containerName="extract"
Jul 14 19:59:51.494056 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:59:51.493357    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="d632af5e-2745-4a30-9039-195015c27632" containerName="extract"
Jul 14 19:59:51.494056 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:59:51.493363    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="721784e8-cbc4-4542-9a67-3a6b3cf8057b" containerName="extract"
Jul 14 19:59:51.494056 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:59:51.493371    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="f4cf1772-b226-41c9-9172-4cde84bf2501" containerName="extract"
Jul 14 19:59:51.496311 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:59:51.496293    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-rj6cq"
Jul 14 19:59:51.499328 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:59:51.499312    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-jbq5b\""
Jul 14 19:59:51.508179 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:59:51.508145    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-rj6cq"]
Jul 14 19:59:51.659243 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:59:51.659203    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bee8f711-e29d-48a4-ac23-7275e82af001-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-rj6cq\" (UID: \"bee8f711-e29d-48a4-ac23-7275e82af001\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-rj6cq"
Jul 14 19:59:51.659243 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:59:51.659244    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bee8f711-e29d-48a4-ac23-7275e82af001-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-rj6cq\" (UID: \"bee8f711-e29d-48a4-ac23-7275e82af001\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-rj6cq"
Jul 14 19:59:51.659453 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:59:51.659360    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bee8f711-e29d-48a4-ac23-7275e82af001-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-rj6cq\" (UID: \"bee8f711-e29d-48a4-ac23-7275e82af001\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-rj6cq"
Jul 14 19:59:51.659453 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:59:51.659397    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bee8f711-e29d-48a4-ac23-7275e82af001-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-rj6cq\" (UID: \"bee8f711-e29d-48a4-ac23-7275e82af001\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-rj6cq"
Jul 14 19:59:51.659453 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:59:51.659446    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bee8f711-e29d-48a4-ac23-7275e82af001-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-rj6cq\" (UID: \"bee8f711-e29d-48a4-ac23-7275e82af001\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-rj6cq"
Jul 14 19:59:51.659582 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:59:51.659482    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bee8f711-e29d-48a4-ac23-7275e82af001-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-rj6cq\" (UID: \"bee8f711-e29d-48a4-ac23-7275e82af001\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-rj6cq"
Jul 14 19:59:51.659582 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:59:51.659502    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fswbk\" (UniqueName: \"kubernetes.io/projected/bee8f711-e29d-48a4-ac23-7275e82af001-kube-api-access-fswbk\") pod \"maas-default-gateway-openshift-default-56654dcf7-rj6cq\" (UID: \"bee8f711-e29d-48a4-ac23-7275e82af001\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-rj6cq"
Jul 14 19:59:51.659582 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:59:51.659550    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bee8f711-e29d-48a4-ac23-7275e82af001-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-rj6cq\" (UID: \"bee8f711-e29d-48a4-ac23-7275e82af001\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-rj6cq"
Jul 14 19:59:51.659677 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:59:51.659626    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bee8f711-e29d-48a4-ac23-7275e82af001-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-rj6cq\" (UID: \"bee8f711-e29d-48a4-ac23-7275e82af001\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-rj6cq"
Jul 14 19:59:51.760555 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:59:51.760402    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bee8f711-e29d-48a4-ac23-7275e82af001-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-rj6cq\" (UID: \"bee8f711-e29d-48a4-ac23-7275e82af001\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-rj6cq"
Jul 14 19:59:51.760555 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:59:51.760474    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bee8f711-e29d-48a4-ac23-7275e82af001-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-rj6cq\" (UID: \"bee8f711-e29d-48a4-ac23-7275e82af001\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-rj6cq"
Jul 14 19:59:51.760555 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:59:51.760506    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fswbk\" (UniqueName: \"kubernetes.io/projected/bee8f711-e29d-48a4-ac23-7275e82af001-kube-api-access-fswbk\") pod \"maas-default-gateway-openshift-default-56654dcf7-rj6cq\" (UID: \"bee8f711-e29d-48a4-ac23-7275e82af001\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-rj6cq"
Jul 14 19:59:51.760851 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:59:51.760566    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bee8f711-e29d-48a4-ac23-7275e82af001-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-rj6cq\" (UID: \"bee8f711-e29d-48a4-ac23-7275e82af001\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-rj6cq"
Jul 14 19:59:51.760851 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:59:51.760609    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bee8f711-e29d-48a4-ac23-7275e82af001-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-rj6cq\" (UID: \"bee8f711-e29d-48a4-ac23-7275e82af001\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-rj6cq"
Jul 14 19:59:51.760851 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:59:51.760639    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bee8f711-e29d-48a4-ac23-7275e82af001-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-rj6cq\" (UID: \"bee8f711-e29d-48a4-ac23-7275e82af001\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-rj6cq"
Jul 14 19:59:51.760851 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:59:51.760662    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bee8f711-e29d-48a4-ac23-7275e82af001-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-rj6cq\" (UID: \"bee8f711-e29d-48a4-ac23-7275e82af001\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-rj6cq"
Jul 14 19:59:51.760851 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:59:51.760754    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bee8f711-e29d-48a4-ac23-7275e82af001-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-rj6cq\" (UID: \"bee8f711-e29d-48a4-ac23-7275e82af001\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-rj6cq"
Jul 14 19:59:51.760851 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:59:51.760786    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bee8f711-e29d-48a4-ac23-7275e82af001-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-rj6cq\" (UID: \"bee8f711-e29d-48a4-ac23-7275e82af001\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-rj6cq"
Jul 14 19:59:51.761128 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:59:51.760880    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bee8f711-e29d-48a4-ac23-7275e82af001-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-rj6cq\" (UID: \"bee8f711-e29d-48a4-ac23-7275e82af001\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-rj6cq"
Jul 14 19:59:51.761128 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:59:51.760890    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bee8f711-e29d-48a4-ac23-7275e82af001-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-rj6cq\" (UID: \"bee8f711-e29d-48a4-ac23-7275e82af001\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-rj6cq"
Jul 14 19:59:51.761322 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:59:51.761300    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bee8f711-e29d-48a4-ac23-7275e82af001-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-rj6cq\" (UID: \"bee8f711-e29d-48a4-ac23-7275e82af001\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-rj6cq"
Jul 14 19:59:51.761464 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:59:51.761353    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bee8f711-e29d-48a4-ac23-7275e82af001-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-rj6cq\" (UID: \"bee8f711-e29d-48a4-ac23-7275e82af001\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-rj6cq"
Jul 14 19:59:51.761464 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:59:51.761412    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bee8f711-e29d-48a4-ac23-7275e82af001-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-rj6cq\" (UID: \"bee8f711-e29d-48a4-ac23-7275e82af001\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-rj6cq"
Jul 14 19:59:51.763673 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:59:51.763654    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bee8f711-e29d-48a4-ac23-7275e82af001-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-rj6cq\" (UID: \"bee8f711-e29d-48a4-ac23-7275e82af001\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-rj6cq"
Jul 14 19:59:51.764007 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:59:51.763985    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bee8f711-e29d-48a4-ac23-7275e82af001-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-rj6cq\" (UID: \"bee8f711-e29d-48a4-ac23-7275e82af001\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-rj6cq"
Jul 14 19:59:51.769847 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:59:51.769810    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bee8f711-e29d-48a4-ac23-7275e82af001-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-rj6cq\" (UID: \"bee8f711-e29d-48a4-ac23-7275e82af001\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-rj6cq"
Jul 14 19:59:51.769963 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:59:51.769875    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fswbk\" (UniqueName: \"kubernetes.io/projected/bee8f711-e29d-48a4-ac23-7275e82af001-kube-api-access-fswbk\") pod \"maas-default-gateway-openshift-default-56654dcf7-rj6cq\" (UID: \"bee8f711-e29d-48a4-ac23-7275e82af001\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-rj6cq"
Jul 14 19:59:51.807845 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:59:51.807807    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-rj6cq"
Jul 14 19:59:51.954643 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:59:51.954606    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-rj6cq"]
Jul 14 19:59:51.956964 ip-10-0-140-201 kubenswrapper[2579]: W0714 19:59:51.956938    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbee8f711_e29d_48a4_ac23_7275e82af001.slice/crio-79406ce505ca1fc2adb05fd571c777fc0a0f9e211dd587c77297a9ab185879a4 WatchSource:0}: Error finding container 79406ce505ca1fc2adb05fd571c777fc0a0f9e211dd587c77297a9ab185879a4: Status 404 returned error can't find the container with id 79406ce505ca1fc2adb05fd571c777fc0a0f9e211dd587c77297a9ab185879a4
Jul 14 19:59:51.959509 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:59:51.959480    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 14 19:59:51.959623 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:59:51.959588    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 14 19:59:51.959684 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:59:51.959639    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 14 19:59:52.144349 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:59:52.144314    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-rj6cq" event={"ID":"bee8f711-e29d-48a4-ac23-7275e82af001","Type":"ContainerStarted","Data":"6c8fcd3616d8e5028c875a11f13f0b3334eaa6a2c7244742367ee9ca484d45d5"}
Jul 14 19:59:52.144579 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:59:52.144369    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-rj6cq" event={"ID":"bee8f711-e29d-48a4-ac23-7275e82af001","Type":"ContainerStarted","Data":"79406ce505ca1fc2adb05fd571c777fc0a0f9e211dd587c77297a9ab185879a4"}
Jul 14 19:59:52.165296 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:59:52.165237    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-rj6cq" podStartSLOduration=1.165221593 podStartE2EDuration="1.165221593s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 19:59:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 19:59:52.164024478 +0000 UTC m=+491.875620023" watchObservedRunningTime="2026-07-14 19:59:52.165221593 +0000 UTC m=+491.876817136"
Jul 14 19:59:52.809025 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:59:52.808968    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-rj6cq"
Jul 14 19:59:53.813519 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:59:53.813485    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-rj6cq"
Jul 14 19:59:54.161566 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:59:54.161456    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-rj6cq"
Jul 14 19:59:54.162398 ip-10-0-140-201 kubenswrapper[2579]: I0714 19:59:54.162376    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-rj6cq"
Jul 14 20:00:47.210246 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:00:47.210151    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-9c85946f4-m9b9z"]
Jul 14 20:00:47.213856 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:00:47.213835    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-9c85946f4-m9b9z"
Jul 14 20:00:47.216919 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:00:47.216895    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Jul 14 20:00:47.217052 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:00:47.216928    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Jul 14 20:00:47.218000 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:00:47.217973    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-p4clj\""
Jul 14 20:00:47.228281 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:00:47.228256    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-9c85946f4-m9b9z"]
Jul 14 20:00:47.269266 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:00:47.269227    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ec8087c6-5b24-43c6-ba48-167034ba5c5a-webhook-cert\") pod \"maas-controller-9c85946f4-m9b9z\" (UID: \"ec8087c6-5b24-43c6-ba48-167034ba5c5a\") " pod="opendatahub/maas-controller-9c85946f4-m9b9z"
Jul 14 20:00:47.269436 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:00:47.269333    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-89nfl\" (UniqueName: \"kubernetes.io/projected/ec8087c6-5b24-43c6-ba48-167034ba5c5a-kube-api-access-89nfl\") pod \"maas-controller-9c85946f4-m9b9z\" (UID: \"ec8087c6-5b24-43c6-ba48-167034ba5c5a\") " pod="opendatahub/maas-controller-9c85946f4-m9b9z"
Jul 14 20:00:47.369999 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:00:47.369953    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ec8087c6-5b24-43c6-ba48-167034ba5c5a-webhook-cert\") pod \"maas-controller-9c85946f4-m9b9z\" (UID: \"ec8087c6-5b24-43c6-ba48-167034ba5c5a\") " pod="opendatahub/maas-controller-9c85946f4-m9b9z"
Jul 14 20:00:47.370196 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:00:47.370056    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-89nfl\" (UniqueName: \"kubernetes.io/projected/ec8087c6-5b24-43c6-ba48-167034ba5c5a-kube-api-access-89nfl\") pod \"maas-controller-9c85946f4-m9b9z\" (UID: \"ec8087c6-5b24-43c6-ba48-167034ba5c5a\") " pod="opendatahub/maas-controller-9c85946f4-m9b9z"
Jul 14 20:00:47.372659 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:00:47.372638    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ec8087c6-5b24-43c6-ba48-167034ba5c5a-webhook-cert\") pod \"maas-controller-9c85946f4-m9b9z\" (UID: \"ec8087c6-5b24-43c6-ba48-167034ba5c5a\") " pod="opendatahub/maas-controller-9c85946f4-m9b9z"
Jul 14 20:00:47.379799 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:00:47.379762    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-89nfl\" (UniqueName: \"kubernetes.io/projected/ec8087c6-5b24-43c6-ba48-167034ba5c5a-kube-api-access-89nfl\") pod \"maas-controller-9c85946f4-m9b9z\" (UID: \"ec8087c6-5b24-43c6-ba48-167034ba5c5a\") " pod="opendatahub/maas-controller-9c85946f4-m9b9z"
Jul 14 20:00:47.526961 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:00:47.526840    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-9c85946f4-m9b9z"
Jul 14 20:00:47.669713 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:00:47.669682    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-9c85946f4-m9b9z"]
Jul 14 20:00:47.671686 ip-10-0-140-201 kubenswrapper[2579]: W0714 20:00:47.671658    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podec8087c6_5b24_43c6_ba48_167034ba5c5a.slice/crio-2e725e7e7ba290d2d8707393a6b92b117ef9d843f8f04df0eb9bbfc8a584e58f WatchSource:0}: Error finding container 2e725e7e7ba290d2d8707393a6b92b117ef9d843f8f04df0eb9bbfc8a584e58f: Status 404 returned error can't find the container with id 2e725e7e7ba290d2d8707393a6b92b117ef9d843f8f04df0eb9bbfc8a584e58f
Jul 14 20:00:48.443925 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:00:48.443888    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-9c85946f4-m9b9z" event={"ID":"ec8087c6-5b24-43c6-ba48-167034ba5c5a","Type":"ContainerStarted","Data":"2e725e7e7ba290d2d8707393a6b92b117ef9d843f8f04df0eb9bbfc8a584e58f"}
Jul 14 20:00:50.458133 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:00:50.458091    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-9c85946f4-m9b9z" event={"ID":"ec8087c6-5b24-43c6-ba48-167034ba5c5a","Type":"ContainerStarted","Data":"881defe9109c38840c91c0dbe344f9513312a443f0cf6cef642a70567d23a716"}
Jul 14 20:00:50.458547 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:00:50.458159    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-9c85946f4-m9b9z"
Jul 14 20:00:50.479468 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:00:50.479173    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-9c85946f4-m9b9z" podStartSLOduration=0.839157002 podStartE2EDuration="3.47915186s" totalImagesPullingTime="2.639994858s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 20:00:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 20:00:50.478028728 +0000 UTC m=+550.189624272" watchObservedRunningTime="2026-07-14 20:00:50.47915186 +0000 UTC m=+550.190747405"
Jul 14 20:01:01.464853 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:01:01.464816    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-9c85946f4-m9b9z"
Jul 14 20:01:01.551450 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:01:01.551417    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-9c85946f4-m9b9z"]
Jul 14 20:01:01.551657 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:01:01.551628    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-9c85946f4-m9b9z" podUID="ec8087c6-5b24-43c6-ba48-167034ba5c5a" containerName="manager" containerID="cri-o://881defe9109c38840c91c0dbe344f9513312a443f0cf6cef642a70567d23a716" gracePeriod=30
Jul 14 20:01:01.809230 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:01:01.809204    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-9c85946f4-m9b9z"
Jul 14 20:01:01.904194 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:01:01.904154    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ec8087c6-5b24-43c6-ba48-167034ba5c5a-webhook-cert\") pod \"ec8087c6-5b24-43c6-ba48-167034ba5c5a\" (UID: \"ec8087c6-5b24-43c6-ba48-167034ba5c5a\") "
Jul 14 20:01:01.904369 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:01:01.904224    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-89nfl\" (UniqueName: \"kubernetes.io/projected/ec8087c6-5b24-43c6-ba48-167034ba5c5a-kube-api-access-89nfl\") pod \"ec8087c6-5b24-43c6-ba48-167034ba5c5a\" (UID: \"ec8087c6-5b24-43c6-ba48-167034ba5c5a\") "
Jul 14 20:01:01.906509 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:01:01.906481    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ec8087c6-5b24-43c6-ba48-167034ba5c5a-kube-api-access-89nfl" (OuterVolumeSpecName: "kube-api-access-89nfl") pod "ec8087c6-5b24-43c6-ba48-167034ba5c5a" (UID: "ec8087c6-5b24-43c6-ba48-167034ba5c5a"). InnerVolumeSpecName "kube-api-access-89nfl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 14 20:01:01.906509 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:01:01.906487    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ec8087c6-5b24-43c6-ba48-167034ba5c5a-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "ec8087c6-5b24-43c6-ba48-167034ba5c5a" (UID: "ec8087c6-5b24-43c6-ba48-167034ba5c5a"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 14 20:01:02.005595 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:01:02.005501    2579 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ec8087c6-5b24-43c6-ba48-167034ba5c5a-webhook-cert\") on node \"ip-10-0-140-201.ec2.internal\" DevicePath \"\""
Jul 14 20:01:02.005595 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:01:02.005558    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-89nfl\" (UniqueName: \"kubernetes.io/projected/ec8087c6-5b24-43c6-ba48-167034ba5c5a-kube-api-access-89nfl\") on node \"ip-10-0-140-201.ec2.internal\" DevicePath \"\""
Jul 14 20:01:02.519223 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:01:02.519184    2579 generic.go:356] "Generic (PLEG): container finished" podID="ec8087c6-5b24-43c6-ba48-167034ba5c5a" containerID="881defe9109c38840c91c0dbe344f9513312a443f0cf6cef642a70567d23a716" exitCode=0
Jul 14 20:01:02.519747 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:01:02.519233    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-9c85946f4-m9b9z"
Jul 14 20:01:02.519747 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:01:02.519282    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-9c85946f4-m9b9z" event={"ID":"ec8087c6-5b24-43c6-ba48-167034ba5c5a","Type":"ContainerDied","Data":"881defe9109c38840c91c0dbe344f9513312a443f0cf6cef642a70567d23a716"}
Jul 14 20:01:02.519747 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:01:02.519347    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-9c85946f4-m9b9z" event={"ID":"ec8087c6-5b24-43c6-ba48-167034ba5c5a","Type":"ContainerDied","Data":"2e725e7e7ba290d2d8707393a6b92b117ef9d843f8f04df0eb9bbfc8a584e58f"}
Jul 14 20:01:02.519747 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:01:02.519382    2579 scope.go:117] "RemoveContainer" containerID="881defe9109c38840c91c0dbe344f9513312a443f0cf6cef642a70567d23a716"
Jul 14 20:01:02.529307 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:01:02.529289    2579 scope.go:117] "RemoveContainer" containerID="881defe9109c38840c91c0dbe344f9513312a443f0cf6cef642a70567d23a716"
Jul 14 20:01:02.529684 ip-10-0-140-201 kubenswrapper[2579]: E0714 20:01:02.529665    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"881defe9109c38840c91c0dbe344f9513312a443f0cf6cef642a70567d23a716\": container with ID starting with 881defe9109c38840c91c0dbe344f9513312a443f0cf6cef642a70567d23a716 not found: ID does not exist" containerID="881defe9109c38840c91c0dbe344f9513312a443f0cf6cef642a70567d23a716"
Jul 14 20:01:02.529752 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:01:02.529693    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"881defe9109c38840c91c0dbe344f9513312a443f0cf6cef642a70567d23a716"} err="failed to get container status \"881defe9109c38840c91c0dbe344f9513312a443f0cf6cef642a70567d23a716\": rpc error: code = NotFound desc = could not find container \"881defe9109c38840c91c0dbe344f9513312a443f0cf6cef642a70567d23a716\": container with ID starting with 881defe9109c38840c91c0dbe344f9513312a443f0cf6cef642a70567d23a716 not found: ID does not exist"
Jul 14 20:01:02.543368 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:01:02.543340    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-9c85946f4-m9b9z"]
Jul 14 20:01:02.549562 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:01:02.549099    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-9c85946f4-m9b9z"]
Jul 14 20:01:02.847964 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:01:02.847883    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ec8087c6-5b24-43c6-ba48-167034ba5c5a" path="/var/lib/kubelet/pods/ec8087c6-5b24-43c6-ba48-167034ba5c5a/volumes"
Jul 14 20:01:32.679904 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:01:32.679867    2579 generic.go:356] "Generic (PLEG): container finished" podID="bee8f711-e29d-48a4-ac23-7275e82af001" containerID="6c8fcd3616d8e5028c875a11f13f0b3334eaa6a2c7244742367ee9ca484d45d5" exitCode=0
Jul 14 20:01:32.680337 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:01:32.679940    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-rj6cq" event={"ID":"bee8f711-e29d-48a4-ac23-7275e82af001","Type":"ContainerDied","Data":"6c8fcd3616d8e5028c875a11f13f0b3334eaa6a2c7244742367ee9ca484d45d5"}
Jul 14 20:01:32.680337 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:01:32.680334    2579 scope.go:117] "RemoveContainer" containerID="6c8fcd3616d8e5028c875a11f13f0b3334eaa6a2c7244742367ee9ca484d45d5"
Jul 14 20:01:32.681382 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:01:32.681352    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 14 20:01:32.681484 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:01:32.681434    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 14 20:01:32.681563 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:01:32.681485    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 14 20:01:33.686882 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:01:33.686850    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-rj6cq" event={"ID":"bee8f711-e29d-48a4-ac23-7275e82af001","Type":"ContainerStarted","Data":"3275ccd3afb3bbcfb314339ad284e6b93c94556f72a8032aa6927cb6dab5a18d"}
Jul 14 20:01:33.808787 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:01:33.808745    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-rj6cq"
Jul 14 20:01:33.809025 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:01:33.809003    2579 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-rj6cq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.38:15021/healthz/ready\": dial tcp 10.133.0.38:15021: connect: connection refused" start-of-body=
Jul 14 20:01:33.809072 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:01:33.809051    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-rj6cq" podUID="bee8f711-e29d-48a4-ac23-7275e82af001" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.38:15021/healthz/ready\": dial tcp 10.133.0.38:15021: connect: connection refused"
Jul 14 20:01:34.810727 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:01:34.810692    2579 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-rj6cq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.38:15021/healthz/ready\": dial tcp 10.133.0.38:15021: connect: connection refused" start-of-body=
Jul 14 20:01:34.811118 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:01:34.810744    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-rj6cq" podUID="bee8f711-e29d-48a4-ac23-7275e82af001" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.38:15021/healthz/ready\": dial tcp 10.133.0.38:15021: connect: connection refused"
Jul 14 20:01:35.808400 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:01:35.808353    2579 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-rj6cq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.38:15021/healthz/ready\": dial tcp 10.133.0.38:15021: connect: connection refused" start-of-body=
Jul 14 20:01:35.808646 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:01:35.808457    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-rj6cq" podUID="bee8f711-e29d-48a4-ac23-7275e82af001" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.38:15021/healthz/ready\": dial tcp 10.133.0.38:15021: connect: connection refused"
Jul 14 20:01:36.808335 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:01:36.808293    2579 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-rj6cq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.38:15021/healthz/ready\": dial tcp 10.133.0.38:15021: connect: connection refused" start-of-body=
Jul 14 20:01:36.808762 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:01:36.808357    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-rj6cq" podUID="bee8f711-e29d-48a4-ac23-7275e82af001" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.38:15021/healthz/ready\": dial tcp 10.133.0.38:15021: connect: connection refused"
Jul 14 20:01:37.809109 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:01:37.809069    2579 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-rj6cq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.38:15021/healthz/ready\": dial tcp 10.133.0.38:15021: connect: connection refused" start-of-body=
Jul 14 20:01:37.809490 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:01:37.809131    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-rj6cq" podUID="bee8f711-e29d-48a4-ac23-7275e82af001" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.38:15021/healthz/ready\": dial tcp 10.133.0.38:15021: connect: connection refused"
Jul 14 20:01:38.808608 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:01:38.808567    2579 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-rj6cq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.38:15021/healthz/ready\": dial tcp 10.133.0.38:15021: connect: connection refused" start-of-body=
Jul 14 20:01:38.808802 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:01:38.808627    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-rj6cq" podUID="bee8f711-e29d-48a4-ac23-7275e82af001" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.38:15021/healthz/ready\": dial tcp 10.133.0.38:15021: connect: connection refused"
Jul 14 20:01:39.162122 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:01:39.162032    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-rj6cq"
Jul 14 20:01:39.812226 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:01:39.812192    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-rj6cq"
Jul 14 20:01:39.813190 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:01:39.813174    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-rj6cq"
Jul 14 20:01:40.765967 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:01:40.765940    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-q4xzw_ef54193c-7659-4e47-87ac-4d129d22a268/ovn-acl-logging/0.log"
Jul 14 20:01:40.773389 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:01:40.773357    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-q4xzw_ef54193c-7659-4e47-87ac-4d129d22a268/ovn-acl-logging/0.log"
Jul 14 20:02:27.797860 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:02:27.797822    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbrvmqx"]
Jul 14 20:02:27.798304 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:02:27.798188    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ec8087c6-5b24-43c6-ba48-167034ba5c5a" containerName="manager"
Jul 14 20:02:27.798304 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:02:27.798201    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="ec8087c6-5b24-43c6-ba48-167034ba5c5a" containerName="manager"
Jul 14 20:02:27.798304 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:02:27.798284    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="ec8087c6-5b24-43c6-ba48-167034ba5c5a" containerName="manager"
Jul 14 20:02:27.801446 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:02:27.801427    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbrvmqx"
Jul 14 20:02:27.804200 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:02:27.804177    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-ccq98\""
Jul 14 20:02:27.805261 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:02:27.805244    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Jul 14 20:02:27.805370 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:02:27.805244    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\""
Jul 14 20:02:27.807855 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:02:27.807838    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Jul 14 20:02:27.813988 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:02:27.813962    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbrvmqx"]
Jul 14 20:02:27.876134 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:02:27.876090    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zpl9f\" (UniqueName: \"kubernetes.io/projected/71c4680a-f271-48cd-9dcb-b4b069b5909b-kube-api-access-zpl9f\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbrvmqx\" (UID: \"71c4680a-f271-48cd-9dcb-b4b069b5909b\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbrvmqx"
Jul 14 20:02:27.876306 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:02:27.876207    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/71c4680a-f271-48cd-9dcb-b4b069b5909b-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbrvmqx\" (UID: \"71c4680a-f271-48cd-9dcb-b4b069b5909b\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbrvmqx"
Jul 14 20:02:27.876306 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:02:27.876259    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/71c4680a-f271-48cd-9dcb-b4b069b5909b-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbrvmqx\" (UID: \"71c4680a-f271-48cd-9dcb-b4b069b5909b\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbrvmqx"
Jul 14 20:02:27.876306 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:02:27.876287    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/71c4680a-f271-48cd-9dcb-b4b069b5909b-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbrvmqx\" (UID: \"71c4680a-f271-48cd-9dcb-b4b069b5909b\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbrvmqx"
Jul 14 20:02:27.876416 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:02:27.876321    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/71c4680a-f271-48cd-9dcb-b4b069b5909b-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbrvmqx\" (UID: \"71c4680a-f271-48cd-9dcb-b4b069b5909b\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbrvmqx"
Jul 14 20:02:27.876416 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:02:27.876370    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/71c4680a-f271-48cd-9dcb-b4b069b5909b-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbrvmqx\" (UID: \"71c4680a-f271-48cd-9dcb-b4b069b5909b\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbrvmqx"
Jul 14 20:02:27.977723 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:02:27.977675    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zpl9f\" (UniqueName: \"kubernetes.io/projected/71c4680a-f271-48cd-9dcb-b4b069b5909b-kube-api-access-zpl9f\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbrvmqx\" (UID: \"71c4680a-f271-48cd-9dcb-b4b069b5909b\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbrvmqx"
Jul 14 20:02:27.977933 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:02:27.977766    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/71c4680a-f271-48cd-9dcb-b4b069b5909b-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbrvmqx\" (UID: \"71c4680a-f271-48cd-9dcb-b4b069b5909b\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbrvmqx"
Jul 14 20:02:27.977933 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:02:27.977795    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/71c4680a-f271-48cd-9dcb-b4b069b5909b-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbrvmqx\" (UID: \"71c4680a-f271-48cd-9dcb-b4b069b5909b\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbrvmqx"
Jul 14 20:02:27.977933 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:02:27.977820    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/71c4680a-f271-48cd-9dcb-b4b069b5909b-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbrvmqx\" (UID: \"71c4680a-f271-48cd-9dcb-b4b069b5909b\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbrvmqx"
Jul 14 20:02:27.977933 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:02:27.977852    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/71c4680a-f271-48cd-9dcb-b4b069b5909b-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbrvmqx\" (UID: \"71c4680a-f271-48cd-9dcb-b4b069b5909b\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbrvmqx"
Jul 14 20:02:27.977933 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:02:27.977882    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/71c4680a-f271-48cd-9dcb-b4b069b5909b-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbrvmqx\" (UID: \"71c4680a-f271-48cd-9dcb-b4b069b5909b\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbrvmqx"
Jul 14 20:02:27.978365 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:02:27.978343    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/71c4680a-f271-48cd-9dcb-b4b069b5909b-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbrvmqx\" (UID: \"71c4680a-f271-48cd-9dcb-b4b069b5909b\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbrvmqx"
Jul 14 20:02:27.978428 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:02:27.978376    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/71c4680a-f271-48cd-9dcb-b4b069b5909b-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbrvmqx\" (UID: \"71c4680a-f271-48cd-9dcb-b4b069b5909b\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbrvmqx"
Jul 14 20:02:27.978428 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:02:27.978412    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/71c4680a-f271-48cd-9dcb-b4b069b5909b-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbrvmqx\" (UID: \"71c4680a-f271-48cd-9dcb-b4b069b5909b\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbrvmqx"
Jul 14 20:02:27.980395 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:02:27.980368    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/71c4680a-f271-48cd-9dcb-b4b069b5909b-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbrvmqx\" (UID: \"71c4680a-f271-48cd-9dcb-b4b069b5909b\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbrvmqx"
Jul 14 20:02:27.980613 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:02:27.980596    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/71c4680a-f271-48cd-9dcb-b4b069b5909b-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbrvmqx\" (UID: \"71c4680a-f271-48cd-9dcb-b4b069b5909b\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbrvmqx"
Jul 14 20:02:27.986579 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:02:27.986551    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zpl9f\" (UniqueName: \"kubernetes.io/projected/71c4680a-f271-48cd-9dcb-b4b069b5909b-kube-api-access-zpl9f\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbrvmqx\" (UID: \"71c4680a-f271-48cd-9dcb-b4b069b5909b\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbrvmqx"
Jul 14 20:02:28.111709 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:02:28.111596    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbrvmqx"
Jul 14 20:02:28.255161 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:02:28.255134    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbrvmqx"]
Jul 14 20:02:28.256900 ip-10-0-140-201 kubenswrapper[2579]: W0714 20:02:28.256873    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod71c4680a_f271_48cd_9dcb_b4b069b5909b.slice/crio-d50e2fd63bcc8f67bfbd598a866de96dc47be8aa54892db6eba9b03be9cd8adc WatchSource:0}: Error finding container d50e2fd63bcc8f67bfbd598a866de96dc47be8aa54892db6eba9b03be9cd8adc: Status 404 returned error can't find the container with id d50e2fd63bcc8f67bfbd598a866de96dc47be8aa54892db6eba9b03be9cd8adc
Jul 14 20:02:28.258185 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:02:28.258166    2579 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 14 20:02:28.981454 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:02:28.981414    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbrvmqx" event={"ID":"71c4680a-f271-48cd-9dcb-b4b069b5909b","Type":"ContainerStarted","Data":"d50e2fd63bcc8f67bfbd598a866de96dc47be8aa54892db6eba9b03be9cd8adc"}
Jul 14 20:02:29.988028 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:02:29.987993    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbrvmqx" event={"ID":"71c4680a-f271-48cd-9dcb-b4b069b5909b","Type":"ContainerStarted","Data":"94272f53bde9f0b784e71308be5e74393eaca175f00bab63b5678ed1fc405d55"}
Jul 14 20:02:30.007830 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:02:30.007778    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbrvmqx" podStartSLOduration=1.981918437 podStartE2EDuration="3.007761608s" totalImagesPullingTime="1.025843171s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 20:02:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 20:02:30.005669442 +0000 UTC m=+649.717264999" watchObservedRunningTime="2026-07-14 20:02:30.007761608 +0000 UTC m=+649.719357152"
Jul 14 20:02:38.112493 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:02:38.112450    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbrvmqx"
Jul 14 20:02:38.113035 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:02:38.112555    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbrvmqx"
Jul 14 20:02:38.125611 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:02:38.125582    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbrvmqx"
Jul 14 20:02:39.046840 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:02:39.046808    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbrvmqx"
Jul 14 20:05:22.675349 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:05:22.675266    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-696d845876-425n4"]
Jul 14 20:05:22.678667 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:05:22.678647    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-696d845876-425n4"
Jul 14 20:05:22.682802 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:05:22.682772    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-p4clj\""
Jul 14 20:05:22.682802 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:05:22.682794    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Jul 14 20:05:22.682996 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:05:22.682857    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Jul 14 20:05:22.694707 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:05:22.694566    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-696d845876-425n4"]
Jul 14 20:05:22.710093 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:05:22.710058    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/5391ab3c-7ea8-49cc-8ad4-74eda106fe53-webhook-cert\") pod \"maas-controller-696d845876-425n4\" (UID: \"5391ab3c-7ea8-49cc-8ad4-74eda106fe53\") " pod="opendatahub/maas-controller-696d845876-425n4"
Jul 14 20:05:22.710234 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:05:22.710112    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-klw2w\" (UniqueName: \"kubernetes.io/projected/5391ab3c-7ea8-49cc-8ad4-74eda106fe53-kube-api-access-klw2w\") pod \"maas-controller-696d845876-425n4\" (UID: \"5391ab3c-7ea8-49cc-8ad4-74eda106fe53\") " pod="opendatahub/maas-controller-696d845876-425n4"
Jul 14 20:05:22.810933 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:05:22.810878    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-klw2w\" (UniqueName: \"kubernetes.io/projected/5391ab3c-7ea8-49cc-8ad4-74eda106fe53-kube-api-access-klw2w\") pod \"maas-controller-696d845876-425n4\" (UID: \"5391ab3c-7ea8-49cc-8ad4-74eda106fe53\") " pod="opendatahub/maas-controller-696d845876-425n4"
Jul 14 20:05:22.811119 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:05:22.810990    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/5391ab3c-7ea8-49cc-8ad4-74eda106fe53-webhook-cert\") pod \"maas-controller-696d845876-425n4\" (UID: \"5391ab3c-7ea8-49cc-8ad4-74eda106fe53\") " pod="opendatahub/maas-controller-696d845876-425n4"
Jul 14 20:05:22.813646 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:05:22.813616    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/5391ab3c-7ea8-49cc-8ad4-74eda106fe53-webhook-cert\") pod \"maas-controller-696d845876-425n4\" (UID: \"5391ab3c-7ea8-49cc-8ad4-74eda106fe53\") " pod="opendatahub/maas-controller-696d845876-425n4"
Jul 14 20:05:22.821556 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:05:22.821502    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-klw2w\" (UniqueName: \"kubernetes.io/projected/5391ab3c-7ea8-49cc-8ad4-74eda106fe53-kube-api-access-klw2w\") pod \"maas-controller-696d845876-425n4\" (UID: \"5391ab3c-7ea8-49cc-8ad4-74eda106fe53\") " pod="opendatahub/maas-controller-696d845876-425n4"
Jul 14 20:05:22.988520 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:05:22.988484    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-696d845876-425n4"
Jul 14 20:05:23.147033 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:05:23.147003    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-696d845876-425n4"]
Jul 14 20:05:23.147976 ip-10-0-140-201 kubenswrapper[2579]: W0714 20:05:23.147944    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5391ab3c_7ea8_49cc_8ad4_74eda106fe53.slice/crio-fe508dd4e8f368d5597bdb2a27c04d55b3f132910385f977ae8df67ba14f0d97 WatchSource:0}: Error finding container fe508dd4e8f368d5597bdb2a27c04d55b3f132910385f977ae8df67ba14f0d97: Status 404 returned error can't find the container with id fe508dd4e8f368d5597bdb2a27c04d55b3f132910385f977ae8df67ba14f0d97
Jul 14 20:05:23.890718 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:05:23.890618    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-696d845876-425n4" event={"ID":"5391ab3c-7ea8-49cc-8ad4-74eda106fe53","Type":"ContainerStarted","Data":"c98517ea4a3ef1ea6ca99e88cc5661a56d9a948f65b8bd0c3a50ed3017c63514"}
Jul 14 20:05:23.890718 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:05:23.890671    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-696d845876-425n4" event={"ID":"5391ab3c-7ea8-49cc-8ad4-74eda106fe53","Type":"ContainerStarted","Data":"fe508dd4e8f368d5597bdb2a27c04d55b3f132910385f977ae8df67ba14f0d97"}
Jul 14 20:05:23.891183 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:05:23.890827    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-696d845876-425n4"
Jul 14 20:05:23.912310 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:05:23.912256    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-696d845876-425n4" podStartSLOduration=1.497828508 podStartE2EDuration="1.912237997s" totalImagesPullingTime="414.409489ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 20:05:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 20:05:23.910663725 +0000 UTC m=+823.622259282" watchObservedRunningTime="2026-07-14 20:05:23.912237997 +0000 UTC m=+823.623833541"
Jul 14 20:05:34.898151 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:05:34.898113    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-696d845876-425n4"
Jul 14 20:06:40.806338 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:06:40.806300    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-q4xzw_ef54193c-7659-4e47-87ac-4d129d22a268/ovn-acl-logging/0.log"
Jul 14 20:06:40.809023 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:06:40.809008    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-q4xzw_ef54193c-7659-4e47-87ac-4d129d22a268/ovn-acl-logging/0.log"
Jul 14 20:09:53.547602 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:09:53.547567    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-647c64497-dxlph"]
Jul 14 20:09:53.550589 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:09:53.550562    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-647c64497-dxlph"
Jul 14 20:09:53.581725 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:09:53.581698    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-647c64497-dxlph"]
Jul 14 20:09:53.630431 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:09:53.630390    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5b2d5cd4-32a6-4787-888b-39d8df66822e-oauth-serving-cert\") pod \"console-647c64497-dxlph\" (UID: \"5b2d5cd4-32a6-4787-888b-39d8df66822e\") " pod="openshift-console/console-647c64497-dxlph"
Jul 14 20:09:53.630431 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:09:53.630439    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5b2d5cd4-32a6-4787-888b-39d8df66822e-trusted-ca-bundle\") pod \"console-647c64497-dxlph\" (UID: \"5b2d5cd4-32a6-4787-888b-39d8df66822e\") " pod="openshift-console/console-647c64497-dxlph"
Jul 14 20:09:53.630728 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:09:53.630468    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dsf2n\" (UniqueName: \"kubernetes.io/projected/5b2d5cd4-32a6-4787-888b-39d8df66822e-kube-api-access-dsf2n\") pod \"console-647c64497-dxlph\" (UID: \"5b2d5cd4-32a6-4787-888b-39d8df66822e\") " pod="openshift-console/console-647c64497-dxlph"
Jul 14 20:09:53.630728 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:09:53.630626    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5b2d5cd4-32a6-4787-888b-39d8df66822e-console-config\") pod \"console-647c64497-dxlph\" (UID: \"5b2d5cd4-32a6-4787-888b-39d8df66822e\") " pod="openshift-console/console-647c64497-dxlph"
Jul 14 20:09:53.630728 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:09:53.630664    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5b2d5cd4-32a6-4787-888b-39d8df66822e-console-serving-cert\") pod \"console-647c64497-dxlph\" (UID: \"5b2d5cd4-32a6-4787-888b-39d8df66822e\") " pod="openshift-console/console-647c64497-dxlph"
Jul 14 20:09:53.630728 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:09:53.630689    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5b2d5cd4-32a6-4787-888b-39d8df66822e-service-ca\") pod \"console-647c64497-dxlph\" (UID: \"5b2d5cd4-32a6-4787-888b-39d8df66822e\") " pod="openshift-console/console-647c64497-dxlph"
Jul 14 20:09:53.630728 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:09:53.630724    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5b2d5cd4-32a6-4787-888b-39d8df66822e-console-oauth-config\") pod \"console-647c64497-dxlph\" (UID: \"5b2d5cd4-32a6-4787-888b-39d8df66822e\") " pod="openshift-console/console-647c64497-dxlph"
Jul 14 20:09:53.731495 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:09:53.731441    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5b2d5cd4-32a6-4787-888b-39d8df66822e-console-config\") pod \"console-647c64497-dxlph\" (UID: \"5b2d5cd4-32a6-4787-888b-39d8df66822e\") " pod="openshift-console/console-647c64497-dxlph"
Jul 14 20:09:53.731495 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:09:53.731500    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5b2d5cd4-32a6-4787-888b-39d8df66822e-console-serving-cert\") pod \"console-647c64497-dxlph\" (UID: \"5b2d5cd4-32a6-4787-888b-39d8df66822e\") " pod="openshift-console/console-647c64497-dxlph"
Jul 14 20:09:53.731779 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:09:53.731613    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5b2d5cd4-32a6-4787-888b-39d8df66822e-service-ca\") pod \"console-647c64497-dxlph\" (UID: \"5b2d5cd4-32a6-4787-888b-39d8df66822e\") " pod="openshift-console/console-647c64497-dxlph"
Jul 14 20:09:53.731779 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:09:53.731653    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5b2d5cd4-32a6-4787-888b-39d8df66822e-console-oauth-config\") pod \"console-647c64497-dxlph\" (UID: \"5b2d5cd4-32a6-4787-888b-39d8df66822e\") " pod="openshift-console/console-647c64497-dxlph"
Jul 14 20:09:53.731779 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:09:53.731700    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5b2d5cd4-32a6-4787-888b-39d8df66822e-oauth-serving-cert\") pod \"console-647c64497-dxlph\" (UID: \"5b2d5cd4-32a6-4787-888b-39d8df66822e\") " pod="openshift-console/console-647c64497-dxlph"
Jul 14 20:09:53.731779 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:09:53.731720    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5b2d5cd4-32a6-4787-888b-39d8df66822e-trusted-ca-bundle\") pod \"console-647c64497-dxlph\" (UID: \"5b2d5cd4-32a6-4787-888b-39d8df66822e\") " pod="openshift-console/console-647c64497-dxlph"
Jul 14 20:09:53.731779 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:09:53.731753    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dsf2n\" (UniqueName: \"kubernetes.io/projected/5b2d5cd4-32a6-4787-888b-39d8df66822e-kube-api-access-dsf2n\") pod \"console-647c64497-dxlph\" (UID: \"5b2d5cd4-32a6-4787-888b-39d8df66822e\") " pod="openshift-console/console-647c64497-dxlph"
Jul 14 20:09:53.732330 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:09:53.732296    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5b2d5cd4-32a6-4787-888b-39d8df66822e-service-ca\") pod \"console-647c64497-dxlph\" (UID: \"5b2d5cd4-32a6-4787-888b-39d8df66822e\") " pod="openshift-console/console-647c64497-dxlph"
Jul 14 20:09:53.732464 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:09:53.732296    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5b2d5cd4-32a6-4787-888b-39d8df66822e-console-config\") pod \"console-647c64497-dxlph\" (UID: \"5b2d5cd4-32a6-4787-888b-39d8df66822e\") " pod="openshift-console/console-647c64497-dxlph"
Jul 14 20:09:53.732464 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:09:53.732363    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5b2d5cd4-32a6-4787-888b-39d8df66822e-oauth-serving-cert\") pod \"console-647c64497-dxlph\" (UID: \"5b2d5cd4-32a6-4787-888b-39d8df66822e\") " pod="openshift-console/console-647c64497-dxlph"
Jul 14 20:09:53.732791 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:09:53.732770    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5b2d5cd4-32a6-4787-888b-39d8df66822e-trusted-ca-bundle\") pod \"console-647c64497-dxlph\" (UID: \"5b2d5cd4-32a6-4787-888b-39d8df66822e\") " pod="openshift-console/console-647c64497-dxlph"
Jul 14 20:09:53.734772 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:09:53.734746    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5b2d5cd4-32a6-4787-888b-39d8df66822e-console-oauth-config\") pod \"console-647c64497-dxlph\" (UID: \"5b2d5cd4-32a6-4787-888b-39d8df66822e\") " pod="openshift-console/console-647c64497-dxlph"
Jul 14 20:09:53.734878 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:09:53.734821    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5b2d5cd4-32a6-4787-888b-39d8df66822e-console-serving-cert\") pod \"console-647c64497-dxlph\" (UID: \"5b2d5cd4-32a6-4787-888b-39d8df66822e\") " pod="openshift-console/console-647c64497-dxlph"
Jul 14 20:09:53.742106 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:09:53.742083    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dsf2n\" (UniqueName: \"kubernetes.io/projected/5b2d5cd4-32a6-4787-888b-39d8df66822e-kube-api-access-dsf2n\") pod \"console-647c64497-dxlph\" (UID: \"5b2d5cd4-32a6-4787-888b-39d8df66822e\") " pod="openshift-console/console-647c64497-dxlph"
Jul 14 20:09:53.859894 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:09:53.859797    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-647c64497-dxlph"
Jul 14 20:09:54.004184 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:09:54.004152    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-647c64497-dxlph"]
Jul 14 20:09:54.005266 ip-10-0-140-201 kubenswrapper[2579]: W0714 20:09:54.005233    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5b2d5cd4_32a6_4787_888b_39d8df66822e.slice/crio-95e4ead255de823cb9800c5586f8c61b1578ce3a3e859856ceb0fad31647561c WatchSource:0}: Error finding container 95e4ead255de823cb9800c5586f8c61b1578ce3a3e859856ceb0fad31647561c: Status 404 returned error can't find the container with id 95e4ead255de823cb9800c5586f8c61b1578ce3a3e859856ceb0fad31647561c
Jul 14 20:09:54.324883 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:09:54.324842    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-647c64497-dxlph" event={"ID":"5b2d5cd4-32a6-4787-888b-39d8df66822e","Type":"ContainerStarted","Data":"728dc363983c145a684277e967c4d4e6316b519e979cb59f45b15ed568da7b37"}
Jul 14 20:09:54.325062 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:09:54.324894    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-647c64497-dxlph" event={"ID":"5b2d5cd4-32a6-4787-888b-39d8df66822e","Type":"ContainerStarted","Data":"95e4ead255de823cb9800c5586f8c61b1578ce3a3e859856ceb0fad31647561c"}
Jul 14 20:09:54.348700 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:09:54.348653    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-647c64497-dxlph" podStartSLOduration=1.348635869 podStartE2EDuration="1.348635869s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 20:09:53 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 20:09:54.34581155 +0000 UTC m=+1094.057407128" watchObservedRunningTime="2026-07-14 20:09:54.348635869 +0000 UTC m=+1094.060231414"
Jul 14 20:10:03.860003 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:10:03.859966    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-647c64497-dxlph"
Jul 14 20:10:03.860433 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:10:03.860237    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-647c64497-dxlph"
Jul 14 20:10:03.864701 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:10:03.864680    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-647c64497-dxlph"
Jul 14 20:10:04.394091 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:10:04.394060    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-647c64497-dxlph"
Jul 14 20:10:04.490499 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:10:04.490467    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-57657645cd-ftk5j"]
Jul 14 20:10:29.512661 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:10:29.512612    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-57657645cd-ftk5j" podUID="16395ab3-5219-4209-9dfb-701ea71c37e0" containerName="console" containerID="cri-o://4d9630949f45a61b8ad736c0010d2b99a2362dc14c490d27ae9f3acc19982286" gracePeriod=15
Jul 14 20:10:29.761237 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:10:29.761212    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-57657645cd-ftk5j"
Jul 14 20:10:29.857296 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:10:29.857212    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/16395ab3-5219-4209-9dfb-701ea71c37e0-console-config\") pod \"16395ab3-5219-4209-9dfb-701ea71c37e0\" (UID: \"16395ab3-5219-4209-9dfb-701ea71c37e0\") "
Jul 14 20:10:29.857296 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:10:29.857269    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/16395ab3-5219-4209-9dfb-701ea71c37e0-oauth-serving-cert\") pod \"16395ab3-5219-4209-9dfb-701ea71c37e0\" (UID: \"16395ab3-5219-4209-9dfb-701ea71c37e0\") "
Jul 14 20:10:29.857296 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:10:29.857296    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/16395ab3-5219-4209-9dfb-701ea71c37e0-console-oauth-config\") pod \"16395ab3-5219-4209-9dfb-701ea71c37e0\" (UID: \"16395ab3-5219-4209-9dfb-701ea71c37e0\") "
Jul 14 20:10:29.857570 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:10:29.857314    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/16395ab3-5219-4209-9dfb-701ea71c37e0-service-ca\") pod \"16395ab3-5219-4209-9dfb-701ea71c37e0\" (UID: \"16395ab3-5219-4209-9dfb-701ea71c37e0\") "
Jul 14 20:10:29.857570 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:10:29.857335    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-82f6q\" (UniqueName: \"kubernetes.io/projected/16395ab3-5219-4209-9dfb-701ea71c37e0-kube-api-access-82f6q\") pod \"16395ab3-5219-4209-9dfb-701ea71c37e0\" (UID: \"16395ab3-5219-4209-9dfb-701ea71c37e0\") "
Jul 14 20:10:29.857570 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:10:29.857372    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/16395ab3-5219-4209-9dfb-701ea71c37e0-console-serving-cert\") pod \"16395ab3-5219-4209-9dfb-701ea71c37e0\" (UID: \"16395ab3-5219-4209-9dfb-701ea71c37e0\") "
Jul 14 20:10:29.857570 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:10:29.857412    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/16395ab3-5219-4209-9dfb-701ea71c37e0-trusted-ca-bundle\") pod \"16395ab3-5219-4209-9dfb-701ea71c37e0\" (UID: \"16395ab3-5219-4209-9dfb-701ea71c37e0\") "
Jul 14 20:10:29.857785 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:10:29.857704    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/16395ab3-5219-4209-9dfb-701ea71c37e0-console-config" (OuterVolumeSpecName: "console-config") pod "16395ab3-5219-4209-9dfb-701ea71c37e0" (UID: "16395ab3-5219-4209-9dfb-701ea71c37e0"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 14 20:10:29.857785 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:10:29.857747    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/16395ab3-5219-4209-9dfb-701ea71c37e0-service-ca" (OuterVolumeSpecName: "service-ca") pod "16395ab3-5219-4209-9dfb-701ea71c37e0" (UID: "16395ab3-5219-4209-9dfb-701ea71c37e0"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 14 20:10:29.857878 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:10:29.857808    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/16395ab3-5219-4209-9dfb-701ea71c37e0-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "16395ab3-5219-4209-9dfb-701ea71c37e0" (UID: "16395ab3-5219-4209-9dfb-701ea71c37e0"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 14 20:10:29.858030 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:10:29.858009    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/16395ab3-5219-4209-9dfb-701ea71c37e0-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "16395ab3-5219-4209-9dfb-701ea71c37e0" (UID: "16395ab3-5219-4209-9dfb-701ea71c37e0"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 14 20:10:29.859662 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:10:29.859633    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/16395ab3-5219-4209-9dfb-701ea71c37e0-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "16395ab3-5219-4209-9dfb-701ea71c37e0" (UID: "16395ab3-5219-4209-9dfb-701ea71c37e0"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 14 20:10:29.859752 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:10:29.859679    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/16395ab3-5219-4209-9dfb-701ea71c37e0-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "16395ab3-5219-4209-9dfb-701ea71c37e0" (UID: "16395ab3-5219-4209-9dfb-701ea71c37e0"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 14 20:10:29.859752 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:10:29.859721    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/16395ab3-5219-4209-9dfb-701ea71c37e0-kube-api-access-82f6q" (OuterVolumeSpecName: "kube-api-access-82f6q") pod "16395ab3-5219-4209-9dfb-701ea71c37e0" (UID: "16395ab3-5219-4209-9dfb-701ea71c37e0"). InnerVolumeSpecName "kube-api-access-82f6q". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 14 20:10:29.958114 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:10:29.958080    2579 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/16395ab3-5219-4209-9dfb-701ea71c37e0-console-config\") on node \"ip-10-0-140-201.ec2.internal\" DevicePath \"\""
Jul 14 20:10:29.958114 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:10:29.958111    2579 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/16395ab3-5219-4209-9dfb-701ea71c37e0-oauth-serving-cert\") on node \"ip-10-0-140-201.ec2.internal\" DevicePath \"\""
Jul 14 20:10:29.958114 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:10:29.958121    2579 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/16395ab3-5219-4209-9dfb-701ea71c37e0-console-oauth-config\") on node \"ip-10-0-140-201.ec2.internal\" DevicePath \"\""
Jul 14 20:10:29.958331 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:10:29.958130    2579 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/16395ab3-5219-4209-9dfb-701ea71c37e0-service-ca\") on node \"ip-10-0-140-201.ec2.internal\" DevicePath \"\""
Jul 14 20:10:29.958331 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:10:29.958140    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-82f6q\" (UniqueName: \"kubernetes.io/projected/16395ab3-5219-4209-9dfb-701ea71c37e0-kube-api-access-82f6q\") on node \"ip-10-0-140-201.ec2.internal\" DevicePath \"\""
Jul 14 20:10:29.958331 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:10:29.958149    2579 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/16395ab3-5219-4209-9dfb-701ea71c37e0-console-serving-cert\") on node \"ip-10-0-140-201.ec2.internal\" DevicePath \"\""
Jul 14 20:10:29.958331 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:10:29.958157    2579 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/16395ab3-5219-4209-9dfb-701ea71c37e0-trusted-ca-bundle\") on node \"ip-10-0-140-201.ec2.internal\" DevicePath \"\""
Jul 14 20:10:30.535395 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:10:30.535360    2579 generic.go:356] "Generic (PLEG): container finished" podID="16395ab3-5219-4209-9dfb-701ea71c37e0" containerID="4d9630949f45a61b8ad736c0010d2b99a2362dc14c490d27ae9f3acc19982286" exitCode=0
Jul 14 20:10:30.535904 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:10:30.535422    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-57657645cd-ftk5j"
Jul 14 20:10:30.535904 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:10:30.535457    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-57657645cd-ftk5j" event={"ID":"16395ab3-5219-4209-9dfb-701ea71c37e0","Type":"ContainerDied","Data":"4d9630949f45a61b8ad736c0010d2b99a2362dc14c490d27ae9f3acc19982286"}
Jul 14 20:10:30.535904 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:10:30.535557    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-57657645cd-ftk5j" event={"ID":"16395ab3-5219-4209-9dfb-701ea71c37e0","Type":"ContainerDied","Data":"819306d97712b4b4b53f564e074fe1bfac74070901c213d88e65b75be2e052e5"}
Jul 14 20:10:30.535904 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:10:30.535592    2579 scope.go:117] "RemoveContainer" containerID="4d9630949f45a61b8ad736c0010d2b99a2362dc14c490d27ae9f3acc19982286"
Jul 14 20:10:30.545631 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:10:30.545611    2579 scope.go:117] "RemoveContainer" containerID="4d9630949f45a61b8ad736c0010d2b99a2362dc14c490d27ae9f3acc19982286"
Jul 14 20:10:30.545880 ip-10-0-140-201 kubenswrapper[2579]: E0714 20:10:30.545862    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4d9630949f45a61b8ad736c0010d2b99a2362dc14c490d27ae9f3acc19982286\": container with ID starting with 4d9630949f45a61b8ad736c0010d2b99a2362dc14c490d27ae9f3acc19982286 not found: ID does not exist" containerID="4d9630949f45a61b8ad736c0010d2b99a2362dc14c490d27ae9f3acc19982286"
Jul 14 20:10:30.545931 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:10:30.545889    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4d9630949f45a61b8ad736c0010d2b99a2362dc14c490d27ae9f3acc19982286"} err="failed to get container status \"4d9630949f45a61b8ad736c0010d2b99a2362dc14c490d27ae9f3acc19982286\": rpc error: code = NotFound desc = could not find container \"4d9630949f45a61b8ad736c0010d2b99a2362dc14c490d27ae9f3acc19982286\": container with ID starting with 4d9630949f45a61b8ad736c0010d2b99a2362dc14c490d27ae9f3acc19982286 not found: ID does not exist"
Jul 14 20:10:30.558035 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:10:30.558010    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-57657645cd-ftk5j"]
Jul 14 20:10:30.562289 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:10:30.562271    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-57657645cd-ftk5j"]
Jul 14 20:10:30.849138 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:10:30.849057    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="16395ab3-5219-4209-9dfb-701ea71c37e0" path="/var/lib/kubelet/pods/16395ab3-5219-4209-9dfb-701ea71c37e0/volumes"
Jul 14 20:11:40.840401 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:11:40.840293    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-q4xzw_ef54193c-7659-4e47-87ac-4d129d22a268/ovn-acl-logging/0.log"
Jul 14 20:11:40.844654 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:11:40.844627    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-q4xzw_ef54193c-7659-4e47-87ac-4d129d22a268/ovn-acl-logging/0.log"
Jul 14 20:15:00.141577 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:15:00.141540    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29734335-k8kms"]
Jul 14 20:15:00.142067 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:15:00.141888    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="16395ab3-5219-4209-9dfb-701ea71c37e0" containerName="console"
Jul 14 20:15:00.142067 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:15:00.141898    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="16395ab3-5219-4209-9dfb-701ea71c37e0" containerName="console"
Jul 14 20:15:00.142067 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:15:00.141966    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="16395ab3-5219-4209-9dfb-701ea71c37e0" containerName="console"
Jul 14 20:15:00.145012 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:15:00.144994    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29734335-k8kms"
Jul 14 20:15:00.147475 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:15:00.147455    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-4blwh\""
Jul 14 20:15:00.154543 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:15:00.154514    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29734335-k8kms"
Jul 14 20:15:00.161040 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:15:00.161019    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29734335-k8kms"]
Jul 14 20:15:00.293466 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:15:00.293440    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29734335-k8kms"]
Jul 14 20:15:00.294881 ip-10-0-140-201 kubenswrapper[2579]: W0714 20:15:00.294852    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5b37711e_54f6_4012_acfc_c9858cad9eaa.slice/crio-882ac4c9f61c9577247222d127d4d9a112df32cd6201e0b1578c92a3ffbf5fa8 WatchSource:0}: Error finding container 882ac4c9f61c9577247222d127d4d9a112df32cd6201e0b1578c92a3ffbf5fa8: Status 404 returned error can't find the container with id 882ac4c9f61c9577247222d127d4d9a112df32cd6201e0b1578c92a3ffbf5fa8
Jul 14 20:15:00.296923 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:15:00.296902    2579 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 14 20:15:00.953935 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:15:00.953897    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29734335-k8kms" event={"ID":"5b37711e-54f6-4012-acfc-c9858cad9eaa","Type":"ContainerStarted","Data":"882ac4c9f61c9577247222d127d4d9a112df32cd6201e0b1578c92a3ffbf5fa8"}
Jul 14 20:15:02.969931 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:15:02.969893    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29734335-k8kms" event={"ID":"5b37711e-54f6-4012-acfc-c9858cad9eaa","Type":"ContainerStarted","Data":"ee0f7935cd709613f05743cf87f01019655d1e0492ac3cd343029c2bcfaa6eff"}
Jul 14 20:15:03.976106 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:15:03.976066    2579 generic.go:356] "Generic (PLEG): container finished" podID="5b37711e-54f6-4012-acfc-c9858cad9eaa" containerID="ee0f7935cd709613f05743cf87f01019655d1e0492ac3cd343029c2bcfaa6eff" exitCode=0
Jul 14 20:15:03.976558 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:15:03.976129    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29734335-k8kms" event={"ID":"5b37711e-54f6-4012-acfc-c9858cad9eaa","Type":"ContainerDied","Data":"ee0f7935cd709613f05743cf87f01019655d1e0492ac3cd343029c2bcfaa6eff"}
Jul 14 20:15:05.116061 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:15:05.116029    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29734335-k8kms"
Jul 14 20:15:05.987394 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:15:05.987357    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29734335-k8kms" event={"ID":"5b37711e-54f6-4012-acfc-c9858cad9eaa","Type":"ContainerDied","Data":"882ac4c9f61c9577247222d127d4d9a112df32cd6201e0b1578c92a3ffbf5fa8"}
Jul 14 20:15:05.987394 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:15:05.987390    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29734335-k8kms"
Jul 14 20:15:05.987683 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:15:05.987408    2579 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="882ac4c9f61c9577247222d127d4d9a112df32cd6201e0b1578c92a3ffbf5fa8"
Jul 14 20:16:40.875267 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:16:40.875152    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-q4xzw_ef54193c-7659-4e47-87ac-4d129d22a268/ovn-acl-logging/0.log"
Jul 14 20:16:40.880651 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:16:40.880632    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-q4xzw_ef54193c-7659-4e47-87ac-4d129d22a268/ovn-acl-logging/0.log"
Jul 14 20:17:46.938967 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:17:46.938935    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-df972874-openshift-default-7486d8b645-4w89m"]
Jul 14 20:17:46.939438 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:17:46.939290    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5b37711e-54f6-4012-acfc-c9858cad9eaa" containerName="cleanup"
Jul 14 20:17:46.939438 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:17:46.939301    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="5b37711e-54f6-4012-acfc-c9858cad9eaa" containerName="cleanup"
Jul 14 20:17:46.939438 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:17:46.939371    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="5b37711e-54f6-4012-acfc-c9858cad9eaa" containerName="cleanup"
Jul 14 20:17:46.942111 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:17:46.942088    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-df972874-openshift-default-7486d8b645-4w89m"
Jul 14 20:17:46.944751 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:17:46.944731    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-df972874-openshift-default-dockercfg-q8w7z\""
Jul 14 20:17:46.969369 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:17:46.969340    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-df972874-openshift-default-7486d8b645-4w89m"]
Jul 14 20:17:47.112899 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:17:47.112850    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/003bdac5-b071-4819-84f7-400b684eeea1-istio-envoy\") pod \"e2e-ait-df972874-openshift-default-7486d8b645-4w89m\" (UID: \"003bdac5-b071-4819-84f7-400b684eeea1\") " pod="openshift-ingress/e2e-ait-df972874-openshift-default-7486d8b645-4w89m"
Jul 14 20:17:47.113094 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:17:47.112953    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/003bdac5-b071-4819-84f7-400b684eeea1-workload-socket\") pod \"e2e-ait-df972874-openshift-default-7486d8b645-4w89m\" (UID: \"003bdac5-b071-4819-84f7-400b684eeea1\") " pod="openshift-ingress/e2e-ait-df972874-openshift-default-7486d8b645-4w89m"
Jul 14 20:17:47.113094 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:17:47.112982    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/003bdac5-b071-4819-84f7-400b684eeea1-workload-certs\") pod \"e2e-ait-df972874-openshift-default-7486d8b645-4w89m\" (UID: \"003bdac5-b071-4819-84f7-400b684eeea1\") " pod="openshift-ingress/e2e-ait-df972874-openshift-default-7486d8b645-4w89m"
Jul 14 20:17:47.113094 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:17:47.113010    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/003bdac5-b071-4819-84f7-400b684eeea1-credential-socket\") pod \"e2e-ait-df972874-openshift-default-7486d8b645-4w89m\" (UID: \"003bdac5-b071-4819-84f7-400b684eeea1\") " pod="openshift-ingress/e2e-ait-df972874-openshift-default-7486d8b645-4w89m"
Jul 14 20:17:47.113094 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:17:47.113029    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2vrw5\" (UniqueName: \"kubernetes.io/projected/003bdac5-b071-4819-84f7-400b684eeea1-kube-api-access-2vrw5\") pod \"e2e-ait-df972874-openshift-default-7486d8b645-4w89m\" (UID: \"003bdac5-b071-4819-84f7-400b684eeea1\") " pod="openshift-ingress/e2e-ait-df972874-openshift-default-7486d8b645-4w89m"
Jul 14 20:17:47.113094 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:17:47.113056    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/003bdac5-b071-4819-84f7-400b684eeea1-istio-data\") pod \"e2e-ait-df972874-openshift-default-7486d8b645-4w89m\" (UID: \"003bdac5-b071-4819-84f7-400b684eeea1\") " pod="openshift-ingress/e2e-ait-df972874-openshift-default-7486d8b645-4w89m"
Jul 14 20:17:47.113094 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:17:47.113076    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/003bdac5-b071-4819-84f7-400b684eeea1-istiod-ca-cert\") pod \"e2e-ait-df972874-openshift-default-7486d8b645-4w89m\" (UID: \"003bdac5-b071-4819-84f7-400b684eeea1\") " pod="openshift-ingress/e2e-ait-df972874-openshift-default-7486d8b645-4w89m"
Jul 14 20:17:47.113094 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:17:47.113093    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/003bdac5-b071-4819-84f7-400b684eeea1-istio-token\") pod \"e2e-ait-df972874-openshift-default-7486d8b645-4w89m\" (UID: \"003bdac5-b071-4819-84f7-400b684eeea1\") " pod="openshift-ingress/e2e-ait-df972874-openshift-default-7486d8b645-4w89m"
Jul 14 20:17:47.113346 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:17:47.113113    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/003bdac5-b071-4819-84f7-400b684eeea1-istio-podinfo\") pod \"e2e-ait-df972874-openshift-default-7486d8b645-4w89m\" (UID: \"003bdac5-b071-4819-84f7-400b684eeea1\") " pod="openshift-ingress/e2e-ait-df972874-openshift-default-7486d8b645-4w89m"
Jul 14 20:17:47.213933 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:17:47.213903    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/003bdac5-b071-4819-84f7-400b684eeea1-workload-certs\") pod \"e2e-ait-df972874-openshift-default-7486d8b645-4w89m\" (UID: \"003bdac5-b071-4819-84f7-400b684eeea1\") " pod="openshift-ingress/e2e-ait-df972874-openshift-default-7486d8b645-4w89m"
Jul 14 20:17:47.214107 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:17:47.213944    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/003bdac5-b071-4819-84f7-400b684eeea1-credential-socket\") pod \"e2e-ait-df972874-openshift-default-7486d8b645-4w89m\" (UID: \"003bdac5-b071-4819-84f7-400b684eeea1\") " pod="openshift-ingress/e2e-ait-df972874-openshift-default-7486d8b645-4w89m"
Jul 14 20:17:47.214107 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:17:47.213967    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2vrw5\" (UniqueName: \"kubernetes.io/projected/003bdac5-b071-4819-84f7-400b684eeea1-kube-api-access-2vrw5\") pod \"e2e-ait-df972874-openshift-default-7486d8b645-4w89m\" (UID: \"003bdac5-b071-4819-84f7-400b684eeea1\") " pod="openshift-ingress/e2e-ait-df972874-openshift-default-7486d8b645-4w89m"
Jul 14 20:17:47.214107 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:17:47.214091    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/003bdac5-b071-4819-84f7-400b684eeea1-istio-data\") pod \"e2e-ait-df972874-openshift-default-7486d8b645-4w89m\" (UID: \"003bdac5-b071-4819-84f7-400b684eeea1\") " pod="openshift-ingress/e2e-ait-df972874-openshift-default-7486d8b645-4w89m"
Jul 14 20:17:47.214661 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:17:47.214149    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/003bdac5-b071-4819-84f7-400b684eeea1-istiod-ca-cert\") pod \"e2e-ait-df972874-openshift-default-7486d8b645-4w89m\" (UID: \"003bdac5-b071-4819-84f7-400b684eeea1\") " pod="openshift-ingress/e2e-ait-df972874-openshift-default-7486d8b645-4w89m"
Jul 14 20:17:47.214661 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:17:47.214183    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/003bdac5-b071-4819-84f7-400b684eeea1-istio-token\") pod \"e2e-ait-df972874-openshift-default-7486d8b645-4w89m\" (UID: \"003bdac5-b071-4819-84f7-400b684eeea1\") " pod="openshift-ingress/e2e-ait-df972874-openshift-default-7486d8b645-4w89m"
Jul 14 20:17:47.214661 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:17:47.214220    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/003bdac5-b071-4819-84f7-400b684eeea1-istio-podinfo\") pod \"e2e-ait-df972874-openshift-default-7486d8b645-4w89m\" (UID: \"003bdac5-b071-4819-84f7-400b684eeea1\") " pod="openshift-ingress/e2e-ait-df972874-openshift-default-7486d8b645-4w89m"
Jul 14 20:17:47.214661 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:17:47.214274    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/003bdac5-b071-4819-84f7-400b684eeea1-istio-envoy\") pod \"e2e-ait-df972874-openshift-default-7486d8b645-4w89m\" (UID: \"003bdac5-b071-4819-84f7-400b684eeea1\") " pod="openshift-ingress/e2e-ait-df972874-openshift-default-7486d8b645-4w89m"
Jul 14 20:17:47.214661 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:17:47.214352    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/003bdac5-b071-4819-84f7-400b684eeea1-credential-socket\") pod \"e2e-ait-df972874-openshift-default-7486d8b645-4w89m\" (UID: \"003bdac5-b071-4819-84f7-400b684eeea1\") " pod="openshift-ingress/e2e-ait-df972874-openshift-default-7486d8b645-4w89m"
Jul 14 20:17:47.214661 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:17:47.214430    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/003bdac5-b071-4819-84f7-400b684eeea1-workload-certs\") pod \"e2e-ait-df972874-openshift-default-7486d8b645-4w89m\" (UID: \"003bdac5-b071-4819-84f7-400b684eeea1\") " pod="openshift-ingress/e2e-ait-df972874-openshift-default-7486d8b645-4w89m"
Jul 14 20:17:47.214661 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:17:47.214460    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/003bdac5-b071-4819-84f7-400b684eeea1-workload-socket\") pod \"e2e-ait-df972874-openshift-default-7486d8b645-4w89m\" (UID: \"003bdac5-b071-4819-84f7-400b684eeea1\") " pod="openshift-ingress/e2e-ait-df972874-openshift-default-7486d8b645-4w89m"
Jul 14 20:17:47.214661 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:17:47.214472    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/003bdac5-b071-4819-84f7-400b684eeea1-istio-data\") pod \"e2e-ait-df972874-openshift-default-7486d8b645-4w89m\" (UID: \"003bdac5-b071-4819-84f7-400b684eeea1\") " pod="openshift-ingress/e2e-ait-df972874-openshift-default-7486d8b645-4w89m"
Jul 14 20:17:47.214992 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:17:47.214787    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/003bdac5-b071-4819-84f7-400b684eeea1-workload-socket\") pod \"e2e-ait-df972874-openshift-default-7486d8b645-4w89m\" (UID: \"003bdac5-b071-4819-84f7-400b684eeea1\") " pod="openshift-ingress/e2e-ait-df972874-openshift-default-7486d8b645-4w89m"
Jul 14 20:17:47.214992 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:17:47.214836    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/003bdac5-b071-4819-84f7-400b684eeea1-istiod-ca-cert\") pod \"e2e-ait-df972874-openshift-default-7486d8b645-4w89m\" (UID: \"003bdac5-b071-4819-84f7-400b684eeea1\") " pod="openshift-ingress/e2e-ait-df972874-openshift-default-7486d8b645-4w89m"
Jul 14 20:17:47.216846 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:17:47.216824    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/003bdac5-b071-4819-84f7-400b684eeea1-istio-podinfo\") pod \"e2e-ait-df972874-openshift-default-7486d8b645-4w89m\" (UID: \"003bdac5-b071-4819-84f7-400b684eeea1\") " pod="openshift-ingress/e2e-ait-df972874-openshift-default-7486d8b645-4w89m"
Jul 14 20:17:47.216920 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:17:47.216858    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/003bdac5-b071-4819-84f7-400b684eeea1-istio-envoy\") pod \"e2e-ait-df972874-openshift-default-7486d8b645-4w89m\" (UID: \"003bdac5-b071-4819-84f7-400b684eeea1\") " pod="openshift-ingress/e2e-ait-df972874-openshift-default-7486d8b645-4w89m"
Jul 14 20:17:47.222413 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:17:47.222382    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/003bdac5-b071-4819-84f7-400b684eeea1-istio-token\") pod \"e2e-ait-df972874-openshift-default-7486d8b645-4w89m\" (UID: \"003bdac5-b071-4819-84f7-400b684eeea1\") " pod="openshift-ingress/e2e-ait-df972874-openshift-default-7486d8b645-4w89m"
Jul 14 20:17:47.222509 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:17:47.222493    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2vrw5\" (UniqueName: \"kubernetes.io/projected/003bdac5-b071-4819-84f7-400b684eeea1-kube-api-access-2vrw5\") pod \"e2e-ait-df972874-openshift-default-7486d8b645-4w89m\" (UID: \"003bdac5-b071-4819-84f7-400b684eeea1\") " pod="openshift-ingress/e2e-ait-df972874-openshift-default-7486d8b645-4w89m"
Jul 14 20:17:47.252399 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:17:47.252365    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-df972874-openshift-default-7486d8b645-4w89m"
Jul 14 20:17:47.400252 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:17:47.400227    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-df972874-openshift-default-7486d8b645-4w89m"]
Jul 14 20:17:47.401908 ip-10-0-140-201 kubenswrapper[2579]: W0714 20:17:47.401875    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod003bdac5_b071_4819_84f7_400b684eeea1.slice/crio-03ae90caeb8083a6e0de385343b7e7862c2067c132a8fe2d9baad3e81605238a WatchSource:0}: Error finding container 03ae90caeb8083a6e0de385343b7e7862c2067c132a8fe2d9baad3e81605238a: Status 404 returned error can't find the container with id 03ae90caeb8083a6e0de385343b7e7862c2067c132a8fe2d9baad3e81605238a
Jul 14 20:17:47.404224 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:17:47.404189    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 14 20:17:47.404333 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:17:47.404251    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 14 20:17:47.404333 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:17:47.404284    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 14 20:17:47.858666 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:17:47.858568    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-df972874-openshift-default-7486d8b645-4w89m" event={"ID":"003bdac5-b071-4819-84f7-400b684eeea1","Type":"ContainerStarted","Data":"51a78f2a92548ed84a1750295c05f0b420c995917a65c453e9f6336985cbe769"}
Jul 14 20:17:47.858807 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:17:47.858665    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-df972874-openshift-default-7486d8b645-4w89m" event={"ID":"003bdac5-b071-4819-84f7-400b684eeea1","Type":"ContainerStarted","Data":"03ae90caeb8083a6e0de385343b7e7862c2067c132a8fe2d9baad3e81605238a"}
Jul 14 20:17:47.882615 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:17:47.882564    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-df972874-openshift-default-7486d8b645-4w89m" podStartSLOduration=1.8825476559999998 podStartE2EDuration="1.882547656s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 20:17:46 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 20:17:47.880873123 +0000 UTC m=+1567.592468690" watchObservedRunningTime="2026-07-14 20:17:47.882547656 +0000 UTC m=+1567.594143194"
Jul 14 20:17:48.253452 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:17:48.253409    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-df972874-openshift-default-7486d8b645-4w89m"
Jul 14 20:17:48.258264 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:17:48.258239    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-df972874-openshift-default-7486d8b645-4w89m"
Jul 14 20:17:48.863449 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:17:48.863415    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-df972874-openshift-default-7486d8b645-4w89m"
Jul 14 20:17:48.864321 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:17:48.864302    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-df972874-openshift-default-7486d8b645-4w89m"
Jul 14 20:18:03.864726 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:18:03.864690    2579 patch_prober.go:28] interesting pod/e2e-ait-df972874-openshift-default-7486d8b645-4w89m container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.44:15021/healthz/ready\": dial tcp 10.133.0.44:15021: connect: connection refused" start-of-body=
Jul 14 20:18:03.865145 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:18:03.864745    2579 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ait-df972874-openshift-default-7486d8b645-4w89m" podUID="003bdac5-b071-4819-84f7-400b684eeea1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.44:15021/healthz/ready\": dial tcp 10.133.0.44:15021: connect: connection refused"
Jul 14 20:18:03.940362 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:18:03.940330    2579 generic.go:356] "Generic (PLEG): container finished" podID="003bdac5-b071-4819-84f7-400b684eeea1" containerID="51a78f2a92548ed84a1750295c05f0b420c995917a65c453e9f6336985cbe769" exitCode=0
Jul 14 20:18:03.940523 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:18:03.940389    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-df972874-openshift-default-7486d8b645-4w89m" event={"ID":"003bdac5-b071-4819-84f7-400b684eeea1","Type":"ContainerDied","Data":"51a78f2a92548ed84a1750295c05f0b420c995917a65c453e9f6336985cbe769"}
Jul 14 20:18:03.940818 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:18:03.940804    2579 scope.go:117] "RemoveContainer" containerID="51a78f2a92548ed84a1750295c05f0b420c995917a65c453e9f6336985cbe769"
Jul 14 20:18:03.941837 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:18:03.941805    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 14 20:18:03.941903 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:18:03.941885    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 14 20:18:03.941949 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:18:03.941932    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 14 20:18:04.948516 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:18:04.948481    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-df972874-openshift-default-7486d8b645-4w89m" event={"ID":"003bdac5-b071-4819-84f7-400b684eeea1","Type":"ContainerStarted","Data":"768555b24fe2e4ddb23bcafd6ad07920c36df5e6a7457cabe8a80c357617d16a"}
Jul 14 20:18:05.252601 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:18:05.252562    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-df972874-openshift-default-7486d8b645-4w89m"
Jul 14 20:18:05.252849 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:18:05.252827    2579 patch_prober.go:28] interesting pod/e2e-ait-df972874-openshift-default-7486d8b645-4w89m container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.44:15021/healthz/ready\": dial tcp 10.133.0.44:15021: connect: connection refused" start-of-body=
Jul 14 20:18:05.252897 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:18:05.252881    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-df972874-openshift-default-7486d8b645-4w89m" podUID="003bdac5-b071-4819-84f7-400b684eeea1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.44:15021/healthz/ready\": dial tcp 10.133.0.44:15021: connect: connection refused"
Jul 14 20:18:06.253035 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:18:06.252995    2579 patch_prober.go:28] interesting pod/e2e-ait-df972874-openshift-default-7486d8b645-4w89m container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.44:15021/healthz/ready\": dial tcp 10.133.0.44:15021: connect: connection refused" start-of-body=
Jul 14 20:18:06.253451 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:18:06.253057    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-df972874-openshift-default-7486d8b645-4w89m" podUID="003bdac5-b071-4819-84f7-400b684eeea1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.44:15021/healthz/ready\": dial tcp 10.133.0.44:15021: connect: connection refused"
Jul 14 20:18:07.253475 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:18:07.253436    2579 patch_prober.go:28] interesting pod/e2e-ait-df972874-openshift-default-7486d8b645-4w89m container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.44:15021/healthz/ready\": dial tcp 10.133.0.44:15021: connect: connection refused" start-of-body=
Jul 14 20:18:07.253894 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:18:07.253499    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-df972874-openshift-default-7486d8b645-4w89m" podUID="003bdac5-b071-4819-84f7-400b684eeea1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.44:15021/healthz/ready\": dial tcp 10.133.0.44:15021: connect: connection refused"
Jul 14 20:18:08.253405 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:18:08.253362    2579 patch_prober.go:28] interesting pod/e2e-ait-df972874-openshift-default-7486d8b645-4w89m container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.44:15021/healthz/ready\": dial tcp 10.133.0.44:15021: connect: connection refused" start-of-body=
Jul 14 20:18:08.253610 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:18:08.253423    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-df972874-openshift-default-7486d8b645-4w89m" podUID="003bdac5-b071-4819-84f7-400b684eeea1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.44:15021/healthz/ready\": dial tcp 10.133.0.44:15021: connect: connection refused"
Jul 14 20:18:09.257011 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:18:09.256982    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-df972874-openshift-default-7486d8b645-4w89m"
Jul 14 20:18:09.257559 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:18:09.257250    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-df972874-openshift-default-7486d8b645-4w89m"
Jul 14 20:18:09.258109 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:18:09.258095    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-df972874-openshift-default-7486d8b645-4w89m"
Jul 14 20:18:53.235771 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:18:53.235687    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-df972874-pzwtt"]
Jul 14 20:18:53.239274 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:18:53.239256    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-df972874-pzwtt"
Jul 14 20:18:53.243060 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:18:53.243040    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 14 20:18:53.243328 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:18:53.243313    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-4blwh\""
Jul 14 20:18:53.262549 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:18:53.262474    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-df972874-pzwtt"]
Jul 14 20:18:53.340900 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:18:53.340862    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/aebdbf77-1b02-4650-a264-b5efb82f896a-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-df972874-pzwtt\" (UID: \"aebdbf77-1b02-4650-a264-b5efb82f896a\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-df972874-pzwtt"
Jul 14 20:18:53.442414 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:18:53.442381    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/aebdbf77-1b02-4650-a264-b5efb82f896a-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-df972874-pzwtt\" (UID: \"aebdbf77-1b02-4650-a264-b5efb82f896a\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-df972874-pzwtt"
Jul 14 20:18:53.443050 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:18:53.443030    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/aebdbf77-1b02-4650-a264-b5efb82f896a-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-df972874-pzwtt\" (UID: \"aebdbf77-1b02-4650-a264-b5efb82f896a\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-df972874-pzwtt"
Jul 14 20:18:53.549224 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:18:53.549096    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-df972874-pzwtt"
Jul 14 20:18:53.705463 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:18:53.705434    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-df972874-pzwtt"]
Jul 14 20:18:53.707334 ip-10-0-140-201 kubenswrapper[2579]: W0714 20:18:53.707304    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaebdbf77_1b02_4650_a264_b5efb82f896a.slice/crio-926401a9cbb8c761ef9c8c73309d419211af0626874627e7b3b582ec66b86d39 WatchSource:0}: Error finding container 926401a9cbb8c761ef9c8c73309d419211af0626874627e7b3b582ec66b86d39: Status 404 returned error can't find the container with id 926401a9cbb8c761ef9c8c73309d419211af0626874627e7b3b582ec66b86d39
Jul 14 20:18:54.212405 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:18:54.212376    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-df972874-pzwtt" event={"ID":"aebdbf77-1b02-4650-a264-b5efb82f896a","Type":"ContainerStarted","Data":"f6a834cf7bdb88b59d088a42aecfb859163f5c7560982fcfe6b30f500a366416"}
Jul 14 20:18:54.212601 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:18:54.212433    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-df972874-pzwtt" event={"ID":"aebdbf77-1b02-4650-a264-b5efb82f896a","Type":"ContainerStarted","Data":"926401a9cbb8c761ef9c8c73309d419211af0626874627e7b3b582ec66b86d39"}
Jul 14 20:18:54.252156 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:18:54.252097    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-df972874-pzwtt" podStartSLOduration=1.25207935 podStartE2EDuration="1.25207935s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 20:18:53 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 20:18:54.250320145 +0000 UTC m=+1633.961915689" watchObservedRunningTime="2026-07-14 20:18:54.25207935 +0000 UTC m=+1633.963674927"
Jul 14 20:18:55.219133 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:18:55.219095    2579 generic.go:356] "Generic (PLEG): container finished" podID="aebdbf77-1b02-4650-a264-b5efb82f896a" containerID="f6a834cf7bdb88b59d088a42aecfb859163f5c7560982fcfe6b30f500a366416" exitCode=0
Jul 14 20:18:55.219283 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:18:55.219181    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-df972874-pzwtt" event={"ID":"aebdbf77-1b02-4650-a264-b5efb82f896a","Type":"ContainerDied","Data":"f6a834cf7bdb88b59d088a42aecfb859163f5c7560982fcfe6b30f500a366416"}
Jul 14 20:18:56.364581 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:18:56.364551    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-df972874-pzwtt"
Jul 14 20:18:56.470756 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:18:56.470722    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/aebdbf77-1b02-4650-a264-b5efb82f896a-maas-api-service-ca\") pod \"aebdbf77-1b02-4650-a264-b5efb82f896a\" (UID: \"aebdbf77-1b02-4650-a264-b5efb82f896a\") "
Jul 14 20:18:56.471108 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:18:56.471084    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/aebdbf77-1b02-4650-a264-b5efb82f896a-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "aebdbf77-1b02-4650-a264-b5efb82f896a" (UID: "aebdbf77-1b02-4650-a264-b5efb82f896a"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 14 20:18:56.571996 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:18:56.571918    2579 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/aebdbf77-1b02-4650-a264-b5efb82f896a-maas-api-service-ca\") on node \"ip-10-0-140-201.ec2.internal\" DevicePath \"\""
Jul 14 20:18:57.231471 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:18:57.231445    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-df972874-pzwtt"
Jul 14 20:18:57.231682 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:18:57.231486    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-df972874-pzwtt" event={"ID":"aebdbf77-1b02-4650-a264-b5efb82f896a","Type":"ContainerDied","Data":"926401a9cbb8c761ef9c8c73309d419211af0626874627e7b3b582ec66b86d39"}
Jul 14 20:18:57.231682 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:18:57.231559    2579 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="926401a9cbb8c761ef9c8c73309d419211af0626874627e7b3b582ec66b86d39"
Jul 14 20:19:18.835434 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:19:18.835395    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-df972874-openshift-default-7486d8b645-4w89m"]
Jul 14 20:19:18.835901 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:19:18.835632    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-df972874-openshift-default-7486d8b645-4w89m" podUID="003bdac5-b071-4819-84f7-400b684eeea1" containerName="istio-proxy" containerID="cri-o://768555b24fe2e4ddb23bcafd6ad07920c36df5e6a7457cabe8a80c357617d16a" gracePeriod=30
Jul 14 20:19:19.758375 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:19:19.758343    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-migrate-bc788bc2-gw-openshift-default-7445d485cf-z6zgx"]
Jul 14 20:19:19.758754 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:19:19.758740    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="aebdbf77-1b02-4650-a264-b5efb82f896a" containerName="revoke-keys"
Jul 14 20:19:19.758813 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:19:19.758755    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="aebdbf77-1b02-4650-a264-b5efb82f896a" containerName="revoke-keys"
Jul 14 20:19:19.758853 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:19:19.758825    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="aebdbf77-1b02-4650-a264-b5efb82f896a" containerName="revoke-keys"
Jul 14 20:19:19.761908 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:19:19.761892    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-bc788bc2-gw-openshift-default-7445d485cf-z6zgx"
Jul 14 20:19:19.784941 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:19:19.784913    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-migrate-bc788bc2-gw-openshift-default-dockercfg-b6bl9\""
Jul 14 20:19:19.789890 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:19:19.789860    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6hzjz\" (UniqueName: \"kubernetes.io/projected/2772d91b-18ac-481a-a835-92e71137207d-kube-api-access-6hzjz\") pod \"e2e-migrate-bc788bc2-gw-openshift-default-7445d485cf-z6zgx\" (UID: \"2772d91b-18ac-481a-a835-92e71137207d\") " pod="openshift-ingress/e2e-migrate-bc788bc2-gw-openshift-default-7445d485cf-z6zgx"
Jul 14 20:19:19.790043 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:19:19.789916    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2772d91b-18ac-481a-a835-92e71137207d-workload-socket\") pod \"e2e-migrate-bc788bc2-gw-openshift-default-7445d485cf-z6zgx\" (UID: \"2772d91b-18ac-481a-a835-92e71137207d\") " pod="openshift-ingress/e2e-migrate-bc788bc2-gw-openshift-default-7445d485cf-z6zgx"
Jul 14 20:19:19.790043 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:19:19.789950    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2772d91b-18ac-481a-a835-92e71137207d-credential-socket\") pod \"e2e-migrate-bc788bc2-gw-openshift-default-7445d485cf-z6zgx\" (UID: \"2772d91b-18ac-481a-a835-92e71137207d\") " pod="openshift-ingress/e2e-migrate-bc788bc2-gw-openshift-default-7445d485cf-z6zgx"
Jul 14 20:19:19.790043 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:19:19.790008    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2772d91b-18ac-481a-a835-92e71137207d-istio-data\") pod \"e2e-migrate-bc788bc2-gw-openshift-default-7445d485cf-z6zgx\" (UID: \"2772d91b-18ac-481a-a835-92e71137207d\") " pod="openshift-ingress/e2e-migrate-bc788bc2-gw-openshift-default-7445d485cf-z6zgx"
Jul 14 20:19:19.790192 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:19:19.790070    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2772d91b-18ac-481a-a835-92e71137207d-istio-envoy\") pod \"e2e-migrate-bc788bc2-gw-openshift-default-7445d485cf-z6zgx\" (UID: \"2772d91b-18ac-481a-a835-92e71137207d\") " pod="openshift-ingress/e2e-migrate-bc788bc2-gw-openshift-default-7445d485cf-z6zgx"
Jul 14 20:19:19.790192 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:19:19.790101    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2772d91b-18ac-481a-a835-92e71137207d-istiod-ca-cert\") pod \"e2e-migrate-bc788bc2-gw-openshift-default-7445d485cf-z6zgx\" (UID: \"2772d91b-18ac-481a-a835-92e71137207d\") " pod="openshift-ingress/e2e-migrate-bc788bc2-gw-openshift-default-7445d485cf-z6zgx"
Jul 14 20:19:19.790192 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:19:19.790161    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2772d91b-18ac-481a-a835-92e71137207d-istio-podinfo\") pod \"e2e-migrate-bc788bc2-gw-openshift-default-7445d485cf-z6zgx\" (UID: \"2772d91b-18ac-481a-a835-92e71137207d\") " pod="openshift-ingress/e2e-migrate-bc788bc2-gw-openshift-default-7445d485cf-z6zgx"
Jul 14 20:19:19.790345 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:19:19.790210    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2772d91b-18ac-481a-a835-92e71137207d-workload-certs\") pod \"e2e-migrate-bc788bc2-gw-openshift-default-7445d485cf-z6zgx\" (UID: \"2772d91b-18ac-481a-a835-92e71137207d\") " pod="openshift-ingress/e2e-migrate-bc788bc2-gw-openshift-default-7445d485cf-z6zgx"
Jul 14 20:19:19.790345 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:19:19.790246    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2772d91b-18ac-481a-a835-92e71137207d-istio-token\") pod \"e2e-migrate-bc788bc2-gw-openshift-default-7445d485cf-z6zgx\" (UID: \"2772d91b-18ac-481a-a835-92e71137207d\") " pod="openshift-ingress/e2e-migrate-bc788bc2-gw-openshift-default-7445d485cf-z6zgx"
Jul 14 20:19:19.802384 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:19:19.802355    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-migrate-bc788bc2-gw-openshift-default-7445d485cf-z6zgx"]
Jul 14 20:19:19.891488 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:19:19.891454    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2772d91b-18ac-481a-a835-92e71137207d-istio-token\") pod \"e2e-migrate-bc788bc2-gw-openshift-default-7445d485cf-z6zgx\" (UID: \"2772d91b-18ac-481a-a835-92e71137207d\") " pod="openshift-ingress/e2e-migrate-bc788bc2-gw-openshift-default-7445d485cf-z6zgx"
Jul 14 20:19:19.892080 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:19:19.891525    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6hzjz\" (UniqueName: \"kubernetes.io/projected/2772d91b-18ac-481a-a835-92e71137207d-kube-api-access-6hzjz\") pod \"e2e-migrate-bc788bc2-gw-openshift-default-7445d485cf-z6zgx\" (UID: \"2772d91b-18ac-481a-a835-92e71137207d\") " pod="openshift-ingress/e2e-migrate-bc788bc2-gw-openshift-default-7445d485cf-z6zgx"
Jul 14 20:19:19.892080 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:19:19.891600    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2772d91b-18ac-481a-a835-92e71137207d-workload-socket\") pod \"e2e-migrate-bc788bc2-gw-openshift-default-7445d485cf-z6zgx\" (UID: \"2772d91b-18ac-481a-a835-92e71137207d\") " pod="openshift-ingress/e2e-migrate-bc788bc2-gw-openshift-default-7445d485cf-z6zgx"
Jul 14 20:19:19.892080 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:19:19.891629    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2772d91b-18ac-481a-a835-92e71137207d-credential-socket\") pod \"e2e-migrate-bc788bc2-gw-openshift-default-7445d485cf-z6zgx\" (UID: \"2772d91b-18ac-481a-a835-92e71137207d\") " pod="openshift-ingress/e2e-migrate-bc788bc2-gw-openshift-default-7445d485cf-z6zgx"
Jul 14 20:19:19.892272 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:19:19.892124    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2772d91b-18ac-481a-a835-92e71137207d-istio-data\") pod \"e2e-migrate-bc788bc2-gw-openshift-default-7445d485cf-z6zgx\" (UID: \"2772d91b-18ac-481a-a835-92e71137207d\") " pod="openshift-ingress/e2e-migrate-bc788bc2-gw-openshift-default-7445d485cf-z6zgx"
Jul 14 20:19:19.892272 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:19:19.892179    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2772d91b-18ac-481a-a835-92e71137207d-istio-envoy\") pod \"e2e-migrate-bc788bc2-gw-openshift-default-7445d485cf-z6zgx\" (UID: \"2772d91b-18ac-481a-a835-92e71137207d\") " pod="openshift-ingress/e2e-migrate-bc788bc2-gw-openshift-default-7445d485cf-z6zgx"
Jul 14 20:19:19.892272 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:19:19.892196    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2772d91b-18ac-481a-a835-92e71137207d-workload-socket\") pod \"e2e-migrate-bc788bc2-gw-openshift-default-7445d485cf-z6zgx\" (UID: \"2772d91b-18ac-481a-a835-92e71137207d\") " pod="openshift-ingress/e2e-migrate-bc788bc2-gw-openshift-default-7445d485cf-z6zgx"
Jul 14 20:19:19.892272 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:19:19.892129    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2772d91b-18ac-481a-a835-92e71137207d-credential-socket\") pod \"e2e-migrate-bc788bc2-gw-openshift-default-7445d485cf-z6zgx\" (UID: \"2772d91b-18ac-481a-a835-92e71137207d\") " pod="openshift-ingress/e2e-migrate-bc788bc2-gw-openshift-default-7445d485cf-z6zgx"
Jul 14 20:19:19.892272 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:19:19.892220    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2772d91b-18ac-481a-a835-92e71137207d-istiod-ca-cert\") pod \"e2e-migrate-bc788bc2-gw-openshift-default-7445d485cf-z6zgx\" (UID: \"2772d91b-18ac-481a-a835-92e71137207d\") " pod="openshift-ingress/e2e-migrate-bc788bc2-gw-openshift-default-7445d485cf-z6zgx"
Jul 14 20:19:19.892564 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:19:19.892285    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2772d91b-18ac-481a-a835-92e71137207d-istio-podinfo\") pod \"e2e-migrate-bc788bc2-gw-openshift-default-7445d485cf-z6zgx\" (UID: \"2772d91b-18ac-481a-a835-92e71137207d\") " pod="openshift-ingress/e2e-migrate-bc788bc2-gw-openshift-default-7445d485cf-z6zgx"
Jul 14 20:19:19.892564 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:19:19.892341    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2772d91b-18ac-481a-a835-92e71137207d-workload-certs\") pod \"e2e-migrate-bc788bc2-gw-openshift-default-7445d485cf-z6zgx\" (UID: \"2772d91b-18ac-481a-a835-92e71137207d\") " pod="openshift-ingress/e2e-migrate-bc788bc2-gw-openshift-default-7445d485cf-z6zgx"
Jul 14 20:19:19.892564 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:19:19.892500    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2772d91b-18ac-481a-a835-92e71137207d-istio-data\") pod \"e2e-migrate-bc788bc2-gw-openshift-default-7445d485cf-z6zgx\" (UID: \"2772d91b-18ac-481a-a835-92e71137207d\") " pod="openshift-ingress/e2e-migrate-bc788bc2-gw-openshift-default-7445d485cf-z6zgx"
Jul 14 20:19:19.892686 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:19:19.892672    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2772d91b-18ac-481a-a835-92e71137207d-workload-certs\") pod \"e2e-migrate-bc788bc2-gw-openshift-default-7445d485cf-z6zgx\" (UID: \"2772d91b-18ac-481a-a835-92e71137207d\") " pod="openshift-ingress/e2e-migrate-bc788bc2-gw-openshift-default-7445d485cf-z6zgx"
Jul 14 20:19:19.892833 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:19:19.892816    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2772d91b-18ac-481a-a835-92e71137207d-istiod-ca-cert\") pod \"e2e-migrate-bc788bc2-gw-openshift-default-7445d485cf-z6zgx\" (UID: \"2772d91b-18ac-481a-a835-92e71137207d\") " pod="openshift-ingress/e2e-migrate-bc788bc2-gw-openshift-default-7445d485cf-z6zgx"
Jul 14 20:19:19.894692 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:19:19.894670    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2772d91b-18ac-481a-a835-92e71137207d-istio-envoy\") pod \"e2e-migrate-bc788bc2-gw-openshift-default-7445d485cf-z6zgx\" (UID: \"2772d91b-18ac-481a-a835-92e71137207d\") " pod="openshift-ingress/e2e-migrate-bc788bc2-gw-openshift-default-7445d485cf-z6zgx"
Jul 14 20:19:19.894808 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:19:19.894798    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2772d91b-18ac-481a-a835-92e71137207d-istio-podinfo\") pod \"e2e-migrate-bc788bc2-gw-openshift-default-7445d485cf-z6zgx\" (UID: \"2772d91b-18ac-481a-a835-92e71137207d\") " pod="openshift-ingress/e2e-migrate-bc788bc2-gw-openshift-default-7445d485cf-z6zgx"
Jul 14 20:19:19.910189 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:19:19.910163    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6hzjz\" (UniqueName: \"kubernetes.io/projected/2772d91b-18ac-481a-a835-92e71137207d-kube-api-access-6hzjz\") pod \"e2e-migrate-bc788bc2-gw-openshift-default-7445d485cf-z6zgx\" (UID: \"2772d91b-18ac-481a-a835-92e71137207d\") " pod="openshift-ingress/e2e-migrate-bc788bc2-gw-openshift-default-7445d485cf-z6zgx"
Jul 14 20:19:19.913641 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:19:19.913619    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2772d91b-18ac-481a-a835-92e71137207d-istio-token\") pod \"e2e-migrate-bc788bc2-gw-openshift-default-7445d485cf-z6zgx\" (UID: \"2772d91b-18ac-481a-a835-92e71137207d\") " pod="openshift-ingress/e2e-migrate-bc788bc2-gw-openshift-default-7445d485cf-z6zgx"
Jul 14 20:19:20.072992 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:19:20.072963    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-bc788bc2-gw-openshift-default-7445d485cf-z6zgx"
Jul 14 20:19:20.270127 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:19:20.270094    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-migrate-bc788bc2-gw-openshift-default-7445d485cf-z6zgx"]
Jul 14 20:19:20.276725 ip-10-0-140-201 kubenswrapper[2579]: W0714 20:19:20.276692    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2772d91b_18ac_481a_a835_92e71137207d.slice/crio-4166365c2d862d7cccd9cf871d10a038052902bdb65ca36a41ffbe16e220f721 WatchSource:0}: Error finding container 4166365c2d862d7cccd9cf871d10a038052902bdb65ca36a41ffbe16e220f721: Status 404 returned error can't find the container with id 4166365c2d862d7cccd9cf871d10a038052902bdb65ca36a41ffbe16e220f721
Jul 14 20:19:20.279062 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:19:20.279024    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 14 20:19:20.279144 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:19:20.279115    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 14 20:19:20.279190 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:19:20.279150    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 14 20:19:20.381323 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:19:20.381272    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-bc788bc2-gw-openshift-default-7445d485cf-z6zgx" event={"ID":"2772d91b-18ac-481a-a835-92e71137207d","Type":"ContainerStarted","Data":"1ec03be952f4f7a40d8d99c9f7567c10e4b8af31a54d65aeaca4da45c74f2683"}
Jul 14 20:19:20.381524 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:19:20.381382    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-bc788bc2-gw-openshift-default-7445d485cf-z6zgx" event={"ID":"2772d91b-18ac-481a-a835-92e71137207d","Type":"ContainerStarted","Data":"4166365c2d862d7cccd9cf871d10a038052902bdb65ca36a41ffbe16e220f721"}
Jul 14 20:19:20.443794 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:19:20.443739    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-migrate-bc788bc2-gw-openshift-default-7445d485cf-z6zgx" podStartSLOduration=1.443722128 podStartE2EDuration="1.443722128s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 20:19:19 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 20:19:20.442318997 +0000 UTC m=+1660.153914543" watchObservedRunningTime="2026-07-14 20:19:20.443722128 +0000 UTC m=+1660.155317672"
Jul 14 20:19:21.073169 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:19:21.073126    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-migrate-bc788bc2-gw-openshift-default-7445d485cf-z6zgx"
Jul 14 20:19:21.078432 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:19:21.078406    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-migrate-bc788bc2-gw-openshift-default-7445d485cf-z6zgx"
Jul 14 20:19:21.387894 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:19:21.387800    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-migrate-bc788bc2-gw-openshift-default-7445d485cf-z6zgx"
Jul 14 20:19:21.388869 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:19:21.388845    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-migrate-bc788bc2-gw-openshift-default-7445d485cf-z6zgx"
Jul 14 20:19:24.092548 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:19:24.092498    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-df972874-openshift-default-7486d8b645-4w89m"
Jul 14 20:19:24.133909 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:19:24.133811    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/003bdac5-b071-4819-84f7-400b684eeea1-istio-envoy\") pod \"003bdac5-b071-4819-84f7-400b684eeea1\" (UID: \"003bdac5-b071-4819-84f7-400b684eeea1\") "
Jul 14 20:19:24.133909 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:19:24.133874    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/003bdac5-b071-4819-84f7-400b684eeea1-istio-podinfo\") pod \"003bdac5-b071-4819-84f7-400b684eeea1\" (UID: \"003bdac5-b071-4819-84f7-400b684eeea1\") "
Jul 14 20:19:24.133909 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:19:24.133901    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/003bdac5-b071-4819-84f7-400b684eeea1-credential-socket\") pod \"003bdac5-b071-4819-84f7-400b684eeea1\" (UID: \"003bdac5-b071-4819-84f7-400b684eeea1\") "
Jul 14 20:19:24.134185 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:19:24.133932    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/003bdac5-b071-4819-84f7-400b684eeea1-istiod-ca-cert\") pod \"003bdac5-b071-4819-84f7-400b684eeea1\" (UID: \"003bdac5-b071-4819-84f7-400b684eeea1\") "
Jul 14 20:19:24.134185 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:19:24.133954    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/003bdac5-b071-4819-84f7-400b684eeea1-istio-token\") pod \"003bdac5-b071-4819-84f7-400b684eeea1\" (UID: \"003bdac5-b071-4819-84f7-400b684eeea1\") "
Jul 14 20:19:24.134185 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:19:24.134004    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/003bdac5-b071-4819-84f7-400b684eeea1-workload-socket\") pod \"003bdac5-b071-4819-84f7-400b684eeea1\" (UID: \"003bdac5-b071-4819-84f7-400b684eeea1\") "
Jul 14 20:19:24.134185 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:19:24.134049    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2vrw5\" (UniqueName: \"kubernetes.io/projected/003bdac5-b071-4819-84f7-400b684eeea1-kube-api-access-2vrw5\") pod \"003bdac5-b071-4819-84f7-400b684eeea1\" (UID: \"003bdac5-b071-4819-84f7-400b684eeea1\") "
Jul 14 20:19:24.134185 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:19:24.134101    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/003bdac5-b071-4819-84f7-400b684eeea1-workload-certs\") pod \"003bdac5-b071-4819-84f7-400b684eeea1\" (UID: \"003bdac5-b071-4819-84f7-400b684eeea1\") "
Jul 14 20:19:24.134185 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:19:24.134151    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/003bdac5-b071-4819-84f7-400b684eeea1-istio-data\") pod \"003bdac5-b071-4819-84f7-400b684eeea1\" (UID: \"003bdac5-b071-4819-84f7-400b684eeea1\") "
Jul 14 20:19:24.134493 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:19:24.134220    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/003bdac5-b071-4819-84f7-400b684eeea1-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "003bdac5-b071-4819-84f7-400b684eeea1" (UID: "003bdac5-b071-4819-84f7-400b684eeea1"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 20:19:24.134493 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:19:24.134301    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/003bdac5-b071-4819-84f7-400b684eeea1-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "003bdac5-b071-4819-84f7-400b684eeea1" (UID: "003bdac5-b071-4819-84f7-400b684eeea1"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 14 20:19:24.134493 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:19:24.134399    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/003bdac5-b071-4819-84f7-400b684eeea1-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "003bdac5-b071-4819-84f7-400b684eeea1" (UID: "003bdac5-b071-4819-84f7-400b684eeea1"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 20:19:24.134689 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:19:24.134557    2579 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/003bdac5-b071-4819-84f7-400b684eeea1-credential-socket\") on node \"ip-10-0-140-201.ec2.internal\" DevicePath \"\""
Jul 14 20:19:24.134689 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:19:24.134575    2579 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/003bdac5-b071-4819-84f7-400b684eeea1-istiod-ca-cert\") on node \"ip-10-0-140-201.ec2.internal\" DevicePath \"\""
Jul 14 20:19:24.134689 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:19:24.134589    2579 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/003bdac5-b071-4819-84f7-400b684eeea1-workload-socket\") on node \"ip-10-0-140-201.ec2.internal\" DevicePath \"\""
Jul 14 20:19:24.134855 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:19:24.134683    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/003bdac5-b071-4819-84f7-400b684eeea1-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "003bdac5-b071-4819-84f7-400b684eeea1" (UID: "003bdac5-b071-4819-84f7-400b684eeea1"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 20:19:24.135664 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:19:24.135634    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/003bdac5-b071-4819-84f7-400b684eeea1-istio-data" (OuterVolumeSpecName: "istio-data") pod "003bdac5-b071-4819-84f7-400b684eeea1" (UID: "003bdac5-b071-4819-84f7-400b684eeea1"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 20:19:24.136399 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:19:24.136375    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/003bdac5-b071-4819-84f7-400b684eeea1-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "003bdac5-b071-4819-84f7-400b684eeea1" (UID: "003bdac5-b071-4819-84f7-400b684eeea1"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 20:19:24.136399 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:19:24.136376    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/003bdac5-b071-4819-84f7-400b684eeea1-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "003bdac5-b071-4819-84f7-400b684eeea1" (UID: "003bdac5-b071-4819-84f7-400b684eeea1"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 14 20:19:24.136557 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:19:24.136400    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/003bdac5-b071-4819-84f7-400b684eeea1-kube-api-access-2vrw5" (OuterVolumeSpecName: "kube-api-access-2vrw5") pod "003bdac5-b071-4819-84f7-400b684eeea1" (UID: "003bdac5-b071-4819-84f7-400b684eeea1"). InnerVolumeSpecName "kube-api-access-2vrw5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 14 20:19:24.136843 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:19:24.136822    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/003bdac5-b071-4819-84f7-400b684eeea1-istio-token" (OuterVolumeSpecName: "istio-token") pod "003bdac5-b071-4819-84f7-400b684eeea1" (UID: "003bdac5-b071-4819-84f7-400b684eeea1"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 14 20:19:24.236005 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:19:24.235972    2579 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/003bdac5-b071-4819-84f7-400b684eeea1-istio-envoy\") on node \"ip-10-0-140-201.ec2.internal\" DevicePath \"\""
Jul 14 20:19:24.236087 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:19:24.236013    2579 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/003bdac5-b071-4819-84f7-400b684eeea1-istio-podinfo\") on node \"ip-10-0-140-201.ec2.internal\" DevicePath \"\""
Jul 14 20:19:24.236087 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:19:24.236029    2579 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/003bdac5-b071-4819-84f7-400b684eeea1-istio-token\") on node \"ip-10-0-140-201.ec2.internal\" DevicePath \"\""
Jul 14 20:19:24.236087 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:19:24.236044    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2vrw5\" (UniqueName: \"kubernetes.io/projected/003bdac5-b071-4819-84f7-400b684eeea1-kube-api-access-2vrw5\") on node \"ip-10-0-140-201.ec2.internal\" DevicePath \"\""
Jul 14 20:19:24.236087 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:19:24.236058    2579 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/003bdac5-b071-4819-84f7-400b684eeea1-workload-certs\") on node \"ip-10-0-140-201.ec2.internal\" DevicePath \"\""
Jul 14 20:19:24.236087 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:19:24.236071    2579 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/003bdac5-b071-4819-84f7-400b684eeea1-istio-data\") on node \"ip-10-0-140-201.ec2.internal\" DevicePath \"\""
Jul 14 20:19:24.405694 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:19:24.405603    2579 generic.go:356] "Generic (PLEG): container finished" podID="003bdac5-b071-4819-84f7-400b684eeea1" containerID="768555b24fe2e4ddb23bcafd6ad07920c36df5e6a7457cabe8a80c357617d16a" exitCode=0
Jul 14 20:19:24.405694 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:19:24.405660    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-df972874-openshift-default-7486d8b645-4w89m"
Jul 14 20:19:24.405694 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:19:24.405673    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-df972874-openshift-default-7486d8b645-4w89m" event={"ID":"003bdac5-b071-4819-84f7-400b684eeea1","Type":"ContainerDied","Data":"768555b24fe2e4ddb23bcafd6ad07920c36df5e6a7457cabe8a80c357617d16a"}
Jul 14 20:19:24.406034 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:19:24.405730    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-df972874-openshift-default-7486d8b645-4w89m" event={"ID":"003bdac5-b071-4819-84f7-400b684eeea1","Type":"ContainerDied","Data":"03ae90caeb8083a6e0de385343b7e7862c2067c132a8fe2d9baad3e81605238a"}
Jul 14 20:19:24.406034 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:19:24.405757    2579 scope.go:117] "RemoveContainer" containerID="768555b24fe2e4ddb23bcafd6ad07920c36df5e6a7457cabe8a80c357617d16a"
Jul 14 20:19:24.415500 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:19:24.415478    2579 scope.go:117] "RemoveContainer" containerID="51a78f2a92548ed84a1750295c05f0b420c995917a65c453e9f6336985cbe769"
Jul 14 20:19:24.424007 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:19:24.423985    2579 scope.go:117] "RemoveContainer" containerID="768555b24fe2e4ddb23bcafd6ad07920c36df5e6a7457cabe8a80c357617d16a"
Jul 14 20:19:24.424321 ip-10-0-140-201 kubenswrapper[2579]: E0714 20:19:24.424300    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"768555b24fe2e4ddb23bcafd6ad07920c36df5e6a7457cabe8a80c357617d16a\": container with ID starting with 768555b24fe2e4ddb23bcafd6ad07920c36df5e6a7457cabe8a80c357617d16a not found: ID does not exist" containerID="768555b24fe2e4ddb23bcafd6ad07920c36df5e6a7457cabe8a80c357617d16a"
Jul 14 20:19:24.424392 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:19:24.424335    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"768555b24fe2e4ddb23bcafd6ad07920c36df5e6a7457cabe8a80c357617d16a"} err="failed to get container status \"768555b24fe2e4ddb23bcafd6ad07920c36df5e6a7457cabe8a80c357617d16a\": rpc error: code = NotFound desc = could not find container \"768555b24fe2e4ddb23bcafd6ad07920c36df5e6a7457cabe8a80c357617d16a\": container with ID starting with 768555b24fe2e4ddb23bcafd6ad07920c36df5e6a7457cabe8a80c357617d16a not found: ID does not exist"
Jul 14 20:19:24.424392 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:19:24.424363    2579 scope.go:117] "RemoveContainer" containerID="51a78f2a92548ed84a1750295c05f0b420c995917a65c453e9f6336985cbe769"
Jul 14 20:19:24.424684 ip-10-0-140-201 kubenswrapper[2579]: E0714 20:19:24.424666    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"51a78f2a92548ed84a1750295c05f0b420c995917a65c453e9f6336985cbe769\": container with ID starting with 51a78f2a92548ed84a1750295c05f0b420c995917a65c453e9f6336985cbe769 not found: ID does not exist" containerID="51a78f2a92548ed84a1750295c05f0b420c995917a65c453e9f6336985cbe769"
Jul 14 20:19:24.424735 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:19:24.424693    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"51a78f2a92548ed84a1750295c05f0b420c995917a65c453e9f6336985cbe769"} err="failed to get container status \"51a78f2a92548ed84a1750295c05f0b420c995917a65c453e9f6336985cbe769\": rpc error: code = NotFound desc = could not find container \"51a78f2a92548ed84a1750295c05f0b420c995917a65c453e9f6336985cbe769\": container with ID starting with 51a78f2a92548ed84a1750295c05f0b420c995917a65c453e9f6336985cbe769 not found: ID does not exist"
Jul 14 20:19:24.471098 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:19:24.471055    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-df972874-openshift-default-7486d8b645-4w89m"]
Jul 14 20:19:24.492108 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:19:24.492073    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-df972874-openshift-default-7486d8b645-4w89m"]
Jul 14 20:19:24.847950 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:19:24.847911    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="003bdac5-b071-4819-84f7-400b684eeea1" path="/var/lib/kubelet/pods/003bdac5-b071-4819-84f7-400b684eeea1/volumes"
Jul 14 20:19:25.483049 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:19:25.483005    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-bc788bc2-mz6hd"]
Jul 14 20:19:25.483612 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:19:25.483594    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="003bdac5-b071-4819-84f7-400b684eeea1" containerName="istio-proxy"
Jul 14 20:19:25.483664 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:19:25.483616    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="003bdac5-b071-4819-84f7-400b684eeea1" containerName="istio-proxy"
Jul 14 20:19:25.483664 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:19:25.483632    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="003bdac5-b071-4819-84f7-400b684eeea1" containerName="istio-proxy"
Jul 14 20:19:25.483664 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:19:25.483641    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="003bdac5-b071-4819-84f7-400b684eeea1" containerName="istio-proxy"
Jul 14 20:19:25.483759 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:19:25.483727    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="003bdac5-b071-4819-84f7-400b684eeea1" containerName="istio-proxy"
Jul 14 20:19:25.483759 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:19:25.483741    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="003bdac5-b071-4819-84f7-400b684eeea1" containerName="istio-proxy"
Jul 14 20:19:25.488867 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:19:25.488844    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-bc788bc2-mz6hd"
Jul 14 20:19:25.496094 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:19:25.495563    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-4blwh\""
Jul 14 20:19:25.496094 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:19:25.495570    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 14 20:19:25.542655 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:19:25.542621    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-bc788bc2-mz6hd"]
Jul 14 20:19:25.549579 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:19:25.549513    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8d08ba89-fc79-4f8f-9d90-ed287314cf00-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-bc788bc2-mz6hd\" (UID: \"8d08ba89-fc79-4f8f-9d90-ed287314cf00\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-bc788bc2-mz6hd"
Jul 14 20:19:25.650656 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:19:25.650611    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8d08ba89-fc79-4f8f-9d90-ed287314cf00-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-bc788bc2-mz6hd\" (UID: \"8d08ba89-fc79-4f8f-9d90-ed287314cf00\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-bc788bc2-mz6hd"
Jul 14 20:19:25.651271 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:19:25.651250    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8d08ba89-fc79-4f8f-9d90-ed287314cf00-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-bc788bc2-mz6hd\" (UID: \"8d08ba89-fc79-4f8f-9d90-ed287314cf00\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-bc788bc2-mz6hd"
Jul 14 20:19:25.799380 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:19:25.799296    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-bc788bc2-mz6hd"
Jul 14 20:19:25.962630 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:19:25.962604    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-bc788bc2-mz6hd"]
Jul 14 20:19:25.964104 ip-10-0-140-201 kubenswrapper[2579]: W0714 20:19:25.964061    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8d08ba89_fc79_4f8f_9d90_ed287314cf00.slice/crio-f691c3c431b98024d0abc2eb9cf9ad046d72ec621f4c8e7ec42ea74becdb6c53 WatchSource:0}: Error finding container f691c3c431b98024d0abc2eb9cf9ad046d72ec621f4c8e7ec42ea74becdb6c53: Status 404 returned error can't find the container with id f691c3c431b98024d0abc2eb9cf9ad046d72ec621f4c8e7ec42ea74becdb6c53
Jul 14 20:19:26.420882 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:19:26.420841    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-bc788bc2-mz6hd" event={"ID":"8d08ba89-fc79-4f8f-9d90-ed287314cf00","Type":"ContainerStarted","Data":"282004cd548133067fcb3fea77bb7b9835f97d0894f5853f4e6876a47ab6d717"}
Jul 14 20:19:26.421048 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:19:26.420903    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-bc788bc2-mz6hd" event={"ID":"8d08ba89-fc79-4f8f-9d90-ed287314cf00","Type":"ContainerStarted","Data":"f691c3c431b98024d0abc2eb9cf9ad046d72ec621f4c8e7ec42ea74becdb6c53"}
Jul 14 20:19:26.469979 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:19:26.469928    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-bc788bc2-mz6hd" podStartSLOduration=1.469913748 podStartE2EDuration="1.469913748s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 20:19:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 20:19:26.468377278 +0000 UTC m=+1666.179972821" watchObservedRunningTime="2026-07-14 20:19:26.469913748 +0000 UTC m=+1666.181509350"
Jul 14 20:19:27.428054 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:19:27.428020    2579 generic.go:356] "Generic (PLEG): container finished" podID="8d08ba89-fc79-4f8f-9d90-ed287314cf00" containerID="282004cd548133067fcb3fea77bb7b9835f97d0894f5853f4e6876a47ab6d717" exitCode=7
Jul 14 20:19:27.428513 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:19:27.428111    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-bc788bc2-mz6hd" event={"ID":"8d08ba89-fc79-4f8f-9d90-ed287314cf00","Type":"ContainerDied","Data":"282004cd548133067fcb3fea77bb7b9835f97d0894f5853f4e6876a47ab6d717"}
Jul 14 20:19:27.428513 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:19:27.428239    2579 scope.go:117] "RemoveContainer" containerID="282004cd548133067fcb3fea77bb7b9835f97d0894f5853f4e6876a47ab6d717"
Jul 14 20:19:28.435551 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:19:28.435443    2579 generic.go:356] "Generic (PLEG): container finished" podID="8d08ba89-fc79-4f8f-9d90-ed287314cf00" containerID="489ed3a605a3e0fde048d1fabe6bfdb8ba04c1d6dfbd0bdb6c5aa8775b7f75e9" exitCode=7
Jul 14 20:19:28.435551 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:19:28.435509    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-bc788bc2-mz6hd" event={"ID":"8d08ba89-fc79-4f8f-9d90-ed287314cf00","Type":"ContainerDied","Data":"489ed3a605a3e0fde048d1fabe6bfdb8ba04c1d6dfbd0bdb6c5aa8775b7f75e9"}
Jul 14 20:19:28.435973 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:19:28.435598    2579 scope.go:117] "RemoveContainer" containerID="282004cd548133067fcb3fea77bb7b9835f97d0894f5853f4e6876a47ab6d717"
Jul 14 20:19:28.435973 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:19:28.435884    2579 scope.go:117] "RemoveContainer" containerID="489ed3a605a3e0fde048d1fabe6bfdb8ba04c1d6dfbd0bdb6c5aa8775b7f75e9"
Jul 14 20:19:28.436115 ip-10-0-140-201 kubenswrapper[2579]: E0714 20:19:28.436095    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-migrate-bc788bc2-mz6hd_odh-ai-gateway-infra(8d08ba89-fc79-4f8f-9d90-ed287314cf00)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-bc788bc2-mz6hd" podUID="8d08ba89-fc79-4f8f-9d90-ed287314cf00"
Jul 14 20:19:29.442683 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:19:29.442651    2579 scope.go:117] "RemoveContainer" containerID="489ed3a605a3e0fde048d1fabe6bfdb8ba04c1d6dfbd0bdb6c5aa8775b7f75e9"
Jul 14 20:19:29.443169 ip-10-0-140-201 kubenswrapper[2579]: E0714 20:19:29.442959    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-migrate-bc788bc2-mz6hd_odh-ai-gateway-infra(8d08ba89-fc79-4f8f-9d90-ed287314cf00)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-bc788bc2-mz6hd" podUID="8d08ba89-fc79-4f8f-9d90-ed287314cf00"
Jul 14 20:19:37.429707 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:19:37.429663    2579 patch_prober.go:28] interesting pod/e2e-migrate-bc788bc2-gw-openshift-default-7445d485cf-z6zgx container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.46:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Jul 14 20:19:37.430093 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:19:37.429730    2579 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-migrate-bc788bc2-gw-openshift-default-7445d485cf-z6zgx" podUID="2772d91b-18ac-481a-a835-92e71137207d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.46:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Jul 14 20:19:38.493120 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:19:38.493084    2579 generic.go:356] "Generic (PLEG): container finished" podID="2772d91b-18ac-481a-a835-92e71137207d" containerID="1ec03be952f4f7a40d8d99c9f7567c10e4b8af31a54d65aeaca4da45c74f2683" exitCode=0
Jul 14 20:19:38.493120 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:19:38.493121    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-bc788bc2-gw-openshift-default-7445d485cf-z6zgx" event={"ID":"2772d91b-18ac-481a-a835-92e71137207d","Type":"ContainerDied","Data":"1ec03be952f4f7a40d8d99c9f7567c10e4b8af31a54d65aeaca4da45c74f2683"}
Jul 14 20:19:38.493606 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:19:38.493519    2579 scope.go:117] "RemoveContainer" containerID="1ec03be952f4f7a40d8d99c9f7567c10e4b8af31a54d65aeaca4da45c74f2683"
Jul 14 20:19:38.494609 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:19:38.494580    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 14 20:19:38.494681 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:19:38.494666    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 14 20:19:38.494717 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:19:38.494707    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 14 20:19:39.501730 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:19:39.501690    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-bc788bc2-gw-openshift-default-7445d485cf-z6zgx" event={"ID":"2772d91b-18ac-481a-a835-92e71137207d","Type":"ContainerStarted","Data":"3b046f447fad2b2fa568345cc901c2976a025012bf7367b6d6bb7d65437c7a5e"}
Jul 14 20:19:40.074036 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:19:40.073931    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-migrate-bc788bc2-gw-openshift-default-7445d485cf-z6zgx"
Jul 14 20:19:40.074748 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:19:40.074716    2579 patch_prober.go:28] interesting pod/e2e-migrate-bc788bc2-gw-openshift-default-7445d485cf-z6zgx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.46:15021/healthz/ready\": dial tcp 10.133.0.46:15021: connect: connection refused" start-of-body=
Jul 14 20:19:40.074992 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:19:40.074962    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-bc788bc2-gw-openshift-default-7445d485cf-z6zgx" podUID="2772d91b-18ac-481a-a835-92e71137207d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.46:15021/healthz/ready\": dial tcp 10.133.0.46:15021: connect: connection refused"
Jul 14 20:19:41.076600 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:19:41.076064    2579 patch_prober.go:28] interesting pod/e2e-migrate-bc788bc2-gw-openshift-default-7445d485cf-z6zgx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.46:15021/healthz/ready\": dial tcp 10.133.0.46:15021: connect: connection refused" start-of-body=
Jul 14 20:19:41.076600 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:19:41.076135    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-bc788bc2-gw-openshift-default-7445d485cf-z6zgx" podUID="2772d91b-18ac-481a-a835-92e71137207d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.46:15021/healthz/ready\": dial tcp 10.133.0.46:15021: connect: connection refused"
Jul 14 20:19:41.842585 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:19:41.842552    2579 scope.go:117] "RemoveContainer" containerID="489ed3a605a3e0fde048d1fabe6bfdb8ba04c1d6dfbd0bdb6c5aa8775b7f75e9"
Jul 14 20:19:42.074443 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:19:42.074408    2579 patch_prober.go:28] interesting pod/e2e-migrate-bc788bc2-gw-openshift-default-7445d485cf-z6zgx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.46:15021/healthz/ready\": dial tcp 10.133.0.46:15021: connect: connection refused" start-of-body=
Jul 14 20:19:42.074742 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:19:42.074713    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-bc788bc2-gw-openshift-default-7445d485cf-z6zgx" podUID="2772d91b-18ac-481a-a835-92e71137207d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.46:15021/healthz/ready\": dial tcp 10.133.0.46:15021: connect: connection refused"
Jul 14 20:19:42.519870 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:19:42.519835    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-bc788bc2-mz6hd" event={"ID":"8d08ba89-fc79-4f8f-9d90-ed287314cf00","Type":"ContainerStarted","Data":"60fb17a2b4777d072cf4f77b8afe5c3623cfe95ab8b9ff811108760aba59db10"}
Jul 14 20:19:43.074210 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:19:43.074170    2579 patch_prober.go:28] interesting pod/e2e-migrate-bc788bc2-gw-openshift-default-7445d485cf-z6zgx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.46:15021/healthz/ready\": dial tcp 10.133.0.46:15021: connect: connection refused" start-of-body=
Jul 14 20:19:43.074504 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:19:43.074471    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-bc788bc2-gw-openshift-default-7445d485cf-z6zgx" podUID="2772d91b-18ac-481a-a835-92e71137207d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.46:15021/healthz/ready\": dial tcp 10.133.0.46:15021: connect: connection refused"
Jul 14 20:19:43.527307 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:19:43.527275    2579 generic.go:356] "Generic (PLEG): container finished" podID="8d08ba89-fc79-4f8f-9d90-ed287314cf00" containerID="60fb17a2b4777d072cf4f77b8afe5c3623cfe95ab8b9ff811108760aba59db10" exitCode=0
Jul 14 20:19:43.527735 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:19:43.527323    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-bc788bc2-mz6hd" event={"ID":"8d08ba89-fc79-4f8f-9d90-ed287314cf00","Type":"ContainerDied","Data":"60fb17a2b4777d072cf4f77b8afe5c3623cfe95ab8b9ff811108760aba59db10"}
Jul 14 20:19:43.527735 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:19:43.527370    2579 scope.go:117] "RemoveContainer" containerID="489ed3a605a3e0fde048d1fabe6bfdb8ba04c1d6dfbd0bdb6c5aa8775b7f75e9"
Jul 14 20:19:43.612817 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:19:43.612785    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-bc788bc2-mz6hd"]
Jul 14 20:19:44.077313 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:19:44.077281    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-migrate-bc788bc2-gw-openshift-default-7445d485cf-z6zgx"
Jul 14 20:19:44.077585 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:19:44.077560    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-migrate-bc788bc2-gw-openshift-default-7445d485cf-z6zgx"
Jul 14 20:19:44.078353 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:19:44.078336    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-migrate-bc788bc2-gw-openshift-default-7445d485cf-z6zgx"
Jul 14 20:19:44.674222 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:19:44.674200    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-bc788bc2-mz6hd"
Jul 14 20:19:44.843331 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:19:44.843233    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8d08ba89-fc79-4f8f-9d90-ed287314cf00-maas-api-service-ca\") pod \"8d08ba89-fc79-4f8f-9d90-ed287314cf00\" (UID: \"8d08ba89-fc79-4f8f-9d90-ed287314cf00\") "
Jul 14 20:19:44.843650 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:19:44.843627    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8d08ba89-fc79-4f8f-9d90-ed287314cf00-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "8d08ba89-fc79-4f8f-9d90-ed287314cf00" (UID: "8d08ba89-fc79-4f8f-9d90-ed287314cf00"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 14 20:19:44.944314 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:19:44.944283    2579 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8d08ba89-fc79-4f8f-9d90-ed287314cf00-maas-api-service-ca\") on node \"ip-10-0-140-201.ec2.internal\" DevicePath \"\""
Jul 14 20:19:45.541422 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:19:45.541393    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-bc788bc2-mz6hd"
Jul 14 20:19:45.541658 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:19:45.541426    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-bc788bc2-mz6hd" event={"ID":"8d08ba89-fc79-4f8f-9d90-ed287314cf00","Type":"ContainerDied","Data":"f691c3c431b98024d0abc2eb9cf9ad046d72ec621f4c8e7ec42ea74becdb6c53"}
Jul 14 20:19:45.541658 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:19:45.541471    2579 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="f691c3c431b98024d0abc2eb9cf9ad046d72ec621f4c8e7ec42ea74becdb6c53"
Jul 14 20:19:45.623782 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:19:45.623750    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-bc788bc2-mz6hd"]
Jul 14 20:19:45.625943 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:19:45.625921    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-bc788bc2-mz6hd"]
Jul 14 20:19:46.848111 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:19:46.848072    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8d08ba89-fc79-4f8f-9d90-ed287314cf00" path="/var/lib/kubelet/pods/8d08ba89-fc79-4f8f-9d90-ed287314cf00/volumes"
Jul 14 20:20:25.619105 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:20:25.619022    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-bc788bc2-4cz6b"]
Jul 14 20:20:25.619514 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:20:25.619396    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8d08ba89-fc79-4f8f-9d90-ed287314cf00" containerName="revoke-keys"
Jul 14 20:20:25.619514 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:20:25.619407    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="8d08ba89-fc79-4f8f-9d90-ed287314cf00" containerName="revoke-keys"
Jul 14 20:20:25.619514 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:20:25.619424    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8d08ba89-fc79-4f8f-9d90-ed287314cf00" containerName="revoke-keys"
Jul 14 20:20:25.619514 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:20:25.619429    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="8d08ba89-fc79-4f8f-9d90-ed287314cf00" containerName="revoke-keys"
Jul 14 20:20:25.619514 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:20:25.619490    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="8d08ba89-fc79-4f8f-9d90-ed287314cf00" containerName="revoke-keys"
Jul 14 20:20:25.619514 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:20:25.619503    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="8d08ba89-fc79-4f8f-9d90-ed287314cf00" containerName="revoke-keys"
Jul 14 20:20:25.622730 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:20:25.622701    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-bc788bc2-4cz6b"
Jul 14 20:20:25.628270 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:20:25.628246    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 14 20:20:25.629104 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:20:25.629082    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-4blwh\""
Jul 14 20:20:25.670494 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:20:25.670458    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-bc788bc2-4cz6b"]
Jul 14 20:20:25.672960 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:20:25.672927    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-migrate-bc788bc2-gw-openshift-default-7445d485cf-z6zgx"]
Jul 14 20:20:25.673492 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:20:25.673371    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-migrate-bc788bc2-gw-openshift-default-7445d485cf-z6zgx" podUID="2772d91b-18ac-481a-a835-92e71137207d" containerName="istio-proxy" containerID="cri-o://3b046f447fad2b2fa568345cc901c2976a025012bf7367b6d6bb7d65437c7a5e" gracePeriod=30
Jul 14 20:20:25.746644 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:20:25.746601    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0b9dab5a-10cc-498f-9cb0-c66352b9e4c8-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-bc788bc2-4cz6b\" (UID: \"0b9dab5a-10cc-498f-9cb0-c66352b9e4c8\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-bc788bc2-4cz6b"
Jul 14 20:20:25.847543 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:20:25.847494    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0b9dab5a-10cc-498f-9cb0-c66352b9e4c8-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-bc788bc2-4cz6b\" (UID: \"0b9dab5a-10cc-498f-9cb0-c66352b9e4c8\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-bc788bc2-4cz6b"
Jul 14 20:20:25.848134 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:20:25.848116    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0b9dab5a-10cc-498f-9cb0-c66352b9e4c8-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-bc788bc2-4cz6b\" (UID: \"0b9dab5a-10cc-498f-9cb0-c66352b9e4c8\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-bc788bc2-4cz6b"
Jul 14 20:20:25.933333 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:20:25.933246    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-bc788bc2-4cz6b"
Jul 14 20:20:26.122704 ip-10-0-140-201 kubenswrapper[2579]: W0714 20:20:26.122658    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0b9dab5a_10cc_498f_9cb0_c66352b9e4c8.slice/crio-e7318a5f22685eaabae76b978d9fdd6c213d9968da251ff4e7c3fb1ecd3fb1fb WatchSource:0}: Error finding container e7318a5f22685eaabae76b978d9fdd6c213d9968da251ff4e7c3fb1ecd3fb1fb: Status 404 returned error can't find the container with id e7318a5f22685eaabae76b978d9fdd6c213d9968da251ff4e7c3fb1ecd3fb1fb
Jul 14 20:20:26.124708 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:20:26.124686    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-bc788bc2-4cz6b"]
Jul 14 20:20:26.775632 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:20:26.775592    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-bc788bc2-4cz6b" event={"ID":"0b9dab5a-10cc-498f-9cb0-c66352b9e4c8","Type":"ContainerStarted","Data":"50ef8ffb6e5cdaaa08e04fb25ef6a94b34fd70a15ae2884fc0547f8f97d6cbaa"}
Jul 14 20:20:26.776098 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:20:26.775654    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-bc788bc2-4cz6b" event={"ID":"0b9dab5a-10cc-498f-9cb0-c66352b9e4c8","Type":"ContainerStarted","Data":"e7318a5f22685eaabae76b978d9fdd6c213d9968da251ff4e7c3fb1ecd3fb1fb"}
Jul 14 20:20:27.782686 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:20:27.782654    2579 generic.go:356] "Generic (PLEG): container finished" podID="0b9dab5a-10cc-498f-9cb0-c66352b9e4c8" containerID="50ef8ffb6e5cdaaa08e04fb25ef6a94b34fd70a15ae2884fc0547f8f97d6cbaa" exitCode=0
Jul 14 20:20:27.782686 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:20:27.782690    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-bc788bc2-4cz6b" event={"ID":"0b9dab5a-10cc-498f-9cb0-c66352b9e4c8","Type":"ContainerDied","Data":"50ef8ffb6e5cdaaa08e04fb25ef6a94b34fd70a15ae2884fc0547f8f97d6cbaa"}
Jul 14 20:20:28.916170 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:20:28.916141    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-bc788bc2-4cz6b"
Jul 14 20:20:29.078264 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:20:29.078170    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0b9dab5a-10cc-498f-9cb0-c66352b9e4c8-maas-api-service-ca\") pod \"0b9dab5a-10cc-498f-9cb0-c66352b9e4c8\" (UID: \"0b9dab5a-10cc-498f-9cb0-c66352b9e4c8\") "
Jul 14 20:20:29.078637 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:20:29.078513    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0b9dab5a-10cc-498f-9cb0-c66352b9e4c8-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "0b9dab5a-10cc-498f-9cb0-c66352b9e4c8" (UID: "0b9dab5a-10cc-498f-9cb0-c66352b9e4c8"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 14 20:20:29.080312 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:20:29.080283    2579 patch_prober.go:28] interesting pod/e2e-migrate-bc788bc2-gw-openshift-default-7445d485cf-z6zgx container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 14 20:20:29.080440 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:20:29.080338    2579 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-migrate-bc788bc2-gw-openshift-default-7445d485cf-z6zgx" podUID="2772d91b-18ac-481a-a835-92e71137207d" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 14 20:20:29.179082 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:20:29.179049    2579 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0b9dab5a-10cc-498f-9cb0-c66352b9e4c8-maas-api-service-ca\") on node \"ip-10-0-140-201.ec2.internal\" DevicePath \"\""
Jul 14 20:20:29.794956 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:20:29.794922    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-bc788bc2-4cz6b"
Jul 14 20:20:29.794956 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:20:29.794944    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-bc788bc2-4cz6b" event={"ID":"0b9dab5a-10cc-498f-9cb0-c66352b9e4c8","Type":"ContainerDied","Data":"e7318a5f22685eaabae76b978d9fdd6c213d9968da251ff4e7c3fb1ecd3fb1fb"}
Jul 14 20:20:29.795167 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:20:29.794995    2579 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e7318a5f22685eaabae76b978d9fdd6c213d9968da251ff4e7c3fb1ecd3fb1fb"
Jul 14 20:20:30.802524 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:20:30.802492    2579 generic.go:356] "Generic (PLEG): container finished" podID="2772d91b-18ac-481a-a835-92e71137207d" containerID="3b046f447fad2b2fa568345cc901c2976a025012bf7367b6d6bb7d65437c7a5e" exitCode=0
Jul 14 20:20:30.802928 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:20:30.802574    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-bc788bc2-gw-openshift-default-7445d485cf-z6zgx" event={"ID":"2772d91b-18ac-481a-a835-92e71137207d","Type":"ContainerDied","Data":"3b046f447fad2b2fa568345cc901c2976a025012bf7367b6d6bb7d65437c7a5e"}
Jul 14 20:20:30.802928 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:20:30.802635    2579 scope.go:117] "RemoveContainer" containerID="1ec03be952f4f7a40d8d99c9f7567c10e4b8af31a54d65aeaca4da45c74f2683"
Jul 14 20:20:30.941063 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:20:30.940998    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-bc788bc2-gw-openshift-default-7445d485cf-z6zgx"
Jul 14 20:20:31.096678 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:20:31.096649    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2772d91b-18ac-481a-a835-92e71137207d-istio-podinfo\") pod \"2772d91b-18ac-481a-a835-92e71137207d\" (UID: \"2772d91b-18ac-481a-a835-92e71137207d\") "
Jul 14 20:20:31.096850 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:20:31.096741    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2772d91b-18ac-481a-a835-92e71137207d-workload-socket\") pod \"2772d91b-18ac-481a-a835-92e71137207d\" (UID: \"2772d91b-18ac-481a-a835-92e71137207d\") "
Jul 14 20:20:31.096850 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:20:31.096764    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2772d91b-18ac-481a-a835-92e71137207d-istio-token\") pod \"2772d91b-18ac-481a-a835-92e71137207d\" (UID: \"2772d91b-18ac-481a-a835-92e71137207d\") "
Jul 14 20:20:31.096850 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:20:31.096794    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2772d91b-18ac-481a-a835-92e71137207d-istio-envoy\") pod \"2772d91b-18ac-481a-a835-92e71137207d\" (UID: \"2772d91b-18ac-481a-a835-92e71137207d\") "
Jul 14 20:20:31.096850 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:20:31.096820    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2772d91b-18ac-481a-a835-92e71137207d-istio-data\") pod \"2772d91b-18ac-481a-a835-92e71137207d\" (UID: \"2772d91b-18ac-481a-a835-92e71137207d\") "
Jul 14 20:20:31.097043 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:20:31.096874    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6hzjz\" (UniqueName: \"kubernetes.io/projected/2772d91b-18ac-481a-a835-92e71137207d-kube-api-access-6hzjz\") pod \"2772d91b-18ac-481a-a835-92e71137207d\" (UID: \"2772d91b-18ac-481a-a835-92e71137207d\") "
Jul 14 20:20:31.097043 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:20:31.096903    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2772d91b-18ac-481a-a835-92e71137207d-credential-socket\") pod \"2772d91b-18ac-481a-a835-92e71137207d\" (UID: \"2772d91b-18ac-481a-a835-92e71137207d\") "
Jul 14 20:20:31.097043 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:20:31.096946    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2772d91b-18ac-481a-a835-92e71137207d-istiod-ca-cert\") pod \"2772d91b-18ac-481a-a835-92e71137207d\" (UID: \"2772d91b-18ac-481a-a835-92e71137207d\") "
Jul 14 20:20:31.097043 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:20:31.096986    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2772d91b-18ac-481a-a835-92e71137207d-workload-certs\") pod \"2772d91b-18ac-481a-a835-92e71137207d\" (UID: \"2772d91b-18ac-481a-a835-92e71137207d\") "
Jul 14 20:20:31.097245 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:20:31.097059    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2772d91b-18ac-481a-a835-92e71137207d-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "2772d91b-18ac-481a-a835-92e71137207d" (UID: "2772d91b-18ac-481a-a835-92e71137207d"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 20:20:31.097332 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:20:31.097299    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2772d91b-18ac-481a-a835-92e71137207d-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "2772d91b-18ac-481a-a835-92e71137207d" (UID: "2772d91b-18ac-481a-a835-92e71137207d"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 20:20:31.097402 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:20:31.097345    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2772d91b-18ac-481a-a835-92e71137207d-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "2772d91b-18ac-481a-a835-92e71137207d" (UID: "2772d91b-18ac-481a-a835-92e71137207d"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 20:20:31.097456 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:20:31.097410    2579 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2772d91b-18ac-481a-a835-92e71137207d-workload-socket\") on node \"ip-10-0-140-201.ec2.internal\" DevicePath \"\""
Jul 14 20:20:31.097456 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:20:31.097430    2579 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2772d91b-18ac-481a-a835-92e71137207d-workload-certs\") on node \"ip-10-0-140-201.ec2.internal\" DevicePath \"\""
Jul 14 20:20:31.097845 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:20:31.097816    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2772d91b-18ac-481a-a835-92e71137207d-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "2772d91b-18ac-481a-a835-92e71137207d" (UID: "2772d91b-18ac-481a-a835-92e71137207d"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 14 20:20:31.098313 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:20:31.098284    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2772d91b-18ac-481a-a835-92e71137207d-istio-data" (OuterVolumeSpecName: "istio-data") pod "2772d91b-18ac-481a-a835-92e71137207d" (UID: "2772d91b-18ac-481a-a835-92e71137207d"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 20:20:31.099204 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:20:31.099176    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2772d91b-18ac-481a-a835-92e71137207d-istio-token" (OuterVolumeSpecName: "istio-token") pod "2772d91b-18ac-481a-a835-92e71137207d" (UID: "2772d91b-18ac-481a-a835-92e71137207d"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 14 20:20:31.099308 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:20:31.099214    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/2772d91b-18ac-481a-a835-92e71137207d-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "2772d91b-18ac-481a-a835-92e71137207d" (UID: "2772d91b-18ac-481a-a835-92e71137207d"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 14 20:20:31.099308 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:20:31.099242    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2772d91b-18ac-481a-a835-92e71137207d-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "2772d91b-18ac-481a-a835-92e71137207d" (UID: "2772d91b-18ac-481a-a835-92e71137207d"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 20:20:31.099308 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:20:31.099265    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2772d91b-18ac-481a-a835-92e71137207d-kube-api-access-6hzjz" (OuterVolumeSpecName: "kube-api-access-6hzjz") pod "2772d91b-18ac-481a-a835-92e71137207d" (UID: "2772d91b-18ac-481a-a835-92e71137207d"). InnerVolumeSpecName "kube-api-access-6hzjz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 14 20:20:31.198881 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:20:31.198795    2579 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2772d91b-18ac-481a-a835-92e71137207d-istiod-ca-cert\") on node \"ip-10-0-140-201.ec2.internal\" DevicePath \"\""
Jul 14 20:20:31.198881 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:20:31.198824    2579 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2772d91b-18ac-481a-a835-92e71137207d-istio-podinfo\") on node \"ip-10-0-140-201.ec2.internal\" DevicePath \"\""
Jul 14 20:20:31.198881 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:20:31.198833    2579 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2772d91b-18ac-481a-a835-92e71137207d-istio-token\") on node \"ip-10-0-140-201.ec2.internal\" DevicePath \"\""
Jul 14 20:20:31.198881 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:20:31.198841    2579 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2772d91b-18ac-481a-a835-92e71137207d-istio-envoy\") on node \"ip-10-0-140-201.ec2.internal\" DevicePath \"\""
Jul 14 20:20:31.198881 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:20:31.198848    2579 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2772d91b-18ac-481a-a835-92e71137207d-istio-data\") on node \"ip-10-0-140-201.ec2.internal\" DevicePath \"\""
Jul 14 20:20:31.198881 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:20:31.198856    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6hzjz\" (UniqueName: \"kubernetes.io/projected/2772d91b-18ac-481a-a835-92e71137207d-kube-api-access-6hzjz\") on node \"ip-10-0-140-201.ec2.internal\" DevicePath \"\""
Jul 14 20:20:31.198881 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:20:31.198864    2579 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2772d91b-18ac-481a-a835-92e71137207d-credential-socket\") on node \"ip-10-0-140-201.ec2.internal\" DevicePath \"\""
Jul 14 20:20:31.809243 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:20:31.809207    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-bc788bc2-gw-openshift-default-7445d485cf-z6zgx" event={"ID":"2772d91b-18ac-481a-a835-92e71137207d","Type":"ContainerDied","Data":"4166365c2d862d7cccd9cf871d10a038052902bdb65ca36a41ffbe16e220f721"}
Jul 14 20:20:31.809851 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:20:31.809250    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-bc788bc2-gw-openshift-default-7445d485cf-z6zgx"
Jul 14 20:20:31.809851 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:20:31.809267    2579 scope.go:117] "RemoveContainer" containerID="3b046f447fad2b2fa568345cc901c2976a025012bf7367b6d6bb7d65437c7a5e"
Jul 14 20:20:31.865016 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:20:31.864969    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-migrate-bc788bc2-gw-openshift-default-7445d485cf-z6zgx"]
Jul 14 20:20:31.876661 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:20:31.876633    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-migrate-bc788bc2-gw-openshift-default-7445d485cf-z6zgx"]
Jul 14 20:20:32.846811 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:20:32.846777    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2772d91b-18ac-481a-a835-92e71137207d" path="/var/lib/kubelet/pods/2772d91b-18ac-481a-a835-92e71137207d/volumes"
Jul 14 20:20:43.055234 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:20:43.055201    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-c7cbf2c9-openshift-default-6d7bb9f745-wdgtw"]
Jul 14 20:20:43.055784 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:20:43.055764    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0b9dab5a-10cc-498f-9cb0-c66352b9e4c8" containerName="revoke-keys"
Jul 14 20:20:43.055831 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:20:43.055789    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="0b9dab5a-10cc-498f-9cb0-c66352b9e4c8" containerName="revoke-keys"
Jul 14 20:20:43.055831 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:20:43.055807    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8d08ba89-fc79-4f8f-9d90-ed287314cf00" containerName="revoke-keys"
Jul 14 20:20:43.055831 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:20:43.055816    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="8d08ba89-fc79-4f8f-9d90-ed287314cf00" containerName="revoke-keys"
Jul 14 20:20:43.055928 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:20:43.055849    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2772d91b-18ac-481a-a835-92e71137207d" containerName="istio-proxy"
Jul 14 20:20:43.055928 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:20:43.055857    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="2772d91b-18ac-481a-a835-92e71137207d" containerName="istio-proxy"
Jul 14 20:20:43.055928 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:20:43.055869    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2772d91b-18ac-481a-a835-92e71137207d" containerName="istio-proxy"
Jul 14 20:20:43.055928 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:20:43.055877    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="2772d91b-18ac-481a-a835-92e71137207d" containerName="istio-proxy"
Jul 14 20:20:43.056049 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:20:43.055964    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="2772d91b-18ac-481a-a835-92e71137207d" containerName="istio-proxy"
Jul 14 20:20:43.056049 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:20:43.055977    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="0b9dab5a-10cc-498f-9cb0-c66352b9e4c8" containerName="revoke-keys"
Jul 14 20:20:43.056049 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:20:43.055989    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="8d08ba89-fc79-4f8f-9d90-ed287314cf00" containerName="revoke-keys"
Jul 14 20:20:43.059576 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:20:43.059553    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-c7cbf2c9-openshift-default-6d7bb9f745-wdgtw"
Jul 14 20:20:43.065719 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:20:43.065695    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-c7cbf2c9-openshift-default-dockercfg-d5b97\""
Jul 14 20:20:43.093630 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:20:43.093595    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/eeb10f2d-fd76-4897-95f3-da7a3d2bd49a-workload-socket\") pod \"e2e-ait-c7cbf2c9-openshift-default-6d7bb9f745-wdgtw\" (UID: \"eeb10f2d-fd76-4897-95f3-da7a3d2bd49a\") " pod="openshift-ingress/e2e-ait-c7cbf2c9-openshift-default-6d7bb9f745-wdgtw"
Jul 14 20:20:43.093802 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:20:43.093641    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/eeb10f2d-fd76-4897-95f3-da7a3d2bd49a-istio-envoy\") pod \"e2e-ait-c7cbf2c9-openshift-default-6d7bb9f745-wdgtw\" (UID: \"eeb10f2d-fd76-4897-95f3-da7a3d2bd49a\") " pod="openshift-ingress/e2e-ait-c7cbf2c9-openshift-default-6d7bb9f745-wdgtw"
Jul 14 20:20:43.093802 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:20:43.093677    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/eeb10f2d-fd76-4897-95f3-da7a3d2bd49a-workload-certs\") pod \"e2e-ait-c7cbf2c9-openshift-default-6d7bb9f745-wdgtw\" (UID: \"eeb10f2d-fd76-4897-95f3-da7a3d2bd49a\") " pod="openshift-ingress/e2e-ait-c7cbf2c9-openshift-default-6d7bb9f745-wdgtw"
Jul 14 20:20:43.093802 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:20:43.093744    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/eeb10f2d-fd76-4897-95f3-da7a3d2bd49a-istio-token\") pod \"e2e-ait-c7cbf2c9-openshift-default-6d7bb9f745-wdgtw\" (UID: \"eeb10f2d-fd76-4897-95f3-da7a3d2bd49a\") " pod="openshift-ingress/e2e-ait-c7cbf2c9-openshift-default-6d7bb9f745-wdgtw"
Jul 14 20:20:43.093802 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:20:43.093781    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/eeb10f2d-fd76-4897-95f3-da7a3d2bd49a-istio-data\") pod \"e2e-ait-c7cbf2c9-openshift-default-6d7bb9f745-wdgtw\" (UID: \"eeb10f2d-fd76-4897-95f3-da7a3d2bd49a\") " pod="openshift-ingress/e2e-ait-c7cbf2c9-openshift-default-6d7bb9f745-wdgtw"
Jul 14 20:20:43.093962 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:20:43.093806    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/eeb10f2d-fd76-4897-95f3-da7a3d2bd49a-credential-socket\") pod \"e2e-ait-c7cbf2c9-openshift-default-6d7bb9f745-wdgtw\" (UID: \"eeb10f2d-fd76-4897-95f3-da7a3d2bd49a\") " pod="openshift-ingress/e2e-ait-c7cbf2c9-openshift-default-6d7bb9f745-wdgtw"
Jul 14 20:20:43.093962 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:20:43.093849    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cdvfv\" (UniqueName: \"kubernetes.io/projected/eeb10f2d-fd76-4897-95f3-da7a3d2bd49a-kube-api-access-cdvfv\") pod \"e2e-ait-c7cbf2c9-openshift-default-6d7bb9f745-wdgtw\" (UID: \"eeb10f2d-fd76-4897-95f3-da7a3d2bd49a\") " pod="openshift-ingress/e2e-ait-c7cbf2c9-openshift-default-6d7bb9f745-wdgtw"
Jul 14 20:20:43.093962 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:20:43.093877    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/eeb10f2d-fd76-4897-95f3-da7a3d2bd49a-istio-podinfo\") pod \"e2e-ait-c7cbf2c9-openshift-default-6d7bb9f745-wdgtw\" (UID: \"eeb10f2d-fd76-4897-95f3-da7a3d2bd49a\") " pod="openshift-ingress/e2e-ait-c7cbf2c9-openshift-default-6d7bb9f745-wdgtw"
Jul 14 20:20:43.093962 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:20:43.093895    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/eeb10f2d-fd76-4897-95f3-da7a3d2bd49a-istiod-ca-cert\") pod \"e2e-ait-c7cbf2c9-openshift-default-6d7bb9f745-wdgtw\" (UID: \"eeb10f2d-fd76-4897-95f3-da7a3d2bd49a\") " pod="openshift-ingress/e2e-ait-c7cbf2c9-openshift-default-6d7bb9f745-wdgtw"
Jul 14 20:20:43.155085 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:20:43.155051    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-c7cbf2c9-openshift-default-6d7bb9f745-wdgtw"]
Jul 14 20:20:43.194823 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:20:43.194787    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/eeb10f2d-fd76-4897-95f3-da7a3d2bd49a-workload-socket\") pod \"e2e-ait-c7cbf2c9-openshift-default-6d7bb9f745-wdgtw\" (UID: \"eeb10f2d-fd76-4897-95f3-da7a3d2bd49a\") " pod="openshift-ingress/e2e-ait-c7cbf2c9-openshift-default-6d7bb9f745-wdgtw"
Jul 14 20:20:43.195022 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:20:43.194829    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/eeb10f2d-fd76-4897-95f3-da7a3d2bd49a-istio-envoy\") pod \"e2e-ait-c7cbf2c9-openshift-default-6d7bb9f745-wdgtw\" (UID: \"eeb10f2d-fd76-4897-95f3-da7a3d2bd49a\") " pod="openshift-ingress/e2e-ait-c7cbf2c9-openshift-default-6d7bb9f745-wdgtw"
Jul 14 20:20:43.195022 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:20:43.194859    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/eeb10f2d-fd76-4897-95f3-da7a3d2bd49a-workload-certs\") pod \"e2e-ait-c7cbf2c9-openshift-default-6d7bb9f745-wdgtw\" (UID: \"eeb10f2d-fd76-4897-95f3-da7a3d2bd49a\") " pod="openshift-ingress/e2e-ait-c7cbf2c9-openshift-default-6d7bb9f745-wdgtw"
Jul 14 20:20:43.195022 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:20:43.194882    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/eeb10f2d-fd76-4897-95f3-da7a3d2bd49a-istio-token\") pod \"e2e-ait-c7cbf2c9-openshift-default-6d7bb9f745-wdgtw\" (UID: \"eeb10f2d-fd76-4897-95f3-da7a3d2bd49a\") " pod="openshift-ingress/e2e-ait-c7cbf2c9-openshift-default-6d7bb9f745-wdgtw"
Jul 14 20:20:43.195022 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:20:43.194915    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/eeb10f2d-fd76-4897-95f3-da7a3d2bd49a-istio-data\") pod \"e2e-ait-c7cbf2c9-openshift-default-6d7bb9f745-wdgtw\" (UID: \"eeb10f2d-fd76-4897-95f3-da7a3d2bd49a\") " pod="openshift-ingress/e2e-ait-c7cbf2c9-openshift-default-6d7bb9f745-wdgtw"
Jul 14 20:20:43.195022 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:20:43.194942    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/eeb10f2d-fd76-4897-95f3-da7a3d2bd49a-credential-socket\") pod \"e2e-ait-c7cbf2c9-openshift-default-6d7bb9f745-wdgtw\" (UID: \"eeb10f2d-fd76-4897-95f3-da7a3d2bd49a\") " pod="openshift-ingress/e2e-ait-c7cbf2c9-openshift-default-6d7bb9f745-wdgtw"
Jul 14 20:20:43.195022 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:20:43.194965    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cdvfv\" (UniqueName: \"kubernetes.io/projected/eeb10f2d-fd76-4897-95f3-da7a3d2bd49a-kube-api-access-cdvfv\") pod \"e2e-ait-c7cbf2c9-openshift-default-6d7bb9f745-wdgtw\" (UID: \"eeb10f2d-fd76-4897-95f3-da7a3d2bd49a\") " pod="openshift-ingress/e2e-ait-c7cbf2c9-openshift-default-6d7bb9f745-wdgtw"
Jul 14 20:20:43.195022 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:20:43.194998    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/eeb10f2d-fd76-4897-95f3-da7a3d2bd49a-istio-podinfo\") pod \"e2e-ait-c7cbf2c9-openshift-default-6d7bb9f745-wdgtw\" (UID: \"eeb10f2d-fd76-4897-95f3-da7a3d2bd49a\") " pod="openshift-ingress/e2e-ait-c7cbf2c9-openshift-default-6d7bb9f745-wdgtw"
Jul 14 20:20:43.195380 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:20:43.195027    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/eeb10f2d-fd76-4897-95f3-da7a3d2bd49a-istiod-ca-cert\") pod \"e2e-ait-c7cbf2c9-openshift-default-6d7bb9f745-wdgtw\" (UID: \"eeb10f2d-fd76-4897-95f3-da7a3d2bd49a\") " pod="openshift-ingress/e2e-ait-c7cbf2c9-openshift-default-6d7bb9f745-wdgtw"
Jul 14 20:20:43.195380 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:20:43.195256    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/eeb10f2d-fd76-4897-95f3-da7a3d2bd49a-workload-socket\") pod \"e2e-ait-c7cbf2c9-openshift-default-6d7bb9f745-wdgtw\" (UID: \"eeb10f2d-fd76-4897-95f3-da7a3d2bd49a\") " pod="openshift-ingress/e2e-ait-c7cbf2c9-openshift-default-6d7bb9f745-wdgtw"
Jul 14 20:20:43.195380 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:20:43.195307    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/eeb10f2d-fd76-4897-95f3-da7a3d2bd49a-workload-certs\") pod \"e2e-ait-c7cbf2c9-openshift-default-6d7bb9f745-wdgtw\" (UID: \"eeb10f2d-fd76-4897-95f3-da7a3d2bd49a\") " pod="openshift-ingress/e2e-ait-c7cbf2c9-openshift-default-6d7bb9f745-wdgtw"
Jul 14 20:20:43.195491 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:20:43.195430    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/eeb10f2d-fd76-4897-95f3-da7a3d2bd49a-istio-data\") pod \"e2e-ait-c7cbf2c9-openshift-default-6d7bb9f745-wdgtw\" (UID: \"eeb10f2d-fd76-4897-95f3-da7a3d2bd49a\") " pod="openshift-ingress/e2e-ait-c7cbf2c9-openshift-default-6d7bb9f745-wdgtw"
Jul 14 20:20:43.195703 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:20:43.195681    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/eeb10f2d-fd76-4897-95f3-da7a3d2bd49a-credential-socket\") pod \"e2e-ait-c7cbf2c9-openshift-default-6d7bb9f745-wdgtw\" (UID: \"eeb10f2d-fd76-4897-95f3-da7a3d2bd49a\") " pod="openshift-ingress/e2e-ait-c7cbf2c9-openshift-default-6d7bb9f745-wdgtw"
Jul 14 20:20:43.195784 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:20:43.195768    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/eeb10f2d-fd76-4897-95f3-da7a3d2bd49a-istiod-ca-cert\") pod \"e2e-ait-c7cbf2c9-openshift-default-6d7bb9f745-wdgtw\" (UID: \"eeb10f2d-fd76-4897-95f3-da7a3d2bd49a\") " pod="openshift-ingress/e2e-ait-c7cbf2c9-openshift-default-6d7bb9f745-wdgtw"
Jul 14 20:20:43.197320 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:20:43.197298    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/eeb10f2d-fd76-4897-95f3-da7a3d2bd49a-istio-envoy\") pod \"e2e-ait-c7cbf2c9-openshift-default-6d7bb9f745-wdgtw\" (UID: \"eeb10f2d-fd76-4897-95f3-da7a3d2bd49a\") " pod="openshift-ingress/e2e-ait-c7cbf2c9-openshift-default-6d7bb9f745-wdgtw"
Jul 14 20:20:43.197651 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:20:43.197631    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/eeb10f2d-fd76-4897-95f3-da7a3d2bd49a-istio-podinfo\") pod \"e2e-ait-c7cbf2c9-openshift-default-6d7bb9f745-wdgtw\" (UID: \"eeb10f2d-fd76-4897-95f3-da7a3d2bd49a\") " pod="openshift-ingress/e2e-ait-c7cbf2c9-openshift-default-6d7bb9f745-wdgtw"
Jul 14 20:20:43.248983 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:20:43.248944    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cdvfv\" (UniqueName: \"kubernetes.io/projected/eeb10f2d-fd76-4897-95f3-da7a3d2bd49a-kube-api-access-cdvfv\") pod \"e2e-ait-c7cbf2c9-openshift-default-6d7bb9f745-wdgtw\" (UID: \"eeb10f2d-fd76-4897-95f3-da7a3d2bd49a\") " pod="openshift-ingress/e2e-ait-c7cbf2c9-openshift-default-6d7bb9f745-wdgtw"
Jul 14 20:20:43.268876 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:20:43.268843    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/eeb10f2d-fd76-4897-95f3-da7a3d2bd49a-istio-token\") pod \"e2e-ait-c7cbf2c9-openshift-default-6d7bb9f745-wdgtw\" (UID: \"eeb10f2d-fd76-4897-95f3-da7a3d2bd49a\") " pod="openshift-ingress/e2e-ait-c7cbf2c9-openshift-default-6d7bb9f745-wdgtw"
Jul 14 20:20:43.369861 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:20:43.369773    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-c7cbf2c9-openshift-default-6d7bb9f745-wdgtw"
Jul 14 20:20:43.547496 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:20:43.547461    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-c7cbf2c9-openshift-default-6d7bb9f745-wdgtw"]
Jul 14 20:20:43.552410 ip-10-0-140-201 kubenswrapper[2579]: W0714 20:20:43.552383    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeeb10f2d_fd76_4897_95f3_da7a3d2bd49a.slice/crio-c6205c887bdc7eb9719919a4b0ee1d5203c7c97de5e5ac595c73d13ebf65af70 WatchSource:0}: Error finding container c6205c887bdc7eb9719919a4b0ee1d5203c7c97de5e5ac595c73d13ebf65af70: Status 404 returned error can't find the container with id c6205c887bdc7eb9719919a4b0ee1d5203c7c97de5e5ac595c73d13ebf65af70
Jul 14 20:20:43.554547 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:20:43.554499    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 14 20:20:43.554638 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:20:43.554593    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 14 20:20:43.554638 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:20:43.554622    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 14 20:20:43.879765 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:20:43.879729    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-c7cbf2c9-openshift-default-6d7bb9f745-wdgtw" event={"ID":"eeb10f2d-fd76-4897-95f3-da7a3d2bd49a","Type":"ContainerStarted","Data":"dde09df97022b9dc940a3ad7e6fa48ffd61eaa405e4562aad05da49200b4f05c"}
Jul 14 20:20:43.879973 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:20:43.879779    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-c7cbf2c9-openshift-default-6d7bb9f745-wdgtw" event={"ID":"eeb10f2d-fd76-4897-95f3-da7a3d2bd49a","Type":"ContainerStarted","Data":"c6205c887bdc7eb9719919a4b0ee1d5203c7c97de5e5ac595c73d13ebf65af70"}
Jul 14 20:20:43.998480 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:20:43.998422    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-c7cbf2c9-openshift-default-6d7bb9f745-wdgtw" podStartSLOduration=0.998405482 podStartE2EDuration="998.405482ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 20:20:43 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 20:20:43.996867682 +0000 UTC m=+1743.708463228" watchObservedRunningTime="2026-07-14 20:20:43.998405482 +0000 UTC m=+1743.710001025"
Jul 14 20:20:44.370602 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:20:44.370558    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-c7cbf2c9-openshift-default-6d7bb9f745-wdgtw"
Jul 14 20:20:44.375459 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:20:44.375433    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-c7cbf2c9-openshift-default-6d7bb9f745-wdgtw"
Jul 14 20:20:44.885593 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:20:44.885562    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-c7cbf2c9-openshift-default-6d7bb9f745-wdgtw"
Jul 14 20:20:44.886652 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:20:44.886631    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-c7cbf2c9-openshift-default-6d7bb9f745-wdgtw"
Jul 14 20:21:00.927727 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:21:00.927686    2579 patch_prober.go:28] interesting pod/e2e-ait-c7cbf2c9-openshift-default-6d7bb9f745-wdgtw container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.49:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Jul 14 20:21:00.928135 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:21:00.927749    2579 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ait-c7cbf2c9-openshift-default-6d7bb9f745-wdgtw" podUID="eeb10f2d-fd76-4897-95f3-da7a3d2bd49a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.49:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Jul 14 20:21:01.983791 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:21:01.983759    2579 generic.go:356] "Generic (PLEG): container finished" podID="eeb10f2d-fd76-4897-95f3-da7a3d2bd49a" containerID="dde09df97022b9dc940a3ad7e6fa48ffd61eaa405e4562aad05da49200b4f05c" exitCode=0
Jul 14 20:21:01.984229 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:21:01.983822    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-c7cbf2c9-openshift-default-6d7bb9f745-wdgtw" event={"ID":"eeb10f2d-fd76-4897-95f3-da7a3d2bd49a","Type":"ContainerDied","Data":"dde09df97022b9dc940a3ad7e6fa48ffd61eaa405e4562aad05da49200b4f05c"}
Jul 14 20:21:01.984229 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:21:01.984186    2579 scope.go:117] "RemoveContainer" containerID="dde09df97022b9dc940a3ad7e6fa48ffd61eaa405e4562aad05da49200b4f05c"
Jul 14 20:21:01.985158 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:21:01.985131    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 14 20:21:01.985214 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:21:01.985201    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 14 20:21:01.985251 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:21:01.985236    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 14 20:21:02.996826 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:21:02.996785    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-c7cbf2c9-openshift-default-6d7bb9f745-wdgtw" event={"ID":"eeb10f2d-fd76-4897-95f3-da7a3d2bd49a","Type":"ContainerStarted","Data":"070fc8220720d1f92d825cf357b36af921e041aede14842b82375f16b56502e1"}
Jul 14 20:21:03.370014 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:21:03.369909    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-c7cbf2c9-openshift-default-6d7bb9f745-wdgtw"
Jul 14 20:21:03.370197 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:21:03.370167    2579 patch_prober.go:28] interesting pod/e2e-ait-c7cbf2c9-openshift-default-6d7bb9f745-wdgtw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.49:15021/healthz/ready\": dial tcp 10.133.0.49:15021: connect: connection refused" start-of-body=
Jul 14 20:21:03.370270 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:21:03.370226    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-c7cbf2c9-openshift-default-6d7bb9f745-wdgtw" podUID="eeb10f2d-fd76-4897-95f3-da7a3d2bd49a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.49:15021/healthz/ready\": dial tcp 10.133.0.49:15021: connect: connection refused"
Jul 14 20:21:04.370344 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:21:04.370309    2579 patch_prober.go:28] interesting pod/e2e-ait-c7cbf2c9-openshift-default-6d7bb9f745-wdgtw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.49:15021/healthz/ready\": dial tcp 10.133.0.49:15021: connect: connection refused" start-of-body=
Jul 14 20:21:04.370767 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:21:04.370363    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-c7cbf2c9-openshift-default-6d7bb9f745-wdgtw" podUID="eeb10f2d-fd76-4897-95f3-da7a3d2bd49a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.49:15021/healthz/ready\": dial tcp 10.133.0.49:15021: connect: connection refused"
Jul 14 20:21:05.370146 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:21:05.370105    2579 patch_prober.go:28] interesting pod/e2e-ait-c7cbf2c9-openshift-default-6d7bb9f745-wdgtw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.49:15021/healthz/ready\": dial tcp 10.133.0.49:15021: connect: connection refused" start-of-body=
Jul 14 20:21:05.370328 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:21:05.370169    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-c7cbf2c9-openshift-default-6d7bb9f745-wdgtw" podUID="eeb10f2d-fd76-4897-95f3-da7a3d2bd49a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.49:15021/healthz/ready\": dial tcp 10.133.0.49:15021: connect: connection refused"
Jul 14 20:21:06.370461 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:21:06.370423    2579 patch_prober.go:28] interesting pod/e2e-ait-c7cbf2c9-openshift-default-6d7bb9f745-wdgtw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.49:15021/healthz/ready\": dial tcp 10.133.0.49:15021: connect: connection refused" start-of-body=
Jul 14 20:21:06.370877 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:21:06.370490    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-c7cbf2c9-openshift-default-6d7bb9f745-wdgtw" podUID="eeb10f2d-fd76-4897-95f3-da7a3d2bd49a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.49:15021/healthz/ready\": dial tcp 10.133.0.49:15021: connect: connection refused"
Jul 14 20:21:07.374084 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:21:07.374051    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-c7cbf2c9-openshift-default-6d7bb9f745-wdgtw"
Jul 14 20:21:07.374487 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:21:07.374399    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-c7cbf2c9-openshift-default-6d7bb9f745-wdgtw"
Jul 14 20:21:07.375192 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:21:07.375172    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-c7cbf2c9-openshift-default-6d7bb9f745-wdgtw"
Jul 14 20:21:40.912397 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:21:40.912367    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-q4xzw_ef54193c-7659-4e47-87ac-4d129d22a268/ovn-acl-logging/0.log"
Jul 14 20:21:40.918282 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:21:40.918257    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-q4xzw_ef54193c-7659-4e47-87ac-4d129d22a268/ovn-acl-logging/0.log"
Jul 14 20:22:15.699071 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:22:15.699032    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-c7cbf2c9-openshift-default-6d7bb9f745-wdgtw"]
Jul 14 20:22:15.699647 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:22:15.699226    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-c7cbf2c9-openshift-default-6d7bb9f745-wdgtw" podUID="eeb10f2d-fd76-4897-95f3-da7a3d2bd49a" containerName="istio-proxy" containerID="cri-o://070fc8220720d1f92d825cf357b36af921e041aede14842b82375f16b56502e1" gracePeriod=30
Jul 14 20:22:16.002600 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:22:16.002564    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-derive-7044c372-openshift-default-5484f847b7-dfks5"]
Jul 14 20:22:16.003108 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:22:16.003089    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="2772d91b-18ac-481a-a835-92e71137207d" containerName="istio-proxy"
Jul 14 20:22:16.006205 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:22:16.006184    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-7044c372-openshift-default-5484f847b7-dfks5"
Jul 14 20:22:16.009123 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:22:16.009104    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-derive-7044c372-openshift-default-dockercfg-mhq7s\""
Jul 14 20:22:16.029190 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:22:16.029156    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-7044c372-openshift-default-5484f847b7-dfks5"]
Jul 14 20:22:16.094843 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:22:16.094809    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d54kr\" (UniqueName: \"kubernetes.io/projected/3816738b-d08e-4c95-af04-5f7e8bd9ea1a-kube-api-access-d54kr\") pod \"e2e-derive-7044c372-openshift-default-5484f847b7-dfks5\" (UID: \"3816738b-d08e-4c95-af04-5f7e8bd9ea1a\") " pod="openshift-ingress/e2e-derive-7044c372-openshift-default-5484f847b7-dfks5"
Jul 14 20:22:16.094843 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:22:16.094850    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3816738b-d08e-4c95-af04-5f7e8bd9ea1a-istio-token\") pod \"e2e-derive-7044c372-openshift-default-5484f847b7-dfks5\" (UID: \"3816738b-d08e-4c95-af04-5f7e8bd9ea1a\") " pod="openshift-ingress/e2e-derive-7044c372-openshift-default-5484f847b7-dfks5"
Jul 14 20:22:16.095094 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:22:16.094881    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3816738b-d08e-4c95-af04-5f7e8bd9ea1a-credential-socket\") pod \"e2e-derive-7044c372-openshift-default-5484f847b7-dfks5\" (UID: \"3816738b-d08e-4c95-af04-5f7e8bd9ea1a\") " pod="openshift-ingress/e2e-derive-7044c372-openshift-default-5484f847b7-dfks5"
Jul 14 20:22:16.095094 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:22:16.094962    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3816738b-d08e-4c95-af04-5f7e8bd9ea1a-workload-certs\") pod \"e2e-derive-7044c372-openshift-default-5484f847b7-dfks5\" (UID: \"3816738b-d08e-4c95-af04-5f7e8bd9ea1a\") " pod="openshift-ingress/e2e-derive-7044c372-openshift-default-5484f847b7-dfks5"
Jul 14 20:22:16.095094 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:22:16.094991    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3816738b-d08e-4c95-af04-5f7e8bd9ea1a-workload-socket\") pod \"e2e-derive-7044c372-openshift-default-5484f847b7-dfks5\" (UID: \"3816738b-d08e-4c95-af04-5f7e8bd9ea1a\") " pod="openshift-ingress/e2e-derive-7044c372-openshift-default-5484f847b7-dfks5"
Jul 14 20:22:16.095094 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:22:16.095009    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3816738b-d08e-4c95-af04-5f7e8bd9ea1a-istio-envoy\") pod \"e2e-derive-7044c372-openshift-default-5484f847b7-dfks5\" (UID: \"3816738b-d08e-4c95-af04-5f7e8bd9ea1a\") " pod="openshift-ingress/e2e-derive-7044c372-openshift-default-5484f847b7-dfks5"
Jul 14 20:22:16.095094 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:22:16.095049    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3816738b-d08e-4c95-af04-5f7e8bd9ea1a-istio-podinfo\") pod \"e2e-derive-7044c372-openshift-default-5484f847b7-dfks5\" (UID: \"3816738b-d08e-4c95-af04-5f7e8bd9ea1a\") " pod="openshift-ingress/e2e-derive-7044c372-openshift-default-5484f847b7-dfks5"
Jul 14 20:22:16.095303 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:22:16.095104    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3816738b-d08e-4c95-af04-5f7e8bd9ea1a-istio-data\") pod \"e2e-derive-7044c372-openshift-default-5484f847b7-dfks5\" (UID: \"3816738b-d08e-4c95-af04-5f7e8bd9ea1a\") " pod="openshift-ingress/e2e-derive-7044c372-openshift-default-5484f847b7-dfks5"
Jul 14 20:22:16.095303 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:22:16.095139    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3816738b-d08e-4c95-af04-5f7e8bd9ea1a-istiod-ca-cert\") pod \"e2e-derive-7044c372-openshift-default-5484f847b7-dfks5\" (UID: \"3816738b-d08e-4c95-af04-5f7e8bd9ea1a\") " pod="openshift-ingress/e2e-derive-7044c372-openshift-default-5484f847b7-dfks5"
Jul 14 20:22:16.196500 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:22:16.196465    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3816738b-d08e-4c95-af04-5f7e8bd9ea1a-istio-data\") pod \"e2e-derive-7044c372-openshift-default-5484f847b7-dfks5\" (UID: \"3816738b-d08e-4c95-af04-5f7e8bd9ea1a\") " pod="openshift-ingress/e2e-derive-7044c372-openshift-default-5484f847b7-dfks5"
Jul 14 20:22:16.196691 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:22:16.196513    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3816738b-d08e-4c95-af04-5f7e8bd9ea1a-istiod-ca-cert\") pod \"e2e-derive-7044c372-openshift-default-5484f847b7-dfks5\" (UID: \"3816738b-d08e-4c95-af04-5f7e8bd9ea1a\") " pod="openshift-ingress/e2e-derive-7044c372-openshift-default-5484f847b7-dfks5"
Jul 14 20:22:16.196691 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:22:16.196574    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d54kr\" (UniqueName: \"kubernetes.io/projected/3816738b-d08e-4c95-af04-5f7e8bd9ea1a-kube-api-access-d54kr\") pod \"e2e-derive-7044c372-openshift-default-5484f847b7-dfks5\" (UID: \"3816738b-d08e-4c95-af04-5f7e8bd9ea1a\") " pod="openshift-ingress/e2e-derive-7044c372-openshift-default-5484f847b7-dfks5"
Jul 14 20:22:16.196691 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:22:16.196595    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3816738b-d08e-4c95-af04-5f7e8bd9ea1a-istio-token\") pod \"e2e-derive-7044c372-openshift-default-5484f847b7-dfks5\" (UID: \"3816738b-d08e-4c95-af04-5f7e8bd9ea1a\") " pod="openshift-ingress/e2e-derive-7044c372-openshift-default-5484f847b7-dfks5"
Jul 14 20:22:16.196797 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:22:16.196746    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3816738b-d08e-4c95-af04-5f7e8bd9ea1a-credential-socket\") pod \"e2e-derive-7044c372-openshift-default-5484f847b7-dfks5\" (UID: \"3816738b-d08e-4c95-af04-5f7e8bd9ea1a\") " pod="openshift-ingress/e2e-derive-7044c372-openshift-default-5484f847b7-dfks5"
Jul 14 20:22:16.196855 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:22:16.196837    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3816738b-d08e-4c95-af04-5f7e8bd9ea1a-workload-certs\") pod \"e2e-derive-7044c372-openshift-default-5484f847b7-dfks5\" (UID: \"3816738b-d08e-4c95-af04-5f7e8bd9ea1a\") " pod="openshift-ingress/e2e-derive-7044c372-openshift-default-5484f847b7-dfks5"
Jul 14 20:22:16.196891 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:22:16.196881    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3816738b-d08e-4c95-af04-5f7e8bd9ea1a-workload-socket\") pod \"e2e-derive-7044c372-openshift-default-5484f847b7-dfks5\" (UID: \"3816738b-d08e-4c95-af04-5f7e8bd9ea1a\") " pod="openshift-ingress/e2e-derive-7044c372-openshift-default-5484f847b7-dfks5"
Jul 14 20:22:16.196926 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:22:16.196909    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3816738b-d08e-4c95-af04-5f7e8bd9ea1a-istio-envoy\") pod \"e2e-derive-7044c372-openshift-default-5484f847b7-dfks5\" (UID: \"3816738b-d08e-4c95-af04-5f7e8bd9ea1a\") " pod="openshift-ingress/e2e-derive-7044c372-openshift-default-5484f847b7-dfks5"
Jul 14 20:22:16.196978 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:22:16.196936    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3816738b-d08e-4c95-af04-5f7e8bd9ea1a-istio-podinfo\") pod \"e2e-derive-7044c372-openshift-default-5484f847b7-dfks5\" (UID: \"3816738b-d08e-4c95-af04-5f7e8bd9ea1a\") " pod="openshift-ingress/e2e-derive-7044c372-openshift-default-5484f847b7-dfks5"
Jul 14 20:22:16.197029 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:22:16.196979    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3816738b-d08e-4c95-af04-5f7e8bd9ea1a-istio-data\") pod \"e2e-derive-7044c372-openshift-default-5484f847b7-dfks5\" (UID: \"3816738b-d08e-4c95-af04-5f7e8bd9ea1a\") " pod="openshift-ingress/e2e-derive-7044c372-openshift-default-5484f847b7-dfks5"
Jul 14 20:22:16.197132 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:22:16.197106    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3816738b-d08e-4c95-af04-5f7e8bd9ea1a-credential-socket\") pod \"e2e-derive-7044c372-openshift-default-5484f847b7-dfks5\" (UID: \"3816738b-d08e-4c95-af04-5f7e8bd9ea1a\") " pod="openshift-ingress/e2e-derive-7044c372-openshift-default-5484f847b7-dfks5"
Jul 14 20:22:16.197195 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:22:16.197164    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3816738b-d08e-4c95-af04-5f7e8bd9ea1a-workload-socket\") pod \"e2e-derive-7044c372-openshift-default-5484f847b7-dfks5\" (UID: \"3816738b-d08e-4c95-af04-5f7e8bd9ea1a\") " pod="openshift-ingress/e2e-derive-7044c372-openshift-default-5484f847b7-dfks5"
Jul 14 20:22:16.197250 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:22:16.197199    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3816738b-d08e-4c95-af04-5f7e8bd9ea1a-workload-certs\") pod \"e2e-derive-7044c372-openshift-default-5484f847b7-dfks5\" (UID: \"3816738b-d08e-4c95-af04-5f7e8bd9ea1a\") " pod="openshift-ingress/e2e-derive-7044c372-openshift-default-5484f847b7-dfks5"
Jul 14 20:22:16.197381 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:22:16.197359    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3816738b-d08e-4c95-af04-5f7e8bd9ea1a-istiod-ca-cert\") pod \"e2e-derive-7044c372-openshift-default-5484f847b7-dfks5\" (UID: \"3816738b-d08e-4c95-af04-5f7e8bd9ea1a\") " pod="openshift-ingress/e2e-derive-7044c372-openshift-default-5484f847b7-dfks5"
Jul 14 20:22:16.199350 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:22:16.199327    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3816738b-d08e-4c95-af04-5f7e8bd9ea1a-istio-envoy\") pod \"e2e-derive-7044c372-openshift-default-5484f847b7-dfks5\" (UID: \"3816738b-d08e-4c95-af04-5f7e8bd9ea1a\") " pod="openshift-ingress/e2e-derive-7044c372-openshift-default-5484f847b7-dfks5"
Jul 14 20:22:16.199486 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:22:16.199468    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3816738b-d08e-4c95-af04-5f7e8bd9ea1a-istio-podinfo\") pod \"e2e-derive-7044c372-openshift-default-5484f847b7-dfks5\" (UID: \"3816738b-d08e-4c95-af04-5f7e8bd9ea1a\") " pod="openshift-ingress/e2e-derive-7044c372-openshift-default-5484f847b7-dfks5"
Jul 14 20:22:16.207512 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:22:16.207486    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3816738b-d08e-4c95-af04-5f7e8bd9ea1a-istio-token\") pod \"e2e-derive-7044c372-openshift-default-5484f847b7-dfks5\" (UID: \"3816738b-d08e-4c95-af04-5f7e8bd9ea1a\") " pod="openshift-ingress/e2e-derive-7044c372-openshift-default-5484f847b7-dfks5"
Jul 14 20:22:16.208180 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:22:16.208155    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d54kr\" (UniqueName: \"kubernetes.io/projected/3816738b-d08e-4c95-af04-5f7e8bd9ea1a-kube-api-access-d54kr\") pod \"e2e-derive-7044c372-openshift-default-5484f847b7-dfks5\" (UID: \"3816738b-d08e-4c95-af04-5f7e8bd9ea1a\") " pod="openshift-ingress/e2e-derive-7044c372-openshift-default-5484f847b7-dfks5"
Jul 14 20:22:16.317096 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:22:16.316997    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-7044c372-openshift-default-5484f847b7-dfks5"
Jul 14 20:22:16.464043 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:22:16.464016    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-7044c372-openshift-default-5484f847b7-dfks5"]
Jul 14 20:22:16.466950 ip-10-0-140-201 kubenswrapper[2579]: W0714 20:22:16.466916    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3816738b_d08e_4c95_af04_5f7e8bd9ea1a.slice/crio-070ad97267050a538320cb14bf422b4ec3abca62806eef527cefa325c76197a5 WatchSource:0}: Error finding container 070ad97267050a538320cb14bf422b4ec3abca62806eef527cefa325c76197a5: Status 404 returned error can't find the container with id 070ad97267050a538320cb14bf422b4ec3abca62806eef527cefa325c76197a5
Jul 14 20:22:16.469513 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:22:16.469480    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 14 20:22:16.469586 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:22:16.469567    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 14 20:22:16.469624 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:22:16.469595    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 14 20:22:17.404512 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:22:17.404473    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-7044c372-openshift-default-5484f847b7-dfks5" event={"ID":"3816738b-d08e-4c95-af04-5f7e8bd9ea1a","Type":"ContainerStarted","Data":"94b5ac887887cea729d286dde45beec4f64622ad35e229af8410821f37b46e24"}
Jul 14 20:22:17.404917 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:22:17.404587    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-7044c372-openshift-default-5484f847b7-dfks5" event={"ID":"3816738b-d08e-4c95-af04-5f7e8bd9ea1a","Type":"ContainerStarted","Data":"070ad97267050a538320cb14bf422b4ec3abca62806eef527cefa325c76197a5"}
Jul 14 20:22:17.456896 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:22:17.456846    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-derive-7044c372-openshift-default-5484f847b7-dfks5" podStartSLOduration=2.456829299 podStartE2EDuration="2.456829299s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 20:22:15 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 20:22:17.453238645 +0000 UTC m=+1837.164834190" watchObservedRunningTime="2026-07-14 20:22:17.456829299 +0000 UTC m=+1837.168424844"
Jul 14 20:22:18.317567 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:22:18.317504    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-7044c372-openshift-default-5484f847b7-dfks5"
Jul 14 20:22:18.322658 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:22:18.322632    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-7044c372-openshift-default-5484f847b7-dfks5"
Jul 14 20:22:18.410627 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:22:18.410595    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-7044c372-openshift-default-5484f847b7-dfks5"
Jul 14 20:22:18.411500 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:22:18.411482    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-7044c372-openshift-default-5484f847b7-dfks5"
Jul 14 20:22:20.947505 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:22:20.947473    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-c7cbf2c9-openshift-default-6d7bb9f745-wdgtw"
Jul 14 20:22:21.047389 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:22:21.047359    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/eeb10f2d-fd76-4897-95f3-da7a3d2bd49a-istio-envoy\") pod \"eeb10f2d-fd76-4897-95f3-da7a3d2bd49a\" (UID: \"eeb10f2d-fd76-4897-95f3-da7a3d2bd49a\") "
Jul 14 20:22:21.047572 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:22:21.047399    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/eeb10f2d-fd76-4897-95f3-da7a3d2bd49a-istio-podinfo\") pod \"eeb10f2d-fd76-4897-95f3-da7a3d2bd49a\" (UID: \"eeb10f2d-fd76-4897-95f3-da7a3d2bd49a\") "
Jul 14 20:22:21.047572 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:22:21.047444    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/eeb10f2d-fd76-4897-95f3-da7a3d2bd49a-workload-certs\") pod \"eeb10f2d-fd76-4897-95f3-da7a3d2bd49a\" (UID: \"eeb10f2d-fd76-4897-95f3-da7a3d2bd49a\") "
Jul 14 20:22:21.047572 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:22:21.047472    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/eeb10f2d-fd76-4897-95f3-da7a3d2bd49a-istiod-ca-cert\") pod \"eeb10f2d-fd76-4897-95f3-da7a3d2bd49a\" (UID: \"eeb10f2d-fd76-4897-95f3-da7a3d2bd49a\") "
Jul 14 20:22:21.047572 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:22:21.047500    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/eeb10f2d-fd76-4897-95f3-da7a3d2bd49a-istio-data\") pod \"eeb10f2d-fd76-4897-95f3-da7a3d2bd49a\" (UID: \"eeb10f2d-fd76-4897-95f3-da7a3d2bd49a\") "
Jul 14 20:22:21.047572 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:22:21.047517    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/eeb10f2d-fd76-4897-95f3-da7a3d2bd49a-workload-socket\") pod \"eeb10f2d-fd76-4897-95f3-da7a3d2bd49a\" (UID: \"eeb10f2d-fd76-4897-95f3-da7a3d2bd49a\") "
Jul 14 20:22:21.047572 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:22:21.047569    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/eeb10f2d-fd76-4897-95f3-da7a3d2bd49a-credential-socket\") pod \"eeb10f2d-fd76-4897-95f3-da7a3d2bd49a\" (UID: \"eeb10f2d-fd76-4897-95f3-da7a3d2bd49a\") "
Jul 14 20:22:21.047962 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:22:21.047603    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/eeb10f2d-fd76-4897-95f3-da7a3d2bd49a-istio-token\") pod \"eeb10f2d-fd76-4897-95f3-da7a3d2bd49a\" (UID: \"eeb10f2d-fd76-4897-95f3-da7a3d2bd49a\") "
Jul 14 20:22:21.047962 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:22:21.047755    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cdvfv\" (UniqueName: \"kubernetes.io/projected/eeb10f2d-fd76-4897-95f3-da7a3d2bd49a-kube-api-access-cdvfv\") pod \"eeb10f2d-fd76-4897-95f3-da7a3d2bd49a\" (UID: \"eeb10f2d-fd76-4897-95f3-da7a3d2bd49a\") "
Jul 14 20:22:21.047962 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:22:21.047772    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/eeb10f2d-fd76-4897-95f3-da7a3d2bd49a-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "eeb10f2d-fd76-4897-95f3-da7a3d2bd49a" (UID: "eeb10f2d-fd76-4897-95f3-da7a3d2bd49a"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 20:22:21.047962 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:22:21.047856    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/eeb10f2d-fd76-4897-95f3-da7a3d2bd49a-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "eeb10f2d-fd76-4897-95f3-da7a3d2bd49a" (UID: "eeb10f2d-fd76-4897-95f3-da7a3d2bd49a"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 14 20:22:21.048172 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:22:21.048028    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/eeb10f2d-fd76-4897-95f3-da7a3d2bd49a-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "eeb10f2d-fd76-4897-95f3-da7a3d2bd49a" (UID: "eeb10f2d-fd76-4897-95f3-da7a3d2bd49a"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 20:22:21.048172 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:22:21.048128    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/eeb10f2d-fd76-4897-95f3-da7a3d2bd49a-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "eeb10f2d-fd76-4897-95f3-da7a3d2bd49a" (UID: "eeb10f2d-fd76-4897-95f3-da7a3d2bd49a"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 20:22:21.048418 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:22:21.048394    2579 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/eeb10f2d-fd76-4897-95f3-da7a3d2bd49a-istiod-ca-cert\") on node \"ip-10-0-140-201.ec2.internal\" DevicePath \"\""
Jul 14 20:22:21.048560 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:22:21.048421    2579 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/eeb10f2d-fd76-4897-95f3-da7a3d2bd49a-workload-socket\") on node \"ip-10-0-140-201.ec2.internal\" DevicePath \"\""
Jul 14 20:22:21.048560 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:22:21.048437    2579 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/eeb10f2d-fd76-4897-95f3-da7a3d2bd49a-credential-socket\") on node \"ip-10-0-140-201.ec2.internal\" DevicePath \"\""
Jul 14 20:22:21.048560 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:22:21.048451    2579 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/eeb10f2d-fd76-4897-95f3-da7a3d2bd49a-workload-certs\") on node \"ip-10-0-140-201.ec2.internal\" DevicePath \"\""
Jul 14 20:22:21.049208 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:22:21.049181    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/eeb10f2d-fd76-4897-95f3-da7a3d2bd49a-istio-data" (OuterVolumeSpecName: "istio-data") pod "eeb10f2d-fd76-4897-95f3-da7a3d2bd49a" (UID: "eeb10f2d-fd76-4897-95f3-da7a3d2bd49a"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 20:22:21.049771 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:22:21.049751    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/eeb10f2d-fd76-4897-95f3-da7a3d2bd49a-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "eeb10f2d-fd76-4897-95f3-da7a3d2bd49a" (UID: "eeb10f2d-fd76-4897-95f3-da7a3d2bd49a"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 20:22:21.050307 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:22:21.050287    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/eeb10f2d-fd76-4897-95f3-da7a3d2bd49a-kube-api-access-cdvfv" (OuterVolumeSpecName: "kube-api-access-cdvfv") pod "eeb10f2d-fd76-4897-95f3-da7a3d2bd49a" (UID: "eeb10f2d-fd76-4897-95f3-da7a3d2bd49a"). InnerVolumeSpecName "kube-api-access-cdvfv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 14 20:22:21.050307 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:22:21.050291    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/eeb10f2d-fd76-4897-95f3-da7a3d2bd49a-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "eeb10f2d-fd76-4897-95f3-da7a3d2bd49a" (UID: "eeb10f2d-fd76-4897-95f3-da7a3d2bd49a"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 14 20:22:21.050405 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:22:21.050369    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/eeb10f2d-fd76-4897-95f3-da7a3d2bd49a-istio-token" (OuterVolumeSpecName: "istio-token") pod "eeb10f2d-fd76-4897-95f3-da7a3d2bd49a" (UID: "eeb10f2d-fd76-4897-95f3-da7a3d2bd49a"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 14 20:22:21.149556 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:22:21.149500    2579 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/eeb10f2d-fd76-4897-95f3-da7a3d2bd49a-istio-token\") on node \"ip-10-0-140-201.ec2.internal\" DevicePath \"\""
Jul 14 20:22:21.149556 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:22:21.149551    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cdvfv\" (UniqueName: \"kubernetes.io/projected/eeb10f2d-fd76-4897-95f3-da7a3d2bd49a-kube-api-access-cdvfv\") on node \"ip-10-0-140-201.ec2.internal\" DevicePath \"\""
Jul 14 20:22:21.149556 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:22:21.149562    2579 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/eeb10f2d-fd76-4897-95f3-da7a3d2bd49a-istio-envoy\") on node \"ip-10-0-140-201.ec2.internal\" DevicePath \"\""
Jul 14 20:22:21.149831 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:22:21.149570    2579 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/eeb10f2d-fd76-4897-95f3-da7a3d2bd49a-istio-podinfo\") on node \"ip-10-0-140-201.ec2.internal\" DevicePath \"\""
Jul 14 20:22:21.149831 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:22:21.149578    2579 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/eeb10f2d-fd76-4897-95f3-da7a3d2bd49a-istio-data\") on node \"ip-10-0-140-201.ec2.internal\" DevicePath \"\""
Jul 14 20:22:21.428494 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:22:21.428414    2579 generic.go:356] "Generic (PLEG): container finished" podID="eeb10f2d-fd76-4897-95f3-da7a3d2bd49a" containerID="070fc8220720d1f92d825cf357b36af921e041aede14842b82375f16b56502e1" exitCode=0
Jul 14 20:22:21.428494 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:22:21.428466    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-c7cbf2c9-openshift-default-6d7bb9f745-wdgtw"
Jul 14 20:22:21.428494 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:22:21.428471    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-c7cbf2c9-openshift-default-6d7bb9f745-wdgtw" event={"ID":"eeb10f2d-fd76-4897-95f3-da7a3d2bd49a","Type":"ContainerDied","Data":"070fc8220720d1f92d825cf357b36af921e041aede14842b82375f16b56502e1"}
Jul 14 20:22:21.428725 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:22:21.428516    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-c7cbf2c9-openshift-default-6d7bb9f745-wdgtw" event={"ID":"eeb10f2d-fd76-4897-95f3-da7a3d2bd49a","Type":"ContainerDied","Data":"c6205c887bdc7eb9719919a4b0ee1d5203c7c97de5e5ac595c73d13ebf65af70"}
Jul 14 20:22:21.428725 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:22:21.428567    2579 scope.go:117] "RemoveContainer" containerID="070fc8220720d1f92d825cf357b36af921e041aede14842b82375f16b56502e1"
Jul 14 20:22:21.438060 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:22:21.438043    2579 scope.go:117] "RemoveContainer" containerID="dde09df97022b9dc940a3ad7e6fa48ffd61eaa405e4562aad05da49200b4f05c"
Jul 14 20:22:21.446028 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:22:21.446009    2579 scope.go:117] "RemoveContainer" containerID="070fc8220720d1f92d825cf357b36af921e041aede14842b82375f16b56502e1"
Jul 14 20:22:21.446290 ip-10-0-140-201 kubenswrapper[2579]: E0714 20:22:21.446272    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"070fc8220720d1f92d825cf357b36af921e041aede14842b82375f16b56502e1\": container with ID starting with 070fc8220720d1f92d825cf357b36af921e041aede14842b82375f16b56502e1 not found: ID does not exist" containerID="070fc8220720d1f92d825cf357b36af921e041aede14842b82375f16b56502e1"
Jul 14 20:22:21.446339 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:22:21.446298    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"070fc8220720d1f92d825cf357b36af921e041aede14842b82375f16b56502e1"} err="failed to get container status \"070fc8220720d1f92d825cf357b36af921e041aede14842b82375f16b56502e1\": rpc error: code = NotFound desc = could not find container \"070fc8220720d1f92d825cf357b36af921e041aede14842b82375f16b56502e1\": container with ID starting with 070fc8220720d1f92d825cf357b36af921e041aede14842b82375f16b56502e1 not found: ID does not exist"
Jul 14 20:22:21.446339 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:22:21.446315    2579 scope.go:117] "RemoveContainer" containerID="dde09df97022b9dc940a3ad7e6fa48ffd61eaa405e4562aad05da49200b4f05c"
Jul 14 20:22:21.446569 ip-10-0-140-201 kubenswrapper[2579]: E0714 20:22:21.446551    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"dde09df97022b9dc940a3ad7e6fa48ffd61eaa405e4562aad05da49200b4f05c\": container with ID starting with dde09df97022b9dc940a3ad7e6fa48ffd61eaa405e4562aad05da49200b4f05c not found: ID does not exist" containerID="dde09df97022b9dc940a3ad7e6fa48ffd61eaa405e4562aad05da49200b4f05c"
Jul 14 20:22:21.446643 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:22:21.446578    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dde09df97022b9dc940a3ad7e6fa48ffd61eaa405e4562aad05da49200b4f05c"} err="failed to get container status \"dde09df97022b9dc940a3ad7e6fa48ffd61eaa405e4562aad05da49200b4f05c\": rpc error: code = NotFound desc = could not find container \"dde09df97022b9dc940a3ad7e6fa48ffd61eaa405e4562aad05da49200b4f05c\": container with ID starting with dde09df97022b9dc940a3ad7e6fa48ffd61eaa405e4562aad05da49200b4f05c not found: ID does not exist"
Jul 14 20:22:21.456486 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:22:21.456456    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-c7cbf2c9-openshift-default-6d7bb9f745-wdgtw"]
Jul 14 20:22:21.461880 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:22:21.461858    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-c7cbf2c9-openshift-default-6d7bb9f745-wdgtw"]
Jul 14 20:22:22.848629 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:22:22.848595    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="eeb10f2d-fd76-4897-95f3-da7a3d2bd49a" path="/var/lib/kubelet/pods/eeb10f2d-fd76-4897-95f3-da7a3d2bd49a/volumes"
Jul 14 20:22:33.760913 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:22:33.759793    2579 patch_prober.go:28] interesting pod/e2e-derive-7044c372-openshift-default-5484f847b7-dfks5 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.50:15021/healthz/ready\": read tcp 10.133.0.2:38026->10.133.0.50:15021: read: connection reset by peer" start-of-body=
Jul 14 20:22:33.760913 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:22:33.759870    2579 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-derive-7044c372-openshift-default-5484f847b7-dfks5" podUID="3816738b-d08e-4c95-af04-5f7e8bd9ea1a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.50:15021/healthz/ready\": read tcp 10.133.0.2:38026->10.133.0.50:15021: read: connection reset by peer"
Jul 14 20:22:34.506526 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:22:34.506485    2579 generic.go:356] "Generic (PLEG): container finished" podID="3816738b-d08e-4c95-af04-5f7e8bd9ea1a" containerID="94b5ac887887cea729d286dde45beec4f64622ad35e229af8410821f37b46e24" exitCode=0
Jul 14 20:22:34.506732 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:22:34.506562    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-7044c372-openshift-default-5484f847b7-dfks5" event={"ID":"3816738b-d08e-4c95-af04-5f7e8bd9ea1a","Type":"ContainerDied","Data":"94b5ac887887cea729d286dde45beec4f64622ad35e229af8410821f37b46e24"}
Jul 14 20:22:34.507001 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:22:34.506986    2579 scope.go:117] "RemoveContainer" containerID="94b5ac887887cea729d286dde45beec4f64622ad35e229af8410821f37b46e24"
Jul 14 20:22:34.508128 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:22:34.508099    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 14 20:22:34.508196 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:22:34.508185    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 14 20:22:34.508245 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:22:34.508232    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 14 20:22:35.513814 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:22:35.513776    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-7044c372-openshift-default-5484f847b7-dfks5" event={"ID":"3816738b-d08e-4c95-af04-5f7e8bd9ea1a","Type":"ContainerStarted","Data":"28bad9c28f3cf74905deeba86cdaeced99fb61c47c9c84b0adb93eba173c5629"}
Jul 14 20:22:36.317727 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:22:36.317686    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-7044c372-openshift-default-5484f847b7-dfks5"
Jul 14 20:22:36.317953 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:22:36.317934    2579 patch_prober.go:28] interesting pod/e2e-derive-7044c372-openshift-default-5484f847b7-dfks5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.50:15021/healthz/ready\": dial tcp 10.133.0.50:15021: connect: connection refused" start-of-body=
Jul 14 20:22:36.318002 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:22:36.317980    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-7044c372-openshift-default-5484f847b7-dfks5" podUID="3816738b-d08e-4c95-af04-5f7e8bd9ea1a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.50:15021/healthz/ready\": dial tcp 10.133.0.50:15021: connect: connection refused"
Jul 14 20:22:37.317901 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:22:37.317855    2579 patch_prober.go:28] interesting pod/e2e-derive-7044c372-openshift-default-5484f847b7-dfks5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.50:15021/healthz/ready\": dial tcp 10.133.0.50:15021: connect: connection refused" start-of-body=
Jul 14 20:22:37.318308 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:22:37.317922    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-7044c372-openshift-default-5484f847b7-dfks5" podUID="3816738b-d08e-4c95-af04-5f7e8bd9ea1a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.50:15021/healthz/ready\": dial tcp 10.133.0.50:15021: connect: connection refused"
Jul 14 20:22:38.317621 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:22:38.317583    2579 patch_prober.go:28] interesting pod/e2e-derive-7044c372-openshift-default-5484f847b7-dfks5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.50:15021/healthz/ready\": dial tcp 10.133.0.50:15021: connect: connection refused" start-of-body=
Jul 14 20:22:38.317797 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:22:38.317648    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-7044c372-openshift-default-5484f847b7-dfks5" podUID="3816738b-d08e-4c95-af04-5f7e8bd9ea1a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.50:15021/healthz/ready\": dial tcp 10.133.0.50:15021: connect: connection refused"
Jul 14 20:22:39.317672 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:22:39.317633    2579 patch_prober.go:28] interesting pod/e2e-derive-7044c372-openshift-default-5484f847b7-dfks5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.50:15021/healthz/ready\": dial tcp 10.133.0.50:15021: connect: connection refused" start-of-body=
Jul 14 20:22:39.318092 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:22:39.317688    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-7044c372-openshift-default-5484f847b7-dfks5" podUID="3816738b-d08e-4c95-af04-5f7e8bd9ea1a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.50:15021/healthz/ready\": dial tcp 10.133.0.50:15021: connect: connection refused"
Jul 14 20:22:40.321184 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:22:40.321150    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-7044c372-openshift-default-5484f847b7-dfks5"
Jul 14 20:22:40.321611 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:22:40.321503    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-7044c372-openshift-default-5484f847b7-dfks5"
Jul 14 20:22:40.322247 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:22:40.322230    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-7044c372-openshift-default-5484f847b7-dfks5"
Jul 14 20:23:11.634629 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:23:11.634521    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-7044c372-2wh9g"]
Jul 14 20:23:11.635144 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:23:11.635088    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="eeb10f2d-fd76-4897-95f3-da7a3d2bd49a" containerName="istio-proxy"
Jul 14 20:23:11.635144 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:23:11.635108    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="eeb10f2d-fd76-4897-95f3-da7a3d2bd49a" containerName="istio-proxy"
Jul 14 20:23:11.635261 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:23:11.635229    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="eeb10f2d-fd76-4897-95f3-da7a3d2bd49a" containerName="istio-proxy"
Jul 14 20:23:11.638430 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:23:11.638408    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-7044c372-2wh9g"
Jul 14 20:23:11.641444 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:23:11.641420    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-4blwh\""
Jul 14 20:23:11.641626 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:23:11.641605    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 14 20:23:11.647811 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:23:11.647786    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-7044c372-2wh9g"]
Jul 14 20:23:11.749311 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:23:11.749273    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/833935d4-1fba-41be-9230-76ee5e8d241a-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-7044c372-2wh9g\" (UID: \"833935d4-1fba-41be-9230-76ee5e8d241a\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-7044c372-2wh9g"
Jul 14 20:23:11.850544 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:23:11.850488    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/833935d4-1fba-41be-9230-76ee5e8d241a-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-7044c372-2wh9g\" (UID: \"833935d4-1fba-41be-9230-76ee5e8d241a\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-7044c372-2wh9g"
Jul 14 20:23:11.851153 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:23:11.851132    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/833935d4-1fba-41be-9230-76ee5e8d241a-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-7044c372-2wh9g\" (UID: \"833935d4-1fba-41be-9230-76ee5e8d241a\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-7044c372-2wh9g"
Jul 14 20:23:11.949374 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:23:11.949286    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-7044c372-2wh9g"
Jul 14 20:23:12.089525 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:23:12.089495    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-7044c372-2wh9g"]
Jul 14 20:23:12.090391 ip-10-0-140-201 kubenswrapper[2579]: W0714 20:23:12.090367    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod833935d4_1fba_41be_9230_76ee5e8d241a.slice/crio-37b74b9e7982e5ec2c03ba9b65867f573b1023a352ebfcd4aa590e3aca6198e5 WatchSource:0}: Error finding container 37b74b9e7982e5ec2c03ba9b65867f573b1023a352ebfcd4aa590e3aca6198e5: Status 404 returned error can't find the container with id 37b74b9e7982e5ec2c03ba9b65867f573b1023a352ebfcd4aa590e3aca6198e5
Jul 14 20:23:12.712022 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:23:12.711989    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-7044c372-2wh9g" event={"ID":"833935d4-1fba-41be-9230-76ee5e8d241a","Type":"ContainerStarted","Data":"bd8f22894608255e1d51403996a65178812dcc2db5e550a8d78befd06e0cb9b4"}
Jul 14 20:23:12.712384 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:23:12.712040    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-7044c372-2wh9g" event={"ID":"833935d4-1fba-41be-9230-76ee5e8d241a","Type":"ContainerStarted","Data":"37b74b9e7982e5ec2c03ba9b65867f573b1023a352ebfcd4aa590e3aca6198e5"}
Jul 14 20:23:12.734044 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:23:12.733992    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-7044c372-2wh9g" podStartSLOduration=1.733976416 podStartE2EDuration="1.733976416s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 20:23:11 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 20:23:12.729948847 +0000 UTC m=+1892.441544394" watchObservedRunningTime="2026-07-14 20:23:12.733976416 +0000 UTC m=+1892.445571960"
Jul 14 20:23:13.718918 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:23:13.718877    2579 generic.go:356] "Generic (PLEG): container finished" podID="833935d4-1fba-41be-9230-76ee5e8d241a" containerID="bd8f22894608255e1d51403996a65178812dcc2db5e550a8d78befd06e0cb9b4" exitCode=0
Jul 14 20:23:13.719354 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:23:13.718966    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-7044c372-2wh9g" event={"ID":"833935d4-1fba-41be-9230-76ee5e8d241a","Type":"ContainerDied","Data":"bd8f22894608255e1d51403996a65178812dcc2db5e550a8d78befd06e0cb9b4"}
Jul 14 20:23:14.857546 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:23:14.857503    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-7044c372-2wh9g"
Jul 14 20:23:14.983884 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:23:14.983799    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/833935d4-1fba-41be-9230-76ee5e8d241a-maas-api-service-ca\") pod \"833935d4-1fba-41be-9230-76ee5e8d241a\" (UID: \"833935d4-1fba-41be-9230-76ee5e8d241a\") "
Jul 14 20:23:14.984138 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:23:14.984114    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/833935d4-1fba-41be-9230-76ee5e8d241a-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "833935d4-1fba-41be-9230-76ee5e8d241a" (UID: "833935d4-1fba-41be-9230-76ee5e8d241a"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 14 20:23:15.085144 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:23:15.085107    2579 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/833935d4-1fba-41be-9230-76ee5e8d241a-maas-api-service-ca\") on node \"ip-10-0-140-201.ec2.internal\" DevicePath \"\""
Jul 14 20:23:15.730347 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:23:15.730316    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-7044c372-2wh9g"
Jul 14 20:23:15.730522 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:23:15.730364    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-7044c372-2wh9g" event={"ID":"833935d4-1fba-41be-9230-76ee5e8d241a","Type":"ContainerDied","Data":"37b74b9e7982e5ec2c03ba9b65867f573b1023a352ebfcd4aa590e3aca6198e5"}
Jul 14 20:23:15.730522 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:23:15.730412    2579 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="37b74b9e7982e5ec2c03ba9b65867f573b1023a352ebfcd4aa590e3aca6198e5"
Jul 14 20:23:36.962601 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:23:36.962565    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-7044c372-openshift-default-5484f847b7-dfks5"]
Jul 14 20:23:36.963409 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:23:36.962765    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-derive-7044c372-openshift-default-5484f847b7-dfks5" podUID="3816738b-d08e-4c95-af04-5f7e8bd9ea1a" containerName="istio-proxy" containerID="cri-o://28bad9c28f3cf74905deeba86cdaeced99fb61c47c9c84b0adb93eba173c5629" gracePeriod=30
Jul 14 20:23:40.323743 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:23:40.323703    2579 patch_prober.go:28] interesting pod/e2e-derive-7044c372-openshift-default-5484f847b7-dfks5 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 14 20:23:40.324126 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:23:40.323761    2579 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-derive-7044c372-openshift-default-5484f847b7-dfks5" podUID="3816738b-d08e-4c95-af04-5f7e8bd9ea1a" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 14 20:23:42.212785 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:23:42.212758    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-7044c372-openshift-default-5484f847b7-dfks5"
Jul 14 20:23:42.347823 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:23:42.347792    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3816738b-d08e-4c95-af04-5f7e8bd9ea1a-workload-socket\") pod \"3816738b-d08e-4c95-af04-5f7e8bd9ea1a\" (UID: \"3816738b-d08e-4c95-af04-5f7e8bd9ea1a\") "
Jul 14 20:23:42.348006 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:23:42.347834    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3816738b-d08e-4c95-af04-5f7e8bd9ea1a-workload-certs\") pod \"3816738b-d08e-4c95-af04-5f7e8bd9ea1a\" (UID: \"3816738b-d08e-4c95-af04-5f7e8bd9ea1a\") "
Jul 14 20:23:42.348006 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:23:42.347863    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3816738b-d08e-4c95-af04-5f7e8bd9ea1a-istio-data\") pod \"3816738b-d08e-4c95-af04-5f7e8bd9ea1a\" (UID: \"3816738b-d08e-4c95-af04-5f7e8bd9ea1a\") "
Jul 14 20:23:42.348006 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:23:42.347905    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3816738b-d08e-4c95-af04-5f7e8bd9ea1a-credential-socket\") pod \"3816738b-d08e-4c95-af04-5f7e8bd9ea1a\" (UID: \"3816738b-d08e-4c95-af04-5f7e8bd9ea1a\") "
Jul 14 20:23:42.348006 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:23:42.347930    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-d54kr\" (UniqueName: \"kubernetes.io/projected/3816738b-d08e-4c95-af04-5f7e8bd9ea1a-kube-api-access-d54kr\") pod \"3816738b-d08e-4c95-af04-5f7e8bd9ea1a\" (UID: \"3816738b-d08e-4c95-af04-5f7e8bd9ea1a\") "
Jul 14 20:23:42.348006 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:23:42.347944    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3816738b-d08e-4c95-af04-5f7e8bd9ea1a-istiod-ca-cert\") pod \"3816738b-d08e-4c95-af04-5f7e8bd9ea1a\" (UID: \"3816738b-d08e-4c95-af04-5f7e8bd9ea1a\") "
Jul 14 20:23:42.348278 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:23:42.348015    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3816738b-d08e-4c95-af04-5f7e8bd9ea1a-istio-token\") pod \"3816738b-d08e-4c95-af04-5f7e8bd9ea1a\" (UID: \"3816738b-d08e-4c95-af04-5f7e8bd9ea1a\") "
Jul 14 20:23:42.348278 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:23:42.348049    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3816738b-d08e-4c95-af04-5f7e8bd9ea1a-istio-envoy\") pod \"3816738b-d08e-4c95-af04-5f7e8bd9ea1a\" (UID: \"3816738b-d08e-4c95-af04-5f7e8bd9ea1a\") "
Jul 14 20:23:42.348278 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:23:42.348080    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3816738b-d08e-4c95-af04-5f7e8bd9ea1a-istio-podinfo\") pod \"3816738b-d08e-4c95-af04-5f7e8bd9ea1a\" (UID: \"3816738b-d08e-4c95-af04-5f7e8bd9ea1a\") "
Jul 14 20:23:42.348278 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:23:42.348099    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3816738b-d08e-4c95-af04-5f7e8bd9ea1a-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "3816738b-d08e-4c95-af04-5f7e8bd9ea1a" (UID: "3816738b-d08e-4c95-af04-5f7e8bd9ea1a"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 20:23:42.348278 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:23:42.348165    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3816738b-d08e-4c95-af04-5f7e8bd9ea1a-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "3816738b-d08e-4c95-af04-5f7e8bd9ea1a" (UID: "3816738b-d08e-4c95-af04-5f7e8bd9ea1a"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 20:23:42.348519 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:23:42.348370    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3816738b-d08e-4c95-af04-5f7e8bd9ea1a-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "3816738b-d08e-4c95-af04-5f7e8bd9ea1a" (UID: "3816738b-d08e-4c95-af04-5f7e8bd9ea1a"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 20:23:42.348519 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:23:42.348360    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3816738b-d08e-4c95-af04-5f7e8bd9ea1a-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "3816738b-d08e-4c95-af04-5f7e8bd9ea1a" (UID: "3816738b-d08e-4c95-af04-5f7e8bd9ea1a"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 14 20:23:42.348519 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:23:42.348441    2579 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3816738b-d08e-4c95-af04-5f7e8bd9ea1a-workload-socket\") on node \"ip-10-0-140-201.ec2.internal\" DevicePath \"\""
Jul 14 20:23:42.348519 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:23:42.348463    2579 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3816738b-d08e-4c95-af04-5f7e8bd9ea1a-workload-certs\") on node \"ip-10-0-140-201.ec2.internal\" DevicePath \"\""
Jul 14 20:23:42.349218 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:23:42.349190    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3816738b-d08e-4c95-af04-5f7e8bd9ea1a-istio-data" (OuterVolumeSpecName: "istio-data") pod "3816738b-d08e-4c95-af04-5f7e8bd9ea1a" (UID: "3816738b-d08e-4c95-af04-5f7e8bd9ea1a"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 20:23:42.350332 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:23:42.350302    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/3816738b-d08e-4c95-af04-5f7e8bd9ea1a-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "3816738b-d08e-4c95-af04-5f7e8bd9ea1a" (UID: "3816738b-d08e-4c95-af04-5f7e8bd9ea1a"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 14 20:23:42.350332 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:23:42.350299    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3816738b-d08e-4c95-af04-5f7e8bd9ea1a-istio-token" (OuterVolumeSpecName: "istio-token") pod "3816738b-d08e-4c95-af04-5f7e8bd9ea1a" (UID: "3816738b-d08e-4c95-af04-5f7e8bd9ea1a"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 14 20:23:42.350474 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:23:42.350343    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3816738b-d08e-4c95-af04-5f7e8bd9ea1a-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "3816738b-d08e-4c95-af04-5f7e8bd9ea1a" (UID: "3816738b-d08e-4c95-af04-5f7e8bd9ea1a"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 20:23:42.350474 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:23:42.350389    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3816738b-d08e-4c95-af04-5f7e8bd9ea1a-kube-api-access-d54kr" (OuterVolumeSpecName: "kube-api-access-d54kr") pod "3816738b-d08e-4c95-af04-5f7e8bd9ea1a" (UID: "3816738b-d08e-4c95-af04-5f7e8bd9ea1a"). InnerVolumeSpecName "kube-api-access-d54kr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 14 20:23:42.449634 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:23:42.449601    2579 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3816738b-d08e-4c95-af04-5f7e8bd9ea1a-istio-token\") on node \"ip-10-0-140-201.ec2.internal\" DevicePath \"\""
Jul 14 20:23:42.449634 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:23:42.449629    2579 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3816738b-d08e-4c95-af04-5f7e8bd9ea1a-istio-envoy\") on node \"ip-10-0-140-201.ec2.internal\" DevicePath \"\""
Jul 14 20:23:42.449634 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:23:42.449640    2579 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3816738b-d08e-4c95-af04-5f7e8bd9ea1a-istio-podinfo\") on node \"ip-10-0-140-201.ec2.internal\" DevicePath \"\""
Jul 14 20:23:42.449868 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:23:42.449653    2579 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3816738b-d08e-4c95-af04-5f7e8bd9ea1a-istio-data\") on node \"ip-10-0-140-201.ec2.internal\" DevicePath \"\""
Jul 14 20:23:42.449868 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:23:42.449663    2579 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3816738b-d08e-4c95-af04-5f7e8bd9ea1a-credential-socket\") on node \"ip-10-0-140-201.ec2.internal\" DevicePath \"\""
Jul 14 20:23:42.449868 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:23:42.449672    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-d54kr\" (UniqueName: \"kubernetes.io/projected/3816738b-d08e-4c95-af04-5f7e8bd9ea1a-kube-api-access-d54kr\") on node \"ip-10-0-140-201.ec2.internal\" DevicePath \"\""
Jul 14 20:23:42.449868 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:23:42.449680    2579 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3816738b-d08e-4c95-af04-5f7e8bd9ea1a-istiod-ca-cert\") on node \"ip-10-0-140-201.ec2.internal\" DevicePath \"\""
Jul 14 20:23:42.889335 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:23:42.889302    2579 generic.go:356] "Generic (PLEG): container finished" podID="3816738b-d08e-4c95-af04-5f7e8bd9ea1a" containerID="28bad9c28f3cf74905deeba86cdaeced99fb61c47c9c84b0adb93eba173c5629" exitCode=0
Jul 14 20:23:42.889547 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:23:42.889350    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-7044c372-openshift-default-5484f847b7-dfks5"
Jul 14 20:23:42.889547 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:23:42.889394    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-7044c372-openshift-default-5484f847b7-dfks5" event={"ID":"3816738b-d08e-4c95-af04-5f7e8bd9ea1a","Type":"ContainerDied","Data":"28bad9c28f3cf74905deeba86cdaeced99fb61c47c9c84b0adb93eba173c5629"}
Jul 14 20:23:42.889547 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:23:42.889459    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-7044c372-openshift-default-5484f847b7-dfks5" event={"ID":"3816738b-d08e-4c95-af04-5f7e8bd9ea1a","Type":"ContainerDied","Data":"070ad97267050a538320cb14bf422b4ec3abca62806eef527cefa325c76197a5"}
Jul 14 20:23:42.889547 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:23:42.889490    2579 scope.go:117] "RemoveContainer" containerID="28bad9c28f3cf74905deeba86cdaeced99fb61c47c9c84b0adb93eba173c5629"
Jul 14 20:23:42.898978 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:23:42.898960    2579 scope.go:117] "RemoveContainer" containerID="94b5ac887887cea729d286dde45beec4f64622ad35e229af8410821f37b46e24"
Jul 14 20:23:42.907769 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:23:42.907748    2579 scope.go:117] "RemoveContainer" containerID="28bad9c28f3cf74905deeba86cdaeced99fb61c47c9c84b0adb93eba173c5629"
Jul 14 20:23:42.908048 ip-10-0-140-201 kubenswrapper[2579]: E0714 20:23:42.908028    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"28bad9c28f3cf74905deeba86cdaeced99fb61c47c9c84b0adb93eba173c5629\": container with ID starting with 28bad9c28f3cf74905deeba86cdaeced99fb61c47c9c84b0adb93eba173c5629 not found: ID does not exist" containerID="28bad9c28f3cf74905deeba86cdaeced99fb61c47c9c84b0adb93eba173c5629"
Jul 14 20:23:42.908101 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:23:42.908061    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"28bad9c28f3cf74905deeba86cdaeced99fb61c47c9c84b0adb93eba173c5629"} err="failed to get container status \"28bad9c28f3cf74905deeba86cdaeced99fb61c47c9c84b0adb93eba173c5629\": rpc error: code = NotFound desc = could not find container \"28bad9c28f3cf74905deeba86cdaeced99fb61c47c9c84b0adb93eba173c5629\": container with ID starting with 28bad9c28f3cf74905deeba86cdaeced99fb61c47c9c84b0adb93eba173c5629 not found: ID does not exist"
Jul 14 20:23:42.908101 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:23:42.908080    2579 scope.go:117] "RemoveContainer" containerID="94b5ac887887cea729d286dde45beec4f64622ad35e229af8410821f37b46e24"
Jul 14 20:23:42.908341 ip-10-0-140-201 kubenswrapper[2579]: E0714 20:23:42.908325    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"94b5ac887887cea729d286dde45beec4f64622ad35e229af8410821f37b46e24\": container with ID starting with 94b5ac887887cea729d286dde45beec4f64622ad35e229af8410821f37b46e24 not found: ID does not exist" containerID="94b5ac887887cea729d286dde45beec4f64622ad35e229af8410821f37b46e24"
Jul 14 20:23:42.908402 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:23:42.908345    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"94b5ac887887cea729d286dde45beec4f64622ad35e229af8410821f37b46e24"} err="failed to get container status \"94b5ac887887cea729d286dde45beec4f64622ad35e229af8410821f37b46e24\": rpc error: code = NotFound desc = could not find container \"94b5ac887887cea729d286dde45beec4f64622ad35e229af8410821f37b46e24\": container with ID starting with 94b5ac887887cea729d286dde45beec4f64622ad35e229af8410821f37b46e24 not found: ID does not exist"
Jul 14 20:23:42.914164 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:23:42.914139    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-7044c372-openshift-default-5484f847b7-dfks5"]
Jul 14 20:23:42.926765 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:23:42.926737    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-derive-7044c372-openshift-default-5484f847b7-dfks5"]
Jul 14 20:23:44.847683 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:23:44.847649    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3816738b-d08e-4c95-af04-5f7e8bd9ea1a" path="/var/lib/kubelet/pods/3816738b-d08e-4c95-af04-5f7e8bd9ea1a/volumes"
Jul 14 20:25:18.100615 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:25:18.100573    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-d080ee51-openshift-default-558f9c6c95-btfjs"]
Jul 14 20:25:18.101217 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:25:18.101125    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3816738b-d08e-4c95-af04-5f7e8bd9ea1a" containerName="istio-proxy"
Jul 14 20:25:18.101217 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:25:18.101146    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="3816738b-d08e-4c95-af04-5f7e8bd9ea1a" containerName="istio-proxy"
Jul 14 20:25:18.101217 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:25:18.101158    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3816738b-d08e-4c95-af04-5f7e8bd9ea1a" containerName="istio-proxy"
Jul 14 20:25:18.101217 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:25:18.101167    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="3816738b-d08e-4c95-af04-5f7e8bd9ea1a" containerName="istio-proxy"
Jul 14 20:25:18.101217 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:25:18.101179    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="eeb10f2d-fd76-4897-95f3-da7a3d2bd49a" containerName="istio-proxy"
Jul 14 20:25:18.101217 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:25:18.101188    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="eeb10f2d-fd76-4897-95f3-da7a3d2bd49a" containerName="istio-proxy"
Jul 14 20:25:18.101520 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:25:18.101229    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="833935d4-1fba-41be-9230-76ee5e8d241a" containerName="revoke-keys"
Jul 14 20:25:18.101520 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:25:18.101238    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="833935d4-1fba-41be-9230-76ee5e8d241a" containerName="revoke-keys"
Jul 14 20:25:18.101520 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:25:18.101330    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="3816738b-d08e-4c95-af04-5f7e8bd9ea1a" containerName="istio-proxy"
Jul 14 20:25:18.101520 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:25:18.101343    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="eeb10f2d-fd76-4897-95f3-da7a3d2bd49a" containerName="istio-proxy"
Jul 14 20:25:18.101520 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:25:18.101355    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="833935d4-1fba-41be-9230-76ee5e8d241a" containerName="revoke-keys"
Jul 14 20:25:18.104514 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:25:18.104493    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-d080ee51-openshift-default-558f9c6c95-btfjs"
Jul 14 20:25:18.109340 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:25:18.109316    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-d080ee51-openshift-default-dockercfg-dpwt9\""
Jul 14 20:25:18.128739 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:25:18.128708    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-d080ee51-openshift-default-558f9c6c95-btfjs"]
Jul 14 20:25:18.148618 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:25:18.148578    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/245a2890-0468-4902-a859-93e648d56015-istiod-ca-cert\") pod \"e2e-mt-d080ee51-openshift-default-558f9c6c95-btfjs\" (UID: \"245a2890-0468-4902-a859-93e648d56015\") " pod="openshift-ingress/e2e-mt-d080ee51-openshift-default-558f9c6c95-btfjs"
Jul 14 20:25:18.148785 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:25:18.148633    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/245a2890-0468-4902-a859-93e648d56015-istio-token\") pod \"e2e-mt-d080ee51-openshift-default-558f9c6c95-btfjs\" (UID: \"245a2890-0468-4902-a859-93e648d56015\") " pod="openshift-ingress/e2e-mt-d080ee51-openshift-default-558f9c6c95-btfjs"
Jul 14 20:25:18.148785 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:25:18.148755    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/245a2890-0468-4902-a859-93e648d56015-istio-podinfo\") pod \"e2e-mt-d080ee51-openshift-default-558f9c6c95-btfjs\" (UID: \"245a2890-0468-4902-a859-93e648d56015\") " pod="openshift-ingress/e2e-mt-d080ee51-openshift-default-558f9c6c95-btfjs"
Jul 14 20:25:18.148882 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:25:18.148800    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/245a2890-0468-4902-a859-93e648d56015-workload-socket\") pod \"e2e-mt-d080ee51-openshift-default-558f9c6c95-btfjs\" (UID: \"245a2890-0468-4902-a859-93e648d56015\") " pod="openshift-ingress/e2e-mt-d080ee51-openshift-default-558f9c6c95-btfjs"
Jul 14 20:25:18.148922 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:25:18.148888    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/245a2890-0468-4902-a859-93e648d56015-credential-socket\") pod \"e2e-mt-d080ee51-openshift-default-558f9c6c95-btfjs\" (UID: \"245a2890-0468-4902-a859-93e648d56015\") " pod="openshift-ingress/e2e-mt-d080ee51-openshift-default-558f9c6c95-btfjs"
Jul 14 20:25:18.148969 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:25:18.148924    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/245a2890-0468-4902-a859-93e648d56015-istio-data\") pod \"e2e-mt-d080ee51-openshift-default-558f9c6c95-btfjs\" (UID: \"245a2890-0468-4902-a859-93e648d56015\") " pod="openshift-ingress/e2e-mt-d080ee51-openshift-default-558f9c6c95-btfjs"
Jul 14 20:25:18.148969 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:25:18.148944    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/245a2890-0468-4902-a859-93e648d56015-istio-envoy\") pod \"e2e-mt-d080ee51-openshift-default-558f9c6c95-btfjs\" (UID: \"245a2890-0468-4902-a859-93e648d56015\") " pod="openshift-ingress/e2e-mt-d080ee51-openshift-default-558f9c6c95-btfjs"
Jul 14 20:25:18.148969 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:25:18.148963    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r7rb9\" (UniqueName: \"kubernetes.io/projected/245a2890-0468-4902-a859-93e648d56015-kube-api-access-r7rb9\") pod \"e2e-mt-d080ee51-openshift-default-558f9c6c95-btfjs\" (UID: \"245a2890-0468-4902-a859-93e648d56015\") " pod="openshift-ingress/e2e-mt-d080ee51-openshift-default-558f9c6c95-btfjs"
Jul 14 20:25:18.149092 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:25:18.149022    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/245a2890-0468-4902-a859-93e648d56015-workload-certs\") pod \"e2e-mt-d080ee51-openshift-default-558f9c6c95-btfjs\" (UID: \"245a2890-0468-4902-a859-93e648d56015\") " pod="openshift-ingress/e2e-mt-d080ee51-openshift-default-558f9c6c95-btfjs"
Jul 14 20:25:18.249772 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:25:18.249725    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/245a2890-0468-4902-a859-93e648d56015-credential-socket\") pod \"e2e-mt-d080ee51-openshift-default-558f9c6c95-btfjs\" (UID: \"245a2890-0468-4902-a859-93e648d56015\") " pod="openshift-ingress/e2e-mt-d080ee51-openshift-default-558f9c6c95-btfjs"
Jul 14 20:25:18.249772 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:25:18.249775    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/245a2890-0468-4902-a859-93e648d56015-istio-data\") pod \"e2e-mt-d080ee51-openshift-default-558f9c6c95-btfjs\" (UID: \"245a2890-0468-4902-a859-93e648d56015\") " pod="openshift-ingress/e2e-mt-d080ee51-openshift-default-558f9c6c95-btfjs"
Jul 14 20:25:18.250028 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:25:18.249893    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/245a2890-0468-4902-a859-93e648d56015-istio-envoy\") pod \"e2e-mt-d080ee51-openshift-default-558f9c6c95-btfjs\" (UID: \"245a2890-0468-4902-a859-93e648d56015\") " pod="openshift-ingress/e2e-mt-d080ee51-openshift-default-558f9c6c95-btfjs"
Jul 14 20:25:18.250028 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:25:18.249942    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r7rb9\" (UniqueName: \"kubernetes.io/projected/245a2890-0468-4902-a859-93e648d56015-kube-api-access-r7rb9\") pod \"e2e-mt-d080ee51-openshift-default-558f9c6c95-btfjs\" (UID: \"245a2890-0468-4902-a859-93e648d56015\") " pod="openshift-ingress/e2e-mt-d080ee51-openshift-default-558f9c6c95-btfjs"
Jul 14 20:25:18.250028 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:25:18.250020    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/245a2890-0468-4902-a859-93e648d56015-workload-certs\") pod \"e2e-mt-d080ee51-openshift-default-558f9c6c95-btfjs\" (UID: \"245a2890-0468-4902-a859-93e648d56015\") " pod="openshift-ingress/e2e-mt-d080ee51-openshift-default-558f9c6c95-btfjs"
Jul 14 20:25:18.250216 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:25:18.250185    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/245a2890-0468-4902-a859-93e648d56015-istio-data\") pod \"e2e-mt-d080ee51-openshift-default-558f9c6c95-btfjs\" (UID: \"245a2890-0468-4902-a859-93e648d56015\") " pod="openshift-ingress/e2e-mt-d080ee51-openshift-default-558f9c6c95-btfjs"
Jul 14 20:25:18.250281 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:25:18.250196    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/245a2890-0468-4902-a859-93e648d56015-istiod-ca-cert\") pod \"e2e-mt-d080ee51-openshift-default-558f9c6c95-btfjs\" (UID: \"245a2890-0468-4902-a859-93e648d56015\") " pod="openshift-ingress/e2e-mt-d080ee51-openshift-default-558f9c6c95-btfjs"
Jul 14 20:25:18.250336 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:25:18.250306    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/245a2890-0468-4902-a859-93e648d56015-istio-token\") pod \"e2e-mt-d080ee51-openshift-default-558f9c6c95-btfjs\" (UID: \"245a2890-0468-4902-a859-93e648d56015\") " pod="openshift-ingress/e2e-mt-d080ee51-openshift-default-558f9c6c95-btfjs"
Jul 14 20:25:18.250394 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:25:18.250345    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/245a2890-0468-4902-a859-93e648d56015-workload-certs\") pod \"e2e-mt-d080ee51-openshift-default-558f9c6c95-btfjs\" (UID: \"245a2890-0468-4902-a859-93e648d56015\") " pod="openshift-ingress/e2e-mt-d080ee51-openshift-default-558f9c6c95-btfjs"
Jul 14 20:25:18.250466 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:25:18.250450    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/245a2890-0468-4902-a859-93e648d56015-istio-podinfo\") pod \"e2e-mt-d080ee51-openshift-default-558f9c6c95-btfjs\" (UID: \"245a2890-0468-4902-a859-93e648d56015\") " pod="openshift-ingress/e2e-mt-d080ee51-openshift-default-558f9c6c95-btfjs"
Jul 14 20:25:18.250526 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:25:18.250485    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/245a2890-0468-4902-a859-93e648d56015-workload-socket\") pod \"e2e-mt-d080ee51-openshift-default-558f9c6c95-btfjs\" (UID: \"245a2890-0468-4902-a859-93e648d56015\") " pod="openshift-ingress/e2e-mt-d080ee51-openshift-default-558f9c6c95-btfjs"
Jul 14 20:25:18.250603 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:25:18.250516    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/245a2890-0468-4902-a859-93e648d56015-credential-socket\") pod \"e2e-mt-d080ee51-openshift-default-558f9c6c95-btfjs\" (UID: \"245a2890-0468-4902-a859-93e648d56015\") " pod="openshift-ingress/e2e-mt-d080ee51-openshift-default-558f9c6c95-btfjs"
Jul 14 20:25:18.250814 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:25:18.250793    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/245a2890-0468-4902-a859-93e648d56015-workload-socket\") pod \"e2e-mt-d080ee51-openshift-default-558f9c6c95-btfjs\" (UID: \"245a2890-0468-4902-a859-93e648d56015\") " pod="openshift-ingress/e2e-mt-d080ee51-openshift-default-558f9c6c95-btfjs"
Jul 14 20:25:18.251171 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:25:18.251102    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/245a2890-0468-4902-a859-93e648d56015-istiod-ca-cert\") pod \"e2e-mt-d080ee51-openshift-default-558f9c6c95-btfjs\" (UID: \"245a2890-0468-4902-a859-93e648d56015\") " pod="openshift-ingress/e2e-mt-d080ee51-openshift-default-558f9c6c95-btfjs"
Jul 14 20:25:18.252416 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:25:18.252394    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/245a2890-0468-4902-a859-93e648d56015-istio-envoy\") pod \"e2e-mt-d080ee51-openshift-default-558f9c6c95-btfjs\" (UID: \"245a2890-0468-4902-a859-93e648d56015\") " pod="openshift-ingress/e2e-mt-d080ee51-openshift-default-558f9c6c95-btfjs"
Jul 14 20:25:18.253109 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:25:18.253090    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/245a2890-0468-4902-a859-93e648d56015-istio-podinfo\") pod \"e2e-mt-d080ee51-openshift-default-558f9c6c95-btfjs\" (UID: \"245a2890-0468-4902-a859-93e648d56015\") " pod="openshift-ingress/e2e-mt-d080ee51-openshift-default-558f9c6c95-btfjs"
Jul 14 20:25:18.259718 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:25:18.259694    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/245a2890-0468-4902-a859-93e648d56015-istio-token\") pod \"e2e-mt-d080ee51-openshift-default-558f9c6c95-btfjs\" (UID: \"245a2890-0468-4902-a859-93e648d56015\") " pod="openshift-ingress/e2e-mt-d080ee51-openshift-default-558f9c6c95-btfjs"
Jul 14 20:25:18.260033 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:25:18.260009    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r7rb9\" (UniqueName: \"kubernetes.io/projected/245a2890-0468-4902-a859-93e648d56015-kube-api-access-r7rb9\") pod \"e2e-mt-d080ee51-openshift-default-558f9c6c95-btfjs\" (UID: \"245a2890-0468-4902-a859-93e648d56015\") " pod="openshift-ingress/e2e-mt-d080ee51-openshift-default-558f9c6c95-btfjs"
Jul 14 20:25:18.418698 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:25:18.418616    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-d080ee51-openshift-default-558f9c6c95-btfjs"
Jul 14 20:25:18.576156 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:25:18.576127    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-d080ee51-openshift-default-558f9c6c95-btfjs"]
Jul 14 20:25:18.577986 ip-10-0-140-201 kubenswrapper[2579]: W0714 20:25:18.577950    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod245a2890_0468_4902_a859_93e648d56015.slice/crio-8f27a0a4a965e5a9ec17bdcfa145c1ab4d1129869b5e19c2b95cfb63cfae39aa WatchSource:0}: Error finding container 8f27a0a4a965e5a9ec17bdcfa145c1ab4d1129869b5e19c2b95cfb63cfae39aa: Status 404 returned error can't find the container with id 8f27a0a4a965e5a9ec17bdcfa145c1ab4d1129869b5e19c2b95cfb63cfae39aa
Jul 14 20:25:18.580214 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:25:18.580176    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 14 20:25:18.580290 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:25:18.580245    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 14 20:25:18.580290 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:25:18.580281    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 14 20:25:19.418396 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:25:19.418362    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-d080ee51-openshift-default-558f9c6c95-btfjs" event={"ID":"245a2890-0468-4902-a859-93e648d56015","Type":"ContainerStarted","Data":"c2306ad1fc66712a752abd921cd1b33c6c3709ff177b5e2d414939fa055a54b6"}
Jul 14 20:25:19.418825 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:25:19.418416    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-d080ee51-openshift-default-558f9c6c95-btfjs" event={"ID":"245a2890-0468-4902-a859-93e648d56015","Type":"ContainerStarted","Data":"8f27a0a4a965e5a9ec17bdcfa145c1ab4d1129869b5e19c2b95cfb63cfae39aa"}
Jul 14 20:25:19.418825 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:25:19.418740    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-d080ee51-openshift-default-558f9c6c95-btfjs"
Jul 14 20:25:19.423459 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:25:19.423434    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-d080ee51-openshift-default-558f9c6c95-btfjs"
Jul 14 20:25:19.444893 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:25:19.444843    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-d080ee51-openshift-default-558f9c6c95-btfjs" podStartSLOduration=1.4448234 podStartE2EDuration="1.4448234s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 20:25:18 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 20:25:19.443643288 +0000 UTC m=+2019.155238833" watchObservedRunningTime="2026-07-14 20:25:19.4448234 +0000 UTC m=+2019.156418944"
Jul 14 20:25:20.424342 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:25:20.424308    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-d080ee51-openshift-default-558f9c6c95-btfjs"
Jul 14 20:25:20.425168 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:25:20.425150    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-d080ee51-openshift-default-558f9c6c95-btfjs"
Jul 14 20:25:34.502704 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:25:34.502649    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-d080ee51-9fb8g"]
Jul 14 20:25:34.503168 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:25:34.503094    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="3816738b-d08e-4c95-af04-5f7e8bd9ea1a" containerName="istio-proxy"
Jul 14 20:25:34.506287 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:25:34.506266    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-d080ee51-9fb8g"
Jul 14 20:25:34.509176 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:25:34.509141    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-4blwh\""
Jul 14 20:25:34.509933 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:25:34.509913    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 14 20:25:34.519200 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:25:34.519174    2579 generic.go:356] "Generic (PLEG): container finished" podID="245a2890-0468-4902-a859-93e648d56015" containerID="c2306ad1fc66712a752abd921cd1b33c6c3709ff177b5e2d414939fa055a54b6" exitCode=0
Jul 14 20:25:34.519326 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:25:34.519248    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-d080ee51-openshift-default-558f9c6c95-btfjs" event={"ID":"245a2890-0468-4902-a859-93e648d56015","Type":"ContainerDied","Data":"c2306ad1fc66712a752abd921cd1b33c6c3709ff177b5e2d414939fa055a54b6"}
Jul 14 20:25:34.519698 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:25:34.519681    2579 scope.go:117] "RemoveContainer" containerID="c2306ad1fc66712a752abd921cd1b33c6c3709ff177b5e2d414939fa055a54b6"
Jul 14 20:25:34.520684 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:25:34.520657    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 14 20:25:34.520774 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:25:34.520739    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 14 20:25:34.520836 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:25:34.520783    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 14 20:25:34.532737 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:25:34.532713    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-d080ee51-9fb8g"]
Jul 14 20:25:34.622670 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:25:34.622589    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/75846082-8297-43e7-adb0-d3f477a9648d-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-d080ee51-9fb8g\" (UID: \"75846082-8297-43e7-adb0-d3f477a9648d\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-d080ee51-9fb8g"
Jul 14 20:25:34.723578 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:25:34.723519    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/75846082-8297-43e7-adb0-d3f477a9648d-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-d080ee51-9fb8g\" (UID: \"75846082-8297-43e7-adb0-d3f477a9648d\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-d080ee51-9fb8g"
Jul 14 20:25:34.724209 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:25:34.724183    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/75846082-8297-43e7-adb0-d3f477a9648d-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-d080ee51-9fb8g\" (UID: \"75846082-8297-43e7-adb0-d3f477a9648d\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-d080ee51-9fb8g"
Jul 14 20:25:34.817408 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:25:34.817321    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-d080ee51-9fb8g"
Jul 14 20:25:34.997099 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:25:34.997070    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-d080ee51-9fb8g"]
Jul 14 20:25:34.999209 ip-10-0-140-201 kubenswrapper[2579]: W0714 20:25:34.999169    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod75846082_8297_43e7_adb0_d3f477a9648d.slice/crio-a501a60c067fdc3edbc41ab95ca24d7d8bafc5b5e9f113e7fbbf339286db055f WatchSource:0}: Error finding container a501a60c067fdc3edbc41ab95ca24d7d8bafc5b5e9f113e7fbbf339286db055f: Status 404 returned error can't find the container with id a501a60c067fdc3edbc41ab95ca24d7d8bafc5b5e9f113e7fbbf339286db055f
Jul 14 20:25:35.425142 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:25:35.425106    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-d080ee51-openshift-default-558f9c6c95-btfjs"
Jul 14 20:25:35.527138 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:25:35.527097    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-d080ee51-openshift-default-558f9c6c95-btfjs" event={"ID":"245a2890-0468-4902-a859-93e648d56015","Type":"ContainerStarted","Data":"316fa77a1314e0359b727b4833cacf01797dbe0c78ea606912be678a2b5e5063"}
Jul 14 20:25:35.528608 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:25:35.528572    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-d080ee51-9fb8g" event={"ID":"75846082-8297-43e7-adb0-d3f477a9648d","Type":"ContainerStarted","Data":"b31506f6c846452c5dd2479c407edfbf1010cf4d3ac1c18773644c5a23d89b4f"}
Jul 14 20:25:35.528765 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:25:35.528617    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-d080ee51-9fb8g" event={"ID":"75846082-8297-43e7-adb0-d3f477a9648d","Type":"ContainerStarted","Data":"a501a60c067fdc3edbc41ab95ca24d7d8bafc5b5e9f113e7fbbf339286db055f"}
Jul 14 20:25:35.589287 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:25:35.589172    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-d080ee51-9fb8g" podStartSLOduration=1.589148254 podStartE2EDuration="1.589148254s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 20:25:34 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 20:25:35.584858464 +0000 UTC m=+2035.296454010" watchObservedRunningTime="2026-07-14 20:25:35.589148254 +0000 UTC m=+2035.300743800"
Jul 14 20:25:36.419484 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:25:36.419451    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-d080ee51-openshift-default-558f9c6c95-btfjs"
Jul 14 20:25:36.420734 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:25:36.420708    2579 patch_prober.go:28] interesting pod/e2e-mt-d080ee51-openshift-default-558f9c6c95-btfjs container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.52:15021/healthz/ready\": dial tcp 10.133.0.52:15021: connect: connection refused" start-of-body=
Jul 14 20:25:36.420842 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:25:36.420760    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-d080ee51-openshift-default-558f9c6c95-btfjs" podUID="245a2890-0468-4902-a859-93e648d56015" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.52:15021/healthz/ready\": dial tcp 10.133.0.52:15021: connect: connection refused"
Jul 14 20:25:36.535728 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:25:36.535695    2579 generic.go:356] "Generic (PLEG): container finished" podID="75846082-8297-43e7-adb0-d3f477a9648d" containerID="b31506f6c846452c5dd2479c407edfbf1010cf4d3ac1c18773644c5a23d89b4f" exitCode=0
Jul 14 20:25:36.536119 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:25:36.535784    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-d080ee51-9fb8g" event={"ID":"75846082-8297-43e7-adb0-d3f477a9648d","Type":"ContainerDied","Data":"b31506f6c846452c5dd2479c407edfbf1010cf4d3ac1c18773644c5a23d89b4f"}
Jul 14 20:25:37.419921 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:25:37.419878    2579 patch_prober.go:28] interesting pod/e2e-mt-d080ee51-openshift-default-558f9c6c95-btfjs container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.52:15021/healthz/ready\": dial tcp 10.133.0.52:15021: connect: connection refused" start-of-body=
Jul 14 20:25:37.420104 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:25:37.419956    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-d080ee51-openshift-default-558f9c6c95-btfjs" podUID="245a2890-0468-4902-a859-93e648d56015" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.52:15021/healthz/ready\": dial tcp 10.133.0.52:15021: connect: connection refused"
Jul 14 20:25:37.720628 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:25:37.720602    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-d080ee51-9fb8g"
Jul 14 20:25:37.851028 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:25:37.850987    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/75846082-8297-43e7-adb0-d3f477a9648d-maas-api-service-ca\") pod \"75846082-8297-43e7-adb0-d3f477a9648d\" (UID: \"75846082-8297-43e7-adb0-d3f477a9648d\") "
Jul 14 20:25:37.851364 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:25:37.851337    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/75846082-8297-43e7-adb0-d3f477a9648d-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "75846082-8297-43e7-adb0-d3f477a9648d" (UID: "75846082-8297-43e7-adb0-d3f477a9648d"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 14 20:25:37.952595 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:25:37.952479    2579 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/75846082-8297-43e7-adb0-d3f477a9648d-maas-api-service-ca\") on node \"ip-10-0-140-201.ec2.internal\" DevicePath \"\""
Jul 14 20:25:38.419422 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:25:38.419383    2579 patch_prober.go:28] interesting pod/e2e-mt-d080ee51-openshift-default-558f9c6c95-btfjs container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.52:15021/healthz/ready\": dial tcp 10.133.0.52:15021: connect: connection refused" start-of-body=
Jul 14 20:25:38.419608 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:25:38.419444    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-d080ee51-openshift-default-558f9c6c95-btfjs" podUID="245a2890-0468-4902-a859-93e648d56015" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.52:15021/healthz/ready\": dial tcp 10.133.0.52:15021: connect: connection refused"
Jul 14 20:25:38.547096 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:25:38.547062    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-d080ee51-9fb8g"
Jul 14 20:25:38.547282 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:25:38.547096    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-d080ee51-9fb8g" event={"ID":"75846082-8297-43e7-adb0-d3f477a9648d","Type":"ContainerDied","Data":"a501a60c067fdc3edbc41ab95ca24d7d8bafc5b5e9f113e7fbbf339286db055f"}
Jul 14 20:25:38.547282 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:25:38.547142    2579 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a501a60c067fdc3edbc41ab95ca24d7d8bafc5b5e9f113e7fbbf339286db055f"
Jul 14 20:25:39.419990 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:25:39.419955    2579 patch_prober.go:28] interesting pod/e2e-mt-d080ee51-openshift-default-558f9c6c95-btfjs container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.52:15021/healthz/ready\": dial tcp 10.133.0.52:15021: connect: connection refused" start-of-body=
Jul 14 20:25:39.420374 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:25:39.420081    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-d080ee51-openshift-default-558f9c6c95-btfjs" podUID="245a2890-0468-4902-a859-93e648d56015" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.52:15021/healthz/ready\": dial tcp 10.133.0.52:15021: connect: connection refused"
Jul 14 20:25:40.423614 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:25:40.423581    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-d080ee51-openshift-default-558f9c6c95-btfjs"
Jul 14 20:25:40.424025 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:25:40.423881    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-d080ee51-openshift-default-558f9c6c95-btfjs"
Jul 14 20:25:40.424698 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:25:40.424677    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-d080ee51-openshift-default-558f9c6c95-btfjs"
Jul 14 20:26:00.640653 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:26:00.640616    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-d080ee51-openshift-default-558f9c6c95-btfjs"]
Jul 14 20:26:00.641145 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:26:00.640854    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-d080ee51-openshift-default-558f9c6c95-btfjs" podUID="245a2890-0468-4902-a859-93e648d56015" containerName="istio-proxy" containerID="cri-o://316fa77a1314e0359b727b4833cacf01797dbe0c78ea606912be678a2b5e5063" gracePeriod=30
Jul 14 20:26:05.890150 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:26:05.890119    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-d080ee51-openshift-default-558f9c6c95-btfjs"
Jul 14 20:26:06.020272 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:26:06.020230    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/245a2890-0468-4902-a859-93e648d56015-istiod-ca-cert\") pod \"245a2890-0468-4902-a859-93e648d56015\" (UID: \"245a2890-0468-4902-a859-93e648d56015\") "
Jul 14 20:26:06.020272 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:26:06.020282    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/245a2890-0468-4902-a859-93e648d56015-workload-certs\") pod \"245a2890-0468-4902-a859-93e648d56015\" (UID: \"245a2890-0468-4902-a859-93e648d56015\") "
Jul 14 20:26:06.020558 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:26:06.020348    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/245a2890-0468-4902-a859-93e648d56015-workload-socket\") pod \"245a2890-0468-4902-a859-93e648d56015\" (UID: \"245a2890-0468-4902-a859-93e648d56015\") "
Jul 14 20:26:06.020558 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:26:06.020367    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-r7rb9\" (UniqueName: \"kubernetes.io/projected/245a2890-0468-4902-a859-93e648d56015-kube-api-access-r7rb9\") pod \"245a2890-0468-4902-a859-93e648d56015\" (UID: \"245a2890-0468-4902-a859-93e648d56015\") "
Jul 14 20:26:06.020558 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:26:06.020388    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/245a2890-0468-4902-a859-93e648d56015-istio-token\") pod \"245a2890-0468-4902-a859-93e648d56015\" (UID: \"245a2890-0468-4902-a859-93e648d56015\") "
Jul 14 20:26:06.020558 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:26:06.020421    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/245a2890-0468-4902-a859-93e648d56015-credential-socket\") pod \"245a2890-0468-4902-a859-93e648d56015\" (UID: \"245a2890-0468-4902-a859-93e648d56015\") "
Jul 14 20:26:06.020558 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:26:06.020437    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/245a2890-0468-4902-a859-93e648d56015-istio-podinfo\") pod \"245a2890-0468-4902-a859-93e648d56015\" (UID: \"245a2890-0468-4902-a859-93e648d56015\") "
Jul 14 20:26:06.020558 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:26:06.020489    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/245a2890-0468-4902-a859-93e648d56015-istio-data\") pod \"245a2890-0468-4902-a859-93e648d56015\" (UID: \"245a2890-0468-4902-a859-93e648d56015\") "
Jul 14 20:26:06.020558 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:26:06.020513    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/245a2890-0468-4902-a859-93e648d56015-istio-envoy\") pod \"245a2890-0468-4902-a859-93e648d56015\" (UID: \"245a2890-0468-4902-a859-93e648d56015\") "
Jul 14 20:26:06.020914 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:26:06.020684    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/245a2890-0468-4902-a859-93e648d56015-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "245a2890-0468-4902-a859-93e648d56015" (UID: "245a2890-0468-4902-a859-93e648d56015"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 14 20:26:06.020914 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:26:06.020782    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/245a2890-0468-4902-a859-93e648d56015-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "245a2890-0468-4902-a859-93e648d56015" (UID: "245a2890-0468-4902-a859-93e648d56015"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 20:26:06.020914 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:26:06.020805    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/245a2890-0468-4902-a859-93e648d56015-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "245a2890-0468-4902-a859-93e648d56015" (UID: "245a2890-0468-4902-a859-93e648d56015"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 20:26:06.021062 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:26:06.020932    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/245a2890-0468-4902-a859-93e648d56015-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "245a2890-0468-4902-a859-93e648d56015" (UID: "245a2890-0468-4902-a859-93e648d56015"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 20:26:06.021062 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:26:06.020988    2579 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/245a2890-0468-4902-a859-93e648d56015-istiod-ca-cert\") on node \"ip-10-0-140-201.ec2.internal\" DevicePath \"\""
Jul 14 20:26:06.021062 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:26:06.021010    2579 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/245a2890-0468-4902-a859-93e648d56015-workload-certs\") on node \"ip-10-0-140-201.ec2.internal\" DevicePath \"\""
Jul 14 20:26:06.021062 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:26:06.021023    2579 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/245a2890-0468-4902-a859-93e648d56015-workload-socket\") on node \"ip-10-0-140-201.ec2.internal\" DevicePath \"\""
Jul 14 20:26:06.022085 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:26:06.022056    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/245a2890-0468-4902-a859-93e648d56015-istio-data" (OuterVolumeSpecName: "istio-data") pod "245a2890-0468-4902-a859-93e648d56015" (UID: "245a2890-0468-4902-a859-93e648d56015"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 20:26:06.022913 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:26:06.022885    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/245a2890-0468-4902-a859-93e648d56015-istio-token" (OuterVolumeSpecName: "istio-token") pod "245a2890-0468-4902-a859-93e648d56015" (UID: "245a2890-0468-4902-a859-93e648d56015"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 14 20:26:06.022913 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:26:06.022904    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/245a2890-0468-4902-a859-93e648d56015-kube-api-access-r7rb9" (OuterVolumeSpecName: "kube-api-access-r7rb9") pod "245a2890-0468-4902-a859-93e648d56015" (UID: "245a2890-0468-4902-a859-93e648d56015"). InnerVolumeSpecName "kube-api-access-r7rb9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 14 20:26:06.023042 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:26:06.022903    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/245a2890-0468-4902-a859-93e648d56015-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "245a2890-0468-4902-a859-93e648d56015" (UID: "245a2890-0468-4902-a859-93e648d56015"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 20:26:06.023042 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:26:06.022942    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/245a2890-0468-4902-a859-93e648d56015-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "245a2890-0468-4902-a859-93e648d56015" (UID: "245a2890-0468-4902-a859-93e648d56015"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 14 20:26:06.121721 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:26:06.121685    2579 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/245a2890-0468-4902-a859-93e648d56015-istio-data\") on node \"ip-10-0-140-201.ec2.internal\" DevicePath \"\""
Jul 14 20:26:06.121721 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:26:06.121716    2579 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/245a2890-0468-4902-a859-93e648d56015-istio-envoy\") on node \"ip-10-0-140-201.ec2.internal\" DevicePath \"\""
Jul 14 20:26:06.121721 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:26:06.121727    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-r7rb9\" (UniqueName: \"kubernetes.io/projected/245a2890-0468-4902-a859-93e648d56015-kube-api-access-r7rb9\") on node \"ip-10-0-140-201.ec2.internal\" DevicePath \"\""
Jul 14 20:26:06.121957 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:26:06.121737    2579 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/245a2890-0468-4902-a859-93e648d56015-istio-token\") on node \"ip-10-0-140-201.ec2.internal\" DevicePath \"\""
Jul 14 20:26:06.121957 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:26:06.121745    2579 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/245a2890-0468-4902-a859-93e648d56015-credential-socket\") on node \"ip-10-0-140-201.ec2.internal\" DevicePath \"\""
Jul 14 20:26:06.121957 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:26:06.121758    2579 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/245a2890-0468-4902-a859-93e648d56015-istio-podinfo\") on node \"ip-10-0-140-201.ec2.internal\" DevicePath \"\""
Jul 14 20:26:06.705352 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:26:06.705314    2579 generic.go:356] "Generic (PLEG): container finished" podID="245a2890-0468-4902-a859-93e648d56015" containerID="316fa77a1314e0359b727b4833cacf01797dbe0c78ea606912be678a2b5e5063" exitCode=0
Jul 14 20:26:06.705518 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:26:06.705360    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-d080ee51-openshift-default-558f9c6c95-btfjs"
Jul 14 20:26:06.705518 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:26:06.705376    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-d080ee51-openshift-default-558f9c6c95-btfjs" event={"ID":"245a2890-0468-4902-a859-93e648d56015","Type":"ContainerDied","Data":"316fa77a1314e0359b727b4833cacf01797dbe0c78ea606912be678a2b5e5063"}
Jul 14 20:26:06.705518 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:26:06.705427    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-d080ee51-openshift-default-558f9c6c95-btfjs" event={"ID":"245a2890-0468-4902-a859-93e648d56015","Type":"ContainerDied","Data":"8f27a0a4a965e5a9ec17bdcfa145c1ab4d1129869b5e19c2b95cfb63cfae39aa"}
Jul 14 20:26:06.705518 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:26:06.705450    2579 scope.go:117] "RemoveContainer" containerID="316fa77a1314e0359b727b4833cacf01797dbe0c78ea606912be678a2b5e5063"
Jul 14 20:26:06.715561 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:26:06.715523    2579 scope.go:117] "RemoveContainer" containerID="c2306ad1fc66712a752abd921cd1b33c6c3709ff177b5e2d414939fa055a54b6"
Jul 14 20:26:06.723936 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:26:06.723917    2579 scope.go:117] "RemoveContainer" containerID="316fa77a1314e0359b727b4833cacf01797dbe0c78ea606912be678a2b5e5063"
Jul 14 20:26:06.724245 ip-10-0-140-201 kubenswrapper[2579]: E0714 20:26:06.724225    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"316fa77a1314e0359b727b4833cacf01797dbe0c78ea606912be678a2b5e5063\": container with ID starting with 316fa77a1314e0359b727b4833cacf01797dbe0c78ea606912be678a2b5e5063 not found: ID does not exist" containerID="316fa77a1314e0359b727b4833cacf01797dbe0c78ea606912be678a2b5e5063"
Jul 14 20:26:06.724294 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:26:06.724255    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"316fa77a1314e0359b727b4833cacf01797dbe0c78ea606912be678a2b5e5063"} err="failed to get container status \"316fa77a1314e0359b727b4833cacf01797dbe0c78ea606912be678a2b5e5063\": rpc error: code = NotFound desc = could not find container \"316fa77a1314e0359b727b4833cacf01797dbe0c78ea606912be678a2b5e5063\": container with ID starting with 316fa77a1314e0359b727b4833cacf01797dbe0c78ea606912be678a2b5e5063 not found: ID does not exist"
Jul 14 20:26:06.724294 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:26:06.724272    2579 scope.go:117] "RemoveContainer" containerID="c2306ad1fc66712a752abd921cd1b33c6c3709ff177b5e2d414939fa055a54b6"
Jul 14 20:26:06.724514 ip-10-0-140-201 kubenswrapper[2579]: E0714 20:26:06.724496    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c2306ad1fc66712a752abd921cd1b33c6c3709ff177b5e2d414939fa055a54b6\": container with ID starting with c2306ad1fc66712a752abd921cd1b33c6c3709ff177b5e2d414939fa055a54b6 not found: ID does not exist" containerID="c2306ad1fc66712a752abd921cd1b33c6c3709ff177b5e2d414939fa055a54b6"
Jul 14 20:26:06.724579 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:26:06.724521    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c2306ad1fc66712a752abd921cd1b33c6c3709ff177b5e2d414939fa055a54b6"} err="failed to get container status \"c2306ad1fc66712a752abd921cd1b33c6c3709ff177b5e2d414939fa055a54b6\": rpc error: code = NotFound desc = could not find container \"c2306ad1fc66712a752abd921cd1b33c6c3709ff177b5e2d414939fa055a54b6\": container with ID starting with c2306ad1fc66712a752abd921cd1b33c6c3709ff177b5e2d414939fa055a54b6 not found: ID does not exist"
Jul 14 20:26:06.730197 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:26:06.730172    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-d080ee51-openshift-default-558f9c6c95-btfjs"]
Jul 14 20:26:06.734414 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:26:06.734393    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-d080ee51-openshift-default-558f9c6c95-btfjs"]
Jul 14 20:26:06.847940 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:26:06.847911    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="245a2890-0468-4902-a859-93e648d56015" path="/var/lib/kubelet/pods/245a2890-0468-4902-a859-93e648d56015/volumes"
Jul 14 20:26:22.103432 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:26:22.103389    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-08c922cd-openshift-default-5c65c4465f-2zzlm"]
Jul 14 20:26:22.103961 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:26:22.103940    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="75846082-8297-43e7-adb0-d3f477a9648d" containerName="revoke-keys"
Jul 14 20:26:22.104037 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:26:22.103964    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="75846082-8297-43e7-adb0-d3f477a9648d" containerName="revoke-keys"
Jul 14 20:26:22.104037 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:26:22.103986    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="245a2890-0468-4902-a859-93e648d56015" containerName="istio-proxy"
Jul 14 20:26:22.104037 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:26:22.103995    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="245a2890-0468-4902-a859-93e648d56015" containerName="istio-proxy"
Jul 14 20:26:22.104182 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:26:22.104111    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="245a2890-0468-4902-a859-93e648d56015" containerName="istio-proxy"
Jul 14 20:26:22.104182 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:26:22.104127    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="245a2890-0468-4902-a859-93e648d56015" containerName="istio-proxy"
Jul 14 20:26:22.104182 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:26:22.104139    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="75846082-8297-43e7-adb0-d3f477a9648d" containerName="revoke-keys"
Jul 14 20:26:22.107190 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:26:22.107168    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-08c922cd-openshift-default-5c65c4465f-2zzlm"
Jul 14 20:26:22.139179 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:26:22.139151    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-08c922cd-openshift-default-dockercfg-xhgjp\""
Jul 14 20:26:22.155265 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:26:22.155228    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-08c922cd-openshift-default-5c65c4465f-2zzlm"]
Jul 14 20:26:22.178543 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:26:22.178487    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a0e30a1a-e0e0-4551-8a39-87f3cf65e821-istio-data\") pod \"e2e-mt-08c922cd-openshift-default-5c65c4465f-2zzlm\" (UID: \"a0e30a1a-e0e0-4551-8a39-87f3cf65e821\") " pod="openshift-ingress/e2e-mt-08c922cd-openshift-default-5c65c4465f-2zzlm"
Jul 14 20:26:22.178707 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:26:22.178555    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a0e30a1a-e0e0-4551-8a39-87f3cf65e821-istio-token\") pod \"e2e-mt-08c922cd-openshift-default-5c65c4465f-2zzlm\" (UID: \"a0e30a1a-e0e0-4551-8a39-87f3cf65e821\") " pod="openshift-ingress/e2e-mt-08c922cd-openshift-default-5c65c4465f-2zzlm"
Jul 14 20:26:22.178707 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:26:22.178585    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a0e30a1a-e0e0-4551-8a39-87f3cf65e821-istiod-ca-cert\") pod \"e2e-mt-08c922cd-openshift-default-5c65c4465f-2zzlm\" (UID: \"a0e30a1a-e0e0-4551-8a39-87f3cf65e821\") " pod="openshift-ingress/e2e-mt-08c922cd-openshift-default-5c65c4465f-2zzlm"
Jul 14 20:26:22.178707 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:26:22.178617    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a0e30a1a-e0e0-4551-8a39-87f3cf65e821-workload-socket\") pod \"e2e-mt-08c922cd-openshift-default-5c65c4465f-2zzlm\" (UID: \"a0e30a1a-e0e0-4551-8a39-87f3cf65e821\") " pod="openshift-ingress/e2e-mt-08c922cd-openshift-default-5c65c4465f-2zzlm"
Jul 14 20:26:22.178842 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:26:22.178743    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a0e30a1a-e0e0-4551-8a39-87f3cf65e821-istio-podinfo\") pod \"e2e-mt-08c922cd-openshift-default-5c65c4465f-2zzlm\" (UID: \"a0e30a1a-e0e0-4551-8a39-87f3cf65e821\") " pod="openshift-ingress/e2e-mt-08c922cd-openshift-default-5c65c4465f-2zzlm"
Jul 14 20:26:22.178842 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:26:22.178799    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a0e30a1a-e0e0-4551-8a39-87f3cf65e821-istio-envoy\") pod \"e2e-mt-08c922cd-openshift-default-5c65c4465f-2zzlm\" (UID: \"a0e30a1a-e0e0-4551-8a39-87f3cf65e821\") " pod="openshift-ingress/e2e-mt-08c922cd-openshift-default-5c65c4465f-2zzlm"
Jul 14 20:26:22.178946 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:26:22.178846    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a0e30a1a-e0e0-4551-8a39-87f3cf65e821-workload-certs\") pod \"e2e-mt-08c922cd-openshift-default-5c65c4465f-2zzlm\" (UID: \"a0e30a1a-e0e0-4551-8a39-87f3cf65e821\") " pod="openshift-ingress/e2e-mt-08c922cd-openshift-default-5c65c4465f-2zzlm"
Jul 14 20:26:22.179001 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:26:22.178974    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6js29\" (UniqueName: \"kubernetes.io/projected/a0e30a1a-e0e0-4551-8a39-87f3cf65e821-kube-api-access-6js29\") pod \"e2e-mt-08c922cd-openshift-default-5c65c4465f-2zzlm\" (UID: \"a0e30a1a-e0e0-4551-8a39-87f3cf65e821\") " pod="openshift-ingress/e2e-mt-08c922cd-openshift-default-5c65c4465f-2zzlm"
Jul 14 20:26:22.179049 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:26:22.179020    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a0e30a1a-e0e0-4551-8a39-87f3cf65e821-credential-socket\") pod \"e2e-mt-08c922cd-openshift-default-5c65c4465f-2zzlm\" (UID: \"a0e30a1a-e0e0-4551-8a39-87f3cf65e821\") " pod="openshift-ingress/e2e-mt-08c922cd-openshift-default-5c65c4465f-2zzlm"
Jul 14 20:26:22.279981 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:26:22.279941    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6js29\" (UniqueName: \"kubernetes.io/projected/a0e30a1a-e0e0-4551-8a39-87f3cf65e821-kube-api-access-6js29\") pod \"e2e-mt-08c922cd-openshift-default-5c65c4465f-2zzlm\" (UID: \"a0e30a1a-e0e0-4551-8a39-87f3cf65e821\") " pod="openshift-ingress/e2e-mt-08c922cd-openshift-default-5c65c4465f-2zzlm"
Jul 14 20:26:22.280161 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:26:22.279999    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a0e30a1a-e0e0-4551-8a39-87f3cf65e821-credential-socket\") pod \"e2e-mt-08c922cd-openshift-default-5c65c4465f-2zzlm\" (UID: \"a0e30a1a-e0e0-4551-8a39-87f3cf65e821\") " pod="openshift-ingress/e2e-mt-08c922cd-openshift-default-5c65c4465f-2zzlm"
Jul 14 20:26:22.280161 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:26:22.280048    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a0e30a1a-e0e0-4551-8a39-87f3cf65e821-istio-data\") pod \"e2e-mt-08c922cd-openshift-default-5c65c4465f-2zzlm\" (UID: \"a0e30a1a-e0e0-4551-8a39-87f3cf65e821\") " pod="openshift-ingress/e2e-mt-08c922cd-openshift-default-5c65c4465f-2zzlm"
Jul 14 20:26:22.280161 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:26:22.280074    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a0e30a1a-e0e0-4551-8a39-87f3cf65e821-istio-token\") pod \"e2e-mt-08c922cd-openshift-default-5c65c4465f-2zzlm\" (UID: \"a0e30a1a-e0e0-4551-8a39-87f3cf65e821\") " pod="openshift-ingress/e2e-mt-08c922cd-openshift-default-5c65c4465f-2zzlm"
Jul 14 20:26:22.280161 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:26:22.280101    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a0e30a1a-e0e0-4551-8a39-87f3cf65e821-istiod-ca-cert\") pod \"e2e-mt-08c922cd-openshift-default-5c65c4465f-2zzlm\" (UID: \"a0e30a1a-e0e0-4551-8a39-87f3cf65e821\") " pod="openshift-ingress/e2e-mt-08c922cd-openshift-default-5c65c4465f-2zzlm"
Jul 14 20:26:22.280161 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:26:22.280134    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a0e30a1a-e0e0-4551-8a39-87f3cf65e821-workload-socket\") pod \"e2e-mt-08c922cd-openshift-default-5c65c4465f-2zzlm\" (UID: \"a0e30a1a-e0e0-4551-8a39-87f3cf65e821\") " pod="openshift-ingress/e2e-mt-08c922cd-openshift-default-5c65c4465f-2zzlm"
Jul 14 20:26:22.280442 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:26:22.280211    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a0e30a1a-e0e0-4551-8a39-87f3cf65e821-istio-podinfo\") pod \"e2e-mt-08c922cd-openshift-default-5c65c4465f-2zzlm\" (UID: \"a0e30a1a-e0e0-4551-8a39-87f3cf65e821\") " pod="openshift-ingress/e2e-mt-08c922cd-openshift-default-5c65c4465f-2zzlm"
Jul 14 20:26:22.280442 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:26:22.280256    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a0e30a1a-e0e0-4551-8a39-87f3cf65e821-istio-envoy\") pod \"e2e-mt-08c922cd-openshift-default-5c65c4465f-2zzlm\" (UID: \"a0e30a1a-e0e0-4551-8a39-87f3cf65e821\") " pod="openshift-ingress/e2e-mt-08c922cd-openshift-default-5c65c4465f-2zzlm"
Jul 14 20:26:22.280442 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:26:22.280283    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a0e30a1a-e0e0-4551-8a39-87f3cf65e821-workload-certs\") pod \"e2e-mt-08c922cd-openshift-default-5c65c4465f-2zzlm\" (UID: \"a0e30a1a-e0e0-4551-8a39-87f3cf65e821\") " pod="openshift-ingress/e2e-mt-08c922cd-openshift-default-5c65c4465f-2zzlm"
Jul 14 20:26:22.280442 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:26:22.280389    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a0e30a1a-e0e0-4551-8a39-87f3cf65e821-credential-socket\") pod \"e2e-mt-08c922cd-openshift-default-5c65c4465f-2zzlm\" (UID: \"a0e30a1a-e0e0-4551-8a39-87f3cf65e821\") " pod="openshift-ingress/e2e-mt-08c922cd-openshift-default-5c65c4465f-2zzlm"
Jul 14 20:26:22.280675 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:26:22.280448    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a0e30a1a-e0e0-4551-8a39-87f3cf65e821-istio-data\") pod \"e2e-mt-08c922cd-openshift-default-5c65c4465f-2zzlm\" (UID: \"a0e30a1a-e0e0-4551-8a39-87f3cf65e821\") " pod="openshift-ingress/e2e-mt-08c922cd-openshift-default-5c65c4465f-2zzlm"
Jul 14 20:26:22.280675 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:26:22.280591    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a0e30a1a-e0e0-4551-8a39-87f3cf65e821-workload-socket\") pod \"e2e-mt-08c922cd-openshift-default-5c65c4465f-2zzlm\" (UID: \"a0e30a1a-e0e0-4551-8a39-87f3cf65e821\") " pod="openshift-ingress/e2e-mt-08c922cd-openshift-default-5c65c4465f-2zzlm"
Jul 14 20:26:22.280793 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:26:22.280734    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a0e30a1a-e0e0-4551-8a39-87f3cf65e821-workload-certs\") pod \"e2e-mt-08c922cd-openshift-default-5c65c4465f-2zzlm\" (UID: \"a0e30a1a-e0e0-4551-8a39-87f3cf65e821\") " pod="openshift-ingress/e2e-mt-08c922cd-openshift-default-5c65c4465f-2zzlm"
Jul 14 20:26:22.281125 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:26:22.281100    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a0e30a1a-e0e0-4551-8a39-87f3cf65e821-istiod-ca-cert\") pod \"e2e-mt-08c922cd-openshift-default-5c65c4465f-2zzlm\" (UID: \"a0e30a1a-e0e0-4551-8a39-87f3cf65e821\") " pod="openshift-ingress/e2e-mt-08c922cd-openshift-default-5c65c4465f-2zzlm"
Jul 14 20:26:22.282643 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:26:22.282623    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a0e30a1a-e0e0-4551-8a39-87f3cf65e821-istio-envoy\") pod \"e2e-mt-08c922cd-openshift-default-5c65c4465f-2zzlm\" (UID: \"a0e30a1a-e0e0-4551-8a39-87f3cf65e821\") " pod="openshift-ingress/e2e-mt-08c922cd-openshift-default-5c65c4465f-2zzlm"
Jul 14 20:26:22.282857 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:26:22.282839    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a0e30a1a-e0e0-4551-8a39-87f3cf65e821-istio-podinfo\") pod \"e2e-mt-08c922cd-openshift-default-5c65c4465f-2zzlm\" (UID: \"a0e30a1a-e0e0-4551-8a39-87f3cf65e821\") " pod="openshift-ingress/e2e-mt-08c922cd-openshift-default-5c65c4465f-2zzlm"
Jul 14 20:26:22.317552 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:26:22.317504    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a0e30a1a-e0e0-4551-8a39-87f3cf65e821-istio-token\") pod \"e2e-mt-08c922cd-openshift-default-5c65c4465f-2zzlm\" (UID: \"a0e30a1a-e0e0-4551-8a39-87f3cf65e821\") " pod="openshift-ingress/e2e-mt-08c922cd-openshift-default-5c65c4465f-2zzlm"
Jul 14 20:26:22.317725 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:26:22.317651    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6js29\" (UniqueName: \"kubernetes.io/projected/a0e30a1a-e0e0-4551-8a39-87f3cf65e821-kube-api-access-6js29\") pod \"e2e-mt-08c922cd-openshift-default-5c65c4465f-2zzlm\" (UID: \"a0e30a1a-e0e0-4551-8a39-87f3cf65e821\") " pod="openshift-ingress/e2e-mt-08c922cd-openshift-default-5c65c4465f-2zzlm"
Jul 14 20:26:22.417702 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:26:22.417602    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-08c922cd-openshift-default-5c65c4465f-2zzlm"
Jul 14 20:26:22.593271 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:26:22.593235    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-08c922cd-openshift-default-5c65c4465f-2zzlm"]
Jul 14 20:26:22.594826 ip-10-0-140-201 kubenswrapper[2579]: W0714 20:26:22.594799    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda0e30a1a_e0e0_4551_8a39_87f3cf65e821.slice/crio-f784450699fbac9860e776a7a88e0032f12d76cf70869a099c22eda0f9b1bd66 WatchSource:0}: Error finding container f784450699fbac9860e776a7a88e0032f12d76cf70869a099c22eda0f9b1bd66: Status 404 returned error can't find the container with id f784450699fbac9860e776a7a88e0032f12d76cf70869a099c22eda0f9b1bd66
Jul 14 20:26:22.596989 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:26:22.596960    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 14 20:26:22.597059 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:26:22.597020    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 14 20:26:22.597059 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:26:22.597049    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 14 20:26:22.801247 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:26:22.801205    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-08c922cd-openshift-default-5c65c4465f-2zzlm" event={"ID":"a0e30a1a-e0e0-4551-8a39-87f3cf65e821","Type":"ContainerStarted","Data":"c941533468d908c5eef44297330f8daf9faaaa369b6c902b79af97dab3c6b28c"}
Jul 14 20:26:22.801443 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:26:22.801276    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-08c922cd-openshift-default-5c65c4465f-2zzlm" event={"ID":"a0e30a1a-e0e0-4551-8a39-87f3cf65e821","Type":"ContainerStarted","Data":"f784450699fbac9860e776a7a88e0032f12d76cf70869a099c22eda0f9b1bd66"}
Jul 14 20:26:22.834257 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:26:22.834184    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-08c922cd-openshift-default-5c65c4465f-2zzlm" podStartSLOduration=0.834161774 podStartE2EDuration="834.161774ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 20:26:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 20:26:22.82842305 +0000 UTC m=+2082.540018595" watchObservedRunningTime="2026-07-14 20:26:22.834161774 +0000 UTC m=+2082.545757319"
Jul 14 20:26:23.417860 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:26:23.417817    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-08c922cd-openshift-default-5c65c4465f-2zzlm"
Jul 14 20:26:23.422675 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:26:23.422650    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-08c922cd-openshift-default-5c65c4465f-2zzlm"
Jul 14 20:26:23.807221 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:26:23.807177    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-08c922cd-openshift-default-5c65c4465f-2zzlm"
Jul 14 20:26:23.808358 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:26:23.808334    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-08c922cd-openshift-default-5c65c4465f-2zzlm"
Jul 14 20:26:38.808702 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:26:38.808660    2579 patch_prober.go:28] interesting pod/e2e-mt-08c922cd-openshift-default-5c65c4465f-2zzlm container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.54:15021/healthz/ready\": dial tcp 10.133.0.54:15021: connect: connection refused" start-of-body=
Jul 14 20:26:38.809116 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:26:38.808733    2579 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-08c922cd-openshift-default-5c65c4465f-2zzlm" podUID="a0e30a1a-e0e0-4551-8a39-87f3cf65e821" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.54:15021/healthz/ready\": dial tcp 10.133.0.54:15021: connect: connection refused"
Jul 14 20:26:38.899066 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:26:38.898970    2579 generic.go:356] "Generic (PLEG): container finished" podID="a0e30a1a-e0e0-4551-8a39-87f3cf65e821" containerID="c941533468d908c5eef44297330f8daf9faaaa369b6c902b79af97dab3c6b28c" exitCode=0
Jul 14 20:26:38.899066 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:26:38.899034    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-08c922cd-openshift-default-5c65c4465f-2zzlm" event={"ID":"a0e30a1a-e0e0-4551-8a39-87f3cf65e821","Type":"ContainerDied","Data":"c941533468d908c5eef44297330f8daf9faaaa369b6c902b79af97dab3c6b28c"}
Jul 14 20:26:38.899456 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:26:38.899439    2579 scope.go:117] "RemoveContainer" containerID="c941533468d908c5eef44297330f8daf9faaaa369b6c902b79af97dab3c6b28c"
Jul 14 20:26:38.900512 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:26:38.900484    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 14 20:26:38.900607 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:26:38.900590    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 14 20:26:38.900667 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:26:38.900649    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 14 20:26:39.909540 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:26:39.909493    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-08c922cd-openshift-default-5c65c4465f-2zzlm" event={"ID":"a0e30a1a-e0e0-4551-8a39-87f3cf65e821","Type":"ContainerStarted","Data":"6733af7a150e9a0903b08ed8cb0df792eefab103ad1389e7babe2c695c38269e"}
Jul 14 20:26:40.418410 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:26:40.418368    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-08c922cd-openshift-default-5c65c4465f-2zzlm"
Jul 14 20:26:40.418687 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:26:40.418662    2579 patch_prober.go:28] interesting pod/e2e-mt-08c922cd-openshift-default-5c65c4465f-2zzlm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.54:15021/healthz/ready\": dial tcp 10.133.0.54:15021: connect: connection refused" start-of-body=
Jul 14 20:26:40.418793 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:26:40.418756    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-08c922cd-openshift-default-5c65c4465f-2zzlm" podUID="a0e30a1a-e0e0-4551-8a39-87f3cf65e821" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.54:15021/healthz/ready\": dial tcp 10.133.0.54:15021: connect: connection refused"
Jul 14 20:26:40.950257 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:26:40.950230    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-q4xzw_ef54193c-7659-4e47-87ac-4d129d22a268/ovn-acl-logging/0.log"
Jul 14 20:26:40.957297 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:26:40.957273    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-q4xzw_ef54193c-7659-4e47-87ac-4d129d22a268/ovn-acl-logging/0.log"
Jul 14 20:26:41.004521 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:26:41.004490    2579 scope.go:117] "RemoveContainer" containerID="60fb17a2b4777d072cf4f77b8afe5c3623cfe95ab8b9ff811108760aba59db10"
Jul 14 20:26:41.419750 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:26:41.419711    2579 patch_prober.go:28] interesting pod/e2e-mt-08c922cd-openshift-default-5c65c4465f-2zzlm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.54:15021/healthz/ready\": dial tcp 10.133.0.54:15021: connect: connection refused" start-of-body=
Jul 14 20:26:41.419962 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:26:41.419776    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-08c922cd-openshift-default-5c65c4465f-2zzlm" podUID="a0e30a1a-e0e0-4551-8a39-87f3cf65e821" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.54:15021/healthz/ready\": dial tcp 10.133.0.54:15021: connect: connection refused"
Jul 14 20:26:42.418277 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:26:42.418243    2579 patch_prober.go:28] interesting pod/e2e-mt-08c922cd-openshift-default-5c65c4465f-2zzlm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.54:15021/healthz/ready\": dial tcp 10.133.0.54:15021: connect: connection refused" start-of-body=
Jul 14 20:26:42.418680 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:26:42.418314    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-08c922cd-openshift-default-5c65c4465f-2zzlm" podUID="a0e30a1a-e0e0-4551-8a39-87f3cf65e821" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.54:15021/healthz/ready\": dial tcp 10.133.0.54:15021: connect: connection refused"
Jul 14 20:26:43.418453 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:26:43.418416    2579 patch_prober.go:28] interesting pod/e2e-mt-08c922cd-openshift-default-5c65c4465f-2zzlm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.54:15021/healthz/ready\": dial tcp 10.133.0.54:15021: connect: connection refused" start-of-body=
Jul 14 20:26:43.418904 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:26:43.418474    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-08c922cd-openshift-default-5c65c4465f-2zzlm" podUID="a0e30a1a-e0e0-4551-8a39-87f3cf65e821" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.54:15021/healthz/ready\": dial tcp 10.133.0.54:15021: connect: connection refused"
Jul 14 20:26:44.422542 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:26:44.422495    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-08c922cd-openshift-default-5c65c4465f-2zzlm"
Jul 14 20:26:44.422970 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:26:44.422788    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-08c922cd-openshift-default-5c65c4465f-2zzlm"
Jul 14 20:26:44.423444 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:26:44.423427    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-08c922cd-openshift-default-5c65c4465f-2zzlm"
Jul 14 20:26:58.224170 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:26:58.224109    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-08c922cd-wf8l7"]
Jul 14 20:26:58.224627 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:26:58.224557    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="245a2890-0468-4902-a859-93e648d56015" containerName="istio-proxy"
Jul 14 20:26:58.224627 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:26:58.224571    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="245a2890-0468-4902-a859-93e648d56015" containerName="istio-proxy"
Jul 14 20:26:58.228022 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:26:58.228004    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-08c922cd-wf8l7"
Jul 14 20:26:58.231186 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:26:58.231161    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 14 20:26:58.231445 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:26:58.231430    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-4blwh\""
Jul 14 20:26:58.243168 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:26:58.243138    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-08c922cd-wf8l7"]
Jul 14 20:26:58.270138 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:26:58.270097    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4352e583-c04a-4d7f-bbb6-f7ac8aa9a55f-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-08c922cd-wf8l7\" (UID: \"4352e583-c04a-4d7f-bbb6-f7ac8aa9a55f\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-08c922cd-wf8l7"
Jul 14 20:26:58.371018 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:26:58.370969    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4352e583-c04a-4d7f-bbb6-f7ac8aa9a55f-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-08c922cd-wf8l7\" (UID: \"4352e583-c04a-4d7f-bbb6-f7ac8aa9a55f\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-08c922cd-wf8l7"
Jul 14 20:26:58.371631 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:26:58.371606    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4352e583-c04a-4d7f-bbb6-f7ac8aa9a55f-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-08c922cd-wf8l7\" (UID: \"4352e583-c04a-4d7f-bbb6-f7ac8aa9a55f\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-08c922cd-wf8l7"
Jul 14 20:26:58.538910 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:26:58.538799    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-08c922cd-wf8l7"
Jul 14 20:26:58.712336 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:26:58.711687    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-08c922cd-wf8l7"]
Jul 14 20:26:59.016747 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:26:59.016695    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-08c922cd-wf8l7" event={"ID":"4352e583-c04a-4d7f-bbb6-f7ac8aa9a55f","Type":"ContainerStarted","Data":"f23193f2297139a125bc6ac8071cf799eaf904280466d59175ad07819f4a396e"}
Jul 14 20:26:59.016917 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:26:59.016769    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-08c922cd-wf8l7" event={"ID":"4352e583-c04a-4d7f-bbb6-f7ac8aa9a55f","Type":"ContainerStarted","Data":"b29999ddcc58710b81bf295abb16e764760a9069691b4743b75d844041a9d608"}
Jul 14 20:26:59.052518 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:26:59.052456    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-08c922cd-wf8l7" podStartSLOduration=1.05243864 podStartE2EDuration="1.05243864s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 20:26:58 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 20:26:59.051882827 +0000 UTC m=+2118.763478384" watchObservedRunningTime="2026-07-14 20:26:59.05243864 +0000 UTC m=+2118.764034183"
Jul 14 20:27:00.024121 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:27:00.024087    2579 generic.go:356] "Generic (PLEG): container finished" podID="4352e583-c04a-4d7f-bbb6-f7ac8aa9a55f" containerID="f23193f2297139a125bc6ac8071cf799eaf904280466d59175ad07819f4a396e" exitCode=0
Jul 14 20:27:00.024604 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:27:00.024162    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-08c922cd-wf8l7" event={"ID":"4352e583-c04a-4d7f-bbb6-f7ac8aa9a55f","Type":"ContainerDied","Data":"f23193f2297139a125bc6ac8071cf799eaf904280466d59175ad07819f4a396e"}
Jul 14 20:27:01.161125 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:27:01.161096    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-08c922cd-wf8l7"
Jul 14 20:27:01.193871 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:27:01.193840    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4352e583-c04a-4d7f-bbb6-f7ac8aa9a55f-maas-api-service-ca\") pod \"4352e583-c04a-4d7f-bbb6-f7ac8aa9a55f\" (UID: \"4352e583-c04a-4d7f-bbb6-f7ac8aa9a55f\") "
Jul 14 20:27:01.194150 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:27:01.194127    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4352e583-c04a-4d7f-bbb6-f7ac8aa9a55f-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "4352e583-c04a-4d7f-bbb6-f7ac8aa9a55f" (UID: "4352e583-c04a-4d7f-bbb6-f7ac8aa9a55f"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 14 20:27:01.294716 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:27:01.294615    2579 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4352e583-c04a-4d7f-bbb6-f7ac8aa9a55f-maas-api-service-ca\") on node \"ip-10-0-140-201.ec2.internal\" DevicePath \"\""
Jul 14 20:27:02.035672 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:27:02.035637    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-08c922cd-wf8l7"
Jul 14 20:27:02.035672 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:27:02.035666    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-08c922cd-wf8l7" event={"ID":"4352e583-c04a-4d7f-bbb6-f7ac8aa9a55f","Type":"ContainerDied","Data":"b29999ddcc58710b81bf295abb16e764760a9069691b4743b75d844041a9d608"}
Jul 14 20:27:02.035885 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:27:02.035715    2579 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="b29999ddcc58710b81bf295abb16e764760a9069691b4743b75d844041a9d608"
Jul 14 20:28:06.059972 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:28:06.059931    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-08c922cd-openshift-default-5c65c4465f-2zzlm"]
Jul 14 20:28:06.060518 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:28:06.060216    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-08c922cd-openshift-default-5c65c4465f-2zzlm" podUID="a0e30a1a-e0e0-4551-8a39-87f3cf65e821" containerName="istio-proxy" containerID="cri-o://6733af7a150e9a0903b08ed8cb0df792eefab103ad1389e7babe2c695c38269e" gracePeriod=30
Jul 14 20:28:11.311203 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:28:11.311176    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-08c922cd-openshift-default-5c65c4465f-2zzlm"
Jul 14 20:28:11.420436 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:28:11.420332    2579 generic.go:356] "Generic (PLEG): container finished" podID="a0e30a1a-e0e0-4551-8a39-87f3cf65e821" containerID="6733af7a150e9a0903b08ed8cb0df792eefab103ad1389e7babe2c695c38269e" exitCode=0
Jul 14 20:28:11.420436 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:28:11.420401    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-08c922cd-openshift-default-5c65c4465f-2zzlm"
Jul 14 20:28:11.420436 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:28:11.420410    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-08c922cd-openshift-default-5c65c4465f-2zzlm" event={"ID":"a0e30a1a-e0e0-4551-8a39-87f3cf65e821","Type":"ContainerDied","Data":"6733af7a150e9a0903b08ed8cb0df792eefab103ad1389e7babe2c695c38269e"}
Jul 14 20:28:11.420755 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:28:11.420487    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-08c922cd-openshift-default-5c65c4465f-2zzlm" event={"ID":"a0e30a1a-e0e0-4551-8a39-87f3cf65e821","Type":"ContainerDied","Data":"f784450699fbac9860e776a7a88e0032f12d76cf70869a099c22eda0f9b1bd66"}
Jul 14 20:28:11.420755 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:28:11.420512    2579 scope.go:117] "RemoveContainer" containerID="6733af7a150e9a0903b08ed8cb0df792eefab103ad1389e7babe2c695c38269e"
Jul 14 20:28:11.429967 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:28:11.429941    2579 scope.go:117] "RemoveContainer" containerID="c941533468d908c5eef44297330f8daf9faaaa369b6c902b79af97dab3c6b28c"
Jul 14 20:28:11.435791 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:28:11.435694    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6js29\" (UniqueName: \"kubernetes.io/projected/a0e30a1a-e0e0-4551-8a39-87f3cf65e821-kube-api-access-6js29\") pod \"a0e30a1a-e0e0-4551-8a39-87f3cf65e821\" (UID: \"a0e30a1a-e0e0-4551-8a39-87f3cf65e821\") "
Jul 14 20:28:11.435791 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:28:11.435738    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a0e30a1a-e0e0-4551-8a39-87f3cf65e821-istiod-ca-cert\") pod \"a0e30a1a-e0e0-4551-8a39-87f3cf65e821\" (UID: \"a0e30a1a-e0e0-4551-8a39-87f3cf65e821\") "
Jul 14 20:28:11.435987 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:28:11.435901    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a0e30a1a-e0e0-4551-8a39-87f3cf65e821-workload-certs\") pod \"a0e30a1a-e0e0-4551-8a39-87f3cf65e821\" (UID: \"a0e30a1a-e0e0-4551-8a39-87f3cf65e821\") "
Jul 14 20:28:11.436051 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:28:11.435992    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a0e30a1a-e0e0-4551-8a39-87f3cf65e821-workload-socket\") pod \"a0e30a1a-e0e0-4551-8a39-87f3cf65e821\" (UID: \"a0e30a1a-e0e0-4551-8a39-87f3cf65e821\") "
Jul 14 20:28:11.436114 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:28:11.436060    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a0e30a1a-e0e0-4551-8a39-87f3cf65e821-credential-socket\") pod \"a0e30a1a-e0e0-4551-8a39-87f3cf65e821\" (UID: \"a0e30a1a-e0e0-4551-8a39-87f3cf65e821\") "
Jul 14 20:28:11.436114 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:28:11.436109    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a0e30a1a-e0e0-4551-8a39-87f3cf65e821-istio-data\") pod \"a0e30a1a-e0e0-4551-8a39-87f3cf65e821\" (UID: \"a0e30a1a-e0e0-4551-8a39-87f3cf65e821\") "
Jul 14 20:28:11.436221 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:28:11.436121    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a0e30a1a-e0e0-4551-8a39-87f3cf65e821-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "a0e30a1a-e0e0-4551-8a39-87f3cf65e821" (UID: "a0e30a1a-e0e0-4551-8a39-87f3cf65e821"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 20:28:11.436221 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:28:11.436144    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a0e30a1a-e0e0-4551-8a39-87f3cf65e821-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "a0e30a1a-e0e0-4551-8a39-87f3cf65e821" (UID: "a0e30a1a-e0e0-4551-8a39-87f3cf65e821"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 14 20:28:11.436335 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:28:11.436237    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a0e30a1a-e0e0-4551-8a39-87f3cf65e821-istio-token\") pod \"a0e30a1a-e0e0-4551-8a39-87f3cf65e821\" (UID: \"a0e30a1a-e0e0-4551-8a39-87f3cf65e821\") "
Jul 14 20:28:11.436335 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:28:11.436279    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a0e30a1a-e0e0-4551-8a39-87f3cf65e821-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "a0e30a1a-e0e0-4551-8a39-87f3cf65e821" (UID: "a0e30a1a-e0e0-4551-8a39-87f3cf65e821"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 20:28:11.436335 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:28:11.436283    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a0e30a1a-e0e0-4551-8a39-87f3cf65e821-istio-podinfo\") pod \"a0e30a1a-e0e0-4551-8a39-87f3cf65e821\" (UID: \"a0e30a1a-e0e0-4551-8a39-87f3cf65e821\") "
Jul 14 20:28:11.436569 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:28:11.436356    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a0e30a1a-e0e0-4551-8a39-87f3cf65e821-istio-envoy\") pod \"a0e30a1a-e0e0-4551-8a39-87f3cf65e821\" (UID: \"a0e30a1a-e0e0-4551-8a39-87f3cf65e821\") "
Jul 14 20:28:11.436569 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:28:11.436383    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a0e30a1a-e0e0-4551-8a39-87f3cf65e821-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "a0e30a1a-e0e0-4551-8a39-87f3cf65e821" (UID: "a0e30a1a-e0e0-4551-8a39-87f3cf65e821"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 20:28:11.437029 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:28:11.436983    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a0e30a1a-e0e0-4551-8a39-87f3cf65e821-istio-data" (OuterVolumeSpecName: "istio-data") pod "a0e30a1a-e0e0-4551-8a39-87f3cf65e821" (UID: "a0e30a1a-e0e0-4551-8a39-87f3cf65e821"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 20:28:11.437029 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:28:11.436999    2579 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a0e30a1a-e0e0-4551-8a39-87f3cf65e821-istiod-ca-cert\") on node \"ip-10-0-140-201.ec2.internal\" DevicePath \"\""
Jul 14 20:28:11.437029 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:28:11.437017    2579 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a0e30a1a-e0e0-4551-8a39-87f3cf65e821-workload-certs\") on node \"ip-10-0-140-201.ec2.internal\" DevicePath \"\""
Jul 14 20:28:11.437250 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:28:11.437032    2579 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a0e30a1a-e0e0-4551-8a39-87f3cf65e821-workload-socket\") on node \"ip-10-0-140-201.ec2.internal\" DevicePath \"\""
Jul 14 20:28:11.437250 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:28:11.437050    2579 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a0e30a1a-e0e0-4551-8a39-87f3cf65e821-credential-socket\") on node \"ip-10-0-140-201.ec2.internal\" DevicePath \"\""
Jul 14 20:28:11.438941 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:28:11.438878    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a0e30a1a-e0e0-4551-8a39-87f3cf65e821-istio-token" (OuterVolumeSpecName: "istio-token") pod "a0e30a1a-e0e0-4551-8a39-87f3cf65e821" (UID: "a0e30a1a-e0e0-4551-8a39-87f3cf65e821"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 14 20:28:11.438941 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:28:11.438878    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/a0e30a1a-e0e0-4551-8a39-87f3cf65e821-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "a0e30a1a-e0e0-4551-8a39-87f3cf65e821" (UID: "a0e30a1a-e0e0-4551-8a39-87f3cf65e821"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 14 20:28:11.438941 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:28:11.438918    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a0e30a1a-e0e0-4551-8a39-87f3cf65e821-kube-api-access-6js29" (OuterVolumeSpecName: "kube-api-access-6js29") pod "a0e30a1a-e0e0-4551-8a39-87f3cf65e821" (UID: "a0e30a1a-e0e0-4551-8a39-87f3cf65e821"). InnerVolumeSpecName "kube-api-access-6js29". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 14 20:28:11.439314 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:28:11.439285    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a0e30a1a-e0e0-4551-8a39-87f3cf65e821-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "a0e30a1a-e0e0-4551-8a39-87f3cf65e821" (UID: "a0e30a1a-e0e0-4551-8a39-87f3cf65e821"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 20:28:11.440557 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:28:11.440516    2579 scope.go:117] "RemoveContainer" containerID="6733af7a150e9a0903b08ed8cb0df792eefab103ad1389e7babe2c695c38269e"
Jul 14 20:28:11.440840 ip-10-0-140-201 kubenswrapper[2579]: E0714 20:28:11.440819    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6733af7a150e9a0903b08ed8cb0df792eefab103ad1389e7babe2c695c38269e\": container with ID starting with 6733af7a150e9a0903b08ed8cb0df792eefab103ad1389e7babe2c695c38269e not found: ID does not exist" containerID="6733af7a150e9a0903b08ed8cb0df792eefab103ad1389e7babe2c695c38269e"
Jul 14 20:28:11.440926 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:28:11.440853    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6733af7a150e9a0903b08ed8cb0df792eefab103ad1389e7babe2c695c38269e"} err="failed to get container status \"6733af7a150e9a0903b08ed8cb0df792eefab103ad1389e7babe2c695c38269e\": rpc error: code = NotFound desc = could not find container \"6733af7a150e9a0903b08ed8cb0df792eefab103ad1389e7babe2c695c38269e\": container with ID starting with 6733af7a150e9a0903b08ed8cb0df792eefab103ad1389e7babe2c695c38269e not found: ID does not exist"
Jul 14 20:28:11.440926 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:28:11.440881    2579 scope.go:117] "RemoveContainer" containerID="c941533468d908c5eef44297330f8daf9faaaa369b6c902b79af97dab3c6b28c"
Jul 14 20:28:11.441183 ip-10-0-140-201 kubenswrapper[2579]: E0714 20:28:11.441155    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c941533468d908c5eef44297330f8daf9faaaa369b6c902b79af97dab3c6b28c\": container with ID starting with c941533468d908c5eef44297330f8daf9faaaa369b6c902b79af97dab3c6b28c not found: ID does not exist" containerID="c941533468d908c5eef44297330f8daf9faaaa369b6c902b79af97dab3c6b28c"
Jul 14 20:28:11.441289 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:28:11.441192    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c941533468d908c5eef44297330f8daf9faaaa369b6c902b79af97dab3c6b28c"} err="failed to get container status \"c941533468d908c5eef44297330f8daf9faaaa369b6c902b79af97dab3c6b28c\": rpc error: code = NotFound desc = could not find container \"c941533468d908c5eef44297330f8daf9faaaa369b6c902b79af97dab3c6b28c\": container with ID starting with c941533468d908c5eef44297330f8daf9faaaa369b6c902b79af97dab3c6b28c not found: ID does not exist"
Jul 14 20:28:11.538405 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:28:11.538362    2579 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a0e30a1a-e0e0-4551-8a39-87f3cf65e821-istio-data\") on node \"ip-10-0-140-201.ec2.internal\" DevicePath \"\""
Jul 14 20:28:11.538405 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:28:11.538394    2579 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a0e30a1a-e0e0-4551-8a39-87f3cf65e821-istio-token\") on node \"ip-10-0-140-201.ec2.internal\" DevicePath \"\""
Jul 14 20:28:11.538405 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:28:11.538404    2579 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a0e30a1a-e0e0-4551-8a39-87f3cf65e821-istio-podinfo\") on node \"ip-10-0-140-201.ec2.internal\" DevicePath \"\""
Jul 14 20:28:11.538405 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:28:11.538412    2579 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a0e30a1a-e0e0-4551-8a39-87f3cf65e821-istio-envoy\") on node \"ip-10-0-140-201.ec2.internal\" DevicePath \"\""
Jul 14 20:28:11.538708 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:28:11.538421    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6js29\" (UniqueName: \"kubernetes.io/projected/a0e30a1a-e0e0-4551-8a39-87f3cf65e821-kube-api-access-6js29\") on node \"ip-10-0-140-201.ec2.internal\" DevicePath \"\""
Jul 14 20:28:11.745567 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:28:11.745511    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-08c922cd-openshift-default-5c65c4465f-2zzlm"]
Jul 14 20:28:11.753153 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:28:11.753122    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-08c922cd-openshift-default-5c65c4465f-2zzlm"]
Jul 14 20:28:12.849612 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:28:12.849578    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a0e30a1a-e0e0-4551-8a39-87f3cf65e821" path="/var/lib/kubelet/pods/a0e30a1a-e0e0-4551-8a39-87f3cf65e821/volumes"
Jul 14 20:29:03.512656 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:29:03.512572    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-a-e56337-openshift-default-56cc4f78dc-h659b"]
Jul 14 20:29:03.513089 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:29:03.512928    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a0e30a1a-e0e0-4551-8a39-87f3cf65e821" containerName="istio-proxy"
Jul 14 20:29:03.513089 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:29:03.512939    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="a0e30a1a-e0e0-4551-8a39-87f3cf65e821" containerName="istio-proxy"
Jul 14 20:29:03.513089 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:29:03.512955    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a0e30a1a-e0e0-4551-8a39-87f3cf65e821" containerName="istio-proxy"
Jul 14 20:29:03.513089 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:29:03.512962    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="a0e30a1a-e0e0-4551-8a39-87f3cf65e821" containerName="istio-proxy"
Jul 14 20:29:03.513089 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:29:03.512969    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4352e583-c04a-4d7f-bbb6-f7ac8aa9a55f" containerName="revoke-keys"
Jul 14 20:29:03.513089 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:29:03.512975    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="4352e583-c04a-4d7f-bbb6-f7ac8aa9a55f" containerName="revoke-keys"
Jul 14 20:29:03.513089 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:29:03.513036    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="a0e30a1a-e0e0-4551-8a39-87f3cf65e821" containerName="istio-proxy"
Jul 14 20:29:03.513089 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:29:03.513046    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="4352e583-c04a-4d7f-bbb6-f7ac8aa9a55f" containerName="revoke-keys"
Jul 14 20:29:03.516076 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:29:03.516058    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-e56337-openshift-default-56cc4f78dc-h659b"
Jul 14 20:29:03.520993 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:29:03.520966    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-a-e56337-openshift-default-dockercfg-wcjp8\""
Jul 14 20:29:03.533816 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:29:03.533779    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-e56337-openshift-default-56cc4f78dc-h659b"]
Jul 14 20:29:03.628133 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:29:03.628099    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c8051428-6098-4925-aa90-b0ca37d59314-workload-certs\") pod \"e2e-inf-a-e56337-openshift-default-56cc4f78dc-h659b\" (UID: \"c8051428-6098-4925-aa90-b0ca37d59314\") " pod="openshift-ingress/e2e-inf-a-e56337-openshift-default-56cc4f78dc-h659b"
Jul 14 20:29:03.628343 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:29:03.628137    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c8051428-6098-4925-aa90-b0ca37d59314-istio-podinfo\") pod \"e2e-inf-a-e56337-openshift-default-56cc4f78dc-h659b\" (UID: \"c8051428-6098-4925-aa90-b0ca37d59314\") " pod="openshift-ingress/e2e-inf-a-e56337-openshift-default-56cc4f78dc-h659b"
Jul 14 20:29:03.628343 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:29:03.628170    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c8051428-6098-4925-aa90-b0ca37d59314-workload-socket\") pod \"e2e-inf-a-e56337-openshift-default-56cc4f78dc-h659b\" (UID: \"c8051428-6098-4925-aa90-b0ca37d59314\") " pod="openshift-ingress/e2e-inf-a-e56337-openshift-default-56cc4f78dc-h659b"
Jul 14 20:29:03.628343 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:29:03.628283    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c8051428-6098-4925-aa90-b0ca37d59314-credential-socket\") pod \"e2e-inf-a-e56337-openshift-default-56cc4f78dc-h659b\" (UID: \"c8051428-6098-4925-aa90-b0ca37d59314\") " pod="openshift-ingress/e2e-inf-a-e56337-openshift-default-56cc4f78dc-h659b"
Jul 14 20:29:03.628343 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:29:03.628333    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h8dt9\" (UniqueName: \"kubernetes.io/projected/c8051428-6098-4925-aa90-b0ca37d59314-kube-api-access-h8dt9\") pod \"e2e-inf-a-e56337-openshift-default-56cc4f78dc-h659b\" (UID: \"c8051428-6098-4925-aa90-b0ca37d59314\") " pod="openshift-ingress/e2e-inf-a-e56337-openshift-default-56cc4f78dc-h659b"
Jul 14 20:29:03.628525 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:29:03.628366    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c8051428-6098-4925-aa90-b0ca37d59314-istio-token\") pod \"e2e-inf-a-e56337-openshift-default-56cc4f78dc-h659b\" (UID: \"c8051428-6098-4925-aa90-b0ca37d59314\") " pod="openshift-ingress/e2e-inf-a-e56337-openshift-default-56cc4f78dc-h659b"
Jul 14 20:29:03.628525 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:29:03.628394    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c8051428-6098-4925-aa90-b0ca37d59314-istiod-ca-cert\") pod \"e2e-inf-a-e56337-openshift-default-56cc4f78dc-h659b\" (UID: \"c8051428-6098-4925-aa90-b0ca37d59314\") " pod="openshift-ingress/e2e-inf-a-e56337-openshift-default-56cc4f78dc-h659b"
Jul 14 20:29:03.628525 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:29:03.628418    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c8051428-6098-4925-aa90-b0ca37d59314-istio-data\") pod \"e2e-inf-a-e56337-openshift-default-56cc4f78dc-h659b\" (UID: \"c8051428-6098-4925-aa90-b0ca37d59314\") " pod="openshift-ingress/e2e-inf-a-e56337-openshift-default-56cc4f78dc-h659b"
Jul 14 20:29:03.628525 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:29:03.628476    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c8051428-6098-4925-aa90-b0ca37d59314-istio-envoy\") pod \"e2e-inf-a-e56337-openshift-default-56cc4f78dc-h659b\" (UID: \"c8051428-6098-4925-aa90-b0ca37d59314\") " pod="openshift-ingress/e2e-inf-a-e56337-openshift-default-56cc4f78dc-h659b"
Jul 14 20:29:03.729665 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:29:03.729624    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c8051428-6098-4925-aa90-b0ca37d59314-workload-certs\") pod \"e2e-inf-a-e56337-openshift-default-56cc4f78dc-h659b\" (UID: \"c8051428-6098-4925-aa90-b0ca37d59314\") " pod="openshift-ingress/e2e-inf-a-e56337-openshift-default-56cc4f78dc-h659b"
Jul 14 20:29:03.729665 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:29:03.729666    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c8051428-6098-4925-aa90-b0ca37d59314-istio-podinfo\") pod \"e2e-inf-a-e56337-openshift-default-56cc4f78dc-h659b\" (UID: \"c8051428-6098-4925-aa90-b0ca37d59314\") " pod="openshift-ingress/e2e-inf-a-e56337-openshift-default-56cc4f78dc-h659b"
Jul 14 20:29:03.729920 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:29:03.729719    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c8051428-6098-4925-aa90-b0ca37d59314-workload-socket\") pod \"e2e-inf-a-e56337-openshift-default-56cc4f78dc-h659b\" (UID: \"c8051428-6098-4925-aa90-b0ca37d59314\") " pod="openshift-ingress/e2e-inf-a-e56337-openshift-default-56cc4f78dc-h659b"
Jul 14 20:29:03.729920 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:29:03.729762    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c8051428-6098-4925-aa90-b0ca37d59314-credential-socket\") pod \"e2e-inf-a-e56337-openshift-default-56cc4f78dc-h659b\" (UID: \"c8051428-6098-4925-aa90-b0ca37d59314\") " pod="openshift-ingress/e2e-inf-a-e56337-openshift-default-56cc4f78dc-h659b"
Jul 14 20:29:03.729920 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:29:03.729795    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h8dt9\" (UniqueName: \"kubernetes.io/projected/c8051428-6098-4925-aa90-b0ca37d59314-kube-api-access-h8dt9\") pod \"e2e-inf-a-e56337-openshift-default-56cc4f78dc-h659b\" (UID: \"c8051428-6098-4925-aa90-b0ca37d59314\") " pod="openshift-ingress/e2e-inf-a-e56337-openshift-default-56cc4f78dc-h659b"
Jul 14 20:29:03.729920 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:29:03.729824    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c8051428-6098-4925-aa90-b0ca37d59314-istio-token\") pod \"e2e-inf-a-e56337-openshift-default-56cc4f78dc-h659b\" (UID: \"c8051428-6098-4925-aa90-b0ca37d59314\") " pod="openshift-ingress/e2e-inf-a-e56337-openshift-default-56cc4f78dc-h659b"
Jul 14 20:29:03.729920 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:29:03.729848    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c8051428-6098-4925-aa90-b0ca37d59314-istiod-ca-cert\") pod \"e2e-inf-a-e56337-openshift-default-56cc4f78dc-h659b\" (UID: \"c8051428-6098-4925-aa90-b0ca37d59314\") " pod="openshift-ingress/e2e-inf-a-e56337-openshift-default-56cc4f78dc-h659b"
Jul 14 20:29:03.729920 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:29:03.729874    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c8051428-6098-4925-aa90-b0ca37d59314-istio-data\") pod \"e2e-inf-a-e56337-openshift-default-56cc4f78dc-h659b\" (UID: \"c8051428-6098-4925-aa90-b0ca37d59314\") " pod="openshift-ingress/e2e-inf-a-e56337-openshift-default-56cc4f78dc-h659b"
Jul 14 20:29:03.729920 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:29:03.729921    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c8051428-6098-4925-aa90-b0ca37d59314-istio-envoy\") pod \"e2e-inf-a-e56337-openshift-default-56cc4f78dc-h659b\" (UID: \"c8051428-6098-4925-aa90-b0ca37d59314\") " pod="openshift-ingress/e2e-inf-a-e56337-openshift-default-56cc4f78dc-h659b"
Jul 14 20:29:03.730298 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:29:03.730115    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c8051428-6098-4925-aa90-b0ca37d59314-workload-certs\") pod \"e2e-inf-a-e56337-openshift-default-56cc4f78dc-h659b\" (UID: \"c8051428-6098-4925-aa90-b0ca37d59314\") " pod="openshift-ingress/e2e-inf-a-e56337-openshift-default-56cc4f78dc-h659b"
Jul 14 20:29:03.730298 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:29:03.730191    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c8051428-6098-4925-aa90-b0ca37d59314-credential-socket\") pod \"e2e-inf-a-e56337-openshift-default-56cc4f78dc-h659b\" (UID: \"c8051428-6098-4925-aa90-b0ca37d59314\") " pod="openshift-ingress/e2e-inf-a-e56337-openshift-default-56cc4f78dc-h659b"
Jul 14 20:29:03.730409 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:29:03.730357    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c8051428-6098-4925-aa90-b0ca37d59314-istio-data\") pod \"e2e-inf-a-e56337-openshift-default-56cc4f78dc-h659b\" (UID: \"c8051428-6098-4925-aa90-b0ca37d59314\") " pod="openshift-ingress/e2e-inf-a-e56337-openshift-default-56cc4f78dc-h659b"
Jul 14 20:29:03.730465 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:29:03.730427    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c8051428-6098-4925-aa90-b0ca37d59314-workload-socket\") pod \"e2e-inf-a-e56337-openshift-default-56cc4f78dc-h659b\" (UID: \"c8051428-6098-4925-aa90-b0ca37d59314\") " pod="openshift-ingress/e2e-inf-a-e56337-openshift-default-56cc4f78dc-h659b"
Jul 14 20:29:03.730871 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:29:03.730846    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c8051428-6098-4925-aa90-b0ca37d59314-istiod-ca-cert\") pod \"e2e-inf-a-e56337-openshift-default-56cc4f78dc-h659b\" (UID: \"c8051428-6098-4925-aa90-b0ca37d59314\") " pod="openshift-ingress/e2e-inf-a-e56337-openshift-default-56cc4f78dc-h659b"
Jul 14 20:29:03.732245 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:29:03.732227    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c8051428-6098-4925-aa90-b0ca37d59314-istio-envoy\") pod \"e2e-inf-a-e56337-openshift-default-56cc4f78dc-h659b\" (UID: \"c8051428-6098-4925-aa90-b0ca37d59314\") " pod="openshift-ingress/e2e-inf-a-e56337-openshift-default-56cc4f78dc-h659b"
Jul 14 20:29:03.732679 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:29:03.732654    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c8051428-6098-4925-aa90-b0ca37d59314-istio-podinfo\") pod \"e2e-inf-a-e56337-openshift-default-56cc4f78dc-h659b\" (UID: \"c8051428-6098-4925-aa90-b0ca37d59314\") " pod="openshift-ingress/e2e-inf-a-e56337-openshift-default-56cc4f78dc-h659b"
Jul 14 20:29:03.738867 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:29:03.738836    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c8051428-6098-4925-aa90-b0ca37d59314-istio-token\") pod \"e2e-inf-a-e56337-openshift-default-56cc4f78dc-h659b\" (UID: \"c8051428-6098-4925-aa90-b0ca37d59314\") " pod="openshift-ingress/e2e-inf-a-e56337-openshift-default-56cc4f78dc-h659b"
Jul 14 20:29:03.739193 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:29:03.739174    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h8dt9\" (UniqueName: \"kubernetes.io/projected/c8051428-6098-4925-aa90-b0ca37d59314-kube-api-access-h8dt9\") pod \"e2e-inf-a-e56337-openshift-default-56cc4f78dc-h659b\" (UID: \"c8051428-6098-4925-aa90-b0ca37d59314\") " pod="openshift-ingress/e2e-inf-a-e56337-openshift-default-56cc4f78dc-h659b"
Jul 14 20:29:03.828807 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:29:03.828715    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-e56337-openshift-default-56cc4f78dc-h659b"
Jul 14 20:29:03.975431 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:29:03.975402    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-e56337-openshift-default-56cc4f78dc-h659b"]
Jul 14 20:29:03.976819 ip-10-0-140-201 kubenswrapper[2579]: W0714 20:29:03.976795    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc8051428_6098_4925_aa90_b0ca37d59314.slice/crio-3f90559bea138e389baf0ae8d85a7dbd111682a5cc3144bb7e0facb167da0679 WatchSource:0}: Error finding container 3f90559bea138e389baf0ae8d85a7dbd111682a5cc3144bb7e0facb167da0679: Status 404 returned error can't find the container with id 3f90559bea138e389baf0ae8d85a7dbd111682a5cc3144bb7e0facb167da0679
Jul 14 20:29:03.979011 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:29:03.978980    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 14 20:29:03.979099 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:29:03.979048    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 14 20:29:03.979099 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:29:03.979077    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 14 20:29:04.719847 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:29:04.719806    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-e56337-openshift-default-56cc4f78dc-h659b" event={"ID":"c8051428-6098-4925-aa90-b0ca37d59314","Type":"ContainerStarted","Data":"862862f7dd051054895a4e302a89ae130ff0ba92c0b6241e3229098413d7dd5b"}
Jul 14 20:29:04.720269 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:29:04.719872    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-e56337-openshift-default-56cc4f78dc-h659b" event={"ID":"c8051428-6098-4925-aa90-b0ca37d59314","Type":"ContainerStarted","Data":"3f90559bea138e389baf0ae8d85a7dbd111682a5cc3144bb7e0facb167da0679"}
Jul 14 20:29:04.829278 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:29:04.829240    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-e56337-openshift-default-56cc4f78dc-h659b"
Jul 14 20:29:05.835007 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:29:05.834963    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-e56337-openshift-default-56cc4f78dc-h659b"
Jul 14 20:29:05.862292 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:29:05.862243    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-a-e56337-openshift-default-56cc4f78dc-h659b" podStartSLOduration=2.8622261460000002 podStartE2EDuration="2.862226146s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 20:29:03 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 20:29:04.748605112 +0000 UTC m=+2244.460200656" watchObservedRunningTime="2026-07-14 20:29:05.862226146 +0000 UTC m=+2245.573821689"
Jul 14 20:29:06.731068 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:29:06.731035    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-e56337-openshift-default-56cc4f78dc-h659b"
Jul 14 20:29:06.732122 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:29:06.732099    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-e56337-openshift-default-56cc4f78dc-h659b"
Jul 14 20:29:12.137196 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:29:12.137155    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-b-d86aa8-openshift-default-54798dffc9-h8rvr"]
Jul 14 20:29:12.137798 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:29:12.137782    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="a0e30a1a-e0e0-4551-8a39-87f3cf65e821" containerName="istio-proxy"
Jul 14 20:29:12.141389 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:29:12.141368    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-d86aa8-openshift-default-54798dffc9-h8rvr"
Jul 14 20:29:12.144306 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:29:12.144285    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-b-d86aa8-openshift-default-dockercfg-ggfpb\""
Jul 14 20:29:12.157373 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:29:12.157343    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-d86aa8-openshift-default-54798dffc9-h8rvr"]
Jul 14 20:29:12.317149 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:29:12.317107    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/71a57a72-44cc-405a-9972-722024edc8e3-workload-socket\") pod \"e2e-inf-b-d86aa8-openshift-default-54798dffc9-h8rvr\" (UID: \"71a57a72-44cc-405a-9972-722024edc8e3\") " pod="openshift-ingress/e2e-inf-b-d86aa8-openshift-default-54798dffc9-h8rvr"
Jul 14 20:29:12.317149 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:29:12.317145    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/71a57a72-44cc-405a-9972-722024edc8e3-credential-socket\") pod \"e2e-inf-b-d86aa8-openshift-default-54798dffc9-h8rvr\" (UID: \"71a57a72-44cc-405a-9972-722024edc8e3\") " pod="openshift-ingress/e2e-inf-b-d86aa8-openshift-default-54798dffc9-h8rvr"
Jul 14 20:29:12.317409 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:29:12.317182    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vlhmm\" (UniqueName: \"kubernetes.io/projected/71a57a72-44cc-405a-9972-722024edc8e3-kube-api-access-vlhmm\") pod \"e2e-inf-b-d86aa8-openshift-default-54798dffc9-h8rvr\" (UID: \"71a57a72-44cc-405a-9972-722024edc8e3\") " pod="openshift-ingress/e2e-inf-b-d86aa8-openshift-default-54798dffc9-h8rvr"
Jul 14 20:29:12.317409 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:29:12.317229    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/71a57a72-44cc-405a-9972-722024edc8e3-istio-token\") pod \"e2e-inf-b-d86aa8-openshift-default-54798dffc9-h8rvr\" (UID: \"71a57a72-44cc-405a-9972-722024edc8e3\") " pod="openshift-ingress/e2e-inf-b-d86aa8-openshift-default-54798dffc9-h8rvr"
Jul 14 20:29:12.317409 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:29:12.317259    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/71a57a72-44cc-405a-9972-722024edc8e3-istiod-ca-cert\") pod \"e2e-inf-b-d86aa8-openshift-default-54798dffc9-h8rvr\" (UID: \"71a57a72-44cc-405a-9972-722024edc8e3\") " pod="openshift-ingress/e2e-inf-b-d86aa8-openshift-default-54798dffc9-h8rvr"
Jul 14 20:29:12.317409 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:29:12.317392    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/71a57a72-44cc-405a-9972-722024edc8e3-istio-data\") pod \"e2e-inf-b-d86aa8-openshift-default-54798dffc9-h8rvr\" (UID: \"71a57a72-44cc-405a-9972-722024edc8e3\") " pod="openshift-ingress/e2e-inf-b-d86aa8-openshift-default-54798dffc9-h8rvr"
Jul 14 20:29:12.317669 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:29:12.317439    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/71a57a72-44cc-405a-9972-722024edc8e3-workload-certs\") pod \"e2e-inf-b-d86aa8-openshift-default-54798dffc9-h8rvr\" (UID: \"71a57a72-44cc-405a-9972-722024edc8e3\") " pod="openshift-ingress/e2e-inf-b-d86aa8-openshift-default-54798dffc9-h8rvr"
Jul 14 20:29:12.317669 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:29:12.317523    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/71a57a72-44cc-405a-9972-722024edc8e3-istio-envoy\") pod \"e2e-inf-b-d86aa8-openshift-default-54798dffc9-h8rvr\" (UID: \"71a57a72-44cc-405a-9972-722024edc8e3\") " pod="openshift-ingress/e2e-inf-b-d86aa8-openshift-default-54798dffc9-h8rvr"
Jul 14 20:29:12.317669 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:29:12.317599    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/71a57a72-44cc-405a-9972-722024edc8e3-istio-podinfo\") pod \"e2e-inf-b-d86aa8-openshift-default-54798dffc9-h8rvr\" (UID: \"71a57a72-44cc-405a-9972-722024edc8e3\") " pod="openshift-ingress/e2e-inf-b-d86aa8-openshift-default-54798dffc9-h8rvr"
Jul 14 20:29:12.418488 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:29:12.418388    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/71a57a72-44cc-405a-9972-722024edc8e3-istiod-ca-cert\") pod \"e2e-inf-b-d86aa8-openshift-default-54798dffc9-h8rvr\" (UID: \"71a57a72-44cc-405a-9972-722024edc8e3\") " pod="openshift-ingress/e2e-inf-b-d86aa8-openshift-default-54798dffc9-h8rvr"
Jul 14 20:29:12.418488 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:29:12.418452    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/71a57a72-44cc-405a-9972-722024edc8e3-istio-data\") pod \"e2e-inf-b-d86aa8-openshift-default-54798dffc9-h8rvr\" (UID: \"71a57a72-44cc-405a-9972-722024edc8e3\") " pod="openshift-ingress/e2e-inf-b-d86aa8-openshift-default-54798dffc9-h8rvr"
Jul 14 20:29:12.418488 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:29:12.418480    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/71a57a72-44cc-405a-9972-722024edc8e3-workload-certs\") pod \"e2e-inf-b-d86aa8-openshift-default-54798dffc9-h8rvr\" (UID: \"71a57a72-44cc-405a-9972-722024edc8e3\") " pod="openshift-ingress/e2e-inf-b-d86aa8-openshift-default-54798dffc9-h8rvr"
Jul 14 20:29:12.418817 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:29:12.418521    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/71a57a72-44cc-405a-9972-722024edc8e3-istio-envoy\") pod \"e2e-inf-b-d86aa8-openshift-default-54798dffc9-h8rvr\" (UID: \"71a57a72-44cc-405a-9972-722024edc8e3\") " pod="openshift-ingress/e2e-inf-b-d86aa8-openshift-default-54798dffc9-h8rvr"
Jul 14 20:29:12.418817 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:29:12.418572    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/71a57a72-44cc-405a-9972-722024edc8e3-istio-podinfo\") pod \"e2e-inf-b-d86aa8-openshift-default-54798dffc9-h8rvr\" (UID: \"71a57a72-44cc-405a-9972-722024edc8e3\") " pod="openshift-ingress/e2e-inf-b-d86aa8-openshift-default-54798dffc9-h8rvr"
Jul 14 20:29:12.418817 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:29:12.418601    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/71a57a72-44cc-405a-9972-722024edc8e3-workload-socket\") pod \"e2e-inf-b-d86aa8-openshift-default-54798dffc9-h8rvr\" (UID: \"71a57a72-44cc-405a-9972-722024edc8e3\") " pod="openshift-ingress/e2e-inf-b-d86aa8-openshift-default-54798dffc9-h8rvr"
Jul 14 20:29:12.418817 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:29:12.418624    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/71a57a72-44cc-405a-9972-722024edc8e3-credential-socket\") pod \"e2e-inf-b-d86aa8-openshift-default-54798dffc9-h8rvr\" (UID: \"71a57a72-44cc-405a-9972-722024edc8e3\") " pod="openshift-ingress/e2e-inf-b-d86aa8-openshift-default-54798dffc9-h8rvr"
Jul 14 20:29:12.418817 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:29:12.418675    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vlhmm\" (UniqueName: \"kubernetes.io/projected/71a57a72-44cc-405a-9972-722024edc8e3-kube-api-access-vlhmm\") pod \"e2e-inf-b-d86aa8-openshift-default-54798dffc9-h8rvr\" (UID: \"71a57a72-44cc-405a-9972-722024edc8e3\") " pod="openshift-ingress/e2e-inf-b-d86aa8-openshift-default-54798dffc9-h8rvr"
Jul 14 20:29:12.418817 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:29:12.418726    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/71a57a72-44cc-405a-9972-722024edc8e3-istio-token\") pod \"e2e-inf-b-d86aa8-openshift-default-54798dffc9-h8rvr\" (UID: \"71a57a72-44cc-405a-9972-722024edc8e3\") " pod="openshift-ingress/e2e-inf-b-d86aa8-openshift-default-54798dffc9-h8rvr"
Jul 14 20:29:12.419171 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:29:12.418935    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/71a57a72-44cc-405a-9972-722024edc8e3-istio-data\") pod \"e2e-inf-b-d86aa8-openshift-default-54798dffc9-h8rvr\" (UID: \"71a57a72-44cc-405a-9972-722024edc8e3\") " pod="openshift-ingress/e2e-inf-b-d86aa8-openshift-default-54798dffc9-h8rvr"
Jul 14 20:29:12.419171 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:29:12.419016    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/71a57a72-44cc-405a-9972-722024edc8e3-credential-socket\") pod \"e2e-inf-b-d86aa8-openshift-default-54798dffc9-h8rvr\" (UID: \"71a57a72-44cc-405a-9972-722024edc8e3\") " pod="openshift-ingress/e2e-inf-b-d86aa8-openshift-default-54798dffc9-h8rvr"
Jul 14 20:29:12.419171 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:29:12.419052    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/71a57a72-44cc-405a-9972-722024edc8e3-workload-socket\") pod \"e2e-inf-b-d86aa8-openshift-default-54798dffc9-h8rvr\" (UID: \"71a57a72-44cc-405a-9972-722024edc8e3\") " pod="openshift-ingress/e2e-inf-b-d86aa8-openshift-default-54798dffc9-h8rvr"
Jul 14 20:29:12.419171 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:29:12.419077    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/71a57a72-44cc-405a-9972-722024edc8e3-workload-certs\") pod \"e2e-inf-b-d86aa8-openshift-default-54798dffc9-h8rvr\" (UID: \"71a57a72-44cc-405a-9972-722024edc8e3\") " pod="openshift-ingress/e2e-inf-b-d86aa8-openshift-default-54798dffc9-h8rvr"
Jul 14 20:29:12.419523 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:29:12.419503    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/71a57a72-44cc-405a-9972-722024edc8e3-istiod-ca-cert\") pod \"e2e-inf-b-d86aa8-openshift-default-54798dffc9-h8rvr\" (UID: \"71a57a72-44cc-405a-9972-722024edc8e3\") " pod="openshift-ingress/e2e-inf-b-d86aa8-openshift-default-54798dffc9-h8rvr"
Jul 14 20:29:12.421343 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:29:12.421318    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/71a57a72-44cc-405a-9972-722024edc8e3-istio-envoy\") pod \"e2e-inf-b-d86aa8-openshift-default-54798dffc9-h8rvr\" (UID: \"71a57a72-44cc-405a-9972-722024edc8e3\") " pod="openshift-ingress/e2e-inf-b-d86aa8-openshift-default-54798dffc9-h8rvr"
Jul 14 20:29:12.421343 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:29:12.421338    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/71a57a72-44cc-405a-9972-722024edc8e3-istio-podinfo\") pod \"e2e-inf-b-d86aa8-openshift-default-54798dffc9-h8rvr\" (UID: \"71a57a72-44cc-405a-9972-722024edc8e3\") " pod="openshift-ingress/e2e-inf-b-d86aa8-openshift-default-54798dffc9-h8rvr"
Jul 14 20:29:12.431915 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:29:12.431894    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/71a57a72-44cc-405a-9972-722024edc8e3-istio-token\") pod \"e2e-inf-b-d86aa8-openshift-default-54798dffc9-h8rvr\" (UID: \"71a57a72-44cc-405a-9972-722024edc8e3\") " pod="openshift-ingress/e2e-inf-b-d86aa8-openshift-default-54798dffc9-h8rvr"
Jul 14 20:29:12.433419 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:29:12.433397    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vlhmm\" (UniqueName: \"kubernetes.io/projected/71a57a72-44cc-405a-9972-722024edc8e3-kube-api-access-vlhmm\") pod \"e2e-inf-b-d86aa8-openshift-default-54798dffc9-h8rvr\" (UID: \"71a57a72-44cc-405a-9972-722024edc8e3\") " pod="openshift-ingress/e2e-inf-b-d86aa8-openshift-default-54798dffc9-h8rvr"
Jul 14 20:29:12.452123 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:29:12.452090    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-d86aa8-openshift-default-54798dffc9-h8rvr"
Jul 14 20:29:12.599180 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:29:12.598850    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-d86aa8-openshift-default-54798dffc9-h8rvr"]
Jul 14 20:29:12.600912 ip-10-0-140-201 kubenswrapper[2579]: W0714 20:29:12.600874    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod71a57a72_44cc_405a_9972_722024edc8e3.slice/crio-a88147a68df5fb784935354360b6da6bbe35a296e9508a976d90b9a90e51ef96 WatchSource:0}: Error finding container a88147a68df5fb784935354360b6da6bbe35a296e9508a976d90b9a90e51ef96: Status 404 returned error can't find the container with id a88147a68df5fb784935354360b6da6bbe35a296e9508a976d90b9a90e51ef96
Jul 14 20:29:12.603407 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:29:12.603372    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 14 20:29:12.603511 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:29:12.603459    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 14 20:29:12.603511 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:29:12.603501    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 14 20:29:12.767444 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:29:12.767404    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-d86aa8-openshift-default-54798dffc9-h8rvr" event={"ID":"71a57a72-44cc-405a-9972-722024edc8e3","Type":"ContainerStarted","Data":"3a4c4648ca64cda40f381c44422a4fd7116bb6f7f7ab84976738200848118120"}
Jul 14 20:29:12.767648 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:29:12.767471    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-d86aa8-openshift-default-54798dffc9-h8rvr" event={"ID":"71a57a72-44cc-405a-9972-722024edc8e3","Type":"ContainerStarted","Data":"a88147a68df5fb784935354360b6da6bbe35a296e9508a976d90b9a90e51ef96"}
Jul 14 20:29:12.792984 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:29:12.790490    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-b-d86aa8-openshift-default-54798dffc9-h8rvr" podStartSLOduration=0.790470073 podStartE2EDuration="790.470073ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 20:29:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 20:29:12.788651508 +0000 UTC m=+2252.500247053" watchObservedRunningTime="2026-07-14 20:29:12.790470073 +0000 UTC m=+2252.502065619"
Jul 14 20:29:13.453070 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:29:13.453035    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-d86aa8-openshift-default-54798dffc9-h8rvr"
Jul 14 20:29:13.457980 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:29:13.457956    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-d86aa8-openshift-default-54798dffc9-h8rvr"
Jul 14 20:29:13.772937 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:29:13.772909    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-d86aa8-openshift-default-54798dffc9-h8rvr"
Jul 14 20:29:13.773837 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:29:13.773815    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-d86aa8-openshift-default-54798dffc9-h8rvr"
Jul 14 20:29:22.773777 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:29:22.773733    2579 patch_prober.go:28] interesting pod/e2e-inf-a-e56337-openshift-default-56cc4f78dc-h659b container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.56:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Jul 14 20:29:22.774380 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:29:22.774347    2579 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-a-e56337-openshift-default-56cc4f78dc-h659b" podUID="c8051428-6098-4925-aa90-b0ca37d59314" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.56:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Jul 14 20:29:24.847431 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:29:24.847391    2579 generic.go:356] "Generic (PLEG): container finished" podID="c8051428-6098-4925-aa90-b0ca37d59314" containerID="862862f7dd051054895a4e302a89ae130ff0ba92c0b6241e3229098413d7dd5b" exitCode=0
Jul 14 20:29:24.848052 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:29:24.848026    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-e56337-openshift-default-56cc4f78dc-h659b" event={"ID":"c8051428-6098-4925-aa90-b0ca37d59314","Type":"ContainerDied","Data":"862862f7dd051054895a4e302a89ae130ff0ba92c0b6241e3229098413d7dd5b"}
Jul 14 20:29:24.848471 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:29:24.848454    2579 scope.go:117] "RemoveContainer" containerID="862862f7dd051054895a4e302a89ae130ff0ba92c0b6241e3229098413d7dd5b"
Jul 14 20:29:24.849446 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:29:24.849408    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 14 20:29:24.849571 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:29:24.849470    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 14 20:29:24.849571 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:29:24.849501    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 14 20:29:25.855161 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:29:25.855125    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-e56337-openshift-default-56cc4f78dc-h659b" event={"ID":"c8051428-6098-4925-aa90-b0ca37d59314","Type":"ContainerStarted","Data":"0e3bd5ce434136a290b21a569c8ba2d13ac243c8509ad673a9baa06c2ad85b1e"}
Jul 14 20:29:26.829479 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:29:26.829438    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-e56337-openshift-default-56cc4f78dc-h659b"
Jul 14 20:29:26.829756 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:29:26.829733    2579 patch_prober.go:28] interesting pod/e2e-inf-a-e56337-openshift-default-56cc4f78dc-h659b container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.56:15021/healthz/ready\": dial tcp 10.133.0.56:15021: connect: connection refused" start-of-body=
Jul 14 20:29:26.829857 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:29:26.829791    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-e56337-openshift-default-56cc4f78dc-h659b" podUID="c8051428-6098-4925-aa90-b0ca37d59314" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.56:15021/healthz/ready\": dial tcp 10.133.0.56:15021: connect: connection refused"
Jul 14 20:29:27.829616 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:29:27.829575    2579 patch_prober.go:28] interesting pod/e2e-inf-a-e56337-openshift-default-56cc4f78dc-h659b container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.56:15021/healthz/ready\": dial tcp 10.133.0.56:15021: connect: connection refused" start-of-body=
Jul 14 20:29:27.830010 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:29:27.829637    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-e56337-openshift-default-56cc4f78dc-h659b" podUID="c8051428-6098-4925-aa90-b0ca37d59314" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.56:15021/healthz/ready\": dial tcp 10.133.0.56:15021: connect: connection refused"
Jul 14 20:29:28.830047 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:29:28.830008    2579 patch_prober.go:28] interesting pod/e2e-inf-a-e56337-openshift-default-56cc4f78dc-h659b container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.56:15021/healthz/ready\": dial tcp 10.133.0.56:15021: connect: connection refused" start-of-body=
Jul 14 20:29:28.830436 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:29:28.830068    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-e56337-openshift-default-56cc4f78dc-h659b" podUID="c8051428-6098-4925-aa90-b0ca37d59314" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.56:15021/healthz/ready\": dial tcp 10.133.0.56:15021: connect: connection refused"
Jul 14 20:29:29.026250 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:29:29.025184    2579 patch_prober.go:28] interesting pod/e2e-inf-b-d86aa8-openshift-default-54798dffc9-h8rvr container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.57:15021/healthz/ready\": read tcp 10.133.0.2:34596->10.133.0.57:15021: read: connection reset by peer" start-of-body=
Jul 14 20:29:29.026250 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:29:29.025255    2579 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-b-d86aa8-openshift-default-54798dffc9-h8rvr" podUID="71a57a72-44cc-405a-9972-722024edc8e3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.57:15021/healthz/ready\": read tcp 10.133.0.2:34596->10.133.0.57:15021: read: connection reset by peer"
Jul 14 20:29:29.829590 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:29:29.829518    2579 patch_prober.go:28] interesting pod/e2e-inf-a-e56337-openshift-default-56cc4f78dc-h659b container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.56:15021/healthz/ready\": dial tcp 10.133.0.56:15021: connect: connection refused" start-of-body=
Jul 14 20:29:29.829789 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:29:29.829620    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-e56337-openshift-default-56cc4f78dc-h659b" podUID="c8051428-6098-4925-aa90-b0ca37d59314" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.56:15021/healthz/ready\": dial tcp 10.133.0.56:15021: connect: connection refused"
Jul 14 20:29:29.884785 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:29:29.884737    2579 generic.go:356] "Generic (PLEG): container finished" podID="71a57a72-44cc-405a-9972-722024edc8e3" containerID="3a4c4648ca64cda40f381c44422a4fd7116bb6f7f7ab84976738200848118120" exitCode=0
Jul 14 20:29:29.885257 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:29:29.884905    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-d86aa8-openshift-default-54798dffc9-h8rvr" event={"ID":"71a57a72-44cc-405a-9972-722024edc8e3","Type":"ContainerDied","Data":"3a4c4648ca64cda40f381c44422a4fd7116bb6f7f7ab84976738200848118120"}
Jul 14 20:29:29.885415 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:29:29.885389    2579 scope.go:117] "RemoveContainer" containerID="3a4c4648ca64cda40f381c44422a4fd7116bb6f7f7ab84976738200848118120"
Jul 14 20:29:29.886837 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:29:29.886796    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 14 20:29:29.886949 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:29:29.886902    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 14 20:29:29.887033 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:29:29.886966    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 14 20:29:30.832735 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:29:30.832702    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-e56337-openshift-default-56cc4f78dc-h659b"
Jul 14 20:29:30.832988 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:29:30.832965    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-e56337-openshift-default-56cc4f78dc-h659b"
Jul 14 20:29:30.833690 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:29:30.833675    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-e56337-openshift-default-56cc4f78dc-h659b"
Jul 14 20:29:30.892203 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:29:30.892173    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-d86aa8-openshift-default-54798dffc9-h8rvr" event={"ID":"71a57a72-44cc-405a-9972-722024edc8e3","Type":"ContainerStarted","Data":"9d486701e2ac4b31c71ccbbc1814b17b86cccecfc6d3cf6c716a75c036b9a8cf"}
Jul 14 20:29:31.452629 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:29:31.452592    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-d86aa8-openshift-default-54798dffc9-h8rvr"
Jul 14 20:29:31.452866 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:29:31.452843    2579 patch_prober.go:28] interesting pod/e2e-inf-b-d86aa8-openshift-default-54798dffc9-h8rvr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.57:15021/healthz/ready\": dial tcp 10.133.0.57:15021: connect: connection refused" start-of-body=
Jul 14 20:29:31.452926 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:29:31.452906    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-d86aa8-openshift-default-54798dffc9-h8rvr" podUID="71a57a72-44cc-405a-9972-722024edc8e3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.57:15021/healthz/ready\": dial tcp 10.133.0.57:15021: connect: connection refused"
Jul 14 20:29:32.452892 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:29:32.452854    2579 patch_prober.go:28] interesting pod/e2e-inf-b-d86aa8-openshift-default-54798dffc9-h8rvr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.57:15021/healthz/ready\": dial tcp 10.133.0.57:15021: connect: connection refused" start-of-body=
Jul 14 20:29:32.453246 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:29:32.452927    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-d86aa8-openshift-default-54798dffc9-h8rvr" podUID="71a57a72-44cc-405a-9972-722024edc8e3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.57:15021/healthz/ready\": dial tcp 10.133.0.57:15021: connect: connection refused"
Jul 14 20:29:33.453279 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:29:33.453245    2579 patch_prober.go:28] interesting pod/e2e-inf-b-d86aa8-openshift-default-54798dffc9-h8rvr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.57:15021/healthz/ready\": dial tcp 10.133.0.57:15021: connect: connection refused" start-of-body=
Jul 14 20:29:33.453684 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:29:33.453310    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-d86aa8-openshift-default-54798dffc9-h8rvr" podUID="71a57a72-44cc-405a-9972-722024edc8e3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.57:15021/healthz/ready\": dial tcp 10.133.0.57:15021: connect: connection refused"
Jul 14 20:29:34.452746 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:29:34.452699    2579 patch_prober.go:28] interesting pod/e2e-inf-b-d86aa8-openshift-default-54798dffc9-h8rvr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.57:15021/healthz/ready\": dial tcp 10.133.0.57:15021: connect: connection refused" start-of-body=
Jul 14 20:29:34.452933 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:29:34.452759    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-d86aa8-openshift-default-54798dffc9-h8rvr" podUID="71a57a72-44cc-405a-9972-722024edc8e3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.57:15021/healthz/ready\": dial tcp 10.133.0.57:15021: connect: connection refused"
Jul 14 20:29:35.453274 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:29:35.453236    2579 patch_prober.go:28] interesting pod/e2e-inf-b-d86aa8-openshift-default-54798dffc9-h8rvr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.57:15021/healthz/ready\": dial tcp 10.133.0.57:15021: connect: connection refused" start-of-body=
Jul 14 20:29:35.453759 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:29:35.453293    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-d86aa8-openshift-default-54798dffc9-h8rvr" podUID="71a57a72-44cc-405a-9972-722024edc8e3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.57:15021/healthz/ready\": dial tcp 10.133.0.57:15021: connect: connection refused"
Jul 14 20:29:36.455667 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:29:36.455638    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-d86aa8-openshift-default-54798dffc9-h8rvr"
Jul 14 20:29:36.456042 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:29:36.455893    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-d86aa8-openshift-default-54798dffc9-h8rvr"
Jul 14 20:29:36.456697 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:29:36.456679    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-d86aa8-openshift-default-54798dffc9-h8rvr"
Jul 14 20:30:36.378193 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:30:36.378109    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-e56337-openshift-default-56cc4f78dc-h659b"]
Jul 14 20:30:36.378669 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:30:36.378322    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-a-e56337-openshift-default-56cc4f78dc-h659b" podUID="c8051428-6098-4925-aa90-b0ca37d59314" containerName="istio-proxy" containerID="cri-o://0e3bd5ce434136a290b21a569c8ba2d13ac243c8509ad673a9baa06c2ad85b1e" gracePeriod=30
Jul 14 20:30:41.620809 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:30:41.620784    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-e56337-openshift-default-56cc4f78dc-h659b"
Jul 14 20:30:41.734516 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:30:41.734468    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c8051428-6098-4925-aa90-b0ca37d59314-istio-podinfo\") pod \"c8051428-6098-4925-aa90-b0ca37d59314\" (UID: \"c8051428-6098-4925-aa90-b0ca37d59314\") "
Jul 14 20:30:41.734516 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:30:41.734525    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c8051428-6098-4925-aa90-b0ca37d59314-workload-socket\") pod \"c8051428-6098-4925-aa90-b0ca37d59314\" (UID: \"c8051428-6098-4925-aa90-b0ca37d59314\") "
Jul 14 20:30:41.734813 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:30:41.734591    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c8051428-6098-4925-aa90-b0ca37d59314-workload-certs\") pod \"c8051428-6098-4925-aa90-b0ca37d59314\" (UID: \"c8051428-6098-4925-aa90-b0ca37d59314\") "
Jul 14 20:30:41.734813 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:30:41.734608    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c8051428-6098-4925-aa90-b0ca37d59314-credential-socket\") pod \"c8051428-6098-4925-aa90-b0ca37d59314\" (UID: \"c8051428-6098-4925-aa90-b0ca37d59314\") "
Jul 14 20:30:41.734813 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:30:41.734632    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c8051428-6098-4925-aa90-b0ca37d59314-istiod-ca-cert\") pod \"c8051428-6098-4925-aa90-b0ca37d59314\" (UID: \"c8051428-6098-4925-aa90-b0ca37d59314\") "
Jul 14 20:30:41.734813 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:30:41.734693    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c8051428-6098-4925-aa90-b0ca37d59314-istio-envoy\") pod \"c8051428-6098-4925-aa90-b0ca37d59314\" (UID: \"c8051428-6098-4925-aa90-b0ca37d59314\") "
Jul 14 20:30:41.734813 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:30:41.734730    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-h8dt9\" (UniqueName: \"kubernetes.io/projected/c8051428-6098-4925-aa90-b0ca37d59314-kube-api-access-h8dt9\") pod \"c8051428-6098-4925-aa90-b0ca37d59314\" (UID: \"c8051428-6098-4925-aa90-b0ca37d59314\") "
Jul 14 20:30:41.734813 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:30:41.734790    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c8051428-6098-4925-aa90-b0ca37d59314-istio-token\") pod \"c8051428-6098-4925-aa90-b0ca37d59314\" (UID: \"c8051428-6098-4925-aa90-b0ca37d59314\") "
Jul 14 20:30:41.735167 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:30:41.734844    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c8051428-6098-4925-aa90-b0ca37d59314-istio-data\") pod \"c8051428-6098-4925-aa90-b0ca37d59314\" (UID: \"c8051428-6098-4925-aa90-b0ca37d59314\") "
Jul 14 20:30:41.735167 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:30:41.734945    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c8051428-6098-4925-aa90-b0ca37d59314-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "c8051428-6098-4925-aa90-b0ca37d59314" (UID: "c8051428-6098-4925-aa90-b0ca37d59314"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 20:30:41.735167 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:30:41.734986    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c8051428-6098-4925-aa90-b0ca37d59314-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "c8051428-6098-4925-aa90-b0ca37d59314" (UID: "c8051428-6098-4925-aa90-b0ca37d59314"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 20:30:41.735167 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:30:41.734997    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c8051428-6098-4925-aa90-b0ca37d59314-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "c8051428-6098-4925-aa90-b0ca37d59314" (UID: "c8051428-6098-4925-aa90-b0ca37d59314"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 20:30:41.735331 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:30:41.735084    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c8051428-6098-4925-aa90-b0ca37d59314-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "c8051428-6098-4925-aa90-b0ca37d59314" (UID: "c8051428-6098-4925-aa90-b0ca37d59314"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 14 20:30:41.735331 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:30:41.735278    2579 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c8051428-6098-4925-aa90-b0ca37d59314-workload-socket\") on node \"ip-10-0-140-201.ec2.internal\" DevicePath \"\""
Jul 14 20:30:41.735331 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:30:41.735300    2579 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c8051428-6098-4925-aa90-b0ca37d59314-workload-certs\") on node \"ip-10-0-140-201.ec2.internal\" DevicePath \"\""
Jul 14 20:30:41.735475 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:30:41.735351    2579 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c8051428-6098-4925-aa90-b0ca37d59314-credential-socket\") on node \"ip-10-0-140-201.ec2.internal\" DevicePath \"\""
Jul 14 20:30:41.735551 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:30:41.735448    2579 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c8051428-6098-4925-aa90-b0ca37d59314-istiod-ca-cert\") on node \"ip-10-0-140-201.ec2.internal\" DevicePath \"\""
Jul 14 20:30:41.736108 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:30:41.736069    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c8051428-6098-4925-aa90-b0ca37d59314-istio-data" (OuterVolumeSpecName: "istio-data") pod "c8051428-6098-4925-aa90-b0ca37d59314" (UID: "c8051428-6098-4925-aa90-b0ca37d59314"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 20:30:41.736997 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:30:41.736973    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/c8051428-6098-4925-aa90-b0ca37d59314-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "c8051428-6098-4925-aa90-b0ca37d59314" (UID: "c8051428-6098-4925-aa90-b0ca37d59314"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 14 20:30:41.737147 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:30:41.737127    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c8051428-6098-4925-aa90-b0ca37d59314-kube-api-access-h8dt9" (OuterVolumeSpecName: "kube-api-access-h8dt9") pod "c8051428-6098-4925-aa90-b0ca37d59314" (UID: "c8051428-6098-4925-aa90-b0ca37d59314"). InnerVolumeSpecName "kube-api-access-h8dt9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 14 20:30:41.737203 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:30:41.737176    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c8051428-6098-4925-aa90-b0ca37d59314-istio-token" (OuterVolumeSpecName: "istio-token") pod "c8051428-6098-4925-aa90-b0ca37d59314" (UID: "c8051428-6098-4925-aa90-b0ca37d59314"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 14 20:30:41.737264 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:30:41.737243    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c8051428-6098-4925-aa90-b0ca37d59314-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "c8051428-6098-4925-aa90-b0ca37d59314" (UID: "c8051428-6098-4925-aa90-b0ca37d59314"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 20:30:41.836017 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:30:41.835975    2579 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c8051428-6098-4925-aa90-b0ca37d59314-istio-envoy\") on node \"ip-10-0-140-201.ec2.internal\" DevicePath \"\""
Jul 14 20:30:41.836017 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:30:41.836008    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-h8dt9\" (UniqueName: \"kubernetes.io/projected/c8051428-6098-4925-aa90-b0ca37d59314-kube-api-access-h8dt9\") on node \"ip-10-0-140-201.ec2.internal\" DevicePath \"\""
Jul 14 20:30:41.836017 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:30:41.836018    2579 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c8051428-6098-4925-aa90-b0ca37d59314-istio-token\") on node \"ip-10-0-140-201.ec2.internal\" DevicePath \"\""
Jul 14 20:30:41.836017 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:30:41.836028    2579 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c8051428-6098-4925-aa90-b0ca37d59314-istio-data\") on node \"ip-10-0-140-201.ec2.internal\" DevicePath \"\""
Jul 14 20:30:41.836303 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:30:41.836036    2579 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c8051428-6098-4925-aa90-b0ca37d59314-istio-podinfo\") on node \"ip-10-0-140-201.ec2.internal\" DevicePath \"\""
Jul 14 20:30:42.288240 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:30:42.288203    2579 generic.go:356] "Generic (PLEG): container finished" podID="c8051428-6098-4925-aa90-b0ca37d59314" containerID="0e3bd5ce434136a290b21a569c8ba2d13ac243c8509ad673a9baa06c2ad85b1e" exitCode=0
Jul 14 20:30:42.288424 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:30:42.288247    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-e56337-openshift-default-56cc4f78dc-h659b" event={"ID":"c8051428-6098-4925-aa90-b0ca37d59314","Type":"ContainerDied","Data":"0e3bd5ce434136a290b21a569c8ba2d13ac243c8509ad673a9baa06c2ad85b1e"}
Jul 14 20:30:42.288424 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:30:42.288254    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-e56337-openshift-default-56cc4f78dc-h659b"
Jul 14 20:30:42.288424 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:30:42.288286    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-e56337-openshift-default-56cc4f78dc-h659b" event={"ID":"c8051428-6098-4925-aa90-b0ca37d59314","Type":"ContainerDied","Data":"3f90559bea138e389baf0ae8d85a7dbd111682a5cc3144bb7e0facb167da0679"}
Jul 14 20:30:42.288424 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:30:42.288307    2579 scope.go:117] "RemoveContainer" containerID="0e3bd5ce434136a290b21a569c8ba2d13ac243c8509ad673a9baa06c2ad85b1e"
Jul 14 20:30:42.298860 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:30:42.298840    2579 scope.go:117] "RemoveContainer" containerID="862862f7dd051054895a4e302a89ae130ff0ba92c0b6241e3229098413d7dd5b"
Jul 14 20:30:42.307678 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:30:42.307656    2579 scope.go:117] "RemoveContainer" containerID="0e3bd5ce434136a290b21a569c8ba2d13ac243c8509ad673a9baa06c2ad85b1e"
Jul 14 20:30:42.307965 ip-10-0-140-201 kubenswrapper[2579]: E0714 20:30:42.307946    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0e3bd5ce434136a290b21a569c8ba2d13ac243c8509ad673a9baa06c2ad85b1e\": container with ID starting with 0e3bd5ce434136a290b21a569c8ba2d13ac243c8509ad673a9baa06c2ad85b1e not found: ID does not exist" containerID="0e3bd5ce434136a290b21a569c8ba2d13ac243c8509ad673a9baa06c2ad85b1e"
Jul 14 20:30:42.308016 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:30:42.307976    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0e3bd5ce434136a290b21a569c8ba2d13ac243c8509ad673a9baa06c2ad85b1e"} err="failed to get container status \"0e3bd5ce434136a290b21a569c8ba2d13ac243c8509ad673a9baa06c2ad85b1e\": rpc error: code = NotFound desc = could not find container \"0e3bd5ce434136a290b21a569c8ba2d13ac243c8509ad673a9baa06c2ad85b1e\": container with ID starting with 0e3bd5ce434136a290b21a569c8ba2d13ac243c8509ad673a9baa06c2ad85b1e not found: ID does not exist"
Jul 14 20:30:42.308016 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:30:42.307995    2579 scope.go:117] "RemoveContainer" containerID="862862f7dd051054895a4e302a89ae130ff0ba92c0b6241e3229098413d7dd5b"
Jul 14 20:30:42.308255 ip-10-0-140-201 kubenswrapper[2579]: E0714 20:30:42.308235    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"862862f7dd051054895a4e302a89ae130ff0ba92c0b6241e3229098413d7dd5b\": container with ID starting with 862862f7dd051054895a4e302a89ae130ff0ba92c0b6241e3229098413d7dd5b not found: ID does not exist" containerID="862862f7dd051054895a4e302a89ae130ff0ba92c0b6241e3229098413d7dd5b"
Jul 14 20:30:42.308291 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:30:42.308266    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"862862f7dd051054895a4e302a89ae130ff0ba92c0b6241e3229098413d7dd5b"} err="failed to get container status \"862862f7dd051054895a4e302a89ae130ff0ba92c0b6241e3229098413d7dd5b\": rpc error: code = NotFound desc = could not find container \"862862f7dd051054895a4e302a89ae130ff0ba92c0b6241e3229098413d7dd5b\": container with ID starting with 862862f7dd051054895a4e302a89ae130ff0ba92c0b6241e3229098413d7dd5b not found: ID does not exist"
Jul 14 20:30:42.312751 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:30:42.312716    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-e56337-openshift-default-56cc4f78dc-h659b"]
Jul 14 20:30:42.315989 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:30:42.315964    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-a-e56337-openshift-default-56cc4f78dc-h659b"]
Jul 14 20:30:42.847572 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:30:42.847517    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c8051428-6098-4925-aa90-b0ca37d59314" path="/var/lib/kubelet/pods/c8051428-6098-4925-aa90-b0ca37d59314/volumes"
Jul 14 20:31:02.714582 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:31:02.714520    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-d86aa8-openshift-default-54798dffc9-h8rvr"]
Jul 14 20:31:02.715137 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:31:02.714762    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-b-d86aa8-openshift-default-54798dffc9-h8rvr" podUID="71a57a72-44cc-405a-9972-722024edc8e3" containerName="istio-proxy" containerID="cri-o://9d486701e2ac4b31c71ccbbc1814b17b86cccecfc6d3cf6c716a75c036b9a8cf" gracePeriod=30
Jul 14 20:31:03.789856 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:31:03.789818    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-a-16b455-openshift-default-7b6fbf9745-6ffr8"]
Jul 14 20:31:03.790369 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:31:03.790348    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c8051428-6098-4925-aa90-b0ca37d59314" containerName="istio-proxy"
Jul 14 20:31:03.790453 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:31:03.790374    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="c8051428-6098-4925-aa90-b0ca37d59314" containerName="istio-proxy"
Jul 14 20:31:03.790453 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:31:03.790400    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c8051428-6098-4925-aa90-b0ca37d59314" containerName="istio-proxy"
Jul 14 20:31:03.790453 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:31:03.790406    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="c8051428-6098-4925-aa90-b0ca37d59314" containerName="istio-proxy"
Jul 14 20:31:03.790580 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:31:03.790476    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="c8051428-6098-4925-aa90-b0ca37d59314" containerName="istio-proxy"
Jul 14 20:31:03.790580 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:31:03.790484    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="c8051428-6098-4925-aa90-b0ca37d59314" containerName="istio-proxy"
Jul 14 20:31:03.793574 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:31:03.793553    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-16b455-openshift-default-7b6fbf9745-6ffr8"
Jul 14 20:31:03.799303 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:31:03.799272    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-a-16b455-openshift-default-dockercfg-m8qk4\""
Jul 14 20:31:03.815008 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:31:03.814966    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-16b455-openshift-default-7b6fbf9745-6ffr8"]
Jul 14 20:31:03.945823 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:31:03.945777    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/286ebc6d-c191-4f5d-b996-8525a48f8710-workload-socket\") pod \"e2e-api-a-16b455-openshift-default-7b6fbf9745-6ffr8\" (UID: \"286ebc6d-c191-4f5d-b996-8525a48f8710\") " pod="openshift-ingress/e2e-api-a-16b455-openshift-default-7b6fbf9745-6ffr8"
Jul 14 20:31:03.946021 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:31:03.945842    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/286ebc6d-c191-4f5d-b996-8525a48f8710-istio-token\") pod \"e2e-api-a-16b455-openshift-default-7b6fbf9745-6ffr8\" (UID: \"286ebc6d-c191-4f5d-b996-8525a48f8710\") " pod="openshift-ingress/e2e-api-a-16b455-openshift-default-7b6fbf9745-6ffr8"
Jul 14 20:31:03.946021 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:31:03.945858    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/286ebc6d-c191-4f5d-b996-8525a48f8710-istiod-ca-cert\") pod \"e2e-api-a-16b455-openshift-default-7b6fbf9745-6ffr8\" (UID: \"286ebc6d-c191-4f5d-b996-8525a48f8710\") " pod="openshift-ingress/e2e-api-a-16b455-openshift-default-7b6fbf9745-6ffr8"
Jul 14 20:31:03.946021 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:31:03.945958    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/286ebc6d-c191-4f5d-b996-8525a48f8710-workload-certs\") pod \"e2e-api-a-16b455-openshift-default-7b6fbf9745-6ffr8\" (UID: \"286ebc6d-c191-4f5d-b996-8525a48f8710\") " pod="openshift-ingress/e2e-api-a-16b455-openshift-default-7b6fbf9745-6ffr8"
Jul 14 20:31:03.946021 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:31:03.946007    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/286ebc6d-c191-4f5d-b996-8525a48f8710-istio-envoy\") pod \"e2e-api-a-16b455-openshift-default-7b6fbf9745-6ffr8\" (UID: \"286ebc6d-c191-4f5d-b996-8525a48f8710\") " pod="openshift-ingress/e2e-api-a-16b455-openshift-default-7b6fbf9745-6ffr8"
Jul 14 20:31:03.946178 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:31:03.946042    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/286ebc6d-c191-4f5d-b996-8525a48f8710-credential-socket\") pod \"e2e-api-a-16b455-openshift-default-7b6fbf9745-6ffr8\" (UID: \"286ebc6d-c191-4f5d-b996-8525a48f8710\") " pod="openshift-ingress/e2e-api-a-16b455-openshift-default-7b6fbf9745-6ffr8"
Jul 14 20:31:03.946178 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:31:03.946076    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/286ebc6d-c191-4f5d-b996-8525a48f8710-istio-data\") pod \"e2e-api-a-16b455-openshift-default-7b6fbf9745-6ffr8\" (UID: \"286ebc6d-c191-4f5d-b996-8525a48f8710\") " pod="openshift-ingress/e2e-api-a-16b455-openshift-default-7b6fbf9745-6ffr8"
Jul 14 20:31:03.946178 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:31:03.946132    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gvhm4\" (UniqueName: \"kubernetes.io/projected/286ebc6d-c191-4f5d-b996-8525a48f8710-kube-api-access-gvhm4\") pod \"e2e-api-a-16b455-openshift-default-7b6fbf9745-6ffr8\" (UID: \"286ebc6d-c191-4f5d-b996-8525a48f8710\") " pod="openshift-ingress/e2e-api-a-16b455-openshift-default-7b6fbf9745-6ffr8"
Jul 14 20:31:03.946298 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:31:03.946208    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/286ebc6d-c191-4f5d-b996-8525a48f8710-istio-podinfo\") pod \"e2e-api-a-16b455-openshift-default-7b6fbf9745-6ffr8\" (UID: \"286ebc6d-c191-4f5d-b996-8525a48f8710\") " pod="openshift-ingress/e2e-api-a-16b455-openshift-default-7b6fbf9745-6ffr8"
Jul 14 20:31:04.046853 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:31:04.046757    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/286ebc6d-c191-4f5d-b996-8525a48f8710-istio-token\") pod \"e2e-api-a-16b455-openshift-default-7b6fbf9745-6ffr8\" (UID: \"286ebc6d-c191-4f5d-b996-8525a48f8710\") " pod="openshift-ingress/e2e-api-a-16b455-openshift-default-7b6fbf9745-6ffr8"
Jul 14 20:31:04.046853 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:31:04.046798    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/286ebc6d-c191-4f5d-b996-8525a48f8710-istiod-ca-cert\") pod \"e2e-api-a-16b455-openshift-default-7b6fbf9745-6ffr8\" (UID: \"286ebc6d-c191-4f5d-b996-8525a48f8710\") " pod="openshift-ingress/e2e-api-a-16b455-openshift-default-7b6fbf9745-6ffr8"
Jul 14 20:31:04.046853 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:31:04.046840    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/286ebc6d-c191-4f5d-b996-8525a48f8710-workload-certs\") pod \"e2e-api-a-16b455-openshift-default-7b6fbf9745-6ffr8\" (UID: \"286ebc6d-c191-4f5d-b996-8525a48f8710\") " pod="openshift-ingress/e2e-api-a-16b455-openshift-default-7b6fbf9745-6ffr8"
Jul 14 20:31:04.047158 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:31:04.046858    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/286ebc6d-c191-4f5d-b996-8525a48f8710-istio-envoy\") pod \"e2e-api-a-16b455-openshift-default-7b6fbf9745-6ffr8\" (UID: \"286ebc6d-c191-4f5d-b996-8525a48f8710\") " pod="openshift-ingress/e2e-api-a-16b455-openshift-default-7b6fbf9745-6ffr8"
Jul 14 20:31:04.047158 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:31:04.046881    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/286ebc6d-c191-4f5d-b996-8525a48f8710-credential-socket\") pod \"e2e-api-a-16b455-openshift-default-7b6fbf9745-6ffr8\" (UID: \"286ebc6d-c191-4f5d-b996-8525a48f8710\") " pod="openshift-ingress/e2e-api-a-16b455-openshift-default-7b6fbf9745-6ffr8"
Jul 14 20:31:04.047158 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:31:04.046904    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/286ebc6d-c191-4f5d-b996-8525a48f8710-istio-data\") pod \"e2e-api-a-16b455-openshift-default-7b6fbf9745-6ffr8\" (UID: \"286ebc6d-c191-4f5d-b996-8525a48f8710\") " pod="openshift-ingress/e2e-api-a-16b455-openshift-default-7b6fbf9745-6ffr8"
Jul 14 20:31:04.047158 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:31:04.046930    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gvhm4\" (UniqueName: \"kubernetes.io/projected/286ebc6d-c191-4f5d-b996-8525a48f8710-kube-api-access-gvhm4\") pod \"e2e-api-a-16b455-openshift-default-7b6fbf9745-6ffr8\" (UID: \"286ebc6d-c191-4f5d-b996-8525a48f8710\") " pod="openshift-ingress/e2e-api-a-16b455-openshift-default-7b6fbf9745-6ffr8"
Jul 14 20:31:04.047158 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:31:04.046980    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/286ebc6d-c191-4f5d-b996-8525a48f8710-istio-podinfo\") pod \"e2e-api-a-16b455-openshift-default-7b6fbf9745-6ffr8\" (UID: \"286ebc6d-c191-4f5d-b996-8525a48f8710\") " pod="openshift-ingress/e2e-api-a-16b455-openshift-default-7b6fbf9745-6ffr8"
Jul 14 20:31:04.047158 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:31:04.047039    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/286ebc6d-c191-4f5d-b996-8525a48f8710-workload-socket\") pod \"e2e-api-a-16b455-openshift-default-7b6fbf9745-6ffr8\" (UID: \"286ebc6d-c191-4f5d-b996-8525a48f8710\") " pod="openshift-ingress/e2e-api-a-16b455-openshift-default-7b6fbf9745-6ffr8"
Jul 14 20:31:04.047574 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:31:04.047432    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/286ebc6d-c191-4f5d-b996-8525a48f8710-workload-socket\") pod \"e2e-api-a-16b455-openshift-default-7b6fbf9745-6ffr8\" (UID: \"286ebc6d-c191-4f5d-b996-8525a48f8710\") " pod="openshift-ingress/e2e-api-a-16b455-openshift-default-7b6fbf9745-6ffr8"
Jul 14 20:31:04.047574 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:31:04.047483    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/286ebc6d-c191-4f5d-b996-8525a48f8710-workload-certs\") pod \"e2e-api-a-16b455-openshift-default-7b6fbf9745-6ffr8\" (UID: \"286ebc6d-c191-4f5d-b996-8525a48f8710\") " pod="openshift-ingress/e2e-api-a-16b455-openshift-default-7b6fbf9745-6ffr8"
Jul 14 20:31:04.047713 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:31:04.047569    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/286ebc6d-c191-4f5d-b996-8525a48f8710-istio-data\") pod \"e2e-api-a-16b455-openshift-default-7b6fbf9745-6ffr8\" (UID: \"286ebc6d-c191-4f5d-b996-8525a48f8710\") " pod="openshift-ingress/e2e-api-a-16b455-openshift-default-7b6fbf9745-6ffr8"
Jul 14 20:31:04.047820 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:31:04.047791    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/286ebc6d-c191-4f5d-b996-8525a48f8710-istiod-ca-cert\") pod \"e2e-api-a-16b455-openshift-default-7b6fbf9745-6ffr8\" (UID: \"286ebc6d-c191-4f5d-b996-8525a48f8710\") " pod="openshift-ingress/e2e-api-a-16b455-openshift-default-7b6fbf9745-6ffr8"
Jul 14 20:31:04.047927 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:31:04.047858    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/286ebc6d-c191-4f5d-b996-8525a48f8710-credential-socket\") pod \"e2e-api-a-16b455-openshift-default-7b6fbf9745-6ffr8\" (UID: \"286ebc6d-c191-4f5d-b996-8525a48f8710\") " pod="openshift-ingress/e2e-api-a-16b455-openshift-default-7b6fbf9745-6ffr8"
Jul 14 20:31:04.049595 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:31:04.049571    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/286ebc6d-c191-4f5d-b996-8525a48f8710-istio-envoy\") pod \"e2e-api-a-16b455-openshift-default-7b6fbf9745-6ffr8\" (UID: \"286ebc6d-c191-4f5d-b996-8525a48f8710\") " pod="openshift-ingress/e2e-api-a-16b455-openshift-default-7b6fbf9745-6ffr8"
Jul 14 20:31:04.050343 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:31:04.050320    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/286ebc6d-c191-4f5d-b996-8525a48f8710-istio-podinfo\") pod \"e2e-api-a-16b455-openshift-default-7b6fbf9745-6ffr8\" (UID: \"286ebc6d-c191-4f5d-b996-8525a48f8710\") " pod="openshift-ingress/e2e-api-a-16b455-openshift-default-7b6fbf9745-6ffr8"
Jul 14 20:31:04.057910 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:31:04.057881    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/286ebc6d-c191-4f5d-b996-8525a48f8710-istio-token\") pod \"e2e-api-a-16b455-openshift-default-7b6fbf9745-6ffr8\" (UID: \"286ebc6d-c191-4f5d-b996-8525a48f8710\") " pod="openshift-ingress/e2e-api-a-16b455-openshift-default-7b6fbf9745-6ffr8"
Jul 14 20:31:04.058823 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:31:04.058798    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gvhm4\" (UniqueName: \"kubernetes.io/projected/286ebc6d-c191-4f5d-b996-8525a48f8710-kube-api-access-gvhm4\") pod \"e2e-api-a-16b455-openshift-default-7b6fbf9745-6ffr8\" (UID: \"286ebc6d-c191-4f5d-b996-8525a48f8710\") " pod="openshift-ingress/e2e-api-a-16b455-openshift-default-7b6fbf9745-6ffr8"
Jul 14 20:31:04.105055 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:31:04.105020    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-16b455-openshift-default-7b6fbf9745-6ffr8"
Jul 14 20:31:04.260643 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:31:04.260612    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-16b455-openshift-default-7b6fbf9745-6ffr8"]
Jul 14 20:31:04.260792 ip-10-0-140-201 kubenswrapper[2579]: W0714 20:31:04.260770    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod286ebc6d_c191_4f5d_b996_8525a48f8710.slice/crio-879ca899812c55fa9dc014e85922714080faa085f646052ddbb91e7cc1471d63 WatchSource:0}: Error finding container 879ca899812c55fa9dc014e85922714080faa085f646052ddbb91e7cc1471d63: Status 404 returned error can't find the container with id 879ca899812c55fa9dc014e85922714080faa085f646052ddbb91e7cc1471d63
Jul 14 20:31:04.262795 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:31:04.262764    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 14 20:31:04.262876 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:31:04.262828    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 14 20:31:04.262876 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:31:04.262855    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 14 20:31:04.410222 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:31:04.410183    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-16b455-openshift-default-7b6fbf9745-6ffr8" event={"ID":"286ebc6d-c191-4f5d-b996-8525a48f8710","Type":"ContainerStarted","Data":"35c294dc46ce6af6377bae458e9918e2888839cea238fdd07307d46f19eeba5a"}
Jul 14 20:31:04.410399 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:31:04.410250    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-16b455-openshift-default-7b6fbf9745-6ffr8" event={"ID":"286ebc6d-c191-4f5d-b996-8525a48f8710","Type":"ContainerStarted","Data":"879ca899812c55fa9dc014e85922714080faa085f646052ddbb91e7cc1471d63"}
Jul 14 20:31:04.452057 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:31:04.451984    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-a-16b455-openshift-default-7b6fbf9745-6ffr8" podStartSLOduration=1.451963801 podStartE2EDuration="1.451963801s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 20:31:03 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 20:31:04.451707963 +0000 UTC m=+2364.163303517" watchObservedRunningTime="2026-07-14 20:31:04.451963801 +0000 UTC m=+2364.163559347"
Jul 14 20:31:05.105610 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:31:05.105575    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-16b455-openshift-default-7b6fbf9745-6ffr8"
Jul 14 20:31:05.110948 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:31:05.110916    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-16b455-openshift-default-7b6fbf9745-6ffr8"
Jul 14 20:31:05.416010 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:31:05.415919    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-16b455-openshift-default-7b6fbf9745-6ffr8"
Jul 14 20:31:05.417110 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:31:05.417085    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-16b455-openshift-default-7b6fbf9745-6ffr8"
Jul 14 20:31:06.458139 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:31:06.458079    2579 patch_prober.go:28] interesting pod/e2e-inf-b-d86aa8-openshift-default-54798dffc9-h8rvr container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 14 20:31:06.458560 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:31:06.458147    2579 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-b-d86aa8-openshift-default-54798dffc9-h8rvr" podUID="71a57a72-44cc-405a-9972-722024edc8e3" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 14 20:31:07.968205 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:31:07.968172    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-d86aa8-openshift-default-54798dffc9-h8rvr"
Jul 14 20:31:08.090303 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:31:08.090215    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/71a57a72-44cc-405a-9972-722024edc8e3-istio-token\") pod \"71a57a72-44cc-405a-9972-722024edc8e3\" (UID: \"71a57a72-44cc-405a-9972-722024edc8e3\") "
Jul 14 20:31:08.090303 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:31:08.090256    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/71a57a72-44cc-405a-9972-722024edc8e3-credential-socket\") pod \"71a57a72-44cc-405a-9972-722024edc8e3\" (UID: \"71a57a72-44cc-405a-9972-722024edc8e3\") "
Jul 14 20:31:08.090303 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:31:08.090285    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/71a57a72-44cc-405a-9972-722024edc8e3-istio-data\") pod \"71a57a72-44cc-405a-9972-722024edc8e3\" (UID: \"71a57a72-44cc-405a-9972-722024edc8e3\") "
Jul 14 20:31:08.090635 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:31:08.090325    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/71a57a72-44cc-405a-9972-722024edc8e3-istio-podinfo\") pod \"71a57a72-44cc-405a-9972-722024edc8e3\" (UID: \"71a57a72-44cc-405a-9972-722024edc8e3\") "
Jul 14 20:31:08.090635 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:31:08.090369    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vlhmm\" (UniqueName: \"kubernetes.io/projected/71a57a72-44cc-405a-9972-722024edc8e3-kube-api-access-vlhmm\") pod \"71a57a72-44cc-405a-9972-722024edc8e3\" (UID: \"71a57a72-44cc-405a-9972-722024edc8e3\") "
Jul 14 20:31:08.090635 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:31:08.090397    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/71a57a72-44cc-405a-9972-722024edc8e3-istiod-ca-cert\") pod \"71a57a72-44cc-405a-9972-722024edc8e3\" (UID: \"71a57a72-44cc-405a-9972-722024edc8e3\") "
Jul 14 20:31:08.090635 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:31:08.090419    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/71a57a72-44cc-405a-9972-722024edc8e3-istio-envoy\") pod \"71a57a72-44cc-405a-9972-722024edc8e3\" (UID: \"71a57a72-44cc-405a-9972-722024edc8e3\") "
Jul 14 20:31:08.090635 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:31:08.090453    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/71a57a72-44cc-405a-9972-722024edc8e3-workload-certs\") pod \"71a57a72-44cc-405a-9972-722024edc8e3\" (UID: \"71a57a72-44cc-405a-9972-722024edc8e3\") "
Jul 14 20:31:08.090635 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:31:08.090595    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/71a57a72-44cc-405a-9972-722024edc8e3-workload-socket\") pod \"71a57a72-44cc-405a-9972-722024edc8e3\" (UID: \"71a57a72-44cc-405a-9972-722024edc8e3\") "
Jul 14 20:31:08.090635 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:31:08.090601    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/71a57a72-44cc-405a-9972-722024edc8e3-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "71a57a72-44cc-405a-9972-722024edc8e3" (UID: "71a57a72-44cc-405a-9972-722024edc8e3"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 20:31:08.091009 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:31:08.090800    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/71a57a72-44cc-405a-9972-722024edc8e3-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "71a57a72-44cc-405a-9972-722024edc8e3" (UID: "71a57a72-44cc-405a-9972-722024edc8e3"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 20:31:08.091009 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:31:08.090949    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/71a57a72-44cc-405a-9972-722024edc8e3-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "71a57a72-44cc-405a-9972-722024edc8e3" (UID: "71a57a72-44cc-405a-9972-722024edc8e3"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 20:31:08.091126 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:31:08.091009    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/71a57a72-44cc-405a-9972-722024edc8e3-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "71a57a72-44cc-405a-9972-722024edc8e3" (UID: "71a57a72-44cc-405a-9972-722024edc8e3"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 14 20:31:08.091126 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:31:08.091089    2579 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/71a57a72-44cc-405a-9972-722024edc8e3-workload-socket\") on node \"ip-10-0-140-201.ec2.internal\" DevicePath \"\""
Jul 14 20:31:08.091126 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:31:08.091108    2579 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/71a57a72-44cc-405a-9972-722024edc8e3-credential-socket\") on node \"ip-10-0-140-201.ec2.internal\" DevicePath \"\""
Jul 14 20:31:08.091126 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:31:08.091120    2579 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/71a57a72-44cc-405a-9972-722024edc8e3-workload-certs\") on node \"ip-10-0-140-201.ec2.internal\" DevicePath \"\""
Jul 14 20:31:08.092028 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:31:08.091998    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/71a57a72-44cc-405a-9972-722024edc8e3-istio-data" (OuterVolumeSpecName: "istio-data") pod "71a57a72-44cc-405a-9972-722024edc8e3" (UID: "71a57a72-44cc-405a-9972-722024edc8e3"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 20:31:08.092896 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:31:08.092863    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/71a57a72-44cc-405a-9972-722024edc8e3-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "71a57a72-44cc-405a-9972-722024edc8e3" (UID: "71a57a72-44cc-405a-9972-722024edc8e3"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 20:31:08.093001 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:31:08.092869    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/71a57a72-44cc-405a-9972-722024edc8e3-istio-token" (OuterVolumeSpecName: "istio-token") pod "71a57a72-44cc-405a-9972-722024edc8e3" (UID: "71a57a72-44cc-405a-9972-722024edc8e3"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 14 20:31:08.093001 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:31:08.092929    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/71a57a72-44cc-405a-9972-722024edc8e3-kube-api-access-vlhmm" (OuterVolumeSpecName: "kube-api-access-vlhmm") pod "71a57a72-44cc-405a-9972-722024edc8e3" (UID: "71a57a72-44cc-405a-9972-722024edc8e3"). InnerVolumeSpecName "kube-api-access-vlhmm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 14 20:31:08.093123 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:31:08.093077    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/71a57a72-44cc-405a-9972-722024edc8e3-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "71a57a72-44cc-405a-9972-722024edc8e3" (UID: "71a57a72-44cc-405a-9972-722024edc8e3"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 14 20:31:08.191947 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:31:08.191904    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vlhmm\" (UniqueName: \"kubernetes.io/projected/71a57a72-44cc-405a-9972-722024edc8e3-kube-api-access-vlhmm\") on node \"ip-10-0-140-201.ec2.internal\" DevicePath \"\""
Jul 14 20:31:08.191947 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:31:08.191943    2579 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/71a57a72-44cc-405a-9972-722024edc8e3-istiod-ca-cert\") on node \"ip-10-0-140-201.ec2.internal\" DevicePath \"\""
Jul 14 20:31:08.191947 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:31:08.191953    2579 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/71a57a72-44cc-405a-9972-722024edc8e3-istio-envoy\") on node \"ip-10-0-140-201.ec2.internal\" DevicePath \"\""
Jul 14 20:31:08.191947 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:31:08.191961    2579 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/71a57a72-44cc-405a-9972-722024edc8e3-istio-token\") on node \"ip-10-0-140-201.ec2.internal\" DevicePath \"\""
Jul 14 20:31:08.192226 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:31:08.191969    2579 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/71a57a72-44cc-405a-9972-722024edc8e3-istio-data\") on node \"ip-10-0-140-201.ec2.internal\" DevicePath \"\""
Jul 14 20:31:08.192226 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:31:08.191976    2579 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/71a57a72-44cc-405a-9972-722024edc8e3-istio-podinfo\") on node \"ip-10-0-140-201.ec2.internal\" DevicePath \"\""
Jul 14 20:31:08.434325 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:31:08.434218    2579 generic.go:356] "Generic (PLEG): container finished" podID="71a57a72-44cc-405a-9972-722024edc8e3" containerID="9d486701e2ac4b31c71ccbbc1814b17b86cccecfc6d3cf6c716a75c036b9a8cf" exitCode=0
Jul 14 20:31:08.434325 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:31:08.434272    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-d86aa8-openshift-default-54798dffc9-h8rvr"
Jul 14 20:31:08.434325 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:31:08.434306    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-d86aa8-openshift-default-54798dffc9-h8rvr" event={"ID":"71a57a72-44cc-405a-9972-722024edc8e3","Type":"ContainerDied","Data":"9d486701e2ac4b31c71ccbbc1814b17b86cccecfc6d3cf6c716a75c036b9a8cf"}
Jul 14 20:31:08.434616 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:31:08.434368    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-d86aa8-openshift-default-54798dffc9-h8rvr" event={"ID":"71a57a72-44cc-405a-9972-722024edc8e3","Type":"ContainerDied","Data":"a88147a68df5fb784935354360b6da6bbe35a296e9508a976d90b9a90e51ef96"}
Jul 14 20:31:08.434616 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:31:08.434392    2579 scope.go:117] "RemoveContainer" containerID="9d486701e2ac4b31c71ccbbc1814b17b86cccecfc6d3cf6c716a75c036b9a8cf"
Jul 14 20:31:08.445004 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:31:08.444980    2579 scope.go:117] "RemoveContainer" containerID="3a4c4648ca64cda40f381c44422a4fd7116bb6f7f7ab84976738200848118120"
Jul 14 20:31:08.453948 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:31:08.453925    2579 scope.go:117] "RemoveContainer" containerID="9d486701e2ac4b31c71ccbbc1814b17b86cccecfc6d3cf6c716a75c036b9a8cf"
Jul 14 20:31:08.454293 ip-10-0-140-201 kubenswrapper[2579]: E0714 20:31:08.454269    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9d486701e2ac4b31c71ccbbc1814b17b86cccecfc6d3cf6c716a75c036b9a8cf\": container with ID starting with 9d486701e2ac4b31c71ccbbc1814b17b86cccecfc6d3cf6c716a75c036b9a8cf not found: ID does not exist" containerID="9d486701e2ac4b31c71ccbbc1814b17b86cccecfc6d3cf6c716a75c036b9a8cf"
Jul 14 20:31:08.454342 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:31:08.454310    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9d486701e2ac4b31c71ccbbc1814b17b86cccecfc6d3cf6c716a75c036b9a8cf"} err="failed to get container status \"9d486701e2ac4b31c71ccbbc1814b17b86cccecfc6d3cf6c716a75c036b9a8cf\": rpc error: code = NotFound desc = could not find container \"9d486701e2ac4b31c71ccbbc1814b17b86cccecfc6d3cf6c716a75c036b9a8cf\": container with ID starting with 9d486701e2ac4b31c71ccbbc1814b17b86cccecfc6d3cf6c716a75c036b9a8cf not found: ID does not exist"
Jul 14 20:31:08.454342 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:31:08.454329    2579 scope.go:117] "RemoveContainer" containerID="3a4c4648ca64cda40f381c44422a4fd7116bb6f7f7ab84976738200848118120"
Jul 14 20:31:08.454773 ip-10-0-140-201 kubenswrapper[2579]: E0714 20:31:08.454735    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3a4c4648ca64cda40f381c44422a4fd7116bb6f7f7ab84976738200848118120\": container with ID starting with 3a4c4648ca64cda40f381c44422a4fd7116bb6f7f7ab84976738200848118120 not found: ID does not exist" containerID="3a4c4648ca64cda40f381c44422a4fd7116bb6f7f7ab84976738200848118120"
Jul 14 20:31:08.454898 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:31:08.454777    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3a4c4648ca64cda40f381c44422a4fd7116bb6f7f7ab84976738200848118120"} err="failed to get container status \"3a4c4648ca64cda40f381c44422a4fd7116bb6f7f7ab84976738200848118120\": rpc error: code = NotFound desc = could not find container \"3a4c4648ca64cda40f381c44422a4fd7116bb6f7f7ab84976738200848118120\": container with ID starting with 3a4c4648ca64cda40f381c44422a4fd7116bb6f7f7ab84976738200848118120 not found: ID does not exist"
Jul 14 20:31:08.458772 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:31:08.458745    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-d86aa8-openshift-default-54798dffc9-h8rvr"]
Jul 14 20:31:08.462620 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:31:08.462594    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-b-d86aa8-openshift-default-54798dffc9-h8rvr"]
Jul 14 20:31:08.847908 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:31:08.847872    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="71a57a72-44cc-405a-9972-722024edc8e3" path="/var/lib/kubelet/pods/71a57a72-44cc-405a-9972-722024edc8e3/volumes"
Jul 14 20:31:12.029441 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:31:12.029399    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-b-ad0405-openshift-default-588fc97c7-29r4k"]
Jul 14 20:31:12.029928 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:31:12.029855    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="71a57a72-44cc-405a-9972-722024edc8e3" containerName="istio-proxy"
Jul 14 20:31:12.029928 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:31:12.029871    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="71a57a72-44cc-405a-9972-722024edc8e3" containerName="istio-proxy"
Jul 14 20:31:12.029928 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:31:12.029879    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="71a57a72-44cc-405a-9972-722024edc8e3" containerName="istio-proxy"
Jul 14 20:31:12.029928 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:31:12.029885    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="71a57a72-44cc-405a-9972-722024edc8e3" containerName="istio-proxy"
Jul 14 20:31:12.030142 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:31:12.030011    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="71a57a72-44cc-405a-9972-722024edc8e3" containerName="istio-proxy"
Jul 14 20:31:12.030142 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:31:12.030024    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="71a57a72-44cc-405a-9972-722024edc8e3" containerName="istio-proxy"
Jul 14 20:31:12.034708 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:31:12.034683    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-ad0405-openshift-default-588fc97c7-29r4k"
Jul 14 20:31:12.041639 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:31:12.041575    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-b-ad0405-openshift-default-dockercfg-m4vw9\""
Jul 14 20:31:12.056271 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:31:12.056237    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-ad0405-openshift-default-588fc97c7-29r4k"]
Jul 14 20:31:12.131102 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:31:12.131018    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qtjqh\" (UniqueName: \"kubernetes.io/projected/b3d9e4b3-2528-47c0-897f-92873c79ad8b-kube-api-access-qtjqh\") pod \"e2e-api-b-ad0405-openshift-default-588fc97c7-29r4k\" (UID: \"b3d9e4b3-2528-47c0-897f-92873c79ad8b\") " pod="openshift-ingress/e2e-api-b-ad0405-openshift-default-588fc97c7-29r4k"
Jul 14 20:31:12.131417 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:31:12.131383    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b3d9e4b3-2528-47c0-897f-92873c79ad8b-istio-envoy\") pod \"e2e-api-b-ad0405-openshift-default-588fc97c7-29r4k\" (UID: \"b3d9e4b3-2528-47c0-897f-92873c79ad8b\") " pod="openshift-ingress/e2e-api-b-ad0405-openshift-default-588fc97c7-29r4k"
Jul 14 20:31:12.131620 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:31:12.131602    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b3d9e4b3-2528-47c0-897f-92873c79ad8b-workload-certs\") pod \"e2e-api-b-ad0405-openshift-default-588fc97c7-29r4k\" (UID: \"b3d9e4b3-2528-47c0-897f-92873c79ad8b\") " pod="openshift-ingress/e2e-api-b-ad0405-openshift-default-588fc97c7-29r4k"
Jul 14 20:31:12.131773 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:31:12.131759    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b3d9e4b3-2528-47c0-897f-92873c79ad8b-istiod-ca-cert\") pod \"e2e-api-b-ad0405-openshift-default-588fc97c7-29r4k\" (UID: \"b3d9e4b3-2528-47c0-897f-92873c79ad8b\") " pod="openshift-ingress/e2e-api-b-ad0405-openshift-default-588fc97c7-29r4k"
Jul 14 20:31:12.131944 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:31:12.131915    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b3d9e4b3-2528-47c0-897f-92873c79ad8b-istio-podinfo\") pod \"e2e-api-b-ad0405-openshift-default-588fc97c7-29r4k\" (UID: \"b3d9e4b3-2528-47c0-897f-92873c79ad8b\") " pod="openshift-ingress/e2e-api-b-ad0405-openshift-default-588fc97c7-29r4k"
Jul 14 20:31:12.132071 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:31:12.132057    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b3d9e4b3-2528-47c0-897f-92873c79ad8b-credential-socket\") pod \"e2e-api-b-ad0405-openshift-default-588fc97c7-29r4k\" (UID: \"b3d9e4b3-2528-47c0-897f-92873c79ad8b\") " pod="openshift-ingress/e2e-api-b-ad0405-openshift-default-588fc97c7-29r4k"
Jul 14 20:31:12.132220 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:31:12.132206    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b3d9e4b3-2528-47c0-897f-92873c79ad8b-istio-data\") pod \"e2e-api-b-ad0405-openshift-default-588fc97c7-29r4k\" (UID: \"b3d9e4b3-2528-47c0-897f-92873c79ad8b\") " pod="openshift-ingress/e2e-api-b-ad0405-openshift-default-588fc97c7-29r4k"
Jul 14 20:31:12.132350 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:31:12.132337    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b3d9e4b3-2528-47c0-897f-92873c79ad8b-istio-token\") pod \"e2e-api-b-ad0405-openshift-default-588fc97c7-29r4k\" (UID: \"b3d9e4b3-2528-47c0-897f-92873c79ad8b\") " pod="openshift-ingress/e2e-api-b-ad0405-openshift-default-588fc97c7-29r4k"
Jul 14 20:31:12.132481 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:31:12.132465    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b3d9e4b3-2528-47c0-897f-92873c79ad8b-workload-socket\") pod \"e2e-api-b-ad0405-openshift-default-588fc97c7-29r4k\" (UID: \"b3d9e4b3-2528-47c0-897f-92873c79ad8b\") " pod="openshift-ingress/e2e-api-b-ad0405-openshift-default-588fc97c7-29r4k"
Jul 14 20:31:12.233952 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:31:12.233895    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b3d9e4b3-2528-47c0-897f-92873c79ad8b-credential-socket\") pod \"e2e-api-b-ad0405-openshift-default-588fc97c7-29r4k\" (UID: \"b3d9e4b3-2528-47c0-897f-92873c79ad8b\") " pod="openshift-ingress/e2e-api-b-ad0405-openshift-default-588fc97c7-29r4k"
Jul 14 20:31:12.233952 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:31:12.233958    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b3d9e4b3-2528-47c0-897f-92873c79ad8b-istio-data\") pod \"e2e-api-b-ad0405-openshift-default-588fc97c7-29r4k\" (UID: \"b3d9e4b3-2528-47c0-897f-92873c79ad8b\") " pod="openshift-ingress/e2e-api-b-ad0405-openshift-default-588fc97c7-29r4k"
Jul 14 20:31:12.234216 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:31:12.233991    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b3d9e4b3-2528-47c0-897f-92873c79ad8b-istio-token\") pod \"e2e-api-b-ad0405-openshift-default-588fc97c7-29r4k\" (UID: \"b3d9e4b3-2528-47c0-897f-92873c79ad8b\") " pod="openshift-ingress/e2e-api-b-ad0405-openshift-default-588fc97c7-29r4k"
Jul 14 20:31:12.234216 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:31:12.234016    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b3d9e4b3-2528-47c0-897f-92873c79ad8b-workload-socket\") pod \"e2e-api-b-ad0405-openshift-default-588fc97c7-29r4k\" (UID: \"b3d9e4b3-2528-47c0-897f-92873c79ad8b\") " pod="openshift-ingress/e2e-api-b-ad0405-openshift-default-588fc97c7-29r4k"
Jul 14 20:31:12.234216 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:31:12.234107    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qtjqh\" (UniqueName: \"kubernetes.io/projected/b3d9e4b3-2528-47c0-897f-92873c79ad8b-kube-api-access-qtjqh\") pod \"e2e-api-b-ad0405-openshift-default-588fc97c7-29r4k\" (UID: \"b3d9e4b3-2528-47c0-897f-92873c79ad8b\") " pod="openshift-ingress/e2e-api-b-ad0405-openshift-default-588fc97c7-29r4k"
Jul 14 20:31:12.234216 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:31:12.234147    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b3d9e4b3-2528-47c0-897f-92873c79ad8b-istio-envoy\") pod \"e2e-api-b-ad0405-openshift-default-588fc97c7-29r4k\" (UID: \"b3d9e4b3-2528-47c0-897f-92873c79ad8b\") " pod="openshift-ingress/e2e-api-b-ad0405-openshift-default-588fc97c7-29r4k"
Jul 14 20:31:12.234216 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:31:12.234191    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b3d9e4b3-2528-47c0-897f-92873c79ad8b-workload-certs\") pod \"e2e-api-b-ad0405-openshift-default-588fc97c7-29r4k\" (UID: \"b3d9e4b3-2528-47c0-897f-92873c79ad8b\") " pod="openshift-ingress/e2e-api-b-ad0405-openshift-default-588fc97c7-29r4k"
Jul 14 20:31:12.234216 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:31:12.234216    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b3d9e4b3-2528-47c0-897f-92873c79ad8b-istiod-ca-cert\") pod \"e2e-api-b-ad0405-openshift-default-588fc97c7-29r4k\" (UID: \"b3d9e4b3-2528-47c0-897f-92873c79ad8b\") " pod="openshift-ingress/e2e-api-b-ad0405-openshift-default-588fc97c7-29r4k"
Jul 14 20:31:12.234599 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:31:12.234271    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b3d9e4b3-2528-47c0-897f-92873c79ad8b-istio-podinfo\") pod \"e2e-api-b-ad0405-openshift-default-588fc97c7-29r4k\" (UID: \"b3d9e4b3-2528-47c0-897f-92873c79ad8b\") " pod="openshift-ingress/e2e-api-b-ad0405-openshift-default-588fc97c7-29r4k"
Jul 14 20:31:12.234599 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:31:12.234377    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b3d9e4b3-2528-47c0-897f-92873c79ad8b-credential-socket\") pod \"e2e-api-b-ad0405-openshift-default-588fc97c7-29r4k\" (UID: \"b3d9e4b3-2528-47c0-897f-92873c79ad8b\") " pod="openshift-ingress/e2e-api-b-ad0405-openshift-default-588fc97c7-29r4k"
Jul 14 20:31:12.234739 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:31:12.234715    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b3d9e4b3-2528-47c0-897f-92873c79ad8b-workload-certs\") pod \"e2e-api-b-ad0405-openshift-default-588fc97c7-29r4k\" (UID: \"b3d9e4b3-2528-47c0-897f-92873c79ad8b\") " pod="openshift-ingress/e2e-api-b-ad0405-openshift-default-588fc97c7-29r4k"
Jul 14 20:31:12.234808 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:31:12.234755    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b3d9e4b3-2528-47c0-897f-92873c79ad8b-istio-data\") pod \"e2e-api-b-ad0405-openshift-default-588fc97c7-29r4k\" (UID: \"b3d9e4b3-2528-47c0-897f-92873c79ad8b\") " pod="openshift-ingress/e2e-api-b-ad0405-openshift-default-588fc97c7-29r4k"
Jul 14 20:31:12.235008 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:31:12.234987    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b3d9e4b3-2528-47c0-897f-92873c79ad8b-workload-socket\") pod \"e2e-api-b-ad0405-openshift-default-588fc97c7-29r4k\" (UID: \"b3d9e4b3-2528-47c0-897f-92873c79ad8b\") " pod="openshift-ingress/e2e-api-b-ad0405-openshift-default-588fc97c7-29r4k"
Jul 14 20:31:12.235346 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:31:12.235324    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b3d9e4b3-2528-47c0-897f-92873c79ad8b-istiod-ca-cert\") pod \"e2e-api-b-ad0405-openshift-default-588fc97c7-29r4k\" (UID: \"b3d9e4b3-2528-47c0-897f-92873c79ad8b\") " pod="openshift-ingress/e2e-api-b-ad0405-openshift-default-588fc97c7-29r4k"
Jul 14 20:31:12.236789 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:31:12.236767    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b3d9e4b3-2528-47c0-897f-92873c79ad8b-istio-envoy\") pod \"e2e-api-b-ad0405-openshift-default-588fc97c7-29r4k\" (UID: \"b3d9e4b3-2528-47c0-897f-92873c79ad8b\") " pod="openshift-ingress/e2e-api-b-ad0405-openshift-default-588fc97c7-29r4k"
Jul 14 20:31:12.236931 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:31:12.236913    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b3d9e4b3-2528-47c0-897f-92873c79ad8b-istio-podinfo\") pod \"e2e-api-b-ad0405-openshift-default-588fc97c7-29r4k\" (UID: \"b3d9e4b3-2528-47c0-897f-92873c79ad8b\") " pod="openshift-ingress/e2e-api-b-ad0405-openshift-default-588fc97c7-29r4k"
Jul 14 20:31:12.246458 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:31:12.246431    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b3d9e4b3-2528-47c0-897f-92873c79ad8b-istio-token\") pod \"e2e-api-b-ad0405-openshift-default-588fc97c7-29r4k\" (UID: \"b3d9e4b3-2528-47c0-897f-92873c79ad8b\") " pod="openshift-ingress/e2e-api-b-ad0405-openshift-default-588fc97c7-29r4k"
Jul 14 20:31:12.248315 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:31:12.248287    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qtjqh\" (UniqueName: \"kubernetes.io/projected/b3d9e4b3-2528-47c0-897f-92873c79ad8b-kube-api-access-qtjqh\") pod \"e2e-api-b-ad0405-openshift-default-588fc97c7-29r4k\" (UID: \"b3d9e4b3-2528-47c0-897f-92873c79ad8b\") " pod="openshift-ingress/e2e-api-b-ad0405-openshift-default-588fc97c7-29r4k"
Jul 14 20:31:12.345362 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:31:12.345257    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-ad0405-openshift-default-588fc97c7-29r4k"
Jul 14 20:31:12.537066 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:31:12.537028    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-ad0405-openshift-default-588fc97c7-29r4k"]
Jul 14 20:31:12.538144 ip-10-0-140-201 kubenswrapper[2579]: W0714 20:31:12.538121    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb3d9e4b3_2528_47c0_897f_92873c79ad8b.slice/crio-fa5f8a66c4cdc52af6895a23c72f35e680ff61466064c108bc10fac8d0b39f0e WatchSource:0}: Error finding container fa5f8a66c4cdc52af6895a23c72f35e680ff61466064c108bc10fac8d0b39f0e: Status 404 returned error can't find the container with id fa5f8a66c4cdc52af6895a23c72f35e680ff61466064c108bc10fac8d0b39f0e
Jul 14 20:31:12.540320 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:31:12.540289    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 14 20:31:12.540377 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:31:12.540359    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 14 20:31:12.540418 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:31:12.540387    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 14 20:31:13.466038 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:31:13.466004    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-ad0405-openshift-default-588fc97c7-29r4k" event={"ID":"b3d9e4b3-2528-47c0-897f-92873c79ad8b","Type":"ContainerStarted","Data":"a9d02ddaa8dba1d2f97b181ebb5464e1e9f49375b085431c6b199ee616cbf862"}
Jul 14 20:31:13.466442 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:31:13.466054    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-ad0405-openshift-default-588fc97c7-29r4k" event={"ID":"b3d9e4b3-2528-47c0-897f-92873c79ad8b","Type":"ContainerStarted","Data":"fa5f8a66c4cdc52af6895a23c72f35e680ff61466064c108bc10fac8d0b39f0e"}
Jul 14 20:31:14.346424 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:31:14.346386    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-ad0405-openshift-default-588fc97c7-29r4k"
Jul 14 20:31:14.351572 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:31:14.351518    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-ad0405-openshift-default-588fc97c7-29r4k"
Jul 14 20:31:14.386076 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:31:14.386005    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-b-ad0405-openshift-default-588fc97c7-29r4k" podStartSLOduration=2.385982585 podStartE2EDuration="2.385982585s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 20:31:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 20:31:13.493097545 +0000 UTC m=+2373.204693083" watchObservedRunningTime="2026-07-14 20:31:14.385982585 +0000 UTC m=+2374.097578130"
Jul 14 20:31:14.471743 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:31:14.471681    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-ad0405-openshift-default-588fc97c7-29r4k"
Jul 14 20:31:14.479344 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:31:14.479065    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-ad0405-openshift-default-588fc97c7-29r4k"
Jul 14 20:31:19.505757 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:31:19.505717    2579 generic.go:356] "Generic (PLEG): container finished" podID="286ebc6d-c191-4f5d-b996-8525a48f8710" containerID="35c294dc46ce6af6377bae458e9918e2888839cea238fdd07307d46f19eeba5a" exitCode=0
Jul 14 20:31:19.506189 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:31:19.505780    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-16b455-openshift-default-7b6fbf9745-6ffr8" event={"ID":"286ebc6d-c191-4f5d-b996-8525a48f8710","Type":"ContainerDied","Data":"35c294dc46ce6af6377bae458e9918e2888839cea238fdd07307d46f19eeba5a"}
Jul 14 20:31:19.506238 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:31:19.506192    2579 scope.go:117] "RemoveContainer" containerID="35c294dc46ce6af6377bae458e9918e2888839cea238fdd07307d46f19eeba5a"
Jul 14 20:31:19.507229 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:31:19.507201    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 14 20:31:19.507332 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:31:19.507283    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 14 20:31:19.507395 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:31:19.507351    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 14 20:31:20.416183 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:31:20.416139    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-16b455-openshift-default-7b6fbf9745-6ffr8"
Jul 14 20:31:20.513736 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:31:20.513693    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-16b455-openshift-default-7b6fbf9745-6ffr8" event={"ID":"286ebc6d-c191-4f5d-b996-8525a48f8710","Type":"ContainerStarted","Data":"79bcf2dc0dba1e3a51841638e6f2d1116427f65141bef4bee63377449ab50906"}
Jul 14 20:31:21.105933 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:31:21.105892    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-16b455-openshift-default-7b6fbf9745-6ffr8"
Jul 14 20:31:21.106956 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:31:21.106933    2579 patch_prober.go:28] interesting pod/e2e-api-a-16b455-openshift-default-7b6fbf9745-6ffr8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.58:15021/healthz/ready\": dial tcp 10.133.0.58:15021: connect: connection refused" start-of-body=
Jul 14 20:31:21.107041 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:31:21.106991    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-16b455-openshift-default-7b6fbf9745-6ffr8" podUID="286ebc6d-c191-4f5d-b996-8525a48f8710" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.58:15021/healthz/ready\": dial tcp 10.133.0.58:15021: connect: connection refused"
Jul 14 20:31:22.105909 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:31:22.105870    2579 patch_prober.go:28] interesting pod/e2e-api-a-16b455-openshift-default-7b6fbf9745-6ffr8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.58:15021/healthz/ready\": dial tcp 10.133.0.58:15021: connect: connection refused" start-of-body=
Jul 14 20:31:22.106297 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:31:22.105930    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-16b455-openshift-default-7b6fbf9745-6ffr8" podUID="286ebc6d-c191-4f5d-b996-8525a48f8710" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.58:15021/healthz/ready\": dial tcp 10.133.0.58:15021: connect: connection refused"
Jul 14 20:31:23.105485 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:31:23.105444    2579 patch_prober.go:28] interesting pod/e2e-api-a-16b455-openshift-default-7b6fbf9745-6ffr8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.58:15021/healthz/ready\": dial tcp 10.133.0.58:15021: connect: connection refused" start-of-body=
Jul 14 20:31:23.105693 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:31:23.105508    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-16b455-openshift-default-7b6fbf9745-6ffr8" podUID="286ebc6d-c191-4f5d-b996-8525a48f8710" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.58:15021/healthz/ready\": dial tcp 10.133.0.58:15021: connect: connection refused"
Jul 14 20:31:24.105555 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:31:24.105492    2579 patch_prober.go:28] interesting pod/e2e-api-a-16b455-openshift-default-7b6fbf9745-6ffr8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.58:15021/healthz/ready\": dial tcp 10.133.0.58:15021: connect: connection refused" start-of-body=
Jul 14 20:31:24.105963 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:31:24.105585    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-16b455-openshift-default-7b6fbf9745-6ffr8" podUID="286ebc6d-c191-4f5d-b996-8525a48f8710" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.58:15021/healthz/ready\": dial tcp 10.133.0.58:15021: connect: connection refused"
Jul 14 20:31:25.109705 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:31:25.109670    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-16b455-openshift-default-7b6fbf9745-6ffr8"
Jul 14 20:31:25.110213 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:31:25.110115    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-16b455-openshift-default-7b6fbf9745-6ffr8"
Jul 14 20:31:25.110848 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:31:25.110828    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-16b455-openshift-default-7b6fbf9745-6ffr8"
Jul 14 20:31:30.512732 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:31:30.512681    2579 patch_prober.go:28] interesting pod/e2e-api-b-ad0405-openshift-default-588fc97c7-29r4k container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.59:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Jul 14 20:31:30.513155 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:31:30.512758    2579 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-b-ad0405-openshift-default-588fc97c7-29r4k" podUID="b3d9e4b3-2528-47c0-897f-92873c79ad8b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.59:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Jul 14 20:31:32.588337 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:31:32.588239    2579 generic.go:356] "Generic (PLEG): container finished" podID="b3d9e4b3-2528-47c0-897f-92873c79ad8b" containerID="a9d02ddaa8dba1d2f97b181ebb5464e1e9f49375b085431c6b199ee616cbf862" exitCode=0
Jul 14 20:31:32.588337 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:31:32.588290    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-ad0405-openshift-default-588fc97c7-29r4k" event={"ID":"b3d9e4b3-2528-47c0-897f-92873c79ad8b","Type":"ContainerDied","Data":"a9d02ddaa8dba1d2f97b181ebb5464e1e9f49375b085431c6b199ee616cbf862"}
Jul 14 20:31:32.588794 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:31:32.588721    2579 scope.go:117] "RemoveContainer" containerID="a9d02ddaa8dba1d2f97b181ebb5464e1e9f49375b085431c6b199ee616cbf862"
Jul 14 20:31:32.589800 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:31:32.589768    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 14 20:31:32.589930 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:31:32.589839    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 14 20:31:32.589930 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:31:32.589874    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 14 20:31:33.600934 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:31:33.600890    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-ad0405-openshift-default-588fc97c7-29r4k" event={"ID":"b3d9e4b3-2528-47c0-897f-92873c79ad8b","Type":"ContainerStarted","Data":"149d65c32b929eb4ab7d231b7ae5fb8246d620e9c670068825dc5ce63d921add"}
Jul 14 20:31:34.346469 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:31:34.346427    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-ad0405-openshift-default-588fc97c7-29r4k"
Jul 14 20:31:34.346742 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:31:34.346718    2579 patch_prober.go:28] interesting pod/e2e-api-b-ad0405-openshift-default-588fc97c7-29r4k container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.59:15021/healthz/ready\": dial tcp 10.133.0.59:15021: connect: connection refused" start-of-body=
Jul 14 20:31:34.346808 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:31:34.346776    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-ad0405-openshift-default-588fc97c7-29r4k" podUID="b3d9e4b3-2528-47c0-897f-92873c79ad8b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.59:15021/healthz/ready\": dial tcp 10.133.0.59:15021: connect: connection refused"
Jul 14 20:31:35.346351 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:31:35.346312    2579 patch_prober.go:28] interesting pod/e2e-api-b-ad0405-openshift-default-588fc97c7-29r4k container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.59:15021/healthz/ready\": dial tcp 10.133.0.59:15021: connect: connection refused" start-of-body=
Jul 14 20:31:35.346807 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:31:35.346370    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-ad0405-openshift-default-588fc97c7-29r4k" podUID="b3d9e4b3-2528-47c0-897f-92873c79ad8b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.59:15021/healthz/ready\": dial tcp 10.133.0.59:15021: connect: connection refused"
Jul 14 20:31:36.346185 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:31:36.346150    2579 patch_prober.go:28] interesting pod/e2e-api-b-ad0405-openshift-default-588fc97c7-29r4k container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.59:15021/healthz/ready\": dial tcp 10.133.0.59:15021: connect: connection refused" start-of-body=
Jul 14 20:31:36.346392 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:31:36.346211    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-ad0405-openshift-default-588fc97c7-29r4k" podUID="b3d9e4b3-2528-47c0-897f-92873c79ad8b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.59:15021/healthz/ready\": dial tcp 10.133.0.59:15021: connect: connection refused"
Jul 14 20:31:37.346456 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:31:37.346415    2579 patch_prober.go:28] interesting pod/e2e-api-b-ad0405-openshift-default-588fc97c7-29r4k container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.59:15021/healthz/ready\": dial tcp 10.133.0.59:15021: connect: connection refused" start-of-body=
Jul 14 20:31:37.346915 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:31:37.346489    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-ad0405-openshift-default-588fc97c7-29r4k" podUID="b3d9e4b3-2528-47c0-897f-92873c79ad8b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.59:15021/healthz/ready\": dial tcp 10.133.0.59:15021: connect: connection refused"
Jul 14 20:31:38.350145 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:31:38.350111    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-ad0405-openshift-default-588fc97c7-29r4k"
Jul 14 20:31:38.350557 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:31:38.350463    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-ad0405-openshift-default-588fc97c7-29r4k"
Jul 14 20:31:38.351294 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:31:38.351277    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-ad0405-openshift-default-588fc97c7-29r4k"
Jul 14 20:31:40.991624 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:31:40.991597    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-q4xzw_ef54193c-7659-4e47-87ac-4d129d22a268/ovn-acl-logging/0.log"
Jul 14 20:31:41.000126 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:31:41.000104    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-q4xzw_ef54193c-7659-4e47-87ac-4d129d22a268/ovn-acl-logging/0.log"
Jul 14 20:31:54.503635 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:31:54.503593    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-16b455-openshift-default-7b6fbf9745-6ffr8"]
Jul 14 20:31:54.504057 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:31:54.503829    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-api-a-16b455-openshift-default-7b6fbf9745-6ffr8" podUID="286ebc6d-c191-4f5d-b996-8525a48f8710" containerName="istio-proxy" containerID="cri-o://79bcf2dc0dba1e3a51841638e6f2d1116427f65141bef4bee63377449ab50906" gracePeriod=30
Jul 14 20:31:55.112902 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:31:55.112859    2579 patch_prober.go:28] interesting pod/e2e-api-a-16b455-openshift-default-7b6fbf9745-6ffr8 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 14 20:31:55.113068 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:31:55.112922    2579 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-a-16b455-openshift-default-7b6fbf9745-6ffr8" podUID="286ebc6d-c191-4f5d-b996-8525a48f8710" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 14 20:31:59.753766 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:31:59.753732    2579 generic.go:356] "Generic (PLEG): container finished" podID="286ebc6d-c191-4f5d-b996-8525a48f8710" containerID="79bcf2dc0dba1e3a51841638e6f2d1116427f65141bef4bee63377449ab50906" exitCode=0
Jul 14 20:31:59.754104 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:31:59.753770    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-16b455-openshift-default-7b6fbf9745-6ffr8" event={"ID":"286ebc6d-c191-4f5d-b996-8525a48f8710","Type":"ContainerDied","Data":"79bcf2dc0dba1e3a51841638e6f2d1116427f65141bef4bee63377449ab50906"}
Jul 14 20:31:59.754104 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:31:59.753884    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-16b455-openshift-default-7b6fbf9745-6ffr8" event={"ID":"286ebc6d-c191-4f5d-b996-8525a48f8710","Type":"ContainerDied","Data":"879ca899812c55fa9dc014e85922714080faa085f646052ddbb91e7cc1471d63"}
Jul 14 20:31:59.754104 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:31:59.753913    2579 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="879ca899812c55fa9dc014e85922714080faa085f646052ddbb91e7cc1471d63"
Jul 14 20:31:59.754104 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:31:59.753932    2579 scope.go:117] "RemoveContainer" containerID="35c294dc46ce6af6377bae458e9918e2888839cea238fdd07307d46f19eeba5a"
Jul 14 20:31:59.758738 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:31:59.758716    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-16b455-openshift-default-7b6fbf9745-6ffr8"
Jul 14 20:31:59.807068 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:31:59.806978    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/286ebc6d-c191-4f5d-b996-8525a48f8710-istiod-ca-cert\") pod \"286ebc6d-c191-4f5d-b996-8525a48f8710\" (UID: \"286ebc6d-c191-4f5d-b996-8525a48f8710\") "
Jul 14 20:31:59.807068 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:31:59.807036    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gvhm4\" (UniqueName: \"kubernetes.io/projected/286ebc6d-c191-4f5d-b996-8525a48f8710-kube-api-access-gvhm4\") pod \"286ebc6d-c191-4f5d-b996-8525a48f8710\" (UID: \"286ebc6d-c191-4f5d-b996-8525a48f8710\") "
Jul 14 20:31:59.807293 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:31:59.807068    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/286ebc6d-c191-4f5d-b996-8525a48f8710-istio-data\") pod \"286ebc6d-c191-4f5d-b996-8525a48f8710\" (UID: \"286ebc6d-c191-4f5d-b996-8525a48f8710\") "
Jul 14 20:31:59.807293 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:31:59.807107    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/286ebc6d-c191-4f5d-b996-8525a48f8710-istio-token\") pod \"286ebc6d-c191-4f5d-b996-8525a48f8710\" (UID: \"286ebc6d-c191-4f5d-b996-8525a48f8710\") "
Jul 14 20:31:59.807293 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:31:59.807188    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/286ebc6d-c191-4f5d-b996-8525a48f8710-istio-podinfo\") pod \"286ebc6d-c191-4f5d-b996-8525a48f8710\" (UID: \"286ebc6d-c191-4f5d-b996-8525a48f8710\") "
Jul 14 20:31:59.807293 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:31:59.807273    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/286ebc6d-c191-4f5d-b996-8525a48f8710-istio-envoy\") pod \"286ebc6d-c191-4f5d-b996-8525a48f8710\" (UID: \"286ebc6d-c191-4f5d-b996-8525a48f8710\") "
Jul 14 20:31:59.807506 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:31:59.807333    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/286ebc6d-c191-4f5d-b996-8525a48f8710-workload-certs\") pod \"286ebc6d-c191-4f5d-b996-8525a48f8710\" (UID: \"286ebc6d-c191-4f5d-b996-8525a48f8710\") "
Jul 14 20:31:59.807506 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:31:59.807386    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/286ebc6d-c191-4f5d-b996-8525a48f8710-workload-socket\") pod \"286ebc6d-c191-4f5d-b996-8525a48f8710\" (UID: \"286ebc6d-c191-4f5d-b996-8525a48f8710\") "
Jul 14 20:31:59.807506 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:31:59.807436    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/286ebc6d-c191-4f5d-b996-8525a48f8710-credential-socket\") pod \"286ebc6d-c191-4f5d-b996-8525a48f8710\" (UID: \"286ebc6d-c191-4f5d-b996-8525a48f8710\") "
Jul 14 20:31:59.807506 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:31:59.807493    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/286ebc6d-c191-4f5d-b996-8525a48f8710-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "286ebc6d-c191-4f5d-b996-8525a48f8710" (UID: "286ebc6d-c191-4f5d-b996-8525a48f8710"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 14 20:31:59.807784 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:31:59.807632    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/286ebc6d-c191-4f5d-b996-8525a48f8710-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "286ebc6d-c191-4f5d-b996-8525a48f8710" (UID: "286ebc6d-c191-4f5d-b996-8525a48f8710"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 20:31:59.807784 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:31:59.807746    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/286ebc6d-c191-4f5d-b996-8525a48f8710-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "286ebc6d-c191-4f5d-b996-8525a48f8710" (UID: "286ebc6d-c191-4f5d-b996-8525a48f8710"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 20:31:59.807894 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:31:59.807831    2579 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/286ebc6d-c191-4f5d-b996-8525a48f8710-istiod-ca-cert\") on node \"ip-10-0-140-201.ec2.internal\" DevicePath \"\""
Jul 14 20:31:59.807894 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:31:59.807853    2579 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/286ebc6d-c191-4f5d-b996-8525a48f8710-workload-certs\") on node \"ip-10-0-140-201.ec2.internal\" DevicePath \"\""
Jul 14 20:31:59.807894 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:31:59.807867    2579 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/286ebc6d-c191-4f5d-b996-8525a48f8710-workload-socket\") on node \"ip-10-0-140-201.ec2.internal\" DevicePath \"\""
Jul 14 20:31:59.808203 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:31:59.808146    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/286ebc6d-c191-4f5d-b996-8525a48f8710-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "286ebc6d-c191-4f5d-b996-8525a48f8710" (UID: "286ebc6d-c191-4f5d-b996-8525a48f8710"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 20:31:59.808410 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:31:59.808383    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/286ebc6d-c191-4f5d-b996-8525a48f8710-istio-data" (OuterVolumeSpecName: "istio-data") pod "286ebc6d-c191-4f5d-b996-8525a48f8710" (UID: "286ebc6d-c191-4f5d-b996-8525a48f8710"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 20:31:59.809629 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:31:59.809606    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/286ebc6d-c191-4f5d-b996-8525a48f8710-kube-api-access-gvhm4" (OuterVolumeSpecName: "kube-api-access-gvhm4") pod "286ebc6d-c191-4f5d-b996-8525a48f8710" (UID: "286ebc6d-c191-4f5d-b996-8525a48f8710"). InnerVolumeSpecName "kube-api-access-gvhm4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 14 20:31:59.809795 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:31:59.809772    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/286ebc6d-c191-4f5d-b996-8525a48f8710-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "286ebc6d-c191-4f5d-b996-8525a48f8710" (UID: "286ebc6d-c191-4f5d-b996-8525a48f8710"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 20:31:59.809868 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:31:59.809838    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/286ebc6d-c191-4f5d-b996-8525a48f8710-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "286ebc6d-c191-4f5d-b996-8525a48f8710" (UID: "286ebc6d-c191-4f5d-b996-8525a48f8710"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 14 20:31:59.810175 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:31:59.810153    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/286ebc6d-c191-4f5d-b996-8525a48f8710-istio-token" (OuterVolumeSpecName: "istio-token") pod "286ebc6d-c191-4f5d-b996-8525a48f8710" (UID: "286ebc6d-c191-4f5d-b996-8525a48f8710"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 14 20:31:59.908662 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:31:59.908625    2579 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/286ebc6d-c191-4f5d-b996-8525a48f8710-istio-envoy\") on node \"ip-10-0-140-201.ec2.internal\" DevicePath \"\""
Jul 14 20:31:59.908662 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:31:59.908660    2579 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/286ebc6d-c191-4f5d-b996-8525a48f8710-credential-socket\") on node \"ip-10-0-140-201.ec2.internal\" DevicePath \"\""
Jul 14 20:31:59.908662 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:31:59.908674    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gvhm4\" (UniqueName: \"kubernetes.io/projected/286ebc6d-c191-4f5d-b996-8525a48f8710-kube-api-access-gvhm4\") on node \"ip-10-0-140-201.ec2.internal\" DevicePath \"\""
Jul 14 20:31:59.908927 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:31:59.908687    2579 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/286ebc6d-c191-4f5d-b996-8525a48f8710-istio-data\") on node \"ip-10-0-140-201.ec2.internal\" DevicePath \"\""
Jul 14 20:31:59.908927 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:31:59.908698    2579 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/286ebc6d-c191-4f5d-b996-8525a48f8710-istio-token\") on node \"ip-10-0-140-201.ec2.internal\" DevicePath \"\""
Jul 14 20:31:59.908927 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:31:59.908708    2579 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/286ebc6d-c191-4f5d-b996-8525a48f8710-istio-podinfo\") on node \"ip-10-0-140-201.ec2.internal\" DevicePath \"\""
Jul 14 20:32:00.761476 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:32:00.761444    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-16b455-openshift-default-7b6fbf9745-6ffr8"
Jul 14 20:32:00.799936 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:32:00.799901    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-16b455-openshift-default-7b6fbf9745-6ffr8"]
Jul 14 20:32:00.804983 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:32:00.804956    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-a-16b455-openshift-default-7b6fbf9745-6ffr8"]
Jul 14 20:32:00.848377 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:32:00.848337    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="286ebc6d-c191-4f5d-b996-8525a48f8710" path="/var/lib/kubelet/pods/286ebc6d-c191-4f5d-b996-8525a48f8710/volumes"
Jul 14 20:32:20.814340 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:32:20.814257    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-ad0405-openshift-default-588fc97c7-29r4k"]
Jul 14 20:32:20.814920 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:32:20.814475    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-api-b-ad0405-openshift-default-588fc97c7-29r4k" podUID="b3d9e4b3-2528-47c0-897f-92873c79ad8b" containerName="istio-proxy" containerID="cri-o://149d65c32b929eb4ab7d231b7ae5fb8246d620e9c670068825dc5ce63d921add" gracePeriod=30
Jul 14 20:32:21.870551 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:32:21.870497    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-a-e55cd3-openshift-default-75f4c4c8bc-dhwrs"]
Jul 14 20:32:21.871086 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:32:21.871067    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="286ebc6d-c191-4f5d-b996-8525a48f8710" containerName="istio-proxy"
Jul 14 20:32:21.871175 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:32:21.871089    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="286ebc6d-c191-4f5d-b996-8525a48f8710" containerName="istio-proxy"
Jul 14 20:32:21.871236 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:32:21.871210    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="286ebc6d-c191-4f5d-b996-8525a48f8710" containerName="istio-proxy"
Jul 14 20:32:21.871236 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:32:21.871226    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="286ebc6d-c191-4f5d-b996-8525a48f8710" containerName="istio-proxy"
Jul 14 20:32:21.874395 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:32:21.874373    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-e55cd3-openshift-default-75f4c4c8bc-dhwrs"
Jul 14 20:32:21.878978 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:32:21.878950    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-a-e55cd3-openshift-default-dockercfg-jwls5\""
Jul 14 20:32:21.889687 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:32:21.889656    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-e55cd3-openshift-default-75f4c4c8bc-dhwrs"]
Jul 14 20:32:22.019681 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:32:22.019643    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a5bf9568-6633-4642-ad21-41e8c51f128a-workload-certs\") pod \"e2e-shared-a-e55cd3-openshift-default-75f4c4c8bc-dhwrs\" (UID: \"a5bf9568-6633-4642-ad21-41e8c51f128a\") " pod="openshift-ingress/e2e-shared-a-e55cd3-openshift-default-75f4c4c8bc-dhwrs"
Jul 14 20:32:22.019849 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:32:22.019689    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a5bf9568-6633-4642-ad21-41e8c51f128a-istiod-ca-cert\") pod \"e2e-shared-a-e55cd3-openshift-default-75f4c4c8bc-dhwrs\" (UID: \"a5bf9568-6633-4642-ad21-41e8c51f128a\") " pod="openshift-ingress/e2e-shared-a-e55cd3-openshift-default-75f4c4c8bc-dhwrs"
Jul 14 20:32:22.019849 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:32:22.019753    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a5bf9568-6633-4642-ad21-41e8c51f128a-credential-socket\") pod \"e2e-shared-a-e55cd3-openshift-default-75f4c4c8bc-dhwrs\" (UID: \"a5bf9568-6633-4642-ad21-41e8c51f128a\") " pod="openshift-ingress/e2e-shared-a-e55cd3-openshift-default-75f4c4c8bc-dhwrs"
Jul 14 20:32:22.019849 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:32:22.019801    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a5bf9568-6633-4642-ad21-41e8c51f128a-istio-envoy\") pod \"e2e-shared-a-e55cd3-openshift-default-75f4c4c8bc-dhwrs\" (UID: \"a5bf9568-6633-4642-ad21-41e8c51f128a\") " pod="openshift-ingress/e2e-shared-a-e55cd3-openshift-default-75f4c4c8bc-dhwrs"
Jul 14 20:32:22.019849 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:32:22.019843    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-79wrq\" (UniqueName: \"kubernetes.io/projected/a5bf9568-6633-4642-ad21-41e8c51f128a-kube-api-access-79wrq\") pod \"e2e-shared-a-e55cd3-openshift-default-75f4c4c8bc-dhwrs\" (UID: \"a5bf9568-6633-4642-ad21-41e8c51f128a\") " pod="openshift-ingress/e2e-shared-a-e55cd3-openshift-default-75f4c4c8bc-dhwrs"
Jul 14 20:32:22.020062 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:32:22.019938    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a5bf9568-6633-4642-ad21-41e8c51f128a-istio-podinfo\") pod \"e2e-shared-a-e55cd3-openshift-default-75f4c4c8bc-dhwrs\" (UID: \"a5bf9568-6633-4642-ad21-41e8c51f128a\") " pod="openshift-ingress/e2e-shared-a-e55cd3-openshift-default-75f4c4c8bc-dhwrs"
Jul 14 20:32:22.020062 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:32:22.019984    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a5bf9568-6633-4642-ad21-41e8c51f128a-istio-data\") pod \"e2e-shared-a-e55cd3-openshift-default-75f4c4c8bc-dhwrs\" (UID: \"a5bf9568-6633-4642-ad21-41e8c51f128a\") " pod="openshift-ingress/e2e-shared-a-e55cd3-openshift-default-75f4c4c8bc-dhwrs"
Jul 14 20:32:22.020062 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:32:22.020041    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a5bf9568-6633-4642-ad21-41e8c51f128a-workload-socket\") pod \"e2e-shared-a-e55cd3-openshift-default-75f4c4c8bc-dhwrs\" (UID: \"a5bf9568-6633-4642-ad21-41e8c51f128a\") " pod="openshift-ingress/e2e-shared-a-e55cd3-openshift-default-75f4c4c8bc-dhwrs"
Jul 14 20:32:22.020215 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:32:22.020074    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a5bf9568-6633-4642-ad21-41e8c51f128a-istio-token\") pod \"e2e-shared-a-e55cd3-openshift-default-75f4c4c8bc-dhwrs\" (UID: \"a5bf9568-6633-4642-ad21-41e8c51f128a\") " pod="openshift-ingress/e2e-shared-a-e55cd3-openshift-default-75f4c4c8bc-dhwrs"
Jul 14 20:32:22.120938 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:32:22.120822    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a5bf9568-6633-4642-ad21-41e8c51f128a-workload-certs\") pod \"e2e-shared-a-e55cd3-openshift-default-75f4c4c8bc-dhwrs\" (UID: \"a5bf9568-6633-4642-ad21-41e8c51f128a\") " pod="openshift-ingress/e2e-shared-a-e55cd3-openshift-default-75f4c4c8bc-dhwrs"
Jul 14 20:32:22.120938 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:32:22.120888    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a5bf9568-6633-4642-ad21-41e8c51f128a-istiod-ca-cert\") pod \"e2e-shared-a-e55cd3-openshift-default-75f4c4c8bc-dhwrs\" (UID: \"a5bf9568-6633-4642-ad21-41e8c51f128a\") " pod="openshift-ingress/e2e-shared-a-e55cd3-openshift-default-75f4c4c8bc-dhwrs"
Jul 14 20:32:22.120938 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:32:22.120925    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a5bf9568-6633-4642-ad21-41e8c51f128a-credential-socket\") pod \"e2e-shared-a-e55cd3-openshift-default-75f4c4c8bc-dhwrs\" (UID: \"a5bf9568-6633-4642-ad21-41e8c51f128a\") " pod="openshift-ingress/e2e-shared-a-e55cd3-openshift-default-75f4c4c8bc-dhwrs"
Jul 14 20:32:22.121234 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:32:22.120968    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a5bf9568-6633-4642-ad21-41e8c51f128a-istio-envoy\") pod \"e2e-shared-a-e55cd3-openshift-default-75f4c4c8bc-dhwrs\" (UID: \"a5bf9568-6633-4642-ad21-41e8c51f128a\") " pod="openshift-ingress/e2e-shared-a-e55cd3-openshift-default-75f4c4c8bc-dhwrs"
Jul 14 20:32:22.121234 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:32:22.121027    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-79wrq\" (UniqueName: \"kubernetes.io/projected/a5bf9568-6633-4642-ad21-41e8c51f128a-kube-api-access-79wrq\") pod \"e2e-shared-a-e55cd3-openshift-default-75f4c4c8bc-dhwrs\" (UID: \"a5bf9568-6633-4642-ad21-41e8c51f128a\") " pod="openshift-ingress/e2e-shared-a-e55cd3-openshift-default-75f4c4c8bc-dhwrs"
Jul 14 20:32:22.121234 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:32:22.121074    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a5bf9568-6633-4642-ad21-41e8c51f128a-istio-podinfo\") pod \"e2e-shared-a-e55cd3-openshift-default-75f4c4c8bc-dhwrs\" (UID: \"a5bf9568-6633-4642-ad21-41e8c51f128a\") " pod="openshift-ingress/e2e-shared-a-e55cd3-openshift-default-75f4c4c8bc-dhwrs"
Jul 14 20:32:22.121234 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:32:22.121196    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a5bf9568-6633-4642-ad21-41e8c51f128a-istio-data\") pod \"e2e-shared-a-e55cd3-openshift-default-75f4c4c8bc-dhwrs\" (UID: \"a5bf9568-6633-4642-ad21-41e8c51f128a\") " pod="openshift-ingress/e2e-shared-a-e55cd3-openshift-default-75f4c4c8bc-dhwrs"
Jul 14 20:32:22.121443 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:32:22.121247    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a5bf9568-6633-4642-ad21-41e8c51f128a-workload-socket\") pod \"e2e-shared-a-e55cd3-openshift-default-75f4c4c8bc-dhwrs\" (UID: \"a5bf9568-6633-4642-ad21-41e8c51f128a\") " pod="openshift-ingress/e2e-shared-a-e55cd3-openshift-default-75f4c4c8bc-dhwrs"
Jul 14 20:32:22.121443 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:32:22.121281    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a5bf9568-6633-4642-ad21-41e8c51f128a-istio-token\") pod \"e2e-shared-a-e55cd3-openshift-default-75f4c4c8bc-dhwrs\" (UID: \"a5bf9568-6633-4642-ad21-41e8c51f128a\") " pod="openshift-ingress/e2e-shared-a-e55cd3-openshift-default-75f4c4c8bc-dhwrs"
Jul 14 20:32:22.121443 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:32:22.121334    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a5bf9568-6633-4642-ad21-41e8c51f128a-workload-certs\") pod \"e2e-shared-a-e55cd3-openshift-default-75f4c4c8bc-dhwrs\" (UID: \"a5bf9568-6633-4642-ad21-41e8c51f128a\") " pod="openshift-ingress/e2e-shared-a-e55cd3-openshift-default-75f4c4c8bc-dhwrs"
Jul 14 20:32:22.121443 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:32:22.121368    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a5bf9568-6633-4642-ad21-41e8c51f128a-credential-socket\") pod \"e2e-shared-a-e55cd3-openshift-default-75f4c4c8bc-dhwrs\" (UID: \"a5bf9568-6633-4642-ad21-41e8c51f128a\") " pod="openshift-ingress/e2e-shared-a-e55cd3-openshift-default-75f4c4c8bc-dhwrs"
Jul 14 20:32:22.121698 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:32:22.121677    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a5bf9568-6633-4642-ad21-41e8c51f128a-workload-socket\") pod \"e2e-shared-a-e55cd3-openshift-default-75f4c4c8bc-dhwrs\" (UID: \"a5bf9568-6633-4642-ad21-41e8c51f128a\") " pod="openshift-ingress/e2e-shared-a-e55cd3-openshift-default-75f4c4c8bc-dhwrs"
Jul 14 20:32:22.121799 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:32:22.121776    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a5bf9568-6633-4642-ad21-41e8c51f128a-istio-data\") pod \"e2e-shared-a-e55cd3-openshift-default-75f4c4c8bc-dhwrs\" (UID: \"a5bf9568-6633-4642-ad21-41e8c51f128a\") " pod="openshift-ingress/e2e-shared-a-e55cd3-openshift-default-75f4c4c8bc-dhwrs"
Jul 14 20:32:22.122174 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:32:22.122151    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a5bf9568-6633-4642-ad21-41e8c51f128a-istiod-ca-cert\") pod \"e2e-shared-a-e55cd3-openshift-default-75f4c4c8bc-dhwrs\" (UID: \"a5bf9568-6633-4642-ad21-41e8c51f128a\") " pod="openshift-ingress/e2e-shared-a-e55cd3-openshift-default-75f4c4c8bc-dhwrs"
Jul 14 20:32:22.123653 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:32:22.123628    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a5bf9568-6633-4642-ad21-41e8c51f128a-istio-envoy\") pod \"e2e-shared-a-e55cd3-openshift-default-75f4c4c8bc-dhwrs\" (UID: \"a5bf9568-6633-4642-ad21-41e8c51f128a\") " pod="openshift-ingress/e2e-shared-a-e55cd3-openshift-default-75f4c4c8bc-dhwrs"
Jul 14 20:32:22.124079 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:32:22.124057    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a5bf9568-6633-4642-ad21-41e8c51f128a-istio-podinfo\") pod \"e2e-shared-a-e55cd3-openshift-default-75f4c4c8bc-dhwrs\" (UID: \"a5bf9568-6633-4642-ad21-41e8c51f128a\") " pod="openshift-ingress/e2e-shared-a-e55cd3-openshift-default-75f4c4c8bc-dhwrs"
Jul 14 20:32:22.130976 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:32:22.130945    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a5bf9568-6633-4642-ad21-41e8c51f128a-istio-token\") pod \"e2e-shared-a-e55cd3-openshift-default-75f4c4c8bc-dhwrs\" (UID: \"a5bf9568-6633-4642-ad21-41e8c51f128a\") " pod="openshift-ingress/e2e-shared-a-e55cd3-openshift-default-75f4c4c8bc-dhwrs"
Jul 14 20:32:22.131116 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:32:22.131092    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-79wrq\" (UniqueName: \"kubernetes.io/projected/a5bf9568-6633-4642-ad21-41e8c51f128a-kube-api-access-79wrq\") pod \"e2e-shared-a-e55cd3-openshift-default-75f4c4c8bc-dhwrs\" (UID: \"a5bf9568-6633-4642-ad21-41e8c51f128a\") " pod="openshift-ingress/e2e-shared-a-e55cd3-openshift-default-75f4c4c8bc-dhwrs"
Jul 14 20:32:22.185296 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:32:22.185252    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-e55cd3-openshift-default-75f4c4c8bc-dhwrs"
Jul 14 20:32:22.341879 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:32:22.341848    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-e55cd3-openshift-default-75f4c4c8bc-dhwrs"]
Jul 14 20:32:22.342981 ip-10-0-140-201 kubenswrapper[2579]: W0714 20:32:22.342937    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda5bf9568_6633_4642_ad21_41e8c51f128a.slice/crio-4c44cc3755ea11b5330528b48f736482eed7a78242f89dd38ca6022bed7af5a6 WatchSource:0}: Error finding container 4c44cc3755ea11b5330528b48f736482eed7a78242f89dd38ca6022bed7af5a6: Status 404 returned error can't find the container with id 4c44cc3755ea11b5330528b48f736482eed7a78242f89dd38ca6022bed7af5a6
Jul 14 20:32:22.345137 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:32:22.345104    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 14 20:32:22.345240 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:32:22.345194    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 14 20:32:22.345307 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:32:22.345236    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 14 20:32:22.894855 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:32:22.894816    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-e55cd3-openshift-default-75f4c4c8bc-dhwrs" event={"ID":"a5bf9568-6633-4642-ad21-41e8c51f128a","Type":"ContainerStarted","Data":"abc13328530427038bae838bdd394556279d9eade28431081e9cb5a80e41f8bb"}
Jul 14 20:32:22.895265 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:32:22.894877    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-e55cd3-openshift-default-75f4c4c8bc-dhwrs" event={"ID":"a5bf9568-6633-4642-ad21-41e8c51f128a","Type":"ContainerStarted","Data":"4c44cc3755ea11b5330528b48f736482eed7a78242f89dd38ca6022bed7af5a6"}
Jul 14 20:32:22.925229 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:32:22.925179    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-a-e55cd3-openshift-default-75f4c4c8bc-dhwrs" podStartSLOduration=1.925159693 podStartE2EDuration="1.925159693s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 20:32:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 20:32:22.922713376 +0000 UTC m=+2442.634308913" watchObservedRunningTime="2026-07-14 20:32:22.925159693 +0000 UTC m=+2442.636755237"
Jul 14 20:32:23.186564 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:32:23.186444    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-e55cd3-openshift-default-75f4c4c8bc-dhwrs"
Jul 14 20:32:23.191404 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:32:23.191373    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-e55cd3-openshift-default-75f4c4c8bc-dhwrs"
Jul 14 20:32:23.353413 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:32:23.353375    2579 patch_prober.go:28] interesting pod/e2e-api-b-ad0405-openshift-default-588fc97c7-29r4k container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 14 20:32:23.353594 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:32:23.353442    2579 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-b-ad0405-openshift-default-588fc97c7-29r4k" podUID="b3d9e4b3-2528-47c0-897f-92873c79ad8b" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 14 20:32:23.900862 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:32:23.900819    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-e55cd3-openshift-default-75f4c4c8bc-dhwrs"
Jul 14 20:32:23.901723 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:32:23.901706    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-e55cd3-openshift-default-75f4c4c8bc-dhwrs"
Jul 14 20:32:26.081946 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:32:26.081867    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-ad0405-openshift-default-588fc97c7-29r4k"
Jul 14 20:32:26.164515 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:32:26.164468    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b3d9e4b3-2528-47c0-897f-92873c79ad8b-istio-podinfo\") pod \"b3d9e4b3-2528-47c0-897f-92873c79ad8b\" (UID: \"b3d9e4b3-2528-47c0-897f-92873c79ad8b\") "
Jul 14 20:32:26.164515 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:32:26.164514    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b3d9e4b3-2528-47c0-897f-92873c79ad8b-istio-data\") pod \"b3d9e4b3-2528-47c0-897f-92873c79ad8b\" (UID: \"b3d9e4b3-2528-47c0-897f-92873c79ad8b\") "
Jul 14 20:32:26.164892 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:32:26.164588    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b3d9e4b3-2528-47c0-897f-92873c79ad8b-istio-token\") pod \"b3d9e4b3-2528-47c0-897f-92873c79ad8b\" (UID: \"b3d9e4b3-2528-47c0-897f-92873c79ad8b\") "
Jul 14 20:32:26.164892 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:32:26.164627    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b3d9e4b3-2528-47c0-897f-92873c79ad8b-istio-envoy\") pod \"b3d9e4b3-2528-47c0-897f-92873c79ad8b\" (UID: \"b3d9e4b3-2528-47c0-897f-92873c79ad8b\") "
Jul 14 20:32:26.164892 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:32:26.164649    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b3d9e4b3-2528-47c0-897f-92873c79ad8b-istiod-ca-cert\") pod \"b3d9e4b3-2528-47c0-897f-92873c79ad8b\" (UID: \"b3d9e4b3-2528-47c0-897f-92873c79ad8b\") "
Jul 14 20:32:26.164892 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:32:26.164691    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b3d9e4b3-2528-47c0-897f-92873c79ad8b-workload-socket\") pod \"b3d9e4b3-2528-47c0-897f-92873c79ad8b\" (UID: \"b3d9e4b3-2528-47c0-897f-92873c79ad8b\") "
Jul 14 20:32:26.164892 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:32:26.164752    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b3d9e4b3-2528-47c0-897f-92873c79ad8b-credential-socket\") pod \"b3d9e4b3-2528-47c0-897f-92873c79ad8b\" (UID: \"b3d9e4b3-2528-47c0-897f-92873c79ad8b\") "
Jul 14 20:32:26.164892 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:32:26.164777    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b3d9e4b3-2528-47c0-897f-92873c79ad8b-workload-certs\") pod \"b3d9e4b3-2528-47c0-897f-92873c79ad8b\" (UID: \"b3d9e4b3-2528-47c0-897f-92873c79ad8b\") "
Jul 14 20:32:26.164892 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:32:26.164800    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qtjqh\" (UniqueName: \"kubernetes.io/projected/b3d9e4b3-2528-47c0-897f-92873c79ad8b-kube-api-access-qtjqh\") pod \"b3d9e4b3-2528-47c0-897f-92873c79ad8b\" (UID: \"b3d9e4b3-2528-47c0-897f-92873c79ad8b\") "
Jul 14 20:32:26.165254 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:32:26.164963    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b3d9e4b3-2528-47c0-897f-92873c79ad8b-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "b3d9e4b3-2528-47c0-897f-92873c79ad8b" (UID: "b3d9e4b3-2528-47c0-897f-92873c79ad8b"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 20:32:26.165254 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:32:26.165118    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b3d9e4b3-2528-47c0-897f-92873c79ad8b-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "b3d9e4b3-2528-47c0-897f-92873c79ad8b" (UID: "b3d9e4b3-2528-47c0-897f-92873c79ad8b"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 14 20:32:26.165254 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:32:26.165130    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b3d9e4b3-2528-47c0-897f-92873c79ad8b-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "b3d9e4b3-2528-47c0-897f-92873c79ad8b" (UID: "b3d9e4b3-2528-47c0-897f-92873c79ad8b"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 20:32:26.165254 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:32:26.165218    2579 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b3d9e4b3-2528-47c0-897f-92873c79ad8b-workload-socket\") on node \"ip-10-0-140-201.ec2.internal\" DevicePath \"\""
Jul 14 20:32:26.165493 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:32:26.165378    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b3d9e4b3-2528-47c0-897f-92873c79ad8b-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "b3d9e4b3-2528-47c0-897f-92873c79ad8b" (UID: "b3d9e4b3-2528-47c0-897f-92873c79ad8b"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 20:32:26.165803 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:32:26.165777    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b3d9e4b3-2528-47c0-897f-92873c79ad8b-istio-data" (OuterVolumeSpecName: "istio-data") pod "b3d9e4b3-2528-47c0-897f-92873c79ad8b" (UID: "b3d9e4b3-2528-47c0-897f-92873c79ad8b"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 20:32:26.167015 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:32:26.166960    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/b3d9e4b3-2528-47c0-897f-92873c79ad8b-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "b3d9e4b3-2528-47c0-897f-92873c79ad8b" (UID: "b3d9e4b3-2528-47c0-897f-92873c79ad8b"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 14 20:32:26.167135 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:32:26.167063    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b3d9e4b3-2528-47c0-897f-92873c79ad8b-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "b3d9e4b3-2528-47c0-897f-92873c79ad8b" (UID: "b3d9e4b3-2528-47c0-897f-92873c79ad8b"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 20:32:26.167592 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:32:26.167565    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b3d9e4b3-2528-47c0-897f-92873c79ad8b-kube-api-access-qtjqh" (OuterVolumeSpecName: "kube-api-access-qtjqh") pod "b3d9e4b3-2528-47c0-897f-92873c79ad8b" (UID: "b3d9e4b3-2528-47c0-897f-92873c79ad8b"). InnerVolumeSpecName "kube-api-access-qtjqh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 14 20:32:26.167592 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:32:26.167578    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b3d9e4b3-2528-47c0-897f-92873c79ad8b-istio-token" (OuterVolumeSpecName: "istio-token") pod "b3d9e4b3-2528-47c0-897f-92873c79ad8b" (UID: "b3d9e4b3-2528-47c0-897f-92873c79ad8b"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 14 20:32:26.266364 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:32:26.266331    2579 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b3d9e4b3-2528-47c0-897f-92873c79ad8b-istio-envoy\") on node \"ip-10-0-140-201.ec2.internal\" DevicePath \"\""
Jul 14 20:32:26.266364 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:32:26.266362    2579 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b3d9e4b3-2528-47c0-897f-92873c79ad8b-istiod-ca-cert\") on node \"ip-10-0-140-201.ec2.internal\" DevicePath \"\""
Jul 14 20:32:26.266364 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:32:26.266371    2579 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b3d9e4b3-2528-47c0-897f-92873c79ad8b-credential-socket\") on node \"ip-10-0-140-201.ec2.internal\" DevicePath \"\""
Jul 14 20:32:26.266652 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:32:26.266380    2579 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b3d9e4b3-2528-47c0-897f-92873c79ad8b-workload-certs\") on node \"ip-10-0-140-201.ec2.internal\" DevicePath \"\""
Jul 14 20:32:26.266652 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:32:26.266391    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qtjqh\" (UniqueName: \"kubernetes.io/projected/b3d9e4b3-2528-47c0-897f-92873c79ad8b-kube-api-access-qtjqh\") on node \"ip-10-0-140-201.ec2.internal\" DevicePath \"\""
Jul 14 20:32:26.266652 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:32:26.266400    2579 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b3d9e4b3-2528-47c0-897f-92873c79ad8b-istio-podinfo\") on node \"ip-10-0-140-201.ec2.internal\" DevicePath \"\""
Jul 14 20:32:26.266652 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:32:26.266407    2579 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b3d9e4b3-2528-47c0-897f-92873c79ad8b-istio-data\") on node \"ip-10-0-140-201.ec2.internal\" DevicePath \"\""
Jul 14 20:32:26.266652 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:32:26.266415    2579 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b3d9e4b3-2528-47c0-897f-92873c79ad8b-istio-token\") on node \"ip-10-0-140-201.ec2.internal\" DevicePath \"\""
Jul 14 20:32:26.918761 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:32:26.918725    2579 generic.go:356] "Generic (PLEG): container finished" podID="b3d9e4b3-2528-47c0-897f-92873c79ad8b" containerID="149d65c32b929eb4ab7d231b7ae5fb8246d620e9c670068825dc5ce63d921add" exitCode=0
Jul 14 20:32:26.918972 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:32:26.918777    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-ad0405-openshift-default-588fc97c7-29r4k"
Jul 14 20:32:26.918972 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:32:26.918819    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-ad0405-openshift-default-588fc97c7-29r4k" event={"ID":"b3d9e4b3-2528-47c0-897f-92873c79ad8b","Type":"ContainerDied","Data":"149d65c32b929eb4ab7d231b7ae5fb8246d620e9c670068825dc5ce63d921add"}
Jul 14 20:32:26.918972 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:32:26.918880    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-ad0405-openshift-default-588fc97c7-29r4k" event={"ID":"b3d9e4b3-2528-47c0-897f-92873c79ad8b","Type":"ContainerDied","Data":"fa5f8a66c4cdc52af6895a23c72f35e680ff61466064c108bc10fac8d0b39f0e"}
Jul 14 20:32:26.918972 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:32:26.918917    2579 scope.go:117] "RemoveContainer" containerID="149d65c32b929eb4ab7d231b7ae5fb8246d620e9c670068825dc5ce63d921add"
Jul 14 20:32:26.929053 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:32:26.929033    2579 scope.go:117] "RemoveContainer" containerID="a9d02ddaa8dba1d2f97b181ebb5464e1e9f49375b085431c6b199ee616cbf862"
Jul 14 20:32:26.939520 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:32:26.939119    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-ad0405-openshift-default-588fc97c7-29r4k"]
Jul 14 20:32:26.939520 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:32:26.939368    2579 scope.go:117] "RemoveContainer" containerID="149d65c32b929eb4ab7d231b7ae5fb8246d620e9c670068825dc5ce63d921add"
Jul 14 20:32:26.939806 ip-10-0-140-201 kubenswrapper[2579]: E0714 20:32:26.939763    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"149d65c32b929eb4ab7d231b7ae5fb8246d620e9c670068825dc5ce63d921add\": container with ID starting with 149d65c32b929eb4ab7d231b7ae5fb8246d620e9c670068825dc5ce63d921add not found: ID does not exist" containerID="149d65c32b929eb4ab7d231b7ae5fb8246d620e9c670068825dc5ce63d921add"
Jul 14 20:32:26.939938 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:32:26.939808    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"149d65c32b929eb4ab7d231b7ae5fb8246d620e9c670068825dc5ce63d921add"} err="failed to get container status \"149d65c32b929eb4ab7d231b7ae5fb8246d620e9c670068825dc5ce63d921add\": rpc error: code = NotFound desc = could not find container \"149d65c32b929eb4ab7d231b7ae5fb8246d620e9c670068825dc5ce63d921add\": container with ID starting with 149d65c32b929eb4ab7d231b7ae5fb8246d620e9c670068825dc5ce63d921add not found: ID does not exist"
Jul 14 20:32:26.939938 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:32:26.939837    2579 scope.go:117] "RemoveContainer" containerID="a9d02ddaa8dba1d2f97b181ebb5464e1e9f49375b085431c6b199ee616cbf862"
Jul 14 20:32:26.940171 ip-10-0-140-201 kubenswrapper[2579]: E0714 20:32:26.940147    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a9d02ddaa8dba1d2f97b181ebb5464e1e9f49375b085431c6b199ee616cbf862\": container with ID starting with a9d02ddaa8dba1d2f97b181ebb5464e1e9f49375b085431c6b199ee616cbf862 not found: ID does not exist" containerID="a9d02ddaa8dba1d2f97b181ebb5464e1e9f49375b085431c6b199ee616cbf862"
Jul 14 20:32:26.940252 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:32:26.940179    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a9d02ddaa8dba1d2f97b181ebb5464e1e9f49375b085431c6b199ee616cbf862"} err="failed to get container status \"a9d02ddaa8dba1d2f97b181ebb5464e1e9f49375b085431c6b199ee616cbf862\": rpc error: code = NotFound desc = could not find container \"a9d02ddaa8dba1d2f97b181ebb5464e1e9f49375b085431c6b199ee616cbf862\": container with ID starting with a9d02ddaa8dba1d2f97b181ebb5464e1e9f49375b085431c6b199ee616cbf862 not found: ID does not exist"
Jul 14 20:32:26.942376 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:32:26.942357    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-b-ad0405-openshift-default-588fc97c7-29r4k"]
Jul 14 20:32:28.848999 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:32:28.848962    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b3d9e4b3-2528-47c0-897f-92873c79ad8b" path="/var/lib/kubelet/pods/b3d9e4b3-2528-47c0-897f-92873c79ad8b/volumes"
Jul 14 20:32:30.274986 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:32:30.274944    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-b-d4143c-openshift-default-6d77988bf5-p9xjr"]
Jul 14 20:32:30.275497 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:32:30.275480    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b3d9e4b3-2528-47c0-897f-92873c79ad8b" containerName="istio-proxy"
Jul 14 20:32:30.275497 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:32:30.275498    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="b3d9e4b3-2528-47c0-897f-92873c79ad8b" containerName="istio-proxy"
Jul 14 20:32:30.275701 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:32:30.275511    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b3d9e4b3-2528-47c0-897f-92873c79ad8b" containerName="istio-proxy"
Jul 14 20:32:30.275701 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:32:30.275521    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="b3d9e4b3-2528-47c0-897f-92873c79ad8b" containerName="istio-proxy"
Jul 14 20:32:30.275701 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:32:30.275564    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="286ebc6d-c191-4f5d-b996-8525a48f8710" containerName="istio-proxy"
Jul 14 20:32:30.275701 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:32:30.275574    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="286ebc6d-c191-4f5d-b996-8525a48f8710" containerName="istio-proxy"
Jul 14 20:32:30.275701 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:32:30.275674    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="b3d9e4b3-2528-47c0-897f-92873c79ad8b" containerName="istio-proxy"
Jul 14 20:32:30.275701 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:32:30.275686    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="b3d9e4b3-2528-47c0-897f-92873c79ad8b" containerName="istio-proxy"
Jul 14 20:32:30.280593 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:32:30.280563    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-d4143c-openshift-default-6d77988bf5-p9xjr"
Jul 14 20:32:30.284751 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:32:30.284725    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-b-d4143c-openshift-default-dockercfg-dlp4w\""
Jul 14 20:32:30.302567 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:32:30.302514    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-d4143c-openshift-default-6d77988bf5-p9xjr"]
Jul 14 20:32:30.408418 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:32:30.408372    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a18d9fcf-77a6-4643-9cae-f5992d933fe7-istio-data\") pod \"e2e-shared-b-d4143c-openshift-default-6d77988bf5-p9xjr\" (UID: \"a18d9fcf-77a6-4643-9cae-f5992d933fe7\") " pod="openshift-ingress/e2e-shared-b-d4143c-openshift-default-6d77988bf5-p9xjr"
Jul 14 20:32:30.408737 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:32:30.408713    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bwwph\" (UniqueName: \"kubernetes.io/projected/a18d9fcf-77a6-4643-9cae-f5992d933fe7-kube-api-access-bwwph\") pod \"e2e-shared-b-d4143c-openshift-default-6d77988bf5-p9xjr\" (UID: \"a18d9fcf-77a6-4643-9cae-f5992d933fe7\") " pod="openshift-ingress/e2e-shared-b-d4143c-openshift-default-6d77988bf5-p9xjr"
Jul 14 20:32:30.408892 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:32:30.408877    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a18d9fcf-77a6-4643-9cae-f5992d933fe7-workload-certs\") pod \"e2e-shared-b-d4143c-openshift-default-6d77988bf5-p9xjr\" (UID: \"a18d9fcf-77a6-4643-9cae-f5992d933fe7\") " pod="openshift-ingress/e2e-shared-b-d4143c-openshift-default-6d77988bf5-p9xjr"
Jul 14 20:32:30.409033 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:32:30.409019    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a18d9fcf-77a6-4643-9cae-f5992d933fe7-istio-podinfo\") pod \"e2e-shared-b-d4143c-openshift-default-6d77988bf5-p9xjr\" (UID: \"a18d9fcf-77a6-4643-9cae-f5992d933fe7\") " pod="openshift-ingress/e2e-shared-b-d4143c-openshift-default-6d77988bf5-p9xjr"
Jul 14 20:32:30.409201 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:32:30.409182    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a18d9fcf-77a6-4643-9cae-f5992d933fe7-istio-envoy\") pod \"e2e-shared-b-d4143c-openshift-default-6d77988bf5-p9xjr\" (UID: \"a18d9fcf-77a6-4643-9cae-f5992d933fe7\") " pod="openshift-ingress/e2e-shared-b-d4143c-openshift-default-6d77988bf5-p9xjr"
Jul 14 20:32:30.409356 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:32:30.409341    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a18d9fcf-77a6-4643-9cae-f5992d933fe7-workload-socket\") pod \"e2e-shared-b-d4143c-openshift-default-6d77988bf5-p9xjr\" (UID: \"a18d9fcf-77a6-4643-9cae-f5992d933fe7\") " pod="openshift-ingress/e2e-shared-b-d4143c-openshift-default-6d77988bf5-p9xjr"
Jul 14 20:32:30.409488 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:32:30.409474    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a18d9fcf-77a6-4643-9cae-f5992d933fe7-istio-token\") pod \"e2e-shared-b-d4143c-openshift-default-6d77988bf5-p9xjr\" (UID: \"a18d9fcf-77a6-4643-9cae-f5992d933fe7\") " pod="openshift-ingress/e2e-shared-b-d4143c-openshift-default-6d77988bf5-p9xjr"
Jul 14 20:32:30.409654 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:32:30.409635    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a18d9fcf-77a6-4643-9cae-f5992d933fe7-istiod-ca-cert\") pod \"e2e-shared-b-d4143c-openshift-default-6d77988bf5-p9xjr\" (UID: \"a18d9fcf-77a6-4643-9cae-f5992d933fe7\") " pod="openshift-ingress/e2e-shared-b-d4143c-openshift-default-6d77988bf5-p9xjr"
Jul 14 20:32:30.409773 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:32:30.409759    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a18d9fcf-77a6-4643-9cae-f5992d933fe7-credential-socket\") pod \"e2e-shared-b-d4143c-openshift-default-6d77988bf5-p9xjr\" (UID: \"a18d9fcf-77a6-4643-9cae-f5992d933fe7\") " pod="openshift-ingress/e2e-shared-b-d4143c-openshift-default-6d77988bf5-p9xjr"
Jul 14 20:32:30.511253 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:32:30.511204    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a18d9fcf-77a6-4643-9cae-f5992d933fe7-istio-envoy\") pod \"e2e-shared-b-d4143c-openshift-default-6d77988bf5-p9xjr\" (UID: \"a18d9fcf-77a6-4643-9cae-f5992d933fe7\") " pod="openshift-ingress/e2e-shared-b-d4143c-openshift-default-6d77988bf5-p9xjr"
Jul 14 20:32:30.511253 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:32:30.511260    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a18d9fcf-77a6-4643-9cae-f5992d933fe7-workload-socket\") pod \"e2e-shared-b-d4143c-openshift-default-6d77988bf5-p9xjr\" (UID: \"a18d9fcf-77a6-4643-9cae-f5992d933fe7\") " pod="openshift-ingress/e2e-shared-b-d4143c-openshift-default-6d77988bf5-p9xjr"
Jul 14 20:32:30.511520 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:32:30.511295    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a18d9fcf-77a6-4643-9cae-f5992d933fe7-istio-token\") pod \"e2e-shared-b-d4143c-openshift-default-6d77988bf5-p9xjr\" (UID: \"a18d9fcf-77a6-4643-9cae-f5992d933fe7\") " pod="openshift-ingress/e2e-shared-b-d4143c-openshift-default-6d77988bf5-p9xjr"
Jul 14 20:32:30.511520 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:32:30.511315    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a18d9fcf-77a6-4643-9cae-f5992d933fe7-istiod-ca-cert\") pod \"e2e-shared-b-d4143c-openshift-default-6d77988bf5-p9xjr\" (UID: \"a18d9fcf-77a6-4643-9cae-f5992d933fe7\") " pod="openshift-ingress/e2e-shared-b-d4143c-openshift-default-6d77988bf5-p9xjr"
Jul 14 20:32:30.511520 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:32:30.511335    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a18d9fcf-77a6-4643-9cae-f5992d933fe7-credential-socket\") pod \"e2e-shared-b-d4143c-openshift-default-6d77988bf5-p9xjr\" (UID: \"a18d9fcf-77a6-4643-9cae-f5992d933fe7\") " pod="openshift-ingress/e2e-shared-b-d4143c-openshift-default-6d77988bf5-p9xjr"
Jul 14 20:32:30.511520 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:32:30.511403    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a18d9fcf-77a6-4643-9cae-f5992d933fe7-istio-data\") pod \"e2e-shared-b-d4143c-openshift-default-6d77988bf5-p9xjr\" (UID: \"a18d9fcf-77a6-4643-9cae-f5992d933fe7\") " pod="openshift-ingress/e2e-shared-b-d4143c-openshift-default-6d77988bf5-p9xjr"
Jul 14 20:32:30.511520 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:32:30.511432    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bwwph\" (UniqueName: \"kubernetes.io/projected/a18d9fcf-77a6-4643-9cae-f5992d933fe7-kube-api-access-bwwph\") pod \"e2e-shared-b-d4143c-openshift-default-6d77988bf5-p9xjr\" (UID: \"a18d9fcf-77a6-4643-9cae-f5992d933fe7\") " pod="openshift-ingress/e2e-shared-b-d4143c-openshift-default-6d77988bf5-p9xjr"
Jul 14 20:32:30.511520 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:32:30.511463    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a18d9fcf-77a6-4643-9cae-f5992d933fe7-workload-certs\") pod \"e2e-shared-b-d4143c-openshift-default-6d77988bf5-p9xjr\" (UID: \"a18d9fcf-77a6-4643-9cae-f5992d933fe7\") " pod="openshift-ingress/e2e-shared-b-d4143c-openshift-default-6d77988bf5-p9xjr"
Jul 14 20:32:30.511520 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:32:30.511504    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a18d9fcf-77a6-4643-9cae-f5992d933fe7-istio-podinfo\") pod \"e2e-shared-b-d4143c-openshift-default-6d77988bf5-p9xjr\" (UID: \"a18d9fcf-77a6-4643-9cae-f5992d933fe7\") " pod="openshift-ingress/e2e-shared-b-d4143c-openshift-default-6d77988bf5-p9xjr"
Jul 14 20:32:30.511898 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:32:30.511788    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a18d9fcf-77a6-4643-9cae-f5992d933fe7-workload-socket\") pod \"e2e-shared-b-d4143c-openshift-default-6d77988bf5-p9xjr\" (UID: \"a18d9fcf-77a6-4643-9cae-f5992d933fe7\") " pod="openshift-ingress/e2e-shared-b-d4143c-openshift-default-6d77988bf5-p9xjr"
Jul 14 20:32:30.512144 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:32:30.512050    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a18d9fcf-77a6-4643-9cae-f5992d933fe7-istio-data\") pod \"e2e-shared-b-d4143c-openshift-default-6d77988bf5-p9xjr\" (UID: \"a18d9fcf-77a6-4643-9cae-f5992d933fe7\") " pod="openshift-ingress/e2e-shared-b-d4143c-openshift-default-6d77988bf5-p9xjr"
Jul 14 20:32:30.512144 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:32:30.512077    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a18d9fcf-77a6-4643-9cae-f5992d933fe7-istiod-ca-cert\") pod \"e2e-shared-b-d4143c-openshift-default-6d77988bf5-p9xjr\" (UID: \"a18d9fcf-77a6-4643-9cae-f5992d933fe7\") " pod="openshift-ingress/e2e-shared-b-d4143c-openshift-default-6d77988bf5-p9xjr"
Jul 14 20:32:30.512144 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:32:30.512110    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a18d9fcf-77a6-4643-9cae-f5992d933fe7-workload-certs\") pod \"e2e-shared-b-d4143c-openshift-default-6d77988bf5-p9xjr\" (UID: \"a18d9fcf-77a6-4643-9cae-f5992d933fe7\") " pod="openshift-ingress/e2e-shared-b-d4143c-openshift-default-6d77988bf5-p9xjr"
Jul 14 20:32:30.512279 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:32:30.512160    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a18d9fcf-77a6-4643-9cae-f5992d933fe7-credential-socket\") pod \"e2e-shared-b-d4143c-openshift-default-6d77988bf5-p9xjr\" (UID: \"a18d9fcf-77a6-4643-9cae-f5992d933fe7\") " pod="openshift-ingress/e2e-shared-b-d4143c-openshift-default-6d77988bf5-p9xjr"
Jul 14 20:32:30.513916 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:32:30.513895    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a18d9fcf-77a6-4643-9cae-f5992d933fe7-istio-envoy\") pod \"e2e-shared-b-d4143c-openshift-default-6d77988bf5-p9xjr\" (UID: \"a18d9fcf-77a6-4643-9cae-f5992d933fe7\") " pod="openshift-ingress/e2e-shared-b-d4143c-openshift-default-6d77988bf5-p9xjr"
Jul 14 20:32:30.514318 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:32:30.514301    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a18d9fcf-77a6-4643-9cae-f5992d933fe7-istio-podinfo\") pod \"e2e-shared-b-d4143c-openshift-default-6d77988bf5-p9xjr\" (UID: \"a18d9fcf-77a6-4643-9cae-f5992d933fe7\") " pod="openshift-ingress/e2e-shared-b-d4143c-openshift-default-6d77988bf5-p9xjr"
Jul 14 20:32:30.521145 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:32:30.521112    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a18d9fcf-77a6-4643-9cae-f5992d933fe7-istio-token\") pod \"e2e-shared-b-d4143c-openshift-default-6d77988bf5-p9xjr\" (UID: \"a18d9fcf-77a6-4643-9cae-f5992d933fe7\") " pod="openshift-ingress/e2e-shared-b-d4143c-openshift-default-6d77988bf5-p9xjr"
Jul 14 20:32:30.521253 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:32:30.521184    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bwwph\" (UniqueName: \"kubernetes.io/projected/a18d9fcf-77a6-4643-9cae-f5992d933fe7-kube-api-access-bwwph\") pod \"e2e-shared-b-d4143c-openshift-default-6d77988bf5-p9xjr\" (UID: \"a18d9fcf-77a6-4643-9cae-f5992d933fe7\") " pod="openshift-ingress/e2e-shared-b-d4143c-openshift-default-6d77988bf5-p9xjr"
Jul 14 20:32:30.592972 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:32:30.592871    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-d4143c-openshift-default-6d77988bf5-p9xjr"
Jul 14 20:32:30.766762 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:32:30.766734    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-d4143c-openshift-default-6d77988bf5-p9xjr"]
Jul 14 20:32:30.768259 ip-10-0-140-201 kubenswrapper[2579]: W0714 20:32:30.768233    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda18d9fcf_77a6_4643_9cae_f5992d933fe7.slice/crio-7da8222e2a06a7efa1a175c3a06253f77cc3d12376087737704bc442843371c1 WatchSource:0}: Error finding container 7da8222e2a06a7efa1a175c3a06253f77cc3d12376087737704bc442843371c1: Status 404 returned error can't find the container with id 7da8222e2a06a7efa1a175c3a06253f77cc3d12376087737704bc442843371c1
Jul 14 20:32:30.770815 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:32:30.770781    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 14 20:32:30.770884 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:32:30.770847    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 14 20:32:30.770884 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:32:30.770875    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 14 20:32:30.948163 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:32:30.948122    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-d4143c-openshift-default-6d77988bf5-p9xjr" event={"ID":"a18d9fcf-77a6-4643-9cae-f5992d933fe7","Type":"ContainerStarted","Data":"cedfed0bb377700dc59e2686a1d3770ab850600dab9ff79baa4beb9953f16988"}
Jul 14 20:32:30.948369 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:32:30.948189    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-d4143c-openshift-default-6d77988bf5-p9xjr" event={"ID":"a18d9fcf-77a6-4643-9cae-f5992d933fe7","Type":"ContainerStarted","Data":"7da8222e2a06a7efa1a175c3a06253f77cc3d12376087737704bc442843371c1"}
Jul 14 20:32:30.973086 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:32:30.973015    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-b-d4143c-openshift-default-6d77988bf5-p9xjr" podStartSLOduration=0.972993574 podStartE2EDuration="972.993574ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 20:32:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 20:32:30.969818257 +0000 UTC m=+2450.681413814" watchObservedRunningTime="2026-07-14 20:32:30.972993574 +0000 UTC m=+2450.684589122"
Jul 14 20:32:31.594433 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:32:31.594385    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-d4143c-openshift-default-6d77988bf5-p9xjr"
Jul 14 20:32:31.600123 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:32:31.600092    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-d4143c-openshift-default-6d77988bf5-p9xjr"
Jul 14 20:32:31.954577 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:32:31.954472    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-d4143c-openshift-default-6d77988bf5-p9xjr"
Jul 14 20:32:31.955432 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:32:31.955414    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-d4143c-openshift-default-6d77988bf5-p9xjr"
Jul 14 20:32:37.992480 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:32:37.992444    2579 generic.go:356] "Generic (PLEG): container finished" podID="a5bf9568-6633-4642-ad21-41e8c51f128a" containerID="abc13328530427038bae838bdd394556279d9eade28431081e9cb5a80e41f8bb" exitCode=0
Jul 14 20:32:37.992927 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:32:37.992517    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-e55cd3-openshift-default-75f4c4c8bc-dhwrs" event={"ID":"a5bf9568-6633-4642-ad21-41e8c51f128a","Type":"ContainerDied","Data":"abc13328530427038bae838bdd394556279d9eade28431081e9cb5a80e41f8bb"}
Jul 14 20:32:37.992982 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:32:37.992941    2579 scope.go:117] "RemoveContainer" containerID="abc13328530427038bae838bdd394556279d9eade28431081e9cb5a80e41f8bb"
Jul 14 20:32:37.994033 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:32:37.994008    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 14 20:32:37.994095 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:32:37.994079    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 14 20:32:37.994144 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:32:37.994126    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 14 20:32:38.900980 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:32:38.900938    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-e55cd3-openshift-default-75f4c4c8bc-dhwrs"
Jul 14 20:32:39.002328 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:32:39.002295    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-e55cd3-openshift-default-75f4c4c8bc-dhwrs" event={"ID":"a5bf9568-6633-4642-ad21-41e8c51f128a","Type":"ContainerStarted","Data":"88a0f42abada6fe98308ea726a57043de08c3adfd61ecb1bbd8f6d18a75ed039"}
Jul 14 20:32:39.187460 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:32:39.185976    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-e55cd3-openshift-default-75f4c4c8bc-dhwrs"
Jul 14 20:32:39.188170 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:32:39.187825    2579 patch_prober.go:28] interesting pod/e2e-shared-a-e55cd3-openshift-default-75f4c4c8bc-dhwrs container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.60:15021/healthz/ready\": dial tcp 10.133.0.60:15021: connect: connection refused" start-of-body=
Jul 14 20:32:39.188170 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:32:39.187903    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-e55cd3-openshift-default-75f4c4c8bc-dhwrs" podUID="a5bf9568-6633-4642-ad21-41e8c51f128a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.60:15021/healthz/ready\": dial tcp 10.133.0.60:15021: connect: connection refused"
Jul 14 20:32:40.185798 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:32:40.185750    2579 patch_prober.go:28] interesting pod/e2e-shared-a-e55cd3-openshift-default-75f4c4c8bc-dhwrs container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.60:15021/healthz/ready\": dial tcp 10.133.0.60:15021: connect: connection refused" start-of-body=
Jul 14 20:32:40.186329 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:32:40.185822    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-e55cd3-openshift-default-75f4c4c8bc-dhwrs" podUID="a5bf9568-6633-4642-ad21-41e8c51f128a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.60:15021/healthz/ready\": dial tcp 10.133.0.60:15021: connect: connection refused"
Jul 14 20:32:41.186797 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:32:41.186753    2579 patch_prober.go:28] interesting pod/e2e-shared-a-e55cd3-openshift-default-75f4c4c8bc-dhwrs container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.60:15021/healthz/ready\": dial tcp 10.133.0.60:15021: connect: connection refused" start-of-body=
Jul 14 20:32:41.187309 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:32:41.186845    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-e55cd3-openshift-default-75f4c4c8bc-dhwrs" podUID="a5bf9568-6633-4642-ad21-41e8c51f128a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.60:15021/healthz/ready\": dial tcp 10.133.0.60:15021: connect: connection refused"
Jul 14 20:32:42.185914 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:32:42.185858    2579 patch_prober.go:28] interesting pod/e2e-shared-a-e55cd3-openshift-default-75f4c4c8bc-dhwrs container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.60:15021/healthz/ready\": dial tcp 10.133.0.60:15021: connect: connection refused" start-of-body=
Jul 14 20:32:42.186142 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:32:42.185938    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-e55cd3-openshift-default-75f4c4c8bc-dhwrs" podUID="a5bf9568-6633-4642-ad21-41e8c51f128a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.60:15021/healthz/ready\": dial tcp 10.133.0.60:15021: connect: connection refused"
Jul 14 20:32:43.198386 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:32:43.198345    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-e55cd3-openshift-default-75f4c4c8bc-dhwrs"
Jul 14 20:32:43.198846 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:32:43.198650    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-e55cd3-openshift-default-75f4c4c8bc-dhwrs"
Jul 14 20:32:43.199478 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:32:43.199461    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-e55cd3-openshift-default-75f4c4c8bc-dhwrs"
Jul 14 20:32:47.996736 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:32:47.996691    2579 patch_prober.go:28] interesting pod/e2e-shared-b-d4143c-openshift-default-6d77988bf5-p9xjr container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.61:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Jul 14 20:32:47.997219 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:32:47.996765    2579 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-b-d4143c-openshift-default-6d77988bf5-p9xjr" podUID="a18d9fcf-77a6-4643-9cae-f5992d933fe7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.61:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Jul 14 20:32:49.070261 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:32:49.070228    2579 generic.go:356] "Generic (PLEG): container finished" podID="a18d9fcf-77a6-4643-9cae-f5992d933fe7" containerID="cedfed0bb377700dc59e2686a1d3770ab850600dab9ff79baa4beb9953f16988" exitCode=0
Jul 14 20:32:49.070724 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:32:49.070302    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-d4143c-openshift-default-6d77988bf5-p9xjr" event={"ID":"a18d9fcf-77a6-4643-9cae-f5992d933fe7","Type":"ContainerDied","Data":"cedfed0bb377700dc59e2686a1d3770ab850600dab9ff79baa4beb9953f16988"}
Jul 14 20:32:49.070775 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:32:49.070733    2579 scope.go:117] "RemoveContainer" containerID="cedfed0bb377700dc59e2686a1d3770ab850600dab9ff79baa4beb9953f16988"
Jul 14 20:32:49.071741 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:32:49.071718    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 14 20:32:49.071807 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:32:49.071794    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 14 20:32:49.071863 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:32:49.071851    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 14 20:32:50.081505 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:32:50.081455    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-d4143c-openshift-default-6d77988bf5-p9xjr" event={"ID":"a18d9fcf-77a6-4643-9cae-f5992d933fe7","Type":"ContainerStarted","Data":"42cdc3bc286df15b9ad741aa8885f2064e87030ba2781f60421ca0bee3ce0b81"}
Jul 14 20:32:50.594123 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:32:50.594088    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-d4143c-openshift-default-6d77988bf5-p9xjr"
Jul 14 20:32:50.594496 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:32:50.594469    2579 patch_prober.go:28] interesting pod/e2e-shared-b-d4143c-openshift-default-6d77988bf5-p9xjr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.61:15021/healthz/ready\": dial tcp 10.133.0.61:15021: connect: connection refused" start-of-body=
Jul 14 20:32:50.594708 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:32:50.594681    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-d4143c-openshift-default-6d77988bf5-p9xjr" podUID="a18d9fcf-77a6-4643-9cae-f5992d933fe7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.61:15021/healthz/ready\": dial tcp 10.133.0.61:15021: connect: connection refused"
Jul 14 20:32:51.594989 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:32:51.594939    2579 patch_prober.go:28] interesting pod/e2e-shared-b-d4143c-openshift-default-6d77988bf5-p9xjr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.61:15021/healthz/ready\": dial tcp 10.133.0.61:15021: connect: connection refused" start-of-body=
Jul 14 20:32:51.595647 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:32:51.595611    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-d4143c-openshift-default-6d77988bf5-p9xjr" podUID="a18d9fcf-77a6-4643-9cae-f5992d933fe7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.61:15021/healthz/ready\": dial tcp 10.133.0.61:15021: connect: connection refused"
Jul 14 20:32:52.594416 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:32:52.594375    2579 patch_prober.go:28] interesting pod/e2e-shared-b-d4143c-openshift-default-6d77988bf5-p9xjr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.61:15021/healthz/ready\": dial tcp 10.133.0.61:15021: connect: connection refused" start-of-body=
Jul 14 20:32:52.594786 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:32:52.594754    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-d4143c-openshift-default-6d77988bf5-p9xjr" podUID="a18d9fcf-77a6-4643-9cae-f5992d933fe7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.61:15021/healthz/ready\": dial tcp 10.133.0.61:15021: connect: connection refused"
Jul 14 20:32:53.594762 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:32:53.594710    2579 patch_prober.go:28] interesting pod/e2e-shared-b-d4143c-openshift-default-6d77988bf5-p9xjr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.61:15021/healthz/ready\": dial tcp 10.133.0.61:15021: connect: connection refused" start-of-body=
Jul 14 20:32:53.595282 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:32:53.594783    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-d4143c-openshift-default-6d77988bf5-p9xjr" podUID="a18d9fcf-77a6-4643-9cae-f5992d933fe7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.61:15021/healthz/ready\": dial tcp 10.133.0.61:15021: connect: connection refused"
Jul 14 20:32:54.598064 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:32:54.598031    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-d4143c-openshift-default-6d77988bf5-p9xjr"
Jul 14 20:32:54.598524 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:32:54.598312    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-d4143c-openshift-default-6d77988bf5-p9xjr"
Jul 14 20:32:54.599044 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:32:54.599028    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-d4143c-openshift-default-6d77988bf5-p9xjr"
Jul 14 20:36:41.035816 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:36:41.035783    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-q4xzw_ef54193c-7659-4e47-87ac-4d129d22a268/ovn-acl-logging/0.log"
Jul 14 20:36:41.044218 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:36:41.044196    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-q4xzw_ef54193c-7659-4e47-87ac-4d129d22a268/ovn-acl-logging/0.log"
Jul 14 20:37:41.146505 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:37:41.146470    2579 scope.go:117] "RemoveContainer" containerID="79bcf2dc0dba1e3a51841638e6f2d1116427f65141bef4bee63377449ab50906"
Jul 14 20:38:58.711481 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:38:58.711423    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-e55cd3-openshift-default-75f4c4c8bc-dhwrs"]
Jul 14 20:38:58.712461 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:38:58.712405    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-a-e55cd3-openshift-default-75f4c4c8bc-dhwrs" podUID="a5bf9568-6633-4642-ad21-41e8c51f128a" containerName="istio-proxy" containerID="cri-o://88a0f42abada6fe98308ea726a57043de08c3adfd61ecb1bbd8f6d18a75ed039" gracePeriod=30
Jul 14 20:39:03.959957 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:39:03.959932    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-e55cd3-openshift-default-75f4c4c8bc-dhwrs"
Jul 14 20:39:04.023974 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:39:04.023887    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-79wrq\" (UniqueName: \"kubernetes.io/projected/a5bf9568-6633-4642-ad21-41e8c51f128a-kube-api-access-79wrq\") pod \"a5bf9568-6633-4642-ad21-41e8c51f128a\" (UID: \"a5bf9568-6633-4642-ad21-41e8c51f128a\") "
Jul 14 20:39:04.023974 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:39:04.023932    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a5bf9568-6633-4642-ad21-41e8c51f128a-istio-token\") pod \"a5bf9568-6633-4642-ad21-41e8c51f128a\" (UID: \"a5bf9568-6633-4642-ad21-41e8c51f128a\") "
Jul 14 20:39:04.024200 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:39:04.023980    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a5bf9568-6633-4642-ad21-41e8c51f128a-istiod-ca-cert\") pod \"a5bf9568-6633-4642-ad21-41e8c51f128a\" (UID: \"a5bf9568-6633-4642-ad21-41e8c51f128a\") "
Jul 14 20:39:04.024200 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:39:04.024011    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a5bf9568-6633-4642-ad21-41e8c51f128a-istio-podinfo\") pod \"a5bf9568-6633-4642-ad21-41e8c51f128a\" (UID: \"a5bf9568-6633-4642-ad21-41e8c51f128a\") "
Jul 14 20:39:04.024200 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:39:04.024039    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a5bf9568-6633-4642-ad21-41e8c51f128a-istio-data\") pod \"a5bf9568-6633-4642-ad21-41e8c51f128a\" (UID: \"a5bf9568-6633-4642-ad21-41e8c51f128a\") "
Jul 14 20:39:04.024200 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:39:04.024067    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a5bf9568-6633-4642-ad21-41e8c51f128a-workload-certs\") pod \"a5bf9568-6633-4642-ad21-41e8c51f128a\" (UID: \"a5bf9568-6633-4642-ad21-41e8c51f128a\") "
Jul 14 20:39:04.024200 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:39:04.024086    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a5bf9568-6633-4642-ad21-41e8c51f128a-istio-envoy\") pod \"a5bf9568-6633-4642-ad21-41e8c51f128a\" (UID: \"a5bf9568-6633-4642-ad21-41e8c51f128a\") "
Jul 14 20:39:04.024200 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:39:04.024147    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a5bf9568-6633-4642-ad21-41e8c51f128a-credential-socket\") pod \"a5bf9568-6633-4642-ad21-41e8c51f128a\" (UID: \"a5bf9568-6633-4642-ad21-41e8c51f128a\") "
Jul 14 20:39:04.024200 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:39:04.024175    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a5bf9568-6633-4642-ad21-41e8c51f128a-workload-socket\") pod \"a5bf9568-6633-4642-ad21-41e8c51f128a\" (UID: \"a5bf9568-6633-4642-ad21-41e8c51f128a\") "
Jul 14 20:39:04.024589 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:39:04.024367    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a5bf9568-6633-4642-ad21-41e8c51f128a-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "a5bf9568-6633-4642-ad21-41e8c51f128a" (UID: "a5bf9568-6633-4642-ad21-41e8c51f128a"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 20:39:04.024655 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:39:04.024597    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a5bf9568-6633-4642-ad21-41e8c51f128a-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "a5bf9568-6633-4642-ad21-41e8c51f128a" (UID: "a5bf9568-6633-4642-ad21-41e8c51f128a"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 20:39:04.024655 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:39:04.024609    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a5bf9568-6633-4642-ad21-41e8c51f128a-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "a5bf9568-6633-4642-ad21-41e8c51f128a" (UID: "a5bf9568-6633-4642-ad21-41e8c51f128a"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 20:39:04.024928 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:39:04.024718    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a5bf9568-6633-4642-ad21-41e8c51f128a-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "a5bf9568-6633-4642-ad21-41e8c51f128a" (UID: "a5bf9568-6633-4642-ad21-41e8c51f128a"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 14 20:39:04.025056 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:39:04.025024    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a5bf9568-6633-4642-ad21-41e8c51f128a-istio-data" (OuterVolumeSpecName: "istio-data") pod "a5bf9568-6633-4642-ad21-41e8c51f128a" (UID: "a5bf9568-6633-4642-ad21-41e8c51f128a"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 20:39:04.026318 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:39:04.026298    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a5bf9568-6633-4642-ad21-41e8c51f128a-istio-token" (OuterVolumeSpecName: "istio-token") pod "a5bf9568-6633-4642-ad21-41e8c51f128a" (UID: "a5bf9568-6633-4642-ad21-41e8c51f128a"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 14 20:39:04.026485 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:39:04.026465    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a5bf9568-6633-4642-ad21-41e8c51f128a-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "a5bf9568-6633-4642-ad21-41e8c51f128a" (UID: "a5bf9568-6633-4642-ad21-41e8c51f128a"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 20:39:04.026853 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:39:04.026824    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/a5bf9568-6633-4642-ad21-41e8c51f128a-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "a5bf9568-6633-4642-ad21-41e8c51f128a" (UID: "a5bf9568-6633-4642-ad21-41e8c51f128a"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 14 20:39:04.026853 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:39:04.026839    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a5bf9568-6633-4642-ad21-41e8c51f128a-kube-api-access-79wrq" (OuterVolumeSpecName: "kube-api-access-79wrq") pod "a5bf9568-6633-4642-ad21-41e8c51f128a" (UID: "a5bf9568-6633-4642-ad21-41e8c51f128a"). InnerVolumeSpecName "kube-api-access-79wrq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 14 20:39:04.125614 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:39:04.125576    2579 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a5bf9568-6633-4642-ad21-41e8c51f128a-istio-envoy\") on node \"ip-10-0-140-201.ec2.internal\" DevicePath \"\""
Jul 14 20:39:04.125614 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:39:04.125607    2579 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a5bf9568-6633-4642-ad21-41e8c51f128a-credential-socket\") on node \"ip-10-0-140-201.ec2.internal\" DevicePath \"\""
Jul 14 20:39:04.125614 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:39:04.125617    2579 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a5bf9568-6633-4642-ad21-41e8c51f128a-workload-socket\") on node \"ip-10-0-140-201.ec2.internal\" DevicePath \"\""
Jul 14 20:39:04.125856 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:39:04.125627    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-79wrq\" (UniqueName: \"kubernetes.io/projected/a5bf9568-6633-4642-ad21-41e8c51f128a-kube-api-access-79wrq\") on node \"ip-10-0-140-201.ec2.internal\" DevicePath \"\""
Jul 14 20:39:04.125856 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:39:04.125636    2579 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a5bf9568-6633-4642-ad21-41e8c51f128a-istio-token\") on node \"ip-10-0-140-201.ec2.internal\" DevicePath \"\""
Jul 14 20:39:04.125856 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:39:04.125644    2579 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a5bf9568-6633-4642-ad21-41e8c51f128a-istiod-ca-cert\") on node \"ip-10-0-140-201.ec2.internal\" DevicePath \"\""
Jul 14 20:39:04.125856 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:39:04.125653    2579 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a5bf9568-6633-4642-ad21-41e8c51f128a-istio-podinfo\") on node \"ip-10-0-140-201.ec2.internal\" DevicePath \"\""
Jul 14 20:39:04.125856 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:39:04.125660    2579 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a5bf9568-6633-4642-ad21-41e8c51f128a-istio-data\") on node \"ip-10-0-140-201.ec2.internal\" DevicePath \"\""
Jul 14 20:39:04.125856 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:39:04.125668    2579 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a5bf9568-6633-4642-ad21-41e8c51f128a-workload-certs\") on node \"ip-10-0-140-201.ec2.internal\" DevicePath \"\""
Jul 14 20:39:04.229673 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:39:04.229640    2579 generic.go:356] "Generic (PLEG): container finished" podID="a5bf9568-6633-4642-ad21-41e8c51f128a" containerID="88a0f42abada6fe98308ea726a57043de08c3adfd61ecb1bbd8f6d18a75ed039" exitCode=0
Jul 14 20:39:04.229838 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:39:04.229688    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-e55cd3-openshift-default-75f4c4c8bc-dhwrs"
Jul 14 20:39:04.229838 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:39:04.229731    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-e55cd3-openshift-default-75f4c4c8bc-dhwrs" event={"ID":"a5bf9568-6633-4642-ad21-41e8c51f128a","Type":"ContainerDied","Data":"88a0f42abada6fe98308ea726a57043de08c3adfd61ecb1bbd8f6d18a75ed039"}
Jul 14 20:39:04.229838 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:39:04.229788    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-e55cd3-openshift-default-75f4c4c8bc-dhwrs" event={"ID":"a5bf9568-6633-4642-ad21-41e8c51f128a","Type":"ContainerDied","Data":"4c44cc3755ea11b5330528b48f736482eed7a78242f89dd38ca6022bed7af5a6"}
Jul 14 20:39:04.229838 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:39:04.229812    2579 scope.go:117] "RemoveContainer" containerID="88a0f42abada6fe98308ea726a57043de08c3adfd61ecb1bbd8f6d18a75ed039"
Jul 14 20:39:04.239629 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:39:04.239610    2579 scope.go:117] "RemoveContainer" containerID="abc13328530427038bae838bdd394556279d9eade28431081e9cb5a80e41f8bb"
Jul 14 20:39:04.248594 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:39:04.248575    2579 scope.go:117] "RemoveContainer" containerID="88a0f42abada6fe98308ea726a57043de08c3adfd61ecb1bbd8f6d18a75ed039"
Jul 14 20:39:04.248860 ip-10-0-140-201 kubenswrapper[2579]: E0714 20:39:04.248839    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"88a0f42abada6fe98308ea726a57043de08c3adfd61ecb1bbd8f6d18a75ed039\": container with ID starting with 88a0f42abada6fe98308ea726a57043de08c3adfd61ecb1bbd8f6d18a75ed039 not found: ID does not exist" containerID="88a0f42abada6fe98308ea726a57043de08c3adfd61ecb1bbd8f6d18a75ed039"
Jul 14 20:39:04.248924 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:39:04.248869    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"88a0f42abada6fe98308ea726a57043de08c3adfd61ecb1bbd8f6d18a75ed039"} err="failed to get container status \"88a0f42abada6fe98308ea726a57043de08c3adfd61ecb1bbd8f6d18a75ed039\": rpc error: code = NotFound desc = could not find container \"88a0f42abada6fe98308ea726a57043de08c3adfd61ecb1bbd8f6d18a75ed039\": container with ID starting with 88a0f42abada6fe98308ea726a57043de08c3adfd61ecb1bbd8f6d18a75ed039 not found: ID does not exist"
Jul 14 20:39:04.248924 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:39:04.248888    2579 scope.go:117] "RemoveContainer" containerID="abc13328530427038bae838bdd394556279d9eade28431081e9cb5a80e41f8bb"
Jul 14 20:39:04.249129 ip-10-0-140-201 kubenswrapper[2579]: E0714 20:39:04.249110    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"abc13328530427038bae838bdd394556279d9eade28431081e9cb5a80e41f8bb\": container with ID starting with abc13328530427038bae838bdd394556279d9eade28431081e9cb5a80e41f8bb not found: ID does not exist" containerID="abc13328530427038bae838bdd394556279d9eade28431081e9cb5a80e41f8bb"
Jul 14 20:39:04.249169 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:39:04.249137    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"abc13328530427038bae838bdd394556279d9eade28431081e9cb5a80e41f8bb"} err="failed to get container status \"abc13328530427038bae838bdd394556279d9eade28431081e9cb5a80e41f8bb\": rpc error: code = NotFound desc = could not find container \"abc13328530427038bae838bdd394556279d9eade28431081e9cb5a80e41f8bb\": container with ID starting with abc13328530427038bae838bdd394556279d9eade28431081e9cb5a80e41f8bb not found: ID does not exist"
Jul 14 20:39:04.253943 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:39:04.253918    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-e55cd3-openshift-default-75f4c4c8bc-dhwrs"]
Jul 14 20:39:04.258710 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:39:04.258688    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-a-e55cd3-openshift-default-75f4c4c8bc-dhwrs"]
Jul 14 20:39:04.852742 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:39:04.849859    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a5bf9568-6633-4642-ad21-41e8c51f128a" path="/var/lib/kubelet/pods/a5bf9568-6633-4642-ad21-41e8c51f128a/volumes"
Jul 14 20:39:24.954464 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:39:24.954424    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-d4143c-openshift-default-6d77988bf5-p9xjr"]
Jul 14 20:39:24.955113 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:39:24.954729    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-b-d4143c-openshift-default-6d77988bf5-p9xjr" podUID="a18d9fcf-77a6-4643-9cae-f5992d933fe7" containerName="istio-proxy" containerID="cri-o://42cdc3bc286df15b9ad741aa8885f2064e87030ba2781f60421ca0bee3ce0b81" gracePeriod=30
Jul 14 20:39:30.209198 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:39:30.209168    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-d4143c-openshift-default-6d77988bf5-p9xjr"
Jul 14 20:39:30.287951 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:39:30.287866    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a18d9fcf-77a6-4643-9cae-f5992d933fe7-istio-data\") pod \"a18d9fcf-77a6-4643-9cae-f5992d933fe7\" (UID: \"a18d9fcf-77a6-4643-9cae-f5992d933fe7\") "
Jul 14 20:39:30.287951 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:39:30.287903    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a18d9fcf-77a6-4643-9cae-f5992d933fe7-workload-socket\") pod \"a18d9fcf-77a6-4643-9cae-f5992d933fe7\" (UID: \"a18d9fcf-77a6-4643-9cae-f5992d933fe7\") "
Jul 14 20:39:30.287951 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:39:30.287934    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a18d9fcf-77a6-4643-9cae-f5992d933fe7-istio-podinfo\") pod \"a18d9fcf-77a6-4643-9cae-f5992d933fe7\" (UID: \"a18d9fcf-77a6-4643-9cae-f5992d933fe7\") "
Jul 14 20:39:30.288187 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:39:30.287971    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a18d9fcf-77a6-4643-9cae-f5992d933fe7-credential-socket\") pod \"a18d9fcf-77a6-4643-9cae-f5992d933fe7\" (UID: \"a18d9fcf-77a6-4643-9cae-f5992d933fe7\") "
Jul 14 20:39:30.288187 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:39:30.287992    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a18d9fcf-77a6-4643-9cae-f5992d933fe7-istio-envoy\") pod \"a18d9fcf-77a6-4643-9cae-f5992d933fe7\" (UID: \"a18d9fcf-77a6-4643-9cae-f5992d933fe7\") "
Jul 14 20:39:30.288187 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:39:30.288058    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bwwph\" (UniqueName: \"kubernetes.io/projected/a18d9fcf-77a6-4643-9cae-f5992d933fe7-kube-api-access-bwwph\") pod \"a18d9fcf-77a6-4643-9cae-f5992d933fe7\" (UID: \"a18d9fcf-77a6-4643-9cae-f5992d933fe7\") "
Jul 14 20:39:30.288187 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:39:30.288118    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a18d9fcf-77a6-4643-9cae-f5992d933fe7-istio-token\") pod \"a18d9fcf-77a6-4643-9cae-f5992d933fe7\" (UID: \"a18d9fcf-77a6-4643-9cae-f5992d933fe7\") "
Jul 14 20:39:30.288187 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:39:30.288159    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a18d9fcf-77a6-4643-9cae-f5992d933fe7-istiod-ca-cert\") pod \"a18d9fcf-77a6-4643-9cae-f5992d933fe7\" (UID: \"a18d9fcf-77a6-4643-9cae-f5992d933fe7\") "
Jul 14 20:39:30.288187 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:39:30.288184    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a18d9fcf-77a6-4643-9cae-f5992d933fe7-workload-certs\") pod \"a18d9fcf-77a6-4643-9cae-f5992d933fe7\" (UID: \"a18d9fcf-77a6-4643-9cae-f5992d933fe7\") "
Jul 14 20:39:30.288518 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:39:30.288221    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a18d9fcf-77a6-4643-9cae-f5992d933fe7-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "a18d9fcf-77a6-4643-9cae-f5992d933fe7" (UID: "a18d9fcf-77a6-4643-9cae-f5992d933fe7"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 20:39:30.288518 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:39:30.288260    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a18d9fcf-77a6-4643-9cae-f5992d933fe7-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "a18d9fcf-77a6-4643-9cae-f5992d933fe7" (UID: "a18d9fcf-77a6-4643-9cae-f5992d933fe7"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 20:39:30.288518 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:39:30.288471    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a18d9fcf-77a6-4643-9cae-f5992d933fe7-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "a18d9fcf-77a6-4643-9cae-f5992d933fe7" (UID: "a18d9fcf-77a6-4643-9cae-f5992d933fe7"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 20:39:30.288725 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:39:30.288620    2579 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a18d9fcf-77a6-4643-9cae-f5992d933fe7-workload-certs\") on node \"ip-10-0-140-201.ec2.internal\" DevicePath \"\""
Jul 14 20:39:30.288725 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:39:30.288638    2579 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a18d9fcf-77a6-4643-9cae-f5992d933fe7-workload-socket\") on node \"ip-10-0-140-201.ec2.internal\" DevicePath \"\""
Jul 14 20:39:30.288725 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:39:30.288679    2579 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a18d9fcf-77a6-4643-9cae-f5992d933fe7-credential-socket\") on node \"ip-10-0-140-201.ec2.internal\" DevicePath \"\""
Jul 14 20:39:30.289112 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:39:30.288802    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a18d9fcf-77a6-4643-9cae-f5992d933fe7-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "a18d9fcf-77a6-4643-9cae-f5992d933fe7" (UID: "a18d9fcf-77a6-4643-9cae-f5992d933fe7"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 14 20:39:30.289112 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:39:30.289058    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a18d9fcf-77a6-4643-9cae-f5992d933fe7-istio-data" (OuterVolumeSpecName: "istio-data") pod "a18d9fcf-77a6-4643-9cae-f5992d933fe7" (UID: "a18d9fcf-77a6-4643-9cae-f5992d933fe7"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 20:39:30.290400 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:39:30.290364    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/a18d9fcf-77a6-4643-9cae-f5992d933fe7-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "a18d9fcf-77a6-4643-9cae-f5992d933fe7" (UID: "a18d9fcf-77a6-4643-9cae-f5992d933fe7"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 14 20:39:30.290512 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:39:30.290435    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a18d9fcf-77a6-4643-9cae-f5992d933fe7-istio-token" (OuterVolumeSpecName: "istio-token") pod "a18d9fcf-77a6-4643-9cae-f5992d933fe7" (UID: "a18d9fcf-77a6-4643-9cae-f5992d933fe7"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 14 20:39:30.290512 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:39:30.290449    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a18d9fcf-77a6-4643-9cae-f5992d933fe7-kube-api-access-bwwph" (OuterVolumeSpecName: "kube-api-access-bwwph") pod "a18d9fcf-77a6-4643-9cae-f5992d933fe7" (UID: "a18d9fcf-77a6-4643-9cae-f5992d933fe7"). InnerVolumeSpecName "kube-api-access-bwwph". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 14 20:39:30.290512 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:39:30.290463    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a18d9fcf-77a6-4643-9cae-f5992d933fe7-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "a18d9fcf-77a6-4643-9cae-f5992d933fe7" (UID: "a18d9fcf-77a6-4643-9cae-f5992d933fe7"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 20:39:30.384387 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:39:30.384349    2579 generic.go:356] "Generic (PLEG): container finished" podID="a18d9fcf-77a6-4643-9cae-f5992d933fe7" containerID="42cdc3bc286df15b9ad741aa8885f2064e87030ba2781f60421ca0bee3ce0b81" exitCode=0
Jul 14 20:39:30.384578 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:39:30.384399    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-d4143c-openshift-default-6d77988bf5-p9xjr"
Jul 14 20:39:30.384578 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:39:30.384436    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-d4143c-openshift-default-6d77988bf5-p9xjr" event={"ID":"a18d9fcf-77a6-4643-9cae-f5992d933fe7","Type":"ContainerDied","Data":"42cdc3bc286df15b9ad741aa8885f2064e87030ba2781f60421ca0bee3ce0b81"}
Jul 14 20:39:30.384578 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:39:30.384494    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-d4143c-openshift-default-6d77988bf5-p9xjr" event={"ID":"a18d9fcf-77a6-4643-9cae-f5992d933fe7","Type":"ContainerDied","Data":"7da8222e2a06a7efa1a175c3a06253f77cc3d12376087737704bc442843371c1"}
Jul 14 20:39:30.384578 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:39:30.384510    2579 scope.go:117] "RemoveContainer" containerID="42cdc3bc286df15b9ad741aa8885f2064e87030ba2781f60421ca0bee3ce0b81"
Jul 14 20:39:30.389313 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:39:30.389285    2579 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a18d9fcf-77a6-4643-9cae-f5992d933fe7-istio-token\") on node \"ip-10-0-140-201.ec2.internal\" DevicePath \"\""
Jul 14 20:39:30.389438 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:39:30.389318    2579 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a18d9fcf-77a6-4643-9cae-f5992d933fe7-istiod-ca-cert\") on node \"ip-10-0-140-201.ec2.internal\" DevicePath \"\""
Jul 14 20:39:30.389438 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:39:30.389331    2579 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a18d9fcf-77a6-4643-9cae-f5992d933fe7-istio-data\") on node \"ip-10-0-140-201.ec2.internal\" DevicePath \"\""
Jul 14 20:39:30.389438 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:39:30.389344    2579 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a18d9fcf-77a6-4643-9cae-f5992d933fe7-istio-podinfo\") on node \"ip-10-0-140-201.ec2.internal\" DevicePath \"\""
Jul 14 20:39:30.389438 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:39:30.389354    2579 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a18d9fcf-77a6-4643-9cae-f5992d933fe7-istio-envoy\") on node \"ip-10-0-140-201.ec2.internal\" DevicePath \"\""
Jul 14 20:39:30.389438 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:39:30.389364    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bwwph\" (UniqueName: \"kubernetes.io/projected/a18d9fcf-77a6-4643-9cae-f5992d933fe7-kube-api-access-bwwph\") on node \"ip-10-0-140-201.ec2.internal\" DevicePath \"\""
Jul 14 20:39:30.394680 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:39:30.394653    2579 scope.go:117] "RemoveContainer" containerID="cedfed0bb377700dc59e2686a1d3770ab850600dab9ff79baa4beb9953f16988"
Jul 14 20:39:30.405190 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:39:30.405169    2579 scope.go:117] "RemoveContainer" containerID="42cdc3bc286df15b9ad741aa8885f2064e87030ba2781f60421ca0bee3ce0b81"
Jul 14 20:39:30.405549 ip-10-0-140-201 kubenswrapper[2579]: E0714 20:39:30.405516    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"42cdc3bc286df15b9ad741aa8885f2064e87030ba2781f60421ca0bee3ce0b81\": container with ID starting with 42cdc3bc286df15b9ad741aa8885f2064e87030ba2781f60421ca0bee3ce0b81 not found: ID does not exist" containerID="42cdc3bc286df15b9ad741aa8885f2064e87030ba2781f60421ca0bee3ce0b81"
Jul 14 20:39:30.405640 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:39:30.405561    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"42cdc3bc286df15b9ad741aa8885f2064e87030ba2781f60421ca0bee3ce0b81"} err="failed to get container status \"42cdc3bc286df15b9ad741aa8885f2064e87030ba2781f60421ca0bee3ce0b81\": rpc error: code = NotFound desc = could not find container \"42cdc3bc286df15b9ad741aa8885f2064e87030ba2781f60421ca0bee3ce0b81\": container with ID starting with 42cdc3bc286df15b9ad741aa8885f2064e87030ba2781f60421ca0bee3ce0b81 not found: ID does not exist"
Jul 14 20:39:30.405640 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:39:30.405591    2579 scope.go:117] "RemoveContainer" containerID="cedfed0bb377700dc59e2686a1d3770ab850600dab9ff79baa4beb9953f16988"
Jul 14 20:39:30.405917 ip-10-0-140-201 kubenswrapper[2579]: E0714 20:39:30.405894    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cedfed0bb377700dc59e2686a1d3770ab850600dab9ff79baa4beb9953f16988\": container with ID starting with cedfed0bb377700dc59e2686a1d3770ab850600dab9ff79baa4beb9953f16988 not found: ID does not exist" containerID="cedfed0bb377700dc59e2686a1d3770ab850600dab9ff79baa4beb9953f16988"
Jul 14 20:39:30.406011 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:39:30.405924    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cedfed0bb377700dc59e2686a1d3770ab850600dab9ff79baa4beb9953f16988"} err="failed to get container status \"cedfed0bb377700dc59e2686a1d3770ab850600dab9ff79baa4beb9953f16988\": rpc error: code = NotFound desc = could not find container \"cedfed0bb377700dc59e2686a1d3770ab850600dab9ff79baa4beb9953f16988\": container with ID starting with cedfed0bb377700dc59e2686a1d3770ab850600dab9ff79baa4beb9953f16988 not found: ID does not exist"
Jul 14 20:39:30.409425 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:39:30.409399    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-d4143c-openshift-default-6d77988bf5-p9xjr"]
Jul 14 20:39:30.413947 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:39:30.413924    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-b-d4143c-openshift-default-6d77988bf5-p9xjr"]
Jul 14 20:39:30.848331 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:39:30.848296    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a18d9fcf-77a6-4643-9cae-f5992d933fe7" path="/var/lib/kubelet/pods/a18d9fcf-77a6-4643-9cae-f5992d933fe7/volumes"
Jul 14 20:39:31.086562 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:39:31.086513    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-696d845876-425n4_5391ab3c-7ea8-49cc-8ad4-74eda106fe53/manager/0.log"
Jul 14 20:39:31.600109 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:39:31.600070    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-786799b55c-fp9kv_1aeb97e7-5de4-4638-bf83-02f922e5b286/copy-manifests/0.log"
Jul 14 20:39:31.608293 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:39:31.608265    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-786799b55c-fp9kv_1aeb97e7-5de4-4638-bf83-02f922e5b286/manager/0.log"
Jul 14 20:39:32.281757 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:39:32.281735    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-29734335-k8kms_5b37711e-54f6-4012-acfc-c9858cad9eaa/cleanup/0.log"
Jul 14 20:39:32.656942 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:39:32.656848    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-keys-e2e-ait-df972874-pzwtt_aebdbf77-1b02-4650-a264-b5efb82f896a/revoke-keys/0.log"
Jul 14 20:39:33.039563 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:39:33.039517    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-keys-e2e-derive-7044c372-2wh9g_833935d4-1fba-41be-9230-76ee5e8d241a/revoke-keys/0.log"
Jul 14 20:39:33.406553 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:39:33.406446    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-keys-e2e-migrate-bc788bc2-4cz6b_0b9dab5a-10cc-498f-9cb0-c66352b9e4c8/revoke-keys/0.log"
Jul 14 20:39:33.531944 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:39:33.531917    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-keys-e2e-mt-08c922cd-wf8l7_4352e583-c04a-4d7f-bbb6-f7ac8aa9a55f/revoke-keys/0.log"
Jul 14 20:39:33.660973 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:39:33.660892    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-keys-e2e-mt-d080ee51-9fb8g_75846082-8297-43e7-adb0-d3f477a9648d/revoke-keys/0.log"
Jul 14 20:39:34.878753 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:39:34.878718    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759tdh89_4ba1b4c2-f21c-45ff-a603-677f80d40c5c/extract/0.log"
Jul 14 20:39:34.885463 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:39:34.885440    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759tdh89_4ba1b4c2-f21c-45ff-a603-677f80d40c5c/util/0.log"
Jul 14 20:39:34.893172 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:39:34.893149    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759tdh89_4ba1b4c2-f21c-45ff-a603-677f80d40c5c/pull/0.log"
Jul 14 20:39:35.026565 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:39:35.026512    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0vfwkc_f4cf1772-b226-41c9-9172-4cde84bf2501/util/0.log"
Jul 14 20:39:35.033973 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:39:35.033951    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0vfwkc_f4cf1772-b226-41c9-9172-4cde84bf2501/pull/0.log"
Jul 14 20:39:35.042119 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:39:35.042089    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0vfwkc_f4cf1772-b226-41c9-9172-4cde84bf2501/extract/0.log"
Jul 14 20:39:35.161191 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:39:35.161110    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737xnnb_d632af5e-2745-4a30-9039-195015c27632/pull/0.log"
Jul 14 20:39:35.167749 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:39:35.167723    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737xnnb_d632af5e-2745-4a30-9039-195015c27632/extract/0.log"
Jul 14 20:39:35.173950 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:39:35.173919    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737xnnb_d632af5e-2745-4a30-9039-195015c27632/util/0.log"
Jul 14 20:39:35.295611 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:39:35.295570    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rq7mk_721784e8-cbc4-4542-9a67-3a6b3cf8057b/pull/0.log"
Jul 14 20:39:35.302655 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:39:35.302632    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rq7mk_721784e8-cbc4-4542-9a67-3a6b3cf8057b/extract/0.log"
Jul 14 20:39:35.309855 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:39:35.309834    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rq7mk_721784e8-cbc4-4542-9a67-3a6b3cf8057b/util/0.log"
Jul 14 20:39:36.779499 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:39:36.779466    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4l54tt_89814b01-3939-46c2-8f01-159989e0233d/istio-proxy/0.log"
Jul 14 20:39:36.912651 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:39:36.912620    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-zr2sx_8045a177-9e0f-4acf-9167-effd12177e0c/discovery/0.log"
Jul 14 20:39:37.290613 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:39:37.290579    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-rj6cq_bee8f711-e29d-48a4-ac23-7275e82af001/istio-proxy/1.log"
Jul 14 20:39:38.394156 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:39:38.394118    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbrvmqx_71c4680a-f271-48cd-9dcb-b4b069b5909b/main/0.log"
Jul 14 20:39:46.535832 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:39:46.535796    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-d8x6z_1993baf5-1337-4873-acf4-fd40ade89975/global-pull-secret-syncer/0.log"
Jul 14 20:39:46.671848 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:39:46.671815    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-nb29m_f18327eb-f774-4f26-b798-5628c0dd01ad/konnectivity-agent/0.log"
Jul 14 20:39:46.733543 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:39:46.733513    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-140-201.ec2.internal_f7485cdaac307b25b08583eb8c5cef91/haproxy/0.log"
Jul 14 20:39:51.070766 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:39:51.070732    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759tdh89_4ba1b4c2-f21c-45ff-a603-677f80d40c5c/extract/0.log"
Jul 14 20:39:51.095714 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:39:51.095681    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759tdh89_4ba1b4c2-f21c-45ff-a603-677f80d40c5c/util/0.log"
Jul 14 20:39:51.119266 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:39:51.119233    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759tdh89_4ba1b4c2-f21c-45ff-a603-677f80d40c5c/pull/0.log"
Jul 14 20:39:51.150023 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:39:51.149990    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0vfwkc_f4cf1772-b226-41c9-9172-4cde84bf2501/extract/0.log"
Jul 14 20:39:51.173041 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:39:51.173011    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0vfwkc_f4cf1772-b226-41c9-9172-4cde84bf2501/util/0.log"
Jul 14 20:39:51.198805 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:39:51.198775    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0vfwkc_f4cf1772-b226-41c9-9172-4cde84bf2501/pull/0.log"
Jul 14 20:39:51.236027 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:39:51.236000    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737xnnb_d632af5e-2745-4a30-9039-195015c27632/extract/0.log"
Jul 14 20:39:51.261259 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:39:51.261227    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737xnnb_d632af5e-2745-4a30-9039-195015c27632/util/0.log"
Jul 14 20:39:51.290544 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:39:51.290497    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737xnnb_d632af5e-2745-4a30-9039-195015c27632/pull/0.log"
Jul 14 20:39:51.329303 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:39:51.329209    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rq7mk_721784e8-cbc4-4542-9a67-3a6b3cf8057b/extract/0.log"
Jul 14 20:39:51.355431 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:39:51.355397    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rq7mk_721784e8-cbc4-4542-9a67-3a6b3cf8057b/util/0.log"
Jul 14 20:39:51.377148 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:39:51.377119    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rq7mk_721784e8-cbc4-4542-9a67-3a6b3cf8057b/pull/0.log"
Jul 14 20:39:53.988316 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:39:53.988277    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_cfb08590-fee2-4c07-bbc0-54f3b749e417/alertmanager/0.log"
Jul 14 20:39:54.028585 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:39:54.028559    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_cfb08590-fee2-4c07-bbc0-54f3b749e417/config-reloader/0.log"
Jul 14 20:39:54.064711 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:39:54.064676    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_cfb08590-fee2-4c07-bbc0-54f3b749e417/kube-rbac-proxy-web/0.log"
Jul 14 20:39:54.089670 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:39:54.089636    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_cfb08590-fee2-4c07-bbc0-54f3b749e417/kube-rbac-proxy/0.log"
Jul 14 20:39:54.112304 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:39:54.112277    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_cfb08590-fee2-4c07-bbc0-54f3b749e417/kube-rbac-proxy-metric/0.log"
Jul 14 20:39:54.140604 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:39:54.140571    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_cfb08590-fee2-4c07-bbc0-54f3b749e417/prom-label-proxy/0.log"
Jul 14 20:39:54.165453 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:39:54.165416    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_cfb08590-fee2-4c07-bbc0-54f3b749e417/init-config-reloader/0.log"
Jul 14 20:39:54.219554 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:39:54.219495    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-5f7f494dd4-2fgqz_44512305-0548-44ec-a1f5-9ae26bd2cf8d/cluster-monitoring-operator/0.log"
Jul 14 20:39:54.595746 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:39:54.595653    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-pxxbg_a2bc32ea-0717-4ef1-ba8c-5dd724f8c830/node-exporter/0.log"
Jul 14 20:39:54.618094 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:39:54.618058    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-pxxbg_a2bc32ea-0717-4ef1-ba8c-5dd724f8c830/kube-rbac-proxy/0.log"
Jul 14 20:39:54.638731 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:39:54.638706    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-pxxbg_a2bc32ea-0717-4ef1-ba8c-5dd724f8c830/init-textfile/0.log"
Jul 14 20:39:54.983711 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:39:54.983673    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-64785b6675-crkt9_1d6cb096-03e9-4a1d-93a7-013081f3344a/prometheus-operator/0.log"
Jul 14 20:39:55.007183 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:39:55.007156    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-64785b6675-crkt9_1d6cb096-03e9-4a1d-93a7-013081f3344a/kube-rbac-proxy/0.log"
Jul 14 20:39:55.029948 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:39:55.029915    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-77d98bc786-v22lt_c43d150d-fac8-470e-9fe8-7727cf74bbef/prometheus-operator-admission-webhook/0.log"
Jul 14 20:39:55.061678 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:39:55.061645    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-6cb54594f6-7jsqp_e92d9339-2d28-400f-94b0-db49f85ed4c7/telemeter-client/0.log"
Jul 14 20:39:55.092142 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:39:55.092114    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-6cb54594f6-7jsqp_e92d9339-2d28-400f-94b0-db49f85ed4c7/reload/0.log"
Jul 14 20:39:55.116112 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:39:55.116002    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-6cb54594f6-7jsqp_e92d9339-2d28-400f-94b0-db49f85ed4c7/kube-rbac-proxy/0.log"
Jul 14 20:39:56.492266 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:39:56.492240    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-6cf856758c-67qv6_52346b15-5bc4-4abc-8ecf-d52e688f2541/networking-console-plugin/0.log"
Jul 14 20:39:56.522452 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:39:56.522423    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-6mzxq/perf-node-gather-daemonset-gwrpb"]
Jul 14 20:39:56.522808 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:39:56.522796    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a5bf9568-6633-4642-ad21-41e8c51f128a" containerName="istio-proxy"
Jul 14 20:39:56.522853 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:39:56.522810    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="a5bf9568-6633-4642-ad21-41e8c51f128a" containerName="istio-proxy"
Jul 14 20:39:56.522853 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:39:56.522821    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a18d9fcf-77a6-4643-9cae-f5992d933fe7" containerName="istio-proxy"
Jul 14 20:39:56.522853 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:39:56.522826    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="a18d9fcf-77a6-4643-9cae-f5992d933fe7" containerName="istio-proxy"
Jul 14 20:39:56.522853 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:39:56.522836    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a18d9fcf-77a6-4643-9cae-f5992d933fe7" containerName="istio-proxy"
Jul 14 20:39:56.522853 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:39:56.522841    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="a18d9fcf-77a6-4643-9cae-f5992d933fe7" containerName="istio-proxy"
Jul 14 20:39:56.523013 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:39:56.522861    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a5bf9568-6633-4642-ad21-41e8c51f128a" containerName="istio-proxy"
Jul 14 20:39:56.523013 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:39:56.522867    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="a5bf9568-6633-4642-ad21-41e8c51f128a" containerName="istio-proxy"
Jul 14 20:39:56.523013 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:39:56.522919    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="a18d9fcf-77a6-4643-9cae-f5992d933fe7" containerName="istio-proxy"
Jul 14 20:39:56.523013 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:39:56.522927    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="a5bf9568-6633-4642-ad21-41e8c51f128a" containerName="istio-proxy"
Jul 14 20:39:56.523013 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:39:56.522933    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="a5bf9568-6633-4642-ad21-41e8c51f128a" containerName="istio-proxy"
Jul 14 20:39:56.526188 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:39:56.526167    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-6mzxq/perf-node-gather-daemonset-gwrpb"
Jul 14 20:39:56.529847 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:39:56.529824    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-6mzxq\"/\"openshift-service-ca.crt\""
Jul 14 20:39:56.529980 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:39:56.529884    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-6mzxq\"/\"kube-root-ca.crt\""
Jul 14 20:39:56.530888 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:39:56.530869    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-6mzxq\"/\"default-dockercfg-w8ncr\""
Jul 14 20:39:56.541804 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:39:56.541779    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-6mzxq/perf-node-gather-daemonset-gwrpb"]
Jul 14 20:39:56.622429 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:39:56.622389    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/56205621-d19b-4b5f-bea3-557ff2379e5c-lib-modules\") pod \"perf-node-gather-daemonset-gwrpb\" (UID: \"56205621-d19b-4b5f-bea3-557ff2379e5c\") " pod="openshift-must-gather-6mzxq/perf-node-gather-daemonset-gwrpb"
Jul 14 20:39:56.622429 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:39:56.622434    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kv5dp\" (UniqueName: \"kubernetes.io/projected/56205621-d19b-4b5f-bea3-557ff2379e5c-kube-api-access-kv5dp\") pod \"perf-node-gather-daemonset-gwrpb\" (UID: \"56205621-d19b-4b5f-bea3-557ff2379e5c\") " pod="openshift-must-gather-6mzxq/perf-node-gather-daemonset-gwrpb"
Jul 14 20:39:56.622686 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:39:56.622586    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/56205621-d19b-4b5f-bea3-557ff2379e5c-sys\") pod \"perf-node-gather-daemonset-gwrpb\" (UID: \"56205621-d19b-4b5f-bea3-557ff2379e5c\") " pod="openshift-must-gather-6mzxq/perf-node-gather-daemonset-gwrpb"
Jul 14 20:39:56.622686 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:39:56.622668    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/56205621-d19b-4b5f-bea3-557ff2379e5c-podres\") pod \"perf-node-gather-daemonset-gwrpb\" (UID: \"56205621-d19b-4b5f-bea3-557ff2379e5c\") " pod="openshift-must-gather-6mzxq/perf-node-gather-daemonset-gwrpb"
Jul 14 20:39:56.622754 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:39:56.622696    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/56205621-d19b-4b5f-bea3-557ff2379e5c-proc\") pod \"perf-node-gather-daemonset-gwrpb\" (UID: \"56205621-d19b-4b5f-bea3-557ff2379e5c\") " pod="openshift-must-gather-6mzxq/perf-node-gather-daemonset-gwrpb"
Jul 14 20:39:56.724029 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:39:56.723988    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/56205621-d19b-4b5f-bea3-557ff2379e5c-sys\") pod \"perf-node-gather-daemonset-gwrpb\" (UID: \"56205621-d19b-4b5f-bea3-557ff2379e5c\") " pod="openshift-must-gather-6mzxq/perf-node-gather-daemonset-gwrpb"
Jul 14 20:39:56.724231 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:39:56.724082    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/56205621-d19b-4b5f-bea3-557ff2379e5c-podres\") pod \"perf-node-gather-daemonset-gwrpb\" (UID: \"56205621-d19b-4b5f-bea3-557ff2379e5c\") " pod="openshift-must-gather-6mzxq/perf-node-gather-daemonset-gwrpb"
Jul 14 20:39:56.724231 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:39:56.724123    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/56205621-d19b-4b5f-bea3-557ff2379e5c-proc\") pod \"perf-node-gather-daemonset-gwrpb\" (UID: \"56205621-d19b-4b5f-bea3-557ff2379e5c\") " pod="openshift-must-gather-6mzxq/perf-node-gather-daemonset-gwrpb"
Jul 14 20:39:56.724231 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:39:56.724122    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/56205621-d19b-4b5f-bea3-557ff2379e5c-sys\") pod \"perf-node-gather-daemonset-gwrpb\" (UID: \"56205621-d19b-4b5f-bea3-557ff2379e5c\") " pod="openshift-must-gather-6mzxq/perf-node-gather-daemonset-gwrpb"
Jul 14 20:39:56.724231 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:39:56.724160    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/56205621-d19b-4b5f-bea3-557ff2379e5c-lib-modules\") pod \"perf-node-gather-daemonset-gwrpb\" (UID: \"56205621-d19b-4b5f-bea3-557ff2379e5c\") " pod="openshift-must-gather-6mzxq/perf-node-gather-daemonset-gwrpb"
Jul 14 20:39:56.724231 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:39:56.724192    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/56205621-d19b-4b5f-bea3-557ff2379e5c-proc\") pod \"perf-node-gather-daemonset-gwrpb\" (UID: \"56205621-d19b-4b5f-bea3-557ff2379e5c\") " pod="openshift-must-gather-6mzxq/perf-node-gather-daemonset-gwrpb"
Jul 14 20:39:56.724231 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:39:56.724193    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kv5dp\" (UniqueName: \"kubernetes.io/projected/56205621-d19b-4b5f-bea3-557ff2379e5c-kube-api-access-kv5dp\") pod \"perf-node-gather-daemonset-gwrpb\" (UID: \"56205621-d19b-4b5f-bea3-557ff2379e5c\") " pod="openshift-must-gather-6mzxq/perf-node-gather-daemonset-gwrpb"
Jul 14 20:39:56.724582 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:39:56.724259    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/56205621-d19b-4b5f-bea3-557ff2379e5c-podres\") pod \"perf-node-gather-daemonset-gwrpb\" (UID: \"56205621-d19b-4b5f-bea3-557ff2379e5c\") " pod="openshift-must-gather-6mzxq/perf-node-gather-daemonset-gwrpb"
Jul 14 20:39:56.724582 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:39:56.724307    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/56205621-d19b-4b5f-bea3-557ff2379e5c-lib-modules\") pod \"perf-node-gather-daemonset-gwrpb\" (UID: \"56205621-d19b-4b5f-bea3-557ff2379e5c\") " pod="openshift-must-gather-6mzxq/perf-node-gather-daemonset-gwrpb"
Jul 14 20:39:56.733630 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:39:56.733600    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kv5dp\" (UniqueName: \"kubernetes.io/projected/56205621-d19b-4b5f-bea3-557ff2379e5c-kube-api-access-kv5dp\") pod \"perf-node-gather-daemonset-gwrpb\" (UID: \"56205621-d19b-4b5f-bea3-557ff2379e5c\") " pod="openshift-must-gather-6mzxq/perf-node-gather-daemonset-gwrpb"
Jul 14 20:39:56.836117 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:39:56.836021    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-6mzxq/perf-node-gather-daemonset-gwrpb"
Jul 14 20:39:56.975465 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:39:56.975436    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-6mzxq/perf-node-gather-daemonset-gwrpb"]
Jul 14 20:39:56.976984 ip-10-0-140-201 kubenswrapper[2579]: W0714 20:39:56.976956    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod56205621_d19b_4b5f_bea3_557ff2379e5c.slice/crio-fa91f46872a4e119affe09496538957181c4478000d3425662469abcf6202a6b WatchSource:0}: Error finding container fa91f46872a4e119affe09496538957181c4478000d3425662469abcf6202a6b: Status 404 returned error can't find the container with id fa91f46872a4e119affe09496538957181c4478000d3425662469abcf6202a6b
Jul 14 20:39:57.532513 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:39:57.532478    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-6mzxq/perf-node-gather-daemonset-gwrpb" event={"ID":"56205621-d19b-4b5f-bea3-557ff2379e5c","Type":"ContainerStarted","Data":"94724cabd0a71f6170430c2c6d661e745a54708c46d3ab26e8e7f4ac683d177d"}
Jul 14 20:39:57.532956 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:39:57.532679    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-6mzxq/perf-node-gather-daemonset-gwrpb"
Jul 14 20:39:57.532956 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:39:57.532715    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-6mzxq/perf-node-gather-daemonset-gwrpb" event={"ID":"56205621-d19b-4b5f-bea3-557ff2379e5c","Type":"ContainerStarted","Data":"fa91f46872a4e119affe09496538957181c4478000d3425662469abcf6202a6b"}
Jul 14 20:39:57.555194 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:39:57.555139    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-6mzxq/perf-node-gather-daemonset-gwrpb" podStartSLOduration=1.555121895 podStartE2EDuration="1.555121895s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-14 20:39:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 20:39:57.554041336 +0000 UTC m=+2897.265637082" watchObservedRunningTime="2026-07-14 20:39:57.555121895 +0000 UTC m=+2897.266717438"
Jul 14 20:39:57.713543 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:39:57.713489    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-647c64497-dxlph_5b2d5cd4-32a6-4787-888b-39d8df66822e/console/0.log"
Jul 14 20:39:58.398224 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:39:58.398187    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-78495597f6-l85f2_ccc17280-3650-447f-a954-c075c7cc06d8/volume-data-source-validator/0.log"
Jul 14 20:39:59.551767 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:39:59.551725    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-cpzqc_0360d8bf-1d2a-43c4-8638-6766128ff3d4/dns/0.log"
Jul 14 20:39:59.573502 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:39:59.573476    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-cpzqc_0360d8bf-1d2a-43c4-8638-6766128ff3d4/kube-rbac-proxy/0.log"
Jul 14 20:39:59.651629 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:39:59.651594    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-4qscd_209b5a52-9d80-45ca-9c92-63578a945220/dns-node-resolver/0.log"
Jul 14 20:40:00.290788 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:40:00.290747    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-d5ff7d578-dfw7q_0e41ffb7-ed18-49ef-8d0d-d31257dbcba7/registry/0.log"
Jul 14 20:40:00.341423 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:40:00.341396    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-gb26w_1ea2bd9d-b2c3-42ce-a0ee-c3719d4f048e/node-ca/0.log"
Jul 14 20:40:01.364153 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:40:01.364114    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4l54tt_89814b01-3939-46c2-8f01-159989e0233d/istio-proxy/0.log"
Jul 14 20:40:01.578619 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:40:01.578581    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-zr2sx_8045a177-9e0f-4acf-9167-effd12177e0c/discovery/0.log"
Jul 14 20:40:01.684365 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:40:01.684271    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-rj6cq_bee8f711-e29d-48a4-ac23-7275e82af001/istio-proxy/0.log"
Jul 14 20:40:01.742217 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:40:01.742184    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-rj6cq_bee8f711-e29d-48a4-ac23-7275e82af001/istio-proxy/1.log"
Jul 14 20:40:02.584860 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:40:02.584826    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-nrkrb_ab40987e-7e6f-4346-9c28-b565e00402d5/serve-healthcheck-canary/0.log"
Jul 14 20:40:03.280817 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:40:03.280786    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-wg62n_eaa66e64-34f1-417d-ad95-884ac468df21/kube-rbac-proxy/0.log"
Jul 14 20:40:03.302523 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:40:03.302485    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-wg62n_eaa66e64-34f1-417d-ad95-884ac468df21/exporter/0.log"
Jul 14 20:40:03.328716 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:40:03.328683    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-wg62n_eaa66e64-34f1-417d-ad95-884ac468df21/extractor/0.log"
Jul 14 20:40:03.548734 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:40:03.548649    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-6mzxq/perf-node-gather-daemonset-gwrpb"
Jul 14 20:40:06.017974 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:40:06.017938    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-696d845876-425n4_5391ab3c-7ea8-49cc-8ad4-74eda106fe53/manager/0.log"
Jul 14 20:40:06.196597 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:40:06.196558    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-786799b55c-fp9kv_1aeb97e7-5de4-4638-bf83-02f922e5b286/manager/0.log"
Jul 14 20:40:06.219636 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:40:06.219605    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-786799b55c-fp9kv_1aeb97e7-5de4-4638-bf83-02f922e5b286/copy-manifests/0.log"
Jul 14 20:40:07.266935 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:40:07.266906    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4l54tt_89814b01-3939-46c2-8f01-159989e0233d/istio-proxy/0.log"
Jul 14 20:40:07.471997 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:40:07.471968    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-zr2sx_8045a177-9e0f-4acf-9167-effd12177e0c/discovery/0.log"
Jul 14 20:40:07.522424 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:40:07.522396    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-rj6cq_bee8f711-e29d-48a4-ac23-7275e82af001/istio-proxy/0.log"
Jul 14 20:40:07.563323 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:40:07.563282    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-7fb95d5d68-7t22d_cdc24711-28ef-4845-9cca-90cce025f645/manager/0.log"
Jul 14 20:40:07.588428 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:40:07.588396    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-rj6cq_bee8f711-e29d-48a4-ac23-7275e82af001/istio-proxy/1.log"
Jul 14 20:40:08.881219 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:40:08.881173    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4l54tt_89814b01-3939-46c2-8f01-159989e0233d/istio-proxy/0.log"
Jul 14 20:40:09.091743 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:40:09.091711    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-zr2sx_8045a177-9e0f-4acf-9167-effd12177e0c/discovery/0.log"
Jul 14 20:40:09.142580 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:40:09.142451    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-rj6cq_bee8f711-e29d-48a4-ac23-7275e82af001/istio-proxy/0.log"
Jul 14 20:40:09.205127 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:40:09.205092    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-rj6cq_bee8f711-e29d-48a4-ac23-7275e82af001/istio-proxy/1.log"
Jul 14 20:40:13.114335 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:40:13.114292    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-799cb7f958-gm5zm_71c07105-14b6-4c70-967c-22fe858bea59/kube-storage-version-migrator-operator/1.log"
Jul 14 20:40:13.116073 ip-10-0-140-201 kubenswrapper[2579]: I0714 20:40:13.116048    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-799cb7f958-gm5zm_71c07105-14b6-4c70-967c-22fe858bea59/kube-storage-version-migrator-operator/0.log"