Jul 07 17:40:07.418140 ip-10-0-139-31 systemd[1]: Starting Kubernetes Kubelet...
Jul 07 17:40:07.881419 ip-10-0-139-31 kubenswrapper[2561]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 07 17:40:07.881419 ip-10-0-139-31 kubenswrapper[2561]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jul 07 17:40:07.881419 ip-10-0-139-31 kubenswrapper[2561]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 07 17:40:07.881419 ip-10-0-139-31 kubenswrapper[2561]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jul 07 17:40:07.881419 ip-10-0-139-31 kubenswrapper[2561]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 07 17:40:07.881419 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:07.872047    2561 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jul 07 17:40:07.881419 ip-10-0-139-31 kubenswrapper[2561]: W0707 17:40:07.877661    2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 07 17:40:07.881419 ip-10-0-139-31 kubenswrapper[2561]: W0707 17:40:07.877676    2561 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 07 17:40:07.881419 ip-10-0-139-31 kubenswrapper[2561]: W0707 17:40:07.877680    2561 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 07 17:40:07.881419 ip-10-0-139-31 kubenswrapper[2561]: W0707 17:40:07.877683    2561 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 07 17:40:07.881419 ip-10-0-139-31 kubenswrapper[2561]: W0707 17:40:07.877686    2561 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 07 17:40:07.881419 ip-10-0-139-31 kubenswrapper[2561]: W0707 17:40:07.877689    2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 07 17:40:07.881419 ip-10-0-139-31 kubenswrapper[2561]: W0707 17:40:07.877692    2561 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 07 17:40:07.881419 ip-10-0-139-31 kubenswrapper[2561]: W0707 17:40:07.877695    2561 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 07 17:40:07.895583 ip-10-0-139-31 kubenswrapper[2561]: W0707 17:40:07.877698    2561 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 07 17:40:07.895583 ip-10-0-139-31 kubenswrapper[2561]: W0707 17:40:07.877701    2561 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 07 17:40:07.895583 ip-10-0-139-31 kubenswrapper[2561]: W0707 17:40:07.877704    2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 07 17:40:07.895583 ip-10-0-139-31 kubenswrapper[2561]: W0707 17:40:07.877706    2561 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 07 17:40:07.895583 ip-10-0-139-31 kubenswrapper[2561]: W0707 17:40:07.877709    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 07 17:40:07.895583 ip-10-0-139-31 kubenswrapper[2561]: W0707 17:40:07.877712    2561 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 07 17:40:07.895583 ip-10-0-139-31 kubenswrapper[2561]: W0707 17:40:07.877714    2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 07 17:40:07.895583 ip-10-0-139-31 kubenswrapper[2561]: W0707 17:40:07.877718    2561 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 07 17:40:07.895583 ip-10-0-139-31 kubenswrapper[2561]: W0707 17:40:07.877721    2561 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 07 17:40:07.895583 ip-10-0-139-31 kubenswrapper[2561]: W0707 17:40:07.877723    2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 07 17:40:07.895583 ip-10-0-139-31 kubenswrapper[2561]: W0707 17:40:07.877725    2561 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 07 17:40:07.895583 ip-10-0-139-31 kubenswrapper[2561]: W0707 17:40:07.877728    2561 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 07 17:40:07.895583 ip-10-0-139-31 kubenswrapper[2561]: W0707 17:40:07.877731    2561 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 07 17:40:07.895583 ip-10-0-139-31 kubenswrapper[2561]: W0707 17:40:07.877734    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 07 17:40:07.895583 ip-10-0-139-31 kubenswrapper[2561]: W0707 17:40:07.877738    2561 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 07 17:40:07.895583 ip-10-0-139-31 kubenswrapper[2561]: W0707 17:40:07.877759    2561 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 07 17:40:07.895583 ip-10-0-139-31 kubenswrapper[2561]: W0707 17:40:07.877763    2561 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 07 17:40:07.895583 ip-10-0-139-31 kubenswrapper[2561]: W0707 17:40:07.877766    2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 07 17:40:07.895583 ip-10-0-139-31 kubenswrapper[2561]: W0707 17:40:07.877769    2561 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 07 17:40:07.895583 ip-10-0-139-31 kubenswrapper[2561]: W0707 17:40:07.877772    2561 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 07 17:40:07.897768 ip-10-0-139-31 kubenswrapper[2561]: W0707 17:40:07.877775    2561 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 07 17:40:07.897768 ip-10-0-139-31 kubenswrapper[2561]: W0707 17:40:07.877778    2561 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 07 17:40:07.897768 ip-10-0-139-31 kubenswrapper[2561]: W0707 17:40:07.877781    2561 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 07 17:40:07.897768 ip-10-0-139-31 kubenswrapper[2561]: W0707 17:40:07.877785    2561 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 07 17:40:07.897768 ip-10-0-139-31 kubenswrapper[2561]: W0707 17:40:07.877788    2561 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 07 17:40:07.897768 ip-10-0-139-31 kubenswrapper[2561]: W0707 17:40:07.877791    2561 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 07 17:40:07.897768 ip-10-0-139-31 kubenswrapper[2561]: W0707 17:40:07.877794    2561 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 07 17:40:07.897768 ip-10-0-139-31 kubenswrapper[2561]: W0707 17:40:07.877797    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 07 17:40:07.897768 ip-10-0-139-31 kubenswrapper[2561]: W0707 17:40:07.877800    2561 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 07 17:40:07.897768 ip-10-0-139-31 kubenswrapper[2561]: W0707 17:40:07.877803    2561 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 07 17:40:07.897768 ip-10-0-139-31 kubenswrapper[2561]: W0707 17:40:07.877806    2561 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 07 17:40:07.897768 ip-10-0-139-31 kubenswrapper[2561]: W0707 17:40:07.877808    2561 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 07 17:40:07.897768 ip-10-0-139-31 kubenswrapper[2561]: W0707 17:40:07.877811    2561 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 07 17:40:07.897768 ip-10-0-139-31 kubenswrapper[2561]: W0707 17:40:07.877813    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 07 17:40:07.897768 ip-10-0-139-31 kubenswrapper[2561]: W0707 17:40:07.877816    2561 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 07 17:40:07.897768 ip-10-0-139-31 kubenswrapper[2561]: W0707 17:40:07.877818    2561 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 07 17:40:07.897768 ip-10-0-139-31 kubenswrapper[2561]: W0707 17:40:07.877821    2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 07 17:40:07.897768 ip-10-0-139-31 kubenswrapper[2561]: W0707 17:40:07.877824    2561 feature_gate.go:328] unrecognized feature gate: Example2
Jul 07 17:40:07.897768 ip-10-0-139-31 kubenswrapper[2561]: W0707 17:40:07.877826    2561 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 07 17:40:07.899536 ip-10-0-139-31 kubenswrapper[2561]: W0707 17:40:07.877829    2561 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 07 17:40:07.899536 ip-10-0-139-31 kubenswrapper[2561]: W0707 17:40:07.877832    2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 07 17:40:07.899536 ip-10-0-139-31 kubenswrapper[2561]: W0707 17:40:07.877834    2561 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 07 17:40:07.899536 ip-10-0-139-31 kubenswrapper[2561]: W0707 17:40:07.877853    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 07 17:40:07.899536 ip-10-0-139-31 kubenswrapper[2561]: W0707 17:40:07.877856    2561 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 07 17:40:07.899536 ip-10-0-139-31 kubenswrapper[2561]: W0707 17:40:07.877860    2561 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 07 17:40:07.899536 ip-10-0-139-31 kubenswrapper[2561]: W0707 17:40:07.877863    2561 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 07 17:40:07.899536 ip-10-0-139-31 kubenswrapper[2561]: W0707 17:40:07.877866    2561 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 07 17:40:07.899536 ip-10-0-139-31 kubenswrapper[2561]: W0707 17:40:07.877868    2561 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 07 17:40:07.899536 ip-10-0-139-31 kubenswrapper[2561]: W0707 17:40:07.877871    2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 07 17:40:07.899536 ip-10-0-139-31 kubenswrapper[2561]: W0707 17:40:07.877874    2561 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 07 17:40:07.899536 ip-10-0-139-31 kubenswrapper[2561]: W0707 17:40:07.877878    2561 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 07 17:40:07.899536 ip-10-0-139-31 kubenswrapper[2561]: W0707 17:40:07.877881    2561 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 07 17:40:07.899536 ip-10-0-139-31 kubenswrapper[2561]: W0707 17:40:07.877883    2561 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 07 17:40:07.899536 ip-10-0-139-31 kubenswrapper[2561]: W0707 17:40:07.877886    2561 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 07 17:40:07.899536 ip-10-0-139-31 kubenswrapper[2561]: W0707 17:40:07.877890    2561 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 07 17:40:07.899536 ip-10-0-139-31 kubenswrapper[2561]: W0707 17:40:07.877894    2561 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 07 17:40:07.899536 ip-10-0-139-31 kubenswrapper[2561]: W0707 17:40:07.877898    2561 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 07 17:40:07.899536 ip-10-0-139-31 kubenswrapper[2561]: W0707 17:40:07.877901    2561 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 07 17:40:07.901857 ip-10-0-139-31 kubenswrapper[2561]: W0707 17:40:07.877904    2561 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 07 17:40:07.901857 ip-10-0-139-31 kubenswrapper[2561]: W0707 17:40:07.877906    2561 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 07 17:40:07.901857 ip-10-0-139-31 kubenswrapper[2561]: W0707 17:40:07.877909    2561 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 07 17:40:07.901857 ip-10-0-139-31 kubenswrapper[2561]: W0707 17:40:07.877912    2561 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 07 17:40:07.901857 ip-10-0-139-31 kubenswrapper[2561]: W0707 17:40:07.877915    2561 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 07 17:40:07.901857 ip-10-0-139-31 kubenswrapper[2561]: W0707 17:40:07.877917    2561 feature_gate.go:328] unrecognized feature gate: Example
Jul 07 17:40:07.901857 ip-10-0-139-31 kubenswrapper[2561]: W0707 17:40:07.877920    2561 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 07 17:40:07.901857 ip-10-0-139-31 kubenswrapper[2561]: W0707 17:40:07.877923    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 07 17:40:07.901857 ip-10-0-139-31 kubenswrapper[2561]: W0707 17:40:07.877925    2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 07 17:40:07.901857 ip-10-0-139-31 kubenswrapper[2561]: W0707 17:40:07.877928    2561 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 07 17:40:07.901857 ip-10-0-139-31 kubenswrapper[2561]: W0707 17:40:07.877932    2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 07 17:40:07.901857 ip-10-0-139-31 kubenswrapper[2561]: W0707 17:40:07.877934    2561 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 07 17:40:07.901857 ip-10-0-139-31 kubenswrapper[2561]: W0707 17:40:07.877937    2561 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 07 17:40:07.901857 ip-10-0-139-31 kubenswrapper[2561]: W0707 17:40:07.877939    2561 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 07 17:40:07.901857 ip-10-0-139-31 kubenswrapper[2561]: W0707 17:40:07.877942    2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 07 17:40:07.901857 ip-10-0-139-31 kubenswrapper[2561]: W0707 17:40:07.877944    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 07 17:40:07.901857 ip-10-0-139-31 kubenswrapper[2561]: W0707 17:40:07.877947    2561 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 07 17:40:07.901857 ip-10-0-139-31 kubenswrapper[2561]: W0707 17:40:07.877949    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 07 17:40:07.901857 ip-10-0-139-31 kubenswrapper[2561]: W0707 17:40:07.877952    2561 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 07 17:40:07.901857 ip-10-0-139-31 kubenswrapper[2561]: W0707 17:40:07.877955    2561 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 07 17:40:07.958413 ip-10-0-139-31 kubenswrapper[2561]: W0707 17:40:07.877958    2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 07 17:40:07.958413 ip-10-0-139-31 kubenswrapper[2561]: W0707 17:40:07.877961    2561 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 07 17:40:07.958413 ip-10-0-139-31 kubenswrapper[2561]: W0707 17:40:07.877964    2561 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 07 17:40:07.958413 ip-10-0-139-31 kubenswrapper[2561]: W0707 17:40:07.877967    2561 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 07 17:40:07.958413 ip-10-0-139-31 kubenswrapper[2561]: W0707 17:40:07.877969    2561 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 07 17:40:07.958413 ip-10-0-139-31 kubenswrapper[2561]: W0707 17:40:07.877972    2561 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 07 17:40:07.958413 ip-10-0-139-31 kubenswrapper[2561]: W0707 17:40:07.877975    2561 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 07 17:40:07.958413 ip-10-0-139-31 kubenswrapper[2561]: W0707 17:40:07.877977    2561 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 07 17:40:07.958413 ip-10-0-139-31 kubenswrapper[2561]: W0707 17:40:07.877980    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 07 17:40:07.958413 ip-10-0-139-31 kubenswrapper[2561]: W0707 17:40:07.877982    2561 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 07 17:40:07.958413 ip-10-0-139-31 kubenswrapper[2561]: W0707 17:40:07.877985    2561 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 07 17:40:07.958413 ip-10-0-139-31 kubenswrapper[2561]: W0707 17:40:07.877987    2561 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 07 17:40:07.958413 ip-10-0-139-31 kubenswrapper[2561]: W0707 17:40:07.877990    2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 07 17:40:07.958413 ip-10-0-139-31 kubenswrapper[2561]: W0707 17:40:07.878726    2561 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 07 17:40:07.958413 ip-10-0-139-31 kubenswrapper[2561]: W0707 17:40:07.878732    2561 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 07 17:40:07.958413 ip-10-0-139-31 kubenswrapper[2561]: W0707 17:40:07.878735    2561 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 07 17:40:07.958413 ip-10-0-139-31 kubenswrapper[2561]: W0707 17:40:07.878738    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 07 17:40:07.958413 ip-10-0-139-31 kubenswrapper[2561]: W0707 17:40:07.878742    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 07 17:40:07.958413 ip-10-0-139-31 kubenswrapper[2561]: W0707 17:40:07.878746    2561 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 07 17:40:07.958413 ip-10-0-139-31 kubenswrapper[2561]: W0707 17:40:07.878748    2561 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 07 17:40:07.980189 ip-10-0-139-31 kubenswrapper[2561]: W0707 17:40:07.878751    2561 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 07 17:40:07.980189 ip-10-0-139-31 kubenswrapper[2561]: W0707 17:40:07.878754    2561 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 07 17:40:07.980189 ip-10-0-139-31 kubenswrapper[2561]: W0707 17:40:07.878757    2561 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 07 17:40:07.980189 ip-10-0-139-31 kubenswrapper[2561]: W0707 17:40:07.878760    2561 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 07 17:40:07.980189 ip-10-0-139-31 kubenswrapper[2561]: W0707 17:40:07.878762    2561 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 07 17:40:07.980189 ip-10-0-139-31 kubenswrapper[2561]: W0707 17:40:07.878765    2561 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 07 17:40:07.980189 ip-10-0-139-31 kubenswrapper[2561]: W0707 17:40:07.878768    2561 feature_gate.go:328] unrecognized feature gate: Example
Jul 07 17:40:07.980189 ip-10-0-139-31 kubenswrapper[2561]: W0707 17:40:07.878770    2561 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 07 17:40:07.980189 ip-10-0-139-31 kubenswrapper[2561]: W0707 17:40:07.878773    2561 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 07 17:40:07.980189 ip-10-0-139-31 kubenswrapper[2561]: W0707 17:40:07.878776    2561 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 07 17:40:07.980189 ip-10-0-139-31 kubenswrapper[2561]: W0707 17:40:07.878778    2561 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 07 17:40:07.980189 ip-10-0-139-31 kubenswrapper[2561]: W0707 17:40:07.878781    2561 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 07 17:40:07.980189 ip-10-0-139-31 kubenswrapper[2561]: W0707 17:40:07.878784    2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 07 17:40:07.980189 ip-10-0-139-31 kubenswrapper[2561]: W0707 17:40:07.878786    2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 07 17:40:07.980189 ip-10-0-139-31 kubenswrapper[2561]: W0707 17:40:07.878789    2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 07 17:40:07.980189 ip-10-0-139-31 kubenswrapper[2561]: W0707 17:40:07.878792    2561 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 07 17:40:07.980189 ip-10-0-139-31 kubenswrapper[2561]: W0707 17:40:07.878794    2561 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 07 17:40:07.980189 ip-10-0-139-31 kubenswrapper[2561]: W0707 17:40:07.878797    2561 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 07 17:40:07.980189 ip-10-0-139-31 kubenswrapper[2561]: W0707 17:40:07.878800    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 07 17:40:07.980189 ip-10-0-139-31 kubenswrapper[2561]: W0707 17:40:07.878802    2561 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 07 17:40:07.958183 ip-10-0-139-31 systemd[1]: Started Kubernetes Kubelet.
Jul 07 17:40:08.174887 ip-10-0-139-31 kubenswrapper[2561]: W0707 17:40:07.878805    2561 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 07 17:40:08.174887 ip-10-0-139-31 kubenswrapper[2561]: W0707 17:40:07.878808    2561 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 07 17:40:08.174887 ip-10-0-139-31 kubenswrapper[2561]: W0707 17:40:07.878810    2561 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 07 17:40:08.174887 ip-10-0-139-31 kubenswrapper[2561]: W0707 17:40:07.878814    2561 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 07 17:40:08.174887 ip-10-0-139-31 kubenswrapper[2561]: W0707 17:40:07.878818    2561 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 07 17:40:08.174887 ip-10-0-139-31 kubenswrapper[2561]: W0707 17:40:07.878821    2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 07 17:40:08.174887 ip-10-0-139-31 kubenswrapper[2561]: W0707 17:40:07.878824    2561 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 07 17:40:08.174887 ip-10-0-139-31 kubenswrapper[2561]: W0707 17:40:07.878827    2561 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 07 17:40:08.174887 ip-10-0-139-31 kubenswrapper[2561]: W0707 17:40:07.878830    2561 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 07 17:40:08.174887 ip-10-0-139-31 kubenswrapper[2561]: W0707 17:40:07.878833    2561 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 07 17:40:08.174887 ip-10-0-139-31 kubenswrapper[2561]: W0707 17:40:07.878849    2561 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 07 17:40:08.174887 ip-10-0-139-31 kubenswrapper[2561]: W0707 17:40:07.878854    2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 07 17:40:08.174887 ip-10-0-139-31 kubenswrapper[2561]: W0707 17:40:07.878857    2561 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 07 17:40:08.174887 ip-10-0-139-31 kubenswrapper[2561]: W0707 17:40:07.878860    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 07 17:40:08.174887 ip-10-0-139-31 kubenswrapper[2561]: W0707 17:40:07.878863    2561 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 07 17:40:08.174887 ip-10-0-139-31 kubenswrapper[2561]: W0707 17:40:07.878866    2561 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 07 17:40:08.174887 ip-10-0-139-31 kubenswrapper[2561]: W0707 17:40:07.878868    2561 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 07 17:40:08.174887 ip-10-0-139-31 kubenswrapper[2561]: W0707 17:40:07.878871    2561 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 07 17:40:08.209662 ip-10-0-139-31 kubenswrapper[2561]: W0707 17:40:07.878875    2561 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 07 17:40:08.209662 ip-10-0-139-31 kubenswrapper[2561]: W0707 17:40:07.878878    2561 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 07 17:40:08.209662 ip-10-0-139-31 kubenswrapper[2561]: W0707 17:40:07.878882    2561 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 07 17:40:08.209662 ip-10-0-139-31 kubenswrapper[2561]: W0707 17:40:07.878884    2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 07 17:40:08.209662 ip-10-0-139-31 kubenswrapper[2561]: W0707 17:40:07.878887    2561 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 07 17:40:08.209662 ip-10-0-139-31 kubenswrapper[2561]: W0707 17:40:07.878890    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 07 17:40:08.209662 ip-10-0-139-31 kubenswrapper[2561]: W0707 17:40:07.878893    2561 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 07 17:40:08.209662 ip-10-0-139-31 kubenswrapper[2561]: W0707 17:40:07.878896    2561 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 07 17:40:08.209662 ip-10-0-139-31 kubenswrapper[2561]: W0707 17:40:07.878898    2561 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 07 17:40:08.209662 ip-10-0-139-31 kubenswrapper[2561]: W0707 17:40:07.878901    2561 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 07 17:40:08.209662 ip-10-0-139-31 kubenswrapper[2561]: W0707 17:40:07.878904    2561 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 07 17:40:08.209662 ip-10-0-139-31 kubenswrapper[2561]: W0707 17:40:07.878906    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 07 17:40:08.209662 ip-10-0-139-31 kubenswrapper[2561]: W0707 17:40:07.878909    2561 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 07 17:40:08.209662 ip-10-0-139-31 kubenswrapper[2561]: W0707 17:40:07.878911    2561 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 07 17:40:08.209662 ip-10-0-139-31 kubenswrapper[2561]: W0707 17:40:07.878914    2561 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 07 17:40:08.209662 ip-10-0-139-31 kubenswrapper[2561]: W0707 17:40:07.878916    2561 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 07 17:40:08.209662 ip-10-0-139-31 kubenswrapper[2561]: W0707 17:40:07.878919    2561 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 07 17:40:08.209662 ip-10-0-139-31 kubenswrapper[2561]: W0707 17:40:07.878922    2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 07 17:40:08.209662 ip-10-0-139-31 kubenswrapper[2561]: W0707 17:40:07.878924    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 07 17:40:08.209662 ip-10-0-139-31 kubenswrapper[2561]: W0707 17:40:07.878928    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 07 17:40:08.210578 ip-10-0-139-31 kubenswrapper[2561]: W0707 17:40:07.878932    2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 07 17:40:08.210578 ip-10-0-139-31 kubenswrapper[2561]: W0707 17:40:07.878938    2561 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 07 17:40:08.210578 ip-10-0-139-31 kubenswrapper[2561]: W0707 17:40:07.878941    2561 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 07 17:40:08.210578 ip-10-0-139-31 kubenswrapper[2561]: W0707 17:40:07.878945    2561 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 07 17:40:08.210578 ip-10-0-139-31 kubenswrapper[2561]: W0707 17:40:07.878948    2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 07 17:40:08.210578 ip-10-0-139-31 kubenswrapper[2561]: W0707 17:40:07.878951    2561 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 07 17:40:08.210578 ip-10-0-139-31 kubenswrapper[2561]: W0707 17:40:07.878959    2561 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 07 17:40:08.210578 ip-10-0-139-31 kubenswrapper[2561]: W0707 17:40:07.878962    2561 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 07 17:40:08.210578 ip-10-0-139-31 kubenswrapper[2561]: W0707 17:40:07.878965    2561 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 07 17:40:08.210578 ip-10-0-139-31 kubenswrapper[2561]: W0707 17:40:07.878967    2561 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 07 17:40:08.210578 ip-10-0-139-31 kubenswrapper[2561]: W0707 17:40:07.878970    2561 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 07 17:40:08.210578 ip-10-0-139-31 kubenswrapper[2561]: W0707 17:40:07.878973    2561 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 07 17:40:08.210578 ip-10-0-139-31 kubenswrapper[2561]: W0707 17:40:07.878976    2561 feature_gate.go:328] unrecognized feature gate: Example2
Jul 07 17:40:08.210578 ip-10-0-139-31 kubenswrapper[2561]: W0707 17:40:07.878978    2561 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 07 17:40:08.210578 ip-10-0-139-31 kubenswrapper[2561]: W0707 17:40:07.878981    2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 07 17:40:08.210578 ip-10-0-139-31 kubenswrapper[2561]: W0707 17:40:07.878985    2561 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 07 17:40:08.210578 ip-10-0-139-31 kubenswrapper[2561]: W0707 17:40:07.878988    2561 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 07 17:40:08.210578 ip-10-0-139-31 kubenswrapper[2561]: W0707 17:40:07.878990    2561 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 07 17:40:08.210578 ip-10-0-139-31 kubenswrapper[2561]: W0707 17:40:07.878993    2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 07 17:40:08.211601 ip-10-0-139-31 kubenswrapper[2561]: W0707 17:40:07.878995    2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 07 17:40:08.211601 ip-10-0-139-31 kubenswrapper[2561]: W0707 17:40:07.878998    2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 07 17:40:08.211601 ip-10-0-139-31 kubenswrapper[2561]: W0707 17:40:07.879001    2561 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 07 17:40:08.211601 ip-10-0-139-31 kubenswrapper[2561]: W0707 17:40:07.879007    2561 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 07 17:40:08.211601 ip-10-0-139-31 kubenswrapper[2561]: W0707 17:40:07.879010    2561 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 07 17:40:08.211601 ip-10-0-139-31 kubenswrapper[2561]: W0707 17:40:07.879012    2561 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 07 17:40:08.211601 ip-10-0-139-31 kubenswrapper[2561]: W0707 17:40:07.879015    2561 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 07 17:40:08.211601 ip-10-0-139-31 kubenswrapper[2561]: W0707 17:40:07.879017    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 07 17:40:08.211601 ip-10-0-139-31 kubenswrapper[2561]: W0707 17:40:07.879021    2561 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 07 17:40:08.211601 ip-10-0-139-31 kubenswrapper[2561]: W0707 17:40:07.879024    2561 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 07 17:40:08.211601 ip-10-0-139-31 kubenswrapper[2561]: W0707 17:40:07.879027    2561 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 07 17:40:08.211601 ip-10-0-139-31 kubenswrapper[2561]: W0707 17:40:07.879029    2561 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 07 17:40:08.211601 ip-10-0-139-31 kubenswrapper[2561]: W0707 17:40:07.879032    2561 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 07 17:40:08.211601 ip-10-0-139-31 kubenswrapper[2561]: W0707 17:40:07.879034    2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 07 17:40:08.211601 ip-10-0-139-31 kubenswrapper[2561]: W0707 17:40:07.879037    2561 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 07 17:40:08.211601 ip-10-0-139-31 kubenswrapper[2561]: W0707 17:40:07.879434    2561 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 07 17:40:08.211601 ip-10-0-139-31 kubenswrapper[2561]: W0707 17:40:07.879441    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 07 17:40:08.211601 ip-10-0-139-31 kubenswrapper[2561]: W0707 17:40:07.879445    2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 07 17:40:08.211601 ip-10-0-139-31 kubenswrapper[2561]: W0707 17:40:07.879449    2561 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 07 17:40:08.211601 ip-10-0-139-31 kubenswrapper[2561]: W0707 17:40:07.879453    2561 feature_gate.go:328] unrecognized feature gate: Example
Jul 07 17:40:08.212626 ip-10-0-139-31 kubenswrapper[2561]: W0707 17:40:07.879457    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 07 17:40:08.212626 ip-10-0-139-31 kubenswrapper[2561]: W0707 17:40:07.879463    2561 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 07 17:40:08.212626 ip-10-0-139-31 kubenswrapper[2561]: W0707 17:40:07.879467    2561 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 07 17:40:08.212626 ip-10-0-139-31 kubenswrapper[2561]: W0707 17:40:07.879471    2561 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 07 17:40:08.212626 ip-10-0-139-31 kubenswrapper[2561]: W0707 17:40:07.879474    2561 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 07 17:40:08.212626 ip-10-0-139-31 kubenswrapper[2561]: W0707 17:40:07.879478    2561 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 07 17:40:08.212626 ip-10-0-139-31 kubenswrapper[2561]: W0707 17:40:07.879482    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 07 17:40:08.212626 ip-10-0-139-31 kubenswrapper[2561]: W0707 17:40:07.879486    2561 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 07 17:40:08.212626 ip-10-0-139-31 kubenswrapper[2561]: W0707 17:40:07.879490    2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 07 17:40:08.212626 ip-10-0-139-31 kubenswrapper[2561]: W0707 17:40:07.879494    2561 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 07 17:40:08.212626 ip-10-0-139-31 kubenswrapper[2561]: W0707 17:40:07.879499    2561 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 07 17:40:08.212626 ip-10-0-139-31 kubenswrapper[2561]: W0707 17:40:07.879504    2561 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 07 17:40:08.212626 ip-10-0-139-31 kubenswrapper[2561]: W0707 17:40:07.879509    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 07 17:40:08.212626 ip-10-0-139-31 kubenswrapper[2561]: W0707 17:40:07.879513    2561 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 07 17:40:08.212626 ip-10-0-139-31 kubenswrapper[2561]: W0707 17:40:07.879517    2561 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 07 17:40:08.212626 ip-10-0-139-31 kubenswrapper[2561]: W0707 17:40:07.879524    2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 07 17:40:08.212626 ip-10-0-139-31 kubenswrapper[2561]: W0707 17:40:07.879528    2561 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 07 17:40:08.212626 ip-10-0-139-31 kubenswrapper[2561]: W0707 17:40:07.879532    2561 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 07 17:40:08.212626 ip-10-0-139-31 kubenswrapper[2561]: W0707 17:40:07.879536    2561 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 07 17:40:08.213421 ip-10-0-139-31 kubenswrapper[2561]: W0707 17:40:07.879542    2561 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 07 17:40:08.213421 ip-10-0-139-31 kubenswrapper[2561]: W0707 17:40:07.879547    2561 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 07 17:40:08.213421 ip-10-0-139-31 kubenswrapper[2561]: W0707 17:40:07.879551    2561 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 07 17:40:08.213421 ip-10-0-139-31 kubenswrapper[2561]: W0707 17:40:07.879555    2561 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 07 17:40:08.213421 ip-10-0-139-31 kubenswrapper[2561]: W0707 17:40:07.879559    2561 feature_gate.go:328] unrecognized feature gate: Example2
Jul 07 17:40:08.213421 ip-10-0-139-31 kubenswrapper[2561]: W0707 17:40:07.879563    2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 07 17:40:08.213421 ip-10-0-139-31 kubenswrapper[2561]: W0707 17:40:07.879567    2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 07 17:40:08.213421 ip-10-0-139-31 kubenswrapper[2561]: W0707 17:40:07.879571    2561 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 07 17:40:08.213421 ip-10-0-139-31 kubenswrapper[2561]: W0707 17:40:07.879575    2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 07 17:40:08.213421 ip-10-0-139-31 kubenswrapper[2561]: W0707 17:40:07.879578    2561 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 07 17:40:08.213421 ip-10-0-139-31 kubenswrapper[2561]: W0707 17:40:07.879582    2561 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 07 17:40:08.213421 ip-10-0-139-31 kubenswrapper[2561]: W0707 17:40:07.879586    2561 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 07 17:40:08.213421 ip-10-0-139-31 kubenswrapper[2561]: W0707 17:40:07.879590    2561 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 07 17:40:08.213421 ip-10-0-139-31 kubenswrapper[2561]: W0707 17:40:07.879596    2561 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 07 17:40:08.213421 ip-10-0-139-31 kubenswrapper[2561]: W0707 17:40:07.879599    2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 07 17:40:08.213421 ip-10-0-139-31 kubenswrapper[2561]: W0707 17:40:07.879603    2561 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 07 17:40:08.213421 ip-10-0-139-31 kubenswrapper[2561]: W0707 17:40:07.879607    2561 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 07 17:40:08.213421 ip-10-0-139-31 kubenswrapper[2561]: W0707 17:40:07.879611    2561 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 07 17:40:08.213421 ip-10-0-139-31 kubenswrapper[2561]: W0707 17:40:07.879615    2561 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 07 17:40:08.214023 ip-10-0-139-31 kubenswrapper[2561]: W0707 17:40:07.879620    2561 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 07 17:40:08.214023 ip-10-0-139-31 kubenswrapper[2561]: W0707 17:40:07.879624    2561 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 07 17:40:08.214023 ip-10-0-139-31 kubenswrapper[2561]: W0707 17:40:07.879628    2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 07 17:40:08.214023 ip-10-0-139-31 kubenswrapper[2561]: W0707 17:40:07.879632    2561 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 07 17:40:08.214023 ip-10-0-139-31 kubenswrapper[2561]: W0707 17:40:07.879637    2561 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 07 17:40:08.214023 ip-10-0-139-31 kubenswrapper[2561]: W0707 17:40:07.879641    2561 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 07 17:40:08.214023 ip-10-0-139-31 kubenswrapper[2561]: W0707 17:40:07.879646    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 07 17:40:08.214023 ip-10-0-139-31 kubenswrapper[2561]: W0707 17:40:07.879650    2561 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 07 17:40:08.214023 ip-10-0-139-31 kubenswrapper[2561]: W0707 17:40:07.879655    2561 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 07 17:40:08.214023 ip-10-0-139-31 kubenswrapper[2561]: W0707 17:40:07.879661    2561 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 07 17:40:08.214023 ip-10-0-139-31 kubenswrapper[2561]: W0707 17:40:07.879665    2561 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 07 17:40:08.214023 ip-10-0-139-31 kubenswrapper[2561]: W0707 17:40:07.879669    2561 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 07 17:40:08.214023 ip-10-0-139-31 kubenswrapper[2561]: W0707 17:40:07.879674    2561 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 07 17:40:08.214023 ip-10-0-139-31 kubenswrapper[2561]: W0707 17:40:07.879678    2561 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 07 17:40:08.214023 ip-10-0-139-31 kubenswrapper[2561]: W0707 17:40:07.879684    2561 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 07 17:40:08.214023 ip-10-0-139-31 kubenswrapper[2561]: W0707 17:40:07.879688    2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 07 17:40:08.214023 ip-10-0-139-31 kubenswrapper[2561]: W0707 17:40:07.879694    2561 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 07 17:40:08.214023 ip-10-0-139-31 kubenswrapper[2561]: W0707 17:40:07.879698    2561 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 07 17:40:08.214023 ip-10-0-139-31 kubenswrapper[2561]: W0707 17:40:07.879702    2561 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 07 17:40:08.214023 ip-10-0-139-31 kubenswrapper[2561]: W0707 17:40:07.879706    2561 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 07 17:40:08.214833 ip-10-0-139-31 kubenswrapper[2561]: W0707 17:40:07.879710    2561 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 07 17:40:08.214833 ip-10-0-139-31 kubenswrapper[2561]: W0707 17:40:07.879714    2561 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 07 17:40:08.214833 ip-10-0-139-31 kubenswrapper[2561]: W0707 17:40:07.879718    2561 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 07 17:40:08.214833 ip-10-0-139-31 kubenswrapper[2561]: W0707 17:40:07.879722    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 07 17:40:08.214833 ip-10-0-139-31 kubenswrapper[2561]: W0707 17:40:07.879726    2561 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 07 17:40:08.214833 ip-10-0-139-31 kubenswrapper[2561]: W0707 17:40:07.879729    2561 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 07 17:40:08.214833 ip-10-0-139-31 kubenswrapper[2561]: W0707 17:40:07.879733    2561 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 07 17:40:08.214833 ip-10-0-139-31 kubenswrapper[2561]: W0707 17:40:07.879743    2561 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 07 17:40:08.214833 ip-10-0-139-31 kubenswrapper[2561]: W0707 17:40:07.879747    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 07 17:40:08.214833 ip-10-0-139-31 kubenswrapper[2561]: W0707 17:40:07.879751    2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 07 17:40:08.214833 ip-10-0-139-31 kubenswrapper[2561]: W0707 17:40:07.879755    2561 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 07 17:40:08.214833 ip-10-0-139-31 kubenswrapper[2561]: W0707 17:40:07.879759    2561 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 07 17:40:08.214833 ip-10-0-139-31 kubenswrapper[2561]: W0707 17:40:07.879763    2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 07 17:40:08.214833 ip-10-0-139-31 kubenswrapper[2561]: W0707 17:40:07.879767    2561 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 07 17:40:08.214833 ip-10-0-139-31 kubenswrapper[2561]: W0707 17:40:07.879771    2561 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 07 17:40:08.214833 ip-10-0-139-31 kubenswrapper[2561]: W0707 17:40:07.879774    2561 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 07 17:40:08.214833 ip-10-0-139-31 kubenswrapper[2561]: W0707 17:40:07.879778    2561 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 07 17:40:08.214833 ip-10-0-139-31 kubenswrapper[2561]: W0707 17:40:07.879782    2561 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 07 17:40:08.214833 ip-10-0-139-31 kubenswrapper[2561]: W0707 17:40:07.879786    2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 07 17:40:08.215522 ip-10-0-139-31 kubenswrapper[2561]: W0707 17:40:07.879789    2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 07 17:40:08.215522 ip-10-0-139-31 kubenswrapper[2561]: W0707 17:40:07.879793    2561 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 07 17:40:08.215522 ip-10-0-139-31 kubenswrapper[2561]: W0707 17:40:07.879799    2561 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 07 17:40:08.215522 ip-10-0-139-31 kubenswrapper[2561]: W0707 17:40:07.879802    2561 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 07 17:40:08.215522 ip-10-0-139-31 kubenswrapper[2561]: W0707 17:40:07.879806    2561 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 07 17:40:08.215522 ip-10-0-139-31 kubenswrapper[2561]: W0707 17:40:07.879810    2561 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 07 17:40:08.215522 ip-10-0-139-31 kubenswrapper[2561]: W0707 17:40:07.879813    2561 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 07 17:40:08.215522 ip-10-0-139-31 kubenswrapper[2561]: W0707 17:40:07.879817    2561 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 07 17:40:08.215522 ip-10-0-139-31 kubenswrapper[2561]: W0707 17:40:07.879821    2561 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 07 17:40:08.215522 ip-10-0-139-31 kubenswrapper[2561]: W0707 17:40:07.879830    2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 07 17:40:08.215522 ip-10-0-139-31 kubenswrapper[2561]: W0707 17:40:07.879833    2561 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 07 17:40:08.215522 ip-10-0-139-31 kubenswrapper[2561]: W0707 17:40:07.879857    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 07 17:40:08.215522 ip-10-0-139-31 kubenswrapper[2561]: W0707 17:40:07.879861    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 07 17:40:08.215522 ip-10-0-139-31 kubenswrapper[2561]: W0707 17:40:07.879866    2561 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 07 17:40:08.215522 ip-10-0-139-31 kubenswrapper[2561]: W0707 17:40:07.879869    2561 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 07 17:40:08.215522 ip-10-0-139-31 kubenswrapper[2561]: W0707 17:40:07.879873    2561 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 07 17:40:08.215522 ip-10-0-139-31 kubenswrapper[2561]: W0707 17:40:07.879877    2561 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 07 17:40:08.215522 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:07.879975    2561 flags.go:64] FLAG: --address="0.0.0.0"
Jul 07 17:40:08.215522 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:07.879984    2561 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jul 07 17:40:08.215522 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:07.879993    2561 flags.go:64] FLAG: --anonymous-auth="true"
Jul 07 17:40:08.215522 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:07.879999    2561 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jul 07 17:40:08.216208 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:07.880005    2561 flags.go:64] FLAG: --authentication-token-webhook="false"
Jul 07 17:40:08.216208 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:07.880010    2561 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jul 07 17:40:08.216208 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:07.880015    2561 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jul 07 17:40:08.216208 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:07.880020    2561 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jul 07 17:40:08.216208 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:07.880024    2561 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jul 07 17:40:08.216208 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:07.880028    2561 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jul 07 17:40:08.216208 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:07.880032    2561 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jul 07 17:40:08.216208 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:07.880036    2561 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jul 07 17:40:08.216208 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:07.880040    2561 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jul 07 17:40:08.216208 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:07.880044    2561 flags.go:64] FLAG: --cgroup-root=""
Jul 07 17:40:08.216208 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:07.880048    2561 flags.go:64] FLAG: --cgroups-per-qos="true"
Jul 07 17:40:08.216208 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:07.880051    2561 flags.go:64] FLAG: --client-ca-file=""
Jul 07 17:40:08.216208 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:07.880055    2561 flags.go:64] FLAG: --cloud-provider="external"
Jul 07 17:40:08.216208 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:07.880060    2561 flags.go:64] FLAG: --cluster-dns="[]"
Jul 07 17:40:08.216208 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:07.880065    2561 flags.go:64] FLAG: --cluster-domain=""
Jul 07 17:40:08.216208 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:07.880069    2561 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jul 07 17:40:08.216208 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:07.880073    2561 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jul 07 17:40:08.216208 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:07.880077    2561 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jul 07 17:40:08.216208 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:07.880081    2561 flags.go:64] FLAG: --container-log-max-files="5"
Jul 07 17:40:08.216208 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:07.880086    2561 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jul 07 17:40:08.216208 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:07.880092    2561 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jul 07 17:40:08.216208 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:07.880096    2561 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jul 07 17:40:08.216208 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:07.880100    2561 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jul 07 17:40:08.216938 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:07.880103    2561 flags.go:64] FLAG: --contention-profiling="false"
Jul 07 17:40:08.216938 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:07.880107    2561 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jul 07 17:40:08.216938 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:07.880111    2561 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jul 07 17:40:08.216938 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:07.880115    2561 flags.go:64] FLAG: --cpu-manager-policy="none"
Jul 07 17:40:08.216938 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:07.880118    2561 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jul 07 17:40:08.216938 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:07.880124    2561 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jul 07 17:40:08.216938 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:07.880128    2561 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jul 07 17:40:08.216938 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:07.880131    2561 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jul 07 17:40:08.216938 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:07.880135    2561 flags.go:64] FLAG: --enable-load-reader="false"
Jul 07 17:40:08.216938 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:07.880139    2561 flags.go:64] FLAG: --enable-server="true"
Jul 07 17:40:08.216938 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:07.880144    2561 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jul 07 17:40:08.216938 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:07.880152    2561 flags.go:64] FLAG: --event-burst="100"
Jul 07 17:40:08.216938 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:07.880157    2561 flags.go:64] FLAG: --event-qps="50"
Jul 07 17:40:08.216938 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:07.880160    2561 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jul 07 17:40:08.216938 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:07.880163    2561 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jul 07 17:40:08.216938 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:07.880167    2561 flags.go:64] FLAG: --eviction-hard=""
Jul 07 17:40:08.216938 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:07.880170    2561 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jul 07 17:40:08.216938 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:07.880173    2561 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jul 07 17:40:08.216938 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:07.880176    2561 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jul 07 17:40:08.216938 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:07.880179    2561 flags.go:64] FLAG: --eviction-soft=""
Jul 07 17:40:08.216938 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:07.880182    2561 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jul 07 17:40:08.216938 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:07.880185    2561 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jul 07 17:40:08.216938 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:07.880190    2561 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jul 07 17:40:08.216938 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:07.880193    2561 flags.go:64] FLAG: --experimental-mounter-path=""
Jul 07 17:40:08.216938 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:07.880196    2561 flags.go:64] FLAG: --fail-cgroupv1="false"
Jul 07 17:40:08.217812 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:07.880198    2561 flags.go:64] FLAG: --fail-swap-on="true"
Jul 07 17:40:08.217812 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:07.880201    2561 flags.go:64] FLAG: --feature-gates=""
Jul 07 17:40:08.217812 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:07.880205    2561 flags.go:64] FLAG: --file-check-frequency="20s"
Jul 07 17:40:08.217812 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:07.880208    2561 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jul 07 17:40:08.217812 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:07.880213    2561 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jul 07 17:40:08.217812 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:07.880216    2561 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jul 07 17:40:08.217812 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:07.880219    2561 flags.go:64] FLAG: --healthz-port="10248"
Jul 07 17:40:08.217812 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:07.880222    2561 flags.go:64] FLAG: --help="false"
Jul 07 17:40:08.217812 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:07.880224    2561 flags.go:64] FLAG: --hostname-override="ip-10-0-139-31.ec2.internal"
Jul 07 17:40:08.217812 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:07.880228    2561 flags.go:64] FLAG: --housekeeping-interval="10s"
Jul 07 17:40:08.217812 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:07.880231    2561 flags.go:64] FLAG: --http-check-frequency="20s"
Jul 07 17:40:08.217812 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:07.880234    2561 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jul 07 17:40:08.217812 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:07.880237    2561 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jul 07 17:40:08.217812 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:07.880241    2561 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jul 07 17:40:08.217812 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:07.880244    2561 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jul 07 17:40:08.217812 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:07.880246    2561 flags.go:64] FLAG: --image-service-endpoint=""
Jul 07 17:40:08.217812 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:07.880249    2561 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jul 07 17:40:08.217812 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:07.880252    2561 flags.go:64] FLAG: --kube-api-burst="100"
Jul 07 17:40:08.217812 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:07.880256    2561 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jul 07 17:40:08.217812 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:07.880259    2561 flags.go:64] FLAG: --kube-api-qps="50"
Jul 07 17:40:08.217812 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:07.880262    2561 flags.go:64] FLAG: --kube-reserved=""
Jul 07 17:40:08.217812 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:07.880265    2561 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jul 07 17:40:08.217812 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:07.880267    2561 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jul 07 17:40:08.217812 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:07.880270    2561 flags.go:64] FLAG: --kubelet-cgroups=""
Jul 07 17:40:08.218755 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:07.880273    2561 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jul 07 17:40:08.218755 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:07.880276    2561 flags.go:64] FLAG: --lock-file=""
Jul 07 17:40:08.218755 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:07.880279    2561 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jul 07 17:40:08.218755 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:07.880282    2561 flags.go:64] FLAG: --log-flush-frequency="5s"
Jul 07 17:40:08.218755 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:07.880285    2561 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jul 07 17:40:08.218755 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:07.880292    2561 flags.go:64] FLAG: --log-json-split-stream="false"
Jul 07 17:40:08.218755 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:07.880295    2561 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jul 07 17:40:08.218755 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:07.880298    2561 flags.go:64] FLAG: --log-text-split-stream="false"
Jul 07 17:40:08.218755 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:07.880301    2561 flags.go:64] FLAG: --logging-format="text"
Jul 07 17:40:08.218755 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:07.880303    2561 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jul 07 17:40:08.218755 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:07.880307    2561 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jul 07 17:40:08.218755 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:07.880309    2561 flags.go:64] FLAG: --manifest-url=""
Jul 07 17:40:08.218755 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:07.880314    2561 flags.go:64] FLAG: --manifest-url-header=""
Jul 07 17:40:08.218755 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:07.880319    2561 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jul 07 17:40:08.218755 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:07.880322    2561 flags.go:64] FLAG: --max-open-files="1000000"
Jul 07 17:40:08.218755 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:07.880326    2561 flags.go:64] FLAG: --max-pods="110"
Jul 07 17:40:08.218755 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:07.880329    2561 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jul 07 17:40:08.218755 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:07.880332    2561 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jul 07 17:40:08.218755 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:07.880335    2561 flags.go:64] FLAG: --memory-manager-policy="None"
Jul 07 17:40:08.218755 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:07.880338    2561 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jul 07 17:40:08.218755 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:07.880341    2561 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jul 07 17:40:08.218755 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:07.880344    2561 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jul 07 17:40:08.218755 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:07.880347    2561 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jul 07 17:40:08.218755 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:07.880358    2561 flags.go:64] FLAG: --node-status-max-images="50"
Jul 07 17:40:08.218755 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:07.880361    2561 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jul 07 17:40:08.219660 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:07.880364    2561 flags.go:64] FLAG: --oom-score-adj="-999"
Jul 07 17:40:08.219660 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:07.880367    2561 flags.go:64] FLAG: --pod-cidr=""
Jul 07 17:40:08.219660 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:07.880371    2561 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ce93f6b4197b9c62a26a3131f8057ffe9c9379c5079a4f62e5919b75151394e5"
Jul 07 17:40:08.219660 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:07.880376    2561 flags.go:64] FLAG: --pod-manifest-path=""
Jul 07 17:40:08.219660 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:07.880379    2561 flags.go:64] FLAG: --pod-max-pids="-1"
Jul 07 17:40:08.219660 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:07.880382    2561 flags.go:64] FLAG: --pods-per-core="0"
Jul 07 17:40:08.219660 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:07.880385    2561 flags.go:64] FLAG: --port="10250"
Jul 07 17:40:08.219660 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:07.880388    2561 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jul 07 17:40:08.219660 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:07.880391    2561 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0cc863daf1d6039b3"
Jul 07 17:40:08.219660 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:07.880394    2561 flags.go:64] FLAG: --qos-reserved=""
Jul 07 17:40:08.219660 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:07.880397    2561 flags.go:64] FLAG: --read-only-port="10255"
Jul 07 17:40:08.219660 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:07.880400    2561 flags.go:64] FLAG: --register-node="true"
Jul 07 17:40:08.219660 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:07.880402    2561 flags.go:64] FLAG: --register-with-taints=""
Jul 07 17:40:08.219660 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:07.880407    2561 flags.go:64] FLAG: --registry-burst="10"
Jul 07 17:40:08.219660 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:07.880410    2561 flags.go:64] FLAG: --registry-qps="5"
Jul 07 17:40:08.219660 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:07.880413    2561 flags.go:64] FLAG: --reserved-cpus=""
Jul 07 17:40:08.219660 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:07.880416    2561 flags.go:64] FLAG: --reserved-memory=""
Jul 07 17:40:08.219660 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:07.880419    2561 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jul 07 17:40:08.219660 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:07.880423    2561 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jul 07 17:40:08.219660 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:07.880427    2561 flags.go:64] FLAG: --rotate-certificates="false"
Jul 07 17:40:08.219660 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:07.880430    2561 flags.go:64] FLAG: --rotate-server-certificates="false"
Jul 07 17:40:08.219660 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:07.880433    2561 flags.go:64] FLAG: --runonce="false"
Jul 07 17:40:08.219660 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:07.880435    2561 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jul 07 17:40:08.219660 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:07.880438    2561 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jul 07 17:40:08.219660 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:07.880441    2561 flags.go:64] FLAG: --seccomp-default="false"
Jul 07 17:40:08.220568 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:07.880444    2561 flags.go:64] FLAG: --serialize-image-pulls="true"
Jul 07 17:40:08.220568 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:07.880447    2561 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jul 07 17:40:08.220568 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:07.880450    2561 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jul 07 17:40:08.220568 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:07.880453    2561 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jul 07 17:40:08.220568 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:07.880456    2561 flags.go:64] FLAG: --storage-driver-password="root"
Jul 07 17:40:08.220568 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:07.880459    2561 flags.go:64] FLAG: --storage-driver-secure="false"
Jul 07 17:40:08.220568 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:07.880462    2561 flags.go:64] FLAG: --storage-driver-table="stats"
Jul 07 17:40:08.220568 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:07.880465    2561 flags.go:64] FLAG: --storage-driver-user="root"
Jul 07 17:40:08.220568 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:07.880468    2561 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jul 07 17:40:08.220568 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:07.880471    2561 flags.go:64] FLAG: --sync-frequency="1m0s"
Jul 07 17:40:08.220568 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:07.880475    2561 flags.go:64] FLAG: --system-cgroups=""
Jul 07 17:40:08.220568 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:07.880477    2561 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jul 07 17:40:08.220568 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:07.880483    2561 flags.go:64] FLAG: --system-reserved-cgroup=""
Jul 07 17:40:08.220568 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:07.880486    2561 flags.go:64] FLAG: --tls-cert-file=""
Jul 07 17:40:08.220568 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:07.880488    2561 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jul 07 17:40:08.220568 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:07.880492    2561 flags.go:64] FLAG: --tls-min-version=""
Jul 07 17:40:08.220568 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:07.880496    2561 flags.go:64] FLAG: --tls-private-key-file=""
Jul 07 17:40:08.220568 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:07.880498    2561 flags.go:64] FLAG: --topology-manager-policy="none"
Jul 07 17:40:08.220568 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:07.880501    2561 flags.go:64] FLAG: --topology-manager-policy-options=""
Jul 07 17:40:08.220568 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:07.880504    2561 flags.go:64] FLAG: --topology-manager-scope="container"
Jul 07 17:40:08.220568 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:07.880508    2561 flags.go:64] FLAG: --v="2"
Jul 07 17:40:08.220568 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:07.880512    2561 flags.go:64] FLAG: --version="false"
Jul 07 17:40:08.220568 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:07.880516    2561 flags.go:64] FLAG: --vmodule=""
Jul 07 17:40:08.220568 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:07.880520    2561 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jul 07 17:40:08.220568 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:07.880523    2561 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jul 07 17:40:08.221364 ip-10-0-139-31 kubenswrapper[2561]: W0707 17:40:07.880647    2561 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 07 17:40:08.221364 ip-10-0-139-31 kubenswrapper[2561]: W0707 17:40:07.880653    2561 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 07 17:40:08.221364 ip-10-0-139-31 kubenswrapper[2561]: W0707 17:40:07.880656    2561 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 07 17:40:08.221364 ip-10-0-139-31 kubenswrapper[2561]: W0707 17:40:07.880659    2561 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 07 17:40:08.221364 ip-10-0-139-31 kubenswrapper[2561]: W0707 17:40:07.880662    2561 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 07 17:40:08.221364 ip-10-0-139-31 kubenswrapper[2561]: W0707 17:40:07.880665    2561 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 07 17:40:08.221364 ip-10-0-139-31 kubenswrapper[2561]: W0707 17:40:07.880668    2561 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 07 17:40:08.221364 ip-10-0-139-31 kubenswrapper[2561]: W0707 17:40:07.880671    2561 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 07 17:40:08.221364 ip-10-0-139-31 kubenswrapper[2561]: W0707 17:40:07.880674    2561 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 07 17:40:08.221364 ip-10-0-139-31 kubenswrapper[2561]: W0707 17:40:07.880677    2561 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 07 17:40:08.221364 ip-10-0-139-31 kubenswrapper[2561]: W0707 17:40:07.880680    2561 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 07 17:40:08.221364 ip-10-0-139-31 kubenswrapper[2561]: W0707 17:40:07.880682    2561 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 07 17:40:08.221364 ip-10-0-139-31 kubenswrapper[2561]: W0707 17:40:07.880685    2561 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 07 17:40:08.221364 ip-10-0-139-31 kubenswrapper[2561]: W0707 17:40:07.880688    2561 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 07 17:40:08.221364 ip-10-0-139-31 kubenswrapper[2561]: W0707 17:40:07.880690    2561 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 07 17:40:08.221364 ip-10-0-139-31 kubenswrapper[2561]: W0707 17:40:07.880693    2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 07 17:40:08.221364 ip-10-0-139-31 kubenswrapper[2561]: W0707 17:40:07.880695    2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 07 17:40:08.221364 ip-10-0-139-31 kubenswrapper[2561]: W0707 17:40:07.880698    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 07 17:40:08.221364 ip-10-0-139-31 kubenswrapper[2561]: W0707 17:40:07.880701    2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 07 17:40:08.221364 ip-10-0-139-31 kubenswrapper[2561]: W0707 17:40:07.880703    2561 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 07 17:40:08.221945 ip-10-0-139-31 kubenswrapper[2561]: W0707 17:40:07.880706    2561 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 07 17:40:08.221945 ip-10-0-139-31 kubenswrapper[2561]: W0707 17:40:07.880709    2561 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 07 17:40:08.221945 ip-10-0-139-31 kubenswrapper[2561]: W0707 17:40:07.880712    2561 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 07 17:40:08.221945 ip-10-0-139-31 kubenswrapper[2561]: W0707 17:40:07.880715    2561 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 07 17:40:08.221945 ip-10-0-139-31 kubenswrapper[2561]: W0707 17:40:07.880717    2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 07 17:40:08.221945 ip-10-0-139-31 kubenswrapper[2561]: W0707 17:40:07.880720    2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 07 17:40:08.221945 ip-10-0-139-31 kubenswrapper[2561]: W0707 17:40:07.880723    2561 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 07 17:40:08.221945 ip-10-0-139-31 kubenswrapper[2561]: W0707 17:40:07.880727    2561 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 07 17:40:08.221945 ip-10-0-139-31 kubenswrapper[2561]: W0707 17:40:07.880729    2561 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 07 17:40:08.221945 ip-10-0-139-31 kubenswrapper[2561]: W0707 17:40:07.880732    2561 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 07 17:40:08.221945 ip-10-0-139-31 kubenswrapper[2561]: W0707 17:40:07.880734    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 07 17:40:08.221945 ip-10-0-139-31 kubenswrapper[2561]: W0707 17:40:07.880737    2561 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 07 17:40:08.221945 ip-10-0-139-31 kubenswrapper[2561]: W0707 17:40:07.880739    2561 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 07 17:40:08.221945 ip-10-0-139-31 kubenswrapper[2561]: W0707 17:40:07.880744    2561 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 07 17:40:08.221945 ip-10-0-139-31 kubenswrapper[2561]: W0707 17:40:07.880748    2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 07 17:40:08.221945 ip-10-0-139-31 kubenswrapper[2561]: W0707 17:40:07.880751    2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 07 17:40:08.221945 ip-10-0-139-31 kubenswrapper[2561]: W0707 17:40:07.880753    2561 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 07 17:40:08.221945 ip-10-0-139-31 kubenswrapper[2561]: W0707 17:40:07.880756    2561 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 07 17:40:08.221945 ip-10-0-139-31 kubenswrapper[2561]: W0707 17:40:07.880759    2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 07 17:40:08.221945 ip-10-0-139-31 kubenswrapper[2561]: W0707 17:40:07.880762    2561 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 07 17:40:08.222595 ip-10-0-139-31 kubenswrapper[2561]: W0707 17:40:07.880766    2561 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 07 17:40:08.222595 ip-10-0-139-31 kubenswrapper[2561]: W0707 17:40:07.880770    2561 feature_gate.go:328] unrecognized feature gate: Example2
Jul 07 17:40:08.222595 ip-10-0-139-31 kubenswrapper[2561]: W0707 17:40:07.880772    2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 07 17:40:08.222595 ip-10-0-139-31 kubenswrapper[2561]: W0707 17:40:07.880775    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 07 17:40:08.222595 ip-10-0-139-31 kubenswrapper[2561]: W0707 17:40:07.880778    2561 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 07 17:40:08.222595 ip-10-0-139-31 kubenswrapper[2561]: W0707 17:40:07.880780    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 07 17:40:08.222595 ip-10-0-139-31 kubenswrapper[2561]: W0707 17:40:07.880783    2561 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 07 17:40:08.222595 ip-10-0-139-31 kubenswrapper[2561]: W0707 17:40:07.880786    2561 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 07 17:40:08.222595 ip-10-0-139-31 kubenswrapper[2561]: W0707 17:40:07.880788    2561 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 07 17:40:08.222595 ip-10-0-139-31 kubenswrapper[2561]: W0707 17:40:07.880791    2561 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 07 17:40:08.222595 ip-10-0-139-31 kubenswrapper[2561]: W0707 17:40:07.880793    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 07 17:40:08.222595 ip-10-0-139-31 kubenswrapper[2561]: W0707 17:40:07.880796    2561 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 07 17:40:08.222595 ip-10-0-139-31 kubenswrapper[2561]: W0707 17:40:07.880799    2561 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 07 17:40:08.222595 ip-10-0-139-31 kubenswrapper[2561]: W0707 17:40:07.880801    2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 07 17:40:08.222595 ip-10-0-139-31 kubenswrapper[2561]: W0707 17:40:07.880804    2561 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 07 17:40:08.222595 ip-10-0-139-31 kubenswrapper[2561]: W0707 17:40:07.880806    2561 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 07 17:40:08.222595 ip-10-0-139-31 kubenswrapper[2561]: W0707 17:40:07.880808    2561 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 07 17:40:08.222595 ip-10-0-139-31 kubenswrapper[2561]: W0707 17:40:07.880811    2561 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 07 17:40:08.222595 ip-10-0-139-31 kubenswrapper[2561]: W0707 17:40:07.880813    2561 feature_gate.go:328] unrecognized feature gate: Example
Jul 07 17:40:08.222595 ip-10-0-139-31 kubenswrapper[2561]: W0707 17:40:07.880817    2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 07 17:40:08.223297 ip-10-0-139-31 kubenswrapper[2561]: W0707 17:40:07.880820    2561 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 07 17:40:08.223297 ip-10-0-139-31 kubenswrapper[2561]: W0707 17:40:07.880822    2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 07 17:40:08.223297 ip-10-0-139-31 kubenswrapper[2561]: W0707 17:40:07.880825    2561 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 07 17:40:08.223297 ip-10-0-139-31 kubenswrapper[2561]: W0707 17:40:07.880828    2561 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 07 17:40:08.223297 ip-10-0-139-31 kubenswrapper[2561]: W0707 17:40:07.880831    2561 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 07 17:40:08.223297 ip-10-0-139-31 kubenswrapper[2561]: W0707 17:40:07.880835    2561 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 07 17:40:08.223297 ip-10-0-139-31 kubenswrapper[2561]: W0707 17:40:07.880855    2561 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 07 17:40:08.223297 ip-10-0-139-31 kubenswrapper[2561]: W0707 17:40:07.880858    2561 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 07 17:40:08.223297 ip-10-0-139-31 kubenswrapper[2561]: W0707 17:40:07.880861    2561 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 07 17:40:08.223297 ip-10-0-139-31 kubenswrapper[2561]: W0707 17:40:07.880864    2561 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 07 17:40:08.223297 ip-10-0-139-31 kubenswrapper[2561]: W0707 17:40:07.880868    2561 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 07 17:40:08.223297 ip-10-0-139-31 kubenswrapper[2561]: W0707 17:40:07.880871    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 07 17:40:08.223297 ip-10-0-139-31 kubenswrapper[2561]: W0707 17:40:07.880874    2561 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 07 17:40:08.223297 ip-10-0-139-31 kubenswrapper[2561]: W0707 17:40:07.880876    2561 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 07 17:40:08.223297 ip-10-0-139-31 kubenswrapper[2561]: W0707 17:40:07.880879    2561 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 07 17:40:08.223297 ip-10-0-139-31 kubenswrapper[2561]: W0707 17:40:07.880881    2561 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 07 17:40:08.223297 ip-10-0-139-31 kubenswrapper[2561]: W0707 17:40:07.880884    2561 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 07 17:40:08.223297 ip-10-0-139-31 kubenswrapper[2561]: W0707 17:40:07.880886    2561 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 07 17:40:08.223297 ip-10-0-139-31 kubenswrapper[2561]: W0707 17:40:07.880889    2561 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 07 17:40:08.223873 ip-10-0-139-31 kubenswrapper[2561]: W0707 17:40:07.880892    2561 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 07 17:40:08.223873 ip-10-0-139-31 kubenswrapper[2561]: W0707 17:40:07.880894    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 07 17:40:08.223873 ip-10-0-139-31 kubenswrapper[2561]: W0707 17:40:07.880896    2561 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 07 17:40:08.223873 ip-10-0-139-31 kubenswrapper[2561]: W0707 17:40:07.880899    2561 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 07 17:40:08.223873 ip-10-0-139-31 kubenswrapper[2561]: W0707 17:40:07.880902    2561 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 07 17:40:08.223873 ip-10-0-139-31 kubenswrapper[2561]: W0707 17:40:07.880905    2561 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 07 17:40:08.223873 ip-10-0-139-31 kubenswrapper[2561]: W0707 17:40:07.880907    2561 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 07 17:40:08.223873 ip-10-0-139-31 kubenswrapper[2561]: W0707 17:40:07.880910    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 07 17:40:08.223873 ip-10-0-139-31 kubenswrapper[2561]: W0707 17:40:07.880912    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 07 17:40:08.223873 ip-10-0-139-31 kubenswrapper[2561]: W0707 17:40:07.880915    2561 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 07 17:40:08.223873 ip-10-0-139-31 kubenswrapper[2561]: W0707 17:40:07.880918    2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 07 17:40:08.223873 ip-10-0-139-31 kubenswrapper[2561]: W0707 17:40:07.880920    2561 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 07 17:40:08.223873 ip-10-0-139-31 kubenswrapper[2561]: W0707 17:40:07.880927    2561 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 07 17:40:08.223873 ip-10-0-139-31 kubenswrapper[2561]: W0707 17:40:07.880930    2561 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 07 17:40:08.223873 ip-10-0-139-31 kubenswrapper[2561]: W0707 17:40:07.880934    2561 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 07 17:40:08.223873 ip-10-0-139-31 kubenswrapper[2561]: W0707 17:40:07.880937    2561 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 07 17:40:08.223873 ip-10-0-139-31 kubenswrapper[2561]: W0707 17:40:07.880939    2561 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 07 17:40:08.223873 ip-10-0-139-31 kubenswrapper[2561]: W0707 17:40:07.880942    2561 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 07 17:40:08.223873 ip-10-0-139-31 kubenswrapper[2561]: W0707 17:40:07.880946    2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 07 17:40:08.224652 ip-10-0-139-31 kubenswrapper[2561]: W0707 17:40:07.880948    2561 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 07 17:40:08.224652 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:07.881771    2561 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 07 17:40:08.224652 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:07.889341    2561 server.go:529] "Kubelet version" kubeletVersion="v1.34.8"
Jul 07 17:40:08.224652 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:07.889358    2561 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jul 07 17:40:08.224652 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:07.890323    2561 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jul 07 17:40:08.224652 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:07.890330    2561 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jul 07 17:40:08.224652 ip-10-0-139-31 kubenswrapper[2561]: W0707 17:40:07.890413    2561 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 07 17:40:08.224652 ip-10-0-139-31 kubenswrapper[2561]: W0707 17:40:07.890418    2561 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 07 17:40:08.224652 ip-10-0-139-31 kubenswrapper[2561]: W0707 17:40:07.890422    2561 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 07 17:40:08.224652 ip-10-0-139-31 kubenswrapper[2561]: W0707 17:40:07.890427    2561 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 07 17:40:08.224652 ip-10-0-139-31 kubenswrapper[2561]: W0707 17:40:07.890431    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 07 17:40:08.224652 ip-10-0-139-31 kubenswrapper[2561]: W0707 17:40:07.890434    2561 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 07 17:40:08.224652 ip-10-0-139-31 kubenswrapper[2561]: W0707 17:40:07.890437    2561 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 07 17:40:08.224652 ip-10-0-139-31 kubenswrapper[2561]: W0707 17:40:07.890440    2561 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 07 17:40:08.224652 ip-10-0-139-31 kubenswrapper[2561]: W0707 17:40:07.890443    2561 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 07 17:40:08.225298 ip-10-0-139-31 kubenswrapper[2561]: W0707 17:40:07.890446    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 07 17:40:08.225298 ip-10-0-139-31 kubenswrapper[2561]: W0707 17:40:07.890449    2561 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 07 17:40:08.225298 ip-10-0-139-31 kubenswrapper[2561]: W0707 17:40:07.890452    2561 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 07 17:40:08.225298 ip-10-0-139-31 kubenswrapper[2561]: W0707 17:40:07.890462    2561 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 07 17:40:08.225298 ip-10-0-139-31 kubenswrapper[2561]: W0707 17:40:07.890465    2561 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 07 17:40:08.225298 ip-10-0-139-31 kubenswrapper[2561]: W0707 17:40:07.890476    2561 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 07 17:40:08.225298 ip-10-0-139-31 kubenswrapper[2561]: W0707 17:40:07.890479    2561 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 07 17:40:08.225298 ip-10-0-139-31 kubenswrapper[2561]: W0707 17:40:07.890483    2561 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 07 17:40:08.225298 ip-10-0-139-31 kubenswrapper[2561]: W0707 17:40:07.890485    2561 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 07 17:40:08.225298 ip-10-0-139-31 kubenswrapper[2561]: W0707 17:40:07.890488    2561 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 07 17:40:08.225298 ip-10-0-139-31 kubenswrapper[2561]: W0707 17:40:07.890490    2561 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 07 17:40:08.225298 ip-10-0-139-31 kubenswrapper[2561]: W0707 17:40:07.890493    2561 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 07 17:40:08.225298 ip-10-0-139-31 kubenswrapper[2561]: W0707 17:40:07.890496    2561 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 07 17:40:08.225298 ip-10-0-139-31 kubenswrapper[2561]: W0707 17:40:07.890503    2561 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 07 17:40:08.225298 ip-10-0-139-31 kubenswrapper[2561]: W0707 17:40:07.890506    2561 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 07 17:40:08.225298 ip-10-0-139-31 kubenswrapper[2561]: W0707 17:40:07.890509    2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 07 17:40:08.225298 ip-10-0-139-31 kubenswrapper[2561]: W0707 17:40:07.890511    2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 07 17:40:08.225298 ip-10-0-139-31 kubenswrapper[2561]: W0707 17:40:07.890514    2561 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 07 17:40:08.225298 ip-10-0-139-31 kubenswrapper[2561]: W0707 17:40:07.890517    2561 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 07 17:40:08.225298 ip-10-0-139-31 kubenswrapper[2561]: W0707 17:40:07.890520    2561 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 07 17:40:08.225943 ip-10-0-139-31 kubenswrapper[2561]: W0707 17:40:07.890523    2561 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 07 17:40:08.225943 ip-10-0-139-31 kubenswrapper[2561]: W0707 17:40:07.890525    2561 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 07 17:40:08.225943 ip-10-0-139-31 kubenswrapper[2561]: W0707 17:40:07.890528    2561 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 07 17:40:08.225943 ip-10-0-139-31 kubenswrapper[2561]: W0707 17:40:07.890530    2561 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 07 17:40:08.225943 ip-10-0-139-31 kubenswrapper[2561]: W0707 17:40:07.890533    2561 feature_gate.go:328] unrecognized feature gate: Example
Jul 07 17:40:08.225943 ip-10-0-139-31 kubenswrapper[2561]: W0707 17:40:07.890535    2561 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 07 17:40:08.225943 ip-10-0-139-31 kubenswrapper[2561]: W0707 17:40:07.890538    2561 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 07 17:40:08.225943 ip-10-0-139-31 kubenswrapper[2561]: W0707 17:40:07.890540    2561 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 07 17:40:08.225943 ip-10-0-139-31 kubenswrapper[2561]: W0707 17:40:07.890543    2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 07 17:40:08.225943 ip-10-0-139-31 kubenswrapper[2561]: W0707 17:40:07.890545    2561 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 07 17:40:08.225943 ip-10-0-139-31 kubenswrapper[2561]: W0707 17:40:07.890548    2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 07 17:40:08.225943 ip-10-0-139-31 kubenswrapper[2561]: W0707 17:40:07.890550    2561 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 07 17:40:08.225943 ip-10-0-139-31 kubenswrapper[2561]: W0707 17:40:07.890553    2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 07 17:40:08.225943 ip-10-0-139-31 kubenswrapper[2561]: W0707 17:40:07.890555    2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 07 17:40:08.225943 ip-10-0-139-31 kubenswrapper[2561]: W0707 17:40:07.890558    2561 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 07 17:40:08.225943 ip-10-0-139-31 kubenswrapper[2561]: W0707 17:40:07.890561    2561 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 07 17:40:08.225943 ip-10-0-139-31 kubenswrapper[2561]: W0707 17:40:07.890569    2561 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 07 17:40:08.225943 ip-10-0-139-31 kubenswrapper[2561]: W0707 17:40:07.890572    2561 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 07 17:40:08.225943 ip-10-0-139-31 kubenswrapper[2561]: W0707 17:40:07.890574    2561 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 07 17:40:08.225943 ip-10-0-139-31 kubenswrapper[2561]: W0707 17:40:07.890576    2561 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 07 17:40:08.226507 ip-10-0-139-31 kubenswrapper[2561]: W0707 17:40:07.890579    2561 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 07 17:40:08.226507 ip-10-0-139-31 kubenswrapper[2561]: W0707 17:40:07.890582    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 07 17:40:08.226507 ip-10-0-139-31 kubenswrapper[2561]: W0707 17:40:07.890584    2561 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 07 17:40:08.226507 ip-10-0-139-31 kubenswrapper[2561]: W0707 17:40:07.890586    2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 07 17:40:08.226507 ip-10-0-139-31 kubenswrapper[2561]: W0707 17:40:07.890589    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 07 17:40:08.226507 ip-10-0-139-31 kubenswrapper[2561]: W0707 17:40:07.890592    2561 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 07 17:40:08.226507 ip-10-0-139-31 kubenswrapper[2561]: W0707 17:40:07.890594    2561 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 07 17:40:08.226507 ip-10-0-139-31 kubenswrapper[2561]: W0707 17:40:07.890597    2561 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 07 17:40:08.226507 ip-10-0-139-31 kubenswrapper[2561]: W0707 17:40:07.890599    2561 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 07 17:40:08.226507 ip-10-0-139-31 kubenswrapper[2561]: W0707 17:40:07.890604    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 07 17:40:08.226507 ip-10-0-139-31 kubenswrapper[2561]: W0707 17:40:07.890607    2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 07 17:40:08.226507 ip-10-0-139-31 kubenswrapper[2561]: W0707 17:40:07.890610    2561 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 07 17:40:08.226507 ip-10-0-139-31 kubenswrapper[2561]: W0707 17:40:07.890613    2561 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 07 17:40:08.226507 ip-10-0-139-31 kubenswrapper[2561]: W0707 17:40:07.890615    2561 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 07 17:40:08.226507 ip-10-0-139-31 kubenswrapper[2561]: W0707 17:40:07.890618    2561 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 07 17:40:08.226507 ip-10-0-139-31 kubenswrapper[2561]: W0707 17:40:07.890620    2561 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 07 17:40:08.226507 ip-10-0-139-31 kubenswrapper[2561]: W0707 17:40:07.890623    2561 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 07 17:40:08.226507 ip-10-0-139-31 kubenswrapper[2561]: W0707 17:40:07.890625    2561 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 07 17:40:08.226507 ip-10-0-139-31 kubenswrapper[2561]: W0707 17:40:07.890628    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 07 17:40:08.227609 ip-10-0-139-31 kubenswrapper[2561]: W0707 17:40:07.890631    2561 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 07 17:40:08.227609 ip-10-0-139-31 kubenswrapper[2561]: W0707 17:40:07.890633    2561 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 07 17:40:08.227609 ip-10-0-139-31 kubenswrapper[2561]: W0707 17:40:07.890636    2561 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 07 17:40:08.227609 ip-10-0-139-31 kubenswrapper[2561]: W0707 17:40:07.890638    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 07 17:40:08.227609 ip-10-0-139-31 kubenswrapper[2561]: W0707 17:40:07.890641    2561 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 07 17:40:08.227609 ip-10-0-139-31 kubenswrapper[2561]: W0707 17:40:07.890644    2561 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 07 17:40:08.227609 ip-10-0-139-31 kubenswrapper[2561]: W0707 17:40:07.890646    2561 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 07 17:40:08.227609 ip-10-0-139-31 kubenswrapper[2561]: W0707 17:40:07.890649    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 07 17:40:08.227609 ip-10-0-139-31 kubenswrapper[2561]: W0707 17:40:07.890651    2561 feature_gate.go:328] unrecognized feature gate: Example2
Jul 07 17:40:08.227609 ip-10-0-139-31 kubenswrapper[2561]: W0707 17:40:07.890654    2561 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 07 17:40:08.227609 ip-10-0-139-31 kubenswrapper[2561]: W0707 17:40:07.890662    2561 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 07 17:40:08.227609 ip-10-0-139-31 kubenswrapper[2561]: W0707 17:40:07.890665    2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 07 17:40:08.227609 ip-10-0-139-31 kubenswrapper[2561]: W0707 17:40:07.890668    2561 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 07 17:40:08.227609 ip-10-0-139-31 kubenswrapper[2561]: W0707 17:40:07.890670    2561 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 07 17:40:08.227609 ip-10-0-139-31 kubenswrapper[2561]: W0707 17:40:07.890673    2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 07 17:40:08.227609 ip-10-0-139-31 kubenswrapper[2561]: W0707 17:40:07.890675    2561 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 07 17:40:08.227609 ip-10-0-139-31 kubenswrapper[2561]: W0707 17:40:07.890678    2561 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 07 17:40:08.227609 ip-10-0-139-31 kubenswrapper[2561]: W0707 17:40:07.890680    2561 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 07 17:40:08.227609 ip-10-0-139-31 kubenswrapper[2561]: W0707 17:40:07.890683    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 07 17:40:08.228446 ip-10-0-139-31 kubenswrapper[2561]: W0707 17:40:07.890687    2561 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 07 17:40:08.228446 ip-10-0-139-31 kubenswrapper[2561]: W0707 17:40:07.890690    2561 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 07 17:40:08.228446 ip-10-0-139-31 kubenswrapper[2561]: W0707 17:40:07.890694    2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 07 17:40:08.228446 ip-10-0-139-31 kubenswrapper[2561]: W0707 17:40:07.890698    2561 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 07 17:40:08.228446 ip-10-0-139-31 kubenswrapper[2561]: W0707 17:40:07.890701    2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 07 17:40:08.228446 ip-10-0-139-31 kubenswrapper[2561]: W0707 17:40:07.890703    2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 07 17:40:08.228446 ip-10-0-139-31 kubenswrapper[2561]: W0707 17:40:07.890706    2561 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 07 17:40:08.228446 ip-10-0-139-31 kubenswrapper[2561]: W0707 17:40:07.890708    2561 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 07 17:40:08.228446 ip-10-0-139-31 kubenswrapper[2561]: W0707 17:40:07.890711    2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 07 17:40:08.228446 ip-10-0-139-31 kubenswrapper[2561]: W0707 17:40:07.890714    2561 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 07 17:40:08.228446 ip-10-0-139-31 kubenswrapper[2561]: W0707 17:40:07.890716    2561 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 07 17:40:08.228446 ip-10-0-139-31 kubenswrapper[2561]: W0707 17:40:07.890720    2561 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 07 17:40:08.228446 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:07.890731    2561 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 07 17:40:08.228446 ip-10-0-139-31 kubenswrapper[2561]: W0707 17:40:07.890910    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 07 17:40:08.298255 ip-10-0-139-31 kubenswrapper[2561]: W0707 17:40:07.890915    2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 07 17:40:08.298255 ip-10-0-139-31 kubenswrapper[2561]: W0707 17:40:07.890918    2561 feature_gate.go:328] unrecognized feature gate: Example
Jul 07 17:40:08.298255 ip-10-0-139-31 kubenswrapper[2561]: W0707 17:40:07.890921    2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 07 17:40:08.298255 ip-10-0-139-31 kubenswrapper[2561]: W0707 17:40:07.890924    2561 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 07 17:40:08.298255 ip-10-0-139-31 kubenswrapper[2561]: W0707 17:40:07.890927    2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 07 17:40:08.298255 ip-10-0-139-31 kubenswrapper[2561]: W0707 17:40:07.890930    2561 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 07 17:40:08.298255 ip-10-0-139-31 kubenswrapper[2561]: W0707 17:40:07.890933    2561 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 07 17:40:08.298255 ip-10-0-139-31 kubenswrapper[2561]: W0707 17:40:07.890936    2561 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 07 17:40:08.298255 ip-10-0-139-31 kubenswrapper[2561]: W0707 17:40:07.890939    2561 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 07 17:40:08.298255 ip-10-0-139-31 kubenswrapper[2561]: W0707 17:40:07.890943    2561 feature_gate.go:328] unrecognized feature gate: Example2
Jul 07 17:40:08.298255 ip-10-0-139-31 kubenswrapper[2561]: W0707 17:40:07.890954    2561 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 07 17:40:08.298255 ip-10-0-139-31 kubenswrapper[2561]: W0707 17:40:07.890957    2561 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 07 17:40:08.298255 ip-10-0-139-31 kubenswrapper[2561]: W0707 17:40:07.890960    2561 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 07 17:40:08.298255 ip-10-0-139-31 kubenswrapper[2561]: W0707 17:40:07.890962    2561 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 07 17:40:08.298255 ip-10-0-139-31 kubenswrapper[2561]: W0707 17:40:07.890966    2561 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 07 17:40:08.298255 ip-10-0-139-31 kubenswrapper[2561]: W0707 17:40:07.890968    2561 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 07 17:40:08.298255 ip-10-0-139-31 kubenswrapper[2561]: W0707 17:40:07.890971    2561 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 07 17:40:08.298255 ip-10-0-139-31 kubenswrapper[2561]: W0707 17:40:07.890975    2561 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 07 17:40:08.298255 ip-10-0-139-31 kubenswrapper[2561]: W0707 17:40:07.890978    2561 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 07 17:40:08.299095 ip-10-0-139-31 kubenswrapper[2561]: W0707 17:40:07.890981    2561 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 07 17:40:08.299095 ip-10-0-139-31 kubenswrapper[2561]: W0707 17:40:07.890984    2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 07 17:40:08.299095 ip-10-0-139-31 kubenswrapper[2561]: W0707 17:40:07.890988    2561 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 07 17:40:08.299095 ip-10-0-139-31 kubenswrapper[2561]: W0707 17:40:07.890993    2561 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 07 17:40:08.299095 ip-10-0-139-31 kubenswrapper[2561]: W0707 17:40:07.890996    2561 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 07 17:40:08.299095 ip-10-0-139-31 kubenswrapper[2561]: W0707 17:40:07.890998    2561 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 07 17:40:08.299095 ip-10-0-139-31 kubenswrapper[2561]: W0707 17:40:07.891001    2561 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 07 17:40:08.299095 ip-10-0-139-31 kubenswrapper[2561]: W0707 17:40:07.891004    2561 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 07 17:40:08.299095 ip-10-0-139-31 kubenswrapper[2561]: W0707 17:40:07.891007    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 07 17:40:08.299095 ip-10-0-139-31 kubenswrapper[2561]: W0707 17:40:07.891009    2561 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 07 17:40:08.299095 ip-10-0-139-31 kubenswrapper[2561]: W0707 17:40:07.891012    2561 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 07 17:40:08.299095 ip-10-0-139-31 kubenswrapper[2561]: W0707 17:40:07.891014    2561 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 07 17:40:08.299095 ip-10-0-139-31 kubenswrapper[2561]: W0707 17:40:07.891017    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 07 17:40:08.299095 ip-10-0-139-31 kubenswrapper[2561]: W0707 17:40:07.891021    2561 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 07 17:40:08.299095 ip-10-0-139-31 kubenswrapper[2561]: W0707 17:40:07.891024    2561 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 07 17:40:08.299095 ip-10-0-139-31 kubenswrapper[2561]: W0707 17:40:07.891027    2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 07 17:40:08.299095 ip-10-0-139-31 kubenswrapper[2561]: W0707 17:40:07.891030    2561 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 07 17:40:08.299095 ip-10-0-139-31 kubenswrapper[2561]: W0707 17:40:07.891033    2561 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 07 17:40:08.299095 ip-10-0-139-31 kubenswrapper[2561]: W0707 17:40:07.891036    2561 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 07 17:40:08.300393 ip-10-0-139-31 kubenswrapper[2561]: W0707 17:40:07.891039    2561 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 07 17:40:08.300393 ip-10-0-139-31 kubenswrapper[2561]: W0707 17:40:07.891042    2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 07 17:40:08.300393 ip-10-0-139-31 kubenswrapper[2561]: W0707 17:40:07.891044    2561 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 07 17:40:08.300393 ip-10-0-139-31 kubenswrapper[2561]: W0707 17:40:07.891048    2561 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 07 17:40:08.300393 ip-10-0-139-31 kubenswrapper[2561]: W0707 17:40:07.891050    2561 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 07 17:40:08.300393 ip-10-0-139-31 kubenswrapper[2561]: W0707 17:40:07.891060    2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 07 17:40:08.300393 ip-10-0-139-31 kubenswrapper[2561]: W0707 17:40:07.891063    2561 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 07 17:40:08.300393 ip-10-0-139-31 kubenswrapper[2561]: W0707 17:40:07.891066    2561 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 07 17:40:08.300393 ip-10-0-139-31 kubenswrapper[2561]: W0707 17:40:07.891068    2561 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 07 17:40:08.300393 ip-10-0-139-31 kubenswrapper[2561]: W0707 17:40:07.891071    2561 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 07 17:40:08.300393 ip-10-0-139-31 kubenswrapper[2561]: W0707 17:40:07.891073    2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 07 17:40:08.300393 ip-10-0-139-31 kubenswrapper[2561]: W0707 17:40:07.891076    2561 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 07 17:40:08.300393 ip-10-0-139-31 kubenswrapper[2561]: W0707 17:40:07.891078    2561 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 07 17:40:08.300393 ip-10-0-139-31 kubenswrapper[2561]: W0707 17:40:07.891081    2561 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 07 17:40:08.300393 ip-10-0-139-31 kubenswrapper[2561]: W0707 17:40:07.891083    2561 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 07 17:40:08.300393 ip-10-0-139-31 kubenswrapper[2561]: W0707 17:40:07.891086    2561 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 07 17:40:08.300393 ip-10-0-139-31 kubenswrapper[2561]: W0707 17:40:07.891089    2561 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 07 17:40:08.300393 ip-10-0-139-31 kubenswrapper[2561]: W0707 17:40:07.891092    2561 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 07 17:40:08.300393 ip-10-0-139-31 kubenswrapper[2561]: W0707 17:40:07.891094    2561 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 07 17:40:08.300393 ip-10-0-139-31 kubenswrapper[2561]: W0707 17:40:07.891097    2561 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 07 17:40:08.301208 ip-10-0-139-31 kubenswrapper[2561]: W0707 17:40:07.891100    2561 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 07 17:40:08.301208 ip-10-0-139-31 kubenswrapper[2561]: W0707 17:40:07.891102    2561 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 07 17:40:08.301208 ip-10-0-139-31 kubenswrapper[2561]: W0707 17:40:07.891105    2561 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 07 17:40:08.301208 ip-10-0-139-31 kubenswrapper[2561]: W0707 17:40:07.891107    2561 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 07 17:40:08.301208 ip-10-0-139-31 kubenswrapper[2561]: W0707 17:40:07.891110    2561 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 07 17:40:08.301208 ip-10-0-139-31 kubenswrapper[2561]: W0707 17:40:07.891112    2561 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 07 17:40:08.301208 ip-10-0-139-31 kubenswrapper[2561]: W0707 17:40:07.891115    2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 07 17:40:08.301208 ip-10-0-139-31 kubenswrapper[2561]: W0707 17:40:07.891117    2561 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 07 17:40:08.301208 ip-10-0-139-31 kubenswrapper[2561]: W0707 17:40:07.891120    2561 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 07 17:40:08.301208 ip-10-0-139-31 kubenswrapper[2561]: W0707 17:40:07.891122    2561 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 07 17:40:08.301208 ip-10-0-139-31 kubenswrapper[2561]: W0707 17:40:07.891125    2561 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 07 17:40:08.301208 ip-10-0-139-31 kubenswrapper[2561]: W0707 17:40:07.891128    2561 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 07 17:40:08.301208 ip-10-0-139-31 kubenswrapper[2561]: W0707 17:40:07.891130    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 07 17:40:08.301208 ip-10-0-139-31 kubenswrapper[2561]: W0707 17:40:07.891133    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 07 17:40:08.301208 ip-10-0-139-31 kubenswrapper[2561]: W0707 17:40:07.891135    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 07 17:40:08.301208 ip-10-0-139-31 kubenswrapper[2561]: W0707 17:40:07.891141    2561 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 07 17:40:08.301208 ip-10-0-139-31 kubenswrapper[2561]: W0707 17:40:07.891143    2561 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 07 17:40:08.301208 ip-10-0-139-31 kubenswrapper[2561]: W0707 17:40:07.891146    2561 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 07 17:40:08.301208 ip-10-0-139-31 kubenswrapper[2561]: W0707 17:40:07.891154    2561 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 07 17:40:08.301813 ip-10-0-139-31 kubenswrapper[2561]: W0707 17:40:07.891156    2561 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 07 17:40:08.301813 ip-10-0-139-31 kubenswrapper[2561]: W0707 17:40:07.891159    2561 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 07 17:40:08.301813 ip-10-0-139-31 kubenswrapper[2561]: W0707 17:40:07.891161    2561 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 07 17:40:08.301813 ip-10-0-139-31 kubenswrapper[2561]: W0707 17:40:07.891164    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 07 17:40:08.301813 ip-10-0-139-31 kubenswrapper[2561]: W0707 17:40:07.891166    2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 07 17:40:08.301813 ip-10-0-139-31 kubenswrapper[2561]: W0707 17:40:07.891169    2561 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 07 17:40:08.301813 ip-10-0-139-31 kubenswrapper[2561]: W0707 17:40:07.891172    2561 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 07 17:40:08.301813 ip-10-0-139-31 kubenswrapper[2561]: W0707 17:40:07.891174    2561 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 07 17:40:08.301813 ip-10-0-139-31 kubenswrapper[2561]: W0707 17:40:07.891177    2561 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 07 17:40:08.301813 ip-10-0-139-31 kubenswrapper[2561]: W0707 17:40:07.891180    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 07 17:40:08.301813 ip-10-0-139-31 kubenswrapper[2561]: W0707 17:40:07.891183    2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 07 17:40:08.301813 ip-10-0-139-31 kubenswrapper[2561]: W0707 17:40:07.891185    2561 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 07 17:40:08.301813 ip-10-0-139-31 kubenswrapper[2561]: W0707 17:40:07.891188    2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 07 17:40:08.301813 ip-10-0-139-31 kubenswrapper[2561]: W0707 17:40:07.891190    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 07 17:40:08.301813 ip-10-0-139-31 kubenswrapper[2561]: W0707 17:40:07.891193    2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 07 17:40:08.301813 ip-10-0-139-31 kubenswrapper[2561]: W0707 17:40:07.891195    2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 07 17:40:08.301813 ip-10-0-139-31 kubenswrapper[2561]: W0707 17:40:07.891198    2561 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 07 17:40:08.301813 ip-10-0-139-31 kubenswrapper[2561]: W0707 17:40:07.891200    2561 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 07 17:40:08.301813 ip-10-0-139-31 kubenswrapper[2561]: W0707 17:40:07.891203    2561 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 07 17:40:08.301813 ip-10-0-139-31 kubenswrapper[2561]: W0707 17:40:07.891205    2561 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 07 17:40:08.302823 ip-10-0-139-31 kubenswrapper[2561]: W0707 17:40:07.891208    2561 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 07 17:40:08.302823 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:07.891213    2561 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 07 17:40:08.302823 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:07.891350    2561 server.go:962] "Client rotation is on, will bootstrap in background"
Jul 07 17:40:08.302823 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:07.893870    2561 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jul 07 17:40:08.302823 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:07.895712    2561 server.go:1019] "Starting client certificate rotation"
Jul 07 17:40:08.302823 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:07.895820    2561 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 07 17:40:08.302823 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:07.896674    2561 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 07 17:40:08.302823 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:07.899160    2561 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 07 17:40:08.302823 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:07.907284    2561 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 07 17:40:08.302823 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:07.919949    2561 log.go:25] "Validated CRI v1 runtime API"
Jul 07 17:40:08.302823 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:07.923297    2561 log.go:25] "Validated CRI v1 image API"
Jul 07 17:40:08.302823 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:07.924231    2561 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jul 07 17:40:08.303231 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:07.926939    2561 fs.go:135] Filesystem UUIDs: map[49fd5717-50a4-4d36-b909-ba9a7ffd7139:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 9a4e1745-c84e-4fff-a027-27bcfc1c3b5c:/dev/nvme0n1p4]
Jul 07 17:40:08.303231 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:07.926962    2561 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jul 07 17:40:08.303231 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:07.928470    2561 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 07 17:40:08.303526 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:07.932416    2561 manager.go:216] Machine: {Timestamp:2026-07-07 17:40:07.930749873 +0000 UTC m=+0.378479231 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3100031 MemoryCapacity:33164496896 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec257f51c7680f3d03c6b35b9b0462f0 SystemUUID:ec257f51-c768-0f3d-03c6-b35b9b0462f0 BootID:585c9c17-e591-4cac-ade6-3518c6021d0a Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:56:bc:34:e4:1b Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:56:bc:34:e4:1b Speed:0 Mtu:9001} {Name:ovs-system MacAddress:5a:d9:bd:0a:69:3b Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164496896 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jul 07 17:40:08.303526 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:07.932553    2561 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jul 07 17:40:08.303526 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:07.932640    2561 manager.go:232] Version: {KernelVersion:5.14.0-570.125.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260630-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jul 07 17:40:08.303526 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:07.935353    2561 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jul 07 17:40:08.303526 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:07.935377    2561 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-139-31.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jul 07 17:40:08.303526 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:07.936233    2561 topology_manager.go:138] "Creating topology manager with none policy"
Jul 07 17:40:08.303526 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:07.936244    2561 container_manager_linux.go:309] "Creating device plugin manager"
Jul 07 17:40:08.303526 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:07.936251    2561 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 07 17:40:08.303526 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:07.937067    2561 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 07 17:40:08.303526 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:07.939002    2561 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jul 07 17:40:08.303526 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:07.943765    2561 state_mem.go:36] "Initialized new in-memory state store"
Jul 07 17:40:08.303526 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:07.943900    2561 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jul 07 17:40:08.303526 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:07.943929    2561 kubelet.go:486] "Attempting to sync node with API server"
Jul 07 17:40:08.303526 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:07.943939    2561 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jul 07 17:40:08.303526 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:07.943962    2561 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jul 07 17:40:08.303526 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:07.943971    2561 kubelet.go:398] "Adding apiserver pod source"
Jul 07 17:40:08.303526 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:07.943981    2561 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jul 07 17:40:08.303526 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:07.944354    2561 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 07 17:40:08.304098 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:07.944369    2561 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 07 17:40:08.304098 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:07.947164    2561 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1"
Jul 07 17:40:08.304098 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:07.949586    2561 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jul 07 17:40:08.304098 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:07.949613    2561 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jul 07 17:40:08.304098 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:07.950885    2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jul 07 17:40:08.304098 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:07.950899    2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jul 07 17:40:08.304098 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:07.950905    2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jul 07 17:40:08.304098 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:07.950910    2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jul 07 17:40:08.304098 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:07.950919    2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jul 07 17:40:08.304098 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:07.950925    2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jul 07 17:40:08.304098 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:07.950934    2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jul 07 17:40:08.304098 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:07.950940    2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jul 07 17:40:08.304098 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:07.950947    2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jul 07 17:40:08.304098 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:07.950952    2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jul 07 17:40:08.304098 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:07.950961    2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jul 07 17:40:08.304098 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:07.950967    2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jul 07 17:40:08.304098 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:07.950988    2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jul 07 17:40:08.304098 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:07.950993    2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jul 07 17:40:08.304098 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:07.957163    2561 server.go:1268] "Started kubelet"
Jul 07 17:40:08.304098 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:07.957195    2561 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jul 07 17:40:08.304098 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:07.957274    2561 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jul 07 17:40:08.304098 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:07.957342    2561 server_v1.go:49] "podresources" method="list" useActivePods=true
Jul 07 17:40:08.304098 ip-10-0-139-31 kubenswrapper[2561]: E0707 17:40:07.957875    2561 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 07 17:40:08.304098 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:07.957893    2561 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-139-31.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 07 17:40:08.304098 ip-10-0-139-31 kubenswrapper[2561]: E0707 17:40:07.957936    2561 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-139-31.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 07 17:40:08.304098 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:07.959636    2561 server.go:310] "Adding debug handlers to kubelet server"
Jul 07 17:40:08.304098 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:07.959679    2561 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jul 07 17:40:08.304098 ip-10-0-139-31 kubenswrapper[2561]: E0707 17:40:07.962633    2561 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jul 07 17:40:08.304098 ip-10-0-139-31 kubenswrapper[2561]: E0707 17:40:07.964048    2561 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-139-31.ec2.internal.18c012b1f455620b  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-139-31.ec2.internal,UID:ip-10-0-139-31.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-139-31.ec2.internal,},FirstTimestamp:2026-07-07 17:40:07.956464139 +0000 UTC m=+0.404193488,LastTimestamp:2026-07-07 17:40:07.956464139 +0000 UTC m=+0.404193488,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-139-31.ec2.internal,}"
Jul 07 17:40:08.304098 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:07.968919    2561 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jul 07 17:40:08.304098 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:07.968935    2561 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jul 07 17:40:08.304098 ip-10-0-139-31 kubenswrapper[2561]: E0707 17:40:07.969009    2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-31.ec2.internal\" not found"
Jul 07 17:40:08.304098 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:07.969691    2561 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jul 07 17:40:08.304098 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:07.969693    2561 volume_manager.go:311] "The desired_state_of_world populator starts"
Jul 07 17:40:08.304098 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:07.969724    2561 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jul 07 17:40:08.304098 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:07.969801    2561 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jul 07 17:40:08.304098 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:07.969817    2561 factory.go:55] Registering systemd factory
Jul 07 17:40:08.304098 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:07.969828    2561 factory.go:223] Registration of the systemd container factory successfully
Jul 07 17:40:08.304098 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:07.969823    2561 reconstruct.go:97] "Volume reconstruction finished"
Jul 07 17:40:08.304098 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:07.969858    2561 reconciler.go:29] "Reconciler: start to sync state"
Jul 07 17:40:08.305194 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:07.970061    2561 factory.go:153] Registering CRI-O factory
Jul 07 17:40:08.305194 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:07.970072    2561 factory.go:223] Registration of the crio container factory successfully
Jul 07 17:40:08.305194 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:07.970090    2561 factory.go:103] Registering Raw factory
Jul 07 17:40:08.305194 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:07.970099    2561 manager.go:1196] Started watching for new ooms in manager
Jul 07 17:40:08.305194 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:07.970444    2561 manager.go:349] Starting recovery of all containers
Jul 07 17:40:08.305194 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:07.979387    2561 manager.go:354] Recovery completed
Jul 07 17:40:08.305194 ip-10-0-139-31 kubenswrapper[2561]: E0707 17:40:07.981979    2561 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-139-31.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Jul 07 17:40:08.305194 ip-10-0-139-31 kubenswrapper[2561]: E0707 17:40:07.982071    2561 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Jul 07 17:40:08.305194 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:07.983509    2561 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-q8px6"
Jul 07 17:40:08.305194 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:07.983665    2561 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 07 17:40:08.305194 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:07.985363    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-31.ec2.internal" event="NodeHasSufficientMemory"
Jul 07 17:40:08.305194 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:07.985394    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-31.ec2.internal" event="NodeHasNoDiskPressure"
Jul 07 17:40:08.305194 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:07.985409    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-31.ec2.internal" event="NodeHasSufficientPID"
Jul 07 17:40:08.305194 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:07.985942    2561 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jul 07 17:40:08.305194 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:07.985949    2561 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jul 07 17:40:08.305194 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:07.985958    2561 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 07 17:40:08.305194 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:07.985965    2561 state_mem.go:36] "Initialized new in-memory state store"
Jul 07 17:40:08.305194 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:07.986636    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-31.ec2.internal" event="NodeHasSufficientMemory"
Jul 07 17:40:08.305194 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:07.986657    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-31.ec2.internal" event="NodeHasNoDiskPressure"
Jul 07 17:40:08.305194 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:07.986668    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-31.ec2.internal" event="NodeHasSufficientPID"
Jul 07 17:40:08.305194 ip-10-0-139-31 kubenswrapper[2561]: E0707 17:40:07.987492    2561 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-139-31.ec2.internal.18c012b1f60e88f7  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-139-31.ec2.internal,UID:ip-10-0-139-31.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-139-31.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-139-31.ec2.internal,},FirstTimestamp:2026-07-07 17:40:07.985375479 +0000 UTC m=+0.433104836,LastTimestamp:2026-07-07 17:40:07.985375479 +0000 UTC m=+0.433104836,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-139-31.ec2.internal,}"
Jul 07 17:40:08.305194 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:07.988180    2561 policy_none.go:49] "None policy: Start"
Jul 07 17:40:08.305194 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:07.988883    2561 memory_manager.go:187] "Starting memorymanager" policy="None"
Jul 07 17:40:08.305194 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:07.988903    2561 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jul 07 17:40:08.305194 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:07.992174    2561 policy_none.go:47] "Start"
Jul 07 17:40:08.305194 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:07.992942    2561 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-q8px6"
Jul 07 17:40:08.305194 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:08.054466    2561 manager.go:337] "Starting Device Plugin manager"
Jul 07 17:40:08.305194 ip-10-0-139-31 kubenswrapper[2561]: E0707 17:40:08.054592    2561 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jul 07 17:40:08.305194 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:08.054607    2561 server.go:87] "Starting device plugin registration server"
Jul 07 17:40:08.305194 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:08.054897    2561 eviction_manager.go:189] "Eviction manager: starting control loop"
Jul 07 17:40:08.305194 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:08.054909    2561 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jul 07 17:40:08.305194 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:08.055013    2561 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jul 07 17:40:08.305194 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:08.055099    2561 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jul 07 17:40:08.305194 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:08.055108    2561 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jul 07 17:40:08.305194 ip-10-0-139-31 kubenswrapper[2561]: E0707 17:40:08.055589    2561 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jul 07 17:40:08.305194 ip-10-0-139-31 kubenswrapper[2561]: E0707 17:40:08.055646    2561 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-139-31.ec2.internal\" not found"
Jul 07 17:40:08.305194 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:08.080008    2561 container_manager_linux.go:676] "Failed to ensure state" containerName="/system.slice" err="failed to move PID 2597 into the system container \"/system.slice\": <nil>"
Jul 07 17:40:08.305194 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:08.155502    2561 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 07 17:40:08.305194 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:08.156610    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-31.ec2.internal" event="NodeHasSufficientMemory"
Jul 07 17:40:08.475689 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:08.156645    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-31.ec2.internal" event="NodeHasNoDiskPressure"
Jul 07 17:40:08.475689 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:08.156659    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-31.ec2.internal" event="NodeHasSufficientPID"
Jul 07 17:40:08.475689 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:08.156689    2561 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-139-31.ec2.internal"
Jul 07 17:40:08.475689 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:08.166132    2561 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-139-31.ec2.internal"
Jul 07 17:40:08.475689 ip-10-0-139-31 kubenswrapper[2561]: E0707 17:40:08.166162    2561 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-139-31.ec2.internal\": node \"ip-10-0-139-31.ec2.internal\" not found"
Jul 07 17:40:08.475689 ip-10-0-139-31 kubenswrapper[2561]: E0707 17:40:08.199136    2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-31.ec2.internal\" not found"
Jul 07 17:40:08.475689 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:08.216776    2561 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jul 07 17:40:08.475689 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:08.218092    2561 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jul 07 17:40:08.475689 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:08.218139    2561 status_manager.go:244] "Starting to sync pod status with apiserver"
Jul 07 17:40:08.475689 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:08.218168    2561 kubelet.go:2448] "Starting kubelet main sync loop"
Jul 07 17:40:08.475689 ip-10-0-139-31 kubenswrapper[2561]: E0707 17:40:08.218213    2561 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jul 07 17:40:08.475689 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:08.220214    2561 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 07 17:40:08.475689 ip-10-0-139-31 kubenswrapper[2561]: E0707 17:40:08.299593    2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-31.ec2.internal\" not found"
Jul 07 17:40:08.475689 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:08.318761    2561 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-31.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-139-31.ec2.internal"]
Jul 07 17:40:08.475689 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:08.318879    2561 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 07 17:40:08.475689 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:08.322580    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-31.ec2.internal" event="NodeHasSufficientMemory"
Jul 07 17:40:08.475689 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:08.322616    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-31.ec2.internal" event="NodeHasNoDiskPressure"
Jul 07 17:40:08.475689 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:08.322628    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-31.ec2.internal" event="NodeHasSufficientPID"
Jul 07 17:40:08.475689 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:08.324959    2561 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 07 17:40:08.475689 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:08.325072    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-31.ec2.internal"
Jul 07 17:40:08.475689 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:08.325117    2561 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 07 17:40:08.475689 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:08.325712    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-31.ec2.internal" event="NodeHasSufficientMemory"
Jul 07 17:40:08.475689 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:08.325724    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-31.ec2.internal" event="NodeHasSufficientMemory"
Jul 07 17:40:08.475689 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:08.325739    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-31.ec2.internal" event="NodeHasNoDiskPressure"
Jul 07 17:40:08.475689 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:08.325744    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-31.ec2.internal" event="NodeHasNoDiskPressure"
Jul 07 17:40:08.475689 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:08.325754    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-31.ec2.internal" event="NodeHasSufficientPID"
Jul 07 17:40:08.475689 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:08.325754    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-31.ec2.internal" event="NodeHasSufficientPID"
Jul 07 17:40:08.475689 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:08.327984    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-31.ec2.internal"
Jul 07 17:40:08.475689 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:08.328006    2561 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 07 17:40:08.475689 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:08.328708    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-31.ec2.internal" event="NodeHasSufficientMemory"
Jul 07 17:40:08.475689 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:08.328729    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-31.ec2.internal" event="NodeHasNoDiskPressure"
Jul 07 17:40:08.475689 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:08.328738    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-31.ec2.internal" event="NodeHasSufficientPID"
Jul 07 17:40:08.475689 ip-10-0-139-31 kubenswrapper[2561]: E0707 17:40:08.352537    2561 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-139-31.ec2.internal\" not found" node="ip-10-0-139-31.ec2.internal"
Jul 07 17:40:08.475689 ip-10-0-139-31 kubenswrapper[2561]: E0707 17:40:08.357333    2561 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-139-31.ec2.internal\" not found" node="ip-10-0-139-31.ec2.internal"
Jul 07 17:40:08.475689 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:08.372538    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/b3b4cf5ec3f082f4790614941a60c42f-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-139-31.ec2.internal\" (UID: \"b3b4cf5ec3f082f4790614941a60c42f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-31.ec2.internal"
Jul 07 17:40:08.475689 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:08.372566    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b3b4cf5ec3f082f4790614941a60c42f-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-139-31.ec2.internal\" (UID: \"b3b4cf5ec3f082f4790614941a60c42f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-31.ec2.internal"
Jul 07 17:40:08.476914 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:08.372586    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/bc20af9d845b73d5b3a3fef90b1087f9-config\") pod \"kube-apiserver-proxy-ip-10-0-139-31.ec2.internal\" (UID: \"bc20af9d845b73d5b3a3fef90b1087f9\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-139-31.ec2.internal"
Jul 07 17:40:08.476914 ip-10-0-139-31 kubenswrapper[2561]: E0707 17:40:08.399702    2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-31.ec2.internal\" not found"
Jul 07 17:40:08.476914 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:08.472971    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/b3b4cf5ec3f082f4790614941a60c42f-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-139-31.ec2.internal\" (UID: \"b3b4cf5ec3f082f4790614941a60c42f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-31.ec2.internal"
Jul 07 17:40:08.476914 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:08.473005    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b3b4cf5ec3f082f4790614941a60c42f-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-139-31.ec2.internal\" (UID: \"b3b4cf5ec3f082f4790614941a60c42f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-31.ec2.internal"
Jul 07 17:40:08.476914 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:08.473024    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/bc20af9d845b73d5b3a3fef90b1087f9-config\") pod \"kube-apiserver-proxy-ip-10-0-139-31.ec2.internal\" (UID: \"bc20af9d845b73d5b3a3fef90b1087f9\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-139-31.ec2.internal"
Jul 07 17:40:08.476914 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:08.473066    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/bc20af9d845b73d5b3a3fef90b1087f9-config\") pod \"kube-apiserver-proxy-ip-10-0-139-31.ec2.internal\" (UID: \"bc20af9d845b73d5b3a3fef90b1087f9\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-139-31.ec2.internal"
Jul 07 17:40:08.476914 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:08.473074    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/b3b4cf5ec3f082f4790614941a60c42f-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-139-31.ec2.internal\" (UID: \"b3b4cf5ec3f082f4790614941a60c42f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-31.ec2.internal"
Jul 07 17:40:08.476914 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:08.473073    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b3b4cf5ec3f082f4790614941a60c42f-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-139-31.ec2.internal\" (UID: \"b3b4cf5ec3f082f4790614941a60c42f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-31.ec2.internal"
Jul 07 17:40:08.634580 ip-10-0-139-31 kubenswrapper[2561]: E0707 17:40:08.500122    2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-31.ec2.internal\" not found"
Jul 07 17:40:08.634580 ip-10-0-139-31 kubenswrapper[2561]: E0707 17:40:08.600401    2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-31.ec2.internal\" not found"
Jul 07 17:40:08.663559 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:08.655384    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-31.ec2.internal"
Jul 07 17:40:08.663559 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:08.660576    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-31.ec2.internal"
Jul 07 17:40:10.134839 ip-10-0-139-31 kubenswrapper[2561]: E0707 17:40:08.700950    2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-31.ec2.internal\" not found"
Jul 07 17:40:10.134839 ip-10-0-139-31 kubenswrapper[2561]: E0707 17:40:10.098074    2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-31.ec2.internal\" not found"
Jul 07 17:40:10.309109 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:10.191625    2561 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jul 07 17:40:10.309109 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:10.191794    2561 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 07 17:40:10.309109 ip-10-0-139-31 kubenswrapper[2561]: E0707 17:40:10.198916    2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-31.ec2.internal\" not found"
Jul 07 17:40:10.309109 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:10.258471    2561 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 07 17:40:10.309109 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:10.292855    2561 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-06 17:35:09 +0000 UTC" deadline="2028-04-21 10:54:39.566154492 +0000 UTC"
Jul 07 17:40:10.309109 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:10.292892    2561 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="15689h14m29.273265909s"
Jul 07 17:40:10.309109 ip-10-0-139-31 kubenswrapper[2561]: E0707 17:40:10.300004    2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-31.ec2.internal\" not found"
Jul 07 17:40:10.442861 ip-10-0-139-31 kubenswrapper[2561]: E0707 17:40:10.400760    2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-31.ec2.internal\" not found"
Jul 07 17:40:10.608569 ip-10-0-139-31 kubenswrapper[2561]: E0707 17:40:10.501338    2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-31.ec2.internal\" not found"
Jul 07 17:40:10.608569 ip-10-0-139-31 kubenswrapper[2561]: W0707 17:40:10.533589    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb3b4cf5ec3f082f4790614941a60c42f.slice/crio-698d5d32f0b6a936f81766319f8cbab335b35e19036206727d0569f890554b96 WatchSource:0}: Error finding container 698d5d32f0b6a936f81766319f8cbab335b35e19036206727d0569f890554b96: Status 404 returned error can't find the container with id 698d5d32f0b6a936f81766319f8cbab335b35e19036206727d0569f890554b96
Jul 07 17:40:10.608569 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:10.538621    2561 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 07 17:40:10.608569 ip-10-0-139-31 kubenswrapper[2561]: W0707 17:40:10.569650    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbc20af9d845b73d5b3a3fef90b1087f9.slice/crio-61c853045620bffeedc07de126c0075fd31d314b5feebde62326fa0cb091ea00 WatchSource:0}: Error finding container 61c853045620bffeedc07de126c0075fd31d314b5feebde62326fa0cb091ea00: Status 404 returned error can't find the container with id 61c853045620bffeedc07de126c0075fd31d314b5feebde62326fa0cb091ea00
Jul 07 17:40:10.608569 ip-10-0-139-31 kubenswrapper[2561]: E0707 17:40:10.601805    2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-31.ec2.internal\" not found"
Jul 07 17:40:10.794636 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:10.615639    2561 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 07 17:40:10.794636 ip-10-0-139-31 kubenswrapper[2561]: E0707 17:40:10.702130    2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-31.ec2.internal\" not found"
Jul 07 17:40:10.985468 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:10.801985    2561 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 07 17:40:10.985468 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:10.866044    2561 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-31.ec2.internal"
Jul 07 17:40:10.985468 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:10.880243    2561 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 07 17:40:10.985468 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:10.881207    2561 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-31.ec2.internal"
Jul 07 17:40:10.985468 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:10.890497    2561 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 07 17:40:11.241930 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:11.241890    2561 apiserver.go:52] "Watching apiserver"
Jul 07 17:40:11.252235 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:11.251270    2561 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 07 17:40:11.252235 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:11.251718    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-multus/network-metrics-daemon-pkn6n","kube-system/konnectivity-agent-kks9r","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-31.ec2.internal","openshift-multus/multus-additional-cni-plugins-tl75q","openshift-network-diagnostics/network-check-target-gmjlh","openshift-network-operator/iptables-alerter-snd82","openshift-ovn-kubernetes/ovnkube-node-rbzjn","kube-system/global-pull-secret-syncer-6cwrd","kube-system/kube-apiserver-proxy-ip-10-0-139-31.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rlzxl","openshift-cluster-node-tuning-operator/tuned-tr2xs","openshift-dns/node-resolver-4wz7j","openshift-image-registry/node-ca-vf2rn","openshift-multus/multus-7wjgt"]
Jul 07 17:40:11.254520 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:11.254495    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-rbzjn"
Jul 07 17:40:11.257116 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:11.257091    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-vf2rn"
Jul 07 17:40:11.257839 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:11.257817    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 07 17:40:11.257934 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:11.257839    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 07 17:40:11.258170 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:11.258152    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 07 17:40:11.258393 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:11.258377    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 07 17:40:11.258488 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:11.258427    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-c7nr6\""
Jul 07 17:40:11.260154 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:11.260131    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 07 17:40:11.261181 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:11.260341    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 07 17:40:11.261181 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:11.260555    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 07 17:40:11.261181 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:11.261082    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 07 17:40:11.261181 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:11.261131    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 07 17:40:11.261460 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:11.261316    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-t4tpc\""
Jul 07 17:40:11.261460 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:11.261389    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-7wjgt"
Jul 07 17:40:11.263365 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:11.263346    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-tl75q"
Jul 07 17:40:11.264688 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:11.264047    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 07 17:40:11.264688 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:11.264077    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 07 17:40:11.264688 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:11.264310    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 07 17:40:11.264688 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:11.264408    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-khgq9\""
Jul 07 17:40:11.264688 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:11.264576    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 07 17:40:11.265576 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:11.265493    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gmjlh"
Jul 07 17:40:11.265576 ip-10-0-139-31 kubenswrapper[2561]: E0707 17:40:11.265556    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gmjlh" podUID="0efe7076-81fe-4e2c-bf49-626c4d955b19"
Jul 07 17:40:11.269470 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:11.269025    2561 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jul 07 17:40:11.269625 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:11.269599    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-4zfhw\""
Jul 07 17:40:11.269802 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:11.269783    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 07 17:40:11.269903 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:11.269880    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 07 17:40:11.270201 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:11.270186    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-snd82"
Jul 07 17:40:11.272207 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:11.272188    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6cwrd"
Jul 07 17:40:11.272320 ip-10-0-139-31 kubenswrapper[2561]: E0707 17:40:11.272289    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6cwrd" podUID="e54430cd-5514-416a-83cc-c3b1a549e576"
Jul 07 17:40:11.273900 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:11.273881    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pkn6n"
Jul 07 17:40:11.273988 ip-10-0-139-31 kubenswrapper[2561]: E0707 17:40:11.273963    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pkn6n" podUID="9d99e831-14fe-4b13-9a8b-3d9ca165c60e"
Jul 07 17:40:11.274846 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:11.274825    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 07 17:40:11.275001 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:11.274832    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-dllg7\""
Jul 07 17:40:11.275175 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:11.275159    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 07 17:40:11.275245 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:11.275182    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 07 17:40:11.276374 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:11.276356    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-kks9r"
Jul 07 17:40:11.279095 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:11.278696    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rlzxl"
Jul 07 17:40:11.279095 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:11.278990    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-kl6jn\""
Jul 07 17:40:11.279263 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:11.279248    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 07 17:40:11.279715 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:11.279696    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 07 17:40:11.281143 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:11.281118    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-tr2xs"
Jul 07 17:40:11.281649 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:11.281626    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q9xzj\" (UniqueName: \"kubernetes.io/projected/44315251-6c4d-438d-bc14-446002aa92a7-kube-api-access-q9xzj\") pod \"multus-additional-cni-plugins-tl75q\" (UID: \"44315251-6c4d-438d-bc14-446002aa92a7\") " pod="openshift-multus/multus-additional-cni-plugins-tl75q"
Jul 07 17:40:11.281649 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:11.281642    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 07 17:40:11.281828 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:11.281661    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/65ec2965-856f-4dc9-94a6-9f8d20151d5d-multus-cni-dir\") pod \"multus-7wjgt\" (UID: \"65ec2965-856f-4dc9-94a6-9f8d20151d5d\") " pod="openshift-multus/multus-7wjgt"
Jul 07 17:40:11.281828 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:11.281684    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/65ec2965-856f-4dc9-94a6-9f8d20151d5d-host-run-k8s-cni-cncf-io\") pod \"multus-7wjgt\" (UID: \"65ec2965-856f-4dc9-94a6-9f8d20151d5d\") " pod="openshift-multus/multus-7wjgt"
Jul 07 17:40:11.281828 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:11.281708    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/65ec2965-856f-4dc9-94a6-9f8d20151d5d-host-var-lib-cni-bin\") pod \"multus-7wjgt\" (UID: \"65ec2965-856f-4dc9-94a6-9f8d20151d5d\") " pod="openshift-multus/multus-7wjgt"
Jul 07 17:40:11.281828 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:11.281731    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/65ec2965-856f-4dc9-94a6-9f8d20151d5d-multus-conf-dir\") pod \"multus-7wjgt\" (UID: \"65ec2965-856f-4dc9-94a6-9f8d20151d5d\") " pod="openshift-multus/multus-7wjgt"
Jul 07 17:40:11.281828 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:11.281753    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/312df236-de73-4f4c-96dc-35bde1429d6b-host-slash\") pod \"ovnkube-node-rbzjn\" (UID: \"312df236-de73-4f4c-96dc-35bde1429d6b\") " pod="openshift-ovn-kubernetes/ovnkube-node-rbzjn"
Jul 07 17:40:11.281828 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:11.281785    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/312df236-de73-4f4c-96dc-35bde1429d6b-var-lib-openvswitch\") pod \"ovnkube-node-rbzjn\" (UID: \"312df236-de73-4f4c-96dc-35bde1429d6b\") " pod="openshift-ovn-kubernetes/ovnkube-node-rbzjn"
Jul 07 17:40:11.281828 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:11.281819    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 07 17:40:11.281828 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:11.281823    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/312df236-de73-4f4c-96dc-35bde1429d6b-run-openvswitch\") pod \"ovnkube-node-rbzjn\" (UID: \"312df236-de73-4f4c-96dc-35bde1429d6b\") " pod="openshift-ovn-kubernetes/ovnkube-node-rbzjn"
Jul 07 17:40:11.282216 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:11.281868    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jul 07 17:40:11.282216 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:11.281888    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-c4jsc\""
Jul 07 17:40:11.282216 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:11.281894    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/44315251-6c4d-438d-bc14-446002aa92a7-cni-binary-copy\") pod \"multus-additional-cni-plugins-tl75q\" (UID: \"44315251-6c4d-438d-bc14-446002aa92a7\") " pod="openshift-multus/multus-additional-cni-plugins-tl75q"
Jul 07 17:40:11.282216 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:11.281938    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/312df236-de73-4f4c-96dc-35bde1429d6b-etc-openvswitch\") pod \"ovnkube-node-rbzjn\" (UID: \"312df236-de73-4f4c-96dc-35bde1429d6b\") " pod="openshift-ovn-kubernetes/ovnkube-node-rbzjn"
Jul 07 17:40:11.282216 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:11.281969    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/312df236-de73-4f4c-96dc-35bde1429d6b-run-ovn\") pod \"ovnkube-node-rbzjn\" (UID: \"312df236-de73-4f4c-96dc-35bde1429d6b\") " pod="openshift-ovn-kubernetes/ovnkube-node-rbzjn"
Jul 07 17:40:11.282216 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:11.281994    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/312df236-de73-4f4c-96dc-35bde1429d6b-env-overrides\") pod \"ovnkube-node-rbzjn\" (UID: \"312df236-de73-4f4c-96dc-35bde1429d6b\") " pod="openshift-ovn-kubernetes/ovnkube-node-rbzjn"
Jul 07 17:40:11.282216 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:11.282016    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/312df236-de73-4f4c-96dc-35bde1429d6b-ovnkube-script-lib\") pod \"ovnkube-node-rbzjn\" (UID: \"312df236-de73-4f4c-96dc-35bde1429d6b\") " pod="openshift-ovn-kubernetes/ovnkube-node-rbzjn"
Jul 07 17:40:11.282216 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:11.282052    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e54430cd-5514-416a-83cc-c3b1a549e576-original-pull-secret\") pod \"global-pull-secret-syncer-6cwrd\" (UID: \"e54430cd-5514-416a-83cc-c3b1a549e576\") " pod="kube-system/global-pull-secret-syncer-6cwrd"
Jul 07 17:40:11.282216 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:11.282084    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/8e97c2c1-e9ea-41fb-9bb9-ed0cf128c144-host\") pod \"node-ca-vf2rn\" (UID: \"8e97c2c1-e9ea-41fb-9bb9-ed0cf128c144\") " pod="openshift-image-registry/node-ca-vf2rn"
Jul 07 17:40:11.282216 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:11.282129    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/65ec2965-856f-4dc9-94a6-9f8d20151d5d-host-var-lib-kubelet\") pod \"multus-7wjgt\" (UID: \"65ec2965-856f-4dc9-94a6-9f8d20151d5d\") " pod="openshift-multus/multus-7wjgt"
Jul 07 17:40:11.282216 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:11.282180    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/312df236-de73-4f4c-96dc-35bde1429d6b-host-cni-netd\") pod \"ovnkube-node-rbzjn\" (UID: \"312df236-de73-4f4c-96dc-35bde1429d6b\") " pod="openshift-ovn-kubernetes/ovnkube-node-rbzjn"
Jul 07 17:40:11.282216 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:11.282205    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/312df236-de73-4f4c-96dc-35bde1429d6b-ovn-node-metrics-cert\") pod \"ovnkube-node-rbzjn\" (UID: \"312df236-de73-4f4c-96dc-35bde1429d6b\") " pod="openshift-ovn-kubernetes/ovnkube-node-rbzjn"
Jul 07 17:40:11.282800 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:11.282229    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/44315251-6c4d-438d-bc14-446002aa92a7-os-release\") pod \"multus-additional-cni-plugins-tl75q\" (UID: \"44315251-6c4d-438d-bc14-446002aa92a7\") " pod="openshift-multus/multus-additional-cni-plugins-tl75q"
Jul 07 17:40:11.282800 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:11.282252    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t6nc8\" (UniqueName: \"kubernetes.io/projected/9f644cf8-e282-4cac-b3d9-600ee88741b7-kube-api-access-t6nc8\") pod \"iptables-alerter-snd82\" (UID: \"9f644cf8-e282-4cac-b3d9-600ee88741b7\") " pod="openshift-network-operator/iptables-alerter-snd82"
Jul 07 17:40:11.282800 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:11.282275    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/312df236-de73-4f4c-96dc-35bde1429d6b-log-socket\") pod \"ovnkube-node-rbzjn\" (UID: \"312df236-de73-4f4c-96dc-35bde1429d6b\") " pod="openshift-ovn-kubernetes/ovnkube-node-rbzjn"
Jul 07 17:40:11.282800 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:11.282312    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/44315251-6c4d-438d-bc14-446002aa92a7-tuning-conf-dir\") pod \"multus-additional-cni-plugins-tl75q\" (UID: \"44315251-6c4d-438d-bc14-446002aa92a7\") " pod="openshift-multus/multus-additional-cni-plugins-tl75q"
Jul 07 17:40:11.282800 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:11.282348    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/9f644cf8-e282-4cac-b3d9-600ee88741b7-iptables-alerter-script\") pod \"iptables-alerter-snd82\" (UID: \"9f644cf8-e282-4cac-b3d9-600ee88741b7\") " pod="openshift-network-operator/iptables-alerter-snd82"
Jul 07 17:40:11.282800 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:11.282371    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/65ec2965-856f-4dc9-94a6-9f8d20151d5d-multus-daemon-config\") pod \"multus-7wjgt\" (UID: \"65ec2965-856f-4dc9-94a6-9f8d20151d5d\") " pod="openshift-multus/multus-7wjgt"
Jul 07 17:40:11.282800 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:11.282396    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2ssch\" (UniqueName: \"kubernetes.io/projected/312df236-de73-4f4c-96dc-35bde1429d6b-kube-api-access-2ssch\") pod \"ovnkube-node-rbzjn\" (UID: \"312df236-de73-4f4c-96dc-35bde1429d6b\") " pod="openshift-ovn-kubernetes/ovnkube-node-rbzjn"
Jul 07 17:40:11.282800 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:11.282421    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/312df236-de73-4f4c-96dc-35bde1429d6b-host-kubelet\") pod \"ovnkube-node-rbzjn\" (UID: \"312df236-de73-4f4c-96dc-35bde1429d6b\") " pod="openshift-ovn-kubernetes/ovnkube-node-rbzjn"
Jul 07 17:40:11.282800 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:11.282459    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/312df236-de73-4f4c-96dc-35bde1429d6b-host-cni-bin\") pod \"ovnkube-node-rbzjn\" (UID: \"312df236-de73-4f4c-96dc-35bde1429d6b\") " pod="openshift-ovn-kubernetes/ovnkube-node-rbzjn"
Jul 07 17:40:11.282800 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:11.282481    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/312df236-de73-4f4c-96dc-35bde1429d6b-ovnkube-config\") pod \"ovnkube-node-rbzjn\" (UID: \"312df236-de73-4f4c-96dc-35bde1429d6b\") " pod="openshift-ovn-kubernetes/ovnkube-node-rbzjn"
Jul 07 17:40:11.282800 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:11.282513    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/65ec2965-856f-4dc9-94a6-9f8d20151d5d-host-run-multus-certs\") pod \"multus-7wjgt\" (UID: \"65ec2965-856f-4dc9-94a6-9f8d20151d5d\") " pod="openshift-multus/multus-7wjgt"
Jul 07 17:40:11.282800 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:11.282536    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/312df236-de73-4f4c-96dc-35bde1429d6b-host-run-netns\") pod \"ovnkube-node-rbzjn\" (UID: \"312df236-de73-4f4c-96dc-35bde1429d6b\") " pod="openshift-ovn-kubernetes/ovnkube-node-rbzjn"
Jul 07 17:40:11.282800 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:11.282558    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/65ec2965-856f-4dc9-94a6-9f8d20151d5d-os-release\") pod \"multus-7wjgt\" (UID: \"65ec2965-856f-4dc9-94a6-9f8d20151d5d\") " pod="openshift-multus/multus-7wjgt"
Jul 07 17:40:11.282800 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:11.282579    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/65ec2965-856f-4dc9-94a6-9f8d20151d5d-host-var-lib-cni-multus\") pod \"multus-7wjgt\" (UID: \"65ec2965-856f-4dc9-94a6-9f8d20151d5d\") " pod="openshift-multus/multus-7wjgt"
Jul 07 17:40:11.282800 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:11.282605    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-km4h8\" (UniqueName: \"kubernetes.io/projected/0efe7076-81fe-4e2c-bf49-626c4d955b19-kube-api-access-km4h8\") pod \"network-check-target-gmjlh\" (UID: \"0efe7076-81fe-4e2c-bf49-626c4d955b19\") " pod="openshift-network-diagnostics/network-check-target-gmjlh"
Jul 07 17:40:11.282800 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:11.282642    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/e54430cd-5514-416a-83cc-c3b1a549e576-kubelet-config\") pod \"global-pull-secret-syncer-6cwrd\" (UID: \"e54430cd-5514-416a-83cc-c3b1a549e576\") " pod="kube-system/global-pull-secret-syncer-6cwrd"
Jul 07 17:40:11.283534 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:11.282704    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/9f644cf8-e282-4cac-b3d9-600ee88741b7-host-slash\") pod \"iptables-alerter-snd82\" (UID: \"9f644cf8-e282-4cac-b3d9-600ee88741b7\") " pod="openshift-network-operator/iptables-alerter-snd82"
Jul 07 17:40:11.283534 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:11.282733    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/65ec2965-856f-4dc9-94a6-9f8d20151d5d-cnibin\") pod \"multus-7wjgt\" (UID: \"65ec2965-856f-4dc9-94a6-9f8d20151d5d\") " pod="openshift-multus/multus-7wjgt"
Jul 07 17:40:11.283534 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:11.282756    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/44315251-6c4d-438d-bc14-446002aa92a7-system-cni-dir\") pod \"multus-additional-cni-plugins-tl75q\" (UID: \"44315251-6c4d-438d-bc14-446002aa92a7\") " pod="openshift-multus/multus-additional-cni-plugins-tl75q"
Jul 07 17:40:11.283534 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:11.282779    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/44315251-6c4d-438d-bc14-446002aa92a7-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-tl75q\" (UID: \"44315251-6c4d-438d-bc14-446002aa92a7\") " pod="openshift-multus/multus-additional-cni-plugins-tl75q"
Jul 07 17:40:11.283534 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:11.282815    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/65ec2965-856f-4dc9-94a6-9f8d20151d5d-system-cni-dir\") pod \"multus-7wjgt\" (UID: \"65ec2965-856f-4dc9-94a6-9f8d20151d5d\") " pod="openshift-multus/multus-7wjgt"
Jul 07 17:40:11.283534 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:11.282841    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/65ec2965-856f-4dc9-94a6-9f8d20151d5d-hostroot\") pod \"multus-7wjgt\" (UID: \"65ec2965-856f-4dc9-94a6-9f8d20151d5d\") " pod="openshift-multus/multus-7wjgt"
Jul 07 17:40:11.283534 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:11.282873    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/65ec2965-856f-4dc9-94a6-9f8d20151d5d-etc-kubernetes\") pod \"multus-7wjgt\" (UID: \"65ec2965-856f-4dc9-94a6-9f8d20151d5d\") " pod="openshift-multus/multus-7wjgt"
Jul 07 17:40:11.283534 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:11.282904    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/8e97c2c1-e9ea-41fb-9bb9-ed0cf128c144-serviceca\") pod \"node-ca-vf2rn\" (UID: \"8e97c2c1-e9ea-41fb-9bb9-ed0cf128c144\") " pod="openshift-image-registry/node-ca-vf2rn"
Jul 07 17:40:11.283951 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:11.283612    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-4wz7j"
Jul 07 17:40:11.284031 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:11.284013    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-4kmsj\""
Jul 07 17:40:11.284092 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:11.284072    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 07 17:40:11.284147 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:11.284118    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4wcsf\" (UniqueName: \"kubernetes.io/projected/8e97c2c1-e9ea-41fb-9bb9-ed0cf128c144-kube-api-access-4wcsf\") pod \"node-ca-vf2rn\" (UID: \"8e97c2c1-e9ea-41fb-9bb9-ed0cf128c144\") " pod="openshift-image-registry/node-ca-vf2rn"
Jul 07 17:40:11.284205 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:11.284176    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/65ec2965-856f-4dc9-94a6-9f8d20151d5d-cni-binary-copy\") pod \"multus-7wjgt\" (UID: \"65ec2965-856f-4dc9-94a6-9f8d20151d5d\") " pod="openshift-multus/multus-7wjgt"
Jul 07 17:40:11.284263 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:11.284204    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/312df236-de73-4f4c-96dc-35bde1429d6b-node-log\") pod \"ovnkube-node-rbzjn\" (UID: \"312df236-de73-4f4c-96dc-35bde1429d6b\") " pod="openshift-ovn-kubernetes/ovnkube-node-rbzjn"
Jul 07 17:40:11.284263 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:11.284228    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/44315251-6c4d-438d-bc14-446002aa92a7-cnibin\") pod \"multus-additional-cni-plugins-tl75q\" (UID: \"44315251-6c4d-438d-bc14-446002aa92a7\") " pod="openshift-multus/multus-additional-cni-plugins-tl75q"
Jul 07 17:40:11.284362 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:11.284269    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/312df236-de73-4f4c-96dc-35bde1429d6b-systemd-units\") pod \"ovnkube-node-rbzjn\" (UID: \"312df236-de73-4f4c-96dc-35bde1429d6b\") " pod="openshift-ovn-kubernetes/ovnkube-node-rbzjn"
Jul 07 17:40:11.284362 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:11.284303    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jl7j9\" (UniqueName: \"kubernetes.io/projected/65ec2965-856f-4dc9-94a6-9f8d20151d5d-kube-api-access-jl7j9\") pod \"multus-7wjgt\" (UID: \"65ec2965-856f-4dc9-94a6-9f8d20151d5d\") " pod="openshift-multus/multus-7wjgt"
Jul 07 17:40:11.284362 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:11.284329    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/312df236-de73-4f4c-96dc-35bde1429d6b-host-run-ovn-kubernetes\") pod \"ovnkube-node-rbzjn\" (UID: \"312df236-de73-4f4c-96dc-35bde1429d6b\") " pod="openshift-ovn-kubernetes/ovnkube-node-rbzjn"
Jul 07 17:40:11.284534 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:11.284367    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/65ec2965-856f-4dc9-94a6-9f8d20151d5d-host-run-netns\") pod \"multus-7wjgt\" (UID: \"65ec2965-856f-4dc9-94a6-9f8d20151d5d\") " pod="openshift-multus/multus-7wjgt"
Jul 07 17:40:11.284534 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:11.284402    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/312df236-de73-4f4c-96dc-35bde1429d6b-run-systemd\") pod \"ovnkube-node-rbzjn\" (UID: \"312df236-de73-4f4c-96dc-35bde1429d6b\") " pod="openshift-ovn-kubernetes/ovnkube-node-rbzjn"
Jul 07 17:40:11.284534 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:11.284463    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/312df236-de73-4f4c-96dc-35bde1429d6b-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-rbzjn\" (UID: \"312df236-de73-4f4c-96dc-35bde1429d6b\") " pod="openshift-ovn-kubernetes/ovnkube-node-rbzjn"
Jul 07 17:40:11.284534 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:11.284492    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/e54430cd-5514-416a-83cc-c3b1a549e576-dbus\") pod \"global-pull-secret-syncer-6cwrd\" (UID: \"e54430cd-5514-416a-83cc-c3b1a549e576\") " pod="kube-system/global-pull-secret-syncer-6cwrd"
Jul 07 17:40:11.284534 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:11.284517    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/65ec2965-856f-4dc9-94a6-9f8d20151d5d-multus-socket-dir-parent\") pod \"multus-7wjgt\" (UID: \"65ec2965-856f-4dc9-94a6-9f8d20151d5d\") " pod="openshift-multus/multus-7wjgt"
Jul 07 17:40:11.284838 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:11.284542    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/44315251-6c4d-438d-bc14-446002aa92a7-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-tl75q\" (UID: \"44315251-6c4d-438d-bc14-446002aa92a7\") " pod="openshift-multus/multus-additional-cni-plugins-tl75q"
Jul 07 17:40:11.284838 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:11.284619    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 07 17:40:11.285402 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:11.285382    2561 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 07 17:40:11.286172 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:11.286112    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 07 17:40:11.286267 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:11.286204    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-xmmjs\""
Jul 07 17:40:11.286362 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:11.286345    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 07 17:40:11.310459 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:11.310418    2561 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-tr5mq"
Jul 07 17:40:11.319002 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:11.318981    2561 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-tr5mq"
Jul 07 17:40:11.367669 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:11.367593    2561 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jul 07 17:40:11.385297 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:11.385256    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/eb766f56-403b-4ead-9992-2436c4ee7791-etc-systemd\") pod \"tuned-tr2xs\" (UID: \"eb766f56-403b-4ead-9992-2436c4ee7791\") " pod="openshift-cluster-node-tuning-operator/tuned-tr2xs"
Jul 07 17:40:11.385490 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:11.385304    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/65ec2965-856f-4dc9-94a6-9f8d20151d5d-multus-daemon-config\") pod \"multus-7wjgt\" (UID: \"65ec2965-856f-4dc9-94a6-9f8d20151d5d\") " pod="openshift-multus/multus-7wjgt"
Jul 07 17:40:11.385490 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:11.385332    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2ssch\" (UniqueName: \"kubernetes.io/projected/312df236-de73-4f4c-96dc-35bde1429d6b-kube-api-access-2ssch\") pod \"ovnkube-node-rbzjn\" (UID: \"312df236-de73-4f4c-96dc-35bde1429d6b\") " pod="openshift-ovn-kubernetes/ovnkube-node-rbzjn"
Jul 07 17:40:11.385490 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:11.385358    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/f0111691-8bad-46a1-ac45-0de1d6a50801-sys-fs\") pod \"aws-ebs-csi-driver-node-rlzxl\" (UID: \"f0111691-8bad-46a1-ac45-0de1d6a50801\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rlzxl"
Jul 07 17:40:11.385490 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:11.385383    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/312df236-de73-4f4c-96dc-35bde1429d6b-host-kubelet\") pod \"ovnkube-node-rbzjn\" (UID: \"312df236-de73-4f4c-96dc-35bde1429d6b\") " pod="openshift-ovn-kubernetes/ovnkube-node-rbzjn"
Jul 07 17:40:11.385490 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:11.385405    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/312df236-de73-4f4c-96dc-35bde1429d6b-host-cni-bin\") pod \"ovnkube-node-rbzjn\" (UID: \"312df236-de73-4f4c-96dc-35bde1429d6b\") " pod="openshift-ovn-kubernetes/ovnkube-node-rbzjn"
Jul 07 17:40:11.385490 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:11.385490    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/312df236-de73-4f4c-96dc-35bde1429d6b-host-cni-bin\") pod \"ovnkube-node-rbzjn\" (UID: \"312df236-de73-4f4c-96dc-35bde1429d6b\") " pod="openshift-ovn-kubernetes/ovnkube-node-rbzjn"
Jul 07 17:40:11.385876 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:11.385527    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/312df236-de73-4f4c-96dc-35bde1429d6b-host-kubelet\") pod \"ovnkube-node-rbzjn\" (UID: \"312df236-de73-4f4c-96dc-35bde1429d6b\") " pod="openshift-ovn-kubernetes/ovnkube-node-rbzjn"
Jul 07 17:40:11.385876 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:11.385559    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/312df236-de73-4f4c-96dc-35bde1429d6b-ovnkube-config\") pod \"ovnkube-node-rbzjn\" (UID: \"312df236-de73-4f4c-96dc-35bde1429d6b\") " pod="openshift-ovn-kubernetes/ovnkube-node-rbzjn"
Jul 07 17:40:11.385876 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:11.385583    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/eb766f56-403b-4ead-9992-2436c4ee7791-host\") pod \"tuned-tr2xs\" (UID: \"eb766f56-403b-4ead-9992-2436c4ee7791\") " pod="openshift-cluster-node-tuning-operator/tuned-tr2xs"
Jul 07 17:40:11.385876 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:11.385606    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/65ec2965-856f-4dc9-94a6-9f8d20151d5d-host-run-multus-certs\") pod \"multus-7wjgt\" (UID: \"65ec2965-856f-4dc9-94a6-9f8d20151d5d\") " pod="openshift-multus/multus-7wjgt"
Jul 07 17:40:11.385876 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:11.385630    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/312df236-de73-4f4c-96dc-35bde1429d6b-host-run-netns\") pod \"ovnkube-node-rbzjn\" (UID: \"312df236-de73-4f4c-96dc-35bde1429d6b\") " pod="openshift-ovn-kubernetes/ovnkube-node-rbzjn"
Jul 07 17:40:11.385876 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:11.385656    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gx2kx\" (UniqueName: \"kubernetes.io/projected/9d99e831-14fe-4b13-9a8b-3d9ca165c60e-kube-api-access-gx2kx\") pod \"network-metrics-daemon-pkn6n\" (UID: \"9d99e831-14fe-4b13-9a8b-3d9ca165c60e\") " pod="openshift-multus/network-metrics-daemon-pkn6n"
Jul 07 17:40:11.385876 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:11.385683    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/65ec2965-856f-4dc9-94a6-9f8d20151d5d-os-release\") pod \"multus-7wjgt\" (UID: \"65ec2965-856f-4dc9-94a6-9f8d20151d5d\") " pod="openshift-multus/multus-7wjgt"
Jul 07 17:40:11.385876 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:11.385705    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/65ec2965-856f-4dc9-94a6-9f8d20151d5d-host-var-lib-cni-multus\") pod \"multus-7wjgt\" (UID: \"65ec2965-856f-4dc9-94a6-9f8d20151d5d\") " pod="openshift-multus/multus-7wjgt"
Jul 07 17:40:11.385876 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:11.385733    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-km4h8\" (UniqueName: \"kubernetes.io/projected/0efe7076-81fe-4e2c-bf49-626c4d955b19-kube-api-access-km4h8\") pod \"network-check-target-gmjlh\" (UID: \"0efe7076-81fe-4e2c-bf49-626c4d955b19\") " pod="openshift-network-diagnostics/network-check-target-gmjlh"
Jul 07 17:40:11.385876 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:11.385758    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/e54430cd-5514-416a-83cc-c3b1a549e576-kubelet-config\") pod \"global-pull-secret-syncer-6cwrd\" (UID: \"e54430cd-5514-416a-83cc-c3b1a549e576\") " pod="kube-system/global-pull-secret-syncer-6cwrd"
Jul 07 17:40:11.385876 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:11.385776    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/312df236-de73-4f4c-96dc-35bde1429d6b-host-run-netns\") pod \"ovnkube-node-rbzjn\" (UID: \"312df236-de73-4f4c-96dc-35bde1429d6b\") " pod="openshift-ovn-kubernetes/ovnkube-node-rbzjn"
Jul 07 17:40:11.385876 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:11.385854    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/65ec2965-856f-4dc9-94a6-9f8d20151d5d-os-release\") pod \"multus-7wjgt\" (UID: \"65ec2965-856f-4dc9-94a6-9f8d20151d5d\") " pod="openshift-multus/multus-7wjgt"
Jul 07 17:40:11.386427 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:11.385890    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/65ec2965-856f-4dc9-94a6-9f8d20151d5d-host-var-lib-cni-multus\") pod \"multus-7wjgt\" (UID: \"65ec2965-856f-4dc9-94a6-9f8d20151d5d\") " pod="openshift-multus/multus-7wjgt"
Jul 07 17:40:11.386427 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:11.386033    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/65ec2965-856f-4dc9-94a6-9f8d20151d5d-multus-daemon-config\") pod \"multus-7wjgt\" (UID: \"65ec2965-856f-4dc9-94a6-9f8d20151d5d\") " pod="openshift-multus/multus-7wjgt"
Jul 07 17:40:11.386427 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:11.386127    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/65ec2965-856f-4dc9-94a6-9f8d20151d5d-host-run-multus-certs\") pod \"multus-7wjgt\" (UID: \"65ec2965-856f-4dc9-94a6-9f8d20151d5d\") " pod="openshift-multus/multus-7wjgt"
Jul 07 17:40:11.386427 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:11.386138    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/e54430cd-5514-416a-83cc-c3b1a549e576-kubelet-config\") pod \"global-pull-secret-syncer-6cwrd\" (UID: \"e54430cd-5514-416a-83cc-c3b1a549e576\") " pod="kube-system/global-pull-secret-syncer-6cwrd"
Jul 07 17:40:11.386427 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:11.385782    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/eb766f56-403b-4ead-9992-2436c4ee7791-etc-kubernetes\") pod \"tuned-tr2xs\" (UID: \"eb766f56-403b-4ead-9992-2436c4ee7791\") " pod="openshift-cluster-node-tuning-operator/tuned-tr2xs"
Jul 07 17:40:11.386427 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:11.386179    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jzrxn\" (UniqueName: \"kubernetes.io/projected/54fe2d84-2eed-4379-aeb5-6588b2ee961d-kube-api-access-jzrxn\") pod \"node-resolver-4wz7j\" (UID: \"54fe2d84-2eed-4379-aeb5-6588b2ee961d\") " pod="openshift-dns/node-resolver-4wz7j"
Jul 07 17:40:11.386427 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:11.386206    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/9f644cf8-e282-4cac-b3d9-600ee88741b7-host-slash\") pod \"iptables-alerter-snd82\" (UID: \"9f644cf8-e282-4cac-b3d9-600ee88741b7\") " pod="openshift-network-operator/iptables-alerter-snd82"
Jul 07 17:40:11.386427 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:11.386237    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/65ec2965-856f-4dc9-94a6-9f8d20151d5d-cnibin\") pod \"multus-7wjgt\" (UID: \"65ec2965-856f-4dc9-94a6-9f8d20151d5d\") " pod="openshift-multus/multus-7wjgt"
Jul 07 17:40:11.386427 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:11.386261    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/44315251-6c4d-438d-bc14-446002aa92a7-system-cni-dir\") pod \"multus-additional-cni-plugins-tl75q\" (UID: \"44315251-6c4d-438d-bc14-446002aa92a7\") " pod="openshift-multus/multus-additional-cni-plugins-tl75q"
Jul 07 17:40:11.386427 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:11.386286    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/2ef9c095-d303-40c3-920c-c9ff990f4032-konnectivity-ca\") pod \"konnectivity-agent-kks9r\" (UID: \"2ef9c095-d303-40c3-920c-c9ff990f4032\") " pod="kube-system/konnectivity-agent-kks9r"
Jul 07 17:40:11.386427 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:11.386335    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/eb766f56-403b-4ead-9992-2436c4ee7791-etc-sysctl-conf\") pod \"tuned-tr2xs\" (UID: \"eb766f56-403b-4ead-9992-2436c4ee7791\") " pod="openshift-cluster-node-tuning-operator/tuned-tr2xs"
Jul 07 17:40:11.386427 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:11.386348    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/312df236-de73-4f4c-96dc-35bde1429d6b-ovnkube-config\") pod \"ovnkube-node-rbzjn\" (UID: \"312df236-de73-4f4c-96dc-35bde1429d6b\") " pod="openshift-ovn-kubernetes/ovnkube-node-rbzjn"
Jul 07 17:40:11.386427 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:11.386357    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/eb766f56-403b-4ead-9992-2436c4ee7791-run\") pod \"tuned-tr2xs\" (UID: \"eb766f56-403b-4ead-9992-2436c4ee7791\") " pod="openshift-cluster-node-tuning-operator/tuned-tr2xs"
Jul 07 17:40:11.386427 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:11.386380    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/eb766f56-403b-4ead-9992-2436c4ee7791-var-lib-kubelet\") pod \"tuned-tr2xs\" (UID: \"eb766f56-403b-4ead-9992-2436c4ee7791\") " pod="openshift-cluster-node-tuning-operator/tuned-tr2xs"
Jul 07 17:40:11.386427 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:11.386404    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/eb766f56-403b-4ead-9992-2436c4ee7791-etc-tuned\") pod \"tuned-tr2xs\" (UID: \"eb766f56-403b-4ead-9992-2436c4ee7791\") " pod="openshift-cluster-node-tuning-operator/tuned-tr2xs"
Jul 07 17:40:11.386427 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:11.386414    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/44315251-6c4d-438d-bc14-446002aa92a7-system-cni-dir\") pod \"multus-additional-cni-plugins-tl75q\" (UID: \"44315251-6c4d-438d-bc14-446002aa92a7\") " pod="openshift-multus/multus-additional-cni-plugins-tl75q"
Jul 07 17:40:11.386427 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:11.386430    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/44315251-6c4d-438d-bc14-446002aa92a7-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-tl75q\" (UID: \"44315251-6c4d-438d-bc14-446002aa92a7\") " pod="openshift-multus/multus-additional-cni-plugins-tl75q"
Jul 07 17:40:11.387250 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:11.386473    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/65ec2965-856f-4dc9-94a6-9f8d20151d5d-system-cni-dir\") pod \"multus-7wjgt\" (UID: \"65ec2965-856f-4dc9-94a6-9f8d20151d5d\") " pod="openshift-multus/multus-7wjgt"
Jul 07 17:40:11.387250 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:11.386511    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/65ec2965-856f-4dc9-94a6-9f8d20151d5d-hostroot\") pod \"multus-7wjgt\" (UID: \"65ec2965-856f-4dc9-94a6-9f8d20151d5d\") " pod="openshift-multus/multus-7wjgt"
Jul 07 17:40:11.387250 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:11.386527    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/65ec2965-856f-4dc9-94a6-9f8d20151d5d-cnibin\") pod \"multus-7wjgt\" (UID: \"65ec2965-856f-4dc9-94a6-9f8d20151d5d\") " pod="openshift-multus/multus-7wjgt"
Jul 07 17:40:11.387250 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:11.386534    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/65ec2965-856f-4dc9-94a6-9f8d20151d5d-etc-kubernetes\") pod \"multus-7wjgt\" (UID: \"65ec2965-856f-4dc9-94a6-9f8d20151d5d\") " pod="openshift-multus/multus-7wjgt"
Jul 07 17:40:11.387250 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:11.386584    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/65ec2965-856f-4dc9-94a6-9f8d20151d5d-etc-kubernetes\") pod \"multus-7wjgt\" (UID: \"65ec2965-856f-4dc9-94a6-9f8d20151d5d\") " pod="openshift-multus/multus-7wjgt"
Jul 07 17:40:11.387250 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:11.386610    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mcfdr\" (UniqueName: \"kubernetes.io/projected/eb766f56-403b-4ead-9992-2436c4ee7791-kube-api-access-mcfdr\") pod \"tuned-tr2xs\" (UID: \"eb766f56-403b-4ead-9992-2436c4ee7791\") " pod="openshift-cluster-node-tuning-operator/tuned-tr2xs"
Jul 07 17:40:11.387250 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:11.386649    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/f0111691-8bad-46a1-ac45-0de1d6a50801-kubelet-dir\") pod \"aws-ebs-csi-driver-node-rlzxl\" (UID: \"f0111691-8bad-46a1-ac45-0de1d6a50801\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rlzxl"
Jul 07 17:40:11.387250 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:11.386486    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/9f644cf8-e282-4cac-b3d9-600ee88741b7-host-slash\") pod \"iptables-alerter-snd82\" (UID: \"9f644cf8-e282-4cac-b3d9-600ee88741b7\") " pod="openshift-network-operator/iptables-alerter-snd82"
Jul 07 17:40:11.387250 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:11.386671    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/f0111691-8bad-46a1-ac45-0de1d6a50801-socket-dir\") pod \"aws-ebs-csi-driver-node-rlzxl\" (UID: \"f0111691-8bad-46a1-ac45-0de1d6a50801\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rlzxl"
Jul 07 17:40:11.387250 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:11.386696    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/f0111691-8bad-46a1-ac45-0de1d6a50801-registration-dir\") pod \"aws-ebs-csi-driver-node-rlzxl\" (UID: \"f0111691-8bad-46a1-ac45-0de1d6a50801\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rlzxl"
Jul 07 17:40:11.387250 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:11.386697    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/65ec2965-856f-4dc9-94a6-9f8d20151d5d-hostroot\") pod \"multus-7wjgt\" (UID: \"65ec2965-856f-4dc9-94a6-9f8d20151d5d\") " pod="openshift-multus/multus-7wjgt"
Jul 07 17:40:11.387250 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:11.386721    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/8e97c2c1-e9ea-41fb-9bb9-ed0cf128c144-serviceca\") pod \"node-ca-vf2rn\" (UID: \"8e97c2c1-e9ea-41fb-9bb9-ed0cf128c144\") " pod="openshift-image-registry/node-ca-vf2rn"
Jul 07 17:40:11.387250 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:11.386753    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4wcsf\" (UniqueName: \"kubernetes.io/projected/8e97c2c1-e9ea-41fb-9bb9-ed0cf128c144-kube-api-access-4wcsf\") pod \"node-ca-vf2rn\" (UID: \"8e97c2c1-e9ea-41fb-9bb9-ed0cf128c144\") " pod="openshift-image-registry/node-ca-vf2rn"
Jul 07 17:40:11.387250 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:11.386781    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/65ec2965-856f-4dc9-94a6-9f8d20151d5d-cni-binary-copy\") pod \"multus-7wjgt\" (UID: \"65ec2965-856f-4dc9-94a6-9f8d20151d5d\") " pod="openshift-multus/multus-7wjgt"
Jul 07 17:40:11.387250 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:11.386805    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/312df236-de73-4f4c-96dc-35bde1429d6b-node-log\") pod \"ovnkube-node-rbzjn\" (UID: \"312df236-de73-4f4c-96dc-35bde1429d6b\") " pod="openshift-ovn-kubernetes/ovnkube-node-rbzjn"
Jul 07 17:40:11.387250 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:11.386802    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/65ec2965-856f-4dc9-94a6-9f8d20151d5d-system-cni-dir\") pod \"multus-7wjgt\" (UID: \"65ec2965-856f-4dc9-94a6-9f8d20151d5d\") " pod="openshift-multus/multus-7wjgt"
Jul 07 17:40:11.387250 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:11.386847    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/312df236-de73-4f4c-96dc-35bde1429d6b-node-log\") pod \"ovnkube-node-rbzjn\" (UID: \"312df236-de73-4f4c-96dc-35bde1429d6b\") " pod="openshift-ovn-kubernetes/ovnkube-node-rbzjn"
Jul 07 17:40:11.387250 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:11.386881    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/44315251-6c4d-438d-bc14-446002aa92a7-cnibin\") pod \"multus-additional-cni-plugins-tl75q\" (UID: \"44315251-6c4d-438d-bc14-446002aa92a7\") " pod="openshift-multus/multus-additional-cni-plugins-tl75q"
Jul 07 17:40:11.388148 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:11.386913    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/312df236-de73-4f4c-96dc-35bde1429d6b-systemd-units\") pod \"ovnkube-node-rbzjn\" (UID: \"312df236-de73-4f4c-96dc-35bde1429d6b\") " pod="openshift-ovn-kubernetes/ovnkube-node-rbzjn"
Jul 07 17:40:11.388148 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:11.386948    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/44315251-6c4d-438d-bc14-446002aa92a7-cnibin\") pod \"multus-additional-cni-plugins-tl75q\" (UID: \"44315251-6c4d-438d-bc14-446002aa92a7\") " pod="openshift-multus/multus-additional-cni-plugins-tl75q"
Jul 07 17:40:11.388148 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:11.386971    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9d99e831-14fe-4b13-9a8b-3d9ca165c60e-metrics-certs\") pod \"network-metrics-daemon-pkn6n\" (UID: \"9d99e831-14fe-4b13-9a8b-3d9ca165c60e\") " pod="openshift-multus/network-metrics-daemon-pkn6n"
Jul 07 17:40:11.388148 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:11.386992    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/312df236-de73-4f4c-96dc-35bde1429d6b-systemd-units\") pod \"ovnkube-node-rbzjn\" (UID: \"312df236-de73-4f4c-96dc-35bde1429d6b\") " pod="openshift-ovn-kubernetes/ovnkube-node-rbzjn"
Jul 07 17:40:11.388148 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:11.387032    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/f0111691-8bad-46a1-ac45-0de1d6a50801-etc-selinux\") pod \"aws-ebs-csi-driver-node-rlzxl\" (UID: \"f0111691-8bad-46a1-ac45-0de1d6a50801\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rlzxl"
Jul 07 17:40:11.388148 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:11.387059    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x295j\" (UniqueName: \"kubernetes.io/projected/f0111691-8bad-46a1-ac45-0de1d6a50801-kube-api-access-x295j\") pod \"aws-ebs-csi-driver-node-rlzxl\" (UID: \"f0111691-8bad-46a1-ac45-0de1d6a50801\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rlzxl"
Jul 07 17:40:11.388148 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:11.387094    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/44315251-6c4d-438d-bc14-446002aa92a7-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-tl75q\" (UID: \"44315251-6c4d-438d-bc14-446002aa92a7\") " pod="openshift-multus/multus-additional-cni-plugins-tl75q"
Jul 07 17:40:11.388148 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:11.387107    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jl7j9\" (UniqueName: \"kubernetes.io/projected/65ec2965-856f-4dc9-94a6-9f8d20151d5d-kube-api-access-jl7j9\") pod \"multus-7wjgt\" (UID: \"65ec2965-856f-4dc9-94a6-9f8d20151d5d\") " pod="openshift-multus/multus-7wjgt"
Jul 07 17:40:11.388148 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:11.387134    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/312df236-de73-4f4c-96dc-35bde1429d6b-host-run-ovn-kubernetes\") pod \"ovnkube-node-rbzjn\" (UID: \"312df236-de73-4f4c-96dc-35bde1429d6b\") " pod="openshift-ovn-kubernetes/ovnkube-node-rbzjn"
Jul 07 17:40:11.388148 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:11.387159    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/2ef9c095-d303-40c3-920c-c9ff990f4032-agent-certs\") pod \"konnectivity-agent-kks9r\" (UID: \"2ef9c095-d303-40c3-920c-c9ff990f4032\") " pod="kube-system/konnectivity-agent-kks9r"
Jul 07 17:40:11.388148 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:11.387182    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/54fe2d84-2eed-4379-aeb5-6588b2ee961d-tmp-dir\") pod \"node-resolver-4wz7j\" (UID: \"54fe2d84-2eed-4379-aeb5-6588b2ee961d\") " pod="openshift-dns/node-resolver-4wz7j"
Jul 07 17:40:11.388148 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:11.387205    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/65ec2965-856f-4dc9-94a6-9f8d20151d5d-host-run-netns\") pod \"multus-7wjgt\" (UID: \"65ec2965-856f-4dc9-94a6-9f8d20151d5d\") " pod="openshift-multus/multus-7wjgt"
Jul 07 17:40:11.388148 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:11.387229    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/312df236-de73-4f4c-96dc-35bde1429d6b-run-systemd\") pod \"ovnkube-node-rbzjn\" (UID: \"312df236-de73-4f4c-96dc-35bde1429d6b\") " pod="openshift-ovn-kubernetes/ovnkube-node-rbzjn"
Jul 07 17:40:11.388148 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:11.387256    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/312df236-de73-4f4c-96dc-35bde1429d6b-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-rbzjn\" (UID: \"312df236-de73-4f4c-96dc-35bde1429d6b\") " pod="openshift-ovn-kubernetes/ovnkube-node-rbzjn"
Jul 07 17:40:11.388148 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:11.387281    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/e54430cd-5514-416a-83cc-c3b1a549e576-dbus\") pod \"global-pull-secret-syncer-6cwrd\" (UID: \"e54430cd-5514-416a-83cc-c3b1a549e576\") " pod="kube-system/global-pull-secret-syncer-6cwrd"
Jul 07 17:40:11.388148 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:11.387292    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/65ec2965-856f-4dc9-94a6-9f8d20151d5d-cni-binary-copy\") pod \"multus-7wjgt\" (UID: \"65ec2965-856f-4dc9-94a6-9f8d20151d5d\") " pod="openshift-multus/multus-7wjgt"
Jul 07 17:40:11.388148 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:11.387304    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/eb766f56-403b-4ead-9992-2436c4ee7791-etc-sysconfig\") pod \"tuned-tr2xs\" (UID: \"eb766f56-403b-4ead-9992-2436c4ee7791\") " pod="openshift-cluster-node-tuning-operator/tuned-tr2xs"
Jul 07 17:40:11.388954 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:11.387356    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/65ec2965-856f-4dc9-94a6-9f8d20151d5d-host-run-netns\") pod \"multus-7wjgt\" (UID: \"65ec2965-856f-4dc9-94a6-9f8d20151d5d\") " pod="openshift-multus/multus-7wjgt"
Jul 07 17:40:11.388954 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:11.387385    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/312df236-de73-4f4c-96dc-35bde1429d6b-host-run-ovn-kubernetes\") pod \"ovnkube-node-rbzjn\" (UID: \"312df236-de73-4f4c-96dc-35bde1429d6b\") " pod="openshift-ovn-kubernetes/ovnkube-node-rbzjn"
Jul 07 17:40:11.388954 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:11.387382    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/8e97c2c1-e9ea-41fb-9bb9-ed0cf128c144-serviceca\") pod \"node-ca-vf2rn\" (UID: \"8e97c2c1-e9ea-41fb-9bb9-ed0cf128c144\") " pod="openshift-image-registry/node-ca-vf2rn"
Jul 07 17:40:11.388954 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:11.387374    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/312df236-de73-4f4c-96dc-35bde1429d6b-run-systemd\") pod \"ovnkube-node-rbzjn\" (UID: \"312df236-de73-4f4c-96dc-35bde1429d6b\") " pod="openshift-ovn-kubernetes/ovnkube-node-rbzjn"
Jul 07 17:40:11.388954 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:11.387429    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/312df236-de73-4f4c-96dc-35bde1429d6b-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-rbzjn\" (UID: \"312df236-de73-4f4c-96dc-35bde1429d6b\") " pod="openshift-ovn-kubernetes/ovnkube-node-rbzjn"
Jul 07 17:40:11.388954 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:11.387476    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/eb766f56-403b-4ead-9992-2436c4ee7791-sys\") pod \"tuned-tr2xs\" (UID: \"eb766f56-403b-4ead-9992-2436c4ee7791\") " pod="openshift-cluster-node-tuning-operator/tuned-tr2xs"
Jul 07 17:40:11.388954 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:11.387515    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/65ec2965-856f-4dc9-94a6-9f8d20151d5d-multus-socket-dir-parent\") pod \"multus-7wjgt\" (UID: \"65ec2965-856f-4dc9-94a6-9f8d20151d5d\") " pod="openshift-multus/multus-7wjgt"
Jul 07 17:40:11.388954 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:11.387542    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/44315251-6c4d-438d-bc14-446002aa92a7-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-tl75q\" (UID: \"44315251-6c4d-438d-bc14-446002aa92a7\") " pod="openshift-multus/multus-additional-cni-plugins-tl75q"
Jul 07 17:40:11.388954 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:11.387572    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/e54430cd-5514-416a-83cc-c3b1a549e576-dbus\") pod \"global-pull-secret-syncer-6cwrd\" (UID: \"e54430cd-5514-416a-83cc-c3b1a549e576\") " pod="kube-system/global-pull-secret-syncer-6cwrd"
Jul 07 17:40:11.388954 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:11.387606    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/65ec2965-856f-4dc9-94a6-9f8d20151d5d-multus-socket-dir-parent\") pod \"multus-7wjgt\" (UID: \"65ec2965-856f-4dc9-94a6-9f8d20151d5d\") " pod="openshift-multus/multus-7wjgt"
Jul 07 17:40:11.388954 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:11.387650    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/eb766f56-403b-4ead-9992-2436c4ee7791-etc-modprobe-d\") pod \"tuned-tr2xs\" (UID: \"eb766f56-403b-4ead-9992-2436c4ee7791\") " pod="openshift-cluster-node-tuning-operator/tuned-tr2xs"
Jul 07 17:40:11.388954 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:11.387678    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/eb766f56-403b-4ead-9992-2436c4ee7791-etc-sysctl-d\") pod \"tuned-tr2xs\" (UID: \"eb766f56-403b-4ead-9992-2436c4ee7791\") " pod="openshift-cluster-node-tuning-operator/tuned-tr2xs"
Jul 07 17:40:11.388954 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:11.387703    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/eb766f56-403b-4ead-9992-2436c4ee7791-tmp\") pod \"tuned-tr2xs\" (UID: \"eb766f56-403b-4ead-9992-2436c4ee7791\") " pod="openshift-cluster-node-tuning-operator/tuned-tr2xs"
Jul 07 17:40:11.388954 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:11.387736    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q9xzj\" (UniqueName: \"kubernetes.io/projected/44315251-6c4d-438d-bc14-446002aa92a7-kube-api-access-q9xzj\") pod \"multus-additional-cni-plugins-tl75q\" (UID: \"44315251-6c4d-438d-bc14-446002aa92a7\") " pod="openshift-multus/multus-additional-cni-plugins-tl75q"
Jul 07 17:40:11.388954 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:11.387766    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/65ec2965-856f-4dc9-94a6-9f8d20151d5d-multus-cni-dir\") pod \"multus-7wjgt\" (UID: \"65ec2965-856f-4dc9-94a6-9f8d20151d5d\") " pod="openshift-multus/multus-7wjgt"
Jul 07 17:40:11.388954 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:11.387791    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/65ec2965-856f-4dc9-94a6-9f8d20151d5d-host-run-k8s-cni-cncf-io\") pod \"multus-7wjgt\" (UID: \"65ec2965-856f-4dc9-94a6-9f8d20151d5d\") " pod="openshift-multus/multus-7wjgt"
Jul 07 17:40:11.388954 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:11.387814    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/65ec2965-856f-4dc9-94a6-9f8d20151d5d-host-var-lib-cni-bin\") pod \"multus-7wjgt\" (UID: \"65ec2965-856f-4dc9-94a6-9f8d20151d5d\") " pod="openshift-multus/multus-7wjgt"
Jul 07 17:40:11.389559 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:11.387837    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/65ec2965-856f-4dc9-94a6-9f8d20151d5d-multus-conf-dir\") pod \"multus-7wjgt\" (UID: \"65ec2965-856f-4dc9-94a6-9f8d20151d5d\") " pod="openshift-multus/multus-7wjgt"
Jul 07 17:40:11.389559 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:11.387860    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/312df236-de73-4f4c-96dc-35bde1429d6b-host-slash\") pod \"ovnkube-node-rbzjn\" (UID: \"312df236-de73-4f4c-96dc-35bde1429d6b\") " pod="openshift-ovn-kubernetes/ovnkube-node-rbzjn"
Jul 07 17:40:11.389559 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:11.387882    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/312df236-de73-4f4c-96dc-35bde1429d6b-var-lib-openvswitch\") pod \"ovnkube-node-rbzjn\" (UID: \"312df236-de73-4f4c-96dc-35bde1429d6b\") " pod="openshift-ovn-kubernetes/ovnkube-node-rbzjn"
Jul 07 17:40:11.389559 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:11.387906    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/312df236-de73-4f4c-96dc-35bde1429d6b-run-openvswitch\") pod \"ovnkube-node-rbzjn\" (UID: \"312df236-de73-4f4c-96dc-35bde1429d6b\") " pod="openshift-ovn-kubernetes/ovnkube-node-rbzjn"
Jul 07 17:40:11.389559 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:11.387930    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/44315251-6c4d-438d-bc14-446002aa92a7-cni-binary-copy\") pod \"multus-additional-cni-plugins-tl75q\" (UID: \"44315251-6c4d-438d-bc14-446002aa92a7\") " pod="openshift-multus/multus-additional-cni-plugins-tl75q"
Jul 07 17:40:11.389559 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:11.387940    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/44315251-6c4d-438d-bc14-446002aa92a7-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-tl75q\" (UID: \"44315251-6c4d-438d-bc14-446002aa92a7\") " pod="openshift-multus/multus-additional-cni-plugins-tl75q"
Jul 07 17:40:11.389559 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:11.387955    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/312df236-de73-4f4c-96dc-35bde1429d6b-etc-openvswitch\") pod \"ovnkube-node-rbzjn\" (UID: \"312df236-de73-4f4c-96dc-35bde1429d6b\") " pod="openshift-ovn-kubernetes/ovnkube-node-rbzjn"
Jul 07 17:40:11.389559 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:11.387980    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/312df236-de73-4f4c-96dc-35bde1429d6b-run-openvswitch\") pod \"ovnkube-node-rbzjn\" (UID: \"312df236-de73-4f4c-96dc-35bde1429d6b\") " pod="openshift-ovn-kubernetes/ovnkube-node-rbzjn"
Jul 07 17:40:11.389559 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:11.387998    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/65ec2965-856f-4dc9-94a6-9f8d20151d5d-multus-cni-dir\") pod \"multus-7wjgt\" (UID: \"65ec2965-856f-4dc9-94a6-9f8d20151d5d\") " pod="openshift-multus/multus-7wjgt"
Jul 07 17:40:11.389559 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:11.388023    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/312df236-de73-4f4c-96dc-35bde1429d6b-var-lib-openvswitch\") pod \"ovnkube-node-rbzjn\" (UID: \"312df236-de73-4f4c-96dc-35bde1429d6b\") " pod="openshift-ovn-kubernetes/ovnkube-node-rbzjn"
Jul 07 17:40:11.389559 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:11.387978    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/312df236-de73-4f4c-96dc-35bde1429d6b-run-ovn\") pod \"ovnkube-node-rbzjn\" (UID: \"312df236-de73-4f4c-96dc-35bde1429d6b\") " pod="openshift-ovn-kubernetes/ovnkube-node-rbzjn"
Jul 07 17:40:11.389559 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:11.388044    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/65ec2965-856f-4dc9-94a6-9f8d20151d5d-host-run-k8s-cni-cncf-io\") pod \"multus-7wjgt\" (UID: \"65ec2965-856f-4dc9-94a6-9f8d20151d5d\") " pod="openshift-multus/multus-7wjgt"
Jul 07 17:40:11.389559 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:11.388056    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/312df236-de73-4f4c-96dc-35bde1429d6b-env-overrides\") pod \"ovnkube-node-rbzjn\" (UID: \"312df236-de73-4f4c-96dc-35bde1429d6b\") " pod="openshift-ovn-kubernetes/ovnkube-node-rbzjn"
Jul 07 17:40:11.389559 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:11.388074    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/312df236-de73-4f4c-96dc-35bde1429d6b-ovnkube-script-lib\") pod \"ovnkube-node-rbzjn\" (UID: \"312df236-de73-4f4c-96dc-35bde1429d6b\") " pod="openshift-ovn-kubernetes/ovnkube-node-rbzjn"
Jul 07 17:40:11.389559 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:11.388083    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/65ec2965-856f-4dc9-94a6-9f8d20151d5d-host-var-lib-cni-bin\") pod \"multus-7wjgt\" (UID: \"65ec2965-856f-4dc9-94a6-9f8d20151d5d\") " pod="openshift-multus/multus-7wjgt"
Jul 07 17:40:11.389559 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:11.388091    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e54430cd-5514-416a-83cc-c3b1a549e576-original-pull-secret\") pod \"global-pull-secret-syncer-6cwrd\" (UID: \"e54430cd-5514-416a-83cc-c3b1a549e576\") " pod="kube-system/global-pull-secret-syncer-6cwrd"
Jul 07 17:40:11.389559 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:11.388116    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/f0111691-8bad-46a1-ac45-0de1d6a50801-device-dir\") pod \"aws-ebs-csi-driver-node-rlzxl\" (UID: \"f0111691-8bad-46a1-ac45-0de1d6a50801\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rlzxl"
Jul 07 17:40:11.390340 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:11.388120    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/312df236-de73-4f4c-96dc-35bde1429d6b-etc-openvswitch\") pod \"ovnkube-node-rbzjn\" (UID: \"312df236-de73-4f4c-96dc-35bde1429d6b\") " pod="openshift-ovn-kubernetes/ovnkube-node-rbzjn"
Jul 07 17:40:11.390340 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:11.388153    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/54fe2d84-2eed-4379-aeb5-6588b2ee961d-hosts-file\") pod \"node-resolver-4wz7j\" (UID: \"54fe2d84-2eed-4379-aeb5-6588b2ee961d\") " pod="openshift-dns/node-resolver-4wz7j"
Jul 07 17:40:11.390340 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:11.388177    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/8e97c2c1-e9ea-41fb-9bb9-ed0cf128c144-host\") pod \"node-ca-vf2rn\" (UID: \"8e97c2c1-e9ea-41fb-9bb9-ed0cf128c144\") " pod="openshift-image-registry/node-ca-vf2rn"
Jul 07 17:40:11.390340 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:11.388201    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/65ec2965-856f-4dc9-94a6-9f8d20151d5d-host-var-lib-kubelet\") pod \"multus-7wjgt\" (UID: \"65ec2965-856f-4dc9-94a6-9f8d20151d5d\") " pod="openshift-multus/multus-7wjgt"
Jul 07 17:40:11.390340 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:11.388225    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/312df236-de73-4f4c-96dc-35bde1429d6b-host-cni-netd\") pod \"ovnkube-node-rbzjn\" (UID: \"312df236-de73-4f4c-96dc-35bde1429d6b\") " pod="openshift-ovn-kubernetes/ovnkube-node-rbzjn"
Jul 07 17:40:11.390340 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:11.388242    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/312df236-de73-4f4c-96dc-35bde1429d6b-ovn-node-metrics-cert\") pod \"ovnkube-node-rbzjn\" (UID: \"312df236-de73-4f4c-96dc-35bde1429d6b\") " pod="openshift-ovn-kubernetes/ovnkube-node-rbzjn"
Jul 07 17:40:11.390340 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:11.388257    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/44315251-6c4d-438d-bc14-446002aa92a7-os-release\") pod \"multus-additional-cni-plugins-tl75q\" (UID: \"44315251-6c4d-438d-bc14-446002aa92a7\") " pod="openshift-multus/multus-additional-cni-plugins-tl75q"
Jul 07 17:40:11.390340 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:11.388282    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t6nc8\" (UniqueName: \"kubernetes.io/projected/9f644cf8-e282-4cac-b3d9-600ee88741b7-kube-api-access-t6nc8\") pod \"iptables-alerter-snd82\" (UID: \"9f644cf8-e282-4cac-b3d9-600ee88741b7\") " pod="openshift-network-operator/iptables-alerter-snd82"
Jul 07 17:40:11.390340 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:11.388305    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/eb766f56-403b-4ead-9992-2436c4ee7791-lib-modules\") pod \"tuned-tr2xs\" (UID: \"eb766f56-403b-4ead-9992-2436c4ee7791\") " pod="openshift-cluster-node-tuning-operator/tuned-tr2xs"
Jul 07 17:40:11.390340 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:11.388326    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/312df236-de73-4f4c-96dc-35bde1429d6b-log-socket\") pod \"ovnkube-node-rbzjn\" (UID: \"312df236-de73-4f4c-96dc-35bde1429d6b\") " pod="openshift-ovn-kubernetes/ovnkube-node-rbzjn"
Jul 07 17:40:11.390340 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:11.388341    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/44315251-6c4d-438d-bc14-446002aa92a7-tuning-conf-dir\") pod \"multus-additional-cni-plugins-tl75q\" (UID: \"44315251-6c4d-438d-bc14-446002aa92a7\") " pod="openshift-multus/multus-additional-cni-plugins-tl75q"
Jul 07 17:40:11.390340 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:11.388357    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/9f644cf8-e282-4cac-b3d9-600ee88741b7-iptables-alerter-script\") pod \"iptables-alerter-snd82\" (UID: \"9f644cf8-e282-4cac-b3d9-600ee88741b7\") " pod="openshift-network-operator/iptables-alerter-snd82"
Jul 07 17:40:11.390340 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:11.388459    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/44315251-6c4d-438d-bc14-446002aa92a7-cni-binary-copy\") pod \"multus-additional-cni-plugins-tl75q\" (UID: \"44315251-6c4d-438d-bc14-446002aa92a7\") " pod="openshift-multus/multus-additional-cni-plugins-tl75q"
Jul 07 17:40:11.390340 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:11.388518    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/312df236-de73-4f4c-96dc-35bde1429d6b-host-slash\") pod \"ovnkube-node-rbzjn\" (UID: \"312df236-de73-4f4c-96dc-35bde1429d6b\") " pod="openshift-ovn-kubernetes/ovnkube-node-rbzjn"
Jul 07 17:40:11.390340 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:11.388556    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/312df236-de73-4f4c-96dc-35bde1429d6b-run-ovn\") pod \"ovnkube-node-rbzjn\" (UID: \"312df236-de73-4f4c-96dc-35bde1429d6b\") " pod="openshift-ovn-kubernetes/ovnkube-node-rbzjn"
Jul 07 17:40:11.390340 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:11.388641    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/312df236-de73-4f4c-96dc-35bde1429d6b-host-cni-netd\") pod \"ovnkube-node-rbzjn\" (UID: \"312df236-de73-4f4c-96dc-35bde1429d6b\") " pod="openshift-ovn-kubernetes/ovnkube-node-rbzjn"
Jul 07 17:40:11.390340 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:11.388657    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/312df236-de73-4f4c-96dc-35bde1429d6b-ovnkube-script-lib\") pod \"ovnkube-node-rbzjn\" (UID: \"312df236-de73-4f4c-96dc-35bde1429d6b\") " pod="openshift-ovn-kubernetes/ovnkube-node-rbzjn"
Jul 07 17:40:11.391144 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:11.388154    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/65ec2965-856f-4dc9-94a6-9f8d20151d5d-multus-conf-dir\") pod \"multus-7wjgt\" (UID: \"65ec2965-856f-4dc9-94a6-9f8d20151d5d\") " pod="openshift-multus/multus-7wjgt"
Jul 07 17:40:11.391144 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:11.388820    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/9f644cf8-e282-4cac-b3d9-600ee88741b7-iptables-alerter-script\") pod \"iptables-alerter-snd82\" (UID: \"9f644cf8-e282-4cac-b3d9-600ee88741b7\") " pod="openshift-network-operator/iptables-alerter-snd82"
Jul 07 17:40:11.391144 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:11.388872    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/8e97c2c1-e9ea-41fb-9bb9-ed0cf128c144-host\") pod \"node-ca-vf2rn\" (UID: \"8e97c2c1-e9ea-41fb-9bb9-ed0cf128c144\") " pod="openshift-image-registry/node-ca-vf2rn"
Jul 07 17:40:11.391144 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:11.388908    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/312df236-de73-4f4c-96dc-35bde1429d6b-log-socket\") pod \"ovnkube-node-rbzjn\" (UID: \"312df236-de73-4f4c-96dc-35bde1429d6b\") " pod="openshift-ovn-kubernetes/ovnkube-node-rbzjn"
Jul 07 17:40:11.391144 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:11.388918    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/312df236-de73-4f4c-96dc-35bde1429d6b-env-overrides\") pod \"ovnkube-node-rbzjn\" (UID: \"312df236-de73-4f4c-96dc-35bde1429d6b\") " pod="openshift-ovn-kubernetes/ovnkube-node-rbzjn"
Jul 07 17:40:11.391144 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:11.388932    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/44315251-6c4d-438d-bc14-446002aa92a7-os-release\") pod \"multus-additional-cni-plugins-tl75q\" (UID: \"44315251-6c4d-438d-bc14-446002aa92a7\") " pod="openshift-multus/multus-additional-cni-plugins-tl75q"
Jul 07 17:40:11.391144 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:11.388963    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/65ec2965-856f-4dc9-94a6-9f8d20151d5d-host-var-lib-kubelet\") pod \"multus-7wjgt\" (UID: \"65ec2965-856f-4dc9-94a6-9f8d20151d5d\") " pod="openshift-multus/multus-7wjgt"
Jul 07 17:40:11.391144 ip-10-0-139-31 kubenswrapper[2561]: E0707 17:40:11.388984    2561 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 07 17:40:11.391144 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:11.389036    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/44315251-6c4d-438d-bc14-446002aa92a7-tuning-conf-dir\") pod \"multus-additional-cni-plugins-tl75q\" (UID: \"44315251-6c4d-438d-bc14-446002aa92a7\") " pod="openshift-multus/multus-additional-cni-plugins-tl75q"
Jul 07 17:40:11.391144 ip-10-0-139-31 kubenswrapper[2561]: E0707 17:40:11.389128    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e54430cd-5514-416a-83cc-c3b1a549e576-original-pull-secret podName:e54430cd-5514-416a-83cc-c3b1a549e576 nodeName:}" failed. No retries permitted until 2026-07-07 17:40:11.889093801 +0000 UTC m=+3.040218193 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e54430cd-5514-416a-83cc-c3b1a549e576-original-pull-secret") pod "global-pull-secret-syncer-6cwrd" (UID: "e54430cd-5514-416a-83cc-c3b1a549e576") : object "kube-system"/"original-pull-secret" not registered
Jul 07 17:40:11.391144 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:11.389204    2561 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jul 07 17:40:11.393180 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:11.393157    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/312df236-de73-4f4c-96dc-35bde1429d6b-ovn-node-metrics-cert\") pod \"ovnkube-node-rbzjn\" (UID: \"312df236-de73-4f4c-96dc-35bde1429d6b\") " pod="openshift-ovn-kubernetes/ovnkube-node-rbzjn"
Jul 07 17:40:11.395229 ip-10-0-139-31 kubenswrapper[2561]: E0707 17:40:11.395209    2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 07 17:40:11.395334 ip-10-0-139-31 kubenswrapper[2561]: E0707 17:40:11.395234    2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 07 17:40:11.395334 ip-10-0-139-31 kubenswrapper[2561]: E0707 17:40:11.395247    2561 projected.go:196] Error preparing data for projected volume kube-api-access-km4h8 for pod openshift-network-diagnostics/network-check-target-gmjlh: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 07 17:40:11.395334 ip-10-0-139-31 kubenswrapper[2561]: E0707 17:40:11.395305    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0efe7076-81fe-4e2c-bf49-626c4d955b19-kube-api-access-km4h8 podName:0efe7076-81fe-4e2c-bf49-626c4d955b19 nodeName:}" failed. No retries permitted until 2026-07-07 17:40:11.895287045 +0000 UTC m=+3.046411424 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-km4h8" (UniqueName: "kubernetes.io/projected/0efe7076-81fe-4e2c-bf49-626c4d955b19-kube-api-access-km4h8") pod "network-check-target-gmjlh" (UID: "0efe7076-81fe-4e2c-bf49-626c4d955b19") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 07 17:40:11.395334 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:11.395242    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2ssch\" (UniqueName: \"kubernetes.io/projected/312df236-de73-4f4c-96dc-35bde1429d6b-kube-api-access-2ssch\") pod \"ovnkube-node-rbzjn\" (UID: \"312df236-de73-4f4c-96dc-35bde1429d6b\") " pod="openshift-ovn-kubernetes/ovnkube-node-rbzjn"
Jul 07 17:40:11.401461 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:11.401415    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t6nc8\" (UniqueName: \"kubernetes.io/projected/9f644cf8-e282-4cac-b3d9-600ee88741b7-kube-api-access-t6nc8\") pod \"iptables-alerter-snd82\" (UID: \"9f644cf8-e282-4cac-b3d9-600ee88741b7\") " pod="openshift-network-operator/iptables-alerter-snd82"
Jul 07 17:40:11.402300 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:11.402267    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4wcsf\" (UniqueName: \"kubernetes.io/projected/8e97c2c1-e9ea-41fb-9bb9-ed0cf128c144-kube-api-access-4wcsf\") pod \"node-ca-vf2rn\" (UID: \"8e97c2c1-e9ea-41fb-9bb9-ed0cf128c144\") " pod="openshift-image-registry/node-ca-vf2rn"
Jul 07 17:40:11.403757 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:11.403735    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jl7j9\" (UniqueName: \"kubernetes.io/projected/65ec2965-856f-4dc9-94a6-9f8d20151d5d-kube-api-access-jl7j9\") pod \"multus-7wjgt\" (UID: \"65ec2965-856f-4dc9-94a6-9f8d20151d5d\") " pod="openshift-multus/multus-7wjgt"
Jul 07 17:40:11.405312 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:11.405288    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q9xzj\" (UniqueName: \"kubernetes.io/projected/44315251-6c4d-438d-bc14-446002aa92a7-kube-api-access-q9xzj\") pod \"multus-additional-cni-plugins-tl75q\" (UID: \"44315251-6c4d-438d-bc14-446002aa92a7\") " pod="openshift-multus/multus-additional-cni-plugins-tl75q"
Jul 07 17:40:11.488698 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:11.488664    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/2ef9c095-d303-40c3-920c-c9ff990f4032-konnectivity-ca\") pod \"konnectivity-agent-kks9r\" (UID: \"2ef9c095-d303-40c3-920c-c9ff990f4032\") " pod="kube-system/konnectivity-agent-kks9r"
Jul 07 17:40:11.488698 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:11.488702    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/eb766f56-403b-4ead-9992-2436c4ee7791-etc-sysctl-conf\") pod \"tuned-tr2xs\" (UID: \"eb766f56-403b-4ead-9992-2436c4ee7791\") " pod="openshift-cluster-node-tuning-operator/tuned-tr2xs"
Jul 07 17:40:11.488938 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:11.488723    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/eb766f56-403b-4ead-9992-2436c4ee7791-run\") pod \"tuned-tr2xs\" (UID: \"eb766f56-403b-4ead-9992-2436c4ee7791\") " pod="openshift-cluster-node-tuning-operator/tuned-tr2xs"
Jul 07 17:40:11.488938 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:11.488745    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/eb766f56-403b-4ead-9992-2436c4ee7791-var-lib-kubelet\") pod \"tuned-tr2xs\" (UID: \"eb766f56-403b-4ead-9992-2436c4ee7791\") " pod="openshift-cluster-node-tuning-operator/tuned-tr2xs"
Jul 07 17:40:11.488938 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:11.488763    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/eb766f56-403b-4ead-9992-2436c4ee7791-etc-tuned\") pod \"tuned-tr2xs\" (UID: \"eb766f56-403b-4ead-9992-2436c4ee7791\") " pod="openshift-cluster-node-tuning-operator/tuned-tr2xs"
Jul 07 17:40:11.488938 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:11.488788    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mcfdr\" (UniqueName: \"kubernetes.io/projected/eb766f56-403b-4ead-9992-2436c4ee7791-kube-api-access-mcfdr\") pod \"tuned-tr2xs\" (UID: \"eb766f56-403b-4ead-9992-2436c4ee7791\") " pod="openshift-cluster-node-tuning-operator/tuned-tr2xs"
Jul 07 17:40:11.488938 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:11.488825    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/f0111691-8bad-46a1-ac45-0de1d6a50801-kubelet-dir\") pod \"aws-ebs-csi-driver-node-rlzxl\" (UID: \"f0111691-8bad-46a1-ac45-0de1d6a50801\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rlzxl"
Jul 07 17:40:11.488938 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:11.488848    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/eb766f56-403b-4ead-9992-2436c4ee7791-run\") pod \"tuned-tr2xs\" (UID: \"eb766f56-403b-4ead-9992-2436c4ee7791\") " pod="openshift-cluster-node-tuning-operator/tuned-tr2xs"
Jul 07 17:40:11.488938 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:11.488856    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/f0111691-8bad-46a1-ac45-0de1d6a50801-socket-dir\") pod \"aws-ebs-csi-driver-node-rlzxl\" (UID: \"f0111691-8bad-46a1-ac45-0de1d6a50801\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rlzxl"
Jul 07 17:40:11.488938 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:11.488887    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/eb766f56-403b-4ead-9992-2436c4ee7791-etc-sysctl-conf\") pod \"tuned-tr2xs\" (UID: \"eb766f56-403b-4ead-9992-2436c4ee7791\") " pod="openshift-cluster-node-tuning-operator/tuned-tr2xs"
Jul 07 17:40:11.488938 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:11.488911    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/f0111691-8bad-46a1-ac45-0de1d6a50801-registration-dir\") pod \"aws-ebs-csi-driver-node-rlzxl\" (UID: \"f0111691-8bad-46a1-ac45-0de1d6a50801\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rlzxl"
Jul 07 17:40:11.489345 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:11.488945    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9d99e831-14fe-4b13-9a8b-3d9ca165c60e-metrics-certs\") pod \"network-metrics-daemon-pkn6n\" (UID: \"9d99e831-14fe-4b13-9a8b-3d9ca165c60e\") " pod="openshift-multus/network-metrics-daemon-pkn6n"
Jul 07 17:40:11.489345 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:11.488971    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/f0111691-8bad-46a1-ac45-0de1d6a50801-etc-selinux\") pod \"aws-ebs-csi-driver-node-rlzxl\" (UID: \"f0111691-8bad-46a1-ac45-0de1d6a50801\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rlzxl"
Jul 07 17:40:11.489345 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:11.488995    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x295j\" (UniqueName: \"kubernetes.io/projected/f0111691-8bad-46a1-ac45-0de1d6a50801-kube-api-access-x295j\") pod \"aws-ebs-csi-driver-node-rlzxl\" (UID: \"f0111691-8bad-46a1-ac45-0de1d6a50801\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rlzxl"
Jul 07 17:40:11.489345 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:11.489020    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/2ef9c095-d303-40c3-920c-c9ff990f4032-agent-certs\") pod \"konnectivity-agent-kks9r\" (UID: \"2ef9c095-d303-40c3-920c-c9ff990f4032\") " pod="kube-system/konnectivity-agent-kks9r"
Jul 07 17:40:11.489345 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:11.489047    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/54fe2d84-2eed-4379-aeb5-6588b2ee961d-tmp-dir\") pod \"node-resolver-4wz7j\" (UID: \"54fe2d84-2eed-4379-aeb5-6588b2ee961d\") " pod="openshift-dns/node-resolver-4wz7j"
Jul 07 17:40:11.489345 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:11.489074    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/eb766f56-403b-4ead-9992-2436c4ee7791-etc-sysconfig\") pod \"tuned-tr2xs\" (UID: \"eb766f56-403b-4ead-9992-2436c4ee7791\") " pod="openshift-cluster-node-tuning-operator/tuned-tr2xs"
Jul 07 17:40:11.489345 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:11.489097    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/eb766f56-403b-4ead-9992-2436c4ee7791-sys\") pod \"tuned-tr2xs\" (UID: \"eb766f56-403b-4ead-9992-2436c4ee7791\") " pod="openshift-cluster-node-tuning-operator/tuned-tr2xs"
Jul 07 17:40:11.489345 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:11.489122    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/eb766f56-403b-4ead-9992-2436c4ee7791-etc-modprobe-d\") pod \"tuned-tr2xs\" (UID: \"eb766f56-403b-4ead-9992-2436c4ee7791\") " pod="openshift-cluster-node-tuning-operator/tuned-tr2xs"
Jul 07 17:40:11.489345 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:11.489143    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/eb766f56-403b-4ead-9992-2436c4ee7791-etc-sysctl-d\") pod \"tuned-tr2xs\" (UID: \"eb766f56-403b-4ead-9992-2436c4ee7791\") " pod="openshift-cluster-node-tuning-operator/tuned-tr2xs"
Jul 07 17:40:11.489345 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:11.489165    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/eb766f56-403b-4ead-9992-2436c4ee7791-tmp\") pod \"tuned-tr2xs\" (UID: \"eb766f56-403b-4ead-9992-2436c4ee7791\") " pod="openshift-cluster-node-tuning-operator/tuned-tr2xs"
Jul 07 17:40:11.489345 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:11.489217    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/f0111691-8bad-46a1-ac45-0de1d6a50801-device-dir\") pod \"aws-ebs-csi-driver-node-rlzxl\" (UID: \"f0111691-8bad-46a1-ac45-0de1d6a50801\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rlzxl"
Jul 07 17:40:11.489345 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:11.489228    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/eb766f56-403b-4ead-9992-2436c4ee7791-var-lib-kubelet\") pod \"tuned-tr2xs\" (UID: \"eb766f56-403b-4ead-9992-2436c4ee7791\") " pod="openshift-cluster-node-tuning-operator/tuned-tr2xs"
Jul 07 17:40:11.489345 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:11.489265    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/f0111691-8bad-46a1-ac45-0de1d6a50801-device-dir\") pod \"aws-ebs-csi-driver-node-rlzxl\" (UID: \"f0111691-8bad-46a1-ac45-0de1d6a50801\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rlzxl"
Jul 07 17:40:11.489345 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:11.489290    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/eb766f56-403b-4ead-9992-2436c4ee7791-sys\") pod \"tuned-tr2xs\" (UID: \"eb766f56-403b-4ead-9992-2436c4ee7791\") " pod="openshift-cluster-node-tuning-operator/tuned-tr2xs"
Jul 07 17:40:11.489345 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:11.489312    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/f0111691-8bad-46a1-ac45-0de1d6a50801-kubelet-dir\") pod \"aws-ebs-csi-driver-node-rlzxl\" (UID: \"f0111691-8bad-46a1-ac45-0de1d6a50801\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rlzxl"
Jul 07 17:40:11.490074 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:11.489363    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/eb766f56-403b-4ead-9992-2436c4ee7791-etc-modprobe-d\") pod \"tuned-tr2xs\" (UID: \"eb766f56-403b-4ead-9992-2436c4ee7791\") " pod="openshift-cluster-node-tuning-operator/tuned-tr2xs"
Jul 07 17:40:11.490074 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:11.489363    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/2ef9c095-d303-40c3-920c-c9ff990f4032-konnectivity-ca\") pod \"konnectivity-agent-kks9r\" (UID: \"2ef9c095-d303-40c3-920c-c9ff990f4032\") " pod="kube-system/konnectivity-agent-kks9r"
Jul 07 17:40:11.490074 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:11.489407    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/eb766f56-403b-4ead-9992-2436c4ee7791-etc-sysconfig\") pod \"tuned-tr2xs\" (UID: \"eb766f56-403b-4ead-9992-2436c4ee7791\") " pod="openshift-cluster-node-tuning-operator/tuned-tr2xs"
Jul 07 17:40:11.490074 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:11.489490    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/f0111691-8bad-46a1-ac45-0de1d6a50801-etc-selinux\") pod \"aws-ebs-csi-driver-node-rlzxl\" (UID: \"f0111691-8bad-46a1-ac45-0de1d6a50801\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rlzxl"
Jul 07 17:40:11.490074 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:11.489512    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/eb766f56-403b-4ead-9992-2436c4ee7791-etc-sysctl-d\") pod \"tuned-tr2xs\" (UID: \"eb766f56-403b-4ead-9992-2436c4ee7791\") " pod="openshift-cluster-node-tuning-operator/tuned-tr2xs"
Jul 07 17:40:11.490074 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:11.488969    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/f0111691-8bad-46a1-ac45-0de1d6a50801-socket-dir\") pod \"aws-ebs-csi-driver-node-rlzxl\" (UID: \"f0111691-8bad-46a1-ac45-0de1d6a50801\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rlzxl"
Jul 07 17:40:11.490074 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:11.489541    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/f0111691-8bad-46a1-ac45-0de1d6a50801-registration-dir\") pod \"aws-ebs-csi-driver-node-rlzxl\" (UID: \"f0111691-8bad-46a1-ac45-0de1d6a50801\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rlzxl"
Jul 07 17:40:11.490074 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:11.489575    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/54fe2d84-2eed-4379-aeb5-6588b2ee961d-tmp-dir\") pod \"node-resolver-4wz7j\" (UID: \"54fe2d84-2eed-4379-aeb5-6588b2ee961d\") " pod="openshift-dns/node-resolver-4wz7j"
Jul 07 17:40:11.490074 ip-10-0-139-31 kubenswrapper[2561]: E0707 17:40:11.489615    2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 07 17:40:11.490074 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:11.489659    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/54fe2d84-2eed-4379-aeb5-6588b2ee961d-hosts-file\") pod \"node-resolver-4wz7j\" (UID: \"54fe2d84-2eed-4379-aeb5-6588b2ee961d\") " pod="openshift-dns/node-resolver-4wz7j"
Jul 07 17:40:11.490074 ip-10-0-139-31 kubenswrapper[2561]: E0707 17:40:11.489677    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9d99e831-14fe-4b13-9a8b-3d9ca165c60e-metrics-certs podName:9d99e831-14fe-4b13-9a8b-3d9ca165c60e nodeName:}" failed. No retries permitted until 2026-07-07 17:40:11.98966078 +0000 UTC m=+3.140785155 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9d99e831-14fe-4b13-9a8b-3d9ca165c60e-metrics-certs") pod "network-metrics-daemon-pkn6n" (UID: "9d99e831-14fe-4b13-9a8b-3d9ca165c60e") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 07 17:40:11.490074 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:11.489708    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/54fe2d84-2eed-4379-aeb5-6588b2ee961d-hosts-file\") pod \"node-resolver-4wz7j\" (UID: \"54fe2d84-2eed-4379-aeb5-6588b2ee961d\") " pod="openshift-dns/node-resolver-4wz7j"
Jul 07 17:40:11.490074 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:11.489730    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/eb766f56-403b-4ead-9992-2436c4ee7791-lib-modules\") pod \"tuned-tr2xs\" (UID: \"eb766f56-403b-4ead-9992-2436c4ee7791\") " pod="openshift-cluster-node-tuning-operator/tuned-tr2xs"
Jul 07 17:40:11.490074 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:11.489765    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/eb766f56-403b-4ead-9992-2436c4ee7791-etc-systemd\") pod \"tuned-tr2xs\" (UID: \"eb766f56-403b-4ead-9992-2436c4ee7791\") " pod="openshift-cluster-node-tuning-operator/tuned-tr2xs"
Jul 07 17:40:11.490074 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:11.489792    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/f0111691-8bad-46a1-ac45-0de1d6a50801-sys-fs\") pod \"aws-ebs-csi-driver-node-rlzxl\" (UID: \"f0111691-8bad-46a1-ac45-0de1d6a50801\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rlzxl"
Jul 07 17:40:11.490074 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:11.489822    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/eb766f56-403b-4ead-9992-2436c4ee7791-host\") pod \"tuned-tr2xs\" (UID: \"eb766f56-403b-4ead-9992-2436c4ee7791\") " pod="openshift-cluster-node-tuning-operator/tuned-tr2xs"
Jul 07 17:40:11.490074 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:11.489851    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gx2kx\" (UniqueName: \"kubernetes.io/projected/9d99e831-14fe-4b13-9a8b-3d9ca165c60e-kube-api-access-gx2kx\") pod \"network-metrics-daemon-pkn6n\" (UID: \"9d99e831-14fe-4b13-9a8b-3d9ca165c60e\") " pod="openshift-multus/network-metrics-daemon-pkn6n"
Jul 07 17:40:11.490931 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:11.489851    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/eb766f56-403b-4ead-9992-2436c4ee7791-lib-modules\") pod \"tuned-tr2xs\" (UID: \"eb766f56-403b-4ead-9992-2436c4ee7791\") " pod="openshift-cluster-node-tuning-operator/tuned-tr2xs"
Jul 07 17:40:11.490931 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:11.489878    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/eb766f56-403b-4ead-9992-2436c4ee7791-etc-systemd\") pod \"tuned-tr2xs\" (UID: \"eb766f56-403b-4ead-9992-2436c4ee7791\") " pod="openshift-cluster-node-tuning-operator/tuned-tr2xs"
Jul 07 17:40:11.490931 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:11.489901    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/eb766f56-403b-4ead-9992-2436c4ee7791-host\") pod \"tuned-tr2xs\" (UID: \"eb766f56-403b-4ead-9992-2436c4ee7791\") " pod="openshift-cluster-node-tuning-operator/tuned-tr2xs"
Jul 07 17:40:11.490931 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:11.489901    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/f0111691-8bad-46a1-ac45-0de1d6a50801-sys-fs\") pod \"aws-ebs-csi-driver-node-rlzxl\" (UID: \"f0111691-8bad-46a1-ac45-0de1d6a50801\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rlzxl"
Jul 07 17:40:11.490931 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:11.489945    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/eb766f56-403b-4ead-9992-2436c4ee7791-etc-kubernetes\") pod \"tuned-tr2xs\" (UID: \"eb766f56-403b-4ead-9992-2436c4ee7791\") " pod="openshift-cluster-node-tuning-operator/tuned-tr2xs"
Jul 07 17:40:11.490931 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:11.489974    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jzrxn\" (UniqueName: \"kubernetes.io/projected/54fe2d84-2eed-4379-aeb5-6588b2ee961d-kube-api-access-jzrxn\") pod \"node-resolver-4wz7j\" (UID: \"54fe2d84-2eed-4379-aeb5-6588b2ee961d\") " pod="openshift-dns/node-resolver-4wz7j"
Jul 07 17:40:11.490931 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:11.490032    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/eb766f56-403b-4ead-9992-2436c4ee7791-etc-kubernetes\") pod \"tuned-tr2xs\" (UID: \"eb766f56-403b-4ead-9992-2436c4ee7791\") " pod="openshift-cluster-node-tuning-operator/tuned-tr2xs"
Jul 07 17:40:11.491524 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:11.491506    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/eb766f56-403b-4ead-9992-2436c4ee7791-etc-tuned\") pod \"tuned-tr2xs\" (UID: \"eb766f56-403b-4ead-9992-2436c4ee7791\") " pod="openshift-cluster-node-tuning-operator/tuned-tr2xs"
Jul 07 17:40:11.491838 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:11.491793    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/eb766f56-403b-4ead-9992-2436c4ee7791-tmp\") pod \"tuned-tr2xs\" (UID: \"eb766f56-403b-4ead-9992-2436c4ee7791\") " pod="openshift-cluster-node-tuning-operator/tuned-tr2xs"
Jul 07 17:40:11.491910 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:11.491901    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/2ef9c095-d303-40c3-920c-c9ff990f4032-agent-certs\") pod \"konnectivity-agent-kks9r\" (UID: \"2ef9c095-d303-40c3-920c-c9ff990f4032\") " pod="kube-system/konnectivity-agent-kks9r"
Jul 07 17:40:11.499223 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:11.499195    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mcfdr\" (UniqueName: \"kubernetes.io/projected/eb766f56-403b-4ead-9992-2436c4ee7791-kube-api-access-mcfdr\") pod \"tuned-tr2xs\" (UID: \"eb766f56-403b-4ead-9992-2436c4ee7791\") " pod="openshift-cluster-node-tuning-operator/tuned-tr2xs"
Jul 07 17:40:11.499947 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:11.499894    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-x295j\" (UniqueName: \"kubernetes.io/projected/f0111691-8bad-46a1-ac45-0de1d6a50801-kube-api-access-x295j\") pod \"aws-ebs-csi-driver-node-rlzxl\" (UID: \"f0111691-8bad-46a1-ac45-0de1d6a50801\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rlzxl"
Jul 07 17:40:11.500229 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:11.500201    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gx2kx\" (UniqueName: \"kubernetes.io/projected/9d99e831-14fe-4b13-9a8b-3d9ca165c60e-kube-api-access-gx2kx\") pod \"network-metrics-daemon-pkn6n\" (UID: \"9d99e831-14fe-4b13-9a8b-3d9ca165c60e\") " pod="openshift-multus/network-metrics-daemon-pkn6n"
Jul 07 17:40:11.500933 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:11.500842    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jzrxn\" (UniqueName: \"kubernetes.io/projected/54fe2d84-2eed-4379-aeb5-6588b2ee961d-kube-api-access-jzrxn\") pod \"node-resolver-4wz7j\" (UID: \"54fe2d84-2eed-4379-aeb5-6588b2ee961d\") " pod="openshift-dns/node-resolver-4wz7j"
Jul 07 17:40:11.521916 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:11.521858    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-31.ec2.internal" event={"ID":"b3b4cf5ec3f082f4790614941a60c42f","Type":"ContainerStarted","Data":"698d5d32f0b6a936f81766319f8cbab335b35e19036206727d0569f890554b96"}
Jul 07 17:40:11.522994 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:11.522966    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-31.ec2.internal" event={"ID":"bc20af9d845b73d5b3a3fef90b1087f9","Type":"ContainerStarted","Data":"61c853045620bffeedc07de126c0075fd31d314b5feebde62326fa0cb091ea00"}
Jul 07 17:40:11.576491 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:11.576437    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-rbzjn"
Jul 07 17:40:11.583068 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:11.583035    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-vf2rn"
Jul 07 17:40:11.591869 ip-10-0-139-31 kubenswrapper[2561]: W0707 17:40:11.591795    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod312df236_de73_4f4c_96dc_35bde1429d6b.slice/crio-8c3dedd0f960805ba21a083c79fd5768fe12c139691035395cd73f7cf8e7ff44 WatchSource:0}: Error finding container 8c3dedd0f960805ba21a083c79fd5768fe12c139691035395cd73f7cf8e7ff44: Status 404 returned error can't find the container with id 8c3dedd0f960805ba21a083c79fd5768fe12c139691035395cd73f7cf8e7ff44
Jul 07 17:40:11.592884 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:11.592858    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-7wjgt"
Jul 07 17:40:11.595226 ip-10-0-139-31 kubenswrapper[2561]: W0707 17:40:11.595190    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8e97c2c1_e9ea_41fb_9bb9_ed0cf128c144.slice/crio-cad70109192eb7e54245987dfc6b7e2ac262b07de3b68b973383426a6fb56a0d WatchSource:0}: Error finding container cad70109192eb7e54245987dfc6b7e2ac262b07de3b68b973383426a6fb56a0d: Status 404 returned error can't find the container with id cad70109192eb7e54245987dfc6b7e2ac262b07de3b68b973383426a6fb56a0d
Jul 07 17:40:11.599648 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:11.599626    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-tl75q"
Jul 07 17:40:11.604859 ip-10-0-139-31 kubenswrapper[2561]: W0707 17:40:11.604831    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod65ec2965_856f_4dc9_94a6_9f8d20151d5d.slice/crio-7efd0dfb97211474d16a72c157c2a38a78c78ed5f55ac61283c0eabb5bcf315e WatchSource:0}: Error finding container 7efd0dfb97211474d16a72c157c2a38a78c78ed5f55ac61283c0eabb5bcf315e: Status 404 returned error can't find the container with id 7efd0dfb97211474d16a72c157c2a38a78c78ed5f55ac61283c0eabb5bcf315e
Jul 07 17:40:11.608966 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:11.608943    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-snd82"
Jul 07 17:40:11.610156 ip-10-0-139-31 kubenswrapper[2561]: W0707 17:40:11.610130    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod44315251_6c4d_438d_bc14_446002aa92a7.slice/crio-1eb9bb39805f13b02fc0bae2cab37cc8734ab6c9e4ea43dd4f3c3b26ed0e45ca WatchSource:0}: Error finding container 1eb9bb39805f13b02fc0bae2cab37cc8734ab6c9e4ea43dd4f3c3b26ed0e45ca: Status 404 returned error can't find the container with id 1eb9bb39805f13b02fc0bae2cab37cc8734ab6c9e4ea43dd4f3c3b26ed0e45ca
Jul 07 17:40:11.616790 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:11.616767    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-kks9r"
Jul 07 17:40:11.618622 ip-10-0-139-31 kubenswrapper[2561]: W0707 17:40:11.618570    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9f644cf8_e282_4cac_b3d9_600ee88741b7.slice/crio-505fa6e537009dca11df42f5be6149f21c805a621fce1e216aa65bbd13327077 WatchSource:0}: Error finding container 505fa6e537009dca11df42f5be6149f21c805a621fce1e216aa65bbd13327077: Status 404 returned error can't find the container with id 505fa6e537009dca11df42f5be6149f21c805a621fce1e216aa65bbd13327077
Jul 07 17:40:11.625660 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:11.625632    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rlzxl"
Jul 07 17:40:11.637692 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:11.637657    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-tr2xs"
Jul 07 17:40:11.644489 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:11.644466    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-4wz7j"
Jul 07 17:40:11.726776 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:11.726745    2561 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 07 17:40:11.893139 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:11.893043    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e54430cd-5514-416a-83cc-c3b1a549e576-original-pull-secret\") pod \"global-pull-secret-syncer-6cwrd\" (UID: \"e54430cd-5514-416a-83cc-c3b1a549e576\") " pod="kube-system/global-pull-secret-syncer-6cwrd"
Jul 07 17:40:11.893312 ip-10-0-139-31 kubenswrapper[2561]: E0707 17:40:11.893215    2561 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 07 17:40:11.893312 ip-10-0-139-31 kubenswrapper[2561]: E0707 17:40:11.893287    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e54430cd-5514-416a-83cc-c3b1a549e576-original-pull-secret podName:e54430cd-5514-416a-83cc-c3b1a549e576 nodeName:}" failed. No retries permitted until 2026-07-07 17:40:12.893264558 +0000 UTC m=+4.044388941 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e54430cd-5514-416a-83cc-c3b1a549e576-original-pull-secret") pod "global-pull-secret-syncer-6cwrd" (UID: "e54430cd-5514-416a-83cc-c3b1a549e576") : object "kube-system"/"original-pull-secret" not registered
Jul 07 17:40:11.993840 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:11.993799    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-km4h8\" (UniqueName: \"kubernetes.io/projected/0efe7076-81fe-4e2c-bf49-626c4d955b19-kube-api-access-km4h8\") pod \"network-check-target-gmjlh\" (UID: \"0efe7076-81fe-4e2c-bf49-626c4d955b19\") " pod="openshift-network-diagnostics/network-check-target-gmjlh"
Jul 07 17:40:11.993999 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:11.993862    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9d99e831-14fe-4b13-9a8b-3d9ca165c60e-metrics-certs\") pod \"network-metrics-daemon-pkn6n\" (UID: \"9d99e831-14fe-4b13-9a8b-3d9ca165c60e\") " pod="openshift-multus/network-metrics-daemon-pkn6n"
Jul 07 17:40:11.993999 ip-10-0-139-31 kubenswrapper[2561]: E0707 17:40:11.993991    2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 07 17:40:11.994102 ip-10-0-139-31 kubenswrapper[2561]: E0707 17:40:11.993995    2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 07 17:40:11.994102 ip-10-0-139-31 kubenswrapper[2561]: E0707 17:40:11.994020    2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 07 17:40:11.994102 ip-10-0-139-31 kubenswrapper[2561]: E0707 17:40:11.994033    2561 projected.go:196] Error preparing data for projected volume kube-api-access-km4h8 for pod openshift-network-diagnostics/network-check-target-gmjlh: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 07 17:40:11.994102 ip-10-0-139-31 kubenswrapper[2561]: E0707 17:40:11.994053    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9d99e831-14fe-4b13-9a8b-3d9ca165c60e-metrics-certs podName:9d99e831-14fe-4b13-9a8b-3d9ca165c60e nodeName:}" failed. No retries permitted until 2026-07-07 17:40:12.994031956 +0000 UTC m=+4.145156351 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9d99e831-14fe-4b13-9a8b-3d9ca165c60e-metrics-certs") pod "network-metrics-daemon-pkn6n" (UID: "9d99e831-14fe-4b13-9a8b-3d9ca165c60e") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 07 17:40:11.994102 ip-10-0-139-31 kubenswrapper[2561]: E0707 17:40:11.994086    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0efe7076-81fe-4e2c-bf49-626c4d955b19-kube-api-access-km4h8 podName:0efe7076-81fe-4e2c-bf49-626c4d955b19 nodeName:}" failed. No retries permitted until 2026-07-07 17:40:12.994069375 +0000 UTC m=+4.145193765 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-km4h8" (UniqueName: "kubernetes.io/projected/0efe7076-81fe-4e2c-bf49-626c4d955b19-kube-api-access-km4h8") pod "network-check-target-gmjlh" (UID: "0efe7076-81fe-4e2c-bf49-626c4d955b19") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 07 17:40:12.322859 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:12.322696    2561 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-06 17:35:11 +0000 UTC" deadline="2028-04-19 04:01:55.897446698 +0000 UTC"
Jul 07 17:40:12.322859 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:12.322761    2561 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15634h21m43.574690168s"
Jul 07 17:40:12.515209 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:12.515174    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pkn6n"
Jul 07 17:40:12.515405 ip-10-0-139-31 kubenswrapper[2561]: E0707 17:40:12.515328    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pkn6n" podUID="9d99e831-14fe-4b13-9a8b-3d9ca165c60e"
Jul 07 17:40:12.526807 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:12.526765    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-vf2rn" event={"ID":"8e97c2c1-e9ea-41fb-9bb9-ed0cf128c144","Type":"ContainerStarted","Data":"cad70109192eb7e54245987dfc6b7e2ac262b07de3b68b973383426a6fb56a0d"}
Jul 07 17:40:12.528161 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:12.528138    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rbzjn" event={"ID":"312df236-de73-4f4c-96dc-35bde1429d6b","Type":"ContainerStarted","Data":"8c3dedd0f960805ba21a083c79fd5768fe12c139691035395cd73f7cf8e7ff44"}
Jul 07 17:40:12.529551 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:12.529486    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-snd82" event={"ID":"9f644cf8-e282-4cac-b3d9-600ee88741b7","Type":"ContainerStarted","Data":"505fa6e537009dca11df42f5be6149f21c805a621fce1e216aa65bbd13327077"}
Jul 07 17:40:12.531435 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:12.531216    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-tl75q" event={"ID":"44315251-6c4d-438d-bc14-446002aa92a7","Type":"ContainerStarted","Data":"1eb9bb39805f13b02fc0bae2cab37cc8734ab6c9e4ea43dd4f3c3b26ed0e45ca"}
Jul 07 17:40:12.532870 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:12.532801    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-7wjgt" event={"ID":"65ec2965-856f-4dc9-94a6-9f8d20151d5d","Type":"ContainerStarted","Data":"7efd0dfb97211474d16a72c157c2a38a78c78ed5f55ac61283c0eabb5bcf315e"}
Jul 07 17:40:12.837865 ip-10-0-139-31 kubenswrapper[2561]: W0707 17:40:12.837836    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod54fe2d84_2eed_4379_aeb5_6588b2ee961d.slice/crio-25b84873ac312206afa4cac3dce69606b4449122e44c0256c51c430b8efae032 WatchSource:0}: Error finding container 25b84873ac312206afa4cac3dce69606b4449122e44c0256c51c430b8efae032: Status 404 returned error can't find the container with id 25b84873ac312206afa4cac3dce69606b4449122e44c0256c51c430b8efae032
Jul 07 17:40:12.860533 ip-10-0-139-31 kubenswrapper[2561]: W0707 17:40:12.860493    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeb766f56_403b_4ead_9992_2436c4ee7791.slice/crio-c377d396ce4673faec15ba761332557bfce8cc360206ab92af9a06f5603c589b WatchSource:0}: Error finding container c377d396ce4673faec15ba761332557bfce8cc360206ab92af9a06f5603c589b: Status 404 returned error can't find the container with id c377d396ce4673faec15ba761332557bfce8cc360206ab92af9a06f5603c589b
Jul 07 17:40:12.900727 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:12.900691    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e54430cd-5514-416a-83cc-c3b1a549e576-original-pull-secret\") pod \"global-pull-secret-syncer-6cwrd\" (UID: \"e54430cd-5514-416a-83cc-c3b1a549e576\") " pod="kube-system/global-pull-secret-syncer-6cwrd"
Jul 07 17:40:12.900948 ip-10-0-139-31 kubenswrapper[2561]: E0707 17:40:12.900903    2561 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 07 17:40:12.901055 ip-10-0-139-31 kubenswrapper[2561]: E0707 17:40:12.900984    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e54430cd-5514-416a-83cc-c3b1a549e576-original-pull-secret podName:e54430cd-5514-416a-83cc-c3b1a549e576 nodeName:}" failed. No retries permitted until 2026-07-07 17:40:14.900963576 +0000 UTC m=+6.052087958 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e54430cd-5514-416a-83cc-c3b1a549e576-original-pull-secret") pod "global-pull-secret-syncer-6cwrd" (UID: "e54430cd-5514-416a-83cc-c3b1a549e576") : object "kube-system"/"original-pull-secret" not registered
Jul 07 17:40:13.001513 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:13.001266    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-km4h8\" (UniqueName: \"kubernetes.io/projected/0efe7076-81fe-4e2c-bf49-626c4d955b19-kube-api-access-km4h8\") pod \"network-check-target-gmjlh\" (UID: \"0efe7076-81fe-4e2c-bf49-626c4d955b19\") " pod="openshift-network-diagnostics/network-check-target-gmjlh"
Jul 07 17:40:13.001513 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:13.001507    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9d99e831-14fe-4b13-9a8b-3d9ca165c60e-metrics-certs\") pod \"network-metrics-daemon-pkn6n\" (UID: \"9d99e831-14fe-4b13-9a8b-3d9ca165c60e\") " pod="openshift-multus/network-metrics-daemon-pkn6n"
Jul 07 17:40:13.001729 ip-10-0-139-31 kubenswrapper[2561]: E0707 17:40:13.001671    2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 07 17:40:13.001842 ip-10-0-139-31 kubenswrapper[2561]: E0707 17:40:13.001733    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9d99e831-14fe-4b13-9a8b-3d9ca165c60e-metrics-certs podName:9d99e831-14fe-4b13-9a8b-3d9ca165c60e nodeName:}" failed. No retries permitted until 2026-07-07 17:40:15.001715373 +0000 UTC m=+6.152839763 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9d99e831-14fe-4b13-9a8b-3d9ca165c60e-metrics-certs") pod "network-metrics-daemon-pkn6n" (UID: "9d99e831-14fe-4b13-9a8b-3d9ca165c60e") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 07 17:40:13.002158 ip-10-0-139-31 kubenswrapper[2561]: E0707 17:40:13.002019    2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 07 17:40:13.002158 ip-10-0-139-31 kubenswrapper[2561]: E0707 17:40:13.002044    2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 07 17:40:13.002158 ip-10-0-139-31 kubenswrapper[2561]: E0707 17:40:13.002057    2561 projected.go:196] Error preparing data for projected volume kube-api-access-km4h8 for pod openshift-network-diagnostics/network-check-target-gmjlh: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 07 17:40:13.002158 ip-10-0-139-31 kubenswrapper[2561]: E0707 17:40:13.002109    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0efe7076-81fe-4e2c-bf49-626c4d955b19-kube-api-access-km4h8 podName:0efe7076-81fe-4e2c-bf49-626c4d955b19 nodeName:}" failed. No retries permitted until 2026-07-07 17:40:15.002093311 +0000 UTC m=+6.153217690 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-km4h8" (UniqueName: "kubernetes.io/projected/0efe7076-81fe-4e2c-bf49-626c4d955b19-kube-api-access-km4h8") pod "network-check-target-gmjlh" (UID: "0efe7076-81fe-4e2c-bf49-626c4d955b19") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 07 17:40:13.322943 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:13.322902    2561 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-06 17:35:11 +0000 UTC" deadline="2028-03-21 00:45:33.070173798 +0000 UTC"
Jul 07 17:40:13.322943 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:13.322943    2561 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14935h5m19.747236231s"
Jul 07 17:40:13.518081 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:13.518041    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6cwrd"
Jul 07 17:40:13.518426 ip-10-0-139-31 kubenswrapper[2561]: E0707 17:40:13.518179    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6cwrd" podUID="e54430cd-5514-416a-83cc-c3b1a549e576"
Jul 07 17:40:13.518595 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:13.518575    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gmjlh"
Jul 07 17:40:13.518679 ip-10-0-139-31 kubenswrapper[2561]: E0707 17:40:13.518664    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gmjlh" podUID="0efe7076-81fe-4e2c-bf49-626c4d955b19"
Jul 07 17:40:13.538504 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:13.538468    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-tr2xs" event={"ID":"eb766f56-403b-4ead-9992-2436c4ee7791","Type":"ContainerStarted","Data":"c377d396ce4673faec15ba761332557bfce8cc360206ab92af9a06f5603c589b"}
Jul 07 17:40:13.547227 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:13.547134    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-kks9r" event={"ID":"2ef9c095-d303-40c3-920c-c9ff990f4032","Type":"ContainerStarted","Data":"9df036de0bb9e30cbdfe33fad35deb8f17ae4157c2fafc88835d5f2b43ebf82c"}
Jul 07 17:40:13.568010 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:13.567900    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-31.ec2.internal" event={"ID":"bc20af9d845b73d5b3a3fef90b1087f9","Type":"ContainerStarted","Data":"b0899e996b950dfa47ab5161ecf2ca690318a6fa5b47589ef8c3b83abd2639b8"}
Jul 07 17:40:13.570474 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:13.570408    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-4wz7j" event={"ID":"54fe2d84-2eed-4379-aeb5-6588b2ee961d","Type":"ContainerStarted","Data":"25b84873ac312206afa4cac3dce69606b4449122e44c0256c51c430b8efae032"}
Jul 07 17:40:13.585371 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:13.585333    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rlzxl" event={"ID":"f0111691-8bad-46a1-ac45-0de1d6a50801","Type":"ContainerStarted","Data":"c8e0dd220fc3e276238439de221fad2f0d4c689bef4ea4c324824f4ccebb99fa"}
Jul 07 17:40:13.596086 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:13.595967    2561 generic.go:356] "Generic (PLEG): container finished" podID="b3b4cf5ec3f082f4790614941a60c42f" containerID="b7100de1c0248036c23781fb62b6f54c74e9e6270b41f5b5886ee1163fd06783" exitCode=0
Jul 07 17:40:13.596086 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:13.596021    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-31.ec2.internal" event={"ID":"b3b4cf5ec3f082f4790614941a60c42f","Type":"ContainerDied","Data":"b7100de1c0248036c23781fb62b6f54c74e9e6270b41f5b5886ee1163fd06783"}
Jul 07 17:40:13.617473 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:13.617085    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-31.ec2.internal" podStartSLOduration=3.617062291 podStartE2EDuration="3.617062291s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 17:40:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 17:40:13.590011417 +0000 UTC m=+4.741135816" watchObservedRunningTime="2026-07-07 17:40:13.617062291 +0000 UTC m=+4.768186690"
Jul 07 17:40:14.515723 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:14.515640    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pkn6n"
Jul 07 17:40:14.516173 ip-10-0-139-31 kubenswrapper[2561]: E0707 17:40:14.515777    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pkn6n" podUID="9d99e831-14fe-4b13-9a8b-3d9ca165c60e"
Jul 07 17:40:14.626602 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:14.626564    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-31.ec2.internal" event={"ID":"b3b4cf5ec3f082f4790614941a60c42f","Type":"ContainerStarted","Data":"de23ea60a82efab25632239c3299c1e0935545c6eeaba9b13b341f9f35e5e762"}
Jul 07 17:40:14.916946 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:14.916860    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e54430cd-5514-416a-83cc-c3b1a549e576-original-pull-secret\") pod \"global-pull-secret-syncer-6cwrd\" (UID: \"e54430cd-5514-416a-83cc-c3b1a549e576\") " pod="kube-system/global-pull-secret-syncer-6cwrd"
Jul 07 17:40:14.917125 ip-10-0-139-31 kubenswrapper[2561]: E0707 17:40:14.917048    2561 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 07 17:40:14.917125 ip-10-0-139-31 kubenswrapper[2561]: E0707 17:40:14.917111    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e54430cd-5514-416a-83cc-c3b1a549e576-original-pull-secret podName:e54430cd-5514-416a-83cc-c3b1a549e576 nodeName:}" failed. No retries permitted until 2026-07-07 17:40:18.91709212 +0000 UTC m=+10.068216500 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e54430cd-5514-416a-83cc-c3b1a549e576-original-pull-secret") pod "global-pull-secret-syncer-6cwrd" (UID: "e54430cd-5514-416a-83cc-c3b1a549e576") : object "kube-system"/"original-pull-secret" not registered
Jul 07 17:40:15.018356 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:15.017457    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-km4h8\" (UniqueName: \"kubernetes.io/projected/0efe7076-81fe-4e2c-bf49-626c4d955b19-kube-api-access-km4h8\") pod \"network-check-target-gmjlh\" (UID: \"0efe7076-81fe-4e2c-bf49-626c4d955b19\") " pod="openshift-network-diagnostics/network-check-target-gmjlh"
Jul 07 17:40:15.018356 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:15.017524    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9d99e831-14fe-4b13-9a8b-3d9ca165c60e-metrics-certs\") pod \"network-metrics-daemon-pkn6n\" (UID: \"9d99e831-14fe-4b13-9a8b-3d9ca165c60e\") " pod="openshift-multus/network-metrics-daemon-pkn6n"
Jul 07 17:40:15.018356 ip-10-0-139-31 kubenswrapper[2561]: E0707 17:40:15.017650    2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 07 17:40:15.018356 ip-10-0-139-31 kubenswrapper[2561]: E0707 17:40:15.017713    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9d99e831-14fe-4b13-9a8b-3d9ca165c60e-metrics-certs podName:9d99e831-14fe-4b13-9a8b-3d9ca165c60e nodeName:}" failed. No retries permitted until 2026-07-07 17:40:19.01769449 +0000 UTC m=+10.168818889 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9d99e831-14fe-4b13-9a8b-3d9ca165c60e-metrics-certs") pod "network-metrics-daemon-pkn6n" (UID: "9d99e831-14fe-4b13-9a8b-3d9ca165c60e") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 07 17:40:15.018356 ip-10-0-139-31 kubenswrapper[2561]: E0707 17:40:15.018243    2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 07 17:40:15.018356 ip-10-0-139-31 kubenswrapper[2561]: E0707 17:40:15.018263    2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 07 17:40:15.018356 ip-10-0-139-31 kubenswrapper[2561]: E0707 17:40:15.018277    2561 projected.go:196] Error preparing data for projected volume kube-api-access-km4h8 for pod openshift-network-diagnostics/network-check-target-gmjlh: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 07 17:40:15.018356 ip-10-0-139-31 kubenswrapper[2561]: E0707 17:40:15.018319    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0efe7076-81fe-4e2c-bf49-626c4d955b19-kube-api-access-km4h8 podName:0efe7076-81fe-4e2c-bf49-626c4d955b19 nodeName:}" failed. No retries permitted until 2026-07-07 17:40:19.018306156 +0000 UTC m=+10.169430550 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-km4h8" (UniqueName: "kubernetes.io/projected/0efe7076-81fe-4e2c-bf49-626c4d955b19-kube-api-access-km4h8") pod "network-check-target-gmjlh" (UID: "0efe7076-81fe-4e2c-bf49-626c4d955b19") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 07 17:40:15.516255 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:15.516222    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6cwrd"
Jul 07 17:40:15.516755 ip-10-0-139-31 kubenswrapper[2561]: E0707 17:40:15.516360    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6cwrd" podUID="e54430cd-5514-416a-83cc-c3b1a549e576"
Jul 07 17:40:15.516755 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:15.516417    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gmjlh"
Jul 07 17:40:15.516755 ip-10-0-139-31 kubenswrapper[2561]: E0707 17:40:15.516538    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gmjlh" podUID="0efe7076-81fe-4e2c-bf49-626c4d955b19"
Jul 07 17:40:16.516294 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:16.515799    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pkn6n"
Jul 07 17:40:16.516294 ip-10-0-139-31 kubenswrapper[2561]: E0707 17:40:16.515947    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pkn6n" podUID="9d99e831-14fe-4b13-9a8b-3d9ca165c60e"
Jul 07 17:40:17.515926 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:17.515412    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gmjlh"
Jul 07 17:40:17.515926 ip-10-0-139-31 kubenswrapper[2561]: E0707 17:40:17.515563    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gmjlh" podUID="0efe7076-81fe-4e2c-bf49-626c4d955b19"
Jul 07 17:40:17.515926 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:17.515614    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6cwrd"
Jul 07 17:40:17.515926 ip-10-0-139-31 kubenswrapper[2561]: E0707 17:40:17.515730    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6cwrd" podUID="e54430cd-5514-416a-83cc-c3b1a549e576"
Jul 07 17:40:18.515309 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:18.515273    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pkn6n"
Jul 07 17:40:18.515774 ip-10-0-139-31 kubenswrapper[2561]: E0707 17:40:18.515411    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pkn6n" podUID="9d99e831-14fe-4b13-9a8b-3d9ca165c60e"
Jul 07 17:40:18.948274 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:18.948187    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e54430cd-5514-416a-83cc-c3b1a549e576-original-pull-secret\") pod \"global-pull-secret-syncer-6cwrd\" (UID: \"e54430cd-5514-416a-83cc-c3b1a549e576\") " pod="kube-system/global-pull-secret-syncer-6cwrd"
Jul 07 17:40:18.948432 ip-10-0-139-31 kubenswrapper[2561]: E0707 17:40:18.948338    2561 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 07 17:40:18.948432 ip-10-0-139-31 kubenswrapper[2561]: E0707 17:40:18.948408    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e54430cd-5514-416a-83cc-c3b1a549e576-original-pull-secret podName:e54430cd-5514-416a-83cc-c3b1a549e576 nodeName:}" failed. No retries permitted until 2026-07-07 17:40:26.948387146 +0000 UTC m=+18.099511537 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e54430cd-5514-416a-83cc-c3b1a549e576-original-pull-secret") pod "global-pull-secret-syncer-6cwrd" (UID: "e54430cd-5514-416a-83cc-c3b1a549e576") : object "kube-system"/"original-pull-secret" not registered
Jul 07 17:40:19.049164 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:19.049129    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-km4h8\" (UniqueName: \"kubernetes.io/projected/0efe7076-81fe-4e2c-bf49-626c4d955b19-kube-api-access-km4h8\") pod \"network-check-target-gmjlh\" (UID: \"0efe7076-81fe-4e2c-bf49-626c4d955b19\") " pod="openshift-network-diagnostics/network-check-target-gmjlh"
Jul 07 17:40:19.049335 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:19.049185    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9d99e831-14fe-4b13-9a8b-3d9ca165c60e-metrics-certs\") pod \"network-metrics-daemon-pkn6n\" (UID: \"9d99e831-14fe-4b13-9a8b-3d9ca165c60e\") " pod="openshift-multus/network-metrics-daemon-pkn6n"
Jul 07 17:40:19.049335 ip-10-0-139-31 kubenswrapper[2561]: E0707 17:40:19.049298    2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 07 17:40:19.049335 ip-10-0-139-31 kubenswrapper[2561]: E0707 17:40:19.049307    2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 07 17:40:19.049335 ip-10-0-139-31 kubenswrapper[2561]: E0707 17:40:19.049330    2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 07 17:40:19.049540 ip-10-0-139-31 kubenswrapper[2561]: E0707 17:40:19.049341    2561 projected.go:196] Error preparing data for projected volume kube-api-access-km4h8 for pod openshift-network-diagnostics/network-check-target-gmjlh: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 07 17:40:19.049540 ip-10-0-139-31 kubenswrapper[2561]: E0707 17:40:19.049356    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9d99e831-14fe-4b13-9a8b-3d9ca165c60e-metrics-certs podName:9d99e831-14fe-4b13-9a8b-3d9ca165c60e nodeName:}" failed. No retries permitted until 2026-07-07 17:40:27.049339929 +0000 UTC m=+18.200464317 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9d99e831-14fe-4b13-9a8b-3d9ca165c60e-metrics-certs") pod "network-metrics-daemon-pkn6n" (UID: "9d99e831-14fe-4b13-9a8b-3d9ca165c60e") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 07 17:40:19.049540 ip-10-0-139-31 kubenswrapper[2561]: E0707 17:40:19.049393    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0efe7076-81fe-4e2c-bf49-626c4d955b19-kube-api-access-km4h8 podName:0efe7076-81fe-4e2c-bf49-626c4d955b19 nodeName:}" failed. No retries permitted until 2026-07-07 17:40:27.049376636 +0000 UTC m=+18.200501014 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-km4h8" (UniqueName: "kubernetes.io/projected/0efe7076-81fe-4e2c-bf49-626c4d955b19-kube-api-access-km4h8") pod "network-check-target-gmjlh" (UID: "0efe7076-81fe-4e2c-bf49-626c4d955b19") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 07 17:40:19.516354 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:19.515898    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gmjlh"
Jul 07 17:40:19.516354 ip-10-0-139-31 kubenswrapper[2561]: E0707 17:40:19.516015    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gmjlh" podUID="0efe7076-81fe-4e2c-bf49-626c4d955b19"
Jul 07 17:40:19.516354 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:19.516070    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6cwrd"
Jul 07 17:40:19.516354 ip-10-0-139-31 kubenswrapper[2561]: E0707 17:40:19.516182    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6cwrd" podUID="e54430cd-5514-416a-83cc-c3b1a549e576"
Jul 07 17:40:20.514959 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:20.514927    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pkn6n"
Jul 07 17:40:20.515173 ip-10-0-139-31 kubenswrapper[2561]: E0707 17:40:20.515079    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pkn6n" podUID="9d99e831-14fe-4b13-9a8b-3d9ca165c60e"
Jul 07 17:40:21.515962 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:21.515923    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gmjlh"
Jul 07 17:40:21.516412 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:21.515970    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6cwrd"
Jul 07 17:40:21.516412 ip-10-0-139-31 kubenswrapper[2561]: E0707 17:40:21.516070    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gmjlh" podUID="0efe7076-81fe-4e2c-bf49-626c4d955b19"
Jul 07 17:40:21.516412 ip-10-0-139-31 kubenswrapper[2561]: E0707 17:40:21.516171    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6cwrd" podUID="e54430cd-5514-416a-83cc-c3b1a549e576"
Jul 07 17:40:22.515471 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:22.515364    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pkn6n"
Jul 07 17:40:22.515652 ip-10-0-139-31 kubenswrapper[2561]: E0707 17:40:22.515504    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pkn6n" podUID="9d99e831-14fe-4b13-9a8b-3d9ca165c60e"
Jul 07 17:40:23.514997 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:23.514965    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gmjlh"
Jul 07 17:40:23.514997 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:23.514986    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6cwrd"
Jul 07 17:40:23.515530 ip-10-0-139-31 kubenswrapper[2561]: E0707 17:40:23.515110    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gmjlh" podUID="0efe7076-81fe-4e2c-bf49-626c4d955b19"
Jul 07 17:40:23.515530 ip-10-0-139-31 kubenswrapper[2561]: E0707 17:40:23.515191    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6cwrd" podUID="e54430cd-5514-416a-83cc-c3b1a549e576"
Jul 07 17:40:24.515727 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:24.515695    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pkn6n"
Jul 07 17:40:24.516210 ip-10-0-139-31 kubenswrapper[2561]: E0707 17:40:24.515829    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pkn6n" podUID="9d99e831-14fe-4b13-9a8b-3d9ca165c60e"
Jul 07 17:40:25.518372 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:25.518341    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6cwrd"
Jul 07 17:40:25.518372 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:25.518356    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gmjlh"
Jul 07 17:40:25.518892 ip-10-0-139-31 kubenswrapper[2561]: E0707 17:40:25.518464    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6cwrd" podUID="e54430cd-5514-416a-83cc-c3b1a549e576"
Jul 07 17:40:25.518892 ip-10-0-139-31 kubenswrapper[2561]: E0707 17:40:25.518566    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gmjlh" podUID="0efe7076-81fe-4e2c-bf49-626c4d955b19"
Jul 07 17:40:26.515081 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:26.515030    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pkn6n"
Jul 07 17:40:26.515304 ip-10-0-139-31 kubenswrapper[2561]: E0707 17:40:26.515184    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pkn6n" podUID="9d99e831-14fe-4b13-9a8b-3d9ca165c60e"
Jul 07 17:40:27.008544 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:27.008428    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e54430cd-5514-416a-83cc-c3b1a549e576-original-pull-secret\") pod \"global-pull-secret-syncer-6cwrd\" (UID: \"e54430cd-5514-416a-83cc-c3b1a549e576\") " pod="kube-system/global-pull-secret-syncer-6cwrd"
Jul 07 17:40:27.008933 ip-10-0-139-31 kubenswrapper[2561]: E0707 17:40:27.008588    2561 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 07 17:40:27.008933 ip-10-0-139-31 kubenswrapper[2561]: E0707 17:40:27.008657    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e54430cd-5514-416a-83cc-c3b1a549e576-original-pull-secret podName:e54430cd-5514-416a-83cc-c3b1a549e576 nodeName:}" failed. No retries permitted until 2026-07-07 17:40:43.008639601 +0000 UTC m=+34.159764000 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e54430cd-5514-416a-83cc-c3b1a549e576-original-pull-secret") pod "global-pull-secret-syncer-6cwrd" (UID: "e54430cd-5514-416a-83cc-c3b1a549e576") : object "kube-system"/"original-pull-secret" not registered
Jul 07 17:40:27.109428 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:27.109394    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-km4h8\" (UniqueName: \"kubernetes.io/projected/0efe7076-81fe-4e2c-bf49-626c4d955b19-kube-api-access-km4h8\") pod \"network-check-target-gmjlh\" (UID: \"0efe7076-81fe-4e2c-bf49-626c4d955b19\") " pod="openshift-network-diagnostics/network-check-target-gmjlh"
Jul 07 17:40:27.109591 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:27.109458    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9d99e831-14fe-4b13-9a8b-3d9ca165c60e-metrics-certs\") pod \"network-metrics-daemon-pkn6n\" (UID: \"9d99e831-14fe-4b13-9a8b-3d9ca165c60e\") " pod="openshift-multus/network-metrics-daemon-pkn6n"
Jul 07 17:40:27.109591 ip-10-0-139-31 kubenswrapper[2561]: E0707 17:40:27.109550    2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 07 17:40:27.109591 ip-10-0-139-31 kubenswrapper[2561]: E0707 17:40:27.109564    2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 07 17:40:27.109591 ip-10-0-139-31 kubenswrapper[2561]: E0707 17:40:27.109580    2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 07 17:40:27.109591 ip-10-0-139-31 kubenswrapper[2561]: E0707 17:40:27.109592    2561 projected.go:196] Error preparing data for projected volume kube-api-access-km4h8 for pod openshift-network-diagnostics/network-check-target-gmjlh: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 07 17:40:27.109810 ip-10-0-139-31 kubenswrapper[2561]: E0707 17:40:27.109617    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9d99e831-14fe-4b13-9a8b-3d9ca165c60e-metrics-certs podName:9d99e831-14fe-4b13-9a8b-3d9ca165c60e nodeName:}" failed. No retries permitted until 2026-07-07 17:40:43.109597194 +0000 UTC m=+34.260721586 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9d99e831-14fe-4b13-9a8b-3d9ca165c60e-metrics-certs") pod "network-metrics-daemon-pkn6n" (UID: "9d99e831-14fe-4b13-9a8b-3d9ca165c60e") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 07 17:40:27.109810 ip-10-0-139-31 kubenswrapper[2561]: E0707 17:40:27.109633    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0efe7076-81fe-4e2c-bf49-626c4d955b19-kube-api-access-km4h8 podName:0efe7076-81fe-4e2c-bf49-626c4d955b19 nodeName:}" failed. No retries permitted until 2026-07-07 17:40:43.10962494 +0000 UTC m=+34.260749317 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-km4h8" (UniqueName: "kubernetes.io/projected/0efe7076-81fe-4e2c-bf49-626c4d955b19-kube-api-access-km4h8") pod "network-check-target-gmjlh" (UID: "0efe7076-81fe-4e2c-bf49-626c4d955b19") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 07 17:40:27.515953 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:27.515913    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gmjlh"
Jul 07 17:40:27.516147 ip-10-0-139-31 kubenswrapper[2561]: E0707 17:40:27.516039    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gmjlh" podUID="0efe7076-81fe-4e2c-bf49-626c4d955b19"
Jul 07 17:40:27.516244 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:27.515925    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6cwrd"
Jul 07 17:40:27.516380 ip-10-0-139-31 kubenswrapper[2561]: E0707 17:40:27.516332    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6cwrd" podUID="e54430cd-5514-416a-83cc-c3b1a549e576"
Jul 07 17:40:28.516053 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:28.516011    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pkn6n"
Jul 07 17:40:28.516510 ip-10-0-139-31 kubenswrapper[2561]: E0707 17:40:28.516145    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pkn6n" podUID="9d99e831-14fe-4b13-9a8b-3d9ca165c60e"
Jul 07 17:40:29.515741 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:29.515691    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gmjlh"
Jul 07 17:40:29.515932 ip-10-0-139-31 kubenswrapper[2561]: E0707 17:40:29.515804    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gmjlh" podUID="0efe7076-81fe-4e2c-bf49-626c4d955b19"
Jul 07 17:40:29.515932 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:29.515887    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6cwrd"
Jul 07 17:40:29.516043 ip-10-0-139-31 kubenswrapper[2561]: E0707 17:40:29.516004    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6cwrd" podUID="e54430cd-5514-416a-83cc-c3b1a549e576"
Jul 07 17:40:30.515814 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:30.515779    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pkn6n"
Jul 07 17:40:30.516191 ip-10-0-139-31 kubenswrapper[2561]: E0707 17:40:30.515891    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pkn6n" podUID="9d99e831-14fe-4b13-9a8b-3d9ca165c60e"
Jul 07 17:40:31.516283 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:31.515859    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gmjlh"
Jul 07 17:40:31.516935 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:31.515905    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6cwrd"
Jul 07 17:40:31.516935 ip-10-0-139-31 kubenswrapper[2561]: E0707 17:40:31.516395    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gmjlh" podUID="0efe7076-81fe-4e2c-bf49-626c4d955b19"
Jul 07 17:40:31.516935 ip-10-0-139-31 kubenswrapper[2561]: E0707 17:40:31.516438    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6cwrd" podUID="e54430cd-5514-416a-83cc-c3b1a549e576"
Jul 07 17:40:31.659814 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:31.659725    2561 generic.go:356] "Generic (PLEG): container finished" podID="44315251-6c4d-438d-bc14-446002aa92a7" containerID="f865cb0394d609929e35e7b21f02b437c70372e87777e34961d7725ca2e75510" exitCode=0
Jul 07 17:40:31.659972 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:31.659816    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-tl75q" event={"ID":"44315251-6c4d-438d-bc14-446002aa92a7","Type":"ContainerDied","Data":"f865cb0394d609929e35e7b21f02b437c70372e87777e34961d7725ca2e75510"}
Jul 07 17:40:31.661624 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:31.661591    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-7wjgt" event={"ID":"65ec2965-856f-4dc9-94a6-9f8d20151d5d","Type":"ContainerStarted","Data":"3c8d033d5b981f2af62595e61b36f52c01009d8e2efab40a61524d5bd82c05ad"}
Jul 07 17:40:31.663297 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:31.663273    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-4wz7j" event={"ID":"54fe2d84-2eed-4379-aeb5-6588b2ee961d","Type":"ContainerStarted","Data":"76b93e35ecd641e48cff34a70e0b9e62104a287d8a3f71a3ce0f0612c3dc8c34"}
Jul 07 17:40:31.665101 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:31.665074    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rlzxl" event={"ID":"f0111691-8bad-46a1-ac45-0de1d6a50801","Type":"ContainerStarted","Data":"33df45f8b2b46f9822ff99aa5bd57ab819566a77f059b514a430223ed6a23a72"}
Jul 07 17:40:31.669758 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:31.669723    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-vf2rn" event={"ID":"8e97c2c1-e9ea-41fb-9bb9-ed0cf128c144","Type":"ContainerStarted","Data":"585e4fff22d665493916113715a3d87c9e868983061cd29947ca3907588781c2"}
Jul 07 17:40:31.673001 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:31.672976    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rbzjn" event={"ID":"312df236-de73-4f4c-96dc-35bde1429d6b","Type":"ContainerStarted","Data":"154c0c3b112a48e25a4cda200690286f216510c302aafa6c49f713fa9451665b"}
Jul 07 17:40:31.673126 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:31.673061    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rbzjn" event={"ID":"312df236-de73-4f4c-96dc-35bde1429d6b","Type":"ContainerStarted","Data":"2baa20eefe0538bb83d8d0555d22e8e21c0ea08f0941e43e66be56aedc4bf550"}
Jul 07 17:40:31.673126 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:31.673104    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rbzjn" event={"ID":"312df236-de73-4f4c-96dc-35bde1429d6b","Type":"ContainerStarted","Data":"823a7419a146c3ba99020a59524acce9dc36e3b2c06ba34cea203eed95f71a74"}
Jul 07 17:40:31.673240 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:31.673140    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rbzjn" event={"ID":"312df236-de73-4f4c-96dc-35bde1429d6b","Type":"ContainerStarted","Data":"61e467a4ecfc70f871e256af578e885039c6f818f6d62bf2caa8271c3446390b"}
Jul 07 17:40:31.673240 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:31.673180    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rbzjn" event={"ID":"312df236-de73-4f4c-96dc-35bde1429d6b","Type":"ContainerStarted","Data":"e583df519e8118ca2b201772a17af66b0b860ddb0e6e598382ffc08820295115"}
Jul 07 17:40:31.673240 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:31.673224    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rbzjn" event={"ID":"312df236-de73-4f4c-96dc-35bde1429d6b","Type":"ContainerStarted","Data":"df5930a18c36f5514d58f8cccdcaae484a9d6a4200357ee426333f3300dfe519"}
Jul 07 17:40:31.676330 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:31.676273    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-tr2xs" event={"ID":"eb766f56-403b-4ead-9992-2436c4ee7791","Type":"ContainerStarted","Data":"3838ad66ea8fe797cfa6f4e1968a57e2b7f80aae9345d8b2c925709182f752c6"}
Jul 07 17:40:31.678532 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:31.678508    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-kks9r" event={"ID":"2ef9c095-d303-40c3-920c-c9ff990f4032","Type":"ContainerStarted","Data":"17fd1ede181a3fd10d0a3d80952a33fc088a28bdae2819d7236328a29320e659"}
Jul 07 17:40:31.685062 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:31.685010    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-31.ec2.internal" podStartSLOduration=21.684997896 podStartE2EDuration="21.684997896s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 17:40:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 17:40:14.645280338 +0000 UTC m=+5.796404738" watchObservedRunningTime="2026-07-07 17:40:31.684997896 +0000 UTC m=+22.836122294"
Jul 07 17:40:31.721781 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:31.721727    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-tr2xs" podStartSLOduration=4.81787621 podStartE2EDuration="22.721711577s" totalImagesPullingTime="17.903835367s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 17:40:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 17:40:31.70275172 +0000 UTC m=+22.853876124" watchObservedRunningTime="2026-07-07 17:40:31.721711577 +0000 UTC m=+22.872835978"
Jul 07 17:40:31.721947 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:31.721878    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-7wjgt" podStartSLOduration=3.51251003 podStartE2EDuration="22.721873121s" totalImagesPullingTime="19.209363091s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 17:40:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 17:40:31.721379596 +0000 UTC m=+22.872503995" watchObservedRunningTime="2026-07-07 17:40:31.721873121 +0000 UTC m=+22.872997518"
Jul 07 17:40:31.744960 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:31.744911    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-kks9r" podStartSLOduration=4.811576109 podStartE2EDuration="22.744894637s" totalImagesPullingTime="17.933318528s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 17:40:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 17:40:31.744023959 +0000 UTC m=+22.895148357" watchObservedRunningTime="2026-07-07 17:40:31.744894637 +0000 UTC m=+22.896019035"
Jul 07 17:40:31.767794 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:31.767734    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-4wz7j" podStartSLOduration=4.8668261 podStartE2EDuration="22.767718004s" totalImagesPullingTime="17.900891904s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 17:40:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 17:40:31.767689607 +0000 UTC m=+22.918814026" watchObservedRunningTime="2026-07-07 17:40:31.767718004 +0000 UTC m=+22.918842396"
Jul 07 17:40:31.784048 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:31.783979    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-vf2rn" podStartSLOduration=3.621873597 podStartE2EDuration="22.783961399s" totalImagesPullingTime="19.162087802s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 17:40:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 17:40:31.783908563 +0000 UTC m=+22.935032963" watchObservedRunningTime="2026-07-07 17:40:31.783961399 +0000 UTC m=+22.935085798"
Jul 07 17:40:32.455771 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:32.455741    2561 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jul 07 17:40:32.515003 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:32.514960    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pkn6n"
Jul 07 17:40:32.515193 ip-10-0-139-31 kubenswrapper[2561]: E0707 17:40:32.515085    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pkn6n" podUID="9d99e831-14fe-4b13-9a8b-3d9ca165c60e"
Jul 07 17:40:32.682504 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:32.682417    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-snd82" event={"ID":"9f644cf8-e282-4cac-b3d9-600ee88741b7","Type":"ContainerStarted","Data":"b5fd003919fbb6f8405746205ce8fe4df07192900017881e22340b372937b3b6"}
Jul 07 17:40:32.684251 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:32.684220    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rlzxl" event={"ID":"f0111691-8bad-46a1-ac45-0de1d6a50801","Type":"ContainerStarted","Data":"1b3a834bca9c7b52c4659a2bc55dd4a0922eab0e9d3360bceca0fa8c2a4bd165"}
Jul 07 17:40:33.364097 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:33.363979    2561 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-07T17:40:32.455764731Z","UUID":"dd7b0f48-53d2-476d-9aa5-69fdc38c0bdb","Handler":null,"Name":"","Endpoint":""}
Jul 07 17:40:33.365696 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:33.365669    2561 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jul 07 17:40:33.365824 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:33.365716    2561 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jul 07 17:40:33.515183 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:33.515149    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6cwrd"
Jul 07 17:40:33.515376 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:33.515149    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gmjlh"
Jul 07 17:40:33.515376 ip-10-0-139-31 kubenswrapper[2561]: E0707 17:40:33.515269    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6cwrd" podUID="e54430cd-5514-416a-83cc-c3b1a549e576"
Jul 07 17:40:33.515376 ip-10-0-139-31 kubenswrapper[2561]: E0707 17:40:33.515358    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gmjlh" podUID="0efe7076-81fe-4e2c-bf49-626c4d955b19"
Jul 07 17:40:34.516019 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:34.515840    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pkn6n"
Jul 07 17:40:34.516481 ip-10-0-139-31 kubenswrapper[2561]: E0707 17:40:34.516098    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pkn6n" podUID="9d99e831-14fe-4b13-9a8b-3d9ca165c60e"
Jul 07 17:40:34.691165 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:34.691127    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rbzjn" event={"ID":"312df236-de73-4f4c-96dc-35bde1429d6b","Type":"ContainerStarted","Data":"9392d42740b77a421efddf2f2641d48fd3deac2c7f39655b1e64bc8dadb5b855"}
Jul 07 17:40:34.692987 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:34.692964    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rlzxl" event={"ID":"f0111691-8bad-46a1-ac45-0de1d6a50801","Type":"ContainerStarted","Data":"697493c733cc75da9c27cff25006cfe85e9567e2a4abb10a0b6a9c77e2c5063e"}
Jul 07 17:40:34.712758 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:34.712707    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rlzxl" podStartSLOduration=5.10969914 podStartE2EDuration="25.712692233s" totalImagesPullingTime="20.602993093s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 17:40:09 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 17:40:34.712424819 +0000 UTC m=+25.863549216" watchObservedRunningTime="2026-07-07 17:40:34.712692233 +0000 UTC m=+25.863816663"
Jul 07 17:40:34.713149 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:34.713129    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-snd82" podStartSLOduration=6.911214323 podStartE2EDuration="25.713123493s" totalImagesPullingTime="18.80190917s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 17:40:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 17:40:32.697511384 +0000 UTC m=+23.848635782" watchObservedRunningTime="2026-07-07 17:40:34.713123493 +0000 UTC m=+25.864247948"
Jul 07 17:40:35.515611 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:35.515576    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6cwrd"
Jul 07 17:40:35.515788 ip-10-0-139-31 kubenswrapper[2561]: E0707 17:40:35.515684    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6cwrd" podUID="e54430cd-5514-416a-83cc-c3b1a549e576"
Jul 07 17:40:35.515788 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:35.515733    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gmjlh"
Jul 07 17:40:35.515871 ip-10-0-139-31 kubenswrapper[2561]: E0707 17:40:35.515810    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gmjlh" podUID="0efe7076-81fe-4e2c-bf49-626c4d955b19"
Jul 07 17:40:36.515774 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:36.515585    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pkn6n"
Jul 07 17:40:36.516236 ip-10-0-139-31 kubenswrapper[2561]: E0707 17:40:36.515872    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pkn6n" podUID="9d99e831-14fe-4b13-9a8b-3d9ca165c60e"
Jul 07 17:40:36.672532 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:36.672493    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-kks9r"
Jul 07 17:40:36.673286 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:36.673268    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-kks9r"
Jul 07 17:40:36.700736 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:36.700697    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rbzjn" event={"ID":"312df236-de73-4f4c-96dc-35bde1429d6b","Type":"ContainerStarted","Data":"c2d709e00abffed4f600ee101e58e9f38a4e8422ec27f82c2e812e9fa05a0f0f"}
Jul 07 17:40:36.731040 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:36.730989    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-rbzjn" podStartSLOduration=8.482241477 podStartE2EDuration="27.730970904s" totalImagesPullingTime="19.248729427s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 17:40:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 17:40:36.729246994 +0000 UTC m=+27.880371392" watchObservedRunningTime="2026-07-07 17:40:36.730970904 +0000 UTC m=+27.882095301"
Jul 07 17:40:37.518698 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:37.518670    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gmjlh"
Jul 07 17:40:37.519156 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:37.518673    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6cwrd"
Jul 07 17:40:37.519156 ip-10-0-139-31 kubenswrapper[2561]: E0707 17:40:37.518780    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gmjlh" podUID="0efe7076-81fe-4e2c-bf49-626c4d955b19"
Jul 07 17:40:37.519156 ip-10-0-139-31 kubenswrapper[2561]: E0707 17:40:37.518857    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6cwrd" podUID="e54430cd-5514-416a-83cc-c3b1a549e576"
Jul 07 17:40:37.703984 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:37.703953    2561 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness"
Jul 07 17:40:37.704645 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:37.704541    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-rbzjn"
Jul 07 17:40:37.704899 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:37.704879    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-rbzjn"
Jul 07 17:40:37.725907 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:37.725878    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-rbzjn"
Jul 07 17:40:37.730124 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:37.730083    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-rbzjn"
Jul 07 17:40:37.969299 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:37.969221    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-6cwrd"]
Jul 07 17:40:37.969493 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:37.969341    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6cwrd"
Jul 07 17:40:37.969493 ip-10-0-139-31 kubenswrapper[2561]: E0707 17:40:37.969428    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6cwrd" podUID="e54430cd-5514-416a-83cc-c3b1a549e576"
Jul 07 17:40:37.972667 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:37.972573    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-gmjlh"]
Jul 07 17:40:37.972791 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:37.972711    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gmjlh"
Jul 07 17:40:37.972853 ip-10-0-139-31 kubenswrapper[2561]: E0707 17:40:37.972801    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gmjlh" podUID="0efe7076-81fe-4e2c-bf49-626c4d955b19"
Jul 07 17:40:37.973264 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:37.973237    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-pkn6n"]
Jul 07 17:40:37.973385 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:37.973355    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pkn6n"
Jul 07 17:40:37.973518 ip-10-0-139-31 kubenswrapper[2561]: E0707 17:40:37.973461    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pkn6n" podUID="9d99e831-14fe-4b13-9a8b-3d9ca165c60e"
Jul 07 17:40:38.326692 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:38.326586    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-kks9r"
Jul 07 17:40:38.326832 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:38.326726    2561 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness"
Jul 07 17:40:38.327319 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:38.327299    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-kks9r"
Jul 07 17:40:38.706222 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:38.706138    2561 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness"
Jul 07 17:40:39.516112 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:39.516018    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6cwrd"
Jul 07 17:40:39.516112 ip-10-0-139-31 kubenswrapper[2561]: E0707 17:40:39.516101    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6cwrd" podUID="e54430cd-5514-416a-83cc-c3b1a549e576"
Jul 07 17:40:39.516333 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:39.516110    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pkn6n"
Jul 07 17:40:39.516333 ip-10-0-139-31 kubenswrapper[2561]: E0707 17:40:39.516207    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pkn6n" podUID="9d99e831-14fe-4b13-9a8b-3d9ca165c60e"
Jul 07 17:40:39.516333 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:39.516234    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gmjlh"
Jul 07 17:40:39.516333 ip-10-0-139-31 kubenswrapper[2561]: E0707 17:40:39.516278    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gmjlh" podUID="0efe7076-81fe-4e2c-bf49-626c4d955b19"
Jul 07 17:40:39.709816 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:39.709781    2561 generic.go:356] "Generic (PLEG): container finished" podID="44315251-6c4d-438d-bc14-446002aa92a7" containerID="e1976a46c4f2bf554844f350f8c7dba5077096e3e95261e2b0cfb87b5c06f8ca" exitCode=0
Jul 07 17:40:39.710229 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:39.709866    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-tl75q" event={"ID":"44315251-6c4d-438d-bc14-446002aa92a7","Type":"ContainerDied","Data":"e1976a46c4f2bf554844f350f8c7dba5077096e3e95261e2b0cfb87b5c06f8ca"}
Jul 07 17:40:39.710229 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:39.709940    2561 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness"
Jul 07 17:40:39.785780 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:39.785538    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-rbzjn"
Jul 07 17:40:41.516154 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:41.516056    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pkn6n"
Jul 07 17:40:41.516154 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:41.516057    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6cwrd"
Jul 07 17:40:41.517113 ip-10-0-139-31 kubenswrapper[2561]: E0707 17:40:41.516181    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pkn6n" podUID="9d99e831-14fe-4b13-9a8b-3d9ca165c60e"
Jul 07 17:40:41.517113 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:41.516059    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gmjlh"
Jul 07 17:40:41.517113 ip-10-0-139-31 kubenswrapper[2561]: E0707 17:40:41.516234    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6cwrd" podUID="e54430cd-5514-416a-83cc-c3b1a549e576"
Jul 07 17:40:41.517113 ip-10-0-139-31 kubenswrapper[2561]: E0707 17:40:41.516309    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gmjlh" podUID="0efe7076-81fe-4e2c-bf49-626c4d955b19"
Jul 07 17:40:41.716708 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:41.716662    2561 generic.go:356] "Generic (PLEG): container finished" podID="44315251-6c4d-438d-bc14-446002aa92a7" containerID="0724e71f4d65ca85a2491bacf8069db8b93a43a7d63f47ee6cb6dc9fb053151a" exitCode=0
Jul 07 17:40:41.716850 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:41.716715    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-tl75q" event={"ID":"44315251-6c4d-438d-bc14-446002aa92a7","Type":"ContainerDied","Data":"0724e71f4d65ca85a2491bacf8069db8b93a43a7d63f47ee6cb6dc9fb053151a"}
Jul 07 17:40:43.033497 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:43.033458    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e54430cd-5514-416a-83cc-c3b1a549e576-original-pull-secret\") pod \"global-pull-secret-syncer-6cwrd\" (UID: \"e54430cd-5514-416a-83cc-c3b1a549e576\") " pod="kube-system/global-pull-secret-syncer-6cwrd"
Jul 07 17:40:43.033854 ip-10-0-139-31 kubenswrapper[2561]: E0707 17:40:43.033598    2561 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 07 17:40:43.033854 ip-10-0-139-31 kubenswrapper[2561]: E0707 17:40:43.033658    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e54430cd-5514-416a-83cc-c3b1a549e576-original-pull-secret podName:e54430cd-5514-416a-83cc-c3b1a549e576 nodeName:}" failed. No retries permitted until 2026-07-07 17:41:15.033641666 +0000 UTC m=+66.184766041 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e54430cd-5514-416a-83cc-c3b1a549e576-original-pull-secret") pod "global-pull-secret-syncer-6cwrd" (UID: "e54430cd-5514-416a-83cc-c3b1a549e576") : object "kube-system"/"original-pull-secret" not registered
Jul 07 17:40:43.134424 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:43.134392    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-km4h8\" (UniqueName: \"kubernetes.io/projected/0efe7076-81fe-4e2c-bf49-626c4d955b19-kube-api-access-km4h8\") pod \"network-check-target-gmjlh\" (UID: \"0efe7076-81fe-4e2c-bf49-626c4d955b19\") " pod="openshift-network-diagnostics/network-check-target-gmjlh"
Jul 07 17:40:43.134608 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:43.134435    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9d99e831-14fe-4b13-9a8b-3d9ca165c60e-metrics-certs\") pod \"network-metrics-daemon-pkn6n\" (UID: \"9d99e831-14fe-4b13-9a8b-3d9ca165c60e\") " pod="openshift-multus/network-metrics-daemon-pkn6n"
Jul 07 17:40:43.134608 ip-10-0-139-31 kubenswrapper[2561]: E0707 17:40:43.134556    2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 07 17:40:43.134608 ip-10-0-139-31 kubenswrapper[2561]: E0707 17:40:43.134578    2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 07 17:40:43.134608 ip-10-0-139-31 kubenswrapper[2561]: E0707 17:40:43.134605    2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 07 17:40:43.134751 ip-10-0-139-31 kubenswrapper[2561]: E0707 17:40:43.134619    2561 projected.go:196] Error preparing data for projected volume kube-api-access-km4h8 for pod openshift-network-diagnostics/network-check-target-gmjlh: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 07 17:40:43.134751 ip-10-0-139-31 kubenswrapper[2561]: E0707 17:40:43.134626    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9d99e831-14fe-4b13-9a8b-3d9ca165c60e-metrics-certs podName:9d99e831-14fe-4b13-9a8b-3d9ca165c60e nodeName:}" failed. No retries permitted until 2026-07-07 17:41:15.134606222 +0000 UTC m=+66.285730601 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9d99e831-14fe-4b13-9a8b-3d9ca165c60e-metrics-certs") pod "network-metrics-daemon-pkn6n" (UID: "9d99e831-14fe-4b13-9a8b-3d9ca165c60e") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 07 17:40:43.134751 ip-10-0-139-31 kubenswrapper[2561]: E0707 17:40:43.134669    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0efe7076-81fe-4e2c-bf49-626c4d955b19-kube-api-access-km4h8 podName:0efe7076-81fe-4e2c-bf49-626c4d955b19 nodeName:}" failed. No retries permitted until 2026-07-07 17:41:15.134653648 +0000 UTC m=+66.285778045 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-km4h8" (UniqueName: "kubernetes.io/projected/0efe7076-81fe-4e2c-bf49-626c4d955b19-kube-api-access-km4h8") pod "network-check-target-gmjlh" (UID: "0efe7076-81fe-4e2c-bf49-626c4d955b19") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 07 17:40:43.515535 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:43.515498    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6cwrd"
Jul 07 17:40:43.515743 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:43.515506    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pkn6n"
Jul 07 17:40:43.515743 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:43.515636    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gmjlh"
Jul 07 17:40:43.515743 ip-10-0-139-31 kubenswrapper[2561]: E0707 17:40:43.515629    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6cwrd" podUID="e54430cd-5514-416a-83cc-c3b1a549e576"
Jul 07 17:40:43.515743 ip-10-0-139-31 kubenswrapper[2561]: E0707 17:40:43.515722    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pkn6n" podUID="9d99e831-14fe-4b13-9a8b-3d9ca165c60e"
Jul 07 17:40:43.515930 ip-10-0-139-31 kubenswrapper[2561]: E0707 17:40:43.515784    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gmjlh" podUID="0efe7076-81fe-4e2c-bf49-626c4d955b19"
Jul 07 17:40:43.723193 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:43.723158    2561 generic.go:356] "Generic (PLEG): container finished" podID="44315251-6c4d-438d-bc14-446002aa92a7" containerID="febaa9396db8fb85a776d83471d1bbe50abfb0759b41d5bc312c9d5301009f47" exitCode=0
Jul 07 17:40:43.723333 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:43.723215    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-tl75q" event={"ID":"44315251-6c4d-438d-bc14-446002aa92a7","Type":"ContainerDied","Data":"febaa9396db8fb85a776d83471d1bbe50abfb0759b41d5bc312c9d5301009f47"}
Jul 07 17:40:44.651725 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:44.651686    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-31.ec2.internal" event="NodeReady"
Jul 07 17:40:44.652140 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:44.651829    2561 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jul 07 17:40:44.686127 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:44.686098    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-7ff58857cc-rmtgp"]
Jul 07 17:40:44.705102 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:44.705071    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-699db"]
Jul 07 17:40:44.705279 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:44.705182    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7ff58857cc-rmtgp"
Jul 07 17:40:44.708309 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:44.708282    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-ktw2w\""
Jul 07 17:40:44.708484 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:44.708321    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Jul 07 17:40:44.708484 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:44.708327    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Jul 07 17:40:44.708484 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:44.708281    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Jul 07 17:40:44.714022 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:44.714004    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Jul 07 17:40:44.715343 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:44.715324    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-7ff58857cc-rmtgp"]
Jul 07 17:40:44.715415 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:44.715355    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-8q22f"]
Jul 07 17:40:44.715470 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:44.715432    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-699db"
Jul 07 17:40:44.717929 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:44.717910    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 07 17:40:44.718035 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:44.718024    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 07 17:40:44.718091 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:44.718034    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-gg8rv\""
Jul 07 17:40:44.734330 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:44.734305    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-699db"]
Jul 07 17:40:44.734330 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:44.734338    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-8q22f"]
Jul 07 17:40:44.734547 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:44.734422    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-8q22f"
Jul 07 17:40:44.736789 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:44.736766    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 07 17:40:44.736891 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:44.736788    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 07 17:40:44.736891 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:44.736766    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 07 17:40:44.736891 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:44.736777    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-l7zp2\""
Jul 07 17:40:44.846783 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:44.846746    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/41ffd3cf-e077-4933-af1c-24ae8b0d5704-ca-trust-extracted\") pod \"image-registry-7ff58857cc-rmtgp\" (UID: \"41ffd3cf-e077-4933-af1c-24ae8b0d5704\") " pod="openshift-image-registry/image-registry-7ff58857cc-rmtgp"
Jul 07 17:40:44.846783 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:44.846780    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/41ffd3cf-e077-4933-af1c-24ae8b0d5704-registry-certificates\") pod \"image-registry-7ff58857cc-rmtgp\" (UID: \"41ffd3cf-e077-4933-af1c-24ae8b0d5704\") " pod="openshift-image-registry/image-registry-7ff58857cc-rmtgp"
Jul 07 17:40:44.847021 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:44.846851    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bx6bb\" (UniqueName: \"kubernetes.io/projected/d4f02e4d-1da9-4fbd-ae01-7d5b954981ca-kube-api-access-bx6bb\") pod \"ingress-canary-8q22f\" (UID: \"d4f02e4d-1da9-4fbd-ae01-7d5b954981ca\") " pod="openshift-ingress-canary/ingress-canary-8q22f"
Jul 07 17:40:44.847021 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:44.846871    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zf7hj\" (UniqueName: \"kubernetes.io/projected/66fea407-ba7e-4f9e-be19-2ed756f53841-kube-api-access-zf7hj\") pod \"dns-default-699db\" (UID: \"66fea407-ba7e-4f9e-be19-2ed756f53841\") " pod="openshift-dns/dns-default-699db"
Jul 07 17:40:44.847021 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:44.846890    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d4f02e4d-1da9-4fbd-ae01-7d5b954981ca-cert\") pod \"ingress-canary-8q22f\" (UID: \"d4f02e4d-1da9-4fbd-ae01-7d5b954981ca\") " pod="openshift-ingress-canary/ingress-canary-8q22f"
Jul 07 17:40:44.847021 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:44.846957    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/66fea407-ba7e-4f9e-be19-2ed756f53841-metrics-tls\") pod \"dns-default-699db\" (UID: \"66fea407-ba7e-4f9e-be19-2ed756f53841\") " pod="openshift-dns/dns-default-699db"
Jul 07 17:40:44.847021 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:44.847004    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/41ffd3cf-e077-4933-af1c-24ae8b0d5704-trusted-ca\") pod \"image-registry-7ff58857cc-rmtgp\" (UID: \"41ffd3cf-e077-4933-af1c-24ae8b0d5704\") " pod="openshift-image-registry/image-registry-7ff58857cc-rmtgp"
Jul 07 17:40:44.847248 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:44.847035    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/41ffd3cf-e077-4933-af1c-24ae8b0d5704-installation-pull-secrets\") pod \"image-registry-7ff58857cc-rmtgp\" (UID: \"41ffd3cf-e077-4933-af1c-24ae8b0d5704\") " pod="openshift-image-registry/image-registry-7ff58857cc-rmtgp"
Jul 07 17:40:44.847248 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:44.847068    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/41ffd3cf-e077-4933-af1c-24ae8b0d5704-bound-sa-token\") pod \"image-registry-7ff58857cc-rmtgp\" (UID: \"41ffd3cf-e077-4933-af1c-24ae8b0d5704\") " pod="openshift-image-registry/image-registry-7ff58857cc-rmtgp"
Jul 07 17:40:44.847248 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:44.847100    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/41ffd3cf-e077-4933-af1c-24ae8b0d5704-image-registry-private-configuration\") pod \"image-registry-7ff58857cc-rmtgp\" (UID: \"41ffd3cf-e077-4933-af1c-24ae8b0d5704\") " pod="openshift-image-registry/image-registry-7ff58857cc-rmtgp"
Jul 07 17:40:44.847248 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:44.847125    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/41ffd3cf-e077-4933-af1c-24ae8b0d5704-registry-tls\") pod \"image-registry-7ff58857cc-rmtgp\" (UID: \"41ffd3cf-e077-4933-af1c-24ae8b0d5704\") " pod="openshift-image-registry/image-registry-7ff58857cc-rmtgp"
Jul 07 17:40:44.847248 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:44.847175    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/66fea407-ba7e-4f9e-be19-2ed756f53841-config-volume\") pod \"dns-default-699db\" (UID: \"66fea407-ba7e-4f9e-be19-2ed756f53841\") " pod="openshift-dns/dns-default-699db"
Jul 07 17:40:44.847248 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:44.847214    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/66fea407-ba7e-4f9e-be19-2ed756f53841-tmp-dir\") pod \"dns-default-699db\" (UID: \"66fea407-ba7e-4f9e-be19-2ed756f53841\") " pod="openshift-dns/dns-default-699db"
Jul 07 17:40:44.847440 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:44.847259    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qmr7h\" (UniqueName: \"kubernetes.io/projected/41ffd3cf-e077-4933-af1c-24ae8b0d5704-kube-api-access-qmr7h\") pod \"image-registry-7ff58857cc-rmtgp\" (UID: \"41ffd3cf-e077-4933-af1c-24ae8b0d5704\") " pod="openshift-image-registry/image-registry-7ff58857cc-rmtgp"
Jul 07 17:40:44.948181 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:44.948090    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bx6bb\" (UniqueName: \"kubernetes.io/projected/d4f02e4d-1da9-4fbd-ae01-7d5b954981ca-kube-api-access-bx6bb\") pod \"ingress-canary-8q22f\" (UID: \"d4f02e4d-1da9-4fbd-ae01-7d5b954981ca\") " pod="openshift-ingress-canary/ingress-canary-8q22f"
Jul 07 17:40:44.948181 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:44.948140    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zf7hj\" (UniqueName: \"kubernetes.io/projected/66fea407-ba7e-4f9e-be19-2ed756f53841-kube-api-access-zf7hj\") pod \"dns-default-699db\" (UID: \"66fea407-ba7e-4f9e-be19-2ed756f53841\") " pod="openshift-dns/dns-default-699db"
Jul 07 17:40:44.948181 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:44.948166    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d4f02e4d-1da9-4fbd-ae01-7d5b954981ca-cert\") pod \"ingress-canary-8q22f\" (UID: \"d4f02e4d-1da9-4fbd-ae01-7d5b954981ca\") " pod="openshift-ingress-canary/ingress-canary-8q22f"
Jul 07 17:40:44.948496 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:44.948194    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/66fea407-ba7e-4f9e-be19-2ed756f53841-metrics-tls\") pod \"dns-default-699db\" (UID: \"66fea407-ba7e-4f9e-be19-2ed756f53841\") " pod="openshift-dns/dns-default-699db"
Jul 07 17:40:44.948496 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:44.948262    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/41ffd3cf-e077-4933-af1c-24ae8b0d5704-trusted-ca\") pod \"image-registry-7ff58857cc-rmtgp\" (UID: \"41ffd3cf-e077-4933-af1c-24ae8b0d5704\") " pod="openshift-image-registry/image-registry-7ff58857cc-rmtgp"
Jul 07 17:40:44.948496 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:44.948287    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/41ffd3cf-e077-4933-af1c-24ae8b0d5704-installation-pull-secrets\") pod \"image-registry-7ff58857cc-rmtgp\" (UID: \"41ffd3cf-e077-4933-af1c-24ae8b0d5704\") " pod="openshift-image-registry/image-registry-7ff58857cc-rmtgp"
Jul 07 17:40:44.948496 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:44.948315    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/41ffd3cf-e077-4933-af1c-24ae8b0d5704-bound-sa-token\") pod \"image-registry-7ff58857cc-rmtgp\" (UID: \"41ffd3cf-e077-4933-af1c-24ae8b0d5704\") " pod="openshift-image-registry/image-registry-7ff58857cc-rmtgp"
Jul 07 17:40:44.948496 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:44.948345    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/41ffd3cf-e077-4933-af1c-24ae8b0d5704-image-registry-private-configuration\") pod \"image-registry-7ff58857cc-rmtgp\" (UID: \"41ffd3cf-e077-4933-af1c-24ae8b0d5704\") " pod="openshift-image-registry/image-registry-7ff58857cc-rmtgp"
Jul 07 17:40:44.948496 ip-10-0-139-31 kubenswrapper[2561]: E0707 17:40:44.948346    2561 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 07 17:40:44.948496 ip-10-0-139-31 kubenswrapper[2561]: E0707 17:40:44.948418    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/66fea407-ba7e-4f9e-be19-2ed756f53841-metrics-tls podName:66fea407-ba7e-4f9e-be19-2ed756f53841 nodeName:}" failed. No retries permitted until 2026-07-07 17:40:45.44839771 +0000 UTC m=+36.599522091 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/66fea407-ba7e-4f9e-be19-2ed756f53841-metrics-tls") pod "dns-default-699db" (UID: "66fea407-ba7e-4f9e-be19-2ed756f53841") : secret "dns-default-metrics-tls" not found
Jul 07 17:40:44.948827 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:44.948777    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/41ffd3cf-e077-4933-af1c-24ae8b0d5704-registry-tls\") pod \"image-registry-7ff58857cc-rmtgp\" (UID: \"41ffd3cf-e077-4933-af1c-24ae8b0d5704\") " pod="openshift-image-registry/image-registry-7ff58857cc-rmtgp"
Jul 07 17:40:44.948827 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:44.948804    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/66fea407-ba7e-4f9e-be19-2ed756f53841-config-volume\") pod \"dns-default-699db\" (UID: \"66fea407-ba7e-4f9e-be19-2ed756f53841\") " pod="openshift-dns/dns-default-699db"
Jul 07 17:40:44.948920 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:44.948839    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/66fea407-ba7e-4f9e-be19-2ed756f53841-tmp-dir\") pod \"dns-default-699db\" (UID: \"66fea407-ba7e-4f9e-be19-2ed756f53841\") " pod="openshift-dns/dns-default-699db"
Jul 07 17:40:44.948920 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:44.948887    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qmr7h\" (UniqueName: \"kubernetes.io/projected/41ffd3cf-e077-4933-af1c-24ae8b0d5704-kube-api-access-qmr7h\") pod \"image-registry-7ff58857cc-rmtgp\" (UID: \"41ffd3cf-e077-4933-af1c-24ae8b0d5704\") " pod="openshift-image-registry/image-registry-7ff58857cc-rmtgp"
Jul 07 17:40:44.948920 ip-10-0-139-31 kubenswrapper[2561]: E0707 17:40:44.948912    2561 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 07 17:40:44.949059 ip-10-0-139-31 kubenswrapper[2561]: E0707 17:40:44.948926    2561 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7ff58857cc-rmtgp: secret "image-registry-tls" not found
Jul 07 17:40:44.949059 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:44.948926    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/41ffd3cf-e077-4933-af1c-24ae8b0d5704-ca-trust-extracted\") pod \"image-registry-7ff58857cc-rmtgp\" (UID: \"41ffd3cf-e077-4933-af1c-24ae8b0d5704\") " pod="openshift-image-registry/image-registry-7ff58857cc-rmtgp"
Jul 07 17:40:44.949059 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:44.948949    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/41ffd3cf-e077-4933-af1c-24ae8b0d5704-registry-certificates\") pod \"image-registry-7ff58857cc-rmtgp\" (UID: \"41ffd3cf-e077-4933-af1c-24ae8b0d5704\") " pod="openshift-image-registry/image-registry-7ff58857cc-rmtgp"
Jul 07 17:40:44.949059 ip-10-0-139-31 kubenswrapper[2561]: E0707 17:40:44.948971    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/41ffd3cf-e077-4933-af1c-24ae8b0d5704-registry-tls podName:41ffd3cf-e077-4933-af1c-24ae8b0d5704 nodeName:}" failed. No retries permitted until 2026-07-07 17:40:45.448956198 +0000 UTC m=+36.600080581 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/41ffd3cf-e077-4933-af1c-24ae8b0d5704-registry-tls") pod "image-registry-7ff58857cc-rmtgp" (UID: "41ffd3cf-e077-4933-af1c-24ae8b0d5704") : secret "image-registry-tls" not found
Jul 07 17:40:44.949647 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:44.949429    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/66fea407-ba7e-4f9e-be19-2ed756f53841-tmp-dir\") pod \"dns-default-699db\" (UID: \"66fea407-ba7e-4f9e-be19-2ed756f53841\") " pod="openshift-dns/dns-default-699db"
Jul 07 17:40:44.949647 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:44.949503    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/66fea407-ba7e-4f9e-be19-2ed756f53841-config-volume\") pod \"dns-default-699db\" (UID: \"66fea407-ba7e-4f9e-be19-2ed756f53841\") " pod="openshift-dns/dns-default-699db"
Jul 07 17:40:44.949647 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:44.949596    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/41ffd3cf-e077-4933-af1c-24ae8b0d5704-ca-trust-extracted\") pod \"image-registry-7ff58857cc-rmtgp\" (UID: \"41ffd3cf-e077-4933-af1c-24ae8b0d5704\") " pod="openshift-image-registry/image-registry-7ff58857cc-rmtgp"
Jul 07 17:40:44.949858 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:44.949829    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/41ffd3cf-e077-4933-af1c-24ae8b0d5704-trusted-ca\") pod \"image-registry-7ff58857cc-rmtgp\" (UID: \"41ffd3cf-e077-4933-af1c-24ae8b0d5704\") " pod="openshift-image-registry/image-registry-7ff58857cc-rmtgp"
Jul 07 17:40:44.953046 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:44.952902    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/41ffd3cf-e077-4933-af1c-24ae8b0d5704-image-registry-private-configuration\") pod \"image-registry-7ff58857cc-rmtgp\" (UID: \"41ffd3cf-e077-4933-af1c-24ae8b0d5704\") " pod="openshift-image-registry/image-registry-7ff58857cc-rmtgp"
Jul 07 17:40:44.953150 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:44.952921    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d4f02e4d-1da9-4fbd-ae01-7d5b954981ca-cert\") pod \"ingress-canary-8q22f\" (UID: \"d4f02e4d-1da9-4fbd-ae01-7d5b954981ca\") " pod="openshift-ingress-canary/ingress-canary-8q22f"
Jul 07 17:40:44.953150 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:44.952926    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/41ffd3cf-e077-4933-af1c-24ae8b0d5704-installation-pull-secrets\") pod \"image-registry-7ff58857cc-rmtgp\" (UID: \"41ffd3cf-e077-4933-af1c-24ae8b0d5704\") " pod="openshift-image-registry/image-registry-7ff58857cc-rmtgp"
Jul 07 17:40:44.958655 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:44.958630    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/41ffd3cf-e077-4933-af1c-24ae8b0d5704-registry-certificates\") pod \"image-registry-7ff58857cc-rmtgp\" (UID: \"41ffd3cf-e077-4933-af1c-24ae8b0d5704\") " pod="openshift-image-registry/image-registry-7ff58857cc-rmtgp"
Jul 07 17:40:44.958655 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:44.958640    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qmr7h\" (UniqueName: \"kubernetes.io/projected/41ffd3cf-e077-4933-af1c-24ae8b0d5704-kube-api-access-qmr7h\") pod \"image-registry-7ff58857cc-rmtgp\" (UID: \"41ffd3cf-e077-4933-af1c-24ae8b0d5704\") " pod="openshift-image-registry/image-registry-7ff58857cc-rmtgp"
Jul 07 17:40:44.958819 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:44.958774    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/41ffd3cf-e077-4933-af1c-24ae8b0d5704-bound-sa-token\") pod \"image-registry-7ff58857cc-rmtgp\" (UID: \"41ffd3cf-e077-4933-af1c-24ae8b0d5704\") " pod="openshift-image-registry/image-registry-7ff58857cc-rmtgp"
Jul 07 17:40:44.959503 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:44.959328    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zf7hj\" (UniqueName: \"kubernetes.io/projected/66fea407-ba7e-4f9e-be19-2ed756f53841-kube-api-access-zf7hj\") pod \"dns-default-699db\" (UID: \"66fea407-ba7e-4f9e-be19-2ed756f53841\") " pod="openshift-dns/dns-default-699db"
Jul 07 17:40:44.963380 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:44.963355    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bx6bb\" (UniqueName: \"kubernetes.io/projected/d4f02e4d-1da9-4fbd-ae01-7d5b954981ca-kube-api-access-bx6bb\") pod \"ingress-canary-8q22f\" (UID: \"d4f02e4d-1da9-4fbd-ae01-7d5b954981ca\") " pod="openshift-ingress-canary/ingress-canary-8q22f"
Jul 07 17:40:45.043229 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:45.043190    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-8q22f"
Jul 07 17:40:45.233907 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:45.233665    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-8q22f"]
Jul 07 17:40:45.239631 ip-10-0-139-31 kubenswrapper[2561]: W0707 17:40:45.239576    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd4f02e4d_1da9_4fbd_ae01_7d5b954981ca.slice/crio-a6ff3b1f34c6c03f1a9750d87629d88b228dfe57ebe32bf67bc767decf1ceb48 WatchSource:0}: Error finding container a6ff3b1f34c6c03f1a9750d87629d88b228dfe57ebe32bf67bc767decf1ceb48: Status 404 returned error can't find the container with id a6ff3b1f34c6c03f1a9750d87629d88b228dfe57ebe32bf67bc767decf1ceb48
Jul 07 17:40:45.453297 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:45.453255    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/66fea407-ba7e-4f9e-be19-2ed756f53841-metrics-tls\") pod \"dns-default-699db\" (UID: \"66fea407-ba7e-4f9e-be19-2ed756f53841\") " pod="openshift-dns/dns-default-699db"
Jul 07 17:40:45.453514 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:45.453320    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/41ffd3cf-e077-4933-af1c-24ae8b0d5704-registry-tls\") pod \"image-registry-7ff58857cc-rmtgp\" (UID: \"41ffd3cf-e077-4933-af1c-24ae8b0d5704\") " pod="openshift-image-registry/image-registry-7ff58857cc-rmtgp"
Jul 07 17:40:45.453514 ip-10-0-139-31 kubenswrapper[2561]: E0707 17:40:45.453414    2561 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 07 17:40:45.453514 ip-10-0-139-31 kubenswrapper[2561]: E0707 17:40:45.453501    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/66fea407-ba7e-4f9e-be19-2ed756f53841-metrics-tls podName:66fea407-ba7e-4f9e-be19-2ed756f53841 nodeName:}" failed. No retries permitted until 2026-07-07 17:40:46.453481592 +0000 UTC m=+37.604605982 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/66fea407-ba7e-4f9e-be19-2ed756f53841-metrics-tls") pod "dns-default-699db" (UID: "66fea407-ba7e-4f9e-be19-2ed756f53841") : secret "dns-default-metrics-tls" not found
Jul 07 17:40:45.453514 ip-10-0-139-31 kubenswrapper[2561]: E0707 17:40:45.453503    2561 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 07 17:40:45.453718 ip-10-0-139-31 kubenswrapper[2561]: E0707 17:40:45.453525    2561 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7ff58857cc-rmtgp: secret "image-registry-tls" not found
Jul 07 17:40:45.453718 ip-10-0-139-31 kubenswrapper[2561]: E0707 17:40:45.453578    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/41ffd3cf-e077-4933-af1c-24ae8b0d5704-registry-tls podName:41ffd3cf-e077-4933-af1c-24ae8b0d5704 nodeName:}" failed. No retries permitted until 2026-07-07 17:40:46.453562177 +0000 UTC m=+37.604686559 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/41ffd3cf-e077-4933-af1c-24ae8b0d5704-registry-tls") pod "image-registry-7ff58857cc-rmtgp" (UID: "41ffd3cf-e077-4933-af1c-24ae8b0d5704") : secret "image-registry-tls" not found
Jul 07 17:40:45.516057 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:45.515966    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gmjlh"
Jul 07 17:40:45.516057 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:45.516014    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6cwrd"
Jul 07 17:40:45.516277 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:45.515974    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pkn6n"
Jul 07 17:40:45.518801 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:45.518777    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 07 17:40:45.519992 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:45.519971    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-92crh\""
Jul 07 17:40:45.520112 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:45.520040    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 07 17:40:45.520112 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:45.520106    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-njwcl\""
Jul 07 17:40:45.520254 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:45.520217    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 07 17:40:45.520254 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:45.520238    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 07 17:40:45.728965 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:45.728927    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-8q22f" event={"ID":"d4f02e4d-1da9-4fbd-ae01-7d5b954981ca","Type":"ContainerStarted","Data":"a6ff3b1f34c6c03f1a9750d87629d88b228dfe57ebe32bf67bc767decf1ceb48"}
Jul 07 17:40:46.461401 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:46.461366    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/66fea407-ba7e-4f9e-be19-2ed756f53841-metrics-tls\") pod \"dns-default-699db\" (UID: \"66fea407-ba7e-4f9e-be19-2ed756f53841\") " pod="openshift-dns/dns-default-699db"
Jul 07 17:40:46.461401 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:46.461409    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/41ffd3cf-e077-4933-af1c-24ae8b0d5704-registry-tls\") pod \"image-registry-7ff58857cc-rmtgp\" (UID: \"41ffd3cf-e077-4933-af1c-24ae8b0d5704\") " pod="openshift-image-registry/image-registry-7ff58857cc-rmtgp"
Jul 07 17:40:46.461651 ip-10-0-139-31 kubenswrapper[2561]: E0707 17:40:46.461557    2561 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 07 17:40:46.461651 ip-10-0-139-31 kubenswrapper[2561]: E0707 17:40:46.461580    2561 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7ff58857cc-rmtgp: secret "image-registry-tls" not found
Jul 07 17:40:46.461651 ip-10-0-139-31 kubenswrapper[2561]: E0707 17:40:46.461559    2561 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 07 17:40:46.461651 ip-10-0-139-31 kubenswrapper[2561]: E0707 17:40:46.461636    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/41ffd3cf-e077-4933-af1c-24ae8b0d5704-registry-tls podName:41ffd3cf-e077-4933-af1c-24ae8b0d5704 nodeName:}" failed. No retries permitted until 2026-07-07 17:40:48.46162203 +0000 UTC m=+39.612746405 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/41ffd3cf-e077-4933-af1c-24ae8b0d5704-registry-tls") pod "image-registry-7ff58857cc-rmtgp" (UID: "41ffd3cf-e077-4933-af1c-24ae8b0d5704") : secret "image-registry-tls" not found
Jul 07 17:40:46.461651 ip-10-0-139-31 kubenswrapper[2561]: E0707 17:40:46.461651    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/66fea407-ba7e-4f9e-be19-2ed756f53841-metrics-tls podName:66fea407-ba7e-4f9e-be19-2ed756f53841 nodeName:}" failed. No retries permitted until 2026-07-07 17:40:48.461643426 +0000 UTC m=+39.612767801 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/66fea407-ba7e-4f9e-be19-2ed756f53841-metrics-tls") pod "dns-default-699db" (UID: "66fea407-ba7e-4f9e-be19-2ed756f53841") : secret "dns-default-metrics-tls" not found
Jul 07 17:40:46.524460 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:46.524401    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kks9r_2ef9c095-d303-40c3-920c-c9ff990f4032/konnectivity-agent/0.log" limit=1024
Jul 07 17:40:48.221870 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:48.221833    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kks9r_2ef9c095-d303-40c3-920c-c9ff990f4032/konnectivity-agent/0.log" limit=1024
Jul 07 17:40:48.480060 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:48.479972    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/66fea407-ba7e-4f9e-be19-2ed756f53841-metrics-tls\") pod \"dns-default-699db\" (UID: \"66fea407-ba7e-4f9e-be19-2ed756f53841\") " pod="openshift-dns/dns-default-699db"
Jul 07 17:40:48.480060 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:48.480029    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/41ffd3cf-e077-4933-af1c-24ae8b0d5704-registry-tls\") pod \"image-registry-7ff58857cc-rmtgp\" (UID: \"41ffd3cf-e077-4933-af1c-24ae8b0d5704\") " pod="openshift-image-registry/image-registry-7ff58857cc-rmtgp"
Jul 07 17:40:48.480276 ip-10-0-139-31 kubenswrapper[2561]: E0707 17:40:48.480178    2561 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 07 17:40:48.480276 ip-10-0-139-31 kubenswrapper[2561]: E0707 17:40:48.480202    2561 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7ff58857cc-rmtgp: secret "image-registry-tls" not found
Jul 07 17:40:48.480276 ip-10-0-139-31 kubenswrapper[2561]: E0707 17:40:48.480270    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/41ffd3cf-e077-4933-af1c-24ae8b0d5704-registry-tls podName:41ffd3cf-e077-4933-af1c-24ae8b0d5704 nodeName:}" failed. No retries permitted until 2026-07-07 17:40:52.480250727 +0000 UTC m=+43.631375123 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/41ffd3cf-e077-4933-af1c-24ae8b0d5704-registry-tls") pod "image-registry-7ff58857cc-rmtgp" (UID: "41ffd3cf-e077-4933-af1c-24ae8b0d5704") : secret "image-registry-tls" not found
Jul 07 17:40:48.480426 ip-10-0-139-31 kubenswrapper[2561]: E0707 17:40:48.480286    2561 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 07 17:40:48.480426 ip-10-0-139-31 kubenswrapper[2561]: E0707 17:40:48.480349    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/66fea407-ba7e-4f9e-be19-2ed756f53841-metrics-tls podName:66fea407-ba7e-4f9e-be19-2ed756f53841 nodeName:}" failed. No retries permitted until 2026-07-07 17:40:52.480332128 +0000 UTC m=+43.631456528 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/66fea407-ba7e-4f9e-be19-2ed756f53841-metrics-tls") pod "dns-default-699db" (UID: "66fea407-ba7e-4f9e-be19-2ed756f53841") : secret "dns-default-metrics-tls" not found
Jul 07 17:40:48.699857 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:48.699828    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kks9r_2ef9c095-d303-40c3-920c-c9ff990f4032/konnectivity-agent/0.log" limit=1024
Jul 07 17:40:48.756013 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:48.755920    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kks9r_2ef9c095-d303-40c3-920c-c9ff990f4032/konnectivity-agent/0.log" limit=1024
Jul 07 17:40:48.911171 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:48.911110    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kks9r_2ef9c095-d303-40c3-920c-c9ff990f4032/konnectivity-agent/0.log" limit=1024
Jul 07 17:40:49.011337 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:49.011243    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kks9r_2ef9c095-d303-40c3-920c-c9ff990f4032/konnectivity-agent/0.log" limit=1024
Jul 07 17:40:50.745406 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:50.745369    2561 generic.go:356] "Generic (PLEG): container finished" podID="44315251-6c4d-438d-bc14-446002aa92a7" containerID="752f66b26fc6a1caec389be57924f3121b4e729759e4888e3f840737035c94d3" exitCode=0
Jul 07 17:40:50.745829 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:50.745468    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-tl75q" event={"ID":"44315251-6c4d-438d-bc14-446002aa92a7","Type":"ContainerDied","Data":"752f66b26fc6a1caec389be57924f3121b4e729759e4888e3f840737035c94d3"}
Jul 07 17:40:50.746906 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:50.746885    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-8q22f" event={"ID":"d4f02e4d-1da9-4fbd-ae01-7d5b954981ca","Type":"ContainerStarted","Data":"814d003220027e083645e25448fbd26f595c030ba859261a070d29da729bb10e"}
Jul 07 17:40:51.751935 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:51.751901    2561 generic.go:356] "Generic (PLEG): container finished" podID="44315251-6c4d-438d-bc14-446002aa92a7" containerID="9f66e97231857e7ce9c75f44705f28528a32b2cab4c06255c5044fd1d3fd8e44" exitCode=0
Jul 07 17:40:51.752300 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:51.751975    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-tl75q" event={"ID":"44315251-6c4d-438d-bc14-446002aa92a7","Type":"ContainerDied","Data":"9f66e97231857e7ce9c75f44705f28528a32b2cab4c06255c5044fd1d3fd8e44"}
Jul 07 17:40:51.776609 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:51.776554    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-8q22f" podStartSLOduration=3.151549931 podStartE2EDuration="7.776534334s" totalImagesPullingTime="4.624984403s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 17:40:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 17:40:50.7870626 +0000 UTC m=+41.938186996" watchObservedRunningTime="2026-07-07 17:40:51.776534334 +0000 UTC m=+42.927658767"
Jul 07 17:40:52.515179 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:52.515144    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/66fea407-ba7e-4f9e-be19-2ed756f53841-metrics-tls\") pod \"dns-default-699db\" (UID: \"66fea407-ba7e-4f9e-be19-2ed756f53841\") " pod="openshift-dns/dns-default-699db"
Jul 07 17:40:52.515179 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:52.515183    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/41ffd3cf-e077-4933-af1c-24ae8b0d5704-registry-tls\") pod \"image-registry-7ff58857cc-rmtgp\" (UID: \"41ffd3cf-e077-4933-af1c-24ae8b0d5704\") " pod="openshift-image-registry/image-registry-7ff58857cc-rmtgp"
Jul 07 17:40:52.515386 ip-10-0-139-31 kubenswrapper[2561]: E0707 17:40:52.515293    2561 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 07 17:40:52.515386 ip-10-0-139-31 kubenswrapper[2561]: E0707 17:40:52.515351    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/66fea407-ba7e-4f9e-be19-2ed756f53841-metrics-tls podName:66fea407-ba7e-4f9e-be19-2ed756f53841 nodeName:}" failed. No retries permitted until 2026-07-07 17:41:00.515337013 +0000 UTC m=+51.666461394 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/66fea407-ba7e-4f9e-be19-2ed756f53841-metrics-tls") pod "dns-default-699db" (UID: "66fea407-ba7e-4f9e-be19-2ed756f53841") : secret "dns-default-metrics-tls" not found
Jul 07 17:40:52.515386 ip-10-0-139-31 kubenswrapper[2561]: E0707 17:40:52.515297    2561 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 07 17:40:52.515521 ip-10-0-139-31 kubenswrapper[2561]: E0707 17:40:52.515392    2561 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7ff58857cc-rmtgp: secret "image-registry-tls" not found
Jul 07 17:40:52.515521 ip-10-0-139-31 kubenswrapper[2561]: E0707 17:40:52.515432    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/41ffd3cf-e077-4933-af1c-24ae8b0d5704-registry-tls podName:41ffd3cf-e077-4933-af1c-24ae8b0d5704 nodeName:}" failed. No retries permitted until 2026-07-07 17:41:00.515421547 +0000 UTC m=+51.666545938 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/41ffd3cf-e077-4933-af1c-24ae8b0d5704-registry-tls") pod "image-registry-7ff58857cc-rmtgp" (UID: "41ffd3cf-e077-4933-af1c-24ae8b0d5704") : secret "image-registry-tls" not found
Jul 07 17:40:52.757327 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:52.757287    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-tl75q" event={"ID":"44315251-6c4d-438d-bc14-446002aa92a7","Type":"ContainerStarted","Data":"af358052f082e188cd00d68d8907a059fbbbe2f7dc571f8bab45da310a95d6e1"}
Jul 07 17:40:52.782631 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:52.782537    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-tl75q" podStartSLOduration=8.44861432 podStartE2EDuration="43.782521052s" totalImagesPullingTime="35.333906732s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 17:40:09 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 17:40:52.780778773 +0000 UTC m=+43.931903176" watchObservedRunningTime="2026-07-07 17:40:52.782521052 +0000 UTC m=+43.933645449"
Jul 07 17:40:52.906880 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:52.906845    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kks9r_2ef9c095-d303-40c3-920c-c9ff990f4032/konnectivity-agent/0.log" limit=1024
Jul 07 17:40:52.979902 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:40:52.979845    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kks9r_2ef9c095-d303-40c3-920c-c9ff990f4032/konnectivity-agent/0.log" limit=1024
Jul 07 17:41:00.574909 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:41:00.574842    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/66fea407-ba7e-4f9e-be19-2ed756f53841-metrics-tls\") pod \"dns-default-699db\" (UID: \"66fea407-ba7e-4f9e-be19-2ed756f53841\") " pod="openshift-dns/dns-default-699db"
Jul 07 17:41:00.574909 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:41:00.574919    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/41ffd3cf-e077-4933-af1c-24ae8b0d5704-registry-tls\") pod \"image-registry-7ff58857cc-rmtgp\" (UID: \"41ffd3cf-e077-4933-af1c-24ae8b0d5704\") " pod="openshift-image-registry/image-registry-7ff58857cc-rmtgp"
Jul 07 17:41:00.575496 ip-10-0-139-31 kubenswrapper[2561]: E0707 17:41:00.574993    2561 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 07 17:41:00.575496 ip-10-0-139-31 kubenswrapper[2561]: E0707 17:41:00.575073    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/66fea407-ba7e-4f9e-be19-2ed756f53841-metrics-tls podName:66fea407-ba7e-4f9e-be19-2ed756f53841 nodeName:}" failed. No retries permitted until 2026-07-07 17:41:16.57505845 +0000 UTC m=+67.726182827 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/66fea407-ba7e-4f9e-be19-2ed756f53841-metrics-tls") pod "dns-default-699db" (UID: "66fea407-ba7e-4f9e-be19-2ed756f53841") : secret "dns-default-metrics-tls" not found
Jul 07 17:41:00.575496 ip-10-0-139-31 kubenswrapper[2561]: E0707 17:41:00.575086    2561 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 07 17:41:00.575496 ip-10-0-139-31 kubenswrapper[2561]: E0707 17:41:00.575106    2561 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7ff58857cc-rmtgp: secret "image-registry-tls" not found
Jul 07 17:41:00.575496 ip-10-0-139-31 kubenswrapper[2561]: E0707 17:41:00.575164    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/41ffd3cf-e077-4933-af1c-24ae8b0d5704-registry-tls podName:41ffd3cf-e077-4933-af1c-24ae8b0d5704 nodeName:}" failed. No retries permitted until 2026-07-07 17:41:16.575147075 +0000 UTC m=+67.726271453 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/41ffd3cf-e077-4933-af1c-24ae8b0d5704-registry-tls") pod "image-registry-7ff58857cc-rmtgp" (UID: "41ffd3cf-e077-4933-af1c-24ae8b0d5704") : secret "image-registry-tls" not found
Jul 07 17:41:10.728460 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:41:10.728416    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-rbzjn"
Jul 07 17:41:15.082879 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:41:15.082832    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e54430cd-5514-416a-83cc-c3b1a549e576-original-pull-secret\") pod \"global-pull-secret-syncer-6cwrd\" (UID: \"e54430cd-5514-416a-83cc-c3b1a549e576\") " pod="kube-system/global-pull-secret-syncer-6cwrd"
Jul 07 17:41:15.086137 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:41:15.086111    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 07 17:41:15.096489 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:41:15.096430    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e54430cd-5514-416a-83cc-c3b1a549e576-original-pull-secret\") pod \"global-pull-secret-syncer-6cwrd\" (UID: \"e54430cd-5514-416a-83cc-c3b1a549e576\") " pod="kube-system/global-pull-secret-syncer-6cwrd"
Jul 07 17:41:15.183217 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:41:15.183180    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-km4h8\" (UniqueName: \"kubernetes.io/projected/0efe7076-81fe-4e2c-bf49-626c4d955b19-kube-api-access-km4h8\") pod \"network-check-target-gmjlh\" (UID: \"0efe7076-81fe-4e2c-bf49-626c4d955b19\") " pod="openshift-network-diagnostics/network-check-target-gmjlh"
Jul 07 17:41:15.183383 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:41:15.183229    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9d99e831-14fe-4b13-9a8b-3d9ca165c60e-metrics-certs\") pod \"network-metrics-daemon-pkn6n\" (UID: \"9d99e831-14fe-4b13-9a8b-3d9ca165c60e\") " pod="openshift-multus/network-metrics-daemon-pkn6n"
Jul 07 17:41:15.185959 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:41:15.185941    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 07 17:41:15.186035 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:41:15.185993    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 07 17:41:15.194032 ip-10-0-139-31 kubenswrapper[2561]: E0707 17:41:15.194008    2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Jul 07 17:41:15.194124 ip-10-0-139-31 kubenswrapper[2561]: E0707 17:41:15.194083    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9d99e831-14fe-4b13-9a8b-3d9ca165c60e-metrics-certs podName:9d99e831-14fe-4b13-9a8b-3d9ca165c60e nodeName:}" failed. No retries permitted until 2026-07-07 17:42:19.194066524 +0000 UTC m=+130.345190903 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9d99e831-14fe-4b13-9a8b-3d9ca165c60e-metrics-certs") pod "network-metrics-daemon-pkn6n" (UID: "9d99e831-14fe-4b13-9a8b-3d9ca165c60e") : secret "metrics-daemon-secret" not found
Jul 07 17:41:15.196181 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:41:15.196160    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 07 17:41:15.206710 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:41:15.206684    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-km4h8\" (UniqueName: \"kubernetes.io/projected/0efe7076-81fe-4e2c-bf49-626c4d955b19-kube-api-access-km4h8\") pod \"network-check-target-gmjlh\" (UID: \"0efe7076-81fe-4e2c-bf49-626c4d955b19\") " pod="openshift-network-diagnostics/network-check-target-gmjlh"
Jul 07 17:41:15.229385 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:41:15.229356    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-njwcl\""
Jul 07 17:41:15.232555 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:41:15.232538    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6cwrd"
Jul 07 17:41:15.237242 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:41:15.237226    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gmjlh"
Jul 07 17:41:15.369049 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:41:15.369018    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-gmjlh"]
Jul 07 17:41:15.372416 ip-10-0-139-31 kubenswrapper[2561]: W0707 17:41:15.372395    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0efe7076_81fe_4e2c_bf49_626c4d955b19.slice/crio-0b360fcc652988a5245b0b69bdd17b6df52b5d057faf7eb4b6045e82ba63cbeb WatchSource:0}: Error finding container 0b360fcc652988a5245b0b69bdd17b6df52b5d057faf7eb4b6045e82ba63cbeb: Status 404 returned error can't find the container with id 0b360fcc652988a5245b0b69bdd17b6df52b5d057faf7eb4b6045e82ba63cbeb
Jul 07 17:41:15.380810 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:41:15.380785    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-6cwrd"]
Jul 07 17:41:15.385160 ip-10-0-139-31 kubenswrapper[2561]: W0707 17:41:15.385138    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode54430cd_5514_416a_83cc_c3b1a549e576.slice/crio-8cd2603afa436e3095b11bca19bb6643fd5363aba5fc78d0e8bc2b46afe142d5 WatchSource:0}: Error finding container 8cd2603afa436e3095b11bca19bb6643fd5363aba5fc78d0e8bc2b46afe142d5: Status 404 returned error can't find the container with id 8cd2603afa436e3095b11bca19bb6643fd5363aba5fc78d0e8bc2b46afe142d5
Jul 07 17:41:15.813663 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:41:15.813631    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-6cwrd" event={"ID":"e54430cd-5514-416a-83cc-c3b1a549e576","Type":"ContainerStarted","Data":"8cd2603afa436e3095b11bca19bb6643fd5363aba5fc78d0e8bc2b46afe142d5"}
Jul 07 17:41:15.817562 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:41:15.815013    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-gmjlh" event={"ID":"0efe7076-81fe-4e2c-bf49-626c4d955b19","Type":"ContainerStarted","Data":"0b360fcc652988a5245b0b69bdd17b6df52b5d057faf7eb4b6045e82ba63cbeb"}
Jul 07 17:41:16.594803 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:41:16.594759    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/66fea407-ba7e-4f9e-be19-2ed756f53841-metrics-tls\") pod \"dns-default-699db\" (UID: \"66fea407-ba7e-4f9e-be19-2ed756f53841\") " pod="openshift-dns/dns-default-699db"
Jul 07 17:41:16.595307 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:41:16.594823    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/41ffd3cf-e077-4933-af1c-24ae8b0d5704-registry-tls\") pod \"image-registry-7ff58857cc-rmtgp\" (UID: \"41ffd3cf-e077-4933-af1c-24ae8b0d5704\") " pod="openshift-image-registry/image-registry-7ff58857cc-rmtgp"
Jul 07 17:41:16.595307 ip-10-0-139-31 kubenswrapper[2561]: E0707 17:41:16.594938    2561 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 07 17:41:16.595307 ip-10-0-139-31 kubenswrapper[2561]: E0707 17:41:16.594964    2561 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7ff58857cc-rmtgp: secret "image-registry-tls" not found
Jul 07 17:41:16.595307 ip-10-0-139-31 kubenswrapper[2561]: E0707 17:41:16.595042    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/41ffd3cf-e077-4933-af1c-24ae8b0d5704-registry-tls podName:41ffd3cf-e077-4933-af1c-24ae8b0d5704 nodeName:}" failed. No retries permitted until 2026-07-07 17:41:48.595020599 +0000 UTC m=+99.746144992 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/41ffd3cf-e077-4933-af1c-24ae8b0d5704-registry-tls") pod "image-registry-7ff58857cc-rmtgp" (UID: "41ffd3cf-e077-4933-af1c-24ae8b0d5704") : secret "image-registry-tls" not found
Jul 07 17:41:16.595568 ip-10-0-139-31 kubenswrapper[2561]: E0707 17:41:16.594936    2561 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 07 17:41:16.595568 ip-10-0-139-31 kubenswrapper[2561]: E0707 17:41:16.595487    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/66fea407-ba7e-4f9e-be19-2ed756f53841-metrics-tls podName:66fea407-ba7e-4f9e-be19-2ed756f53841 nodeName:}" failed. No retries permitted until 2026-07-07 17:41:48.595469988 +0000 UTC m=+99.746594372 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/66fea407-ba7e-4f9e-be19-2ed756f53841-metrics-tls") pod "dns-default-699db" (UID: "66fea407-ba7e-4f9e-be19-2ed756f53841") : secret "dns-default-metrics-tls" not found
Jul 07 17:41:20.830070 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:41:20.830032    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-gmjlh" event={"ID":"0efe7076-81fe-4e2c-bf49-626c4d955b19","Type":"ContainerStarted","Data":"d54f6b0a6ff50baee9a97399e0416ffca710a361394252dae9a3809c278275d0"}
Jul 07 17:41:20.830623 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:41:20.830112    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-gmjlh"
Jul 07 17:41:20.831495 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:41:20.831475    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-6cwrd" event={"ID":"e54430cd-5514-416a-83cc-c3b1a549e576","Type":"ContainerStarted","Data":"509d7662bb72f241996c74cd9ced5e3a588e733707389d1e03c2e339043eb315"}
Jul 07 17:41:20.847896 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:41:20.847847    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-gmjlh" podStartSLOduration=67.201976678 podStartE2EDuration="1m11.847830478s" totalImagesPullingTime="4.6458538s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 17:40:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 17:41:20.847218069 +0000 UTC m=+71.998342467" watchObservedRunningTime="2026-07-07 17:41:20.847830478 +0000 UTC m=+71.998954875"
Jul 07 17:41:20.869421 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:41:20.866636    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-6cwrd" podStartSLOduration=67.229253709 podStartE2EDuration="1m11.866614605s" totalImagesPullingTime="4.637360896s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 17:40:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 17:41:20.865106432 +0000 UTC m=+72.016230831" watchObservedRunningTime="2026-07-07 17:41:20.866614605 +0000 UTC m=+72.017739004"
Jul 07 17:41:24.862622 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:41:24.862589    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-4l8wb"]
Jul 07 17:41:24.865778 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:41:24.865760    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-4l8wb"
Jul 07 17:41:24.868534 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:41:24.868513    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\""
Jul 07 17:41:24.868652 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:41:24.868511    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\""
Jul 07 17:41:24.869593 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:41:24.869575    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\""
Jul 07 17:41:24.869728 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:41:24.869598    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-tmqfq\""
Jul 07 17:41:24.875968 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:41:24.875947    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-4l8wb"]
Jul 07 17:41:24.961341 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:41:24.961305    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/13c72263-3ad9-4a4f-85cd-1ca8bee3b3d5-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-4l8wb\" (UID: \"13c72263-3ad9-4a4f-85cd-1ca8bee3b3d5\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-4l8wb"
Jul 07 17:41:24.961556 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:41:24.961368    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5w95w\" (UniqueName: \"kubernetes.io/projected/13c72263-3ad9-4a4f-85cd-1ca8bee3b3d5-kube-api-access-5w95w\") pod \"cluster-samples-operator-56fcf86bf-4l8wb\" (UID: \"13c72263-3ad9-4a4f-85cd-1ca8bee3b3d5\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-4l8wb"
Jul 07 17:41:24.970373 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:41:24.970342    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-68b757fb67-bjl48"]
Jul 07 17:41:24.972753 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:41:24.972732    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-68b757fb67-bjl48"
Jul 07 17:41:24.975408 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:41:24.975389    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\""
Jul 07 17:41:24.975671 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:41:24.975511    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\""
Jul 07 17:41:24.975962 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:41:24.975944    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-vqv8z\""
Jul 07 17:41:24.976065 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:41:24.976045    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\""
Jul 07 17:41:24.976338 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:41:24.976320    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-5c847dcfc4-gwhjt"]
Jul 07 17:41:24.976628 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:41:24.976613    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\""
Jul 07 17:41:24.978719 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:41:24.978696    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-5c847dcfc4-gwhjt"
Jul 07 17:41:24.980921 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:41:24.980891    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\""
Jul 07 17:41:24.981573 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:41:24.981544    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-c2lj2"]
Jul 07 17:41:24.987027 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:41:24.983916    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-c2lj2"
Jul 07 17:41:24.987027 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:41:24.986092    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-prp2t\""
Jul 07 17:41:24.987027 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:41:24.986389    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 07 17:41:24.987027 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:41:24.986652    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 07 17:41:24.987027 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:41:24.986861    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\""
Jul 07 17:41:24.987904 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:41:24.987755    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\""
Jul 07 17:41:24.990253 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:41:24.990222    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\""
Jul 07 17:41:24.990403 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:41:24.990387    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\""
Jul 07 17:41:24.990718 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:41:24.990695    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-qxvpt\""
Jul 07 17:41:24.990815 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:41:24.990772    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-68b757fb67-bjl48"]
Jul 07 17:41:24.992092 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:41:24.992073    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\""
Jul 07 17:41:24.992346 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:41:24.992326    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\""
Jul 07 17:41:24.993458 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:41:24.993430    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-5c847dcfc4-gwhjt"]
Jul 07 17:41:24.993607 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:41:24.993593    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\""
Jul 07 17:41:24.997340 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:41:24.997318    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-c2lj2"]
Jul 07 17:41:25.062812 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:41:25.062774    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5bhqs\" (UniqueName: \"kubernetes.io/projected/fb9a13b7-2352-49f4-a15a-bf67a478c82f-kube-api-access-5bhqs\") pod \"kube-storage-version-migrator-operator-846bf668f7-c2lj2\" (UID: \"fb9a13b7-2352-49f4-a15a-bf67a478c82f\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-c2lj2"
Jul 07 17:41:25.063025 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:41:25.062834    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5w95w\" (UniqueName: \"kubernetes.io/projected/13c72263-3ad9-4a4f-85cd-1ca8bee3b3d5-kube-api-access-5w95w\") pod \"cluster-samples-operator-56fcf86bf-4l8wb\" (UID: \"13c72263-3ad9-4a4f-85cd-1ca8bee3b3d5\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-4l8wb"
Jul 07 17:41:25.063025 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:41:25.062918    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/805597ff-168d-4099-95b8-0037b0ceba2f-serving-cert\") pod \"console-operator-68b757fb67-bjl48\" (UID: \"805597ff-168d-4099-95b8-0037b0ceba2f\") " pod="openshift-console-operator/console-operator-68b757fb67-bjl48"
Jul 07 17:41:25.063025 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:41:25.062954    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/22855c2a-6a54-4a07-8655-db3f563f7e11-serving-cert\") pod \"insights-operator-5c847dcfc4-gwhjt\" (UID: \"22855c2a-6a54-4a07-8655-db3f563f7e11\") " pod="openshift-insights/insights-operator-5c847dcfc4-gwhjt"
Jul 07 17:41:25.063025 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:41:25.063010    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/22855c2a-6a54-4a07-8655-db3f563f7e11-trusted-ca-bundle\") pod \"insights-operator-5c847dcfc4-gwhjt\" (UID: \"22855c2a-6a54-4a07-8655-db3f563f7e11\") " pod="openshift-insights/insights-operator-5c847dcfc4-gwhjt"
Jul 07 17:41:25.063249 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:41:25.063042    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/22855c2a-6a54-4a07-8655-db3f563f7e11-snapshots\") pod \"insights-operator-5c847dcfc4-gwhjt\" (UID: \"22855c2a-6a54-4a07-8655-db3f563f7e11\") " pod="openshift-insights/insights-operator-5c847dcfc4-gwhjt"
Jul 07 17:41:25.063249 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:41:25.063071    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/13c72263-3ad9-4a4f-85cd-1ca8bee3b3d5-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-4l8wb\" (UID: \"13c72263-3ad9-4a4f-85cd-1ca8bee3b3d5\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-4l8wb"
Jul 07 17:41:25.063249 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:41:25.063131    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/805597ff-168d-4099-95b8-0037b0ceba2f-config\") pod \"console-operator-68b757fb67-bjl48\" (UID: \"805597ff-168d-4099-95b8-0037b0ceba2f\") " pod="openshift-console-operator/console-operator-68b757fb67-bjl48"
Jul 07 17:41:25.063249 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:41:25.063160    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/805597ff-168d-4099-95b8-0037b0ceba2f-trusted-ca\") pod \"console-operator-68b757fb67-bjl48\" (UID: \"805597ff-168d-4099-95b8-0037b0ceba2f\") " pod="openshift-console-operator/console-operator-68b757fb67-bjl48"
Jul 07 17:41:25.063249 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:41:25.063195    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/22855c2a-6a54-4a07-8655-db3f563f7e11-service-ca-bundle\") pod \"insights-operator-5c847dcfc4-gwhjt\" (UID: \"22855c2a-6a54-4a07-8655-db3f563f7e11\") " pod="openshift-insights/insights-operator-5c847dcfc4-gwhjt"
Jul 07 17:41:25.063249 ip-10-0-139-31 kubenswrapper[2561]: E0707 17:41:25.063237    2561 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 07 17:41:25.063436 ip-10-0-139-31 kubenswrapper[2561]: E0707 17:41:25.063303    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/13c72263-3ad9-4a4f-85cd-1ca8bee3b3d5-samples-operator-tls podName:13c72263-3ad9-4a4f-85cd-1ca8bee3b3d5 nodeName:}" failed. No retries permitted until 2026-07-07 17:41:25.563287803 +0000 UTC m=+76.714412182 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/13c72263-3ad9-4a4f-85cd-1ca8bee3b3d5-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-4l8wb" (UID: "13c72263-3ad9-4a4f-85cd-1ca8bee3b3d5") : secret "samples-operator-tls" not found
Jul 07 17:41:25.063436 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:41:25.063237    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/fb9a13b7-2352-49f4-a15a-bf67a478c82f-config\") pod \"kube-storage-version-migrator-operator-846bf668f7-c2lj2\" (UID: \"fb9a13b7-2352-49f4-a15a-bf67a478c82f\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-c2lj2"
Jul 07 17:41:25.063436 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:41:25.063357    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4rzwn\" (UniqueName: \"kubernetes.io/projected/805597ff-168d-4099-95b8-0037b0ceba2f-kube-api-access-4rzwn\") pod \"console-operator-68b757fb67-bjl48\" (UID: \"805597ff-168d-4099-95b8-0037b0ceba2f\") " pod="openshift-console-operator/console-operator-68b757fb67-bjl48"
Jul 07 17:41:25.063436 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:41:25.063385    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/fb9a13b7-2352-49f4-a15a-bf67a478c82f-serving-cert\") pod \"kube-storage-version-migrator-operator-846bf668f7-c2lj2\" (UID: \"fb9a13b7-2352-49f4-a15a-bf67a478c82f\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-c2lj2"
Jul 07 17:41:25.063620 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:41:25.063470    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/22855c2a-6a54-4a07-8655-db3f563f7e11-tmp\") pod \"insights-operator-5c847dcfc4-gwhjt\" (UID: \"22855c2a-6a54-4a07-8655-db3f563f7e11\") " pod="openshift-insights/insights-operator-5c847dcfc4-gwhjt"
Jul 07 17:41:25.063620 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:41:25.063498    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rkh4f\" (UniqueName: \"kubernetes.io/projected/22855c2a-6a54-4a07-8655-db3f563f7e11-kube-api-access-rkh4f\") pod \"insights-operator-5c847dcfc4-gwhjt\" (UID: \"22855c2a-6a54-4a07-8655-db3f563f7e11\") " pod="openshift-insights/insights-operator-5c847dcfc4-gwhjt"
Jul 07 17:41:25.071803 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:41:25.071781    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5w95w\" (UniqueName: \"kubernetes.io/projected/13c72263-3ad9-4a4f-85cd-1ca8bee3b3d5-kube-api-access-5w95w\") pod \"cluster-samples-operator-56fcf86bf-4l8wb\" (UID: \"13c72263-3ad9-4a4f-85cd-1ca8bee3b3d5\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-4l8wb"
Jul 07 17:41:25.164792 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:41:25.164700    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/fb9a13b7-2352-49f4-a15a-bf67a478c82f-config\") pod \"kube-storage-version-migrator-operator-846bf668f7-c2lj2\" (UID: \"fb9a13b7-2352-49f4-a15a-bf67a478c82f\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-c2lj2"
Jul 07 17:41:25.164792 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:41:25.164740    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4rzwn\" (UniqueName: \"kubernetes.io/projected/805597ff-168d-4099-95b8-0037b0ceba2f-kube-api-access-4rzwn\") pod \"console-operator-68b757fb67-bjl48\" (UID: \"805597ff-168d-4099-95b8-0037b0ceba2f\") " pod="openshift-console-operator/console-operator-68b757fb67-bjl48"
Jul 07 17:41:25.164792 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:41:25.164759    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/fb9a13b7-2352-49f4-a15a-bf67a478c82f-serving-cert\") pod \"kube-storage-version-migrator-operator-846bf668f7-c2lj2\" (UID: \"fb9a13b7-2352-49f4-a15a-bf67a478c82f\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-c2lj2"
Jul 07 17:41:25.165015 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:41:25.164904    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/22855c2a-6a54-4a07-8655-db3f563f7e11-tmp\") pod \"insights-operator-5c847dcfc4-gwhjt\" (UID: \"22855c2a-6a54-4a07-8655-db3f563f7e11\") " pod="openshift-insights/insights-operator-5c847dcfc4-gwhjt"
Jul 07 17:41:25.165015 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:41:25.164941    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rkh4f\" (UniqueName: \"kubernetes.io/projected/22855c2a-6a54-4a07-8655-db3f563f7e11-kube-api-access-rkh4f\") pod \"insights-operator-5c847dcfc4-gwhjt\" (UID: \"22855c2a-6a54-4a07-8655-db3f563f7e11\") " pod="openshift-insights/insights-operator-5c847dcfc4-gwhjt"
Jul 07 17:41:25.165015 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:41:25.164981    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5bhqs\" (UniqueName: \"kubernetes.io/projected/fb9a13b7-2352-49f4-a15a-bf67a478c82f-kube-api-access-5bhqs\") pod \"kube-storage-version-migrator-operator-846bf668f7-c2lj2\" (UID: \"fb9a13b7-2352-49f4-a15a-bf67a478c82f\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-c2lj2"
Jul 07 17:41:25.165181 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:41:25.165160    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/805597ff-168d-4099-95b8-0037b0ceba2f-serving-cert\") pod \"console-operator-68b757fb67-bjl48\" (UID: \"805597ff-168d-4099-95b8-0037b0ceba2f\") " pod="openshift-console-operator/console-operator-68b757fb67-bjl48"
Jul 07 17:41:25.165240 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:41:25.165194    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/22855c2a-6a54-4a07-8655-db3f563f7e11-serving-cert\") pod \"insights-operator-5c847dcfc4-gwhjt\" (UID: \"22855c2a-6a54-4a07-8655-db3f563f7e11\") " pod="openshift-insights/insights-operator-5c847dcfc4-gwhjt"
Jul 07 17:41:25.165346 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:41:25.165324    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/22855c2a-6a54-4a07-8655-db3f563f7e11-tmp\") pod \"insights-operator-5c847dcfc4-gwhjt\" (UID: \"22855c2a-6a54-4a07-8655-db3f563f7e11\") " pod="openshift-insights/insights-operator-5c847dcfc4-gwhjt"
Jul 07 17:41:25.165423 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:41:25.165375    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/fb9a13b7-2352-49f4-a15a-bf67a478c82f-config\") pod \"kube-storage-version-migrator-operator-846bf668f7-c2lj2\" (UID: \"fb9a13b7-2352-49f4-a15a-bf67a478c82f\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-c2lj2"
Jul 07 17:41:25.165423 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:41:25.165332    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/22855c2a-6a54-4a07-8655-db3f563f7e11-trusted-ca-bundle\") pod \"insights-operator-5c847dcfc4-gwhjt\" (UID: \"22855c2a-6a54-4a07-8655-db3f563f7e11\") " pod="openshift-insights/insights-operator-5c847dcfc4-gwhjt"
Jul 07 17:41:25.165553 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:41:25.165478    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/22855c2a-6a54-4a07-8655-db3f563f7e11-snapshots\") pod \"insights-operator-5c847dcfc4-gwhjt\" (UID: \"22855c2a-6a54-4a07-8655-db3f563f7e11\") " pod="openshift-insights/insights-operator-5c847dcfc4-gwhjt"
Jul 07 17:41:25.165553 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:41:25.165521    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/805597ff-168d-4099-95b8-0037b0ceba2f-config\") pod \"console-operator-68b757fb67-bjl48\" (UID: \"805597ff-168d-4099-95b8-0037b0ceba2f\") " pod="openshift-console-operator/console-operator-68b757fb67-bjl48"
Jul 07 17:41:25.165553 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:41:25.165549    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/805597ff-168d-4099-95b8-0037b0ceba2f-trusted-ca\") pod \"console-operator-68b757fb67-bjl48\" (UID: \"805597ff-168d-4099-95b8-0037b0ceba2f\") " pod="openshift-console-operator/console-operator-68b757fb67-bjl48"
Jul 07 17:41:25.165711 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:41:25.165583    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/22855c2a-6a54-4a07-8655-db3f563f7e11-service-ca-bundle\") pod \"insights-operator-5c847dcfc4-gwhjt\" (UID: \"22855c2a-6a54-4a07-8655-db3f563f7e11\") " pod="openshift-insights/insights-operator-5c847dcfc4-gwhjt"
Jul 07 17:41:25.166054 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:41:25.166030    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/22855c2a-6a54-4a07-8655-db3f563f7e11-snapshots\") pod \"insights-operator-5c847dcfc4-gwhjt\" (UID: \"22855c2a-6a54-4a07-8655-db3f563f7e11\") " pod="openshift-insights/insights-operator-5c847dcfc4-gwhjt"
Jul 07 17:41:25.166219 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:41:25.166197    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/22855c2a-6a54-4a07-8655-db3f563f7e11-service-ca-bundle\") pod \"insights-operator-5c847dcfc4-gwhjt\" (UID: \"22855c2a-6a54-4a07-8655-db3f563f7e11\") " pod="openshift-insights/insights-operator-5c847dcfc4-gwhjt"
Jul 07 17:41:25.166219 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:41:25.166206    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/805597ff-168d-4099-95b8-0037b0ceba2f-config\") pod \"console-operator-68b757fb67-bjl48\" (UID: \"805597ff-168d-4099-95b8-0037b0ceba2f\") " pod="openshift-console-operator/console-operator-68b757fb67-bjl48"
Jul 07 17:41:25.166353 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:41:25.166224    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/22855c2a-6a54-4a07-8655-db3f563f7e11-trusted-ca-bundle\") pod \"insights-operator-5c847dcfc4-gwhjt\" (UID: \"22855c2a-6a54-4a07-8655-db3f563f7e11\") " pod="openshift-insights/insights-operator-5c847dcfc4-gwhjt"
Jul 07 17:41:25.166801 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:41:25.166780    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/805597ff-168d-4099-95b8-0037b0ceba2f-trusted-ca\") pod \"console-operator-68b757fb67-bjl48\" (UID: \"805597ff-168d-4099-95b8-0037b0ceba2f\") " pod="openshift-console-operator/console-operator-68b757fb67-bjl48"
Jul 07 17:41:25.167581 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:41:25.167561    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/805597ff-168d-4099-95b8-0037b0ceba2f-serving-cert\") pod \"console-operator-68b757fb67-bjl48\" (UID: \"805597ff-168d-4099-95b8-0037b0ceba2f\") " pod="openshift-console-operator/console-operator-68b757fb67-bjl48"
Jul 07 17:41:25.167681 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:41:25.167662    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/fb9a13b7-2352-49f4-a15a-bf67a478c82f-serving-cert\") pod \"kube-storage-version-migrator-operator-846bf668f7-c2lj2\" (UID: \"fb9a13b7-2352-49f4-a15a-bf67a478c82f\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-c2lj2"
Jul 07 17:41:25.167757 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:41:25.167742    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/22855c2a-6a54-4a07-8655-db3f563f7e11-serving-cert\") pod \"insights-operator-5c847dcfc4-gwhjt\" (UID: \"22855c2a-6a54-4a07-8655-db3f563f7e11\") " pod="openshift-insights/insights-operator-5c847dcfc4-gwhjt"
Jul 07 17:41:25.174613 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:41:25.174578    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4rzwn\" (UniqueName: \"kubernetes.io/projected/805597ff-168d-4099-95b8-0037b0ceba2f-kube-api-access-4rzwn\") pod \"console-operator-68b757fb67-bjl48\" (UID: \"805597ff-168d-4099-95b8-0037b0ceba2f\") " pod="openshift-console-operator/console-operator-68b757fb67-bjl48"
Jul 07 17:41:25.175318 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:41:25.175300    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rkh4f\" (UniqueName: \"kubernetes.io/projected/22855c2a-6a54-4a07-8655-db3f563f7e11-kube-api-access-rkh4f\") pod \"insights-operator-5c847dcfc4-gwhjt\" (UID: \"22855c2a-6a54-4a07-8655-db3f563f7e11\") " pod="openshift-insights/insights-operator-5c847dcfc4-gwhjt"
Jul 07 17:41:25.175581 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:41:25.175562    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5bhqs\" (UniqueName: \"kubernetes.io/projected/fb9a13b7-2352-49f4-a15a-bf67a478c82f-kube-api-access-5bhqs\") pod \"kube-storage-version-migrator-operator-846bf668f7-c2lj2\" (UID: \"fb9a13b7-2352-49f4-a15a-bf67a478c82f\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-c2lj2"
Jul 07 17:41:25.283287 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:41:25.283258    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-68b757fb67-bjl48"
Jul 07 17:41:25.294738 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:41:25.294705    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-5c847dcfc4-gwhjt"
Jul 07 17:41:25.300494 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:41:25.300467    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-c2lj2"
Jul 07 17:41:25.424910 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:41:25.424823    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-68b757fb67-bjl48"]
Jul 07 17:41:25.427555 ip-10-0-139-31 kubenswrapper[2561]: W0707 17:41:25.427530    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod805597ff_168d_4099_95b8_0037b0ceba2f.slice/crio-bbdac911dc7696bb5de415670bfa4b011234cb54d3ca32669cf7d0a750616986 WatchSource:0}: Error finding container bbdac911dc7696bb5de415670bfa4b011234cb54d3ca32669cf7d0a750616986: Status 404 returned error can't find the container with id bbdac911dc7696bb5de415670bfa4b011234cb54d3ca32669cf7d0a750616986
Jul 07 17:41:25.569528 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:41:25.569495    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/13c72263-3ad9-4a4f-85cd-1ca8bee3b3d5-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-4l8wb\" (UID: \"13c72263-3ad9-4a4f-85cd-1ca8bee3b3d5\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-4l8wb"
Jul 07 17:41:25.569699 ip-10-0-139-31 kubenswrapper[2561]: E0707 17:41:25.569615    2561 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 07 17:41:25.569699 ip-10-0-139-31 kubenswrapper[2561]: E0707 17:41:25.569677    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/13c72263-3ad9-4a4f-85cd-1ca8bee3b3d5-samples-operator-tls podName:13c72263-3ad9-4a4f-85cd-1ca8bee3b3d5 nodeName:}" failed. No retries permitted until 2026-07-07 17:41:26.569661423 +0000 UTC m=+77.720785799 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/13c72263-3ad9-4a4f-85cd-1ca8bee3b3d5-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-4l8wb" (UID: "13c72263-3ad9-4a4f-85cd-1ca8bee3b3d5") : secret "samples-operator-tls" not found
Jul 07 17:41:25.652018 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:41:25.651990    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-c2lj2"]
Jul 07 17:41:25.652745 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:41:25.652724    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-5c847dcfc4-gwhjt"]
Jul 07 17:41:25.654576 ip-10-0-139-31 kubenswrapper[2561]: W0707 17:41:25.654542    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfb9a13b7_2352_49f4_a15a_bf67a478c82f.slice/crio-888e3e9cddf5ca5191458dbc33a06e52cca2ee58024b7eaefb963bfbc87e6af9 WatchSource:0}: Error finding container 888e3e9cddf5ca5191458dbc33a06e52cca2ee58024b7eaefb963bfbc87e6af9: Status 404 returned error can't find the container with id 888e3e9cddf5ca5191458dbc33a06e52cca2ee58024b7eaefb963bfbc87e6af9
Jul 07 17:41:25.655065 ip-10-0-139-31 kubenswrapper[2561]: W0707 17:41:25.655049    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod22855c2a_6a54_4a07_8655_db3f563f7e11.slice/crio-9b798248035354cff893b9b631de57517e7380fea6b3312ebceff5ac2bfc9243 WatchSource:0}: Error finding container 9b798248035354cff893b9b631de57517e7380fea6b3312ebceff5ac2bfc9243: Status 404 returned error can't find the container with id 9b798248035354cff893b9b631de57517e7380fea6b3312ebceff5ac2bfc9243
Jul 07 17:41:25.845299 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:41:25.845263    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-68b757fb67-bjl48" event={"ID":"805597ff-168d-4099-95b8-0037b0ceba2f","Type":"ContainerStarted","Data":"bbdac911dc7696bb5de415670bfa4b011234cb54d3ca32669cf7d0a750616986"}
Jul 07 17:41:25.846367 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:41:25.846341    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5c847dcfc4-gwhjt" event={"ID":"22855c2a-6a54-4a07-8655-db3f563f7e11","Type":"ContainerStarted","Data":"9b798248035354cff893b9b631de57517e7380fea6b3312ebceff5ac2bfc9243"}
Jul 07 17:41:25.847372 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:41:25.847352    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-c2lj2" event={"ID":"fb9a13b7-2352-49f4-a15a-bf67a478c82f","Type":"ContainerStarted","Data":"888e3e9cddf5ca5191458dbc33a06e52cca2ee58024b7eaefb963bfbc87e6af9"}
Jul 07 17:41:26.576840 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:41:26.576793    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/13c72263-3ad9-4a4f-85cd-1ca8bee3b3d5-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-4l8wb\" (UID: \"13c72263-3ad9-4a4f-85cd-1ca8bee3b3d5\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-4l8wb"
Jul 07 17:41:26.577321 ip-10-0-139-31 kubenswrapper[2561]: E0707 17:41:26.576954    2561 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 07 17:41:26.577321 ip-10-0-139-31 kubenswrapper[2561]: E0707 17:41:26.577026    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/13c72263-3ad9-4a4f-85cd-1ca8bee3b3d5-samples-operator-tls podName:13c72263-3ad9-4a4f-85cd-1ca8bee3b3d5 nodeName:}" failed. No retries permitted until 2026-07-07 17:41:28.57700729 +0000 UTC m=+79.728131671 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/13c72263-3ad9-4a4f-85cd-1ca8bee3b3d5-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-4l8wb" (UID: "13c72263-3ad9-4a4f-85cd-1ca8bee3b3d5") : secret "samples-operator-tls" not found
Jul 07 17:41:28.595678 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:41:28.595627    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/13c72263-3ad9-4a4f-85cd-1ca8bee3b3d5-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-4l8wb\" (UID: \"13c72263-3ad9-4a4f-85cd-1ca8bee3b3d5\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-4l8wb"
Jul 07 17:41:28.596177 ip-10-0-139-31 kubenswrapper[2561]: E0707 17:41:28.595828    2561 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 07 17:41:28.596177 ip-10-0-139-31 kubenswrapper[2561]: E0707 17:41:28.595934    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/13c72263-3ad9-4a4f-85cd-1ca8bee3b3d5-samples-operator-tls podName:13c72263-3ad9-4a4f-85cd-1ca8bee3b3d5 nodeName:}" failed. No retries permitted until 2026-07-07 17:41:32.595912304 +0000 UTC m=+83.747036682 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/13c72263-3ad9-4a4f-85cd-1ca8bee3b3d5-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-4l8wb" (UID: "13c72263-3ad9-4a4f-85cd-1ca8bee3b3d5") : secret "samples-operator-tls" not found
Jul 07 17:41:28.858794 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:41:28.858680    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-c2lj2" event={"ID":"fb9a13b7-2352-49f4-a15a-bf67a478c82f","Type":"ContainerStarted","Data":"583cafe27c89f9b49f69a789611c3fd7c4a92eb54035e1d18ce0f7734521e43c"}
Jul 07 17:41:28.860213 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:41:28.860188    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-bjl48_805597ff-168d-4099-95b8-0037b0ceba2f/console-operator/0.log"
Jul 07 17:41:28.860338 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:41:28.860229    2561 generic.go:356] "Generic (PLEG): container finished" podID="805597ff-168d-4099-95b8-0037b0ceba2f" containerID="38b011e11c048931d8b1c9070ffa7a2816662a4215d4c3f5ea28fac2b9eda6c0" exitCode=255
Jul 07 17:41:28.860338 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:41:28.860314    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-68b757fb67-bjl48" event={"ID":"805597ff-168d-4099-95b8-0037b0ceba2f","Type":"ContainerDied","Data":"38b011e11c048931d8b1c9070ffa7a2816662a4215d4c3f5ea28fac2b9eda6c0"}
Jul 07 17:41:28.860545 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:41:28.860523    2561 scope.go:117] "RemoveContainer" containerID="38b011e11c048931d8b1c9070ffa7a2816662a4215d4c3f5ea28fac2b9eda6c0"
Jul 07 17:41:28.861929 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:41:28.861908    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5c847dcfc4-gwhjt" event={"ID":"22855c2a-6a54-4a07-8655-db3f563f7e11","Type":"ContainerStarted","Data":"8adb585a56ab6e46f920707c9916be60d84b66b584dbbf8629aab7fc487e6f77"}
Jul 07 17:41:28.876963 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:41:28.876920    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-c2lj2" podStartSLOduration=1.8364099729999999 podStartE2EDuration="4.876905826s" totalImagesPullingTime="3.040495853s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 17:41:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 17:41:28.875074221 +0000 UTC m=+80.026198632" watchObservedRunningTime="2026-07-07 17:41:28.876905826 +0000 UTC m=+80.028030223"
Jul 07 17:41:28.911124 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:41:28.911057    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-5c847dcfc4-gwhjt" podStartSLOduration=1.868903697 podStartE2EDuration="4.911034627s" totalImagesPullingTime="3.04213093s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 17:41:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 17:41:28.909965835 +0000 UTC m=+80.061090237" watchObservedRunningTime="2026-07-07 17:41:28.911034627 +0000 UTC m=+80.062159029"
Jul 07 17:41:29.798737 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:41:29.798704    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-tghnn"]
Jul 07 17:41:29.802019 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:41:29.801996    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-tghnn"
Jul 07 17:41:29.804627 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:41:29.804603    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 07 17:41:29.804758 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:41:29.804651    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-6sssg\""
Jul 07 17:41:29.804758 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:41:29.804747    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 07 17:41:29.815121 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:41:29.815090    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-tghnn"]
Jul 07 17:41:29.867303 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:41:29.867276    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-bjl48_805597ff-168d-4099-95b8-0037b0ceba2f/console-operator/1.log"
Jul 07 17:41:29.867752 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:41:29.867736    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-bjl48_805597ff-168d-4099-95b8-0037b0ceba2f/console-operator/0.log"
Jul 07 17:41:29.867817 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:41:29.867771    2561 generic.go:356] "Generic (PLEG): container finished" podID="805597ff-168d-4099-95b8-0037b0ceba2f" containerID="500a7be9c8948d44b5d83b6a8017395d2d78580ebe0d389e06e4b4043188ebe7" exitCode=255
Jul 07 17:41:29.867882 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:41:29.867859    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-68b757fb67-bjl48" event={"ID":"805597ff-168d-4099-95b8-0037b0ceba2f","Type":"ContainerDied","Data":"500a7be9c8948d44b5d83b6a8017395d2d78580ebe0d389e06e4b4043188ebe7"}
Jul 07 17:41:29.867949 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:41:29.867916    2561 scope.go:117] "RemoveContainer" containerID="38b011e11c048931d8b1c9070ffa7a2816662a4215d4c3f5ea28fac2b9eda6c0"
Jul 07 17:41:29.868177 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:41:29.868161    2561 scope.go:117] "RemoveContainer" containerID="500a7be9c8948d44b5d83b6a8017395d2d78580ebe0d389e06e4b4043188ebe7"
Jul 07 17:41:29.868436 ip-10-0-139-31 kubenswrapper[2561]: E0707 17:41:29.868348    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-68b757fb67-bjl48_openshift-console-operator(805597ff-168d-4099-95b8-0037b0ceba2f)\"" pod="openshift-console-operator/console-operator-68b757fb67-bjl48" podUID="805597ff-168d-4099-95b8-0037b0ceba2f"
Jul 07 17:41:29.906632 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:41:29.906586    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/0eb58169-3997-45ba-a3c1-6d875fb3d7d2-data-volume\") pod \"insights-runtime-extractor-tghnn\" (UID: \"0eb58169-3997-45ba-a3c1-6d875fb3d7d2\") " pod="openshift-insights/insights-runtime-extractor-tghnn"
Jul 07 17:41:29.906812 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:41:29.906658    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6bnkt\" (UniqueName: \"kubernetes.io/projected/0eb58169-3997-45ba-a3c1-6d875fb3d7d2-kube-api-access-6bnkt\") pod \"insights-runtime-extractor-tghnn\" (UID: \"0eb58169-3997-45ba-a3c1-6d875fb3d7d2\") " pod="openshift-insights/insights-runtime-extractor-tghnn"
Jul 07 17:41:29.906812 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:41:29.906699    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/0eb58169-3997-45ba-a3c1-6d875fb3d7d2-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-tghnn\" (UID: \"0eb58169-3997-45ba-a3c1-6d875fb3d7d2\") " pod="openshift-insights/insights-runtime-extractor-tghnn"
Jul 07 17:41:29.906812 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:41:29.906726    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/0eb58169-3997-45ba-a3c1-6d875fb3d7d2-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-tghnn\" (UID: \"0eb58169-3997-45ba-a3c1-6d875fb3d7d2\") " pod="openshift-insights/insights-runtime-extractor-tghnn"
Jul 07 17:41:29.906812 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:41:29.906752    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/0eb58169-3997-45ba-a3c1-6d875fb3d7d2-crio-socket\") pod \"insights-runtime-extractor-tghnn\" (UID: \"0eb58169-3997-45ba-a3c1-6d875fb3d7d2\") " pod="openshift-insights/insights-runtime-extractor-tghnn"
Jul 07 17:41:30.007925 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:41:30.007823    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6bnkt\" (UniqueName: \"kubernetes.io/projected/0eb58169-3997-45ba-a3c1-6d875fb3d7d2-kube-api-access-6bnkt\") pod \"insights-runtime-extractor-tghnn\" (UID: \"0eb58169-3997-45ba-a3c1-6d875fb3d7d2\") " pod="openshift-insights/insights-runtime-extractor-tghnn"
Jul 07 17:41:30.008095 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:41:30.007995    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/0eb58169-3997-45ba-a3c1-6d875fb3d7d2-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-tghnn\" (UID: \"0eb58169-3997-45ba-a3c1-6d875fb3d7d2\") " pod="openshift-insights/insights-runtime-extractor-tghnn"
Jul 07 17:41:30.008095 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:41:30.008043    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/0eb58169-3997-45ba-a3c1-6d875fb3d7d2-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-tghnn\" (UID: \"0eb58169-3997-45ba-a3c1-6d875fb3d7d2\") " pod="openshift-insights/insights-runtime-extractor-tghnn"
Jul 07 17:41:30.008217 ip-10-0-139-31 kubenswrapper[2561]: E0707 17:41:30.008099    2561 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 07 17:41:30.008217 ip-10-0-139-31 kubenswrapper[2561]: E0707 17:41:30.008138    2561 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 07 17:41:30.008217 ip-10-0-139-31 kubenswrapper[2561]: E0707 17:41:30.008177    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/0eb58169-3997-45ba-a3c1-6d875fb3d7d2-kube-rbac-proxy-cm podName:0eb58169-3997-45ba-a3c1-6d875fb3d7d2 nodeName:}" failed. No retries permitted until 2026-07-07 17:41:30.508156518 +0000 UTC m=+81.659280922 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/0eb58169-3997-45ba-a3c1-6d875fb3d7d2-kube-rbac-proxy-cm") pod "insights-runtime-extractor-tghnn" (UID: "0eb58169-3997-45ba-a3c1-6d875fb3d7d2") : configmap "kube-rbac-proxy" not found
Jul 07 17:41:30.008217 ip-10-0-139-31 kubenswrapper[2561]: E0707 17:41:30.008198    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0eb58169-3997-45ba-a3c1-6d875fb3d7d2-insights-runtime-extractor-tls podName:0eb58169-3997-45ba-a3c1-6d875fb3d7d2 nodeName:}" failed. No retries permitted until 2026-07-07 17:41:30.508188081 +0000 UTC m=+81.659312461 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/0eb58169-3997-45ba-a3c1-6d875fb3d7d2-insights-runtime-extractor-tls") pod "insights-runtime-extractor-tghnn" (UID: "0eb58169-3997-45ba-a3c1-6d875fb3d7d2") : secret "insights-runtime-extractor-tls" not found
Jul 07 17:41:30.008416 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:41:30.008225    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/0eb58169-3997-45ba-a3c1-6d875fb3d7d2-crio-socket\") pod \"insights-runtime-extractor-tghnn\" (UID: \"0eb58169-3997-45ba-a3c1-6d875fb3d7d2\") " pod="openshift-insights/insights-runtime-extractor-tghnn"
Jul 07 17:41:30.008416 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:41:30.008391    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/0eb58169-3997-45ba-a3c1-6d875fb3d7d2-crio-socket\") pod \"insights-runtime-extractor-tghnn\" (UID: \"0eb58169-3997-45ba-a3c1-6d875fb3d7d2\") " pod="openshift-insights/insights-runtime-extractor-tghnn"
Jul 07 17:41:30.008560 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:41:30.008488    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/0eb58169-3997-45ba-a3c1-6d875fb3d7d2-data-volume\") pod \"insights-runtime-extractor-tghnn\" (UID: \"0eb58169-3997-45ba-a3c1-6d875fb3d7d2\") " pod="openshift-insights/insights-runtime-extractor-tghnn"
Jul 07 17:41:30.008765 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:41:30.008744    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/0eb58169-3997-45ba-a3c1-6d875fb3d7d2-data-volume\") pod \"insights-runtime-extractor-tghnn\" (UID: \"0eb58169-3997-45ba-a3c1-6d875fb3d7d2\") " pod="openshift-insights/insights-runtime-extractor-tghnn"
Jul 07 17:41:30.019325 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:41:30.019300    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6bnkt\" (UniqueName: \"kubernetes.io/projected/0eb58169-3997-45ba-a3c1-6d875fb3d7d2-kube-api-access-6bnkt\") pod \"insights-runtime-extractor-tghnn\" (UID: \"0eb58169-3997-45ba-a3c1-6d875fb3d7d2\") " pod="openshift-insights/insights-runtime-extractor-tghnn"
Jul 07 17:41:30.513893 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:41:30.513851    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/0eb58169-3997-45ba-a3c1-6d875fb3d7d2-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-tghnn\" (UID: \"0eb58169-3997-45ba-a3c1-6d875fb3d7d2\") " pod="openshift-insights/insights-runtime-extractor-tghnn"
Jul 07 17:41:30.513893 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:41:30.513897    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/0eb58169-3997-45ba-a3c1-6d875fb3d7d2-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-tghnn\" (UID: \"0eb58169-3997-45ba-a3c1-6d875fb3d7d2\") " pod="openshift-insights/insights-runtime-extractor-tghnn"
Jul 07 17:41:30.514183 ip-10-0-139-31 kubenswrapper[2561]: E0707 17:41:30.513997    2561 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 07 17:41:30.514183 ip-10-0-139-31 kubenswrapper[2561]: E0707 17:41:30.514058    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0eb58169-3997-45ba-a3c1-6d875fb3d7d2-insights-runtime-extractor-tls podName:0eb58169-3997-45ba-a3c1-6d875fb3d7d2 nodeName:}" failed. No retries permitted until 2026-07-07 17:41:31.514044253 +0000 UTC m=+82.665168634 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/0eb58169-3997-45ba-a3c1-6d875fb3d7d2-insights-runtime-extractor-tls") pod "insights-runtime-extractor-tghnn" (UID: "0eb58169-3997-45ba-a3c1-6d875fb3d7d2") : secret "insights-runtime-extractor-tls" not found
Jul 07 17:41:30.514183 ip-10-0-139-31 kubenswrapper[2561]: E0707 17:41:30.514002    2561 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 07 17:41:30.514183 ip-10-0-139-31 kubenswrapper[2561]: E0707 17:41:30.514142    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/0eb58169-3997-45ba-a3c1-6d875fb3d7d2-kube-rbac-proxy-cm podName:0eb58169-3997-45ba-a3c1-6d875fb3d7d2 nodeName:}" failed. No retries permitted until 2026-07-07 17:41:31.514129218 +0000 UTC m=+82.665253595 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/0eb58169-3997-45ba-a3c1-6d875fb3d7d2-kube-rbac-proxy-cm") pod "insights-runtime-extractor-tghnn" (UID: "0eb58169-3997-45ba-a3c1-6d875fb3d7d2") : configmap "kube-rbac-proxy" not found
Jul 07 17:41:30.873079 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:41:30.873053    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-bjl48_805597ff-168d-4099-95b8-0037b0ceba2f/console-operator/1.log"
Jul 07 17:41:30.873475 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:41:30.873396    2561 scope.go:117] "RemoveContainer" containerID="500a7be9c8948d44b5d83b6a8017395d2d78580ebe0d389e06e4b4043188ebe7"
Jul 07 17:41:30.873600 ip-10-0-139-31 kubenswrapper[2561]: E0707 17:41:30.873578    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-68b757fb67-bjl48_openshift-console-operator(805597ff-168d-4099-95b8-0037b0ceba2f)\"" pod="openshift-console-operator/console-operator-68b757fb67-bjl48" podUID="805597ff-168d-4099-95b8-0037b0ceba2f"
Jul 07 17:41:31.521839 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:41:31.521721    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/0eb58169-3997-45ba-a3c1-6d875fb3d7d2-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-tghnn\" (UID: \"0eb58169-3997-45ba-a3c1-6d875fb3d7d2\") " pod="openshift-insights/insights-runtime-extractor-tghnn"
Jul 07 17:41:31.521839 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:41:31.521758    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/0eb58169-3997-45ba-a3c1-6d875fb3d7d2-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-tghnn\" (UID: \"0eb58169-3997-45ba-a3c1-6d875fb3d7d2\") " pod="openshift-insights/insights-runtime-extractor-tghnn"
Jul 07 17:41:31.521839 ip-10-0-139-31 kubenswrapper[2561]: E0707 17:41:31.521820    2561 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 07 17:41:31.522057 ip-10-0-139-31 kubenswrapper[2561]: E0707 17:41:31.521857    2561 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 07 17:41:31.522057 ip-10-0-139-31 kubenswrapper[2561]: E0707 17:41:31.521877    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/0eb58169-3997-45ba-a3c1-6d875fb3d7d2-kube-rbac-proxy-cm podName:0eb58169-3997-45ba-a3c1-6d875fb3d7d2 nodeName:}" failed. No retries permitted until 2026-07-07 17:41:33.521861102 +0000 UTC m=+84.672985479 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/0eb58169-3997-45ba-a3c1-6d875fb3d7d2-kube-rbac-proxy-cm") pod "insights-runtime-extractor-tghnn" (UID: "0eb58169-3997-45ba-a3c1-6d875fb3d7d2") : configmap "kube-rbac-proxy" not found
Jul 07 17:41:31.522057 ip-10-0-139-31 kubenswrapper[2561]: E0707 17:41:31.521902    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0eb58169-3997-45ba-a3c1-6d875fb3d7d2-insights-runtime-extractor-tls podName:0eb58169-3997-45ba-a3c1-6d875fb3d7d2 nodeName:}" failed. No retries permitted until 2026-07-07 17:41:33.521892403 +0000 UTC m=+84.673016780 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/0eb58169-3997-45ba-a3c1-6d875fb3d7d2-insights-runtime-extractor-tls") pod "insights-runtime-extractor-tghnn" (UID: "0eb58169-3997-45ba-a3c1-6d875fb3d7d2") : secret "insights-runtime-extractor-tls" not found
Jul 07 17:41:31.588606 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:41:31.588577    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-4wz7j_54fe2d84-2eed-4379-aeb5-6588b2ee961d/dns-node-resolver/0.log"
Jul 07 17:41:32.633032 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:41:32.632986    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/13c72263-3ad9-4a4f-85cd-1ca8bee3b3d5-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-4l8wb\" (UID: \"13c72263-3ad9-4a4f-85cd-1ca8bee3b3d5\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-4l8wb"
Jul 07 17:41:32.633439 ip-10-0-139-31 kubenswrapper[2561]: E0707 17:41:32.633135    2561 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 07 17:41:32.633439 ip-10-0-139-31 kubenswrapper[2561]: E0707 17:41:32.633212    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/13c72263-3ad9-4a4f-85cd-1ca8bee3b3d5-samples-operator-tls podName:13c72263-3ad9-4a4f-85cd-1ca8bee3b3d5 nodeName:}" failed. No retries permitted until 2026-07-07 17:41:40.633195625 +0000 UTC m=+91.784320005 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/13c72263-3ad9-4a4f-85cd-1ca8bee3b3d5-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-4l8wb" (UID: "13c72263-3ad9-4a4f-85cd-1ca8bee3b3d5") : secret "samples-operator-tls" not found
Jul 07 17:41:32.992141 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:41:32.992049    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-vf2rn_8e97c2c1-e9ea-41fb-9bb9-ed0cf128c144/node-ca/0.log"
Jul 07 17:41:33.395033 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:41:33.395000    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-8q22f_d4f02e4d-1da9-4fbd-ae01-7d5b954981ca/serve-healthcheck-canary/0.log"
Jul 07 17:41:33.539949 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:41:33.539917    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/0eb58169-3997-45ba-a3c1-6d875fb3d7d2-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-tghnn\" (UID: \"0eb58169-3997-45ba-a3c1-6d875fb3d7d2\") " pod="openshift-insights/insights-runtime-extractor-tghnn"
Jul 07 17:41:33.539949 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:41:33.539955    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/0eb58169-3997-45ba-a3c1-6d875fb3d7d2-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-tghnn\" (UID: \"0eb58169-3997-45ba-a3c1-6d875fb3d7d2\") " pod="openshift-insights/insights-runtime-extractor-tghnn"
Jul 07 17:41:33.540201 ip-10-0-139-31 kubenswrapper[2561]: E0707 17:41:33.540034    2561 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 07 17:41:33.540201 ip-10-0-139-31 kubenswrapper[2561]: E0707 17:41:33.540083    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/0eb58169-3997-45ba-a3c1-6d875fb3d7d2-kube-rbac-proxy-cm podName:0eb58169-3997-45ba-a3c1-6d875fb3d7d2 nodeName:}" failed. No retries permitted until 2026-07-07 17:41:37.540069737 +0000 UTC m=+88.691194113 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/0eb58169-3997-45ba-a3c1-6d875fb3d7d2-kube-rbac-proxy-cm") pod "insights-runtime-extractor-tghnn" (UID: "0eb58169-3997-45ba-a3c1-6d875fb3d7d2") : configmap "kube-rbac-proxy" not found
Jul 07 17:41:33.540201 ip-10-0-139-31 kubenswrapper[2561]: E0707 17:41:33.540084    2561 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 07 17:41:33.540201 ip-10-0-139-31 kubenswrapper[2561]: E0707 17:41:33.540140    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0eb58169-3997-45ba-a3c1-6d875fb3d7d2-insights-runtime-extractor-tls podName:0eb58169-3997-45ba-a3c1-6d875fb3d7d2 nodeName:}" failed. No retries permitted until 2026-07-07 17:41:37.540123821 +0000 UTC m=+88.691248211 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/0eb58169-3997-45ba-a3c1-6d875fb3d7d2-insights-runtime-extractor-tls") pod "insights-runtime-extractor-tghnn" (UID: "0eb58169-3997-45ba-a3c1-6d875fb3d7d2") : secret "insights-runtime-extractor-tls" not found
Jul 07 17:41:35.284225 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:41:35.284171    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-68b757fb67-bjl48"
Jul 07 17:41:35.284647 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:41:35.284247    2561 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-68b757fb67-bjl48"
Jul 07 17:41:35.284647 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:41:35.284613    2561 scope.go:117] "RemoveContainer" containerID="500a7be9c8948d44b5d83b6a8017395d2d78580ebe0d389e06e4b4043188ebe7"
Jul 07 17:41:35.284781 ip-10-0-139-31 kubenswrapper[2561]: E0707 17:41:35.284761    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-68b757fb67-bjl48_openshift-console-operator(805597ff-168d-4099-95b8-0037b0ceba2f)\"" pod="openshift-console-operator/console-operator-68b757fb67-bjl48" podUID="805597ff-168d-4099-95b8-0037b0ceba2f"
Jul 07 17:41:37.573176 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:41:37.573129    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/0eb58169-3997-45ba-a3c1-6d875fb3d7d2-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-tghnn\" (UID: \"0eb58169-3997-45ba-a3c1-6d875fb3d7d2\") " pod="openshift-insights/insights-runtime-extractor-tghnn"
Jul 07 17:41:37.573176 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:41:37.573176    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/0eb58169-3997-45ba-a3c1-6d875fb3d7d2-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-tghnn\" (UID: \"0eb58169-3997-45ba-a3c1-6d875fb3d7d2\") " pod="openshift-insights/insights-runtime-extractor-tghnn"
Jul 07 17:41:37.573667 ip-10-0-139-31 kubenswrapper[2561]: E0707 17:41:37.573266    2561 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 07 17:41:37.573667 ip-10-0-139-31 kubenswrapper[2561]: E0707 17:41:37.573291    2561 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 07 17:41:37.573667 ip-10-0-139-31 kubenswrapper[2561]: E0707 17:41:37.573321    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/0eb58169-3997-45ba-a3c1-6d875fb3d7d2-kube-rbac-proxy-cm podName:0eb58169-3997-45ba-a3c1-6d875fb3d7d2 nodeName:}" failed. No retries permitted until 2026-07-07 17:41:45.573307526 +0000 UTC m=+96.724431902 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/0eb58169-3997-45ba-a3c1-6d875fb3d7d2-kube-rbac-proxy-cm") pod "insights-runtime-extractor-tghnn" (UID: "0eb58169-3997-45ba-a3c1-6d875fb3d7d2") : configmap "kube-rbac-proxy" not found
Jul 07 17:41:37.573667 ip-10-0-139-31 kubenswrapper[2561]: E0707 17:41:37.573346    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0eb58169-3997-45ba-a3c1-6d875fb3d7d2-insights-runtime-extractor-tls podName:0eb58169-3997-45ba-a3c1-6d875fb3d7d2 nodeName:}" failed. No retries permitted until 2026-07-07 17:41:45.573332821 +0000 UTC m=+96.724457201 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/0eb58169-3997-45ba-a3c1-6d875fb3d7d2-insights-runtime-extractor-tls") pod "insights-runtime-extractor-tghnn" (UID: "0eb58169-3997-45ba-a3c1-6d875fb3d7d2") : secret "insights-runtime-extractor-tls" not found
Jul 07 17:41:40.696420 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:41:40.696372    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/13c72263-3ad9-4a4f-85cd-1ca8bee3b3d5-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-4l8wb\" (UID: \"13c72263-3ad9-4a4f-85cd-1ca8bee3b3d5\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-4l8wb"
Jul 07 17:41:40.698884 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:41:40.698859    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/13c72263-3ad9-4a4f-85cd-1ca8bee3b3d5-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-4l8wb\" (UID: \"13c72263-3ad9-4a4f-85cd-1ca8bee3b3d5\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-4l8wb"
Jul 07 17:41:40.774136 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:41:40.774097    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-4l8wb"
Jul 07 17:41:40.903535 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:41:40.903496    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-4l8wb"]
Jul 07 17:41:41.904783 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:41:41.904745    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-4l8wb" event={"ID":"13c72263-3ad9-4a4f-85cd-1ca8bee3b3d5","Type":"ContainerStarted","Data":"96126b74a60937cc4560ec7348a03ba36d9609b42f6d7073b1cd918eefff1ddc"}
Jul 07 17:41:42.909757 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:41:42.909717    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-4l8wb" event={"ID":"13c72263-3ad9-4a4f-85cd-1ca8bee3b3d5","Type":"ContainerStarted","Data":"8ca5008e1ad0925cb87399aaad598e7ca629a76d00c3520bdee6a008f1cfc952"}
Jul 07 17:41:42.910141 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:41:42.909786    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-4l8wb" event={"ID":"13c72263-3ad9-4a4f-85cd-1ca8bee3b3d5","Type":"ContainerStarted","Data":"1c0c0fb1b228351e9df0871090266698d6e35d9a673aea9e1f480c9d7d5afde4"}
Jul 07 17:41:42.927681 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:41:42.927628    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-4l8wb" podStartSLOduration=17.176780045 podStartE2EDuration="18.927612965s" totalImagesPullingTime="1.75083292s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 17:41:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 17:41:42.925635091 +0000 UTC m=+94.076759489" watchObservedRunningTime="2026-07-07 17:41:42.927612965 +0000 UTC m=+94.078737362"
Jul 07 17:41:45.637946 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:41:45.637885    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/0eb58169-3997-45ba-a3c1-6d875fb3d7d2-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-tghnn\" (UID: \"0eb58169-3997-45ba-a3c1-6d875fb3d7d2\") " pod="openshift-insights/insights-runtime-extractor-tghnn"
Jul 07 17:41:45.637946 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:41:45.637949    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/0eb58169-3997-45ba-a3c1-6d875fb3d7d2-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-tghnn\" (UID: \"0eb58169-3997-45ba-a3c1-6d875fb3d7d2\") " pod="openshift-insights/insights-runtime-extractor-tghnn"
Jul 07 17:41:45.638629 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:41:45.638599    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/0eb58169-3997-45ba-a3c1-6d875fb3d7d2-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-tghnn\" (UID: \"0eb58169-3997-45ba-a3c1-6d875fb3d7d2\") " pod="openshift-insights/insights-runtime-extractor-tghnn"
Jul 07 17:41:45.640356 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:41:45.640335    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/0eb58169-3997-45ba-a3c1-6d875fb3d7d2-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-tghnn\" (UID: \"0eb58169-3997-45ba-a3c1-6d875fb3d7d2\") " pod="openshift-insights/insights-runtime-extractor-tghnn"
Jul 07 17:41:45.711172 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:41:45.711131    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-tghnn"
Jul 07 17:41:45.837322 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:41:45.837287    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-tghnn"]
Jul 07 17:41:45.840903 ip-10-0-139-31 kubenswrapper[2561]: W0707 17:41:45.840872    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0eb58169_3997_45ba_a3c1_6d875fb3d7d2.slice/crio-6a1a384b47b655936c0577ba9bd9b0b732588e1c765c0a01a8bda608070f9b42 WatchSource:0}: Error finding container 6a1a384b47b655936c0577ba9bd9b0b732588e1c765c0a01a8bda608070f9b42: Status 404 returned error can't find the container with id 6a1a384b47b655936c0577ba9bd9b0b732588e1c765c0a01a8bda608070f9b42
Jul 07 17:41:45.920151 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:41:45.920063    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-tghnn" event={"ID":"0eb58169-3997-45ba-a3c1-6d875fb3d7d2","Type":"ContainerStarted","Data":"6a1a384b47b655936c0577ba9bd9b0b732588e1c765c0a01a8bda608070f9b42"}
Jul 07 17:41:48.515461 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:41:48.515420    2561 scope.go:117] "RemoveContainer" containerID="500a7be9c8948d44b5d83b6a8017395d2d78580ebe0d389e06e4b4043188ebe7"
Jul 07 17:41:48.669282 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:41:48.669249    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/66fea407-ba7e-4f9e-be19-2ed756f53841-metrics-tls\") pod \"dns-default-699db\" (UID: \"66fea407-ba7e-4f9e-be19-2ed756f53841\") " pod="openshift-dns/dns-default-699db"
Jul 07 17:41:48.669468 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:41:48.669301    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/41ffd3cf-e077-4933-af1c-24ae8b0d5704-registry-tls\") pod \"image-registry-7ff58857cc-rmtgp\" (UID: \"41ffd3cf-e077-4933-af1c-24ae8b0d5704\") " pod="openshift-image-registry/image-registry-7ff58857cc-rmtgp"
Jul 07 17:41:48.672167 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:41:48.672138    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/66fea407-ba7e-4f9e-be19-2ed756f53841-metrics-tls\") pod \"dns-default-699db\" (UID: \"66fea407-ba7e-4f9e-be19-2ed756f53841\") " pod="openshift-dns/dns-default-699db"
Jul 07 17:41:48.672275 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:41:48.672205    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/41ffd3cf-e077-4933-af1c-24ae8b0d5704-registry-tls\") pod \"image-registry-7ff58857cc-rmtgp\" (UID: \"41ffd3cf-e077-4933-af1c-24ae8b0d5704\") " pod="openshift-image-registry/image-registry-7ff58857cc-rmtgp"
Jul 07 17:41:48.917997 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:41:48.917964    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-ktw2w\""
Jul 07 17:41:48.926265 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:41:48.926229    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7ff58857cc-rmtgp"
Jul 07 17:41:48.926462 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:41:48.926422    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-gg8rv\""
Jul 07 17:41:48.934467 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:41:48.934430    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-699db"
Jul 07 17:41:49.682373 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:41:49.682344    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-699db"]
Jul 07 17:41:49.685041 ip-10-0-139-31 kubenswrapper[2561]: W0707 17:41:49.685012    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod66fea407_ba7e_4f9e_be19_2ed756f53841.slice/crio-72c21234ece985c2d9bf090552b2db424244fbb90a28f2e3c61508bd417e0bc9 WatchSource:0}: Error finding container 72c21234ece985c2d9bf090552b2db424244fbb90a28f2e3c61508bd417e0bc9: Status 404 returned error can't find the container with id 72c21234ece985c2d9bf090552b2db424244fbb90a28f2e3c61508bd417e0bc9
Jul 07 17:41:49.702724 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:41:49.702692    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-7ff58857cc-rmtgp"]
Jul 07 17:41:49.705781 ip-10-0-139-31 kubenswrapper[2561]: W0707 17:41:49.705754    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod41ffd3cf_e077_4933_af1c_24ae8b0d5704.slice/crio-b5456d9a0a028492340f01c53fbd7db20ca01e0401786ee5889f471b6b5098c0 WatchSource:0}: Error finding container b5456d9a0a028492340f01c53fbd7db20ca01e0401786ee5889f471b6b5098c0: Status 404 returned error can't find the container with id b5456d9a0a028492340f01c53fbd7db20ca01e0401786ee5889f471b6b5098c0
Jul 07 17:41:49.937235 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:41:49.937199    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-tghnn" event={"ID":"0eb58169-3997-45ba-a3c1-6d875fb3d7d2","Type":"ContainerStarted","Data":"08cf4c02a05ccc66c297c45e33b56ce34c5225d9fdcb79636a40781cb1bc1bf6"}
Jul 07 17:41:49.938385 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:41:49.938354    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-699db" event={"ID":"66fea407-ba7e-4f9e-be19-2ed756f53841","Type":"ContainerStarted","Data":"72c21234ece985c2d9bf090552b2db424244fbb90a28f2e3c61508bd417e0bc9"}
Jul 07 17:41:49.940270 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:41:49.940251    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-bjl48_805597ff-168d-4099-95b8-0037b0ceba2f/console-operator/1.log"
Jul 07 17:41:49.940387 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:41:49.940327    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-68b757fb67-bjl48" event={"ID":"805597ff-168d-4099-95b8-0037b0ceba2f","Type":"ContainerStarted","Data":"a36bae7b7443905801c69b6df7e2fe4af6c254d505bbe77bc40a3c39ba3195fb"}
Jul 07 17:41:49.940695 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:41:49.940648    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-68b757fb67-bjl48"
Jul 07 17:41:49.941989 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:41:49.941915    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7ff58857cc-rmtgp" event={"ID":"41ffd3cf-e077-4933-af1c-24ae8b0d5704","Type":"ContainerStarted","Data":"16ca79556ab87f6e2e94ba4f333e73258a620be3770feada9100dc3831078fbd"}
Jul 07 17:41:49.941989 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:41:49.941955    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7ff58857cc-rmtgp" event={"ID":"41ffd3cf-e077-4933-af1c-24ae8b0d5704","Type":"ContainerStarted","Data":"b5456d9a0a028492340f01c53fbd7db20ca01e0401786ee5889f471b6b5098c0"}
Jul 07 17:41:49.942150 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:41:49.942090    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-7ff58857cc-rmtgp"
Jul 07 17:41:49.958998 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:41:49.958949    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-68b757fb67-bjl48" podStartSLOduration=22.694538967 podStartE2EDuration="25.958934624s" totalImagesPullingTime="3.264395657s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 17:41:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 17:41:49.958606106 +0000 UTC m=+101.109730505" watchObservedRunningTime="2026-07-07 17:41:49.958934624 +0000 UTC m=+101.110059022"
Jul 07 17:41:49.977823 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:41:49.977769    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-7ff58857cc-rmtgp" podStartSLOduration=100.977749617 podStartE2EDuration="1m40.977749617s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 17:40:09 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 17:41:49.977298437 +0000 UTC m=+101.128422859" watchObservedRunningTime="2026-07-07 17:41:49.977749617 +0000 UTC m=+101.128873998"
Jul 07 17:41:50.507857 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:41:50.507810    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-85ccd85fdd-56tqm"]
Jul 07 17:41:50.511180 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:41:50.511150    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-85ccd85fdd-56tqm"
Jul 07 17:41:50.513763 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:41:50.513727    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-hsz88\""
Jul 07 17:41:50.514971 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:41:50.514948    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
Jul 07 17:41:50.515072 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:41:50.514998    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
Jul 07 17:41:50.515596 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:41:50.515221    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
Jul 07 17:41:50.515596 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:41:50.515419    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\""
Jul 07 17:41:50.522682 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:41:50.521163    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-85ccd85fdd-56tqm"]
Jul 07 17:41:50.687776 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:41:50.687682    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ndg8c\" (UniqueName: \"kubernetes.io/projected/f5291d18-546b-4e1d-a2e4-8148a64c0701-kube-api-access-ndg8c\") pod \"managed-serviceaccount-addon-agent-85ccd85fdd-56tqm\" (UID: \"f5291d18-546b-4e1d-a2e4-8148a64c0701\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-85ccd85fdd-56tqm"
Jul 07 17:41:50.687776 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:41:50.687741    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/f5291d18-546b-4e1d-a2e4-8148a64c0701-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-85ccd85fdd-56tqm\" (UID: \"f5291d18-546b-4e1d-a2e4-8148a64c0701\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-85ccd85fdd-56tqm"
Jul 07 17:41:50.788721 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:41:50.788677    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ndg8c\" (UniqueName: \"kubernetes.io/projected/f5291d18-546b-4e1d-a2e4-8148a64c0701-kube-api-access-ndg8c\") pod \"managed-serviceaccount-addon-agent-85ccd85fdd-56tqm\" (UID: \"f5291d18-546b-4e1d-a2e4-8148a64c0701\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-85ccd85fdd-56tqm"
Jul 07 17:41:50.788927 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:41:50.788744    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/f5291d18-546b-4e1d-a2e4-8148a64c0701-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-85ccd85fdd-56tqm\" (UID: \"f5291d18-546b-4e1d-a2e4-8148a64c0701\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-85ccd85fdd-56tqm"
Jul 07 17:41:50.792175 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:41:50.792105    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/f5291d18-546b-4e1d-a2e4-8148a64c0701-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-85ccd85fdd-56tqm\" (UID: \"f5291d18-546b-4e1d-a2e4-8148a64c0701\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-85ccd85fdd-56tqm"
Jul 07 17:41:50.800672 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:41:50.800637    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ndg8c\" (UniqueName: \"kubernetes.io/projected/f5291d18-546b-4e1d-a2e4-8148a64c0701-kube-api-access-ndg8c\") pod \"managed-serviceaccount-addon-agent-85ccd85fdd-56tqm\" (UID: \"f5291d18-546b-4e1d-a2e4-8148a64c0701\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-85ccd85fdd-56tqm"
Jul 07 17:41:50.845494 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:41:50.845458    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-85ccd85fdd-56tqm"
Jul 07 17:41:50.860247 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:41:50.860214    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-68b757fb67-bjl48"
Jul 07 17:41:50.949512 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:41:50.949406    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-tghnn" event={"ID":"0eb58169-3997-45ba-a3c1-6d875fb3d7d2","Type":"ContainerStarted","Data":"16168d98fadc3b865b5fb91a346596c4e256e3c50301cf4da3207f526c0e2929"}
Jul 07 17:41:51.054991 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:41:51.054954    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-685bfb5f64-d4cpl"]
Jul 07 17:41:51.075620 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:41:51.075580    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-685bfb5f64-d4cpl"]
Jul 07 17:41:51.075772 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:41:51.075717    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-685bfb5f64-d4cpl"
Jul 07 17:41:51.078511 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:41:51.078485    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-p2dq4\""
Jul 07 17:41:51.078640 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:41:51.078565    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Jul 07 17:41:51.078712 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:41:51.078485    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Jul 07 17:41:51.192966 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:41:51.192929    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sgj8m\" (UniqueName: \"kubernetes.io/projected/4822b40c-4869-4df7-856d-bd6958e729a4-kube-api-access-sgj8m\") pod \"downloads-685bfb5f64-d4cpl\" (UID: \"4822b40c-4869-4df7-856d-bd6958e729a4\") " pod="openshift-console/downloads-685bfb5f64-d4cpl"
Jul 07 17:41:51.293845 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:41:51.293647    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sgj8m\" (UniqueName: \"kubernetes.io/projected/4822b40c-4869-4df7-856d-bd6958e729a4-kube-api-access-sgj8m\") pod \"downloads-685bfb5f64-d4cpl\" (UID: \"4822b40c-4869-4df7-856d-bd6958e729a4\") " pod="openshift-console/downloads-685bfb5f64-d4cpl"
Jul 07 17:41:51.305561 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:41:51.305499    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sgj8m\" (UniqueName: \"kubernetes.io/projected/4822b40c-4869-4df7-856d-bd6958e729a4-kube-api-access-sgj8m\") pod \"downloads-685bfb5f64-d4cpl\" (UID: \"4822b40c-4869-4df7-856d-bd6958e729a4\") " pod="openshift-console/downloads-685bfb5f64-d4cpl"
Jul 07 17:41:51.389039 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:41:51.388980    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-685bfb5f64-d4cpl"
Jul 07 17:41:51.625814 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:41:51.625759    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-85ccd85fdd-56tqm"]
Jul 07 17:41:51.628344 ip-10-0-139-31 kubenswrapper[2561]: W0707 17:41:51.628320    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf5291d18_546b_4e1d_a2e4_8148a64c0701.slice/crio-44aa43025cc99863c65b2ff765a70c0da9046e6ffbf50c7c0795fb30e6479de8 WatchSource:0}: Error finding container 44aa43025cc99863c65b2ff765a70c0da9046e6ffbf50c7c0795fb30e6479de8: Status 404 returned error can't find the container with id 44aa43025cc99863c65b2ff765a70c0da9046e6ffbf50c7c0795fb30e6479de8
Jul 07 17:41:51.642140 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:41:51.642112    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-685bfb5f64-d4cpl"]
Jul 07 17:41:51.765612 ip-10-0-139-31 kubenswrapper[2561]: W0707 17:41:51.765575    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4822b40c_4869_4df7_856d_bd6958e729a4.slice/crio-f154aa31eb8f4d5b8a054aa3be61a735360f28327eda148a38e9706aa00dfe8d WatchSource:0}: Error finding container f154aa31eb8f4d5b8a054aa3be61a735360f28327eda148a38e9706aa00dfe8d: Status 404 returned error can't find the container with id f154aa31eb8f4d5b8a054aa3be61a735360f28327eda148a38e9706aa00dfe8d
Jul 07 17:41:51.837851 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:41:51.837805    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-gmjlh"
Jul 07 17:41:51.953668 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:41:51.953630    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-85ccd85fdd-56tqm" event={"ID":"f5291d18-546b-4e1d-a2e4-8148a64c0701","Type":"ContainerStarted","Data":"44aa43025cc99863c65b2ff765a70c0da9046e6ffbf50c7c0795fb30e6479de8"}
Jul 07 17:41:51.954882 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:41:51.954849    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-685bfb5f64-d4cpl" event={"ID":"4822b40c-4869-4df7-856d-bd6958e729a4","Type":"ContainerStarted","Data":"f154aa31eb8f4d5b8a054aa3be61a735360f28327eda148a38e9706aa00dfe8d"}
Jul 07 17:41:51.956590 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:41:51.956565    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-699db" event={"ID":"66fea407-ba7e-4f9e-be19-2ed756f53841","Type":"ContainerStarted","Data":"e1ac59dd119651a91d35d9b3d2fe7732ff687203eb1d895fc47b65b0e31cee38"}
Jul 07 17:41:52.963216 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:41:52.963183    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-699db" event={"ID":"66fea407-ba7e-4f9e-be19-2ed756f53841","Type":"ContainerStarted","Data":"08c72cf3589dc7a7c3ce9ed6bcdc60a05b1f9a5406dc9e2c14bc990cb73bacc8"}
Jul 07 17:41:52.963850 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:41:52.963260    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-699db"
Jul 07 17:41:52.982937 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:41:52.982883    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-699db" podStartSLOduration=66.882133386 podStartE2EDuration="1m8.982862474s" totalImagesPullingTime="2.100729088s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 17:40:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 17:41:52.982395982 +0000 UTC m=+104.133520380" watchObservedRunningTime="2026-07-07 17:41:52.982862474 +0000 UTC m=+104.133986872"
Jul 07 17:41:53.972282 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:41:53.972187    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-tghnn" event={"ID":"0eb58169-3997-45ba-a3c1-6d875fb3d7d2","Type":"ContainerStarted","Data":"51f04a3fffbe095bbcb512077cc63e491c871cdb39f963b4567590e454f28f3b"}
Jul 07 17:41:53.999564 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:41:53.998162    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-tghnn" podStartSLOduration=17.17990825 podStartE2EDuration="24.998129052s" totalImagesPullingTime="7.818220802s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 17:41:29 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 17:41:53.996973532 +0000 UTC m=+105.148097931" watchObservedRunningTime="2026-07-07 17:41:53.998129052 +0000 UTC m=+105.149253449"
Jul 07 17:41:54.718755 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:41:54.718718    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-567f7b8b7c-wsp7f"]
Jul 07 17:41:54.727909 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:41:54.727464    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-wsp7f"
Jul 07 17:41:54.730050 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:41:54.729854    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-567f7b8b7c-wsp7f"]
Jul 07 17:41:54.730381 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:41:54.730301    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\""
Jul 07 17:41:54.730381 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:41:54.730364    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 07 17:41:54.731916 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:41:54.731332    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-dd29s\""
Jul 07 17:41:54.731916 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:41:54.731374    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\""
Jul 07 17:41:54.731916 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:41:54.731620    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 07 17:41:54.731916 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:41:54.731816    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 07 17:41:54.823778 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:41:54.823741    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xm292\" (UniqueName: \"kubernetes.io/projected/aabcec3a-d52b-4805-b27a-8fdb9c56e8e0-kube-api-access-xm292\") pod \"prometheus-operator-567f7b8b7c-wsp7f\" (UID: \"aabcec3a-d52b-4805-b27a-8fdb9c56e8e0\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-wsp7f"
Jul 07 17:41:54.823929 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:41:54.823789    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/aabcec3a-d52b-4805-b27a-8fdb9c56e8e0-metrics-client-ca\") pod \"prometheus-operator-567f7b8b7c-wsp7f\" (UID: \"aabcec3a-d52b-4805-b27a-8fdb9c56e8e0\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-wsp7f"
Jul 07 17:41:54.823929 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:41:54.823811    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/aabcec3a-d52b-4805-b27a-8fdb9c56e8e0-prometheus-operator-tls\") pod \"prometheus-operator-567f7b8b7c-wsp7f\" (UID: \"aabcec3a-d52b-4805-b27a-8fdb9c56e8e0\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-wsp7f"
Jul 07 17:41:54.824004 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:41:54.823922    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/aabcec3a-d52b-4805-b27a-8fdb9c56e8e0-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-567f7b8b7c-wsp7f\" (UID: \"aabcec3a-d52b-4805-b27a-8fdb9c56e8e0\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-wsp7f"
Jul 07 17:41:54.925238 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:41:54.925197    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xm292\" (UniqueName: \"kubernetes.io/projected/aabcec3a-d52b-4805-b27a-8fdb9c56e8e0-kube-api-access-xm292\") pod \"prometheus-operator-567f7b8b7c-wsp7f\" (UID: \"aabcec3a-d52b-4805-b27a-8fdb9c56e8e0\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-wsp7f"
Jul 07 17:41:54.925428 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:41:54.925254    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/aabcec3a-d52b-4805-b27a-8fdb9c56e8e0-metrics-client-ca\") pod \"prometheus-operator-567f7b8b7c-wsp7f\" (UID: \"aabcec3a-d52b-4805-b27a-8fdb9c56e8e0\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-wsp7f"
Jul 07 17:41:54.925428 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:41:54.925283    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/aabcec3a-d52b-4805-b27a-8fdb9c56e8e0-prometheus-operator-tls\") pod \"prometheus-operator-567f7b8b7c-wsp7f\" (UID: \"aabcec3a-d52b-4805-b27a-8fdb9c56e8e0\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-wsp7f"
Jul 07 17:41:54.925428 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:41:54.925366    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/aabcec3a-d52b-4805-b27a-8fdb9c56e8e0-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-567f7b8b7c-wsp7f\" (UID: \"aabcec3a-d52b-4805-b27a-8fdb9c56e8e0\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-wsp7f"
Jul 07 17:41:54.925616 ip-10-0-139-31 kubenswrapper[2561]: E0707 17:41:54.925507    2561 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-tls: secret "prometheus-operator-tls" not found
Jul 07 17:41:54.925616 ip-10-0-139-31 kubenswrapper[2561]: E0707 17:41:54.925571    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/aabcec3a-d52b-4805-b27a-8fdb9c56e8e0-prometheus-operator-tls podName:aabcec3a-d52b-4805-b27a-8fdb9c56e8e0 nodeName:}" failed. No retries permitted until 2026-07-07 17:41:55.425556502 +0000 UTC m=+106.576680879 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "prometheus-operator-tls" (UniqueName: "kubernetes.io/secret/aabcec3a-d52b-4805-b27a-8fdb9c56e8e0-prometheus-operator-tls") pod "prometheus-operator-567f7b8b7c-wsp7f" (UID: "aabcec3a-d52b-4805-b27a-8fdb9c56e8e0") : secret "prometheus-operator-tls" not found
Jul 07 17:41:54.925985 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:41:54.925962    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/aabcec3a-d52b-4805-b27a-8fdb9c56e8e0-metrics-client-ca\") pod \"prometheus-operator-567f7b8b7c-wsp7f\" (UID: \"aabcec3a-d52b-4805-b27a-8fdb9c56e8e0\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-wsp7f"
Jul 07 17:41:54.928052 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:41:54.928025    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/aabcec3a-d52b-4805-b27a-8fdb9c56e8e0-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-567f7b8b7c-wsp7f\" (UID: \"aabcec3a-d52b-4805-b27a-8fdb9c56e8e0\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-wsp7f"
Jul 07 17:41:54.935539 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:41:54.935516    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xm292\" (UniqueName: \"kubernetes.io/projected/aabcec3a-d52b-4805-b27a-8fdb9c56e8e0-kube-api-access-xm292\") pod \"prometheus-operator-567f7b8b7c-wsp7f\" (UID: \"aabcec3a-d52b-4805-b27a-8fdb9c56e8e0\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-wsp7f"
Jul 07 17:41:55.430491 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:41:55.430430    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/aabcec3a-d52b-4805-b27a-8fdb9c56e8e0-prometheus-operator-tls\") pod \"prometheus-operator-567f7b8b7c-wsp7f\" (UID: \"aabcec3a-d52b-4805-b27a-8fdb9c56e8e0\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-wsp7f"
Jul 07 17:41:55.433249 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:41:55.433221    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/aabcec3a-d52b-4805-b27a-8fdb9c56e8e0-prometheus-operator-tls\") pod \"prometheus-operator-567f7b8b7c-wsp7f\" (UID: \"aabcec3a-d52b-4805-b27a-8fdb9c56e8e0\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-wsp7f"
Jul 07 17:41:55.641421 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:41:55.641398    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-wsp7f"
Jul 07 17:41:55.801930 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:41:55.801850    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-567f7b8b7c-wsp7f"]
Jul 07 17:41:55.805715 ip-10-0-139-31 kubenswrapper[2561]: W0707 17:41:55.805686    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaabcec3a_d52b_4805_b27a_8fdb9c56e8e0.slice/crio-15d5360f7c3a63182baa93b30f763836cea2151e5fc140682aebb41f97e89dd7 WatchSource:0}: Error finding container 15d5360f7c3a63182baa93b30f763836cea2151e5fc140682aebb41f97e89dd7: Status 404 returned error can't find the container with id 15d5360f7c3a63182baa93b30f763836cea2151e5fc140682aebb41f97e89dd7
Jul 07 17:41:55.980525 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:41:55.980420    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-85ccd85fdd-56tqm" event={"ID":"f5291d18-546b-4e1d-a2e4-8148a64c0701","Type":"ContainerStarted","Data":"2259f4d739bac3cc119a997bca63a6202763ff1592b6b0ea5073ed3d38a4cfac"}
Jul 07 17:41:55.981565 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:41:55.981545    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-wsp7f" event={"ID":"aabcec3a-d52b-4805-b27a-8fdb9c56e8e0","Type":"ContainerStarted","Data":"15d5360f7c3a63182baa93b30f763836cea2151e5fc140682aebb41f97e89dd7"}
Jul 07 17:41:55.997156 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:41:55.997098    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-85ccd85fdd-56tqm" podStartSLOduration=2.008497871 podStartE2EDuration="5.997080883s" totalImagesPullingTime="3.988583012s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 17:41:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 17:41:55.996649506 +0000 UTC m=+107.147773905" watchObservedRunningTime="2026-07-07 17:41:55.997080883 +0000 UTC m=+107.148205281"
Jul 07 17:41:56.986693 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:41:56.986662    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-wsp7f" event={"ID":"aabcec3a-d52b-4805-b27a-8fdb9c56e8e0","Type":"ContainerStarted","Data":"ecec01ba5d0e6738689519b713eea0dec4a09d45a4c75fd3b0db470a648a9f93"}
Jul 07 17:41:57.992594 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:41:57.992552    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-wsp7f" event={"ID":"aabcec3a-d52b-4805-b27a-8fdb9c56e8e0","Type":"ContainerStarted","Data":"d94d45d053ff3efcec32677cdb04bc6232c52469eca7eb97eb8470a769cd9c48"}
Jul 07 17:41:58.012035 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:41:58.011981    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-wsp7f" podStartSLOduration=2.907371375 podStartE2EDuration="4.011964628s" totalImagesPullingTime="1.104593253s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 17:41:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 17:41:58.010378421 +0000 UTC m=+109.161502821" watchObservedRunningTime="2026-07-07 17:41:58.011964628 +0000 UTC m=+109.163089026"
Jul 07 17:42:00.117988 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:42:00.117952    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-7c9dbb8b7d-jrgqd"]
Jul 07 17:42:00.121077 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:42:00.121053    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-jrgqd"
Jul 07 17:42:00.124070 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:42:00.124044    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\""
Jul 07 17:42:00.124070 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:42:00.124060    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\""
Jul 07 17:42:00.125290 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:42:00.125263    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\""
Jul 07 17:42:00.125415 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:42:00.125330    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-7fp7q\""
Jul 07 17:42:00.131821 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:42:00.131799    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-7c9dbb8b7d-jrgqd"]
Jul 07 17:42:00.144293 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:42:00.144261    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-ml5ss"]
Jul 07 17:42:00.158503 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:42:00.158473    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-ml5ss"
Jul 07 17:42:00.161178 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:42:00.161147    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-fcg8q\""
Jul 07 17:42:00.161357 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:42:00.161264    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 07 17:42:00.161426 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:42:00.161412    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 07 17:42:00.161540 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:42:00.161522    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 07 17:42:00.172141 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:42:00.172101    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/ea719737-17e4-4de5-866a-f0283465c1d0-kube-state-metrics-tls\") pod \"kube-state-metrics-7c9dbb8b7d-jrgqd\" (UID: \"ea719737-17e4-4de5-866a-f0283465c1d0\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-jrgqd"
Jul 07 17:42:00.172141 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:42:00.172142    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/ea719737-17e4-4de5-866a-f0283465c1d0-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-7c9dbb8b7d-jrgqd\" (UID: \"ea719737-17e4-4de5-866a-f0283465c1d0\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-jrgqd"
Jul 07 17:42:00.172342 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:42:00.172193    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/df0a2c16-2d6c-4677-9338-7a72057544a6-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-ml5ss\" (UID: \"df0a2c16-2d6c-4677-9338-7a72057544a6\") " pod="openshift-monitoring/node-exporter-ml5ss"
Jul 07 17:42:00.172342 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:42:00.172234    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ea719737-17e4-4de5-866a-f0283465c1d0-metrics-client-ca\") pod \"kube-state-metrics-7c9dbb8b7d-jrgqd\" (UID: \"ea719737-17e4-4de5-866a-f0283465c1d0\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-jrgqd"
Jul 07 17:42:00.172342 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:42:00.172279    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ea719737-17e4-4de5-866a-f0283465c1d0-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-7c9dbb8b7d-jrgqd\" (UID: \"ea719737-17e4-4de5-866a-f0283465c1d0\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-jrgqd"
Jul 07 17:42:00.172342 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:42:00.172310    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/df0a2c16-2d6c-4677-9338-7a72057544a6-metrics-client-ca\") pod \"node-exporter-ml5ss\" (UID: \"df0a2c16-2d6c-4677-9338-7a72057544a6\") " pod="openshift-monitoring/node-exporter-ml5ss"
Jul 07 17:42:00.172342 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:42:00.172332    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/df0a2c16-2d6c-4677-9338-7a72057544a6-node-exporter-wtmp\") pod \"node-exporter-ml5ss\" (UID: \"df0a2c16-2d6c-4677-9338-7a72057544a6\") " pod="openshift-monitoring/node-exporter-ml5ss"
Jul 07 17:42:00.172611 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:42:00.172409    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/df0a2c16-2d6c-4677-9338-7a72057544a6-root\") pod \"node-exporter-ml5ss\" (UID: \"df0a2c16-2d6c-4677-9338-7a72057544a6\") " pod="openshift-monitoring/node-exporter-ml5ss"
Jul 07 17:42:00.172611 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:42:00.172461    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/df0a2c16-2d6c-4677-9338-7a72057544a6-node-exporter-tls\") pod \"node-exporter-ml5ss\" (UID: \"df0a2c16-2d6c-4677-9338-7a72057544a6\") " pod="openshift-monitoring/node-exporter-ml5ss"
Jul 07 17:42:00.172611 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:42:00.172505    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/ea719737-17e4-4de5-866a-f0283465c1d0-volume-directive-shadow\") pod \"kube-state-metrics-7c9dbb8b7d-jrgqd\" (UID: \"ea719737-17e4-4de5-866a-f0283465c1d0\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-jrgqd"
Jul 07 17:42:00.172611 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:42:00.172559    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/df0a2c16-2d6c-4677-9338-7a72057544a6-node-exporter-textfile\") pod \"node-exporter-ml5ss\" (UID: \"df0a2c16-2d6c-4677-9338-7a72057544a6\") " pod="openshift-monitoring/node-exporter-ml5ss"
Jul 07 17:42:00.172611 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:42:00.172585    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cq26p\" (UniqueName: \"kubernetes.io/projected/df0a2c16-2d6c-4677-9338-7a72057544a6-kube-api-access-cq26p\") pod \"node-exporter-ml5ss\" (UID: \"df0a2c16-2d6c-4677-9338-7a72057544a6\") " pod="openshift-monitoring/node-exporter-ml5ss"
Jul 07 17:42:00.172810 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:42:00.172620    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/df0a2c16-2d6c-4677-9338-7a72057544a6-node-exporter-accelerators-collector-config\") pod \"node-exporter-ml5ss\" (UID: \"df0a2c16-2d6c-4677-9338-7a72057544a6\") " pod="openshift-monitoring/node-exporter-ml5ss"
Jul 07 17:42:00.172810 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:42:00.172672    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l866q\" (UniqueName: \"kubernetes.io/projected/ea719737-17e4-4de5-866a-f0283465c1d0-kube-api-access-l866q\") pod \"kube-state-metrics-7c9dbb8b7d-jrgqd\" (UID: \"ea719737-17e4-4de5-866a-f0283465c1d0\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-jrgqd"
Jul 07 17:42:00.172810 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:42:00.172713    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/df0a2c16-2d6c-4677-9338-7a72057544a6-sys\") pod \"node-exporter-ml5ss\" (UID: \"df0a2c16-2d6c-4677-9338-7a72057544a6\") " pod="openshift-monitoring/node-exporter-ml5ss"
Jul 07 17:42:00.273757 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:42:00.273724    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/df0a2c16-2d6c-4677-9338-7a72057544a6-node-exporter-textfile\") pod \"node-exporter-ml5ss\" (UID: \"df0a2c16-2d6c-4677-9338-7a72057544a6\") " pod="openshift-monitoring/node-exporter-ml5ss"
Jul 07 17:42:00.273757 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:42:00.273763    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cq26p\" (UniqueName: \"kubernetes.io/projected/df0a2c16-2d6c-4677-9338-7a72057544a6-kube-api-access-cq26p\") pod \"node-exporter-ml5ss\" (UID: \"df0a2c16-2d6c-4677-9338-7a72057544a6\") " pod="openshift-monitoring/node-exporter-ml5ss"
Jul 07 17:42:00.273988 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:42:00.273790    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/df0a2c16-2d6c-4677-9338-7a72057544a6-node-exporter-accelerators-collector-config\") pod \"node-exporter-ml5ss\" (UID: \"df0a2c16-2d6c-4677-9338-7a72057544a6\") " pod="openshift-monitoring/node-exporter-ml5ss"
Jul 07 17:42:00.273988 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:42:00.273841    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l866q\" (UniqueName: \"kubernetes.io/projected/ea719737-17e4-4de5-866a-f0283465c1d0-kube-api-access-l866q\") pod \"kube-state-metrics-7c9dbb8b7d-jrgqd\" (UID: \"ea719737-17e4-4de5-866a-f0283465c1d0\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-jrgqd"
Jul 07 17:42:00.273988 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:42:00.273877    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/df0a2c16-2d6c-4677-9338-7a72057544a6-sys\") pod \"node-exporter-ml5ss\" (UID: \"df0a2c16-2d6c-4677-9338-7a72057544a6\") " pod="openshift-monitoring/node-exporter-ml5ss"
Jul 07 17:42:00.273988 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:42:00.273909    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/ea719737-17e4-4de5-866a-f0283465c1d0-kube-state-metrics-tls\") pod \"kube-state-metrics-7c9dbb8b7d-jrgqd\" (UID: \"ea719737-17e4-4de5-866a-f0283465c1d0\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-jrgqd"
Jul 07 17:42:00.273988 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:42:00.273937    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/ea719737-17e4-4de5-866a-f0283465c1d0-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-7c9dbb8b7d-jrgqd\" (UID: \"ea719737-17e4-4de5-866a-f0283465c1d0\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-jrgqd"
Jul 07 17:42:00.273988 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:42:00.273966    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/df0a2c16-2d6c-4677-9338-7a72057544a6-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-ml5ss\" (UID: \"df0a2c16-2d6c-4677-9338-7a72057544a6\") " pod="openshift-monitoring/node-exporter-ml5ss"
Jul 07 17:42:00.274233 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:42:00.273998    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ea719737-17e4-4de5-866a-f0283465c1d0-metrics-client-ca\") pod \"kube-state-metrics-7c9dbb8b7d-jrgqd\" (UID: \"ea719737-17e4-4de5-866a-f0283465c1d0\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-jrgqd"
Jul 07 17:42:00.274233 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:42:00.274023    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ea719737-17e4-4de5-866a-f0283465c1d0-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-7c9dbb8b7d-jrgqd\" (UID: \"ea719737-17e4-4de5-866a-f0283465c1d0\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-jrgqd"
Jul 07 17:42:00.274233 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:42:00.274046    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/df0a2c16-2d6c-4677-9338-7a72057544a6-metrics-client-ca\") pod \"node-exporter-ml5ss\" (UID: \"df0a2c16-2d6c-4677-9338-7a72057544a6\") " pod="openshift-monitoring/node-exporter-ml5ss"
Jul 07 17:42:00.274233 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:42:00.274075    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/df0a2c16-2d6c-4677-9338-7a72057544a6-node-exporter-wtmp\") pod \"node-exporter-ml5ss\" (UID: \"df0a2c16-2d6c-4677-9338-7a72057544a6\") " pod="openshift-monitoring/node-exporter-ml5ss"
Jul 07 17:42:00.274233 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:42:00.274102    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/df0a2c16-2d6c-4677-9338-7a72057544a6-sys\") pod \"node-exporter-ml5ss\" (UID: \"df0a2c16-2d6c-4677-9338-7a72057544a6\") " pod="openshift-monitoring/node-exporter-ml5ss"
Jul 07 17:42:00.274233 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:42:00.274115    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/df0a2c16-2d6c-4677-9338-7a72057544a6-root\") pod \"node-exporter-ml5ss\" (UID: \"df0a2c16-2d6c-4677-9338-7a72057544a6\") " pod="openshift-monitoring/node-exporter-ml5ss"
Jul 07 17:42:00.274233 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:42:00.274132    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/df0a2c16-2d6c-4677-9338-7a72057544a6-node-exporter-textfile\") pod \"node-exporter-ml5ss\" (UID: \"df0a2c16-2d6c-4677-9338-7a72057544a6\") " pod="openshift-monitoring/node-exporter-ml5ss"
Jul 07 17:42:00.274233 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:42:00.274138    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/df0a2c16-2d6c-4677-9338-7a72057544a6-node-exporter-tls\") pod \"node-exporter-ml5ss\" (UID: \"df0a2c16-2d6c-4677-9338-7a72057544a6\") " pod="openshift-monitoring/node-exporter-ml5ss"
Jul 07 17:42:00.274551 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:42:00.274306    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/ea719737-17e4-4de5-866a-f0283465c1d0-volume-directive-shadow\") pod \"kube-state-metrics-7c9dbb8b7d-jrgqd\" (UID: \"ea719737-17e4-4de5-866a-f0283465c1d0\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-jrgqd"
Jul 07 17:42:00.274551 ip-10-0-139-31 kubenswrapper[2561]: E0707 17:42:00.274540    2561 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found
Jul 07 17:42:00.274649 ip-10-0-139-31 kubenswrapper[2561]: E0707 17:42:00.274613    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/df0a2c16-2d6c-4677-9338-7a72057544a6-node-exporter-tls podName:df0a2c16-2d6c-4677-9338-7a72057544a6 nodeName:}" failed. No retries permitted until 2026-07-07 17:42:00.774593243 +0000 UTC m=+111.925717633 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/df0a2c16-2d6c-4677-9338-7a72057544a6-node-exporter-tls") pod "node-exporter-ml5ss" (UID: "df0a2c16-2d6c-4677-9338-7a72057544a6") : secret "node-exporter-tls" not found
Jul 07 17:42:00.274649 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:42:00.274621    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/df0a2c16-2d6c-4677-9338-7a72057544a6-node-exporter-accelerators-collector-config\") pod \"node-exporter-ml5ss\" (UID: \"df0a2c16-2d6c-4677-9338-7a72057544a6\") " pod="openshift-monitoring/node-exporter-ml5ss"
Jul 07 17:42:00.274830 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:42:00.274750    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/df0a2c16-2d6c-4677-9338-7a72057544a6-node-exporter-wtmp\") pod \"node-exporter-ml5ss\" (UID: \"df0a2c16-2d6c-4677-9338-7a72057544a6\") " pod="openshift-monitoring/node-exporter-ml5ss"
Jul 07 17:42:00.274830 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:42:00.274750    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/df0a2c16-2d6c-4677-9338-7a72057544a6-root\") pod \"node-exporter-ml5ss\" (UID: \"df0a2c16-2d6c-4677-9338-7a72057544a6\") " pod="openshift-monitoring/node-exporter-ml5ss"
Jul 07 17:42:00.275324 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:42:00.275278    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/df0a2c16-2d6c-4677-9338-7a72057544a6-metrics-client-ca\") pod \"node-exporter-ml5ss\" (UID: \"df0a2c16-2d6c-4677-9338-7a72057544a6\") " pod="openshift-monitoring/node-exporter-ml5ss"
Jul 07 17:42:00.275324 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:42:00.275316    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/ea719737-17e4-4de5-866a-f0283465c1d0-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-7c9dbb8b7d-jrgqd\" (UID: \"ea719737-17e4-4de5-866a-f0283465c1d0\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-jrgqd"
Jul 07 17:42:00.275602 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:42:00.275568    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/ea719737-17e4-4de5-866a-f0283465c1d0-volume-directive-shadow\") pod \"kube-state-metrics-7c9dbb8b7d-jrgqd\" (UID: \"ea719737-17e4-4de5-866a-f0283465c1d0\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-jrgqd"
Jul 07 17:42:00.275788 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:42:00.275689    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ea719737-17e4-4de5-866a-f0283465c1d0-metrics-client-ca\") pod \"kube-state-metrics-7c9dbb8b7d-jrgqd\" (UID: \"ea719737-17e4-4de5-866a-f0283465c1d0\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-jrgqd"
Jul 07 17:42:00.277409 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:42:00.277384    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/df0a2c16-2d6c-4677-9338-7a72057544a6-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-ml5ss\" (UID: \"df0a2c16-2d6c-4677-9338-7a72057544a6\") " pod="openshift-monitoring/node-exporter-ml5ss"
Jul 07 17:42:00.277666 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:42:00.277646    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/ea719737-17e4-4de5-866a-f0283465c1d0-kube-state-metrics-tls\") pod \"kube-state-metrics-7c9dbb8b7d-jrgqd\" (UID: \"ea719737-17e4-4de5-866a-f0283465c1d0\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-jrgqd"
Jul 07 17:42:00.277891 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:42:00.277869    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ea719737-17e4-4de5-866a-f0283465c1d0-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-7c9dbb8b7d-jrgqd\" (UID: \"ea719737-17e4-4de5-866a-f0283465c1d0\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-jrgqd"
Jul 07 17:42:00.283608 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:42:00.283574    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cq26p\" (UniqueName: \"kubernetes.io/projected/df0a2c16-2d6c-4677-9338-7a72057544a6-kube-api-access-cq26p\") pod \"node-exporter-ml5ss\" (UID: \"df0a2c16-2d6c-4677-9338-7a72057544a6\") " pod="openshift-monitoring/node-exporter-ml5ss"
Jul 07 17:42:00.284567 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:42:00.284544    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-l866q\" (UniqueName: \"kubernetes.io/projected/ea719737-17e4-4de5-866a-f0283465c1d0-kube-api-access-l866q\") pod \"kube-state-metrics-7c9dbb8b7d-jrgqd\" (UID: \"ea719737-17e4-4de5-866a-f0283465c1d0\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-jrgqd"
Jul 07 17:42:00.433936 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:42:00.433848    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-jrgqd"
Jul 07 17:42:00.614432 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:42:00.614400    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-7c9dbb8b7d-jrgqd"]
Jul 07 17:42:00.618359 ip-10-0-139-31 kubenswrapper[2561]: W0707 17:42:00.618325    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podea719737_17e4_4de5_866a_f0283465c1d0.slice/crio-c74ddf2a06caa6a6493962d681d9a0f0f0f5917a6b21eb2dd6b633a5425b6362 WatchSource:0}: Error finding container c74ddf2a06caa6a6493962d681d9a0f0f0f5917a6b21eb2dd6b633a5425b6362: Status 404 returned error can't find the container with id c74ddf2a06caa6a6493962d681d9a0f0f0f5917a6b21eb2dd6b633a5425b6362
Jul 07 17:42:00.778816 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:42:00.778739    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/df0a2c16-2d6c-4677-9338-7a72057544a6-node-exporter-tls\") pod \"node-exporter-ml5ss\" (UID: \"df0a2c16-2d6c-4677-9338-7a72057544a6\") " pod="openshift-monitoring/node-exporter-ml5ss"
Jul 07 17:42:00.778980 ip-10-0-139-31 kubenswrapper[2561]: E0707 17:42:00.778923    2561 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found
Jul 07 17:42:00.779035 ip-10-0-139-31 kubenswrapper[2561]: E0707 17:42:00.779004    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/df0a2c16-2d6c-4677-9338-7a72057544a6-node-exporter-tls podName:df0a2c16-2d6c-4677-9338-7a72057544a6 nodeName:}" failed. No retries permitted until 2026-07-07 17:42:01.778985206 +0000 UTC m=+112.930109586 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/df0a2c16-2d6c-4677-9338-7a72057544a6-node-exporter-tls") pod "node-exporter-ml5ss" (UID: "df0a2c16-2d6c-4677-9338-7a72057544a6") : secret "node-exporter-tls" not found
Jul 07 17:42:01.005617 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:42:01.005578    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-jrgqd" event={"ID":"ea719737-17e4-4de5-866a-f0283465c1d0","Type":"ContainerStarted","Data":"c74ddf2a06caa6a6493962d681d9a0f0f0f5917a6b21eb2dd6b633a5425b6362"}
Jul 07 17:42:01.788366 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:42:01.788325    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/df0a2c16-2d6c-4677-9338-7a72057544a6-node-exporter-tls\") pod \"node-exporter-ml5ss\" (UID: \"df0a2c16-2d6c-4677-9338-7a72057544a6\") " pod="openshift-monitoring/node-exporter-ml5ss"
Jul 07 17:42:01.791421 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:42:01.791392    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/df0a2c16-2d6c-4677-9338-7a72057544a6-node-exporter-tls\") pod \"node-exporter-ml5ss\" (UID: \"df0a2c16-2d6c-4677-9338-7a72057544a6\") " pod="openshift-monitoring/node-exporter-ml5ss"
Jul 07 17:42:01.969833 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:42:01.969791    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-ml5ss"
Jul 07 17:42:02.069834 ip-10-0-139-31 kubenswrapper[2561]: W0707 17:42:02.069792    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddf0a2c16_2d6c_4677_9338_7a72057544a6.slice/crio-503c3b6c0ea2ab4887eb3bc7a23189ac16ee9ac6b855bb0d0bdeab55a1400aaf WatchSource:0}: Error finding container 503c3b6c0ea2ab4887eb3bc7a23189ac16ee9ac6b855bb0d0bdeab55a1400aaf: Status 404 returned error can't find the container with id 503c3b6c0ea2ab4887eb3bc7a23189ac16ee9ac6b855bb0d0bdeab55a1400aaf
Jul 07 17:42:02.214782 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:42:02.214732    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-c8f6776f7-v4fjv"]
Jul 07 17:42:02.222148 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:42:02.222120    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-c8f6776f7-v4fjv"
Jul 07 17:42:02.225770 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:42:02.225519    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\""
Jul 07 17:42:02.225770 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:42:02.225584    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\""
Jul 07 17:42:02.225770 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:42:02.225526    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\""
Jul 07 17:42:02.225770 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:42:02.225523    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-10l1044o8sbcq\""
Jul 07 17:42:02.225770 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:42:02.225680    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-ktdd2\""
Jul 07 17:42:02.226073 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:42:02.225817    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\""
Jul 07 17:42:02.226310 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:42:02.226288    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\""
Jul 07 17:42:02.232589 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:42:02.232023    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-c8f6776f7-v4fjv"]
Jul 07 17:42:02.293342 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:42:02.293292    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/16f0c9e3-ea28-4b17-970d-aea17a6d1f56-secret-thanos-querier-tls\") pod \"thanos-querier-c8f6776f7-v4fjv\" (UID: \"16f0c9e3-ea28-4b17-970d-aea17a6d1f56\") " pod="openshift-monitoring/thanos-querier-c8f6776f7-v4fjv"
Jul 07 17:42:02.293516 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:42:02.293338    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kfr7q\" (UniqueName: \"kubernetes.io/projected/16f0c9e3-ea28-4b17-970d-aea17a6d1f56-kube-api-access-kfr7q\") pod \"thanos-querier-c8f6776f7-v4fjv\" (UID: \"16f0c9e3-ea28-4b17-970d-aea17a6d1f56\") " pod="openshift-monitoring/thanos-querier-c8f6776f7-v4fjv"
Jul 07 17:42:02.293592 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:42:02.293513    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/16f0c9e3-ea28-4b17-970d-aea17a6d1f56-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-c8f6776f7-v4fjv\" (UID: \"16f0c9e3-ea28-4b17-970d-aea17a6d1f56\") " pod="openshift-monitoring/thanos-querier-c8f6776f7-v4fjv"
Jul 07 17:42:02.293592 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:42:02.293580    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/16f0c9e3-ea28-4b17-970d-aea17a6d1f56-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-c8f6776f7-v4fjv\" (UID: \"16f0c9e3-ea28-4b17-970d-aea17a6d1f56\") " pod="openshift-monitoring/thanos-querier-c8f6776f7-v4fjv"
Jul 07 17:42:02.293682 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:42:02.293611    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/16f0c9e3-ea28-4b17-970d-aea17a6d1f56-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-c8f6776f7-v4fjv\" (UID: \"16f0c9e3-ea28-4b17-970d-aea17a6d1f56\") " pod="openshift-monitoring/thanos-querier-c8f6776f7-v4fjv"
Jul 07 17:42:02.293682 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:42:02.293646    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/16f0c9e3-ea28-4b17-970d-aea17a6d1f56-secret-grpc-tls\") pod \"thanos-querier-c8f6776f7-v4fjv\" (UID: \"16f0c9e3-ea28-4b17-970d-aea17a6d1f56\") " pod="openshift-monitoring/thanos-querier-c8f6776f7-v4fjv"
Jul 07 17:42:02.293753 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:42:02.293688    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/16f0c9e3-ea28-4b17-970d-aea17a6d1f56-metrics-client-ca\") pod \"thanos-querier-c8f6776f7-v4fjv\" (UID: \"16f0c9e3-ea28-4b17-970d-aea17a6d1f56\") " pod="openshift-monitoring/thanos-querier-c8f6776f7-v4fjv"
Jul 07 17:42:02.293753 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:42:02.293722    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/16f0c9e3-ea28-4b17-970d-aea17a6d1f56-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-c8f6776f7-v4fjv\" (UID: \"16f0c9e3-ea28-4b17-970d-aea17a6d1f56\") " pod="openshift-monitoring/thanos-querier-c8f6776f7-v4fjv"
Jul 07 17:42:02.395088 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:42:02.395046    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/16f0c9e3-ea28-4b17-970d-aea17a6d1f56-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-c8f6776f7-v4fjv\" (UID: \"16f0c9e3-ea28-4b17-970d-aea17a6d1f56\") " pod="openshift-monitoring/thanos-querier-c8f6776f7-v4fjv"
Jul 07 17:42:02.395270 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:42:02.395102    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/16f0c9e3-ea28-4b17-970d-aea17a6d1f56-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-c8f6776f7-v4fjv\" (UID: \"16f0c9e3-ea28-4b17-970d-aea17a6d1f56\") " pod="openshift-monitoring/thanos-querier-c8f6776f7-v4fjv"
Jul 07 17:42:02.395270 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:42:02.395130    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/16f0c9e3-ea28-4b17-970d-aea17a6d1f56-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-c8f6776f7-v4fjv\" (UID: \"16f0c9e3-ea28-4b17-970d-aea17a6d1f56\") " pod="openshift-monitoring/thanos-querier-c8f6776f7-v4fjv"
Jul 07 17:42:02.395270 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:42:02.395155    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/16f0c9e3-ea28-4b17-970d-aea17a6d1f56-secret-grpc-tls\") pod \"thanos-querier-c8f6776f7-v4fjv\" (UID: \"16f0c9e3-ea28-4b17-970d-aea17a6d1f56\") " pod="openshift-monitoring/thanos-querier-c8f6776f7-v4fjv"
Jul 07 17:42:02.395270 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:42:02.395200    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/16f0c9e3-ea28-4b17-970d-aea17a6d1f56-metrics-client-ca\") pod \"thanos-querier-c8f6776f7-v4fjv\" (UID: \"16f0c9e3-ea28-4b17-970d-aea17a6d1f56\") " pod="openshift-monitoring/thanos-querier-c8f6776f7-v4fjv"
Jul 07 17:42:02.395270 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:42:02.395229    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/16f0c9e3-ea28-4b17-970d-aea17a6d1f56-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-c8f6776f7-v4fjv\" (UID: \"16f0c9e3-ea28-4b17-970d-aea17a6d1f56\") " pod="openshift-monitoring/thanos-querier-c8f6776f7-v4fjv"
Jul 07 17:42:02.395573 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:42:02.395310    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/16f0c9e3-ea28-4b17-970d-aea17a6d1f56-secret-thanos-querier-tls\") pod \"thanos-querier-c8f6776f7-v4fjv\" (UID: \"16f0c9e3-ea28-4b17-970d-aea17a6d1f56\") " pod="openshift-monitoring/thanos-querier-c8f6776f7-v4fjv"
Jul 07 17:42:02.395573 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:42:02.395337    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kfr7q\" (UniqueName: \"kubernetes.io/projected/16f0c9e3-ea28-4b17-970d-aea17a6d1f56-kube-api-access-kfr7q\") pod \"thanos-querier-c8f6776f7-v4fjv\" (UID: \"16f0c9e3-ea28-4b17-970d-aea17a6d1f56\") " pod="openshift-monitoring/thanos-querier-c8f6776f7-v4fjv"
Jul 07 17:42:02.396097 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:42:02.396040    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/16f0c9e3-ea28-4b17-970d-aea17a6d1f56-metrics-client-ca\") pod \"thanos-querier-c8f6776f7-v4fjv\" (UID: \"16f0c9e3-ea28-4b17-970d-aea17a6d1f56\") " pod="openshift-monitoring/thanos-querier-c8f6776f7-v4fjv"
Jul 07 17:42:02.397766 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:42:02.397742    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/16f0c9e3-ea28-4b17-970d-aea17a6d1f56-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-c8f6776f7-v4fjv\" (UID: \"16f0c9e3-ea28-4b17-970d-aea17a6d1f56\") " pod="openshift-monitoring/thanos-querier-c8f6776f7-v4fjv"
Jul 07 17:42:02.397855 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:42:02.397834    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/16f0c9e3-ea28-4b17-970d-aea17a6d1f56-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-c8f6776f7-v4fjv\" (UID: \"16f0c9e3-ea28-4b17-970d-aea17a6d1f56\") " pod="openshift-monitoring/thanos-querier-c8f6776f7-v4fjv"
Jul 07 17:42:02.398107 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:42:02.398087    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/16f0c9e3-ea28-4b17-970d-aea17a6d1f56-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-c8f6776f7-v4fjv\" (UID: \"16f0c9e3-ea28-4b17-970d-aea17a6d1f56\") " pod="openshift-monitoring/thanos-querier-c8f6776f7-v4fjv"
Jul 07 17:42:02.398145 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:42:02.398087    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/16f0c9e3-ea28-4b17-970d-aea17a6d1f56-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-c8f6776f7-v4fjv\" (UID: \"16f0c9e3-ea28-4b17-970d-aea17a6d1f56\") " pod="openshift-monitoring/thanos-querier-c8f6776f7-v4fjv"
Jul 07 17:42:02.398685 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:42:02.398664    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/16f0c9e3-ea28-4b17-970d-aea17a6d1f56-secret-grpc-tls\") pod \"thanos-querier-c8f6776f7-v4fjv\" (UID: \"16f0c9e3-ea28-4b17-970d-aea17a6d1f56\") " pod="openshift-monitoring/thanos-querier-c8f6776f7-v4fjv"
Jul 07 17:42:02.399718 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:42:02.399698    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/16f0c9e3-ea28-4b17-970d-aea17a6d1f56-secret-thanos-querier-tls\") pod \"thanos-querier-c8f6776f7-v4fjv\" (UID: \"16f0c9e3-ea28-4b17-970d-aea17a6d1f56\") " pod="openshift-monitoring/thanos-querier-c8f6776f7-v4fjv"
Jul 07 17:42:02.404550 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:42:02.404524    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kfr7q\" (UniqueName: \"kubernetes.io/projected/16f0c9e3-ea28-4b17-970d-aea17a6d1f56-kube-api-access-kfr7q\") pod \"thanos-querier-c8f6776f7-v4fjv\" (UID: \"16f0c9e3-ea28-4b17-970d-aea17a6d1f56\") " pod="openshift-monitoring/thanos-querier-c8f6776f7-v4fjv"
Jul 07 17:42:02.554092 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:42:02.554020    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-c8f6776f7-v4fjv"
Jul 07 17:42:02.722339 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:42:02.722240    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-c8f6776f7-v4fjv"]
Jul 07 17:42:02.727127 ip-10-0-139-31 kubenswrapper[2561]: W0707 17:42:02.727096    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod16f0c9e3_ea28_4b17_970d_aea17a6d1f56.slice/crio-7e34e39f6b5ce5be7506a2d5ba25c41f04c4674fde547d2c12d489df0c11a699 WatchSource:0}: Error finding container 7e34e39f6b5ce5be7506a2d5ba25c41f04c4674fde547d2c12d489df0c11a699: Status 404 returned error can't find the container with id 7e34e39f6b5ce5be7506a2d5ba25c41f04c4674fde547d2c12d489df0c11a699
Jul 07 17:42:02.975253 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:42:02.975157    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-699db"
Jul 07 17:42:03.016974 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:42:03.016872    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-c8f6776f7-v4fjv" event={"ID":"16f0c9e3-ea28-4b17-970d-aea17a6d1f56","Type":"ContainerStarted","Data":"7e34e39f6b5ce5be7506a2d5ba25c41f04c4674fde547d2c12d489df0c11a699"}
Jul 07 17:42:03.020007 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:42:03.019613    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-jrgqd" event={"ID":"ea719737-17e4-4de5-866a-f0283465c1d0","Type":"ContainerStarted","Data":"d753ebd56773d748e5009a8578e135821a1a8e58cacd77b9ad8fa01968d4d1b8"}
Jul 07 17:42:03.020007 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:42:03.019678    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-jrgqd" event={"ID":"ea719737-17e4-4de5-866a-f0283465c1d0","Type":"ContainerStarted","Data":"726483d9d80ada6c2c4d8371e2a3ea41d9785f2d28ae9b9409d674b5c66279c7"}
Jul 07 17:42:03.020007 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:42:03.019704    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-jrgqd" event={"ID":"ea719737-17e4-4de5-866a-f0283465c1d0","Type":"ContainerStarted","Data":"7d11fd3670b0bcd6cb7c68494a8baf899479bb7aab9934ee0bece2e6c5d9400d"}
Jul 07 17:42:03.021326 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:42:03.021301    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-ml5ss" event={"ID":"df0a2c16-2d6c-4677-9338-7a72057544a6","Type":"ContainerStarted","Data":"503c3b6c0ea2ab4887eb3bc7a23189ac16ee9ac6b855bb0d0bdeab55a1400aaf"}
Jul 07 17:42:03.049427 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:42:03.049345    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-jrgqd" podStartSLOduration=1.5613380079999999 podStartE2EDuration="3.049322456s" totalImagesPullingTime="1.487984448s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 17:42:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 17:42:03.047752063 +0000 UTC m=+114.198876462" watchObservedRunningTime="2026-07-07 17:42:03.049322456 +0000 UTC m=+114.200446857"
Jul 07 17:42:04.028628 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:42:04.028585    2561 generic.go:356] "Generic (PLEG): container finished" podID="df0a2c16-2d6c-4677-9338-7a72057544a6" containerID="f4b99d4fe26e64763e3e3c9e9dc677102502739cca472d7d3a2f5b6dd6b82714" exitCode=0
Jul 07 17:42:04.029579 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:42:04.029525    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-ml5ss" event={"ID":"df0a2c16-2d6c-4677-9338-7a72057544a6","Type":"ContainerDied","Data":"f4b99d4fe26e64763e3e3c9e9dc677102502739cca472d7d3a2f5b6dd6b82714"}
Jul 07 17:42:04.869854 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:42:04.869799    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-d5dcff7cf-4glsl"]
Jul 07 17:42:04.874216 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:42:04.874185    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-4glsl"
Jul 07 17:42:04.876856 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:42:04.876645    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\""
Jul 07 17:42:04.876856 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:42:04.876730    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-6pwk8\""
Jul 07 17:42:04.883880 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:42:04.883849    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-d5dcff7cf-4glsl"]
Jul 07 17:42:04.918095 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:42:04.918060    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nfjjl\" (UniqueName: \"kubernetes.io/projected/1ff7cd92-8eda-45ad-8ce7-a0f21132a220-kube-api-access-nfjjl\") pod \"monitoring-plugin-d5dcff7cf-4glsl\" (UID: \"1ff7cd92-8eda-45ad-8ce7-a0f21132a220\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-4glsl"
Jul 07 17:42:04.918245 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:42:04.918168    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/1ff7cd92-8eda-45ad-8ce7-a0f21132a220-monitoring-plugin-cert\") pod \"monitoring-plugin-d5dcff7cf-4glsl\" (UID: \"1ff7cd92-8eda-45ad-8ce7-a0f21132a220\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-4glsl"
Jul 07 17:42:05.019441 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:42:05.019411    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/1ff7cd92-8eda-45ad-8ce7-a0f21132a220-monitoring-plugin-cert\") pod \"monitoring-plugin-d5dcff7cf-4glsl\" (UID: \"1ff7cd92-8eda-45ad-8ce7-a0f21132a220\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-4glsl"
Jul 07 17:42:05.019574 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:42:05.019532    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nfjjl\" (UniqueName: \"kubernetes.io/projected/1ff7cd92-8eda-45ad-8ce7-a0f21132a220-kube-api-access-nfjjl\") pod \"monitoring-plugin-d5dcff7cf-4glsl\" (UID: \"1ff7cd92-8eda-45ad-8ce7-a0f21132a220\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-4glsl"
Jul 07 17:42:05.019636 ip-10-0-139-31 kubenswrapper[2561]: E0707 17:42:05.019603    2561 secret.go:189] Couldn't get secret openshift-monitoring/monitoring-plugin-cert: secret "monitoring-plugin-cert" not found
Jul 07 17:42:05.019687 ip-10-0-139-31 kubenswrapper[2561]: E0707 17:42:05.019677    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1ff7cd92-8eda-45ad-8ce7-a0f21132a220-monitoring-plugin-cert podName:1ff7cd92-8eda-45ad-8ce7-a0f21132a220 nodeName:}" failed. No retries permitted until 2026-07-07 17:42:05.519656038 +0000 UTC m=+116.670780419 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "monitoring-plugin-cert" (UniqueName: "kubernetes.io/secret/1ff7cd92-8eda-45ad-8ce7-a0f21132a220-monitoring-plugin-cert") pod "monitoring-plugin-d5dcff7cf-4glsl" (UID: "1ff7cd92-8eda-45ad-8ce7-a0f21132a220") : secret "monitoring-plugin-cert" not found
Jul 07 17:42:05.029804 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:42:05.029608    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nfjjl\" (UniqueName: \"kubernetes.io/projected/1ff7cd92-8eda-45ad-8ce7-a0f21132a220-kube-api-access-nfjjl\") pod \"monitoring-plugin-d5dcff7cf-4glsl\" (UID: \"1ff7cd92-8eda-45ad-8ce7-a0f21132a220\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-4glsl"
Jul 07 17:42:05.035966 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:42:05.035844    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-c8f6776f7-v4fjv" event={"ID":"16f0c9e3-ea28-4b17-970d-aea17a6d1f56","Type":"ContainerStarted","Data":"801c3907098cf4837f13f5a0d97cfcac23bd9d7c74a4580d3707b5238a86db18"}
Jul 07 17:42:05.038862 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:42:05.038791    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-ml5ss" event={"ID":"df0a2c16-2d6c-4677-9338-7a72057544a6","Type":"ContainerStarted","Data":"4ba533af0981e421894c1c3b112c22cae7a0f89a6618316a4da075baf09e76ae"}
Jul 07 17:42:05.038862 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:42:05.038849    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-ml5ss" event={"ID":"df0a2c16-2d6c-4677-9338-7a72057544a6","Type":"ContainerStarted","Data":"ba62af2fe149203c170542946969c4d5ec2b7c3279723f6a18cda20166e085c4"}
Jul 07 17:42:05.524623 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:42:05.524534    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/1ff7cd92-8eda-45ad-8ce7-a0f21132a220-monitoring-plugin-cert\") pod \"monitoring-plugin-d5dcff7cf-4glsl\" (UID: \"1ff7cd92-8eda-45ad-8ce7-a0f21132a220\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-4glsl"
Jul 07 17:42:05.524792 ip-10-0-139-31 kubenswrapper[2561]: E0707 17:42:05.524682    2561 secret.go:189] Couldn't get secret openshift-monitoring/monitoring-plugin-cert: secret "monitoring-plugin-cert" not found
Jul 07 17:42:05.524792 ip-10-0-139-31 kubenswrapper[2561]: E0707 17:42:05.524752    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1ff7cd92-8eda-45ad-8ce7-a0f21132a220-monitoring-plugin-cert podName:1ff7cd92-8eda-45ad-8ce7-a0f21132a220 nodeName:}" failed. No retries permitted until 2026-07-07 17:42:06.524732535 +0000 UTC m=+117.675856911 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "monitoring-plugin-cert" (UniqueName: "kubernetes.io/secret/1ff7cd92-8eda-45ad-8ce7-a0f21132a220-monitoring-plugin-cert") pod "monitoring-plugin-d5dcff7cf-4glsl" (UID: "1ff7cd92-8eda-45ad-8ce7-a0f21132a220") : secret "monitoring-plugin-cert" not found
Jul 07 17:42:06.045890 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:42:06.045854    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-c8f6776f7-v4fjv" event={"ID":"16f0c9e3-ea28-4b17-970d-aea17a6d1f56","Type":"ContainerStarted","Data":"c488fed30e96cca9acbf0cde6b671bf6cdf68eb0385795995ff94ac84cdd9ccc"}
Jul 07 17:42:06.046250 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:42:06.045945    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-c8f6776f7-v4fjv" event={"ID":"16f0c9e3-ea28-4b17-970d-aea17a6d1f56","Type":"ContainerStarted","Data":"a8eaa388f247421e7b2dd0ffa2bc4b5fcf3c62e30c78e3f900c3a2ed7ab1ab2e"}
Jul 07 17:42:06.458036 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:42:06.457975    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-ml5ss" podStartSLOduration=5.242078045 podStartE2EDuration="6.457954695s" totalImagesPullingTime="1.139291412s" totalInitContainerRuntime="76.585238ms" isStatefulPod=true podCreationTimestamp="2026-07-07 17:42:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 17:42:05.067616505 +0000 UTC m=+116.218740904" watchObservedRunningTime="2026-07-07 17:42:06.457954695 +0000 UTC m=+117.609079111"
Jul 07 17:42:06.458266 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:42:06.458245    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 07 17:42:06.462123 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:42:06.462093    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 17:42:06.465867 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:42:06.465844    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
Jul 07 17:42:06.466003 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:42:06.465850    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
Jul 07 17:42:06.466095 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:42:06.466076    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
Jul 07 17:42:06.466213 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:42:06.466192    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-6bve8g1l5vfrc\""
Jul 07 17:42:06.466271 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:42:06.466256    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
Jul 07 17:42:06.466562 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:42:06.466546    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
Jul 07 17:42:06.470847 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:42:06.470825    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
Jul 07 17:42:06.471006 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:42:06.470987    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\""
Jul 07 17:42:06.471067 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:42:06.471049    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\""
Jul 07 17:42:06.478268 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:42:06.478243    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
Jul 07 17:42:06.478404 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:42:06.478251    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
Jul 07 17:42:06.479132 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:42:06.479115    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
Jul 07 17:42:06.491768 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:42:06.491732    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
Jul 07 17:42:06.492094 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:42:06.492067    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
Jul 07 17:42:06.492187 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:42:06.492168    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-7qw74\""
Jul 07 17:42:06.493654 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:42:06.493627    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Jul 07 17:42:06.500918 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:42:06.500890    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
Jul 07 17:42:06.535966 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:42:06.535932    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/a4e665e6-ee8a-4f4d-b733-9db5a754ff3f-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"a4e665e6-ee8a-4f4d-b733-9db5a754ff3f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 17:42:06.535966 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:42:06.535969    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a4e665e6-ee8a-4f4d-b733-9db5a754ff3f-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a4e665e6-ee8a-4f4d-b733-9db5a754ff3f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 17:42:06.536203 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:42:06.536000    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a4e665e6-ee8a-4f4d-b733-9db5a754ff3f-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a4e665e6-ee8a-4f4d-b733-9db5a754ff3f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 17:42:06.536203 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:42:06.536073    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/a4e665e6-ee8a-4f4d-b733-9db5a754ff3f-web-config\") pod \"prometheus-k8s-0\" (UID: \"a4e665e6-ee8a-4f4d-b733-9db5a754ff3f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 17:42:06.536203 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:42:06.536126    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/a4e665e6-ee8a-4f4d-b733-9db5a754ff3f-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"a4e665e6-ee8a-4f4d-b733-9db5a754ff3f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 17:42:06.536203 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:42:06.536146    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n7cgn\" (UniqueName: \"kubernetes.io/projected/a4e665e6-ee8a-4f4d-b733-9db5a754ff3f-kube-api-access-n7cgn\") pod \"prometheus-k8s-0\" (UID: \"a4e665e6-ee8a-4f4d-b733-9db5a754ff3f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 17:42:06.536203 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:42:06.536173    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/1ff7cd92-8eda-45ad-8ce7-a0f21132a220-monitoring-plugin-cert\") pod \"monitoring-plugin-d5dcff7cf-4glsl\" (UID: \"1ff7cd92-8eda-45ad-8ce7-a0f21132a220\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-4glsl"
Jul 07 17:42:06.536416 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:42:06.536236    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/a4e665e6-ee8a-4f4d-b733-9db5a754ff3f-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"a4e665e6-ee8a-4f4d-b733-9db5a754ff3f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 17:42:06.536416 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:42:06.536270    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/a4e665e6-ee8a-4f4d-b733-9db5a754ff3f-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"a4e665e6-ee8a-4f4d-b733-9db5a754ff3f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 17:42:06.536416 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:42:06.536292    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/a4e665e6-ee8a-4f4d-b733-9db5a754ff3f-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"a4e665e6-ee8a-4f4d-b733-9db5a754ff3f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 17:42:06.536416 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:42:06.536306    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/a4e665e6-ee8a-4f4d-b733-9db5a754ff3f-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"a4e665e6-ee8a-4f4d-b733-9db5a754ff3f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 17:42:06.536416 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:42:06.536324    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a4e665e6-ee8a-4f4d-b733-9db5a754ff3f-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"a4e665e6-ee8a-4f4d-b733-9db5a754ff3f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 17:42:06.536416 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:42:06.536347    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/a4e665e6-ee8a-4f4d-b733-9db5a754ff3f-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"a4e665e6-ee8a-4f4d-b733-9db5a754ff3f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 17:42:06.536416 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:42:06.536391    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/a4e665e6-ee8a-4f4d-b733-9db5a754ff3f-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"a4e665e6-ee8a-4f4d-b733-9db5a754ff3f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 17:42:06.536732 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:42:06.536424    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/a4e665e6-ee8a-4f4d-b733-9db5a754ff3f-config\") pod \"prometheus-k8s-0\" (UID: \"a4e665e6-ee8a-4f4d-b733-9db5a754ff3f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 17:42:06.536732 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:42:06.536473    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a4e665e6-ee8a-4f4d-b733-9db5a754ff3f-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"a4e665e6-ee8a-4f4d-b733-9db5a754ff3f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 17:42:06.536732 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:42:06.536507    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a4e665e6-ee8a-4f4d-b733-9db5a754ff3f-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a4e665e6-ee8a-4f4d-b733-9db5a754ff3f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 17:42:06.536732 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:42:06.536615    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a4e665e6-ee8a-4f4d-b733-9db5a754ff3f-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"a4e665e6-ee8a-4f4d-b733-9db5a754ff3f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 17:42:06.536732 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:42:06.536647    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/a4e665e6-ee8a-4f4d-b733-9db5a754ff3f-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"a4e665e6-ee8a-4f4d-b733-9db5a754ff3f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 17:42:06.536732 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:42:06.536684    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/a4e665e6-ee8a-4f4d-b733-9db5a754ff3f-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"a4e665e6-ee8a-4f4d-b733-9db5a754ff3f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 17:42:06.536732 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:42:06.536706    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/a4e665e6-ee8a-4f4d-b733-9db5a754ff3f-config-out\") pod \"prometheus-k8s-0\" (UID: \"a4e665e6-ee8a-4f4d-b733-9db5a754ff3f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 17:42:06.538749 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:42:06.538720    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/1ff7cd92-8eda-45ad-8ce7-a0f21132a220-monitoring-plugin-cert\") pod \"monitoring-plugin-d5dcff7cf-4glsl\" (UID: \"1ff7cd92-8eda-45ad-8ce7-a0f21132a220\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-4glsl"
Jul 07 17:42:06.544487 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:42:06.544438    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 07 17:42:06.637817 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:42:06.637780    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/a4e665e6-ee8a-4f4d-b733-9db5a754ff3f-config\") pod \"prometheus-k8s-0\" (UID: \"a4e665e6-ee8a-4f4d-b733-9db5a754ff3f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 17:42:06.637817 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:42:06.637816    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a4e665e6-ee8a-4f4d-b733-9db5a754ff3f-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"a4e665e6-ee8a-4f4d-b733-9db5a754ff3f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 17:42:06.638044 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:42:06.637840    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a4e665e6-ee8a-4f4d-b733-9db5a754ff3f-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a4e665e6-ee8a-4f4d-b733-9db5a754ff3f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 17:42:06.638044 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:42:06.637967    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a4e665e6-ee8a-4f4d-b733-9db5a754ff3f-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"a4e665e6-ee8a-4f4d-b733-9db5a754ff3f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 17:42:06.638044 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:42:06.638010    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/a4e665e6-ee8a-4f4d-b733-9db5a754ff3f-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"a4e665e6-ee8a-4f4d-b733-9db5a754ff3f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 17:42:06.638182 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:42:06.638049    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/a4e665e6-ee8a-4f4d-b733-9db5a754ff3f-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"a4e665e6-ee8a-4f4d-b733-9db5a754ff3f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 17:42:06.638182 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:42:06.638077    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/a4e665e6-ee8a-4f4d-b733-9db5a754ff3f-config-out\") pod \"prometheus-k8s-0\" (UID: \"a4e665e6-ee8a-4f4d-b733-9db5a754ff3f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 17:42:06.638304 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:42:06.638282    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/a4e665e6-ee8a-4f4d-b733-9db5a754ff3f-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"a4e665e6-ee8a-4f4d-b733-9db5a754ff3f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 17:42:06.638365 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:42:06.638314    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a4e665e6-ee8a-4f4d-b733-9db5a754ff3f-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a4e665e6-ee8a-4f4d-b733-9db5a754ff3f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 17:42:06.638416 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:42:06.638367    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a4e665e6-ee8a-4f4d-b733-9db5a754ff3f-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a4e665e6-ee8a-4f4d-b733-9db5a754ff3f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 17:42:06.638416 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:42:06.638392    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/a4e665e6-ee8a-4f4d-b733-9db5a754ff3f-web-config\") pod \"prometheus-k8s-0\" (UID: \"a4e665e6-ee8a-4f4d-b733-9db5a754ff3f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 17:42:06.638563 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:42:06.638428    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/a4e665e6-ee8a-4f4d-b733-9db5a754ff3f-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"a4e665e6-ee8a-4f4d-b733-9db5a754ff3f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 17:42:06.638563 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:42:06.638473    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n7cgn\" (UniqueName: \"kubernetes.io/projected/a4e665e6-ee8a-4f4d-b733-9db5a754ff3f-kube-api-access-n7cgn\") pod \"prometheus-k8s-0\" (UID: \"a4e665e6-ee8a-4f4d-b733-9db5a754ff3f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 17:42:06.638563 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:42:06.638541    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/a4e665e6-ee8a-4f4d-b733-9db5a754ff3f-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"a4e665e6-ee8a-4f4d-b733-9db5a754ff3f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 17:42:06.638715 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:42:06.638576    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/a4e665e6-ee8a-4f4d-b733-9db5a754ff3f-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"a4e665e6-ee8a-4f4d-b733-9db5a754ff3f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 17:42:06.638715 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:42:06.638601    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/a4e665e6-ee8a-4f4d-b733-9db5a754ff3f-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"a4e665e6-ee8a-4f4d-b733-9db5a754ff3f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 17:42:06.638715 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:42:06.638628    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/a4e665e6-ee8a-4f4d-b733-9db5a754ff3f-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"a4e665e6-ee8a-4f4d-b733-9db5a754ff3f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 17:42:06.638715 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:42:06.638658    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a4e665e6-ee8a-4f4d-b733-9db5a754ff3f-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"a4e665e6-ee8a-4f4d-b733-9db5a754ff3f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 17:42:06.638715 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:42:06.638675    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/a4e665e6-ee8a-4f4d-b733-9db5a754ff3f-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"a4e665e6-ee8a-4f4d-b733-9db5a754ff3f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 17:42:06.638715 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:42:06.638692    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/a4e665e6-ee8a-4f4d-b733-9db5a754ff3f-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"a4e665e6-ee8a-4f4d-b733-9db5a754ff3f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 17:42:06.639001 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:42:06.638726    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a4e665e6-ee8a-4f4d-b733-9db5a754ff3f-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"a4e665e6-ee8a-4f4d-b733-9db5a754ff3f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 17:42:06.639001 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:42:06.638737    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/a4e665e6-ee8a-4f4d-b733-9db5a754ff3f-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"a4e665e6-ee8a-4f4d-b733-9db5a754ff3f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 17:42:06.639245 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:42:06.639220    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a4e665e6-ee8a-4f4d-b733-9db5a754ff3f-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a4e665e6-ee8a-4f4d-b733-9db5a754ff3f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 17:42:06.639394 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:42:06.639372    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a4e665e6-ee8a-4f4d-b733-9db5a754ff3f-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a4e665e6-ee8a-4f4d-b733-9db5a754ff3f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 17:42:06.639803 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:42:06.639674    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/a4e665e6-ee8a-4f4d-b733-9db5a754ff3f-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"a4e665e6-ee8a-4f4d-b733-9db5a754ff3f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 17:42:06.640394 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:42:06.640371    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/a4e665e6-ee8a-4f4d-b733-9db5a754ff3f-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"a4e665e6-ee8a-4f4d-b733-9db5a754ff3f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 17:42:06.642354 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:42:06.642293    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a4e665e6-ee8a-4f4d-b733-9db5a754ff3f-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a4e665e6-ee8a-4f4d-b733-9db5a754ff3f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 17:42:06.642471 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:42:06.642436    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/a4e665e6-ee8a-4f4d-b733-9db5a754ff3f-web-config\") pod \"prometheus-k8s-0\" (UID: \"a4e665e6-ee8a-4f4d-b733-9db5a754ff3f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 17:42:06.642720 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:42:06.642689    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/a4e665e6-ee8a-4f4d-b733-9db5a754ff3f-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"a4e665e6-ee8a-4f4d-b733-9db5a754ff3f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 17:42:06.643228 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:42:06.643169    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/a4e665e6-ee8a-4f4d-b733-9db5a754ff3f-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"a4e665e6-ee8a-4f4d-b733-9db5a754ff3f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 17:42:06.643513 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:42:06.643488    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/a4e665e6-ee8a-4f4d-b733-9db5a754ff3f-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"a4e665e6-ee8a-4f4d-b733-9db5a754ff3f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 17:42:06.643617 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:42:06.643493    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a4e665e6-ee8a-4f4d-b733-9db5a754ff3f-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"a4e665e6-ee8a-4f4d-b733-9db5a754ff3f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 17:42:06.643743 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:42:06.643724    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/a4e665e6-ee8a-4f4d-b733-9db5a754ff3f-config\") pod \"prometheus-k8s-0\" (UID: \"a4e665e6-ee8a-4f4d-b733-9db5a754ff3f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 17:42:06.643896 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:42:06.643849    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/a4e665e6-ee8a-4f4d-b733-9db5a754ff3f-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"a4e665e6-ee8a-4f4d-b733-9db5a754ff3f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 17:42:06.643896 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:42:06.643881    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/a4e665e6-ee8a-4f4d-b733-9db5a754ff3f-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"a4e665e6-ee8a-4f4d-b733-9db5a754ff3f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 17:42:06.644040 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:42:06.643950    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/a4e665e6-ee8a-4f4d-b733-9db5a754ff3f-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"a4e665e6-ee8a-4f4d-b733-9db5a754ff3f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 17:42:06.644040 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:42:06.644022    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/a4e665e6-ee8a-4f4d-b733-9db5a754ff3f-config-out\") pod \"prometheus-k8s-0\" (UID: \"a4e665e6-ee8a-4f4d-b733-9db5a754ff3f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 17:42:06.644492 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:42:06.644472    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/a4e665e6-ee8a-4f4d-b733-9db5a754ff3f-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"a4e665e6-ee8a-4f4d-b733-9db5a754ff3f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 17:42:06.644783 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:42:06.644766    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a4e665e6-ee8a-4f4d-b733-9db5a754ff3f-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"a4e665e6-ee8a-4f4d-b733-9db5a754ff3f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 17:42:06.661302 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:42:06.661241    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n7cgn\" (UniqueName: \"kubernetes.io/projected/a4e665e6-ee8a-4f4d-b733-9db5a754ff3f-kube-api-access-n7cgn\") pod \"prometheus-k8s-0\" (UID: \"a4e665e6-ee8a-4f4d-b733-9db5a754ff3f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 17:42:06.686996 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:42:06.686957    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-4glsl"
Jul 07 17:42:06.774486 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:42:06.774339    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 17:42:06.862031 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:42:06.861983    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-d5dcff7cf-4glsl"]
Jul 07 17:42:06.863965 ip-10-0-139-31 kubenswrapper[2561]: W0707 17:42:06.863934    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1ff7cd92_8eda_45ad_8ce7_a0f21132a220.slice/crio-f6fb0db5091b07c14a03fdb5c4b934ec9584e77da5f236a86715b9586b72aca1 WatchSource:0}: Error finding container f6fb0db5091b07c14a03fdb5c4b934ec9584e77da5f236a86715b9586b72aca1: Status 404 returned error can't find the container with id f6fb0db5091b07c14a03fdb5c4b934ec9584e77da5f236a86715b9586b72aca1
Jul 07 17:42:06.958368 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:42:06.958245    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 07 17:42:07.057793 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:42:07.057754    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-c8f6776f7-v4fjv" event={"ID":"16f0c9e3-ea28-4b17-970d-aea17a6d1f56","Type":"ContainerStarted","Data":"6cc37f5d615c8f7238e21f55b361d48320c06994a92eefaa0f87e52e70f1183f"}
Jul 07 17:42:07.058268 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:42:07.057864    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-c8f6776f7-v4fjv" event={"ID":"16f0c9e3-ea28-4b17-970d-aea17a6d1f56","Type":"ContainerStarted","Data":"79cf9c9af8b05f842e3fba5cae555ea436c38433d8d6f4d072fb83ddb93e62ba"}
Jul 07 17:42:07.058268 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:42:07.057907    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-c8f6776f7-v4fjv" event={"ID":"16f0c9e3-ea28-4b17-970d-aea17a6d1f56","Type":"ContainerStarted","Data":"34c011e599304a34cabd2e1842efe5de599ca708c499a5c0cf48e5d8f3768c33"}
Jul 07 17:42:07.058268 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:42:07.057948    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-c8f6776f7-v4fjv"
Jul 07 17:42:07.059161 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:42:07.059132    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a4e665e6-ee8a-4f4d-b733-9db5a754ff3f","Type":"ContainerStarted","Data":"7031a2df20f023e8fa92afe03984e7b6ec5a99535501f5cffa526209ef77b428"}
Jul 07 17:42:07.060315 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:42:07.060284    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-4glsl" event={"ID":"1ff7cd92-8eda-45ad-8ce7-a0f21132a220","Type":"ContainerStarted","Data":"f6fb0db5091b07c14a03fdb5c4b934ec9584e77da5f236a86715b9586b72aca1"}
Jul 07 17:42:07.102947 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:42:07.102865    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-c8f6776f7-v4fjv" podStartSLOduration=2.012184169 podStartE2EDuration="5.102842684s" totalImagesPullingTime="3.090658515s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 17:42:02 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 17:42:07.100240745 +0000 UTC m=+118.251365154" watchObservedRunningTime="2026-07-07 17:42:07.102842684 +0000 UTC m=+118.253967083"
Jul 07 17:42:10.954287 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:42:10.954256    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-7ff58857cc-rmtgp"
Jul 07 17:42:12.837198 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:42:12.837161    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-7ff58857cc-rmtgp"]
Jul 07 17:42:13.074109 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:42:13.074081    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-c8f6776f7-v4fjv"
Jul 07 17:42:16.102124 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:42:16.102048    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-685bfb5f64-d4cpl" event={"ID":"4822b40c-4869-4df7-856d-bd6958e729a4","Type":"ContainerStarted","Data":"a52ab66421ee7cecd364b417e6eb8fd0ae04681203ec162fe5328b38ed940872"}
Jul 07 17:42:16.102918 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:42:16.102825    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-685bfb5f64-d4cpl"
Jul 07 17:42:16.121197 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:42:16.121164    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-685bfb5f64-d4cpl"
Jul 07 17:42:16.129775 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:42:16.129709    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-685bfb5f64-d4cpl" podStartSLOduration=1.700583754 podStartE2EDuration="25.129685856s" totalImagesPullingTime="23.429102102s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 17:41:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 17:42:16.127064812 +0000 UTC m=+127.278189211" watchObservedRunningTime="2026-07-07 17:42:16.129685856 +0000 UTC m=+127.280810256"
Jul 07 17:42:17.109065 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:42:17.109024    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a4e665e6-ee8a-4f4d-b733-9db5a754ff3f","Type":"ContainerStarted","Data":"6cd3ac82b3eb52ce0b744a86d78480d4ad2f2f5a83eab4f221ab5ca63d8e7eed"}
Jul 07 17:42:17.110889 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:42:17.110859    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-4glsl" event={"ID":"1ff7cd92-8eda-45ad-8ce7-a0f21132a220","Type":"ContainerStarted","Data":"50071d84999cf951841577b47a49fd3a5af1a30e1051c613f2fcc9c3e738ef94"}
Jul 07 17:42:17.111147 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:42:17.111130    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-4glsl"
Jul 07 17:42:17.117026 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:42:17.117002    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-4glsl"
Jul 07 17:42:17.172079 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:42:17.171980    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-4glsl" podStartSLOduration=3.088597639 podStartE2EDuration="13.171957044s" totalImagesPullingTime="10.083359405s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 17:42:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 17:42:17.170725665 +0000 UTC m=+128.321850062" watchObservedRunningTime="2026-07-07 17:42:17.171957044 +0000 UTC m=+128.323081444"
Jul 07 17:42:18.116874 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:42:18.116835    2561 generic.go:356] "Generic (PLEG): container finished" podID="a4e665e6-ee8a-4f4d-b733-9db5a754ff3f" containerID="6cd3ac82b3eb52ce0b744a86d78480d4ad2f2f5a83eab4f221ab5ca63d8e7eed" exitCode=0
Jul 07 17:42:18.117350 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:42:18.116928    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a4e665e6-ee8a-4f4d-b733-9db5a754ff3f","Type":"ContainerDied","Data":"6cd3ac82b3eb52ce0b744a86d78480d4ad2f2f5a83eab4f221ab5ca63d8e7eed"}
Jul 07 17:42:19.278037 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:42:19.277899    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9d99e831-14fe-4b13-9a8b-3d9ca165c60e-metrics-certs\") pod \"network-metrics-daemon-pkn6n\" (UID: \"9d99e831-14fe-4b13-9a8b-3d9ca165c60e\") " pod="openshift-multus/network-metrics-daemon-pkn6n"
Jul 07 17:42:19.281064 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:42:19.281017    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9d99e831-14fe-4b13-9a8b-3d9ca165c60e-metrics-certs\") pod \"network-metrics-daemon-pkn6n\" (UID: \"9d99e831-14fe-4b13-9a8b-3d9ca165c60e\") " pod="openshift-multus/network-metrics-daemon-pkn6n"
Jul 07 17:42:19.439729 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:42:19.439693    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-92crh\""
Jul 07 17:42:19.448000 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:42:19.447965    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pkn6n"
Jul 07 17:42:19.649302 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:42:19.649150    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-pkn6n"]
Jul 07 17:42:19.653144 ip-10-0-139-31 kubenswrapper[2561]: W0707 17:42:19.653099    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9d99e831_14fe_4b13_9a8b_3d9ca165c60e.slice/crio-44b8a82e09d93ca374aa2dad3c48223c65087748d97acbb1a5e7cbf9f96f8b3f WatchSource:0}: Error finding container 44b8a82e09d93ca374aa2dad3c48223c65087748d97acbb1a5e7cbf9f96f8b3f: Status 404 returned error can't find the container with id 44b8a82e09d93ca374aa2dad3c48223c65087748d97acbb1a5e7cbf9f96f8b3f
Jul 07 17:42:20.129585 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:42:20.129503    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-pkn6n" event={"ID":"9d99e831-14fe-4b13-9a8b-3d9ca165c60e","Type":"ContainerStarted","Data":"44b8a82e09d93ca374aa2dad3c48223c65087748d97acbb1a5e7cbf9f96f8b3f"}
Jul 07 17:42:23.151711 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:42:23.151391    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-pkn6n" event={"ID":"9d99e831-14fe-4b13-9a8b-3d9ca165c60e","Type":"ContainerStarted","Data":"fee241b029c41c9734eb5307cbfd271691a16b54516455ddbe633c26974d0691"}
Jul 07 17:42:23.151711 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:42:23.151493    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-pkn6n" event={"ID":"9d99e831-14fe-4b13-9a8b-3d9ca165c60e","Type":"ContainerStarted","Data":"15a6cf28f399aac80e9cf296cd6b00ea4ca4e6695e9e92ba09be956ce75b4725"}
Jul 07 17:42:23.155222 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:42:23.154429    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a4e665e6-ee8a-4f4d-b733-9db5a754ff3f","Type":"ContainerStarted","Data":"9e33d3586f20dce7567e138da47ec281328b73e64d5d5bcd5fafa5ed76286a1c"}
Jul 07 17:42:23.155222 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:42:23.154545    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a4e665e6-ee8a-4f4d-b733-9db5a754ff3f","Type":"ContainerStarted","Data":"d87b55671c8630007e9a1a02992410ebd4b38e2dc1dce1a6dd3747a117b1dbd5"}
Jul 07 17:42:23.184576 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:42:23.184212    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-pkn6n" podStartSLOduration=131.076062037 podStartE2EDuration="2m14.184187225s" totalImagesPullingTime="3.108125188s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 17:40:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 17:42:23.182808584 +0000 UTC m=+134.333932995" watchObservedRunningTime="2026-07-07 17:42:23.184187225 +0000 UTC m=+134.335311624"
Jul 07 17:42:24.163563 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:42:24.163520    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a4e665e6-ee8a-4f4d-b733-9db5a754ff3f","Type":"ContainerStarted","Data":"269af484b34a986e8ca63c932d2a2fba831cc25c4f1a1b86514cfa87a4cd8b0d"}
Jul 07 17:42:24.164035 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:42:24.163597    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a4e665e6-ee8a-4f4d-b733-9db5a754ff3f","Type":"ContainerStarted","Data":"aa2326f1ca1106a943bb2aebf06abdfa724fb3c3c5792a2e074aaa0d0bda1b47"}
Jul 07 17:42:24.164035 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:42:24.163628    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a4e665e6-ee8a-4f4d-b733-9db5a754ff3f","Type":"ContainerStarted","Data":"69d7aa31523b1a5d3cb0a6fbb19fc4f5f02e1dbd3a9735ce1b60ea46936ac694"}
Jul 07 17:42:24.164035 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:42:24.163668    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a4e665e6-ee8a-4f4d-b733-9db5a754ff3f","Type":"ContainerStarted","Data":"b01477e5894988ac7ad883f6eadb3149a02a593c86daf214e25cd07f0a4eaa57"}
Jul 07 17:42:24.197251 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:42:24.197175    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=3.5501956999999997 podStartE2EDuration="18.197150709s" totalImagesPullingTime="14.62118276s" totalInitContainerRuntime="25.772249ms" isStatefulPod=false podCreationTimestamp="2026-07-07 17:42:06 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 17:42:24.194945216 +0000 UTC m=+135.346069820" watchObservedRunningTime="2026-07-07 17:42:24.197150709 +0000 UTC m=+135.348275134"
Jul 07 17:42:26.774808 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:42:26.774766    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 17:42:37.867229 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:42:37.867158    2561 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-image-registry/image-registry-7ff58857cc-rmtgp" podUID="41ffd3cf-e077-4933-af1c-24ae8b0d5704" containerName="registry" containerID="cri-o://16ca79556ab87f6e2e94ba4f333e73258a620be3770feada9100dc3831078fbd" gracePeriod=30
Jul 07 17:42:38.144904 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:42:38.144871    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7ff58857cc-rmtgp"
Jul 07 17:42:38.220314 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:42:38.220277    2561 generic.go:356] "Generic (PLEG): container finished" podID="41ffd3cf-e077-4933-af1c-24ae8b0d5704" containerID="16ca79556ab87f6e2e94ba4f333e73258a620be3770feada9100dc3831078fbd" exitCode=0
Jul 07 17:42:38.220576 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:42:38.220344    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7ff58857cc-rmtgp"
Jul 07 17:42:38.220576 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:42:38.220362    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7ff58857cc-rmtgp" event={"ID":"41ffd3cf-e077-4933-af1c-24ae8b0d5704","Type":"ContainerDied","Data":"16ca79556ab87f6e2e94ba4f333e73258a620be3770feada9100dc3831078fbd"}
Jul 07 17:42:38.220576 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:42:38.220456    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7ff58857cc-rmtgp" event={"ID":"41ffd3cf-e077-4933-af1c-24ae8b0d5704","Type":"ContainerDied","Data":"b5456d9a0a028492340f01c53fbd7db20ca01e0401786ee5889f471b6b5098c0"}
Jul 07 17:42:38.220576 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:42:38.220483    2561 scope.go:117] "RemoveContainer" containerID="16ca79556ab87f6e2e94ba4f333e73258a620be3770feada9100dc3831078fbd"
Jul 07 17:42:38.229163 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:42:38.229141    2561 scope.go:117] "RemoveContainer" containerID="16ca79556ab87f6e2e94ba4f333e73258a620be3770feada9100dc3831078fbd"
Jul 07 17:42:38.229488 ip-10-0-139-31 kubenswrapper[2561]: E0707 17:42:38.229467    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"16ca79556ab87f6e2e94ba4f333e73258a620be3770feada9100dc3831078fbd\": container with ID starting with 16ca79556ab87f6e2e94ba4f333e73258a620be3770feada9100dc3831078fbd not found: ID does not exist" containerID="16ca79556ab87f6e2e94ba4f333e73258a620be3770feada9100dc3831078fbd"
Jul 07 17:42:38.229543 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:42:38.229499    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"16ca79556ab87f6e2e94ba4f333e73258a620be3770feada9100dc3831078fbd"} err="failed to get container status \"16ca79556ab87f6e2e94ba4f333e73258a620be3770feada9100dc3831078fbd\": rpc error: code = NotFound desc = could not find container \"16ca79556ab87f6e2e94ba4f333e73258a620be3770feada9100dc3831078fbd\": container with ID starting with 16ca79556ab87f6e2e94ba4f333e73258a620be3770feada9100dc3831078fbd not found: ID does not exist"
Jul 07 17:42:38.236774 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:42:38.236754    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/41ffd3cf-e077-4933-af1c-24ae8b0d5704-bound-sa-token\") pod \"41ffd3cf-e077-4933-af1c-24ae8b0d5704\" (UID: \"41ffd3cf-e077-4933-af1c-24ae8b0d5704\") "
Jul 07 17:42:38.236852 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:42:38.236781    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/41ffd3cf-e077-4933-af1c-24ae8b0d5704-registry-tls\") pod \"41ffd3cf-e077-4933-af1c-24ae8b0d5704\" (UID: \"41ffd3cf-e077-4933-af1c-24ae8b0d5704\") "
Jul 07 17:42:38.236852 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:42:38.236817    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/41ffd3cf-e077-4933-af1c-24ae8b0d5704-installation-pull-secrets\") pod \"41ffd3cf-e077-4933-af1c-24ae8b0d5704\" (UID: \"41ffd3cf-e077-4933-af1c-24ae8b0d5704\") "
Jul 07 17:42:38.236852 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:42:38.236846    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/41ffd3cf-e077-4933-af1c-24ae8b0d5704-image-registry-private-configuration\") pod \"41ffd3cf-e077-4933-af1c-24ae8b0d5704\" (UID: \"41ffd3cf-e077-4933-af1c-24ae8b0d5704\") "
Jul 07 17:42:38.236949 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:42:38.236865    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/41ffd3cf-e077-4933-af1c-24ae8b0d5704-trusted-ca\") pod \"41ffd3cf-e077-4933-af1c-24ae8b0d5704\" (UID: \"41ffd3cf-e077-4933-af1c-24ae8b0d5704\") "
Jul 07 17:42:38.236949 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:42:38.236893    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/41ffd3cf-e077-4933-af1c-24ae8b0d5704-registry-certificates\") pod \"41ffd3cf-e077-4933-af1c-24ae8b0d5704\" (UID: \"41ffd3cf-e077-4933-af1c-24ae8b0d5704\") "
Jul 07 17:42:38.236949 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:42:38.236915    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qmr7h\" (UniqueName: \"kubernetes.io/projected/41ffd3cf-e077-4933-af1c-24ae8b0d5704-kube-api-access-qmr7h\") pod \"41ffd3cf-e077-4933-af1c-24ae8b0d5704\" (UID: \"41ffd3cf-e077-4933-af1c-24ae8b0d5704\") "
Jul 07 17:42:38.237100 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:42:38.237079    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/41ffd3cf-e077-4933-af1c-24ae8b0d5704-ca-trust-extracted\") pod \"41ffd3cf-e077-4933-af1c-24ae8b0d5704\" (UID: \"41ffd3cf-e077-4933-af1c-24ae8b0d5704\") "
Jul 07 17:42:38.237432 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:42:38.237403    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/41ffd3cf-e077-4933-af1c-24ae8b0d5704-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "41ffd3cf-e077-4933-af1c-24ae8b0d5704" (UID: "41ffd3cf-e077-4933-af1c-24ae8b0d5704"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 17:42:38.237671 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:42:38.237604    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/41ffd3cf-e077-4933-af1c-24ae8b0d5704-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "41ffd3cf-e077-4933-af1c-24ae8b0d5704" (UID: "41ffd3cf-e077-4933-af1c-24ae8b0d5704"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 17:42:38.239217 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:42:38.239166    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/41ffd3cf-e077-4933-af1c-24ae8b0d5704-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "41ffd3cf-e077-4933-af1c-24ae8b0d5704" (UID: "41ffd3cf-e077-4933-af1c-24ae8b0d5704"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 17:42:38.239569 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:42:38.239539    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/41ffd3cf-e077-4933-af1c-24ae8b0d5704-kube-api-access-qmr7h" (OuterVolumeSpecName: "kube-api-access-qmr7h") pod "41ffd3cf-e077-4933-af1c-24ae8b0d5704" (UID: "41ffd3cf-e077-4933-af1c-24ae8b0d5704"). InnerVolumeSpecName "kube-api-access-qmr7h". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 17:42:38.239659 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:42:38.239617    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/41ffd3cf-e077-4933-af1c-24ae8b0d5704-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "41ffd3cf-e077-4933-af1c-24ae8b0d5704" (UID: "41ffd3cf-e077-4933-af1c-24ae8b0d5704"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 17:42:38.239721 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:42:38.239646    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/41ffd3cf-e077-4933-af1c-24ae8b0d5704-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "41ffd3cf-e077-4933-af1c-24ae8b0d5704" (UID: "41ffd3cf-e077-4933-af1c-24ae8b0d5704"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 17:42:38.239721 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:42:38.239682    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/41ffd3cf-e077-4933-af1c-24ae8b0d5704-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "41ffd3cf-e077-4933-af1c-24ae8b0d5704" (UID: "41ffd3cf-e077-4933-af1c-24ae8b0d5704"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 17:42:38.246264 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:42:38.246237    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/41ffd3cf-e077-4933-af1c-24ae8b0d5704-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "41ffd3cf-e077-4933-af1c-24ae8b0d5704" (UID: "41ffd3cf-e077-4933-af1c-24ae8b0d5704"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 17:42:38.337997 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:42:38.337964    2561 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/41ffd3cf-e077-4933-af1c-24ae8b0d5704-ca-trust-extracted\") on node \"ip-10-0-139-31.ec2.internal\" DevicePath \"\""
Jul 07 17:42:38.337997 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:42:38.337994    2561 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/41ffd3cf-e077-4933-af1c-24ae8b0d5704-bound-sa-token\") on node \"ip-10-0-139-31.ec2.internal\" DevicePath \"\""
Jul 07 17:42:38.337997 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:42:38.338004    2561 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/41ffd3cf-e077-4933-af1c-24ae8b0d5704-registry-tls\") on node \"ip-10-0-139-31.ec2.internal\" DevicePath \"\""
Jul 07 17:42:38.338242 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:42:38.338012    2561 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/41ffd3cf-e077-4933-af1c-24ae8b0d5704-installation-pull-secrets\") on node \"ip-10-0-139-31.ec2.internal\" DevicePath \"\""
Jul 07 17:42:38.338242 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:42:38.338025    2561 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/41ffd3cf-e077-4933-af1c-24ae8b0d5704-image-registry-private-configuration\") on node \"ip-10-0-139-31.ec2.internal\" DevicePath \"\""
Jul 07 17:42:38.338242 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:42:38.338035    2561 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/41ffd3cf-e077-4933-af1c-24ae8b0d5704-trusted-ca\") on node \"ip-10-0-139-31.ec2.internal\" DevicePath \"\""
Jul 07 17:42:38.338242 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:42:38.338043    2561 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/41ffd3cf-e077-4933-af1c-24ae8b0d5704-registry-certificates\") on node \"ip-10-0-139-31.ec2.internal\" DevicePath \"\""
Jul 07 17:42:38.338242 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:42:38.338051    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qmr7h\" (UniqueName: \"kubernetes.io/projected/41ffd3cf-e077-4933-af1c-24ae8b0d5704-kube-api-access-qmr7h\") on node \"ip-10-0-139-31.ec2.internal\" DevicePath \"\""
Jul 07 17:42:38.543860 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:42:38.543824    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-7ff58857cc-rmtgp"]
Jul 07 17:42:38.548234 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:42:38.548208    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-7ff58857cc-rmtgp"]
Jul 07 17:42:39.521220 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:42:39.521173    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="41ffd3cf-e077-4933-af1c-24ae8b0d5704" path="/var/lib/kubelet/pods/41ffd3cf-e077-4933-af1c-24ae8b0d5704/volumes"
Jul 07 17:42:45.249314 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:42:45.249281    2561 generic.go:356] "Generic (PLEG): container finished" podID="22855c2a-6a54-4a07-8655-db3f563f7e11" containerID="8adb585a56ab6e46f920707c9916be60d84b66b584dbbf8629aab7fc487e6f77" exitCode=0
Jul 07 17:42:45.249756 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:42:45.249351    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5c847dcfc4-gwhjt" event={"ID":"22855c2a-6a54-4a07-8655-db3f563f7e11","Type":"ContainerDied","Data":"8adb585a56ab6e46f920707c9916be60d84b66b584dbbf8629aab7fc487e6f77"}
Jul 07 17:42:45.249756 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:42:45.249740    2561 scope.go:117] "RemoveContainer" containerID="8adb585a56ab6e46f920707c9916be60d84b66b584dbbf8629aab7fc487e6f77"
Jul 07 17:42:45.251004 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:42:45.250971    2561 generic.go:356] "Generic (PLEG): container finished" podID="fb9a13b7-2352-49f4-a15a-bf67a478c82f" containerID="583cafe27c89f9b49f69a789611c3fd7c4a92eb54035e1d18ce0f7734521e43c" exitCode=0
Jul 07 17:42:45.251097 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:42:45.251020    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-c2lj2" event={"ID":"fb9a13b7-2352-49f4-a15a-bf67a478c82f","Type":"ContainerDied","Data":"583cafe27c89f9b49f69a789611c3fd7c4a92eb54035e1d18ce0f7734521e43c"}
Jul 07 17:42:45.251293 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:42:45.251277    2561 scope.go:117] "RemoveContainer" containerID="583cafe27c89f9b49f69a789611c3fd7c4a92eb54035e1d18ce0f7734521e43c"
Jul 07 17:42:46.258382 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:42:46.258342    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-c2lj2" event={"ID":"fb9a13b7-2352-49f4-a15a-bf67a478c82f","Type":"ContainerStarted","Data":"b56b0894686135df40142010bafcd9dae109745097d534579f1974a482f200be"}
Jul 07 17:42:46.260284 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:42:46.260258    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5c847dcfc4-gwhjt" event={"ID":"22855c2a-6a54-4a07-8655-db3f563f7e11","Type":"ContainerStarted","Data":"e4f2112241eb926a36272ee71230ac372db13d64ba2e29919a049a2c91003344"}
Jul 07 17:43:06.775366 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:43:06.775270    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 17:43:06.841607 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:43:06.841575    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 17:43:07.367555 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:43:07.367528    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 17:43:24.835264 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:43:24.835226    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 07 17:43:24.835894 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:43:24.835682    2561 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="a4e665e6-ee8a-4f4d-b733-9db5a754ff3f" containerName="kube-rbac-proxy-thanos" containerID="cri-o://269af484b34a986e8ca63c932d2a2fba831cc25c4f1a1b86514cfa87a4cd8b0d" gracePeriod=600
Jul 07 17:43:24.835894 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:43:24.835739    2561 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="a4e665e6-ee8a-4f4d-b733-9db5a754ff3f" containerName="kube-rbac-proxy-web" containerID="cri-o://69d7aa31523b1a5d3cb0a6fbb19fc4f5f02e1dbd3a9735ce1b60ea46936ac694" gracePeriod=600
Jul 07 17:43:24.835894 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:43:24.835687    2561 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="a4e665e6-ee8a-4f4d-b733-9db5a754ff3f" containerName="kube-rbac-proxy" containerID="cri-o://aa2326f1ca1106a943bb2aebf06abdfa724fb3c3c5792a2e074aaa0d0bda1b47" gracePeriod=600
Jul 07 17:43:24.835894 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:43:24.835714    2561 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="a4e665e6-ee8a-4f4d-b733-9db5a754ff3f" containerName="thanos-sidecar" containerID="cri-o://b01477e5894988ac7ad883f6eadb3149a02a593c86daf214e25cd07f0a4eaa57" gracePeriod=600
Jul 07 17:43:24.836105 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:43:24.835742    2561 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="a4e665e6-ee8a-4f4d-b733-9db5a754ff3f" containerName="config-reloader" containerID="cri-o://9e33d3586f20dce7567e138da47ec281328b73e64d5d5bcd5fafa5ed76286a1c" gracePeriod=600
Jul 07 17:43:24.836608 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:43:24.836435    2561 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="a4e665e6-ee8a-4f4d-b733-9db5a754ff3f" containerName="prometheus" containerID="cri-o://d87b55671c8630007e9a1a02992410ebd4b38e2dc1dce1a6dd3747a117b1dbd5" gracePeriod=600
Jul 07 17:43:25.086314 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:43:25.086251    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 17:43:25.232772 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:43:25.232735    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/a4e665e6-ee8a-4f4d-b733-9db5a754ff3f-secret-prometheus-k8s-tls\") pod \"a4e665e6-ee8a-4f4d-b733-9db5a754ff3f\" (UID: \"a4e665e6-ee8a-4f4d-b733-9db5a754ff3f\") "
Jul 07 17:43:25.232772 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:43:25.232776    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/a4e665e6-ee8a-4f4d-b733-9db5a754ff3f-prometheus-k8s-rulefiles-2\") pod \"a4e665e6-ee8a-4f4d-b733-9db5a754ff3f\" (UID: \"a4e665e6-ee8a-4f4d-b733-9db5a754ff3f\") "
Jul 07 17:43:25.233016 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:43:25.232810    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/a4e665e6-ee8a-4f4d-b733-9db5a754ff3f-config\") pod \"a4e665e6-ee8a-4f4d-b733-9db5a754ff3f\" (UID: \"a4e665e6-ee8a-4f4d-b733-9db5a754ff3f\") "
Jul 07 17:43:25.233016 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:43:25.232829    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a4e665e6-ee8a-4f4d-b733-9db5a754ff3f-configmap-metrics-client-ca\") pod \"a4e665e6-ee8a-4f4d-b733-9db5a754ff3f\" (UID: \"a4e665e6-ee8a-4f4d-b733-9db5a754ff3f\") "
Jul 07 17:43:25.233016 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:43:25.232898    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/a4e665e6-ee8a-4f4d-b733-9db5a754ff3f-secret-grpc-tls\") pod \"a4e665e6-ee8a-4f4d-b733-9db5a754ff3f\" (UID: \"a4e665e6-ee8a-4f4d-b733-9db5a754ff3f\") "
Jul 07 17:43:25.233016 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:43:25.232933    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/a4e665e6-ee8a-4f4d-b733-9db5a754ff3f-web-config\") pod \"a4e665e6-ee8a-4f4d-b733-9db5a754ff3f\" (UID: \"a4e665e6-ee8a-4f4d-b733-9db5a754ff3f\") "
Jul 07 17:43:25.233016 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:43:25.232961    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a4e665e6-ee8a-4f4d-b733-9db5a754ff3f-secret-kube-rbac-proxy\") pod \"a4e665e6-ee8a-4f4d-b733-9db5a754ff3f\" (UID: \"a4e665e6-ee8a-4f4d-b733-9db5a754ff3f\") "
Jul 07 17:43:25.233016 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:43:25.232986    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a4e665e6-ee8a-4f4d-b733-9db5a754ff3f-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"a4e665e6-ee8a-4f4d-b733-9db5a754ff3f\" (UID: \"a4e665e6-ee8a-4f4d-b733-9db5a754ff3f\") "
Jul 07 17:43:25.233316 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:43:25.233024    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/a4e665e6-ee8a-4f4d-b733-9db5a754ff3f-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"a4e665e6-ee8a-4f4d-b733-9db5a754ff3f\" (UID: \"a4e665e6-ee8a-4f4d-b733-9db5a754ff3f\") "
Jul 07 17:43:25.233316 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:43:25.233051    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a4e665e6-ee8a-4f4d-b733-9db5a754ff3f-configmap-serving-certs-ca-bundle\") pod \"a4e665e6-ee8a-4f4d-b733-9db5a754ff3f\" (UID: \"a4e665e6-ee8a-4f4d-b733-9db5a754ff3f\") "
Jul 07 17:43:25.233316 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:43:25.233084    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a4e665e6-ee8a-4f4d-b733-9db5a754ff3f-prometheus-trusted-ca-bundle\") pod \"a4e665e6-ee8a-4f4d-b733-9db5a754ff3f\" (UID: \"a4e665e6-ee8a-4f4d-b733-9db5a754ff3f\") "
Jul 07 17:43:25.233316 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:43:25.233111    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/a4e665e6-ee8a-4f4d-b733-9db5a754ff3f-secret-metrics-client-certs\") pod \"a4e665e6-ee8a-4f4d-b733-9db5a754ff3f\" (UID: \"a4e665e6-ee8a-4f4d-b733-9db5a754ff3f\") "
Jul 07 17:43:25.233316 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:43:25.233136    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/a4e665e6-ee8a-4f4d-b733-9db5a754ff3f-thanos-prometheus-http-client-file\") pod \"a4e665e6-ee8a-4f4d-b733-9db5a754ff3f\" (UID: \"a4e665e6-ee8a-4f4d-b733-9db5a754ff3f\") "
Jul 07 17:43:25.233316 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:43:25.233171    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a4e665e6-ee8a-4f4d-b733-9db5a754ff3f-configmap-kubelet-serving-ca-bundle\") pod \"a4e665e6-ee8a-4f4d-b733-9db5a754ff3f\" (UID: \"a4e665e6-ee8a-4f4d-b733-9db5a754ff3f\") "
Jul 07 17:43:25.233316 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:43:25.233200    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/a4e665e6-ee8a-4f4d-b733-9db5a754ff3f-prometheus-k8s-rulefiles-0\") pod \"a4e665e6-ee8a-4f4d-b733-9db5a754ff3f\" (UID: \"a4e665e6-ee8a-4f4d-b733-9db5a754ff3f\") "
Jul 07 17:43:25.233316 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:43:25.233260    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/a4e665e6-ee8a-4f4d-b733-9db5a754ff3f-prometheus-k8s-rulefiles-1\") pod \"a4e665e6-ee8a-4f4d-b733-9db5a754ff3f\" (UID: \"a4e665e6-ee8a-4f4d-b733-9db5a754ff3f\") "
Jul 07 17:43:25.233316 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:43:25.233303    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/a4e665e6-ee8a-4f4d-b733-9db5a754ff3f-config-out\") pod \"a4e665e6-ee8a-4f4d-b733-9db5a754ff3f\" (UID: \"a4e665e6-ee8a-4f4d-b733-9db5a754ff3f\") "
Jul 07 17:43:25.233818 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:43:25.233332    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/a4e665e6-ee8a-4f4d-b733-9db5a754ff3f-tls-assets\") pod \"a4e665e6-ee8a-4f4d-b733-9db5a754ff3f\" (UID: \"a4e665e6-ee8a-4f4d-b733-9db5a754ff3f\") "
Jul 07 17:43:25.233818 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:43:25.233362    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-n7cgn\" (UniqueName: \"kubernetes.io/projected/a4e665e6-ee8a-4f4d-b733-9db5a754ff3f-kube-api-access-n7cgn\") pod \"a4e665e6-ee8a-4f4d-b733-9db5a754ff3f\" (UID: \"a4e665e6-ee8a-4f4d-b733-9db5a754ff3f\") "
Jul 07 17:43:25.233818 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:43:25.233386    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/a4e665e6-ee8a-4f4d-b733-9db5a754ff3f-prometheus-k8s-db\") pod \"a4e665e6-ee8a-4f4d-b733-9db5a754ff3f\" (UID: \"a4e665e6-ee8a-4f4d-b733-9db5a754ff3f\") "
Jul 07 17:43:25.234054 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:43:25.233165    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a4e665e6-ee8a-4f4d-b733-9db5a754ff3f-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "a4e665e6-ee8a-4f4d-b733-9db5a754ff3f" (UID: "a4e665e6-ee8a-4f4d-b733-9db5a754ff3f"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 17:43:25.234129 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:43:25.233265    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a4e665e6-ee8a-4f4d-b733-9db5a754ff3f-prometheus-k8s-rulefiles-2" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-2") pod "a4e665e6-ee8a-4f4d-b733-9db5a754ff3f" (UID: "a4e665e6-ee8a-4f4d-b733-9db5a754ff3f"). InnerVolumeSpecName "prometheus-k8s-rulefiles-2". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 17:43:25.234129 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:43:25.233495    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a4e665e6-ee8a-4f4d-b733-9db5a754ff3f-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "a4e665e6-ee8a-4f4d-b733-9db5a754ff3f" (UID: "a4e665e6-ee8a-4f4d-b733-9db5a754ff3f"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 17:43:25.235035 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:43:25.234366    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a4e665e6-ee8a-4f4d-b733-9db5a754ff3f-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "a4e665e6-ee8a-4f4d-b733-9db5a754ff3f" (UID: "a4e665e6-ee8a-4f4d-b733-9db5a754ff3f"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 17:43:25.235035 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:43:25.234817    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a4e665e6-ee8a-4f4d-b733-9db5a754ff3f-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "a4e665e6-ee8a-4f4d-b733-9db5a754ff3f" (UID: "a4e665e6-ee8a-4f4d-b733-9db5a754ff3f"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 17:43:25.235035 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:43:25.235009    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a4e665e6-ee8a-4f4d-b733-9db5a754ff3f-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "a4e665e6-ee8a-4f4d-b733-9db5a754ff3f" (UID: "a4e665e6-ee8a-4f4d-b733-9db5a754ff3f"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 17:43:25.236533 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:43:25.235748    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a4e665e6-ee8a-4f4d-b733-9db5a754ff3f-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "a4e665e6-ee8a-4f4d-b733-9db5a754ff3f" (UID: "a4e665e6-ee8a-4f4d-b733-9db5a754ff3f"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 17:43:25.236533 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:43:25.235816    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a4e665e6-ee8a-4f4d-b733-9db5a754ff3f-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "a4e665e6-ee8a-4f4d-b733-9db5a754ff3f" (UID: "a4e665e6-ee8a-4f4d-b733-9db5a754ff3f"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 17:43:25.236533 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:43:25.236025    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a4e665e6-ee8a-4f4d-b733-9db5a754ff3f-prometheus-k8s-rulefiles-1" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-1") pod "a4e665e6-ee8a-4f4d-b733-9db5a754ff3f" (UID: "a4e665e6-ee8a-4f4d-b733-9db5a754ff3f"). InnerVolumeSpecName "prometheus-k8s-rulefiles-1". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 17:43:25.237025 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:43:25.236853    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a4e665e6-ee8a-4f4d-b733-9db5a754ff3f-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "a4e665e6-ee8a-4f4d-b733-9db5a754ff3f" (UID: "a4e665e6-ee8a-4f4d-b733-9db5a754ff3f"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 17:43:25.237025 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:43:25.236937    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a4e665e6-ee8a-4f4d-b733-9db5a754ff3f-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "a4e665e6-ee8a-4f4d-b733-9db5a754ff3f" (UID: "a4e665e6-ee8a-4f4d-b733-9db5a754ff3f"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 17:43:25.237025 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:43:25.236990    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a4e665e6-ee8a-4f4d-b733-9db5a754ff3f-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "a4e665e6-ee8a-4f4d-b733-9db5a754ff3f" (UID: "a4e665e6-ee8a-4f4d-b733-9db5a754ff3f"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 17:43:25.237511 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:43:25.237435    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a4e665e6-ee8a-4f4d-b733-9db5a754ff3f-config" (OuterVolumeSpecName: "config") pod "a4e665e6-ee8a-4f4d-b733-9db5a754ff3f" (UID: "a4e665e6-ee8a-4f4d-b733-9db5a754ff3f"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 17:43:25.237903 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:43:25.237870    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a4e665e6-ee8a-4f4d-b733-9db5a754ff3f-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "a4e665e6-ee8a-4f4d-b733-9db5a754ff3f" (UID: "a4e665e6-ee8a-4f4d-b733-9db5a754ff3f"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 17:43:25.238067 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:43:25.238039    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a4e665e6-ee8a-4f4d-b733-9db5a754ff3f-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "a4e665e6-ee8a-4f4d-b733-9db5a754ff3f" (UID: "a4e665e6-ee8a-4f4d-b733-9db5a754ff3f"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 17:43:25.238136 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:43:25.238103    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a4e665e6-ee8a-4f4d-b733-9db5a754ff3f-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "a4e665e6-ee8a-4f4d-b733-9db5a754ff3f" (UID: "a4e665e6-ee8a-4f4d-b733-9db5a754ff3f"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 17:43:25.238280 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:43:25.238259    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a4e665e6-ee8a-4f4d-b733-9db5a754ff3f-config-out" (OuterVolumeSpecName: "config-out") pod "a4e665e6-ee8a-4f4d-b733-9db5a754ff3f" (UID: "a4e665e6-ee8a-4f4d-b733-9db5a754ff3f"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 17:43:25.238352 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:43:25.238335    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a4e665e6-ee8a-4f4d-b733-9db5a754ff3f-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "a4e665e6-ee8a-4f4d-b733-9db5a754ff3f" (UID: "a4e665e6-ee8a-4f4d-b733-9db5a754ff3f"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 17:43:25.238561 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:43:25.238543    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a4e665e6-ee8a-4f4d-b733-9db5a754ff3f-kube-api-access-n7cgn" (OuterVolumeSpecName: "kube-api-access-n7cgn") pod "a4e665e6-ee8a-4f4d-b733-9db5a754ff3f" (UID: "a4e665e6-ee8a-4f4d-b733-9db5a754ff3f"). InnerVolumeSpecName "kube-api-access-n7cgn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 17:43:25.247763 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:43:25.247735    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a4e665e6-ee8a-4f4d-b733-9db5a754ff3f-web-config" (OuterVolumeSpecName: "web-config") pod "a4e665e6-ee8a-4f4d-b733-9db5a754ff3f" (UID: "a4e665e6-ee8a-4f4d-b733-9db5a754ff3f"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 17:43:25.334716 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:43:25.334676    2561 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/a4e665e6-ee8a-4f4d-b733-9db5a754ff3f-prometheus-k8s-rulefiles-1\") on node \"ip-10-0-139-31.ec2.internal\" DevicePath \"\""
Jul 07 17:43:25.334716 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:43:25.334710    2561 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/a4e665e6-ee8a-4f4d-b733-9db5a754ff3f-config-out\") on node \"ip-10-0-139-31.ec2.internal\" DevicePath \"\""
Jul 07 17:43:25.334716 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:43:25.334723    2561 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/a4e665e6-ee8a-4f4d-b733-9db5a754ff3f-tls-assets\") on node \"ip-10-0-139-31.ec2.internal\" DevicePath \"\""
Jul 07 17:43:25.335024 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:43:25.334734    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-n7cgn\" (UniqueName: \"kubernetes.io/projected/a4e665e6-ee8a-4f4d-b733-9db5a754ff3f-kube-api-access-n7cgn\") on node \"ip-10-0-139-31.ec2.internal\" DevicePath \"\""
Jul 07 17:43:25.335024 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:43:25.334746    2561 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/a4e665e6-ee8a-4f4d-b733-9db5a754ff3f-prometheus-k8s-db\") on node \"ip-10-0-139-31.ec2.internal\" DevicePath \"\""
Jul 07 17:43:25.335024 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:43:25.334759    2561 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/a4e665e6-ee8a-4f4d-b733-9db5a754ff3f-secret-prometheus-k8s-tls\") on node \"ip-10-0-139-31.ec2.internal\" DevicePath \"\""
Jul 07 17:43:25.335024 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:43:25.334771    2561 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/a4e665e6-ee8a-4f4d-b733-9db5a754ff3f-prometheus-k8s-rulefiles-2\") on node \"ip-10-0-139-31.ec2.internal\" DevicePath \"\""
Jul 07 17:43:25.335024 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:43:25.334782    2561 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/a4e665e6-ee8a-4f4d-b733-9db5a754ff3f-config\") on node \"ip-10-0-139-31.ec2.internal\" DevicePath \"\""
Jul 07 17:43:25.335024 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:43:25.334793    2561 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a4e665e6-ee8a-4f4d-b733-9db5a754ff3f-configmap-metrics-client-ca\") on node \"ip-10-0-139-31.ec2.internal\" DevicePath \"\""
Jul 07 17:43:25.335024 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:43:25.334805    2561 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/a4e665e6-ee8a-4f4d-b733-9db5a754ff3f-secret-grpc-tls\") on node \"ip-10-0-139-31.ec2.internal\" DevicePath \"\""
Jul 07 17:43:25.335024 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:43:25.334842    2561 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/a4e665e6-ee8a-4f4d-b733-9db5a754ff3f-web-config\") on node \"ip-10-0-139-31.ec2.internal\" DevicePath \"\""
Jul 07 17:43:25.335024 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:43:25.334854    2561 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a4e665e6-ee8a-4f4d-b733-9db5a754ff3f-secret-kube-rbac-proxy\") on node \"ip-10-0-139-31.ec2.internal\" DevicePath \"\""
Jul 07 17:43:25.335024 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:43:25.334867    2561 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a4e665e6-ee8a-4f4d-b733-9db5a754ff3f-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-139-31.ec2.internal\" DevicePath \"\""
Jul 07 17:43:25.335024 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:43:25.334882    2561 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/a4e665e6-ee8a-4f4d-b733-9db5a754ff3f-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-139-31.ec2.internal\" DevicePath \"\""
Jul 07 17:43:25.335024 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:43:25.334895    2561 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a4e665e6-ee8a-4f4d-b733-9db5a754ff3f-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-139-31.ec2.internal\" DevicePath \"\""
Jul 07 17:43:25.335024 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:43:25.334909    2561 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a4e665e6-ee8a-4f4d-b733-9db5a754ff3f-prometheus-trusted-ca-bundle\") on node \"ip-10-0-139-31.ec2.internal\" DevicePath \"\""
Jul 07 17:43:25.335024 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:43:25.334921    2561 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/a4e665e6-ee8a-4f4d-b733-9db5a754ff3f-secret-metrics-client-certs\") on node \"ip-10-0-139-31.ec2.internal\" DevicePath \"\""
Jul 07 17:43:25.335024 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:43:25.334935    2561 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/a4e665e6-ee8a-4f4d-b733-9db5a754ff3f-thanos-prometheus-http-client-file\") on node \"ip-10-0-139-31.ec2.internal\" DevicePath \"\""
Jul 07 17:43:25.335024 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:43:25.334949    2561 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a4e665e6-ee8a-4f4d-b733-9db5a754ff3f-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-139-31.ec2.internal\" DevicePath \"\""
Jul 07 17:43:25.335024 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:43:25.334963    2561 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/a4e665e6-ee8a-4f4d-b733-9db5a754ff3f-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-139-31.ec2.internal\" DevicePath \"\""
Jul 07 17:43:25.424901 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:43:25.424807    2561 generic.go:356] "Generic (PLEG): container finished" podID="a4e665e6-ee8a-4f4d-b733-9db5a754ff3f" containerID="269af484b34a986e8ca63c932d2a2fba831cc25c4f1a1b86514cfa87a4cd8b0d" exitCode=0
Jul 07 17:43:25.424901 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:43:25.424840    2561 generic.go:356] "Generic (PLEG): container finished" podID="a4e665e6-ee8a-4f4d-b733-9db5a754ff3f" containerID="aa2326f1ca1106a943bb2aebf06abdfa724fb3c3c5792a2e074aaa0d0bda1b47" exitCode=0
Jul 07 17:43:25.424901 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:43:25.424850    2561 generic.go:356] "Generic (PLEG): container finished" podID="a4e665e6-ee8a-4f4d-b733-9db5a754ff3f" containerID="69d7aa31523b1a5d3cb0a6fbb19fc4f5f02e1dbd3a9735ce1b60ea46936ac694" exitCode=0
Jul 07 17:43:25.424901 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:43:25.424859    2561 generic.go:356] "Generic (PLEG): container finished" podID="a4e665e6-ee8a-4f4d-b733-9db5a754ff3f" containerID="b01477e5894988ac7ad883f6eadb3149a02a593c86daf214e25cd07f0a4eaa57" exitCode=0
Jul 07 17:43:25.424901 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:43:25.424867    2561 generic.go:356] "Generic (PLEG): container finished" podID="a4e665e6-ee8a-4f4d-b733-9db5a754ff3f" containerID="9e33d3586f20dce7567e138da47ec281328b73e64d5d5bcd5fafa5ed76286a1c" exitCode=0
Jul 07 17:43:25.424901 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:43:25.424875    2561 generic.go:356] "Generic (PLEG): container finished" podID="a4e665e6-ee8a-4f4d-b733-9db5a754ff3f" containerID="d87b55671c8630007e9a1a02992410ebd4b38e2dc1dce1a6dd3747a117b1dbd5" exitCode=0
Jul 07 17:43:25.424901 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:43:25.424884    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a4e665e6-ee8a-4f4d-b733-9db5a754ff3f","Type":"ContainerDied","Data":"269af484b34a986e8ca63c932d2a2fba831cc25c4f1a1b86514cfa87a4cd8b0d"}
Jul 07 17:43:25.425244 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:43:25.424912    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 17:43:25.425244 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:43:25.424954    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a4e665e6-ee8a-4f4d-b733-9db5a754ff3f","Type":"ContainerDied","Data":"aa2326f1ca1106a943bb2aebf06abdfa724fb3c3c5792a2e074aaa0d0bda1b47"}
Jul 07 17:43:25.425244 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:43:25.424984    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a4e665e6-ee8a-4f4d-b733-9db5a754ff3f","Type":"ContainerDied","Data":"69d7aa31523b1a5d3cb0a6fbb19fc4f5f02e1dbd3a9735ce1b60ea46936ac694"}
Jul 07 17:43:25.425244 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:43:25.425010    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a4e665e6-ee8a-4f4d-b733-9db5a754ff3f","Type":"ContainerDied","Data":"b01477e5894988ac7ad883f6eadb3149a02a593c86daf214e25cd07f0a4eaa57"}
Jul 07 17:43:25.425244 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:43:25.425026    2561 scope.go:117] "RemoveContainer" containerID="269af484b34a986e8ca63c932d2a2fba831cc25c4f1a1b86514cfa87a4cd8b0d"
Jul 07 17:43:25.425244 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:43:25.425037    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a4e665e6-ee8a-4f4d-b733-9db5a754ff3f","Type":"ContainerDied","Data":"9e33d3586f20dce7567e138da47ec281328b73e64d5d5bcd5fafa5ed76286a1c"}
Jul 07 17:43:25.425244 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:43:25.425060    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a4e665e6-ee8a-4f4d-b733-9db5a754ff3f","Type":"ContainerDied","Data":"d87b55671c8630007e9a1a02992410ebd4b38e2dc1dce1a6dd3747a117b1dbd5"}
Jul 07 17:43:25.425244 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:43:25.425085    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a4e665e6-ee8a-4f4d-b733-9db5a754ff3f","Type":"ContainerDied","Data":"7031a2df20f023e8fa92afe03984e7b6ec5a99535501f5cffa526209ef77b428"}
Jul 07 17:43:25.433324 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:43:25.433299    2561 scope.go:117] "RemoveContainer" containerID="aa2326f1ca1106a943bb2aebf06abdfa724fb3c3c5792a2e074aaa0d0bda1b47"
Jul 07 17:43:25.440332 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:43:25.440313    2561 scope.go:117] "RemoveContainer" containerID="69d7aa31523b1a5d3cb0a6fbb19fc4f5f02e1dbd3a9735ce1b60ea46936ac694"
Jul 07 17:43:25.447184 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:43:25.447157    2561 scope.go:117] "RemoveContainer" containerID="b01477e5894988ac7ad883f6eadb3149a02a593c86daf214e25cd07f0a4eaa57"
Jul 07 17:43:25.450165 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:43:25.450143    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 07 17:43:25.455719 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:43:25.455695    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 07 17:43:25.455719 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:43:25.455712    2561 scope.go:117] "RemoveContainer" containerID="9e33d3586f20dce7567e138da47ec281328b73e64d5d5bcd5fafa5ed76286a1c"
Jul 07 17:43:25.462901 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:43:25.462878    2561 scope.go:117] "RemoveContainer" containerID="d87b55671c8630007e9a1a02992410ebd4b38e2dc1dce1a6dd3747a117b1dbd5"
Jul 07 17:43:25.470398 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:43:25.470378    2561 scope.go:117] "RemoveContainer" containerID="6cd3ac82b3eb52ce0b744a86d78480d4ad2f2f5a83eab4f221ab5ca63d8e7eed"
Jul 07 17:43:25.477463 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:43:25.477422    2561 scope.go:117] "RemoveContainer" containerID="269af484b34a986e8ca63c932d2a2fba831cc25c4f1a1b86514cfa87a4cd8b0d"
Jul 07 17:43:25.477726 ip-10-0-139-31 kubenswrapper[2561]: E0707 17:43:25.477707    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"269af484b34a986e8ca63c932d2a2fba831cc25c4f1a1b86514cfa87a4cd8b0d\": container with ID starting with 269af484b34a986e8ca63c932d2a2fba831cc25c4f1a1b86514cfa87a4cd8b0d not found: ID does not exist" containerID="269af484b34a986e8ca63c932d2a2fba831cc25c4f1a1b86514cfa87a4cd8b0d"
Jul 07 17:43:25.477791 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:43:25.477734    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"269af484b34a986e8ca63c932d2a2fba831cc25c4f1a1b86514cfa87a4cd8b0d"} err="failed to get container status \"269af484b34a986e8ca63c932d2a2fba831cc25c4f1a1b86514cfa87a4cd8b0d\": rpc error: code = NotFound desc = could not find container \"269af484b34a986e8ca63c932d2a2fba831cc25c4f1a1b86514cfa87a4cd8b0d\": container with ID starting with 269af484b34a986e8ca63c932d2a2fba831cc25c4f1a1b86514cfa87a4cd8b0d not found: ID does not exist"
Jul 07 17:43:25.477791 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:43:25.477753    2561 scope.go:117] "RemoveContainer" containerID="aa2326f1ca1106a943bb2aebf06abdfa724fb3c3c5792a2e074aaa0d0bda1b47"
Jul 07 17:43:25.478022 ip-10-0-139-31 kubenswrapper[2561]: E0707 17:43:25.478005    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"aa2326f1ca1106a943bb2aebf06abdfa724fb3c3c5792a2e074aaa0d0bda1b47\": container with ID starting with aa2326f1ca1106a943bb2aebf06abdfa724fb3c3c5792a2e074aaa0d0bda1b47 not found: ID does not exist" containerID="aa2326f1ca1106a943bb2aebf06abdfa724fb3c3c5792a2e074aaa0d0bda1b47"
Jul 07 17:43:25.478064 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:43:25.478030    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"aa2326f1ca1106a943bb2aebf06abdfa724fb3c3c5792a2e074aaa0d0bda1b47"} err="failed to get container status \"aa2326f1ca1106a943bb2aebf06abdfa724fb3c3c5792a2e074aaa0d0bda1b47\": rpc error: code = NotFound desc = could not find container \"aa2326f1ca1106a943bb2aebf06abdfa724fb3c3c5792a2e074aaa0d0bda1b47\": container with ID starting with aa2326f1ca1106a943bb2aebf06abdfa724fb3c3c5792a2e074aaa0d0bda1b47 not found: ID does not exist"
Jul 07 17:43:25.478064 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:43:25.478046    2561 scope.go:117] "RemoveContainer" containerID="69d7aa31523b1a5d3cb0a6fbb19fc4f5f02e1dbd3a9735ce1b60ea46936ac694"
Jul 07 17:43:25.478286 ip-10-0-139-31 kubenswrapper[2561]: E0707 17:43:25.478267    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"69d7aa31523b1a5d3cb0a6fbb19fc4f5f02e1dbd3a9735ce1b60ea46936ac694\": container with ID starting with 69d7aa31523b1a5d3cb0a6fbb19fc4f5f02e1dbd3a9735ce1b60ea46936ac694 not found: ID does not exist" containerID="69d7aa31523b1a5d3cb0a6fbb19fc4f5f02e1dbd3a9735ce1b60ea46936ac694"
Jul 07 17:43:25.478376 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:43:25.478287    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"69d7aa31523b1a5d3cb0a6fbb19fc4f5f02e1dbd3a9735ce1b60ea46936ac694"} err="failed to get container status \"69d7aa31523b1a5d3cb0a6fbb19fc4f5f02e1dbd3a9735ce1b60ea46936ac694\": rpc error: code = NotFound desc = could not find container \"69d7aa31523b1a5d3cb0a6fbb19fc4f5f02e1dbd3a9735ce1b60ea46936ac694\": container with ID starting with 69d7aa31523b1a5d3cb0a6fbb19fc4f5f02e1dbd3a9735ce1b60ea46936ac694 not found: ID does not exist"
Jul 07 17:43:25.478376 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:43:25.478301    2561 scope.go:117] "RemoveContainer" containerID="b01477e5894988ac7ad883f6eadb3149a02a593c86daf214e25cd07f0a4eaa57"
Jul 07 17:43:25.478574 ip-10-0-139-31 kubenswrapper[2561]: E0707 17:43:25.478550    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b01477e5894988ac7ad883f6eadb3149a02a593c86daf214e25cd07f0a4eaa57\": container with ID starting with b01477e5894988ac7ad883f6eadb3149a02a593c86daf214e25cd07f0a4eaa57 not found: ID does not exist" containerID="b01477e5894988ac7ad883f6eadb3149a02a593c86daf214e25cd07f0a4eaa57"
Jul 07 17:43:25.478644 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:43:25.478583    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b01477e5894988ac7ad883f6eadb3149a02a593c86daf214e25cd07f0a4eaa57"} err="failed to get container status \"b01477e5894988ac7ad883f6eadb3149a02a593c86daf214e25cd07f0a4eaa57\": rpc error: code = NotFound desc = could not find container \"b01477e5894988ac7ad883f6eadb3149a02a593c86daf214e25cd07f0a4eaa57\": container with ID starting with b01477e5894988ac7ad883f6eadb3149a02a593c86daf214e25cd07f0a4eaa57 not found: ID does not exist"
Jul 07 17:43:25.478644 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:43:25.478606    2561 scope.go:117] "RemoveContainer" containerID="9e33d3586f20dce7567e138da47ec281328b73e64d5d5bcd5fafa5ed76286a1c"
Jul 07 17:43:25.478870 ip-10-0-139-31 kubenswrapper[2561]: E0707 17:43:25.478854    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9e33d3586f20dce7567e138da47ec281328b73e64d5d5bcd5fafa5ed76286a1c\": container with ID starting with 9e33d3586f20dce7567e138da47ec281328b73e64d5d5bcd5fafa5ed76286a1c not found: ID does not exist" containerID="9e33d3586f20dce7567e138da47ec281328b73e64d5d5bcd5fafa5ed76286a1c"
Jul 07 17:43:25.478906 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:43:25.478874    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9e33d3586f20dce7567e138da47ec281328b73e64d5d5bcd5fafa5ed76286a1c"} err="failed to get container status \"9e33d3586f20dce7567e138da47ec281328b73e64d5d5bcd5fafa5ed76286a1c\": rpc error: code = NotFound desc = could not find container \"9e33d3586f20dce7567e138da47ec281328b73e64d5d5bcd5fafa5ed76286a1c\": container with ID starting with 9e33d3586f20dce7567e138da47ec281328b73e64d5d5bcd5fafa5ed76286a1c not found: ID does not exist"
Jul 07 17:43:25.478906 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:43:25.478889    2561 scope.go:117] "RemoveContainer" containerID="d87b55671c8630007e9a1a02992410ebd4b38e2dc1dce1a6dd3747a117b1dbd5"
Jul 07 17:43:25.479110 ip-10-0-139-31 kubenswrapper[2561]: E0707 17:43:25.479086    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d87b55671c8630007e9a1a02992410ebd4b38e2dc1dce1a6dd3747a117b1dbd5\": container with ID starting with d87b55671c8630007e9a1a02992410ebd4b38e2dc1dce1a6dd3747a117b1dbd5 not found: ID does not exist" containerID="d87b55671c8630007e9a1a02992410ebd4b38e2dc1dce1a6dd3747a117b1dbd5"
Jul 07 17:43:25.479156 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:43:25.479106    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d87b55671c8630007e9a1a02992410ebd4b38e2dc1dce1a6dd3747a117b1dbd5"} err="failed to get container status \"d87b55671c8630007e9a1a02992410ebd4b38e2dc1dce1a6dd3747a117b1dbd5\": rpc error: code = NotFound desc = could not find container \"d87b55671c8630007e9a1a02992410ebd4b38e2dc1dce1a6dd3747a117b1dbd5\": container with ID starting with d87b55671c8630007e9a1a02992410ebd4b38e2dc1dce1a6dd3747a117b1dbd5 not found: ID does not exist"
Jul 07 17:43:25.479156 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:43:25.479119    2561 scope.go:117] "RemoveContainer" containerID="6cd3ac82b3eb52ce0b744a86d78480d4ad2f2f5a83eab4f221ab5ca63d8e7eed"
Jul 07 17:43:25.479333 ip-10-0-139-31 kubenswrapper[2561]: E0707 17:43:25.479311    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6cd3ac82b3eb52ce0b744a86d78480d4ad2f2f5a83eab4f221ab5ca63d8e7eed\": container with ID starting with 6cd3ac82b3eb52ce0b744a86d78480d4ad2f2f5a83eab4f221ab5ca63d8e7eed not found: ID does not exist" containerID="6cd3ac82b3eb52ce0b744a86d78480d4ad2f2f5a83eab4f221ab5ca63d8e7eed"
Jul 07 17:43:25.479333 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:43:25.479328    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6cd3ac82b3eb52ce0b744a86d78480d4ad2f2f5a83eab4f221ab5ca63d8e7eed"} err="failed to get container status \"6cd3ac82b3eb52ce0b744a86d78480d4ad2f2f5a83eab4f221ab5ca63d8e7eed\": rpc error: code = NotFound desc = could not find container \"6cd3ac82b3eb52ce0b744a86d78480d4ad2f2f5a83eab4f221ab5ca63d8e7eed\": container with ID starting with 6cd3ac82b3eb52ce0b744a86d78480d4ad2f2f5a83eab4f221ab5ca63d8e7eed not found: ID does not exist"
Jul 07 17:43:25.479421 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:43:25.479342    2561 scope.go:117] "RemoveContainer" containerID="269af484b34a986e8ca63c932d2a2fba831cc25c4f1a1b86514cfa87a4cd8b0d"
Jul 07 17:43:25.479666 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:43:25.479642    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"269af484b34a986e8ca63c932d2a2fba831cc25c4f1a1b86514cfa87a4cd8b0d"} err="failed to get container status \"269af484b34a986e8ca63c932d2a2fba831cc25c4f1a1b86514cfa87a4cd8b0d\": rpc error: code = NotFound desc = could not find container \"269af484b34a986e8ca63c932d2a2fba831cc25c4f1a1b86514cfa87a4cd8b0d\": container with ID starting with 269af484b34a986e8ca63c932d2a2fba831cc25c4f1a1b86514cfa87a4cd8b0d not found: ID does not exist"
Jul 07 17:43:25.479786 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:43:25.479667    2561 scope.go:117] "RemoveContainer" containerID="aa2326f1ca1106a943bb2aebf06abdfa724fb3c3c5792a2e074aaa0d0bda1b47"
Jul 07 17:43:25.480283 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:43:25.480081    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"aa2326f1ca1106a943bb2aebf06abdfa724fb3c3c5792a2e074aaa0d0bda1b47"} err="failed to get container status \"aa2326f1ca1106a943bb2aebf06abdfa724fb3c3c5792a2e074aaa0d0bda1b47\": rpc error: code = NotFound desc = could not find container \"aa2326f1ca1106a943bb2aebf06abdfa724fb3c3c5792a2e074aaa0d0bda1b47\": container with ID starting with aa2326f1ca1106a943bb2aebf06abdfa724fb3c3c5792a2e074aaa0d0bda1b47 not found: ID does not exist"
Jul 07 17:43:25.480283 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:43:25.480182    2561 scope.go:117] "RemoveContainer" containerID="69d7aa31523b1a5d3cb0a6fbb19fc4f5f02e1dbd3a9735ce1b60ea46936ac694"
Jul 07 17:43:25.480656 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:43:25.480631    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"69d7aa31523b1a5d3cb0a6fbb19fc4f5f02e1dbd3a9735ce1b60ea46936ac694"} err="failed to get container status \"69d7aa31523b1a5d3cb0a6fbb19fc4f5f02e1dbd3a9735ce1b60ea46936ac694\": rpc error: code = NotFound desc = could not find container \"69d7aa31523b1a5d3cb0a6fbb19fc4f5f02e1dbd3a9735ce1b60ea46936ac694\": container with ID starting with 69d7aa31523b1a5d3cb0a6fbb19fc4f5f02e1dbd3a9735ce1b60ea46936ac694 not found: ID does not exist"
Jul 07 17:43:25.480750 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:43:25.480657    2561 scope.go:117] "RemoveContainer" containerID="b01477e5894988ac7ad883f6eadb3149a02a593c86daf214e25cd07f0a4eaa57"
Jul 07 17:43:25.480942 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:43:25.480923    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b01477e5894988ac7ad883f6eadb3149a02a593c86daf214e25cd07f0a4eaa57"} err="failed to get container status \"b01477e5894988ac7ad883f6eadb3149a02a593c86daf214e25cd07f0a4eaa57\": rpc error: code = NotFound desc = could not find container \"b01477e5894988ac7ad883f6eadb3149a02a593c86daf214e25cd07f0a4eaa57\": container with ID starting with b01477e5894988ac7ad883f6eadb3149a02a593c86daf214e25cd07f0a4eaa57 not found: ID does not exist"
Jul 07 17:43:25.481001 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:43:25.480944    2561 scope.go:117] "RemoveContainer" containerID="9e33d3586f20dce7567e138da47ec281328b73e64d5d5bcd5fafa5ed76286a1c"
Jul 07 17:43:25.481148 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:43:25.481120    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9e33d3586f20dce7567e138da47ec281328b73e64d5d5bcd5fafa5ed76286a1c"} err="failed to get container status \"9e33d3586f20dce7567e138da47ec281328b73e64d5d5bcd5fafa5ed76286a1c\": rpc error: code = NotFound desc = could not find container \"9e33d3586f20dce7567e138da47ec281328b73e64d5d5bcd5fafa5ed76286a1c\": container with ID starting with 9e33d3586f20dce7567e138da47ec281328b73e64d5d5bcd5fafa5ed76286a1c not found: ID does not exist"
Jul 07 17:43:25.481148 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:43:25.481138    2561 scope.go:117] "RemoveContainer" containerID="d87b55671c8630007e9a1a02992410ebd4b38e2dc1dce1a6dd3747a117b1dbd5"
Jul 07 17:43:25.481376 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:43:25.481355    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d87b55671c8630007e9a1a02992410ebd4b38e2dc1dce1a6dd3747a117b1dbd5"} err="failed to get container status \"d87b55671c8630007e9a1a02992410ebd4b38e2dc1dce1a6dd3747a117b1dbd5\": rpc error: code = NotFound desc = could not find container \"d87b55671c8630007e9a1a02992410ebd4b38e2dc1dce1a6dd3747a117b1dbd5\": container with ID starting with d87b55671c8630007e9a1a02992410ebd4b38e2dc1dce1a6dd3747a117b1dbd5 not found: ID does not exist"
Jul 07 17:43:25.481511 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:43:25.481378    2561 scope.go:117] "RemoveContainer" containerID="6cd3ac82b3eb52ce0b744a86d78480d4ad2f2f5a83eab4f221ab5ca63d8e7eed"
Jul 07 17:43:25.481651 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:43:25.481632    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6cd3ac82b3eb52ce0b744a86d78480d4ad2f2f5a83eab4f221ab5ca63d8e7eed"} err="failed to get container status \"6cd3ac82b3eb52ce0b744a86d78480d4ad2f2f5a83eab4f221ab5ca63d8e7eed\": rpc error: code = NotFound desc = could not find container \"6cd3ac82b3eb52ce0b744a86d78480d4ad2f2f5a83eab4f221ab5ca63d8e7eed\": container with ID starting with 6cd3ac82b3eb52ce0b744a86d78480d4ad2f2f5a83eab4f221ab5ca63d8e7eed not found: ID does not exist"
Jul 07 17:43:25.481713 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:43:25.481651    2561 scope.go:117] "RemoveContainer" containerID="269af484b34a986e8ca63c932d2a2fba831cc25c4f1a1b86514cfa87a4cd8b0d"
Jul 07 17:43:25.481898 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:43:25.481878    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"269af484b34a986e8ca63c932d2a2fba831cc25c4f1a1b86514cfa87a4cd8b0d"} err="failed to get container status \"269af484b34a986e8ca63c932d2a2fba831cc25c4f1a1b86514cfa87a4cd8b0d\": rpc error: code = NotFound desc = could not find container \"269af484b34a986e8ca63c932d2a2fba831cc25c4f1a1b86514cfa87a4cd8b0d\": container with ID starting with 269af484b34a986e8ca63c932d2a2fba831cc25c4f1a1b86514cfa87a4cd8b0d not found: ID does not exist"
Jul 07 17:43:25.481898 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:43:25.481897    2561 scope.go:117] "RemoveContainer" containerID="aa2326f1ca1106a943bb2aebf06abdfa724fb3c3c5792a2e074aaa0d0bda1b47"
Jul 07 17:43:25.482096 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:43:25.482077    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"aa2326f1ca1106a943bb2aebf06abdfa724fb3c3c5792a2e074aaa0d0bda1b47"} err="failed to get container status \"aa2326f1ca1106a943bb2aebf06abdfa724fb3c3c5792a2e074aaa0d0bda1b47\": rpc error: code = NotFound desc = could not find container \"aa2326f1ca1106a943bb2aebf06abdfa724fb3c3c5792a2e074aaa0d0bda1b47\": container with ID starting with aa2326f1ca1106a943bb2aebf06abdfa724fb3c3c5792a2e074aaa0d0bda1b47 not found: ID does not exist"
Jul 07 17:43:25.482154 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:43:25.482097    2561 scope.go:117] "RemoveContainer" containerID="69d7aa31523b1a5d3cb0a6fbb19fc4f5f02e1dbd3a9735ce1b60ea46936ac694"
Jul 07 17:43:25.482268 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:43:25.482251    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 07 17:43:25.482322 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:43:25.482286    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"69d7aa31523b1a5d3cb0a6fbb19fc4f5f02e1dbd3a9735ce1b60ea46936ac694"} err="failed to get container status \"69d7aa31523b1a5d3cb0a6fbb19fc4f5f02e1dbd3a9735ce1b60ea46936ac694\": rpc error: code = NotFound desc = could not find container \"69d7aa31523b1a5d3cb0a6fbb19fc4f5f02e1dbd3a9735ce1b60ea46936ac694\": container with ID starting with 69d7aa31523b1a5d3cb0a6fbb19fc4f5f02e1dbd3a9735ce1b60ea46936ac694 not found: ID does not exist"
Jul 07 17:43:25.482322 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:43:25.482299    2561 scope.go:117] "RemoveContainer" containerID="b01477e5894988ac7ad883f6eadb3149a02a593c86daf214e25cd07f0a4eaa57"
Jul 07 17:43:25.482576 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:43:25.482549    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b01477e5894988ac7ad883f6eadb3149a02a593c86daf214e25cd07f0a4eaa57"} err="failed to get container status \"b01477e5894988ac7ad883f6eadb3149a02a593c86daf214e25cd07f0a4eaa57\": rpc error: code = NotFound desc = could not find container \"b01477e5894988ac7ad883f6eadb3149a02a593c86daf214e25cd07f0a4eaa57\": container with ID starting with b01477e5894988ac7ad883f6eadb3149a02a593c86daf214e25cd07f0a4eaa57 not found: ID does not exist"
Jul 07 17:43:25.482668 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:43:25.482577    2561 scope.go:117] "RemoveContainer" containerID="9e33d3586f20dce7567e138da47ec281328b73e64d5d5bcd5fafa5ed76286a1c"
Jul 07 17:43:25.482668 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:43:25.482663    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a4e665e6-ee8a-4f4d-b733-9db5a754ff3f" containerName="thanos-sidecar"
Jul 07 17:43:25.482769 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:43:25.482675    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="a4e665e6-ee8a-4f4d-b733-9db5a754ff3f" containerName="thanos-sidecar"
Jul 07 17:43:25.482769 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:43:25.482690    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a4e665e6-ee8a-4f4d-b733-9db5a754ff3f" containerName="config-reloader"
Jul 07 17:43:25.482769 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:43:25.482699    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="a4e665e6-ee8a-4f4d-b733-9db5a754ff3f" containerName="config-reloader"
Jul 07 17:43:25.482769 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:43:25.482708    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a4e665e6-ee8a-4f4d-b733-9db5a754ff3f" containerName="kube-rbac-proxy-web"
Jul 07 17:43:25.482769 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:43:25.482717    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="a4e665e6-ee8a-4f4d-b733-9db5a754ff3f" containerName="kube-rbac-proxy-web"
Jul 07 17:43:25.482769 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:43:25.482725    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a4e665e6-ee8a-4f4d-b733-9db5a754ff3f" containerName="init-config-reloader"
Jul 07 17:43:25.482769 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:43:25.482732    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="a4e665e6-ee8a-4f4d-b733-9db5a754ff3f" containerName="init-config-reloader"
Jul 07 17:43:25.482769 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:43:25.482742    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a4e665e6-ee8a-4f4d-b733-9db5a754ff3f" containerName="kube-rbac-proxy-thanos"
Jul 07 17:43:25.482769 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:43:25.482750    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="a4e665e6-ee8a-4f4d-b733-9db5a754ff3f" containerName="kube-rbac-proxy-thanos"
Jul 07 17:43:25.482769 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:43:25.482763    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a4e665e6-ee8a-4f4d-b733-9db5a754ff3f" containerName="prometheus"
Jul 07 17:43:25.482769 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:43:25.482770    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="a4e665e6-ee8a-4f4d-b733-9db5a754ff3f" containerName="prometheus"
Jul 07 17:43:25.483157 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:43:25.482778    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="41ffd3cf-e077-4933-af1c-24ae8b0d5704" containerName="registry"
Jul 07 17:43:25.483157 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:43:25.482788    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="41ffd3cf-e077-4933-af1c-24ae8b0d5704" containerName="registry"
Jul 07 17:43:25.483157 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:43:25.482795    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a4e665e6-ee8a-4f4d-b733-9db5a754ff3f" containerName="kube-rbac-proxy"
Jul 07 17:43:25.483157 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:43:25.482800    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="a4e665e6-ee8a-4f4d-b733-9db5a754ff3f" containerName="kube-rbac-proxy"
Jul 07 17:43:25.483157 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:43:25.482794    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9e33d3586f20dce7567e138da47ec281328b73e64d5d5bcd5fafa5ed76286a1c"} err="failed to get container status \"9e33d3586f20dce7567e138da47ec281328b73e64d5d5bcd5fafa5ed76286a1c\": rpc error: code = NotFound desc = could not find container \"9e33d3586f20dce7567e138da47ec281328b73e64d5d5bcd5fafa5ed76286a1c\": container with ID starting with 9e33d3586f20dce7567e138da47ec281328b73e64d5d5bcd5fafa5ed76286a1c not found: ID does not exist"
Jul 07 17:43:25.483157 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:43:25.482812    2561 scope.go:117] "RemoveContainer" containerID="d87b55671c8630007e9a1a02992410ebd4b38e2dc1dce1a6dd3747a117b1dbd5"
Jul 07 17:43:25.483157 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:43:25.482856    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="a4e665e6-ee8a-4f4d-b733-9db5a754ff3f" containerName="thanos-sidecar"
Jul 07 17:43:25.483157 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:43:25.482865    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="a4e665e6-ee8a-4f4d-b733-9db5a754ff3f" containerName="kube-rbac-proxy"
Jul 07 17:43:25.483157 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:43:25.482872    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="41ffd3cf-e077-4933-af1c-24ae8b0d5704" containerName="registry"
Jul 07 17:43:25.483157 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:43:25.482878    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="a4e665e6-ee8a-4f4d-b733-9db5a754ff3f" containerName="config-reloader"
Jul 07 17:43:25.483157 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:43:25.482884    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="a4e665e6-ee8a-4f4d-b733-9db5a754ff3f" containerName="kube-rbac-proxy-thanos"
Jul 07 17:43:25.483157 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:43:25.482890    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="a4e665e6-ee8a-4f4d-b733-9db5a754ff3f" containerName="prometheus"
Jul 07 17:43:25.483157 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:43:25.482895    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="a4e665e6-ee8a-4f4d-b733-9db5a754ff3f" containerName="kube-rbac-proxy-web"
Jul 07 17:43:25.483157 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:43:25.482998    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d87b55671c8630007e9a1a02992410ebd4b38e2dc1dce1a6dd3747a117b1dbd5"} err="failed to get container status \"d87b55671c8630007e9a1a02992410ebd4b38e2dc1dce1a6dd3747a117b1dbd5\": rpc error: code = NotFound desc = could not find container \"d87b55671c8630007e9a1a02992410ebd4b38e2dc1dce1a6dd3747a117b1dbd5\": container with ID starting with d87b55671c8630007e9a1a02992410ebd4b38e2dc1dce1a6dd3747a117b1dbd5 not found: ID does not exist"
Jul 07 17:43:25.483157 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:43:25.483017    2561 scope.go:117] "RemoveContainer" containerID="6cd3ac82b3eb52ce0b744a86d78480d4ad2f2f5a83eab4f221ab5ca63d8e7eed"
Jul 07 17:43:25.483776 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:43:25.483249    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6cd3ac82b3eb52ce0b744a86d78480d4ad2f2f5a83eab4f221ab5ca63d8e7eed"} err="failed to get container status \"6cd3ac82b3eb52ce0b744a86d78480d4ad2f2f5a83eab4f221ab5ca63d8e7eed\": rpc error: code = NotFound desc = could not find container \"6cd3ac82b3eb52ce0b744a86d78480d4ad2f2f5a83eab4f221ab5ca63d8e7eed\": container with ID starting with 6cd3ac82b3eb52ce0b744a86d78480d4ad2f2f5a83eab4f221ab5ca63d8e7eed not found: ID does not exist"
Jul 07 17:43:25.483776 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:43:25.483263    2561 scope.go:117] "RemoveContainer" containerID="269af484b34a986e8ca63c932d2a2fba831cc25c4f1a1b86514cfa87a4cd8b0d"
Jul 07 17:43:25.483776 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:43:25.483436    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"269af484b34a986e8ca63c932d2a2fba831cc25c4f1a1b86514cfa87a4cd8b0d"} err="failed to get container status \"269af484b34a986e8ca63c932d2a2fba831cc25c4f1a1b86514cfa87a4cd8b0d\": rpc error: code = NotFound desc = could not find container \"269af484b34a986e8ca63c932d2a2fba831cc25c4f1a1b86514cfa87a4cd8b0d\": container with ID starting with 269af484b34a986e8ca63c932d2a2fba831cc25c4f1a1b86514cfa87a4cd8b0d not found: ID does not exist"
Jul 07 17:43:25.483776 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:43:25.483472    2561 scope.go:117] "RemoveContainer" containerID="aa2326f1ca1106a943bb2aebf06abdfa724fb3c3c5792a2e074aaa0d0bda1b47"
Jul 07 17:43:25.483776 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:43:25.483688    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"aa2326f1ca1106a943bb2aebf06abdfa724fb3c3c5792a2e074aaa0d0bda1b47"} err="failed to get container status \"aa2326f1ca1106a943bb2aebf06abdfa724fb3c3c5792a2e074aaa0d0bda1b47\": rpc error: code = NotFound desc = could not find container \"aa2326f1ca1106a943bb2aebf06abdfa724fb3c3c5792a2e074aaa0d0bda1b47\": container with ID starting with aa2326f1ca1106a943bb2aebf06abdfa724fb3c3c5792a2e074aaa0d0bda1b47 not found: ID does not exist"
Jul 07 17:43:25.483776 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:43:25.483709    2561 scope.go:117] "RemoveContainer" containerID="69d7aa31523b1a5d3cb0a6fbb19fc4f5f02e1dbd3a9735ce1b60ea46936ac694"
Jul 07 17:43:25.484145 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:43:25.484028    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"69d7aa31523b1a5d3cb0a6fbb19fc4f5f02e1dbd3a9735ce1b60ea46936ac694"} err="failed to get container status \"69d7aa31523b1a5d3cb0a6fbb19fc4f5f02e1dbd3a9735ce1b60ea46936ac694\": rpc error: code = NotFound desc = could not find container \"69d7aa31523b1a5d3cb0a6fbb19fc4f5f02e1dbd3a9735ce1b60ea46936ac694\": container with ID starting with 69d7aa31523b1a5d3cb0a6fbb19fc4f5f02e1dbd3a9735ce1b60ea46936ac694 not found: ID does not exist"
Jul 07 17:43:25.484145 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:43:25.484084    2561 scope.go:117] "RemoveContainer" containerID="b01477e5894988ac7ad883f6eadb3149a02a593c86daf214e25cd07f0a4eaa57"
Jul 07 17:43:25.484406 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:43:25.484377    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b01477e5894988ac7ad883f6eadb3149a02a593c86daf214e25cd07f0a4eaa57"} err="failed to get container status \"b01477e5894988ac7ad883f6eadb3149a02a593c86daf214e25cd07f0a4eaa57\": rpc error: code = NotFound desc = could not find container \"b01477e5894988ac7ad883f6eadb3149a02a593c86daf214e25cd07f0a4eaa57\": container with ID starting with b01477e5894988ac7ad883f6eadb3149a02a593c86daf214e25cd07f0a4eaa57 not found: ID does not exist"
Jul 07 17:43:25.484501 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:43:25.484408    2561 scope.go:117] "RemoveContainer" containerID="9e33d3586f20dce7567e138da47ec281328b73e64d5d5bcd5fafa5ed76286a1c"
Jul 07 17:43:25.484777 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:43:25.484752    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9e33d3586f20dce7567e138da47ec281328b73e64d5d5bcd5fafa5ed76286a1c"} err="failed to get container status \"9e33d3586f20dce7567e138da47ec281328b73e64d5d5bcd5fafa5ed76286a1c\": rpc error: code = NotFound desc = could not find container \"9e33d3586f20dce7567e138da47ec281328b73e64d5d5bcd5fafa5ed76286a1c\": container with ID starting with 9e33d3586f20dce7567e138da47ec281328b73e64d5d5bcd5fafa5ed76286a1c not found: ID does not exist"
Jul 07 17:43:25.484861 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:43:25.484776    2561 scope.go:117] "RemoveContainer" containerID="d87b55671c8630007e9a1a02992410ebd4b38e2dc1dce1a6dd3747a117b1dbd5"
Jul 07 17:43:25.485008 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:43:25.484990    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d87b55671c8630007e9a1a02992410ebd4b38e2dc1dce1a6dd3747a117b1dbd5"} err="failed to get container status \"d87b55671c8630007e9a1a02992410ebd4b38e2dc1dce1a6dd3747a117b1dbd5\": rpc error: code = NotFound desc = could not find container \"d87b55671c8630007e9a1a02992410ebd4b38e2dc1dce1a6dd3747a117b1dbd5\": container with ID starting with d87b55671c8630007e9a1a02992410ebd4b38e2dc1dce1a6dd3747a117b1dbd5 not found: ID does not exist"
Jul 07 17:43:25.485008 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:43:25.485006    2561 scope.go:117] "RemoveContainer" containerID="6cd3ac82b3eb52ce0b744a86d78480d4ad2f2f5a83eab4f221ab5ca63d8e7eed"
Jul 07 17:43:25.485223 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:43:25.485206    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6cd3ac82b3eb52ce0b744a86d78480d4ad2f2f5a83eab4f221ab5ca63d8e7eed"} err="failed to get container status \"6cd3ac82b3eb52ce0b744a86d78480d4ad2f2f5a83eab4f221ab5ca63d8e7eed\": rpc error: code = NotFound desc = could not find container \"6cd3ac82b3eb52ce0b744a86d78480d4ad2f2f5a83eab4f221ab5ca63d8e7eed\": container with ID starting with 6cd3ac82b3eb52ce0b744a86d78480d4ad2f2f5a83eab4f221ab5ca63d8e7eed not found: ID does not exist"
Jul 07 17:43:25.485312 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:43:25.485224    2561 scope.go:117] "RemoveContainer" containerID="269af484b34a986e8ca63c932d2a2fba831cc25c4f1a1b86514cfa87a4cd8b0d"
Jul 07 17:43:25.485467 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:43:25.485426    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"269af484b34a986e8ca63c932d2a2fba831cc25c4f1a1b86514cfa87a4cd8b0d"} err="failed to get container status \"269af484b34a986e8ca63c932d2a2fba831cc25c4f1a1b86514cfa87a4cd8b0d\": rpc error: code = NotFound desc = could not find container \"269af484b34a986e8ca63c932d2a2fba831cc25c4f1a1b86514cfa87a4cd8b0d\": container with ID starting with 269af484b34a986e8ca63c932d2a2fba831cc25c4f1a1b86514cfa87a4cd8b0d not found: ID does not exist"
Jul 07 17:43:25.485467 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:43:25.485464    2561 scope.go:117] "RemoveContainer" containerID="aa2326f1ca1106a943bb2aebf06abdfa724fb3c3c5792a2e074aaa0d0bda1b47"
Jul 07 17:43:25.485672 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:43:25.485656    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"aa2326f1ca1106a943bb2aebf06abdfa724fb3c3c5792a2e074aaa0d0bda1b47"} err="failed to get container status \"aa2326f1ca1106a943bb2aebf06abdfa724fb3c3c5792a2e074aaa0d0bda1b47\": rpc error: code = NotFound desc = could not find container \"aa2326f1ca1106a943bb2aebf06abdfa724fb3c3c5792a2e074aaa0d0bda1b47\": container with ID starting with aa2326f1ca1106a943bb2aebf06abdfa724fb3c3c5792a2e074aaa0d0bda1b47 not found: ID does not exist"
Jul 07 17:43:25.485715 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:43:25.485673    2561 scope.go:117] "RemoveContainer" containerID="69d7aa31523b1a5d3cb0a6fbb19fc4f5f02e1dbd3a9735ce1b60ea46936ac694"
Jul 07 17:43:25.485880 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:43:25.485863    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"69d7aa31523b1a5d3cb0a6fbb19fc4f5f02e1dbd3a9735ce1b60ea46936ac694"} err="failed to get container status \"69d7aa31523b1a5d3cb0a6fbb19fc4f5f02e1dbd3a9735ce1b60ea46936ac694\": rpc error: code = NotFound desc = could not find container \"69d7aa31523b1a5d3cb0a6fbb19fc4f5f02e1dbd3a9735ce1b60ea46936ac694\": container with ID starting with 69d7aa31523b1a5d3cb0a6fbb19fc4f5f02e1dbd3a9735ce1b60ea46936ac694 not found: ID does not exist"
Jul 07 17:43:25.485921 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:43:25.485880    2561 scope.go:117] "RemoveContainer" containerID="b01477e5894988ac7ad883f6eadb3149a02a593c86daf214e25cd07f0a4eaa57"
Jul 07 17:43:25.486073 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:43:25.486057    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b01477e5894988ac7ad883f6eadb3149a02a593c86daf214e25cd07f0a4eaa57"} err="failed to get container status \"b01477e5894988ac7ad883f6eadb3149a02a593c86daf214e25cd07f0a4eaa57\": rpc error: code = NotFound desc = could not find container \"b01477e5894988ac7ad883f6eadb3149a02a593c86daf214e25cd07f0a4eaa57\": container with ID starting with b01477e5894988ac7ad883f6eadb3149a02a593c86daf214e25cd07f0a4eaa57 not found: ID does not exist"
Jul 07 17:43:25.486117 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:43:25.486073    2561 scope.go:117] "RemoveContainer" containerID="9e33d3586f20dce7567e138da47ec281328b73e64d5d5bcd5fafa5ed76286a1c"
Jul 07 17:43:25.486252 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:43:25.486237    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9e33d3586f20dce7567e138da47ec281328b73e64d5d5bcd5fafa5ed76286a1c"} err="failed to get container status \"9e33d3586f20dce7567e138da47ec281328b73e64d5d5bcd5fafa5ed76286a1c\": rpc error: code = NotFound desc = could not find container \"9e33d3586f20dce7567e138da47ec281328b73e64d5d5bcd5fafa5ed76286a1c\": container with ID starting with 9e33d3586f20dce7567e138da47ec281328b73e64d5d5bcd5fafa5ed76286a1c not found: ID does not exist"
Jul 07 17:43:25.486252 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:43:25.486251    2561 scope.go:117] "RemoveContainer" containerID="d87b55671c8630007e9a1a02992410ebd4b38e2dc1dce1a6dd3747a117b1dbd5"
Jul 07 17:43:25.486438 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:43:25.486424    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d87b55671c8630007e9a1a02992410ebd4b38e2dc1dce1a6dd3747a117b1dbd5"} err="failed to get container status \"d87b55671c8630007e9a1a02992410ebd4b38e2dc1dce1a6dd3747a117b1dbd5\": rpc error: code = NotFound desc = could not find container \"d87b55671c8630007e9a1a02992410ebd4b38e2dc1dce1a6dd3747a117b1dbd5\": container with ID starting with d87b55671c8630007e9a1a02992410ebd4b38e2dc1dce1a6dd3747a117b1dbd5 not found: ID does not exist"
Jul 07 17:43:25.486438 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:43:25.486438    2561 scope.go:117] "RemoveContainer" containerID="6cd3ac82b3eb52ce0b744a86d78480d4ad2f2f5a83eab4f221ab5ca63d8e7eed"
Jul 07 17:43:25.486627 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:43:25.486613    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6cd3ac82b3eb52ce0b744a86d78480d4ad2f2f5a83eab4f221ab5ca63d8e7eed"} err="failed to get container status \"6cd3ac82b3eb52ce0b744a86d78480d4ad2f2f5a83eab4f221ab5ca63d8e7eed\": rpc error: code = NotFound desc = could not find container \"6cd3ac82b3eb52ce0b744a86d78480d4ad2f2f5a83eab4f221ab5ca63d8e7eed\": container with ID starting with 6cd3ac82b3eb52ce0b744a86d78480d4ad2f2f5a83eab4f221ab5ca63d8e7eed not found: ID does not exist"
Jul 07 17:43:25.486681 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:43:25.486628    2561 scope.go:117] "RemoveContainer" containerID="269af484b34a986e8ca63c932d2a2fba831cc25c4f1a1b86514cfa87a4cd8b0d"
Jul 07 17:43:25.486807 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:43:25.486790    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"269af484b34a986e8ca63c932d2a2fba831cc25c4f1a1b86514cfa87a4cd8b0d"} err="failed to get container status \"269af484b34a986e8ca63c932d2a2fba831cc25c4f1a1b86514cfa87a4cd8b0d\": rpc error: code = NotFound desc = could not find container \"269af484b34a986e8ca63c932d2a2fba831cc25c4f1a1b86514cfa87a4cd8b0d\": container with ID starting with 269af484b34a986e8ca63c932d2a2fba831cc25c4f1a1b86514cfa87a4cd8b0d not found: ID does not exist"
Jul 07 17:43:25.486845 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:43:25.486808    2561 scope.go:117] "RemoveContainer" containerID="aa2326f1ca1106a943bb2aebf06abdfa724fb3c3c5792a2e074aaa0d0bda1b47"
Jul 07 17:43:25.486985 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:43:25.486962    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"aa2326f1ca1106a943bb2aebf06abdfa724fb3c3c5792a2e074aaa0d0bda1b47"} err="failed to get container status \"aa2326f1ca1106a943bb2aebf06abdfa724fb3c3c5792a2e074aaa0d0bda1b47\": rpc error: code = NotFound desc = could not find container \"aa2326f1ca1106a943bb2aebf06abdfa724fb3c3c5792a2e074aaa0d0bda1b47\": container with ID starting with aa2326f1ca1106a943bb2aebf06abdfa724fb3c3c5792a2e074aaa0d0bda1b47 not found: ID does not exist"
Jul 07 17:43:25.487033 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:43:25.486985    2561 scope.go:117] "RemoveContainer" containerID="69d7aa31523b1a5d3cb0a6fbb19fc4f5f02e1dbd3a9735ce1b60ea46936ac694"
Jul 07 17:43:25.487183 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:43:25.487169    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"69d7aa31523b1a5d3cb0a6fbb19fc4f5f02e1dbd3a9735ce1b60ea46936ac694"} err="failed to get container status \"69d7aa31523b1a5d3cb0a6fbb19fc4f5f02e1dbd3a9735ce1b60ea46936ac694\": rpc error: code = NotFound desc = could not find container \"69d7aa31523b1a5d3cb0a6fbb19fc4f5f02e1dbd3a9735ce1b60ea46936ac694\": container with ID starting with 69d7aa31523b1a5d3cb0a6fbb19fc4f5f02e1dbd3a9735ce1b60ea46936ac694 not found: ID does not exist"
Jul 07 17:43:25.487245 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:43:25.487183    2561 scope.go:117] "RemoveContainer" containerID="b01477e5894988ac7ad883f6eadb3149a02a593c86daf214e25cd07f0a4eaa57"
Jul 07 17:43:25.487355 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:43:25.487339    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b01477e5894988ac7ad883f6eadb3149a02a593c86daf214e25cd07f0a4eaa57"} err="failed to get container status \"b01477e5894988ac7ad883f6eadb3149a02a593c86daf214e25cd07f0a4eaa57\": rpc error: code = NotFound desc = could not find container \"b01477e5894988ac7ad883f6eadb3149a02a593c86daf214e25cd07f0a4eaa57\": container with ID starting with b01477e5894988ac7ad883f6eadb3149a02a593c86daf214e25cd07f0a4eaa57 not found: ID does not exist"
Jul 07 17:43:25.487355 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:43:25.487354    2561 scope.go:117] "RemoveContainer" containerID="9e33d3586f20dce7567e138da47ec281328b73e64d5d5bcd5fafa5ed76286a1c"
Jul 07 17:43:25.487548 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:43:25.487535    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9e33d3586f20dce7567e138da47ec281328b73e64d5d5bcd5fafa5ed76286a1c"} err="failed to get container status \"9e33d3586f20dce7567e138da47ec281328b73e64d5d5bcd5fafa5ed76286a1c\": rpc error: code = NotFound desc = could not find container \"9e33d3586f20dce7567e138da47ec281328b73e64d5d5bcd5fafa5ed76286a1c\": container with ID starting with 9e33d3586f20dce7567e138da47ec281328b73e64d5d5bcd5fafa5ed76286a1c not found: ID does not exist"
Jul 07 17:43:25.487587 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:43:25.487548    2561 scope.go:117] "RemoveContainer" containerID="d87b55671c8630007e9a1a02992410ebd4b38e2dc1dce1a6dd3747a117b1dbd5"
Jul 07 17:43:25.487720 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:43:25.487707    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d87b55671c8630007e9a1a02992410ebd4b38e2dc1dce1a6dd3747a117b1dbd5"} err="failed to get container status \"d87b55671c8630007e9a1a02992410ebd4b38e2dc1dce1a6dd3747a117b1dbd5\": rpc error: code = NotFound desc = could not find container \"d87b55671c8630007e9a1a02992410ebd4b38e2dc1dce1a6dd3747a117b1dbd5\": container with ID starting with d87b55671c8630007e9a1a02992410ebd4b38e2dc1dce1a6dd3747a117b1dbd5 not found: ID does not exist"
Jul 07 17:43:25.487759 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:43:25.487720    2561 scope.go:117] "RemoveContainer" containerID="6cd3ac82b3eb52ce0b744a86d78480d4ad2f2f5a83eab4f221ab5ca63d8e7eed"
Jul 07 17:43:25.487916 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:43:25.487901    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6cd3ac82b3eb52ce0b744a86d78480d4ad2f2f5a83eab4f221ab5ca63d8e7eed"} err="failed to get container status \"6cd3ac82b3eb52ce0b744a86d78480d4ad2f2f5a83eab4f221ab5ca63d8e7eed\": rpc error: code = NotFound desc = could not find container \"6cd3ac82b3eb52ce0b744a86d78480d4ad2f2f5a83eab4f221ab5ca63d8e7eed\": container with ID starting with 6cd3ac82b3eb52ce0b744a86d78480d4ad2f2f5a83eab4f221ab5ca63d8e7eed not found: ID does not exist"
Jul 07 17:43:25.488011 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:43:25.487998    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 17:43:25.491082 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:43:25.491054    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
Jul 07 17:43:25.491334 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:43:25.491315    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
Jul 07 17:43:25.491424 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:43:25.491410    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Jul 07 17:43:25.491492 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:43:25.491469    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\""
Jul 07 17:43:25.491581 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:43:25.491568    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-6bve8g1l5vfrc\""
Jul 07 17:43:25.491633 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:43:25.491614    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
Jul 07 17:43:25.491925 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:43:25.491902    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
Jul 07 17:43:25.492059 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:43:25.491913    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
Jul 07 17:43:25.492059 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:43:25.491913    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-7qw74\""
Jul 07 17:43:25.492059 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:43:25.491950    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\""
Jul 07 17:43:25.492522 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:43:25.492504    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
Jul 07 17:43:25.492606 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:43:25.492529    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
Jul 07 17:43:25.492662 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:43:25.492622    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
Jul 07 17:43:25.492708 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:43:25.492688    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
Jul 07 17:43:25.492757 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:43:25.492728    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
Jul 07 17:43:25.498846 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:43:25.498611    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
Jul 07 17:43:25.502368 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:43:25.501929    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
Jul 07 17:43:25.502368 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:43:25.502260    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 07 17:43:25.519899 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:43:25.519865    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a4e665e6-ee8a-4f4d-b733-9db5a754ff3f" path="/var/lib/kubelet/pods/a4e665e6-ee8a-4f4d-b733-9db5a754ff3f/volumes"
Jul 07 17:43:25.637626 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:43:25.637582    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/74596f1d-2d37-4bae-824c-d3a4b90f6957-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"74596f1d-2d37-4bae-824c-d3a4b90f6957\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 17:43:25.637626 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:43:25.637624    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/74596f1d-2d37-4bae-824c-d3a4b90f6957-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"74596f1d-2d37-4bae-824c-d3a4b90f6957\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 17:43:25.637848 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:43:25.637681    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/74596f1d-2d37-4bae-824c-d3a4b90f6957-config\") pod \"prometheus-k8s-0\" (UID: \"74596f1d-2d37-4bae-824c-d3a4b90f6957\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 17:43:25.637848 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:43:25.637721    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/74596f1d-2d37-4bae-824c-d3a4b90f6957-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"74596f1d-2d37-4bae-824c-d3a4b90f6957\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 17:43:25.637848 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:43:25.637745    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/74596f1d-2d37-4bae-824c-d3a4b90f6957-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"74596f1d-2d37-4bae-824c-d3a4b90f6957\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 17:43:25.637848 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:43:25.637760    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/74596f1d-2d37-4bae-824c-d3a4b90f6957-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"74596f1d-2d37-4bae-824c-d3a4b90f6957\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 17:43:25.637848 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:43:25.637778    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/74596f1d-2d37-4bae-824c-d3a4b90f6957-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"74596f1d-2d37-4bae-824c-d3a4b90f6957\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 17:43:25.637848 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:43:25.637821    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/74596f1d-2d37-4bae-824c-d3a4b90f6957-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"74596f1d-2d37-4bae-824c-d3a4b90f6957\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 17:43:25.637848 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:43:25.637842    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/74596f1d-2d37-4bae-824c-d3a4b90f6957-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"74596f1d-2d37-4bae-824c-d3a4b90f6957\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 17:43:25.638156 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:43:25.637860    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/74596f1d-2d37-4bae-824c-d3a4b90f6957-config-out\") pod \"prometheus-k8s-0\" (UID: \"74596f1d-2d37-4bae-824c-d3a4b90f6957\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 17:43:25.638156 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:43:25.637875    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/74596f1d-2d37-4bae-824c-d3a4b90f6957-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"74596f1d-2d37-4bae-824c-d3a4b90f6957\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 17:43:25.638156 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:43:25.637891    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/74596f1d-2d37-4bae-824c-d3a4b90f6957-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"74596f1d-2d37-4bae-824c-d3a4b90f6957\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 17:43:25.638156 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:43:25.637907    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/74596f1d-2d37-4bae-824c-d3a4b90f6957-web-config\") pod \"prometheus-k8s-0\" (UID: \"74596f1d-2d37-4bae-824c-d3a4b90f6957\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 17:43:25.638156 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:43:25.637921    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/74596f1d-2d37-4bae-824c-d3a4b90f6957-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"74596f1d-2d37-4bae-824c-d3a4b90f6957\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 17:43:25.638156 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:43:25.638002    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/74596f1d-2d37-4bae-824c-d3a4b90f6957-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"74596f1d-2d37-4bae-824c-d3a4b90f6957\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 17:43:25.638156 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:43:25.638034    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zwz5d\" (UniqueName: \"kubernetes.io/projected/74596f1d-2d37-4bae-824c-d3a4b90f6957-kube-api-access-zwz5d\") pod \"prometheus-k8s-0\" (UID: \"74596f1d-2d37-4bae-824c-d3a4b90f6957\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 17:43:25.638156 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:43:25.638061    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/74596f1d-2d37-4bae-824c-d3a4b90f6957-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"74596f1d-2d37-4bae-824c-d3a4b90f6957\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 17:43:25.638156 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:43:25.638098    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/74596f1d-2d37-4bae-824c-d3a4b90f6957-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"74596f1d-2d37-4bae-824c-d3a4b90f6957\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 17:43:25.638156 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:43:25.638133    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/74596f1d-2d37-4bae-824c-d3a4b90f6957-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"74596f1d-2d37-4bae-824c-d3a4b90f6957\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 17:43:25.638156 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:43:25.638156    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/74596f1d-2d37-4bae-824c-d3a4b90f6957-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"74596f1d-2d37-4bae-824c-d3a4b90f6957\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 17:43:25.738837 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:43:25.738752    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/74596f1d-2d37-4bae-824c-d3a4b90f6957-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"74596f1d-2d37-4bae-824c-d3a4b90f6957\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 17:43:25.738837 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:43:25.738794    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/74596f1d-2d37-4bae-824c-d3a4b90f6957-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"74596f1d-2d37-4bae-824c-d3a4b90f6957\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 17:43:25.738837 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:43:25.738815    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/74596f1d-2d37-4bae-824c-d3a4b90f6957-config-out\") pod \"prometheus-k8s-0\" (UID: \"74596f1d-2d37-4bae-824c-d3a4b90f6957\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 17:43:25.738837 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:43:25.738834    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/74596f1d-2d37-4bae-824c-d3a4b90f6957-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"74596f1d-2d37-4bae-824c-d3a4b90f6957\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 17:43:25.739159 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:43:25.738856    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/74596f1d-2d37-4bae-824c-d3a4b90f6957-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"74596f1d-2d37-4bae-824c-d3a4b90f6957\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 17:43:25.739159 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:43:25.738876    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/74596f1d-2d37-4bae-824c-d3a4b90f6957-web-config\") pod \"prometheus-k8s-0\" (UID: \"74596f1d-2d37-4bae-824c-d3a4b90f6957\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 17:43:25.739159 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:43:25.738892    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/74596f1d-2d37-4bae-824c-d3a4b90f6957-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"74596f1d-2d37-4bae-824c-d3a4b90f6957\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 17:43:25.739159 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:43:25.738976    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/74596f1d-2d37-4bae-824c-d3a4b90f6957-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"74596f1d-2d37-4bae-824c-d3a4b90f6957\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 17:43:25.739159 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:43:25.739015    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zwz5d\" (UniqueName: \"kubernetes.io/projected/74596f1d-2d37-4bae-824c-d3a4b90f6957-kube-api-access-zwz5d\") pod \"prometheus-k8s-0\" (UID: \"74596f1d-2d37-4bae-824c-d3a4b90f6957\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 17:43:25.739159 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:43:25.739042    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/74596f1d-2d37-4bae-824c-d3a4b90f6957-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"74596f1d-2d37-4bae-824c-d3a4b90f6957\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 17:43:25.739159 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:43:25.739075    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/74596f1d-2d37-4bae-824c-d3a4b90f6957-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"74596f1d-2d37-4bae-824c-d3a4b90f6957\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 17:43:25.739159 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:43:25.739099    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/74596f1d-2d37-4bae-824c-d3a4b90f6957-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"74596f1d-2d37-4bae-824c-d3a4b90f6957\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 17:43:25.739159 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:43:25.739119    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/74596f1d-2d37-4bae-824c-d3a4b90f6957-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"74596f1d-2d37-4bae-824c-d3a4b90f6957\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 17:43:25.739159 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:43:25.739159    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/74596f1d-2d37-4bae-824c-d3a4b90f6957-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"74596f1d-2d37-4bae-824c-d3a4b90f6957\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 17:43:25.739685 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:43:25.739185    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/74596f1d-2d37-4bae-824c-d3a4b90f6957-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"74596f1d-2d37-4bae-824c-d3a4b90f6957\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 17:43:25.739685 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:43:25.739222    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/74596f1d-2d37-4bae-824c-d3a4b90f6957-config\") pod \"prometheus-k8s-0\" (UID: \"74596f1d-2d37-4bae-824c-d3a4b90f6957\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 17:43:25.739685 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:43:25.739256    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/74596f1d-2d37-4bae-824c-d3a4b90f6957-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"74596f1d-2d37-4bae-824c-d3a4b90f6957\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 17:43:25.739685 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:43:25.739290    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/74596f1d-2d37-4bae-824c-d3a4b90f6957-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"74596f1d-2d37-4bae-824c-d3a4b90f6957\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 17:43:25.739685 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:43:25.739314    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/74596f1d-2d37-4bae-824c-d3a4b90f6957-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"74596f1d-2d37-4bae-824c-d3a4b90f6957\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 17:43:25.739685 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:43:25.739341    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/74596f1d-2d37-4bae-824c-d3a4b90f6957-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"74596f1d-2d37-4bae-824c-d3a4b90f6957\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 17:43:25.739685 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:43:25.739672    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/74596f1d-2d37-4bae-824c-d3a4b90f6957-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"74596f1d-2d37-4bae-824c-d3a4b90f6957\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 17:43:25.741861 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:43:25.739786    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/74596f1d-2d37-4bae-824c-d3a4b90f6957-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"74596f1d-2d37-4bae-824c-d3a4b90f6957\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 17:43:25.741861 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:43:25.740184    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/74596f1d-2d37-4bae-824c-d3a4b90f6957-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"74596f1d-2d37-4bae-824c-d3a4b90f6957\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 17:43:25.741861 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:43:25.740313    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/74596f1d-2d37-4bae-824c-d3a4b90f6957-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"74596f1d-2d37-4bae-824c-d3a4b90f6957\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 17:43:25.741861 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:43:25.740401    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/74596f1d-2d37-4bae-824c-d3a4b90f6957-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"74596f1d-2d37-4bae-824c-d3a4b90f6957\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 17:43:25.741861 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:43:25.740648    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/74596f1d-2d37-4bae-824c-d3a4b90f6957-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"74596f1d-2d37-4bae-824c-d3a4b90f6957\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 17:43:25.741861 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:43:25.741341    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/74596f1d-2d37-4bae-824c-d3a4b90f6957-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"74596f1d-2d37-4bae-824c-d3a4b90f6957\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 17:43:25.741861 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:43:25.741651    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/74596f1d-2d37-4bae-824c-d3a4b90f6957-config-out\") pod \"prometheus-k8s-0\" (UID: \"74596f1d-2d37-4bae-824c-d3a4b90f6957\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 17:43:25.743439 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:43:25.743406    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/74596f1d-2d37-4bae-824c-d3a4b90f6957-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"74596f1d-2d37-4bae-824c-d3a4b90f6957\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 17:43:25.743584 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:43:25.743413    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/74596f1d-2d37-4bae-824c-d3a4b90f6957-web-config\") pod \"prometheus-k8s-0\" (UID: \"74596f1d-2d37-4bae-824c-d3a4b90f6957\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 17:43:25.743732 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:43:25.743713    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/74596f1d-2d37-4bae-824c-d3a4b90f6957-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"74596f1d-2d37-4bae-824c-d3a4b90f6957\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 17:43:25.743985 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:43:25.743961    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/74596f1d-2d37-4bae-824c-d3a4b90f6957-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"74596f1d-2d37-4bae-824c-d3a4b90f6957\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 17:43:25.744062 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:43:25.744037    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/74596f1d-2d37-4bae-824c-d3a4b90f6957-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"74596f1d-2d37-4bae-824c-d3a4b90f6957\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 17:43:25.744157 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:43:25.744131    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/74596f1d-2d37-4bae-824c-d3a4b90f6957-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"74596f1d-2d37-4bae-824c-d3a4b90f6957\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 17:43:25.744575 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:43:25.744544    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/74596f1d-2d37-4bae-824c-d3a4b90f6957-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"74596f1d-2d37-4bae-824c-d3a4b90f6957\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 17:43:25.744575 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:43:25.744548    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/74596f1d-2d37-4bae-824c-d3a4b90f6957-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"74596f1d-2d37-4bae-824c-d3a4b90f6957\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 17:43:25.744879 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:43:25.744858    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/74596f1d-2d37-4bae-824c-d3a4b90f6957-config\") pod \"prometheus-k8s-0\" (UID: \"74596f1d-2d37-4bae-824c-d3a4b90f6957\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 17:43:25.744940 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:43:25.744858    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/74596f1d-2d37-4bae-824c-d3a4b90f6957-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"74596f1d-2d37-4bae-824c-d3a4b90f6957\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 17:43:25.744940 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:43:25.744918    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/74596f1d-2d37-4bae-824c-d3a4b90f6957-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"74596f1d-2d37-4bae-824c-d3a4b90f6957\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 17:43:25.751424 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:43:25.751405    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zwz5d\" (UniqueName: \"kubernetes.io/projected/74596f1d-2d37-4bae-824c-d3a4b90f6957-kube-api-access-zwz5d\") pod \"prometheus-k8s-0\" (UID: \"74596f1d-2d37-4bae-824c-d3a4b90f6957\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 17:43:25.799592 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:43:25.799556    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 17:43:25.953466 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:43:25.953410    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 07 17:43:25.956841 ip-10-0-139-31 kubenswrapper[2561]: W0707 17:43:25.956812    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod74596f1d_2d37_4bae_824c_d3a4b90f6957.slice/crio-4507681cd92703bc1b82a4de89b713c2b7c06c89fa6fbd61f26ec2bed8a0c53a WatchSource:0}: Error finding container 4507681cd92703bc1b82a4de89b713c2b7c06c89fa6fbd61f26ec2bed8a0c53a: Status 404 returned error can't find the container with id 4507681cd92703bc1b82a4de89b713c2b7c06c89fa6fbd61f26ec2bed8a0c53a
Jul 07 17:43:26.430718 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:43:26.430682    2561 generic.go:356] "Generic (PLEG): container finished" podID="74596f1d-2d37-4bae-824c-d3a4b90f6957" containerID="9aacd6da3e1f1a667e21b80afd148ce17272604e8c868d00dc7ada29d6b56d6d" exitCode=0
Jul 07 17:43:26.430718 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:43:26.430721    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"74596f1d-2d37-4bae-824c-d3a4b90f6957","Type":"ContainerDied","Data":"9aacd6da3e1f1a667e21b80afd148ce17272604e8c868d00dc7ada29d6b56d6d"}
Jul 07 17:43:26.430926 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:43:26.430774    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"74596f1d-2d37-4bae-824c-d3a4b90f6957","Type":"ContainerStarted","Data":"4507681cd92703bc1b82a4de89b713c2b7c06c89fa6fbd61f26ec2bed8a0c53a"}
Jul 07 17:43:27.438517 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:43:27.438475    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"74596f1d-2d37-4bae-824c-d3a4b90f6957","Type":"ContainerStarted","Data":"7d07a4cb32694fcb7ce73bad495d1af6d7ab9ff3268bab81d7ad8ede285c676d"}
Jul 07 17:43:27.438940 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:43:27.438561    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"74596f1d-2d37-4bae-824c-d3a4b90f6957","Type":"ContainerStarted","Data":"4c7852f6e6935ffab814860b9b4cd307f37140c81ee2bb2dcc17daa165e59479"}
Jul 07 17:43:27.438940 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:43:27.438600    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"74596f1d-2d37-4bae-824c-d3a4b90f6957","Type":"ContainerStarted","Data":"e971cf238160734547f116ec713da34c5750ba0bd98ff5a2b08d8829e05c4f8c"}
Jul 07 17:43:27.438940 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:43:27.438639    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"74596f1d-2d37-4bae-824c-d3a4b90f6957","Type":"ContainerStarted","Data":"b400ac90cc13d48c9e8068ecea055b8d235961b8e3d0b71b86588ff6b54d4130"}
Jul 07 17:43:27.438940 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:43:27.438683    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"74596f1d-2d37-4bae-824c-d3a4b90f6957","Type":"ContainerStarted","Data":"4272f3d03844e113118dba98b27229d6c3e7a7032da78f5dc36f278bd194e557"}
Jul 07 17:43:27.438940 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:43:27.438725    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"74596f1d-2d37-4bae-824c-d3a4b90f6957","Type":"ContainerStarted","Data":"e185670a50477ae61a296c8bf98395962b92d7093416d12371ff3559bfe29252"}
Jul 07 17:43:27.476314 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:43:27.476252    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.457727089 podStartE2EDuration="2.476236766s" totalImagesPullingTime="0s" totalInitContainerRuntime="18.509677ms" isStatefulPod=false podCreationTimestamp="2026-07-07 17:43:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 17:43:27.470540331 +0000 UTC m=+198.621664730" watchObservedRunningTime="2026-07-07 17:43:27.476236766 +0000 UTC m=+198.627361165"
Jul 07 17:43:30.800127 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:43:30.800081    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 17:44:25.800438 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:44:25.800390    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 17:44:25.816049 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:44:25.816023    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 17:44:26.691289 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:44:26.691249    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 17:45:09.276658 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:45:09.276620    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-bjl48_805597ff-168d-4099-95b8-0037b0ceba2f/console-operator/1.log"
Jul 07 17:45:09.284630 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:45:09.284603    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-bjl48_805597ff-168d-4099-95b8-0037b0ceba2f/console-operator/1.log"
Jul 07 17:45:09.288138 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:45:09.288116    2561 kubelet.go:1648] "Image garbage collection succeeded"
Jul 07 17:45:10.854424 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:45:10.854389    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-d698b7b5d-4pznt"]
Jul 07 17:45:10.857704 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:45:10.857686    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-d698b7b5d-4pznt"
Jul 07 17:45:10.861277 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:45:10.861249    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Jul 07 17:45:10.861277 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:45:10.861250    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Jul 07 17:45:10.861505 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:45:10.861313    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-lvxjn\""
Jul 07 17:45:10.861599 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:45:10.861584    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Jul 07 17:45:10.862063 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:45:10.862047    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Jul 07 17:45:10.887841 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:45:10.884185    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-d698b7b5d-4pznt"]
Jul 07 17:45:10.918003 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:45:10.917963    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/f7ec3e55-c3b6-485d-acde-df0c6790ce1e-apiservice-cert\") pod \"opendatahub-operator-controller-manager-d698b7b5d-4pznt\" (UID: \"f7ec3e55-c3b6-485d-acde-df0c6790ce1e\") " pod="opendatahub/opendatahub-operator-controller-manager-d698b7b5d-4pznt"
Jul 07 17:45:10.918190 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:45:10.918010    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/f7ec3e55-c3b6-485d-acde-df0c6790ce1e-manifests\") pod \"opendatahub-operator-controller-manager-d698b7b5d-4pznt\" (UID: \"f7ec3e55-c3b6-485d-acde-df0c6790ce1e\") " pod="opendatahub/opendatahub-operator-controller-manager-d698b7b5d-4pznt"
Jul 07 17:45:10.918190 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:45:10.918097    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f7ec3e55-c3b6-485d-acde-df0c6790ce1e-tmp\") pod \"opendatahub-operator-controller-manager-d698b7b5d-4pznt\" (UID: \"f7ec3e55-c3b6-485d-acde-df0c6790ce1e\") " pod="opendatahub/opendatahub-operator-controller-manager-d698b7b5d-4pznt"
Jul 07 17:45:10.918190 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:45:10.918134    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/f7ec3e55-c3b6-485d-acde-df0c6790ce1e-webhook-cert\") pod \"opendatahub-operator-controller-manager-d698b7b5d-4pznt\" (UID: \"f7ec3e55-c3b6-485d-acde-df0c6790ce1e\") " pod="opendatahub/opendatahub-operator-controller-manager-d698b7b5d-4pznt"
Jul 07 17:45:10.918190 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:45:10.918165    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hw4kw\" (UniqueName: \"kubernetes.io/projected/f7ec3e55-c3b6-485d-acde-df0c6790ce1e-kube-api-access-hw4kw\") pod \"opendatahub-operator-controller-manager-d698b7b5d-4pznt\" (UID: \"f7ec3e55-c3b6-485d-acde-df0c6790ce1e\") " pod="opendatahub/opendatahub-operator-controller-manager-d698b7b5d-4pznt"
Jul 07 17:45:11.019628 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:45:11.019587    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f7ec3e55-c3b6-485d-acde-df0c6790ce1e-tmp\") pod \"opendatahub-operator-controller-manager-d698b7b5d-4pznt\" (UID: \"f7ec3e55-c3b6-485d-acde-df0c6790ce1e\") " pod="opendatahub/opendatahub-operator-controller-manager-d698b7b5d-4pznt"
Jul 07 17:45:11.019831 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:45:11.019639    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/f7ec3e55-c3b6-485d-acde-df0c6790ce1e-webhook-cert\") pod \"opendatahub-operator-controller-manager-d698b7b5d-4pznt\" (UID: \"f7ec3e55-c3b6-485d-acde-df0c6790ce1e\") " pod="opendatahub/opendatahub-operator-controller-manager-d698b7b5d-4pznt"
Jul 07 17:45:11.019831 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:45:11.019677    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hw4kw\" (UniqueName: \"kubernetes.io/projected/f7ec3e55-c3b6-485d-acde-df0c6790ce1e-kube-api-access-hw4kw\") pod \"opendatahub-operator-controller-manager-d698b7b5d-4pznt\" (UID: \"f7ec3e55-c3b6-485d-acde-df0c6790ce1e\") " pod="opendatahub/opendatahub-operator-controller-manager-d698b7b5d-4pznt"
Jul 07 17:45:11.019831 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:45:11.019716    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/f7ec3e55-c3b6-485d-acde-df0c6790ce1e-apiservice-cert\") pod \"opendatahub-operator-controller-manager-d698b7b5d-4pznt\" (UID: \"f7ec3e55-c3b6-485d-acde-df0c6790ce1e\") " pod="opendatahub/opendatahub-operator-controller-manager-d698b7b5d-4pznt"
Jul 07 17:45:11.019983 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:45:11.019897    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/f7ec3e55-c3b6-485d-acde-df0c6790ce1e-manifests\") pod \"opendatahub-operator-controller-manager-d698b7b5d-4pznt\" (UID: \"f7ec3e55-c3b6-485d-acde-df0c6790ce1e\") " pod="opendatahub/opendatahub-operator-controller-manager-d698b7b5d-4pznt"
Jul 07 17:45:11.020270 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:45:11.020242    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/f7ec3e55-c3b6-485d-acde-df0c6790ce1e-manifests\") pod \"opendatahub-operator-controller-manager-d698b7b5d-4pznt\" (UID: \"f7ec3e55-c3b6-485d-acde-df0c6790ce1e\") " pod="opendatahub/opendatahub-operator-controller-manager-d698b7b5d-4pznt"
Jul 07 17:45:11.022034 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:45:11.022013    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f7ec3e55-c3b6-485d-acde-df0c6790ce1e-tmp\") pod \"opendatahub-operator-controller-manager-d698b7b5d-4pznt\" (UID: \"f7ec3e55-c3b6-485d-acde-df0c6790ce1e\") " pod="opendatahub/opendatahub-operator-controller-manager-d698b7b5d-4pznt"
Jul 07 17:45:11.022117 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:45:11.022097    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/f7ec3e55-c3b6-485d-acde-df0c6790ce1e-apiservice-cert\") pod \"opendatahub-operator-controller-manager-d698b7b5d-4pznt\" (UID: \"f7ec3e55-c3b6-485d-acde-df0c6790ce1e\") " pod="opendatahub/opendatahub-operator-controller-manager-d698b7b5d-4pznt"
Jul 07 17:45:11.022156 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:45:11.022113    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/f7ec3e55-c3b6-485d-acde-df0c6790ce1e-webhook-cert\") pod \"opendatahub-operator-controller-manager-d698b7b5d-4pznt\" (UID: \"f7ec3e55-c3b6-485d-acde-df0c6790ce1e\") " pod="opendatahub/opendatahub-operator-controller-manager-d698b7b5d-4pznt"
Jul 07 17:45:11.030875 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:45:11.030850    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hw4kw\" (UniqueName: \"kubernetes.io/projected/f7ec3e55-c3b6-485d-acde-df0c6790ce1e-kube-api-access-hw4kw\") pod \"opendatahub-operator-controller-manager-d698b7b5d-4pznt\" (UID: \"f7ec3e55-c3b6-485d-acde-df0c6790ce1e\") " pod="opendatahub/opendatahub-operator-controller-manager-d698b7b5d-4pznt"
Jul 07 17:45:11.168984 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:45:11.168892    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-d698b7b5d-4pznt"
Jul 07 17:45:11.333893 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:45:11.333866    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-d698b7b5d-4pznt"]
Jul 07 17:45:11.336274 ip-10-0-139-31 kubenswrapper[2561]: W0707 17:45:11.336240    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf7ec3e55_c3b6_485d_acde_df0c6790ce1e.slice/crio-c35293a968b9a51ac9221e2a94717e380d26db96d95a0d07e70b9608d7d3a76f WatchSource:0}: Error finding container c35293a968b9a51ac9221e2a94717e380d26db96d95a0d07e70b9608d7d3a76f: Status 404 returned error can't find the container with id c35293a968b9a51ac9221e2a94717e380d26db96d95a0d07e70b9608d7d3a76f
Jul 07 17:45:11.338300 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:45:11.338273    2561 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 07 17:45:11.851643 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:45:11.851606    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-d698b7b5d-4pznt" event={"ID":"f7ec3e55-c3b6-485d-acde-df0c6790ce1e","Type":"ContainerStarted","Data":"c35293a968b9a51ac9221e2a94717e380d26db96d95a0d07e70b9608d7d3a76f"}
Jul 07 17:45:14.867716 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:45:14.867681    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-d698b7b5d-4pznt" event={"ID":"f7ec3e55-c3b6-485d-acde-df0c6790ce1e","Type":"ContainerStarted","Data":"9172008ef1757bea4ebfcd109863dd3fa509c74d9ff0d5ecd4c1b20058909601"}
Jul 07 17:45:15.873609 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:45:15.873523    2561 generic.go:356] "Generic (PLEG): container finished" podID="f7ec3e55-c3b6-485d-acde-df0c6790ce1e" containerID="9172008ef1757bea4ebfcd109863dd3fa509c74d9ff0d5ecd4c1b20058909601" exitCode=0
Jul 07 17:45:15.873972 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:45:15.873607    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-d698b7b5d-4pznt" event={"ID":"f7ec3e55-c3b6-485d-acde-df0c6790ce1e","Type":"ContainerDied","Data":"9172008ef1757bea4ebfcd109863dd3fa509c74d9ff0d5ecd4c1b20058909601"}
Jul 07 17:45:16.879739 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:45:16.879704    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-d698b7b5d-4pznt" event={"ID":"f7ec3e55-c3b6-485d-acde-df0c6790ce1e","Type":"ContainerStarted","Data":"47c5f42c3626c984ab2e24ac711bdf73de10595e65fd91361f92cc01d8b83c34"}
Jul 07 17:45:16.880130 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:45:16.879798    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-d698b7b5d-4pznt"
Jul 07 17:45:16.910097 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:45:16.910044    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-d698b7b5d-4pznt" podStartSLOduration=2.397619786 podStartE2EDuration="6.910026756s" totalImagesPullingTime="3.447965519s" totalInitContainerRuntime="1.064441451s" isStatefulPod=false podCreationTimestamp="2026-07-07 17:45:10 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 17:45:16.908437516 +0000 UTC m=+308.059561913" watchObservedRunningTime="2026-07-07 17:45:16.910026756 +0000 UTC m=+308.061151154"
Jul 07 17:45:27.889491 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:45:27.889436    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-d698b7b5d-4pznt"
Jul 07 17:45:28.437153 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:45:28.437113    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-85d9cbc876-lchdw"]
Jul 07 17:45:28.452352 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:45:28.452315    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-85d9cbc876-lchdw"
Jul 07 17:45:28.454817 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:45:28.454783    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-85d9cbc876-lchdw"]
Jul 07 17:45:28.460215 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:45:28.459892    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Jul 07 17:45:28.460215 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:45:28.459977    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\""
Jul 07 17:45:28.461208 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:45:28.461187    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Jul 07 17:45:28.461332 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:45:28.461262    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\""
Jul 07 17:45:28.461419 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:45:28.461346    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\""
Jul 07 17:45:28.461419 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:45:28.461364    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-jlmhz\""
Jul 07 17:45:28.580152 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:45:28.580110    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/1c02957d-3c0e-4e0f-a7d8-95907c357013-manager-config\") pod \"lws-controller-manager-85d9cbc876-lchdw\" (UID: \"1c02957d-3c0e-4e0f-a7d8-95907c357013\") " pod="openshift-lws-operator/lws-controller-manager-85d9cbc876-lchdw"
Jul 07 17:45:28.580350 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:45:28.580161    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tvvnr\" (UniqueName: \"kubernetes.io/projected/1c02957d-3c0e-4e0f-a7d8-95907c357013-kube-api-access-tvvnr\") pod \"lws-controller-manager-85d9cbc876-lchdw\" (UID: \"1c02957d-3c0e-4e0f-a7d8-95907c357013\") " pod="openshift-lws-operator/lws-controller-manager-85d9cbc876-lchdw"
Jul 07 17:45:28.580350 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:45:28.580192    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/1c02957d-3c0e-4e0f-a7d8-95907c357013-metrics-cert\") pod \"lws-controller-manager-85d9cbc876-lchdw\" (UID: \"1c02957d-3c0e-4e0f-a7d8-95907c357013\") " pod="openshift-lws-operator/lws-controller-manager-85d9cbc876-lchdw"
Jul 07 17:45:28.580350 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:45:28.580285    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1c02957d-3c0e-4e0f-a7d8-95907c357013-cert\") pod \"lws-controller-manager-85d9cbc876-lchdw\" (UID: \"1c02957d-3c0e-4e0f-a7d8-95907c357013\") " pod="openshift-lws-operator/lws-controller-manager-85d9cbc876-lchdw"
Jul 07 17:45:28.681019 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:45:28.680977    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1c02957d-3c0e-4e0f-a7d8-95907c357013-cert\") pod \"lws-controller-manager-85d9cbc876-lchdw\" (UID: \"1c02957d-3c0e-4e0f-a7d8-95907c357013\") " pod="openshift-lws-operator/lws-controller-manager-85d9cbc876-lchdw"
Jul 07 17:45:28.681185 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:45:28.681036    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/1c02957d-3c0e-4e0f-a7d8-95907c357013-manager-config\") pod \"lws-controller-manager-85d9cbc876-lchdw\" (UID: \"1c02957d-3c0e-4e0f-a7d8-95907c357013\") " pod="openshift-lws-operator/lws-controller-manager-85d9cbc876-lchdw"
Jul 07 17:45:28.681185 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:45:28.681073    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tvvnr\" (UniqueName: \"kubernetes.io/projected/1c02957d-3c0e-4e0f-a7d8-95907c357013-kube-api-access-tvvnr\") pod \"lws-controller-manager-85d9cbc876-lchdw\" (UID: \"1c02957d-3c0e-4e0f-a7d8-95907c357013\") " pod="openshift-lws-operator/lws-controller-manager-85d9cbc876-lchdw"
Jul 07 17:45:28.681185 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:45:28.681096    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/1c02957d-3c0e-4e0f-a7d8-95907c357013-metrics-cert\") pod \"lws-controller-manager-85d9cbc876-lchdw\" (UID: \"1c02957d-3c0e-4e0f-a7d8-95907c357013\") " pod="openshift-lws-operator/lws-controller-manager-85d9cbc876-lchdw"
Jul 07 17:45:28.681864 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:45:28.681840    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/1c02957d-3c0e-4e0f-a7d8-95907c357013-manager-config\") pod \"lws-controller-manager-85d9cbc876-lchdw\" (UID: \"1c02957d-3c0e-4e0f-a7d8-95907c357013\") " pod="openshift-lws-operator/lws-controller-manager-85d9cbc876-lchdw"
Jul 07 17:45:28.683697 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:45:28.683674    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/1c02957d-3c0e-4e0f-a7d8-95907c357013-metrics-cert\") pod \"lws-controller-manager-85d9cbc876-lchdw\" (UID: \"1c02957d-3c0e-4e0f-a7d8-95907c357013\") " pod="openshift-lws-operator/lws-controller-manager-85d9cbc876-lchdw"
Jul 07 17:45:28.683799 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:45:28.683716    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1c02957d-3c0e-4e0f-a7d8-95907c357013-cert\") pod \"lws-controller-manager-85d9cbc876-lchdw\" (UID: \"1c02957d-3c0e-4e0f-a7d8-95907c357013\") " pod="openshift-lws-operator/lws-controller-manager-85d9cbc876-lchdw"
Jul 07 17:45:28.695864 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:45:28.695797    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tvvnr\" (UniqueName: \"kubernetes.io/projected/1c02957d-3c0e-4e0f-a7d8-95907c357013-kube-api-access-tvvnr\") pod \"lws-controller-manager-85d9cbc876-lchdw\" (UID: \"1c02957d-3c0e-4e0f-a7d8-95907c357013\") " pod="openshift-lws-operator/lws-controller-manager-85d9cbc876-lchdw"
Jul 07 17:45:28.763508 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:45:28.763470    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-85d9cbc876-lchdw"
Jul 07 17:45:28.897820 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:45:28.897790    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-85d9cbc876-lchdw"]
Jul 07 17:45:28.901168 ip-10-0-139-31 kubenswrapper[2561]: W0707 17:45:28.901133    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1c02957d_3c0e_4e0f_a7d8_95907c357013.slice/crio-833645a33c9157ad0d40f8a5e0a81fcd6b366842dbae1ec1fd40281a659cda48 WatchSource:0}: Error finding container 833645a33c9157ad0d40f8a5e0a81fcd6b366842dbae1ec1fd40281a659cda48: Status 404 returned error can't find the container with id 833645a33c9157ad0d40f8a5e0a81fcd6b366842dbae1ec1fd40281a659cda48
Jul 07 17:45:28.934216 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:45:28.934176    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-85d9cbc876-lchdw" event={"ID":"1c02957d-3c0e-4e0f-a7d8-95907c357013","Type":"ContainerStarted","Data":"833645a33c9157ad0d40f8a5e0a81fcd6b366842dbae1ec1fd40281a659cda48"}
Jul 07 17:45:31.827851 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:45:31.827813    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-544cc96c69-tj7pn"]
Jul 07 17:45:31.831358 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:45:31.831331    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-544cc96c69-tj7pn"
Jul 07 17:45:31.842057 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:45:31.842029    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-27bmn\""
Jul 07 17:45:31.842190 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:45:31.842081    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jul 07 17:45:31.842190 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:45:31.842037    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
Jul 07 17:45:31.842190 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:45:31.842039    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Jul 07 17:45:31.842190 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:45:31.842039    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jul 07 17:45:31.857544 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:45:31.857512    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-544cc96c69-tj7pn"]
Jul 07 17:45:31.911713 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:45:31.911681    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f4ce81ff-ae67-41c1-999e-d1768163a94e-tls-certs\") pod \"kube-auth-proxy-544cc96c69-tj7pn\" (UID: \"f4ce81ff-ae67-41c1-999e-d1768163a94e\") " pod="openshift-ingress/kube-auth-proxy-544cc96c69-tj7pn"
Jul 07 17:45:31.911900 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:45:31.911725    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f4ce81ff-ae67-41c1-999e-d1768163a94e-tmp\") pod \"kube-auth-proxy-544cc96c69-tj7pn\" (UID: \"f4ce81ff-ae67-41c1-999e-d1768163a94e\") " pod="openshift-ingress/kube-auth-proxy-544cc96c69-tj7pn"
Jul 07 17:45:31.911900 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:45:31.911848    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xtp4r\" (UniqueName: \"kubernetes.io/projected/f4ce81ff-ae67-41c1-999e-d1768163a94e-kube-api-access-xtp4r\") pod \"kube-auth-proxy-544cc96c69-tj7pn\" (UID: \"f4ce81ff-ae67-41c1-999e-d1768163a94e\") " pod="openshift-ingress/kube-auth-proxy-544cc96c69-tj7pn"
Jul 07 17:45:31.954394 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:45:31.954351    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-85d9cbc876-lchdw" event={"ID":"1c02957d-3c0e-4e0f-a7d8-95907c357013","Type":"ContainerStarted","Data":"68b17a7faeaf2f095c382c82d2ce3ca45c6ee5868c15e4dcebc9e38f7bd360a7"}
Jul 07 17:45:31.954563 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:45:31.954428    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-85d9cbc876-lchdw"
Jul 07 17:45:31.984899 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:45:31.984396    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-85d9cbc876-lchdw" podStartSLOduration=1.3526793019999999 podStartE2EDuration="3.984376066s" totalImagesPullingTime="2.631696764s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 17:45:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 17:45:31.983527579 +0000 UTC m=+323.134651989" watchObservedRunningTime="2026-07-07 17:45:31.984376066 +0000 UTC m=+323.135500465"
Jul 07 17:45:32.012629 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:45:32.012584    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xtp4r\" (UniqueName: \"kubernetes.io/projected/f4ce81ff-ae67-41c1-999e-d1768163a94e-kube-api-access-xtp4r\") pod \"kube-auth-proxy-544cc96c69-tj7pn\" (UID: \"f4ce81ff-ae67-41c1-999e-d1768163a94e\") " pod="openshift-ingress/kube-auth-proxy-544cc96c69-tj7pn"
Jul 07 17:45:32.012840 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:45:32.012637    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f4ce81ff-ae67-41c1-999e-d1768163a94e-tls-certs\") pod \"kube-auth-proxy-544cc96c69-tj7pn\" (UID: \"f4ce81ff-ae67-41c1-999e-d1768163a94e\") " pod="openshift-ingress/kube-auth-proxy-544cc96c69-tj7pn"
Jul 07 17:45:32.012840 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:45:32.012690    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f4ce81ff-ae67-41c1-999e-d1768163a94e-tmp\") pod \"kube-auth-proxy-544cc96c69-tj7pn\" (UID: \"f4ce81ff-ae67-41c1-999e-d1768163a94e\") " pod="openshift-ingress/kube-auth-proxy-544cc96c69-tj7pn"
Jul 07 17:45:32.015705 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:45:32.015671    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f4ce81ff-ae67-41c1-999e-d1768163a94e-tmp\") pod \"kube-auth-proxy-544cc96c69-tj7pn\" (UID: \"f4ce81ff-ae67-41c1-999e-d1768163a94e\") " pod="openshift-ingress/kube-auth-proxy-544cc96c69-tj7pn"
Jul 07 17:45:32.015872 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:45:32.015854    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f4ce81ff-ae67-41c1-999e-d1768163a94e-tls-certs\") pod \"kube-auth-proxy-544cc96c69-tj7pn\" (UID: \"f4ce81ff-ae67-41c1-999e-d1768163a94e\") " pod="openshift-ingress/kube-auth-proxy-544cc96c69-tj7pn"
Jul 07 17:45:32.032740 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:45:32.032699    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xtp4r\" (UniqueName: \"kubernetes.io/projected/f4ce81ff-ae67-41c1-999e-d1768163a94e-kube-api-access-xtp4r\") pod \"kube-auth-proxy-544cc96c69-tj7pn\" (UID: \"f4ce81ff-ae67-41c1-999e-d1768163a94e\") " pod="openshift-ingress/kube-auth-proxy-544cc96c69-tj7pn"
Jul 07 17:45:32.141851 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:45:32.141756    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-544cc96c69-tj7pn"
Jul 07 17:45:32.294466 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:45:32.294374    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-544cc96c69-tj7pn"]
Jul 07 17:45:32.298350 ip-10-0-139-31 kubenswrapper[2561]: W0707 17:45:32.298317    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf4ce81ff_ae67_41c1_999e_d1768163a94e.slice/crio-da5bd5f0d634fe46afb1024833612611451d6a1667efb34a1d7e0e7e6fd96d4f WatchSource:0}: Error finding container da5bd5f0d634fe46afb1024833612611451d6a1667efb34a1d7e0e7e6fd96d4f: Status 404 returned error can't find the container with id da5bd5f0d634fe46afb1024833612611451d6a1667efb34a1d7e0e7e6fd96d4f
Jul 07 17:45:32.960133 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:45:32.960096    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-544cc96c69-tj7pn" event={"ID":"f4ce81ff-ae67-41c1-999e-d1768163a94e","Type":"ContainerStarted","Data":"da5bd5f0d634fe46afb1024833612611451d6a1667efb34a1d7e0e7e6fd96d4f"}
Jul 07 17:45:35.976573 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:45:35.976536    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-544cc96c69-tj7pn" event={"ID":"f4ce81ff-ae67-41c1-999e-d1768163a94e","Type":"ContainerStarted","Data":"10bdff0342c93fd4920c62fa519f39f53612c087f09d68afcffd057eb32969ae"}
Jul 07 17:45:35.993986 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:45:35.993925    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-544cc96c69-tj7pn" podStartSLOduration=1.846826737 podStartE2EDuration="4.993905854s" totalImagesPullingTime="3.147079117s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 17:45:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 17:45:35.992706963 +0000 UTC m=+327.143831362" watchObservedRunningTime="2026-07-07 17:45:35.993905854 +0000 UTC m=+327.145030251"
Jul 07 17:45:42.962512 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:45:42.962482    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-85d9cbc876-lchdw"
Jul 07 17:47:07.921244 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:47:07.921202    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-btxxb"]
Jul 07 17:47:07.924671 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:47:07.924653    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-btxxb"
Jul 07 17:47:07.927411 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:47:07.927386    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\""
Jul 07 17:47:07.927646 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:47:07.927622    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 07 17:47:07.928660 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:47:07.928645    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 07 17:47:07.928727 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:47:07.928647    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-2nrwr\""
Jul 07 17:47:07.937610 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:47:07.937582    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-btxxb"]
Jul 07 17:47:08.057872 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:47:08.057836    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7bdvr\" (UniqueName: \"kubernetes.io/projected/f72d56b4-96bd-46b1-83d0-b40c7802ea7f-kube-api-access-7bdvr\") pod \"dns-operator-controller-manager-864dd78c4c-btxxb\" (UID: \"f72d56b4-96bd-46b1-83d0-b40c7802ea7f\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-btxxb"
Jul 07 17:47:08.158519 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:47:08.158475    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7bdvr\" (UniqueName: \"kubernetes.io/projected/f72d56b4-96bd-46b1-83d0-b40c7802ea7f-kube-api-access-7bdvr\") pod \"dns-operator-controller-manager-864dd78c4c-btxxb\" (UID: \"f72d56b4-96bd-46b1-83d0-b40c7802ea7f\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-btxxb"
Jul 07 17:47:08.168157 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:47:08.168126    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7bdvr\" (UniqueName: \"kubernetes.io/projected/f72d56b4-96bd-46b1-83d0-b40c7802ea7f-kube-api-access-7bdvr\") pod \"dns-operator-controller-manager-864dd78c4c-btxxb\" (UID: \"f72d56b4-96bd-46b1-83d0-b40c7802ea7f\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-btxxb"
Jul 07 17:47:08.234999 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:47:08.234873    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-btxxb"
Jul 07 17:47:08.408765 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:47:08.408578    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-btxxb"]
Jul 07 17:47:08.412377 ip-10-0-139-31 kubenswrapper[2561]: W0707 17:47:08.412343    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf72d56b4_96bd_46b1_83d0_b40c7802ea7f.slice/crio-88806457f59c0f0836f3cf57a5349013a23781ce4b0fd66e20ad2055accf62b2 WatchSource:0}: Error finding container 88806457f59c0f0836f3cf57a5349013a23781ce4b0fd66e20ad2055accf62b2: Status 404 returned error can't find the container with id 88806457f59c0f0836f3cf57a5349013a23781ce4b0fd66e20ad2055accf62b2
Jul 07 17:47:09.400101 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:47:09.400067    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-btxxb" event={"ID":"f72d56b4-96bd-46b1-83d0-b40c7802ea7f","Type":"ContainerStarted","Data":"88806457f59c0f0836f3cf57a5349013a23781ce4b0fd66e20ad2055accf62b2"}
Jul 07 17:47:10.566178 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:47:10.566155    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\""
Jul 07 17:47:11.412954 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:47:11.412909    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-btxxb" event={"ID":"f72d56b4-96bd-46b1-83d0-b40c7802ea7f","Type":"ContainerStarted","Data":"cab674f40067a31f0ee3f2264c6cda3f254d57ead425790fd96a889c72ea2d0f"}
Jul 07 17:47:11.413172 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:47:11.413035    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-btxxb"
Jul 07 17:47:11.436787 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:47:11.436727    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-btxxb" podStartSLOduration=2.288276359 podStartE2EDuration="4.436710048s" totalImagesPullingTime="2.148433689s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 17:47:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 17:47:11.43422191 +0000 UTC m=+422.585346313" watchObservedRunningTime="2026-07-07 17:47:11.436710048 +0000 UTC m=+422.587834456"
Jul 07 17:47:12.604094 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:47:12.604057    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-l59dh"]
Jul 07 17:47:12.607423 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:47:12.607405    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-l59dh"
Jul 07 17:47:12.610573 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:47:12.610554    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"plugin-serving-cert\""
Jul 07 17:47:12.610573 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:47:12.610571    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-zbn5v\""
Jul 07 17:47:12.610762 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:47:12.610571    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kuadrant-console-nginx-conf\""
Jul 07 17:47:12.620384 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:47:12.620360    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-l59dh"]
Jul 07 17:47:12.701747 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:47:12.701702    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rk2jm\" (UniqueName: \"kubernetes.io/projected/041ebf77-dd23-4183-9039-cde1734514f0-kube-api-access-rk2jm\") pod \"kuadrant-console-plugin-66b5774985-l59dh\" (UID: \"041ebf77-dd23-4183-9039-cde1734514f0\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-l59dh"
Jul 07 17:47:12.701923 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:47:12.701816    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/041ebf77-dd23-4183-9039-cde1734514f0-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-l59dh\" (UID: \"041ebf77-dd23-4183-9039-cde1734514f0\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-l59dh"
Jul 07 17:47:12.701923 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:47:12.701862    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/041ebf77-dd23-4183-9039-cde1734514f0-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-l59dh\" (UID: \"041ebf77-dd23-4183-9039-cde1734514f0\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-l59dh"
Jul 07 17:47:12.802246 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:47:12.802199    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/041ebf77-dd23-4183-9039-cde1734514f0-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-l59dh\" (UID: \"041ebf77-dd23-4183-9039-cde1734514f0\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-l59dh"
Jul 07 17:47:12.802429 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:47:12.802278    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/041ebf77-dd23-4183-9039-cde1734514f0-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-l59dh\" (UID: \"041ebf77-dd23-4183-9039-cde1734514f0\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-l59dh"
Jul 07 17:47:12.802429 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:47:12.802324    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rk2jm\" (UniqueName: \"kubernetes.io/projected/041ebf77-dd23-4183-9039-cde1734514f0-kube-api-access-rk2jm\") pod \"kuadrant-console-plugin-66b5774985-l59dh\" (UID: \"041ebf77-dd23-4183-9039-cde1734514f0\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-l59dh"
Jul 07 17:47:12.802937 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:47:12.802918    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/041ebf77-dd23-4183-9039-cde1734514f0-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-l59dh\" (UID: \"041ebf77-dd23-4183-9039-cde1734514f0\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-l59dh"
Jul 07 17:47:12.804669 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:47:12.804640    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/041ebf77-dd23-4183-9039-cde1734514f0-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-l59dh\" (UID: \"041ebf77-dd23-4183-9039-cde1734514f0\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-l59dh"
Jul 07 17:47:12.811695 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:47:12.811671    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rk2jm\" (UniqueName: \"kubernetes.io/projected/041ebf77-dd23-4183-9039-cde1734514f0-kube-api-access-rk2jm\") pod \"kuadrant-console-plugin-66b5774985-l59dh\" (UID: \"041ebf77-dd23-4183-9039-cde1734514f0\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-l59dh"
Jul 07 17:47:12.916732 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:47:12.916637    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-l59dh"
Jul 07 17:47:13.065026 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:47:13.064997    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-l59dh"]
Jul 07 17:47:13.066898 ip-10-0-139-31 kubenswrapper[2561]: W0707 17:47:13.066867    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod041ebf77_dd23_4183_9039_cde1734514f0.slice/crio-391621a6c79849c9cbd8ad7dcacfe4edda35c3acd82a43a8805390763b6e716c WatchSource:0}: Error finding container 391621a6c79849c9cbd8ad7dcacfe4edda35c3acd82a43a8805390763b6e716c: Status 404 returned error can't find the container with id 391621a6c79849c9cbd8ad7dcacfe4edda35c3acd82a43a8805390763b6e716c
Jul 07 17:47:13.423589 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:47:13.423554    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-l59dh" event={"ID":"041ebf77-dd23-4183-9039-cde1734514f0","Type":"ContainerStarted","Data":"391621a6c79849c9cbd8ad7dcacfe4edda35c3acd82a43a8805390763b6e716c"}
Jul 07 17:47:22.420248 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:47:22.420213    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-btxxb"
Jul 07 17:47:23.817051 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:47:23.817014    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-bnj87"]
Jul 07 17:47:23.839173 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:47:23.839137    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-bnj87"
Jul 07 17:47:23.841383 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:47:23.841350    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-bnj87"]
Jul 07 17:47:23.843908 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:47:23.843841    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-z6zdb\""
Jul 07 17:47:23.910041 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:47:23.910002    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-msttv\" (UniqueName: \"kubernetes.io/projected/2c516c91-6b7b-440c-9554-dc60c8503394-kube-api-access-msttv\") pod \"limitador-operator-controller-manager-859d7b78bd-bnj87\" (UID: \"2c516c91-6b7b-440c-9554-dc60c8503394\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-bnj87"
Jul 07 17:47:24.010731 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:47:24.010692    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-msttv\" (UniqueName: \"kubernetes.io/projected/2c516c91-6b7b-440c-9554-dc60c8503394-kube-api-access-msttv\") pod \"limitador-operator-controller-manager-859d7b78bd-bnj87\" (UID: \"2c516c91-6b7b-440c-9554-dc60c8503394\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-bnj87"
Jul 07 17:47:24.032834 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:47:24.032795    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-msttv\" (UniqueName: \"kubernetes.io/projected/2c516c91-6b7b-440c-9554-dc60c8503394-kube-api-access-msttv\") pod \"limitador-operator-controller-manager-859d7b78bd-bnj87\" (UID: \"2c516c91-6b7b-440c-9554-dc60c8503394\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-bnj87"
Jul 07 17:47:24.153837 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:47:24.153735    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-bnj87"
Jul 07 17:47:36.476018 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:47:36.475982    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-bnj87"]
Jul 07 17:47:36.479168 ip-10-0-139-31 kubenswrapper[2561]: W0707 17:47:36.479136    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2c516c91_6b7b_440c_9554_dc60c8503394.slice/crio-2c6eb02dfb19910d59feca5602d03ebbe29ca0ea4068b6b8bfebf5ac3b17de94 WatchSource:0}: Error finding container 2c6eb02dfb19910d59feca5602d03ebbe29ca0ea4068b6b8bfebf5ac3b17de94: Status 404 returned error can't find the container with id 2c6eb02dfb19910d59feca5602d03ebbe29ca0ea4068b6b8bfebf5ac3b17de94
Jul 07 17:47:36.551435 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:47:36.551401    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-bnj87" event={"ID":"2c516c91-6b7b-440c-9554-dc60c8503394","Type":"ContainerStarted","Data":"2c6eb02dfb19910d59feca5602d03ebbe29ca0ea4068b6b8bfebf5ac3b17de94"}
Jul 07 17:47:37.557396 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:47:37.557359    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-l59dh" event={"ID":"041ebf77-dd23-4183-9039-cde1734514f0","Type":"ContainerStarted","Data":"6ff8d9dcc96170ca39be1158cc761fe9d833da257837576474b23471e9d5d182"}
Jul 07 17:47:37.591133 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:47:37.591071    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-l59dh" podStartSLOduration=1.9208510730000001 podStartE2EDuration="25.591054364s" totalImagesPullingTime="23.670203291s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 17:47:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 17:47:37.590654502 +0000 UTC m=+448.741778900" watchObservedRunningTime="2026-07-07 17:47:37.591054364 +0000 UTC m=+448.742178761"
Jul 07 17:47:41.579192 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:47:41.579156    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-bnj87" event={"ID":"2c516c91-6b7b-440c-9554-dc60c8503394","Type":"ContainerStarted","Data":"75a9a090ab0b7293c7abec3d293505940a051bd0106a44251bdc37280afd4292"}
Jul 07 17:47:41.579671 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:47:41.579269    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-bnj87"
Jul 07 17:47:41.628998 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:47:41.628945    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-bnj87" podStartSLOduration=14.135545927 podStartE2EDuration="18.628928804s" totalImagesPullingTime="4.493382877s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 17:47:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 17:47:41.627195154 +0000 UTC m=+452.778319553" watchObservedRunningTime="2026-07-07 17:47:41.628928804 +0000 UTC m=+452.780053202"
Jul 07 17:47:52.586640 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:47:52.586610    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-bnj87"
Jul 07 17:47:57.041410 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:47:57.041370    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-75d556bd77-tmzsh"]
Jul 07 17:47:57.056327 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:47:57.056296    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-tmzsh"
Jul 07 17:47:57.062850 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:47:57.062484    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-vx6wg\""
Jul 07 17:47:57.079639 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:47:57.079611    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-tmzsh"]
Jul 07 17:47:57.111467 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:47:57.111404    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hj6x7\" (UniqueName: \"kubernetes.io/projected/7fafa7fc-c63f-438b-9799-74d72a57cd36-kube-api-access-hj6x7\") pod \"authorino-75d556bd77-tmzsh\" (UID: \"7fafa7fc-c63f-438b-9799-74d72a57cd36\") " pod="kuadrant-system/authorino-75d556bd77-tmzsh"
Jul 07 17:47:57.212525 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:47:57.212490    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hj6x7\" (UniqueName: \"kubernetes.io/projected/7fafa7fc-c63f-438b-9799-74d72a57cd36-kube-api-access-hj6x7\") pod \"authorino-75d556bd77-tmzsh\" (UID: \"7fafa7fc-c63f-438b-9799-74d72a57cd36\") " pod="kuadrant-system/authorino-75d556bd77-tmzsh"
Jul 07 17:47:57.230360 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:47:57.230324    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hj6x7\" (UniqueName: \"kubernetes.io/projected/7fafa7fc-c63f-438b-9799-74d72a57cd36-kube-api-access-hj6x7\") pod \"authorino-75d556bd77-tmzsh\" (UID: \"7fafa7fc-c63f-438b-9799-74d72a57cd36\") " pod="kuadrant-system/authorino-75d556bd77-tmzsh"
Jul 07 17:47:57.365460 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:47:57.365417    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-tmzsh"
Jul 07 17:47:57.522717 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:47:57.522684    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-tmzsh"]
Jul 07 17:47:57.526819 ip-10-0-139-31 kubenswrapper[2561]: W0707 17:47:57.526791    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod7fafa7fc_c63f_438b_9799_74d72a57cd36.slice/crio-96bc87f3daffe4b1f4fdb3b131a2b0db6fbc7f006ad14e5916e43b33776b1fef WatchSource:0}: Error finding container 96bc87f3daffe4b1f4fdb3b131a2b0db6fbc7f006ad14e5916e43b33776b1fef: Status 404 returned error can't find the container with id 96bc87f3daffe4b1f4fdb3b131a2b0db6fbc7f006ad14e5916e43b33776b1fef
Jul 07 17:47:57.654768 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:47:57.654681    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-tmzsh" event={"ID":"7fafa7fc-c63f-438b-9799-74d72a57cd36","Type":"ContainerStarted","Data":"96bc87f3daffe4b1f4fdb3b131a2b0db6fbc7f006ad14e5916e43b33776b1fef"}
Jul 07 17:48:00.670866 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:48:00.670767    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-tmzsh" event={"ID":"7fafa7fc-c63f-438b-9799-74d72a57cd36","Type":"ContainerStarted","Data":"d7afdff7a5594a37c070d906122c542babad4235b339ba13a224196b5cc9386c"}
Jul 07 17:48:00.697323 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:48:00.697262    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-75d556bd77-tmzsh" podStartSLOduration=0.809964164 podStartE2EDuration="3.697247334s" totalImagesPullingTime="2.88728317s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 17:47:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 17:48:00.696708904 +0000 UTC m=+471.847833303" watchObservedRunningTime="2026-07-07 17:48:00.697247334 +0000 UTC m=+471.848371732"
Jul 07 17:48:30.618046 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:48:30.618011    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-7c665bfb88-w6hrq"]
Jul 07 17:48:30.674682 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:48:30.674644    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7c665bfb88-w6hrq"]
Jul 07 17:48:30.674852 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:48:30.674755    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7c665bfb88-w6hrq"
Jul 07 17:48:30.806876 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:48:30.806836    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4kzlj\" (UniqueName: \"kubernetes.io/projected/6d539f5b-3353-4c5d-9e1c-eae7e91ff0f6-kube-api-access-4kzlj\") pod \"authorino-7c665bfb88-w6hrq\" (UID: \"6d539f5b-3353-4c5d-9e1c-eae7e91ff0f6\") " pod="kuadrant-system/authorino-7c665bfb88-w6hrq"
Jul 07 17:48:30.908146 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:48:30.908056    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4kzlj\" (UniqueName: \"kubernetes.io/projected/6d539f5b-3353-4c5d-9e1c-eae7e91ff0f6-kube-api-access-4kzlj\") pod \"authorino-7c665bfb88-w6hrq\" (UID: \"6d539f5b-3353-4c5d-9e1c-eae7e91ff0f6\") " pod="kuadrant-system/authorino-7c665bfb88-w6hrq"
Jul 07 17:48:30.921119 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:48:30.921086    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4kzlj\" (UniqueName: \"kubernetes.io/projected/6d539f5b-3353-4c5d-9e1c-eae7e91ff0f6-kube-api-access-4kzlj\") pod \"authorino-7c665bfb88-w6hrq\" (UID: \"6d539f5b-3353-4c5d-9e1c-eae7e91ff0f6\") " pod="kuadrant-system/authorino-7c665bfb88-w6hrq"
Jul 07 17:48:30.933373 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:48:30.933343    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-7c665bfb88-w6hrq"]
Jul 07 17:48:30.933641 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:48:30.933626    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7c665bfb88-w6hrq"
Jul 07 17:48:30.978288 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:48:30.978256    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-969f48648-6lflj"]
Jul 07 17:48:30.981913 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:48:30.981890    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-969f48648-6lflj"
Jul 07 17:48:30.985265 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:48:30.985197    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\""
Jul 07 17:48:30.995370 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:48:30.995311    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-969f48648-6lflj"]
Jul 07 17:48:31.092034 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:48:31.091999    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-7c665bfb88-w6hrq"]
Jul 07 17:48:31.096071 ip-10-0-139-31 kubenswrapper[2561]: W0707 17:48:31.096036    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod6d539f5b_3353_4c5d_9e1c_eae7e91ff0f6.slice/crio-8e8b106c4aad566beb4790bd0b8aa12f707b4838cfe3f12e2b140921a4504d7f WatchSource:0}: Error finding container 8e8b106c4aad566beb4790bd0b8aa12f707b4838cfe3f12e2b140921a4504d7f: Status 404 returned error can't find the container with id 8e8b106c4aad566beb4790bd0b8aa12f707b4838cfe3f12e2b140921a4504d7f
Jul 07 17:48:31.109791 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:48:31.109764    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-25pj6\" (UniqueName: \"kubernetes.io/projected/ec098cea-fa7e-4257-b00c-9bdf8ccfeb63-kube-api-access-25pj6\") pod \"authorino-969f48648-6lflj\" (UID: \"ec098cea-fa7e-4257-b00c-9bdf8ccfeb63\") " pod="kuadrant-system/authorino-969f48648-6lflj"
Jul 07 17:48:31.109913 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:48:31.109804    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/ec098cea-fa7e-4257-b00c-9bdf8ccfeb63-tls-cert\") pod \"authorino-969f48648-6lflj\" (UID: \"ec098cea-fa7e-4257-b00c-9bdf8ccfeb63\") " pod="kuadrant-system/authorino-969f48648-6lflj"
Jul 07 17:48:31.210573 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:48:31.210478    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-25pj6\" (UniqueName: \"kubernetes.io/projected/ec098cea-fa7e-4257-b00c-9bdf8ccfeb63-kube-api-access-25pj6\") pod \"authorino-969f48648-6lflj\" (UID: \"ec098cea-fa7e-4257-b00c-9bdf8ccfeb63\") " pod="kuadrant-system/authorino-969f48648-6lflj"
Jul 07 17:48:31.210573 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:48:31.210536    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/ec098cea-fa7e-4257-b00c-9bdf8ccfeb63-tls-cert\") pod \"authorino-969f48648-6lflj\" (UID: \"ec098cea-fa7e-4257-b00c-9bdf8ccfeb63\") " pod="kuadrant-system/authorino-969f48648-6lflj"
Jul 07 17:48:31.213026 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:48:31.213004    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/ec098cea-fa7e-4257-b00c-9bdf8ccfeb63-tls-cert\") pod \"authorino-969f48648-6lflj\" (UID: \"ec098cea-fa7e-4257-b00c-9bdf8ccfeb63\") " pod="kuadrant-system/authorino-969f48648-6lflj"
Jul 07 17:48:31.225862 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:48:31.225831    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-25pj6\" (UniqueName: \"kubernetes.io/projected/ec098cea-fa7e-4257-b00c-9bdf8ccfeb63-kube-api-access-25pj6\") pod \"authorino-969f48648-6lflj\" (UID: \"ec098cea-fa7e-4257-b00c-9bdf8ccfeb63\") " pod="kuadrant-system/authorino-969f48648-6lflj"
Jul 07 17:48:31.296103 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:48:31.296060    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-969f48648-6lflj"
Jul 07 17:48:31.439877 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:48:31.439843    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-969f48648-6lflj"]
Jul 07 17:48:31.445887 ip-10-0-139-31 kubenswrapper[2561]: W0707 17:48:31.445851    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podec098cea_fa7e_4257_b00c_9bdf8ccfeb63.slice/crio-9c113a5e4b5b60440e332b8420d3aff07f6c27d67108bc9d6b703c0dbe3fb9a8 WatchSource:0}: Error finding container 9c113a5e4b5b60440e332b8420d3aff07f6c27d67108bc9d6b703c0dbe3fb9a8: Status 404 returned error can't find the container with id 9c113a5e4b5b60440e332b8420d3aff07f6c27d67108bc9d6b703c0dbe3fb9a8
Jul 07 17:48:31.810176 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:48:31.810146    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-969f48648-6lflj" event={"ID":"ec098cea-fa7e-4257-b00c-9bdf8ccfeb63","Type":"ContainerStarted","Data":"9c113a5e4b5b60440e332b8420d3aff07f6c27d67108bc9d6b703c0dbe3fb9a8"}
Jul 07 17:48:31.811633 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:48:31.811610    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7c665bfb88-w6hrq" event={"ID":"6d539f5b-3353-4c5d-9e1c-eae7e91ff0f6","Type":"ContainerStarted","Data":"6542f9d149ca77d205e819dfe65842b5ebdb56c9b9dbf78d04890cd299e09f93"}
Jul 07 17:48:31.811730 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:48:31.811645    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7c665bfb88-w6hrq" event={"ID":"6d539f5b-3353-4c5d-9e1c-eae7e91ff0f6","Type":"ContainerStarted","Data":"8e8b106c4aad566beb4790bd0b8aa12f707b4838cfe3f12e2b140921a4504d7f"}
Jul 07 17:48:31.811730 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:48:31.811638    2561 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-7c665bfb88-w6hrq" podUID="6d539f5b-3353-4c5d-9e1c-eae7e91ff0f6" containerName="authorino" containerID="cri-o://6542f9d149ca77d205e819dfe65842b5ebdb56c9b9dbf78d04890cd299e09f93" gracePeriod=30
Jul 07 17:48:31.836617 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:48:31.836561    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-7c665bfb88-w6hrq" podStartSLOduration=1.479214078 podStartE2EDuration="1.836543912s" totalImagesPullingTime="357.329834ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 17:48:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 17:48:31.835565716 +0000 UTC m=+502.986690115" watchObservedRunningTime="2026-07-07 17:48:31.836543912 +0000 UTC m=+502.987668390"
Jul 07 17:48:32.063333 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:48:32.063303    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7c665bfb88-w6hrq"
Jul 07 17:48:32.220357 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:48:32.220317    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4kzlj\" (UniqueName: \"kubernetes.io/projected/6d539f5b-3353-4c5d-9e1c-eae7e91ff0f6-kube-api-access-4kzlj\") pod \"6d539f5b-3353-4c5d-9e1c-eae7e91ff0f6\" (UID: \"6d539f5b-3353-4c5d-9e1c-eae7e91ff0f6\") "
Jul 07 17:48:32.222592 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:48:32.222561    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6d539f5b-3353-4c5d-9e1c-eae7e91ff0f6-kube-api-access-4kzlj" (OuterVolumeSpecName: "kube-api-access-4kzlj") pod "6d539f5b-3353-4c5d-9e1c-eae7e91ff0f6" (UID: "6d539f5b-3353-4c5d-9e1c-eae7e91ff0f6"). InnerVolumeSpecName "kube-api-access-4kzlj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 17:48:32.321349 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:48:32.321315    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4kzlj\" (UniqueName: \"kubernetes.io/projected/6d539f5b-3353-4c5d-9e1c-eae7e91ff0f6-kube-api-access-4kzlj\") on node \"ip-10-0-139-31.ec2.internal\" DevicePath \"\""
Jul 07 17:48:32.817809 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:48:32.817762    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-969f48648-6lflj" event={"ID":"ec098cea-fa7e-4257-b00c-9bdf8ccfeb63","Type":"ContainerStarted","Data":"f7fb1fba2eedd9c5a86d691953f2675a4625ec3b3acc57159e5fb8763ab9a61d"}
Jul 07 17:48:32.818948 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:48:32.818919    2561 generic.go:356] "Generic (PLEG): container finished" podID="6d539f5b-3353-4c5d-9e1c-eae7e91ff0f6" containerID="6542f9d149ca77d205e819dfe65842b5ebdb56c9b9dbf78d04890cd299e09f93" exitCode=0
Jul 07 17:48:32.819130 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:48:32.818954    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7c665bfb88-w6hrq"
Jul 07 17:48:32.819130 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:48:32.819007    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7c665bfb88-w6hrq" event={"ID":"6d539f5b-3353-4c5d-9e1c-eae7e91ff0f6","Type":"ContainerDied","Data":"6542f9d149ca77d205e819dfe65842b5ebdb56c9b9dbf78d04890cd299e09f93"}
Jul 07 17:48:32.819130 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:48:32.819046    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7c665bfb88-w6hrq" event={"ID":"6d539f5b-3353-4c5d-9e1c-eae7e91ff0f6","Type":"ContainerDied","Data":"8e8b106c4aad566beb4790bd0b8aa12f707b4838cfe3f12e2b140921a4504d7f"}
Jul 07 17:48:32.819130 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:48:32.819068    2561 scope.go:117] "RemoveContainer" containerID="6542f9d149ca77d205e819dfe65842b5ebdb56c9b9dbf78d04890cd299e09f93"
Jul 07 17:48:32.827689 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:48:32.827664    2561 scope.go:117] "RemoveContainer" containerID="6542f9d149ca77d205e819dfe65842b5ebdb56c9b9dbf78d04890cd299e09f93"
Jul 07 17:48:32.827966 ip-10-0-139-31 kubenswrapper[2561]: E0707 17:48:32.827945    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6542f9d149ca77d205e819dfe65842b5ebdb56c9b9dbf78d04890cd299e09f93\": container with ID starting with 6542f9d149ca77d205e819dfe65842b5ebdb56c9b9dbf78d04890cd299e09f93 not found: ID does not exist" containerID="6542f9d149ca77d205e819dfe65842b5ebdb56c9b9dbf78d04890cd299e09f93"
Jul 07 17:48:32.828037 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:48:32.827979    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6542f9d149ca77d205e819dfe65842b5ebdb56c9b9dbf78d04890cd299e09f93"} err="failed to get container status \"6542f9d149ca77d205e819dfe65842b5ebdb56c9b9dbf78d04890cd299e09f93\": rpc error: code = NotFound desc = could not find container \"6542f9d149ca77d205e819dfe65842b5ebdb56c9b9dbf78d04890cd299e09f93\": container with ID starting with 6542f9d149ca77d205e819dfe65842b5ebdb56c9b9dbf78d04890cd299e09f93 not found: ID does not exist"
Jul 07 17:48:32.848088 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:48:32.848034    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-969f48648-6lflj" podStartSLOduration=2.544481205 podStartE2EDuration="2.848016013s" totalImagesPullingTime="303.534808ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 17:48:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 17:48:32.847041097 +0000 UTC m=+503.998165496" watchObservedRunningTime="2026-07-07 17:48:32.848016013 +0000 UTC m=+503.999140411"
Jul 07 17:48:32.894838 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:48:32.894793    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-7c665bfb88-w6hrq"]
Jul 07 17:48:32.899523 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:48:32.899487    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-7c665bfb88-w6hrq"]
Jul 07 17:48:32.911759 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:48:32.911725    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-tmzsh"]
Jul 07 17:48:32.911931 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:48:32.911905    2561 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-75d556bd77-tmzsh" podUID="7fafa7fc-c63f-438b-9799-74d72a57cd36" containerName="authorino" containerID="cri-o://d7afdff7a5594a37c070d906122c542babad4235b339ba13a224196b5cc9386c" gracePeriod=30
Jul 07 17:48:33.170828 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:48:33.170803    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-tmzsh"
Jul 07 17:48:33.328276 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:48:33.328232    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hj6x7\" (UniqueName: \"kubernetes.io/projected/7fafa7fc-c63f-438b-9799-74d72a57cd36-kube-api-access-hj6x7\") pod \"7fafa7fc-c63f-438b-9799-74d72a57cd36\" (UID: \"7fafa7fc-c63f-438b-9799-74d72a57cd36\") "
Jul 07 17:48:33.330327 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:48:33.330302    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7fafa7fc-c63f-438b-9799-74d72a57cd36-kube-api-access-hj6x7" (OuterVolumeSpecName: "kube-api-access-hj6x7") pod "7fafa7fc-c63f-438b-9799-74d72a57cd36" (UID: "7fafa7fc-c63f-438b-9799-74d72a57cd36"). InnerVolumeSpecName "kube-api-access-hj6x7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 17:48:33.429651 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:48:33.429611    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hj6x7\" (UniqueName: \"kubernetes.io/projected/7fafa7fc-c63f-438b-9799-74d72a57cd36-kube-api-access-hj6x7\") on node \"ip-10-0-139-31.ec2.internal\" DevicePath \"\""
Jul 07 17:48:33.522136 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:48:33.522094    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6d539f5b-3353-4c5d-9e1c-eae7e91ff0f6" path="/var/lib/kubelet/pods/6d539f5b-3353-4c5d-9e1c-eae7e91ff0f6/volumes"
Jul 07 17:48:33.826157 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:48:33.826123    2561 generic.go:356] "Generic (PLEG): container finished" podID="7fafa7fc-c63f-438b-9799-74d72a57cd36" containerID="d7afdff7a5594a37c070d906122c542babad4235b339ba13a224196b5cc9386c" exitCode=0
Jul 07 17:48:33.826583 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:48:33.826165    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-tmzsh"
Jul 07 17:48:33.826583 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:48:33.826209    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-tmzsh" event={"ID":"7fafa7fc-c63f-438b-9799-74d72a57cd36","Type":"ContainerDied","Data":"d7afdff7a5594a37c070d906122c542babad4235b339ba13a224196b5cc9386c"}
Jul 07 17:48:33.826583 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:48:33.826248    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-tmzsh" event={"ID":"7fafa7fc-c63f-438b-9799-74d72a57cd36","Type":"ContainerDied","Data":"96bc87f3daffe4b1f4fdb3b131a2b0db6fbc7f006ad14e5916e43b33776b1fef"}
Jul 07 17:48:33.826583 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:48:33.826265    2561 scope.go:117] "RemoveContainer" containerID="d7afdff7a5594a37c070d906122c542babad4235b339ba13a224196b5cc9386c"
Jul 07 17:48:33.834884 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:48:33.834863    2561 scope.go:117] "RemoveContainer" containerID="d7afdff7a5594a37c070d906122c542babad4235b339ba13a224196b5cc9386c"
Jul 07 17:48:33.835177 ip-10-0-139-31 kubenswrapper[2561]: E0707 17:48:33.835151    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d7afdff7a5594a37c070d906122c542babad4235b339ba13a224196b5cc9386c\": container with ID starting with d7afdff7a5594a37c070d906122c542babad4235b339ba13a224196b5cc9386c not found: ID does not exist" containerID="d7afdff7a5594a37c070d906122c542babad4235b339ba13a224196b5cc9386c"
Jul 07 17:48:33.835285 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:48:33.835181    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d7afdff7a5594a37c070d906122c542babad4235b339ba13a224196b5cc9386c"} err="failed to get container status \"d7afdff7a5594a37c070d906122c542babad4235b339ba13a224196b5cc9386c\": rpc error: code = NotFound desc = could not find container \"d7afdff7a5594a37c070d906122c542babad4235b339ba13a224196b5cc9386c\": container with ID starting with d7afdff7a5594a37c070d906122c542babad4235b339ba13a224196b5cc9386c not found: ID does not exist"
Jul 07 17:48:33.856264 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:48:33.856230    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-tmzsh"]
Jul 07 17:48:33.862192 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:48:33.862165    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-75d556bd77-tmzsh"]
Jul 07 17:48:35.522764 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:48:35.522720    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7fafa7fc-c63f-438b-9799-74d72a57cd36" path="/var/lib/kubelet/pods/7fafa7fc-c63f-438b-9799-74d72a57cd36/volumes"
Jul 07 17:50:03.681208 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:50:03.681175    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-4qhxv"]
Jul 07 17:50:03.681666 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:50:03.681560    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7fafa7fc-c63f-438b-9799-74d72a57cd36" containerName="authorino"
Jul 07 17:50:03.681666 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:50:03.681572    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="7fafa7fc-c63f-438b-9799-74d72a57cd36" containerName="authorino"
Jul 07 17:50:03.681666 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:50:03.681582    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6d539f5b-3353-4c5d-9e1c-eae7e91ff0f6" containerName="authorino"
Jul 07 17:50:03.681666 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:50:03.681588    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="6d539f5b-3353-4c5d-9e1c-eae7e91ff0f6" containerName="authorino"
Jul 07 17:50:03.681666 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:50:03.681641    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="7fafa7fc-c63f-438b-9799-74d72a57cd36" containerName="authorino"
Jul 07 17:50:03.681666 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:50:03.681650    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="6d539f5b-3353-4c5d-9e1c-eae7e91ff0f6" containerName="authorino"
Jul 07 17:50:03.684668 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:50:03.684648    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-4qhxv"
Jul 07 17:50:03.689004 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:50:03.688979    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-rgwkq\""
Jul 07 17:50:03.689132 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:50:03.689022    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Jul 07 17:50:03.689132 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:50:03.688981    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Jul 07 17:50:03.689132 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:50:03.688984    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\""
Jul 07 17:50:03.691911 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:50:03.691886    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ad3d0b26-4541-4dc8-9de5-9a1dd1e13694-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-4qhxv\" (UID: \"ad3d0b26-4541-4dc8-9de5-9a1dd1e13694\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-4qhxv"
Jul 07 17:50:03.692031 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:50:03.691921    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ad3d0b26-4541-4dc8-9de5-9a1dd1e13694-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-4qhxv\" (UID: \"ad3d0b26-4541-4dc8-9de5-9a1dd1e13694\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-4qhxv"
Jul 07 17:50:03.692031 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:50:03.691968    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zqt6n\" (UniqueName: \"kubernetes.io/projected/ad3d0b26-4541-4dc8-9de5-9a1dd1e13694-kube-api-access-zqt6n\") pod \"e2e-trlp-test-simulated-kserve-598466548d-4qhxv\" (UID: \"ad3d0b26-4541-4dc8-9de5-9a1dd1e13694\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-4qhxv"
Jul 07 17:50:03.692031 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:50:03.692017    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ad3d0b26-4541-4dc8-9de5-9a1dd1e13694-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-4qhxv\" (UID: \"ad3d0b26-4541-4dc8-9de5-9a1dd1e13694\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-4qhxv"
Jul 07 17:50:03.692186 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:50:03.692070    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ad3d0b26-4541-4dc8-9de5-9a1dd1e13694-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-4qhxv\" (UID: \"ad3d0b26-4541-4dc8-9de5-9a1dd1e13694\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-4qhxv"
Jul 07 17:50:03.692186 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:50:03.692160    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ad3d0b26-4541-4dc8-9de5-9a1dd1e13694-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-4qhxv\" (UID: \"ad3d0b26-4541-4dc8-9de5-9a1dd1e13694\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-4qhxv"
Jul 07 17:50:03.695311 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:50:03.695291    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-4qhxv"]
Jul 07 17:50:03.792873 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:50:03.792837    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ad3d0b26-4541-4dc8-9de5-9a1dd1e13694-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-4qhxv\" (UID: \"ad3d0b26-4541-4dc8-9de5-9a1dd1e13694\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-4qhxv"
Jul 07 17:50:03.792873 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:50:03.792875    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ad3d0b26-4541-4dc8-9de5-9a1dd1e13694-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-4qhxv\" (UID: \"ad3d0b26-4541-4dc8-9de5-9a1dd1e13694\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-4qhxv"
Jul 07 17:50:03.793123 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:50:03.792900    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zqt6n\" (UniqueName: \"kubernetes.io/projected/ad3d0b26-4541-4dc8-9de5-9a1dd1e13694-kube-api-access-zqt6n\") pod \"e2e-trlp-test-simulated-kserve-598466548d-4qhxv\" (UID: \"ad3d0b26-4541-4dc8-9de5-9a1dd1e13694\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-4qhxv"
Jul 07 17:50:03.793123 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:50:03.793023    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ad3d0b26-4541-4dc8-9de5-9a1dd1e13694-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-4qhxv\" (UID: \"ad3d0b26-4541-4dc8-9de5-9a1dd1e13694\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-4qhxv"
Jul 07 17:50:03.793123 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:50:03.793064    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ad3d0b26-4541-4dc8-9de5-9a1dd1e13694-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-4qhxv\" (UID: \"ad3d0b26-4541-4dc8-9de5-9a1dd1e13694\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-4qhxv"
Jul 07 17:50:03.793251 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:50:03.793154    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ad3d0b26-4541-4dc8-9de5-9a1dd1e13694-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-4qhxv\" (UID: \"ad3d0b26-4541-4dc8-9de5-9a1dd1e13694\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-4qhxv"
Jul 07 17:50:03.793406 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:50:03.793386    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ad3d0b26-4541-4dc8-9de5-9a1dd1e13694-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-4qhxv\" (UID: \"ad3d0b26-4541-4dc8-9de5-9a1dd1e13694\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-4qhxv"
Jul 07 17:50:03.793526 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:50:03.793471    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ad3d0b26-4541-4dc8-9de5-9a1dd1e13694-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-4qhxv\" (UID: \"ad3d0b26-4541-4dc8-9de5-9a1dd1e13694\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-4qhxv"
Jul 07 17:50:03.793606 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:50:03.793584    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ad3d0b26-4541-4dc8-9de5-9a1dd1e13694-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-4qhxv\" (UID: \"ad3d0b26-4541-4dc8-9de5-9a1dd1e13694\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-4qhxv"
Jul 07 17:50:03.795125 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:50:03.795108    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ad3d0b26-4541-4dc8-9de5-9a1dd1e13694-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-4qhxv\" (UID: \"ad3d0b26-4541-4dc8-9de5-9a1dd1e13694\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-4qhxv"
Jul 07 17:50:03.795414 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:50:03.795398    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ad3d0b26-4541-4dc8-9de5-9a1dd1e13694-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-4qhxv\" (UID: \"ad3d0b26-4541-4dc8-9de5-9a1dd1e13694\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-4qhxv"
Jul 07 17:50:03.802781 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:50:03.802754    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zqt6n\" (UniqueName: \"kubernetes.io/projected/ad3d0b26-4541-4dc8-9de5-9a1dd1e13694-kube-api-access-zqt6n\") pod \"e2e-trlp-test-simulated-kserve-598466548d-4qhxv\" (UID: \"ad3d0b26-4541-4dc8-9de5-9a1dd1e13694\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-4qhxv"
Jul 07 17:50:03.996731 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:50:03.996631    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-4qhxv"
Jul 07 17:50:04.135264 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:50:04.135238    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-4qhxv"]
Jul 07 17:50:04.137527 ip-10-0-139-31 kubenswrapper[2561]: W0707 17:50:04.137499    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podad3d0b26_4541_4dc8_9de5_9a1dd1e13694.slice/crio-b77ec0c21673845547c87631708b6f8beb157174f9d0126ecb931f0e49eb7a8d WatchSource:0}: Error finding container b77ec0c21673845547c87631708b6f8beb157174f9d0126ecb931f0e49eb7a8d: Status 404 returned error can't find the container with id b77ec0c21673845547c87631708b6f8beb157174f9d0126ecb931f0e49eb7a8d
Jul 07 17:50:04.278120 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:50:04.278037    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-4qhxv" event={"ID":"ad3d0b26-4541-4dc8-9de5-9a1dd1e13694","Type":"ContainerStarted","Data":"b77ec0c21673845547c87631708b6f8beb157174f9d0126ecb931f0e49eb7a8d"}
Jul 07 17:50:06.290514 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:50:06.290478    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-4qhxv" event={"ID":"ad3d0b26-4541-4dc8-9de5-9a1dd1e13694","Type":"ContainerStarted","Data":"fa3d357fabbbc61ea6a1417866fd11573aea9b10ec3e06621495a96d97a09c80"}
Jul 07 17:50:06.309141 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:50:06.309084    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-4qhxv" podStartSLOduration=1.9913242580000001 podStartE2EDuration="3.309069483s" totalImagesPullingTime="1.317745225s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 17:50:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 17:50:06.308401174 +0000 UTC m=+597.459525573" watchObservedRunningTime="2026-07-07 17:50:06.309069483 +0000 UTC m=+597.460193880"
Jul 07 17:50:09.313132 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:50:09.313102    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-bjl48_805597ff-168d-4099-95b8-0037b0ceba2f/console-operator/1.log"
Jul 07 17:50:09.313728 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:50:09.313196    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-bjl48_805597ff-168d-4099-95b8-0037b0ceba2f/console-operator/1.log"
Jul 07 17:50:13.997311 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:50:13.997252    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-4qhxv"
Jul 07 17:50:13.999856 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:50:13.997347    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-4qhxv"
Jul 07 17:50:14.014850 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:50:14.014820    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-4qhxv"
Jul 07 17:50:14.338070 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:50:14.338035    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-4qhxv"
Jul 07 17:50:32.573349 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:50:32.573263    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-5hs2w"]
Jul 07 17:50:32.576716 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:50:32.576697    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-5hs2w"
Jul 07 17:50:32.579339 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:50:32.579318    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\""
Jul 07 17:50:32.591575 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:50:32.591543    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-5hs2w"]
Jul 07 17:50:32.655337 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:50:32.655291    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9c6028b9-0694-46e3-829f-fab255cc478d-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-5hs2w\" (UID: \"9c6028b9-0694-46e3-829f-fab255cc478d\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-5hs2w"
Jul 07 17:50:32.655549 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:50:32.655352    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wkmrd\" (UniqueName: \"kubernetes.io/projected/9c6028b9-0694-46e3-829f-fab255cc478d-kube-api-access-wkmrd\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-5hs2w\" (UID: \"9c6028b9-0694-46e3-829f-fab255cc478d\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-5hs2w"
Jul 07 17:50:32.655549 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:50:32.655406    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9c6028b9-0694-46e3-829f-fab255cc478d-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-5hs2w\" (UID: \"9c6028b9-0694-46e3-829f-fab255cc478d\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-5hs2w"
Jul 07 17:50:32.655549 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:50:32.655423    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9c6028b9-0694-46e3-829f-fab255cc478d-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-5hs2w\" (UID: \"9c6028b9-0694-46e3-829f-fab255cc478d\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-5hs2w"
Jul 07 17:50:32.655549 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:50:32.655440    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9c6028b9-0694-46e3-829f-fab255cc478d-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-5hs2w\" (UID: \"9c6028b9-0694-46e3-829f-fab255cc478d\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-5hs2w"
Jul 07 17:50:32.655685 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:50:32.655547    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9c6028b9-0694-46e3-829f-fab255cc478d-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-5hs2w\" (UID: \"9c6028b9-0694-46e3-829f-fab255cc478d\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-5hs2w"
Jul 07 17:50:32.756831 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:50:32.756781    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wkmrd\" (UniqueName: \"kubernetes.io/projected/9c6028b9-0694-46e3-829f-fab255cc478d-kube-api-access-wkmrd\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-5hs2w\" (UID: \"9c6028b9-0694-46e3-829f-fab255cc478d\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-5hs2w"
Jul 07 17:50:32.756831 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:50:32.756839    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9c6028b9-0694-46e3-829f-fab255cc478d-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-5hs2w\" (UID: \"9c6028b9-0694-46e3-829f-fab255cc478d\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-5hs2w"
Jul 07 17:50:32.757087 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:50:32.756863    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9c6028b9-0694-46e3-829f-fab255cc478d-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-5hs2w\" (UID: \"9c6028b9-0694-46e3-829f-fab255cc478d\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-5hs2w"
Jul 07 17:50:32.757087 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:50:32.756887    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9c6028b9-0694-46e3-829f-fab255cc478d-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-5hs2w\" (UID: \"9c6028b9-0694-46e3-829f-fab255cc478d\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-5hs2w"
Jul 07 17:50:32.757087 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:50:32.756927    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9c6028b9-0694-46e3-829f-fab255cc478d-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-5hs2w\" (UID: \"9c6028b9-0694-46e3-829f-fab255cc478d\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-5hs2w"
Jul 07 17:50:32.757087 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:50:32.757018    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9c6028b9-0694-46e3-829f-fab255cc478d-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-5hs2w\" (UID: \"9c6028b9-0694-46e3-829f-fab255cc478d\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-5hs2w"
Jul 07 17:50:32.757328 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:50:32.757294    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9c6028b9-0694-46e3-829f-fab255cc478d-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-5hs2w\" (UID: \"9c6028b9-0694-46e3-829f-fab255cc478d\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-5hs2w"
Jul 07 17:50:32.757384 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:50:32.757334    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9c6028b9-0694-46e3-829f-fab255cc478d-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-5hs2w\" (UID: \"9c6028b9-0694-46e3-829f-fab255cc478d\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-5hs2w"
Jul 07 17:50:32.757438 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:50:32.757382    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9c6028b9-0694-46e3-829f-fab255cc478d-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-5hs2w\" (UID: \"9c6028b9-0694-46e3-829f-fab255cc478d\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-5hs2w"
Jul 07 17:50:32.759127 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:50:32.759105    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9c6028b9-0694-46e3-829f-fab255cc478d-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-5hs2w\" (UID: \"9c6028b9-0694-46e3-829f-fab255cc478d\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-5hs2w"
Jul 07 17:50:32.759397 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:50:32.759380    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9c6028b9-0694-46e3-829f-fab255cc478d-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-5hs2w\" (UID: \"9c6028b9-0694-46e3-829f-fab255cc478d\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-5hs2w"
Jul 07 17:50:32.765759 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:50:32.765734    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wkmrd\" (UniqueName: \"kubernetes.io/projected/9c6028b9-0694-46e3-829f-fab255cc478d-kube-api-access-wkmrd\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-5hs2w\" (UID: \"9c6028b9-0694-46e3-829f-fab255cc478d\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-5hs2w"
Jul 07 17:50:32.895062 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:50:32.894930    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-5hs2w"
Jul 07 17:50:33.031707 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:50:33.031677    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-5hs2w"]
Jul 07 17:50:33.033889 ip-10-0-139-31 kubenswrapper[2561]: W0707 17:50:33.033857    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9c6028b9_0694_46e3_829f_fab255cc478d.slice/crio-c47aa18d82da13492f8af9b9f1f1540af32e2684ebad905c5729ef8c66d15dc6 WatchSource:0}: Error finding container c47aa18d82da13492f8af9b9f1f1540af32e2684ebad905c5729ef8c66d15dc6: Status 404 returned error can't find the container with id c47aa18d82da13492f8af9b9f1f1540af32e2684ebad905c5729ef8c66d15dc6
Jul 07 17:50:33.035266 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:50:33.035245    2561 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 07 17:50:33.419041 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:50:33.418994    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-5hs2w" event={"ID":"9c6028b9-0694-46e3-829f-fab255cc478d","Type":"ContainerStarted","Data":"1b6ae87625242567b73f2b9fd8c2dc4399077887b29e7c29870b54b4b756b470"}
Jul 07 17:50:33.419188 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:50:33.419058    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-5hs2w" event={"ID":"9c6028b9-0694-46e3-829f-fab255cc478d","Type":"ContainerStarted","Data":"c47aa18d82da13492f8af9b9f1f1540af32e2684ebad905c5729ef8c66d15dc6"}
Jul 07 17:50:33.439779 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:50:33.439724    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-5hs2w" podStartSLOduration=1.260452517 podStartE2EDuration="1.439706249s" totalImagesPullingTime="179.253732ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 17:50:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 17:50:33.438441435 +0000 UTC m=+624.589565833" watchObservedRunningTime="2026-07-07 17:50:33.439706249 +0000 UTC m=+624.590830647"
Jul 07 17:50:42.895896 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:50:42.895857    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-5hs2w"
Jul 07 17:50:42.896386 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:50:42.895914    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-5hs2w"
Jul 07 17:50:42.908313 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:50:42.908285    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-5hs2w"
Jul 07 17:50:43.474139 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:50:43.474108    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-5hs2w"
Jul 07 17:52:48.338578 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:52:48.338539    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-969f48648-6lflj"]
Jul 07 17:52:48.339103 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:52:48.338738    2561 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-969f48648-6lflj" podUID="ec098cea-fa7e-4257-b00c-9bdf8ccfeb63" containerName="authorino" containerID="cri-o://f7fb1fba2eedd9c5a86d691953f2675a4625ec3b3acc57159e5fb8763ab9a61d" gracePeriod=30
Jul 07 17:52:48.593084 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:52:48.593017    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-969f48648-6lflj"
Jul 07 17:52:48.689217 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:52:48.689182    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-25pj6\" (UniqueName: \"kubernetes.io/projected/ec098cea-fa7e-4257-b00c-9bdf8ccfeb63-kube-api-access-25pj6\") pod \"ec098cea-fa7e-4257-b00c-9bdf8ccfeb63\" (UID: \"ec098cea-fa7e-4257-b00c-9bdf8ccfeb63\") "
Jul 07 17:52:48.689380 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:52:48.689271    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/ec098cea-fa7e-4257-b00c-9bdf8ccfeb63-tls-cert\") pod \"ec098cea-fa7e-4257-b00c-9bdf8ccfeb63\" (UID: \"ec098cea-fa7e-4257-b00c-9bdf8ccfeb63\") "
Jul 07 17:52:48.691485 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:52:48.691434    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ec098cea-fa7e-4257-b00c-9bdf8ccfeb63-kube-api-access-25pj6" (OuterVolumeSpecName: "kube-api-access-25pj6") pod "ec098cea-fa7e-4257-b00c-9bdf8ccfeb63" (UID: "ec098cea-fa7e-4257-b00c-9bdf8ccfeb63"). InnerVolumeSpecName "kube-api-access-25pj6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 17:52:48.699366 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:52:48.699342    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ec098cea-fa7e-4257-b00c-9bdf8ccfeb63-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "ec098cea-fa7e-4257-b00c-9bdf8ccfeb63" (UID: "ec098cea-fa7e-4257-b00c-9bdf8ccfeb63"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 17:52:48.790539 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:52:48.790503    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-25pj6\" (UniqueName: \"kubernetes.io/projected/ec098cea-fa7e-4257-b00c-9bdf8ccfeb63-kube-api-access-25pj6\") on node \"ip-10-0-139-31.ec2.internal\" DevicePath \"\""
Jul 07 17:52:48.790539 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:52:48.790531    2561 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/ec098cea-fa7e-4257-b00c-9bdf8ccfeb63-tls-cert\") on node \"ip-10-0-139-31.ec2.internal\" DevicePath \"\""
Jul 07 17:52:49.055689 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:52:49.055651    2561 generic.go:356] "Generic (PLEG): container finished" podID="ec098cea-fa7e-4257-b00c-9bdf8ccfeb63" containerID="f7fb1fba2eedd9c5a86d691953f2675a4625ec3b3acc57159e5fb8763ab9a61d" exitCode=0
Jul 07 17:52:49.055839 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:52:49.055706    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-969f48648-6lflj"
Jul 07 17:52:49.055839 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:52:49.055735    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-969f48648-6lflj" event={"ID":"ec098cea-fa7e-4257-b00c-9bdf8ccfeb63","Type":"ContainerDied","Data":"f7fb1fba2eedd9c5a86d691953f2675a4625ec3b3acc57159e5fb8763ab9a61d"}
Jul 07 17:52:49.055839 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:52:49.055781    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-969f48648-6lflj" event={"ID":"ec098cea-fa7e-4257-b00c-9bdf8ccfeb63","Type":"ContainerDied","Data":"9c113a5e4b5b60440e332b8420d3aff07f6c27d67108bc9d6b703c0dbe3fb9a8"}
Jul 07 17:52:49.055839 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:52:49.055800    2561 scope.go:117] "RemoveContainer" containerID="f7fb1fba2eedd9c5a86d691953f2675a4625ec3b3acc57159e5fb8763ab9a61d"
Jul 07 17:52:49.065097 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:52:49.065082    2561 scope.go:117] "RemoveContainer" containerID="f7fb1fba2eedd9c5a86d691953f2675a4625ec3b3acc57159e5fb8763ab9a61d"
Jul 07 17:52:49.065405 ip-10-0-139-31 kubenswrapper[2561]: E0707 17:52:49.065385    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f7fb1fba2eedd9c5a86d691953f2675a4625ec3b3acc57159e5fb8763ab9a61d\": container with ID starting with f7fb1fba2eedd9c5a86d691953f2675a4625ec3b3acc57159e5fb8763ab9a61d not found: ID does not exist" containerID="f7fb1fba2eedd9c5a86d691953f2675a4625ec3b3acc57159e5fb8763ab9a61d"
Jul 07 17:52:49.065460 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:52:49.065415    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f7fb1fba2eedd9c5a86d691953f2675a4625ec3b3acc57159e5fb8763ab9a61d"} err="failed to get container status \"f7fb1fba2eedd9c5a86d691953f2675a4625ec3b3acc57159e5fb8763ab9a61d\": rpc error: code = NotFound desc = could not find container \"f7fb1fba2eedd9c5a86d691953f2675a4625ec3b3acc57159e5fb8763ab9a61d\": container with ID starting with f7fb1fba2eedd9c5a86d691953f2675a4625ec3b3acc57159e5fb8763ab9a61d not found: ID does not exist"
Jul 07 17:52:49.081946 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:52:49.081913    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-969f48648-6lflj"]
Jul 07 17:52:49.088659 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:52:49.088637    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-969f48648-6lflj"]
Jul 07 17:52:49.523070 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:52:49.522988    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ec098cea-fa7e-4257-b00c-9bdf8ccfeb63" path="/var/lib/kubelet/pods/ec098cea-fa7e-4257-b00c-9bdf8ccfeb63/volumes"
Jul 07 17:55:09.343710 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:55:09.343619    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-bjl48_805597ff-168d-4099-95b8-0037b0ceba2f/console-operator/1.log"
Jul 07 17:55:09.345217 ip-10-0-139-31 kubenswrapper[2561]: I0707 17:55:09.345193    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-bjl48_805597ff-168d-4099-95b8-0037b0ceba2f/console-operator/1.log"
Jul 07 18:00:00.151965 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:00:00.151928    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29724120-96l5w"]
Jul 07 18:00:00.152492 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:00:00.152305    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ec098cea-fa7e-4257-b00c-9bdf8ccfeb63" containerName="authorino"
Jul 07 18:00:00.152492 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:00:00.152319    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="ec098cea-fa7e-4257-b00c-9bdf8ccfeb63" containerName="authorino"
Jul 07 18:00:00.152492 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:00:00.152395    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="ec098cea-fa7e-4257-b00c-9bdf8ccfeb63" containerName="authorino"
Jul 07 18:00:00.160197 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:00:00.160166    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29724120-96l5w"
Jul 07 18:00:00.163992 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:00:00.163961    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 07 18:00:00.164110 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:00:00.164002    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-mg6kl\""
Jul 07 18:00:00.165125 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:00:00.165108    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 07 18:00:00.169355 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:00:00.169332    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29724120-96l5w"]
Jul 07 18:00:00.235358 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:00:00.235313    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f9tv8\" (UniqueName: \"kubernetes.io/projected/dde07e7d-636a-44bd-a9cf-544f0872c0e9-kube-api-access-f9tv8\") pod \"maas-api-key-cleanup-29724120-96l5w\" (UID: \"dde07e7d-636a-44bd-a9cf-544f0872c0e9\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-29724120-96l5w"
Jul 07 18:00:00.336301 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:00:00.336268    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f9tv8\" (UniqueName: \"kubernetes.io/projected/dde07e7d-636a-44bd-a9cf-544f0872c0e9-kube-api-access-f9tv8\") pod \"maas-api-key-cleanup-29724120-96l5w\" (UID: \"dde07e7d-636a-44bd-a9cf-544f0872c0e9\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-29724120-96l5w"
Jul 07 18:00:00.347162 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:00:00.347140    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f9tv8\" (UniqueName: \"kubernetes.io/projected/dde07e7d-636a-44bd-a9cf-544f0872c0e9-kube-api-access-f9tv8\") pod \"maas-api-key-cleanup-29724120-96l5w\" (UID: \"dde07e7d-636a-44bd-a9cf-544f0872c0e9\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-29724120-96l5w"
Jul 07 18:00:00.471951 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:00:00.471849    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29724120-96l5w"
Jul 07 18:00:00.608510 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:00:00.608473    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29724120-96l5w"]
Jul 07 18:00:00.612154 ip-10-0-139-31 kubenswrapper[2561]: W0707 18:00:00.612129    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddde07e7d_636a_44bd_a9cf_544f0872c0e9.slice/crio-6d4c08097638bdbb43f8e8bce3997bac5d6d738bef96ee7f2b939517d086d744 WatchSource:0}: Error finding container 6d4c08097638bdbb43f8e8bce3997bac5d6d738bef96ee7f2b939517d086d744: Status 404 returned error can't find the container with id 6d4c08097638bdbb43f8e8bce3997bac5d6d738bef96ee7f2b939517d086d744
Jul 07 18:00:00.614471 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:00:00.614433    2561 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 07 18:00:01.075272 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:00:01.075239    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29724120-96l5w" event={"ID":"dde07e7d-636a-44bd-a9cf-544f0872c0e9","Type":"ContainerStarted","Data":"6d4c08097638bdbb43f8e8bce3997bac5d6d738bef96ee7f2b939517d086d744"}
Jul 07 18:00:09.376828 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:00:09.376799    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-bjl48_805597ff-168d-4099-95b8-0037b0ceba2f/console-operator/1.log"
Jul 07 18:00:09.379206 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:00:09.379178    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-bjl48_805597ff-168d-4099-95b8-0037b0ceba2f/console-operator/1.log"
Jul 07 18:00:17.156041 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:00:17.155997    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29724120-96l5w" event={"ID":"dde07e7d-636a-44bd-a9cf-544f0872c0e9","Type":"ContainerStarted","Data":"bafc5bd93c88988aaa6f8299cf008246153b08a610657848d124a880bc46b74e"}
Jul 07 18:00:17.190049 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:00:17.189989    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29724120-96l5w" podStartSLOduration=1.8716252660000001 podStartE2EDuration="17.189974215s" totalImagesPullingTime="15.318348949s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 18:00:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 18:00:17.18858867 +0000 UTC m=+1208.339713069" watchObservedRunningTime="2026-07-07 18:00:17.189974215 +0000 UTC m=+1208.341098613"
Jul 07 18:01:00.017764 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:01:00.017729    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29724120-96l5w"]
Jul 07 18:01:00.018310 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:01:00.017951    2561 kuberuntime_container.go:872] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29724120-96l5w" podUID="dde07e7d-636a-44bd-a9cf-544f0872c0e9" containerName="cleanup" containerID="cri-o://bafc5bd93c88988aaa6f8299cf008246153b08a610657848d124a880bc46b74e" gracePeriod=30
Jul 07 18:01:30.198360 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:01:30.198326    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29724120-96l5w"
Jul 07 18:01:30.352026 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:01:30.351988    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-f9tv8\" (UniqueName: \"kubernetes.io/projected/dde07e7d-636a-44bd-a9cf-544f0872c0e9-kube-api-access-f9tv8\") pod \"dde07e7d-636a-44bd-a9cf-544f0872c0e9\" (UID: \"dde07e7d-636a-44bd-a9cf-544f0872c0e9\") "
Jul 07 18:01:30.354188 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:01:30.354154    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dde07e7d-636a-44bd-a9cf-544f0872c0e9-kube-api-access-f9tv8" (OuterVolumeSpecName: "kube-api-access-f9tv8") pod "dde07e7d-636a-44bd-a9cf-544f0872c0e9" (UID: "dde07e7d-636a-44bd-a9cf-544f0872c0e9"). InnerVolumeSpecName "kube-api-access-f9tv8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 18:01:30.453101 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:01:30.453060    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-f9tv8\" (UniqueName: \"kubernetes.io/projected/dde07e7d-636a-44bd-a9cf-544f0872c0e9-kube-api-access-f9tv8\") on node \"ip-10-0-139-31.ec2.internal\" DevicePath \"\""
Jul 07 18:01:30.498785 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:01:30.498750    2561 generic.go:356] "Generic (PLEG): container finished" podID="dde07e7d-636a-44bd-a9cf-544f0872c0e9" containerID="bafc5bd93c88988aaa6f8299cf008246153b08a610657848d124a880bc46b74e" exitCode=137
Jul 07 18:01:30.498948 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:01:30.498800    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29724120-96l5w" event={"ID":"dde07e7d-636a-44bd-a9cf-544f0872c0e9","Type":"ContainerDied","Data":"bafc5bd93c88988aaa6f8299cf008246153b08a610657848d124a880bc46b74e"}
Jul 07 18:01:30.498948 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:01:30.498807    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29724120-96l5w"
Jul 07 18:01:30.498948 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:01:30.498870    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29724120-96l5w" event={"ID":"dde07e7d-636a-44bd-a9cf-544f0872c0e9","Type":"ContainerDied","Data":"6d4c08097638bdbb43f8e8bce3997bac5d6d738bef96ee7f2b939517d086d744"}
Jul 07 18:01:30.498948 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:01:30.498891    2561 scope.go:117] "RemoveContainer" containerID="bafc5bd93c88988aaa6f8299cf008246153b08a610657848d124a880bc46b74e"
Jul 07 18:01:30.507516 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:01:30.507437    2561 scope.go:117] "RemoveContainer" containerID="bafc5bd93c88988aaa6f8299cf008246153b08a610657848d124a880bc46b74e"
Jul 07 18:01:30.507793 ip-10-0-139-31 kubenswrapper[2561]: E0707 18:01:30.507773    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bafc5bd93c88988aaa6f8299cf008246153b08a610657848d124a880bc46b74e\": container with ID starting with bafc5bd93c88988aaa6f8299cf008246153b08a610657848d124a880bc46b74e not found: ID does not exist" containerID="bafc5bd93c88988aaa6f8299cf008246153b08a610657848d124a880bc46b74e"
Jul 07 18:01:30.507832 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:01:30.507803    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bafc5bd93c88988aaa6f8299cf008246153b08a610657848d124a880bc46b74e"} err="failed to get container status \"bafc5bd93c88988aaa6f8299cf008246153b08a610657848d124a880bc46b74e\": rpc error: code = NotFound desc = could not find container \"bafc5bd93c88988aaa6f8299cf008246153b08a610657848d124a880bc46b74e\": container with ID starting with bafc5bd93c88988aaa6f8299cf008246153b08a610657848d124a880bc46b74e not found: ID does not exist"
Jul 07 18:01:30.530619 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:01:30.530586    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29724120-96l5w"]
Jul 07 18:01:30.533730 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:01:30.533706    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29724120-96l5w"]
Jul 07 18:01:31.521127 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:01:31.521094    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="dde07e7d-636a-44bd-a9cf-544f0872c0e9" path="/var/lib/kubelet/pods/dde07e7d-636a-44bd-a9cf-544f0872c0e9/volumes"
Jul 07 18:05:09.406111 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:05:09.406083    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-bjl48_805597ff-168d-4099-95b8-0037b0ceba2f/console-operator/1.log"
Jul 07 18:05:09.408987 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:05:09.408970    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-bjl48_805597ff-168d-4099-95b8-0037b0ceba2f/console-operator/1.log"
Jul 07 18:06:06.191168 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:06:06.191131    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-1acf7f3b-openshift-default-684f948689-nvmz4"]
Jul 07 18:06:06.191583 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:06:06.191536    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dde07e7d-636a-44bd-a9cf-544f0872c0e9" containerName="cleanup"
Jul 07 18:06:06.191583 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:06:06.191550    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="dde07e7d-636a-44bd-a9cf-544f0872c0e9" containerName="cleanup"
Jul 07 18:06:06.191652 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:06:06.191616    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="dde07e7d-636a-44bd-a9cf-544f0872c0e9" containerName="cleanup"
Jul 07 18:06:06.194011 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:06:06.193996    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-1acf7f3b-openshift-default-684f948689-nvmz4"
Jul 07 18:06:06.197044 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:06:06.197025    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Jul 07 18:06:06.197167 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:06:06.197044    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-1acf7f3b-openshift-default-dockercfg-mszdc\""
Jul 07 18:06:06.290667 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:06:06.290636    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-1acf7f3b-openshift-default-684f948689-nvmz4"]
Jul 07 18:06:06.317854 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:06:06.317819    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/628ca45b-75fd-4048-bfa8-4a5811182937-credential-socket\") pod \"e2e-ait-1acf7f3b-openshift-default-684f948689-nvmz4\" (UID: \"628ca45b-75fd-4048-bfa8-4a5811182937\") " pod="openshift-ingress/e2e-ait-1acf7f3b-openshift-default-684f948689-nvmz4"
Jul 07 18:06:06.317854 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:06:06.317864    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/628ca45b-75fd-4048-bfa8-4a5811182937-istio-envoy\") pod \"e2e-ait-1acf7f3b-openshift-default-684f948689-nvmz4\" (UID: \"628ca45b-75fd-4048-bfa8-4a5811182937\") " pod="openshift-ingress/e2e-ait-1acf7f3b-openshift-default-684f948689-nvmz4"
Jul 07 18:06:06.318098 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:06:06.317895    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/628ca45b-75fd-4048-bfa8-4a5811182937-istio-data\") pod \"e2e-ait-1acf7f3b-openshift-default-684f948689-nvmz4\" (UID: \"628ca45b-75fd-4048-bfa8-4a5811182937\") " pod="openshift-ingress/e2e-ait-1acf7f3b-openshift-default-684f948689-nvmz4"
Jul 07 18:06:06.318098 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:06:06.317939    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/628ca45b-75fd-4048-bfa8-4a5811182937-istio-token\") pod \"e2e-ait-1acf7f3b-openshift-default-684f948689-nvmz4\" (UID: \"628ca45b-75fd-4048-bfa8-4a5811182937\") " pod="openshift-ingress/e2e-ait-1acf7f3b-openshift-default-684f948689-nvmz4"
Jul 07 18:06:06.318098 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:06:06.318019    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/628ca45b-75fd-4048-bfa8-4a5811182937-istio-podinfo\") pod \"e2e-ait-1acf7f3b-openshift-default-684f948689-nvmz4\" (UID: \"628ca45b-75fd-4048-bfa8-4a5811182937\") " pod="openshift-ingress/e2e-ait-1acf7f3b-openshift-default-684f948689-nvmz4"
Jul 07 18:06:06.318098 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:06:06.318040    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/628ca45b-75fd-4048-bfa8-4a5811182937-workload-socket\") pod \"e2e-ait-1acf7f3b-openshift-default-684f948689-nvmz4\" (UID: \"628ca45b-75fd-4048-bfa8-4a5811182937\") " pod="openshift-ingress/e2e-ait-1acf7f3b-openshift-default-684f948689-nvmz4"
Jul 07 18:06:06.318098 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:06:06.318068    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/628ca45b-75fd-4048-bfa8-4a5811182937-workload-certs\") pod \"e2e-ait-1acf7f3b-openshift-default-684f948689-nvmz4\" (UID: \"628ca45b-75fd-4048-bfa8-4a5811182937\") " pod="openshift-ingress/e2e-ait-1acf7f3b-openshift-default-684f948689-nvmz4"
Jul 07 18:06:06.318098 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:06:06.318086    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-296gn\" (UniqueName: \"kubernetes.io/projected/628ca45b-75fd-4048-bfa8-4a5811182937-kube-api-access-296gn\") pod \"e2e-ait-1acf7f3b-openshift-default-684f948689-nvmz4\" (UID: \"628ca45b-75fd-4048-bfa8-4a5811182937\") " pod="openshift-ingress/e2e-ait-1acf7f3b-openshift-default-684f948689-nvmz4"
Jul 07 18:06:06.318311 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:06:06.318125    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/628ca45b-75fd-4048-bfa8-4a5811182937-istiod-ca-cert\") pod \"e2e-ait-1acf7f3b-openshift-default-684f948689-nvmz4\" (UID: \"628ca45b-75fd-4048-bfa8-4a5811182937\") " pod="openshift-ingress/e2e-ait-1acf7f3b-openshift-default-684f948689-nvmz4"
Jul 07 18:06:06.419243 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:06:06.419143    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/628ca45b-75fd-4048-bfa8-4a5811182937-istio-data\") pod \"e2e-ait-1acf7f3b-openshift-default-684f948689-nvmz4\" (UID: \"628ca45b-75fd-4048-bfa8-4a5811182937\") " pod="openshift-ingress/e2e-ait-1acf7f3b-openshift-default-684f948689-nvmz4"
Jul 07 18:06:06.419243 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:06:06.419196    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/628ca45b-75fd-4048-bfa8-4a5811182937-istio-token\") pod \"e2e-ait-1acf7f3b-openshift-default-684f948689-nvmz4\" (UID: \"628ca45b-75fd-4048-bfa8-4a5811182937\") " pod="openshift-ingress/e2e-ait-1acf7f3b-openshift-default-684f948689-nvmz4"
Jul 07 18:06:06.419243 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:06:06.419240    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/628ca45b-75fd-4048-bfa8-4a5811182937-istio-podinfo\") pod \"e2e-ait-1acf7f3b-openshift-default-684f948689-nvmz4\" (UID: \"628ca45b-75fd-4048-bfa8-4a5811182937\") " pod="openshift-ingress/e2e-ait-1acf7f3b-openshift-default-684f948689-nvmz4"
Jul 07 18:06:06.419562 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:06:06.419260    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/628ca45b-75fd-4048-bfa8-4a5811182937-workload-socket\") pod \"e2e-ait-1acf7f3b-openshift-default-684f948689-nvmz4\" (UID: \"628ca45b-75fd-4048-bfa8-4a5811182937\") " pod="openshift-ingress/e2e-ait-1acf7f3b-openshift-default-684f948689-nvmz4"
Jul 07 18:06:06.419562 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:06:06.419286    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/628ca45b-75fd-4048-bfa8-4a5811182937-workload-certs\") pod \"e2e-ait-1acf7f3b-openshift-default-684f948689-nvmz4\" (UID: \"628ca45b-75fd-4048-bfa8-4a5811182937\") " pod="openshift-ingress/e2e-ait-1acf7f3b-openshift-default-684f948689-nvmz4"
Jul 07 18:06:06.419562 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:06:06.419304    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-296gn\" (UniqueName: \"kubernetes.io/projected/628ca45b-75fd-4048-bfa8-4a5811182937-kube-api-access-296gn\") pod \"e2e-ait-1acf7f3b-openshift-default-684f948689-nvmz4\" (UID: \"628ca45b-75fd-4048-bfa8-4a5811182937\") " pod="openshift-ingress/e2e-ait-1acf7f3b-openshift-default-684f948689-nvmz4"
Jul 07 18:06:06.419562 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:06:06.419332    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/628ca45b-75fd-4048-bfa8-4a5811182937-istiod-ca-cert\") pod \"e2e-ait-1acf7f3b-openshift-default-684f948689-nvmz4\" (UID: \"628ca45b-75fd-4048-bfa8-4a5811182937\") " pod="openshift-ingress/e2e-ait-1acf7f3b-openshift-default-684f948689-nvmz4"
Jul 07 18:06:06.419562 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:06:06.419390    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/628ca45b-75fd-4048-bfa8-4a5811182937-credential-socket\") pod \"e2e-ait-1acf7f3b-openshift-default-684f948689-nvmz4\" (UID: \"628ca45b-75fd-4048-bfa8-4a5811182937\") " pod="openshift-ingress/e2e-ait-1acf7f3b-openshift-default-684f948689-nvmz4"
Jul 07 18:06:06.419562 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:06:06.419427    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/628ca45b-75fd-4048-bfa8-4a5811182937-istio-envoy\") pod \"e2e-ait-1acf7f3b-openshift-default-684f948689-nvmz4\" (UID: \"628ca45b-75fd-4048-bfa8-4a5811182937\") " pod="openshift-ingress/e2e-ait-1acf7f3b-openshift-default-684f948689-nvmz4"
Jul 07 18:06:06.419832 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:06:06.419686    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/628ca45b-75fd-4048-bfa8-4a5811182937-istio-data\") pod \"e2e-ait-1acf7f3b-openshift-default-684f948689-nvmz4\" (UID: \"628ca45b-75fd-4048-bfa8-4a5811182937\") " pod="openshift-ingress/e2e-ait-1acf7f3b-openshift-default-684f948689-nvmz4"
Jul 07 18:06:06.419832 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:06:06.419733    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/628ca45b-75fd-4048-bfa8-4a5811182937-workload-socket\") pod \"e2e-ait-1acf7f3b-openshift-default-684f948689-nvmz4\" (UID: \"628ca45b-75fd-4048-bfa8-4a5811182937\") " pod="openshift-ingress/e2e-ait-1acf7f3b-openshift-default-684f948689-nvmz4"
Jul 07 18:06:06.419906 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:06:06.419857    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/628ca45b-75fd-4048-bfa8-4a5811182937-workload-certs\") pod \"e2e-ait-1acf7f3b-openshift-default-684f948689-nvmz4\" (UID: \"628ca45b-75fd-4048-bfa8-4a5811182937\") " pod="openshift-ingress/e2e-ait-1acf7f3b-openshift-default-684f948689-nvmz4"
Jul 07 18:06:06.420045 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:06:06.420026    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/628ca45b-75fd-4048-bfa8-4a5811182937-credential-socket\") pod \"e2e-ait-1acf7f3b-openshift-default-684f948689-nvmz4\" (UID: \"628ca45b-75fd-4048-bfa8-4a5811182937\") " pod="openshift-ingress/e2e-ait-1acf7f3b-openshift-default-684f948689-nvmz4"
Jul 07 18:06:06.420382 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:06:06.420358    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/628ca45b-75fd-4048-bfa8-4a5811182937-istiod-ca-cert\") pod \"e2e-ait-1acf7f3b-openshift-default-684f948689-nvmz4\" (UID: \"628ca45b-75fd-4048-bfa8-4a5811182937\") " pod="openshift-ingress/e2e-ait-1acf7f3b-openshift-default-684f948689-nvmz4"
Jul 07 18:06:06.421622 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:06:06.421605    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/628ca45b-75fd-4048-bfa8-4a5811182937-istio-envoy\") pod \"e2e-ait-1acf7f3b-openshift-default-684f948689-nvmz4\" (UID: \"628ca45b-75fd-4048-bfa8-4a5811182937\") " pod="openshift-ingress/e2e-ait-1acf7f3b-openshift-default-684f948689-nvmz4"
Jul 07 18:06:06.421847 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:06:06.421831    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/628ca45b-75fd-4048-bfa8-4a5811182937-istio-podinfo\") pod \"e2e-ait-1acf7f3b-openshift-default-684f948689-nvmz4\" (UID: \"628ca45b-75fd-4048-bfa8-4a5811182937\") " pod="openshift-ingress/e2e-ait-1acf7f3b-openshift-default-684f948689-nvmz4"
Jul 07 18:06:06.433771 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:06:06.433741    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/628ca45b-75fd-4048-bfa8-4a5811182937-istio-token\") pod \"e2e-ait-1acf7f3b-openshift-default-684f948689-nvmz4\" (UID: \"628ca45b-75fd-4048-bfa8-4a5811182937\") " pod="openshift-ingress/e2e-ait-1acf7f3b-openshift-default-684f948689-nvmz4"
Jul 07 18:06:06.433975 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:06:06.433960    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-296gn\" (UniqueName: \"kubernetes.io/projected/628ca45b-75fd-4048-bfa8-4a5811182937-kube-api-access-296gn\") pod \"e2e-ait-1acf7f3b-openshift-default-684f948689-nvmz4\" (UID: \"628ca45b-75fd-4048-bfa8-4a5811182937\") " pod="openshift-ingress/e2e-ait-1acf7f3b-openshift-default-684f948689-nvmz4"
Jul 07 18:06:06.503996 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:06:06.503961    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-1acf7f3b-openshift-default-684f948689-nvmz4"
Jul 07 18:06:06.652321 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:06:06.652296    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-1acf7f3b-openshift-default-684f948689-nvmz4"]
Jul 07 18:06:06.654591 ip-10-0-139-31 kubenswrapper[2561]: W0707 18:06:06.654563    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod628ca45b_75fd_4048_bfa8_4a5811182937.slice/crio-9b19fe95f5f540f7a95d4953f89c5339eb367ac4d79fe881edaa3d5c25c08607 WatchSource:0}: Error finding container 9b19fe95f5f540f7a95d4953f89c5339eb367ac4d79fe881edaa3d5c25c08607: Status 404 returned error can't find the container with id 9b19fe95f5f540f7a95d4953f89c5339eb367ac4d79fe881edaa3d5c25c08607
Jul 07 18:06:06.656617 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:06:06.656592    2561 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 07 18:06:06.781888 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:06:06.781798    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-1acf7f3b-openshift-default-684f948689-nvmz4" event={"ID":"628ca45b-75fd-4048-bfa8-4a5811182937","Type":"ContainerStarted","Data":"9b19fe95f5f540f7a95d4953f89c5339eb367ac4d79fe881edaa3d5c25c08607"}
Jul 07 18:06:10.581608 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:06:10.581565    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 07 18:06:10.581919 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:06:10.581640    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 07 18:06:10.581919 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:06:10.581673    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 07 18:06:10.804122 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:06:10.804081    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-1acf7f3b-openshift-default-684f948689-nvmz4" event={"ID":"628ca45b-75fd-4048-bfa8-4a5811182937","Type":"ContainerStarted","Data":"ea47448d2098653d9499d5d7d1b695d1dd47c1604e5b5c5188981128fd36f032"}
Jul 07 18:06:10.833029 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:06:10.832974    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-1acf7f3b-openshift-default-684f948689-nvmz4" podStartSLOduration=0.908486952 podStartE2EDuration="4.832957799s" totalImagesPullingTime="3.924470847s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 18:06:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 18:06:10.830970763 +0000 UTC m=+1561.982095161" watchObservedRunningTime="2026-07-07 18:06:10.832957799 +0000 UTC m=+1561.984082197"
Jul 07 18:06:11.504589 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:06:11.504553    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-1acf7f3b-openshift-default-684f948689-nvmz4"
Jul 07 18:06:11.509637 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:06:11.509605    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-1acf7f3b-openshift-default-684f948689-nvmz4"
Jul 07 18:06:11.809961 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:06:11.809927    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-1acf7f3b-openshift-default-684f948689-nvmz4"
Jul 07 18:06:11.877605 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:06:11.877563    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-1acf7f3b-openshift-default-684f948689-nvmz4"
Jul 07 18:06:12.661489 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:06:12.661424    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-1acf7f3b-openshift-default-684f948689-nvmz4"]
Jul 07 18:06:12.814366 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:06:12.814331    2561 kubelet_pods.go:1082] "Unable to retrieve pull secret, the image pull may not succeed." pod="openshift-ingress/e2e-ait-1acf7f3b-openshift-default-684f948689-nvmz4" secret="" err="secret \"e2e-ait-1acf7f3b-openshift-default-dockercfg-mszdc\" not found"
Jul 07 18:06:13.819043 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:06:13.819000    2561 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-1acf7f3b-openshift-default-684f948689-nvmz4" podUID="628ca45b-75fd-4048-bfa8-4a5811182937" containerName="istio-proxy" containerID="cri-o://ea47448d2098653d9499d5d7d1b695d1dd47c1604e5b5c5188981128fd36f032" gracePeriod=30
Jul 07 18:06:18.845176 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:06:18.845146    2561 generic.go:356] "Generic (PLEG): container finished" podID="628ca45b-75fd-4048-bfa8-4a5811182937" containerID="ea47448d2098653d9499d5d7d1b695d1dd47c1604e5b5c5188981128fd36f032" exitCode=0
Jul 07 18:06:18.845598 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:06:18.845224    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-1acf7f3b-openshift-default-684f948689-nvmz4" event={"ID":"628ca45b-75fd-4048-bfa8-4a5811182937","Type":"ContainerDied","Data":"ea47448d2098653d9499d5d7d1b695d1dd47c1604e5b5c5188981128fd36f032"}
Jul 07 18:06:18.977727 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:06:18.977652    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-1acf7f3b-openshift-default-684f948689-nvmz4"
Jul 07 18:06:19.079824 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:06:19.079786    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-1f1d4907-openshift-default-5b7f8559b7-hg9ct"]
Jul 07 18:06:19.080191 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:06:19.080176    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="628ca45b-75fd-4048-bfa8-4a5811182937" containerName="istio-proxy"
Jul 07 18:06:19.080268 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:06:19.080193    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="628ca45b-75fd-4048-bfa8-4a5811182937" containerName="istio-proxy"
Jul 07 18:06:19.080268 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:06:19.080257    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="628ca45b-75fd-4048-bfa8-4a5811182937" containerName="istio-proxy"
Jul 07 18:06:19.083181 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:06:19.083158    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-1f1d4907-openshift-default-5b7f8559b7-hg9ct"
Jul 07 18:06:19.086766 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:06:19.086743    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-1f1d4907-openshift-default-dockercfg-2wjbc\""
Jul 07 18:06:19.103137 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:06:19.103092    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-1f1d4907-openshift-default-5b7f8559b7-hg9ct"]
Jul 07 18:06:19.144553 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:06:19.144519    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/628ca45b-75fd-4048-bfa8-4a5811182937-istiod-ca-cert\") pod \"628ca45b-75fd-4048-bfa8-4a5811182937\" (UID: \"628ca45b-75fd-4048-bfa8-4a5811182937\") "
Jul 07 18:06:19.144744 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:06:19.144589    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/628ca45b-75fd-4048-bfa8-4a5811182937-workload-socket\") pod \"628ca45b-75fd-4048-bfa8-4a5811182937\" (UID: \"628ca45b-75fd-4048-bfa8-4a5811182937\") "
Jul 07 18:06:19.144744 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:06:19.144613    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/628ca45b-75fd-4048-bfa8-4a5811182937-istio-data\") pod \"628ca45b-75fd-4048-bfa8-4a5811182937\" (UID: \"628ca45b-75fd-4048-bfa8-4a5811182937\") "
Jul 07 18:06:19.144744 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:06:19.144632    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/628ca45b-75fd-4048-bfa8-4a5811182937-workload-certs\") pod \"628ca45b-75fd-4048-bfa8-4a5811182937\" (UID: \"628ca45b-75fd-4048-bfa8-4a5811182937\") "
Jul 07 18:06:19.144744 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:06:19.144657    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/628ca45b-75fd-4048-bfa8-4a5811182937-credential-socket\") pod \"628ca45b-75fd-4048-bfa8-4a5811182937\" (UID: \"628ca45b-75fd-4048-bfa8-4a5811182937\") "
Jul 07 18:06:19.144744 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:06:19.144692    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-296gn\" (UniqueName: \"kubernetes.io/projected/628ca45b-75fd-4048-bfa8-4a5811182937-kube-api-access-296gn\") pod \"628ca45b-75fd-4048-bfa8-4a5811182937\" (UID: \"628ca45b-75fd-4048-bfa8-4a5811182937\") "
Jul 07 18:06:19.144744 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:06:19.144732    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/628ca45b-75fd-4048-bfa8-4a5811182937-istio-token\") pod \"628ca45b-75fd-4048-bfa8-4a5811182937\" (UID: \"628ca45b-75fd-4048-bfa8-4a5811182937\") "
Jul 07 18:06:19.145018 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:06:19.144777    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/628ca45b-75fd-4048-bfa8-4a5811182937-istio-podinfo\") pod \"628ca45b-75fd-4048-bfa8-4a5811182937\" (UID: \"628ca45b-75fd-4048-bfa8-4a5811182937\") "
Jul 07 18:06:19.145018 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:06:19.144816    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/628ca45b-75fd-4048-bfa8-4a5811182937-istio-envoy\") pod \"628ca45b-75fd-4048-bfa8-4a5811182937\" (UID: \"628ca45b-75fd-4048-bfa8-4a5811182937\") "
Jul 07 18:06:19.145211 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:06:19.145186    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/628ca45b-75fd-4048-bfa8-4a5811182937-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "628ca45b-75fd-4048-bfa8-4a5811182937" (UID: "628ca45b-75fd-4048-bfa8-4a5811182937"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 18:06:19.145211 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:06:19.145200    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/628ca45b-75fd-4048-bfa8-4a5811182937-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "628ca45b-75fd-4048-bfa8-4a5811182937" (UID: "628ca45b-75fd-4048-bfa8-4a5811182937"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 18:06:19.145787 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:06:19.145747    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/628ca45b-75fd-4048-bfa8-4a5811182937-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "628ca45b-75fd-4048-bfa8-4a5811182937" (UID: "628ca45b-75fd-4048-bfa8-4a5811182937"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 18:06:19.146058 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:06:19.146031    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/628ca45b-75fd-4048-bfa8-4a5811182937-istio-data" (OuterVolumeSpecName: "istio-data") pod "628ca45b-75fd-4048-bfa8-4a5811182937" (UID: "628ca45b-75fd-4048-bfa8-4a5811182937"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 18:06:19.146133 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:06:19.146041    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/628ca45b-75fd-4048-bfa8-4a5811182937-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "628ca45b-75fd-4048-bfa8-4a5811182937" (UID: "628ca45b-75fd-4048-bfa8-4a5811182937"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 18:06:19.147363 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:06:19.147336    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/628ca45b-75fd-4048-bfa8-4a5811182937-istio-token" (OuterVolumeSpecName: "istio-token") pod "628ca45b-75fd-4048-bfa8-4a5811182937" (UID: "628ca45b-75fd-4048-bfa8-4a5811182937"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 18:06:19.147463 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:06:19.147366    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/628ca45b-75fd-4048-bfa8-4a5811182937-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "628ca45b-75fd-4048-bfa8-4a5811182937" (UID: "628ca45b-75fd-4048-bfa8-4a5811182937"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 07 18:06:19.147852 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:06:19.147827    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/628ca45b-75fd-4048-bfa8-4a5811182937-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "628ca45b-75fd-4048-bfa8-4a5811182937" (UID: "628ca45b-75fd-4048-bfa8-4a5811182937"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 18:06:19.147910 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:06:19.147833    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/628ca45b-75fd-4048-bfa8-4a5811182937-kube-api-access-296gn" (OuterVolumeSpecName: "kube-api-access-296gn") pod "628ca45b-75fd-4048-bfa8-4a5811182937" (UID: "628ca45b-75fd-4048-bfa8-4a5811182937"). InnerVolumeSpecName "kube-api-access-296gn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 18:06:19.245995 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:06:19.245897    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/de3d00f1-3817-43ef-95ac-21c1f620905f-istio-data\") pod \"e2e-ait-1f1d4907-openshift-default-5b7f8559b7-hg9ct\" (UID: \"de3d00f1-3817-43ef-95ac-21c1f620905f\") " pod="openshift-ingress/e2e-ait-1f1d4907-openshift-default-5b7f8559b7-hg9ct"
Jul 07 18:06:19.245995 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:06:19.245940    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gs6zf\" (UniqueName: \"kubernetes.io/projected/de3d00f1-3817-43ef-95ac-21c1f620905f-kube-api-access-gs6zf\") pod \"e2e-ait-1f1d4907-openshift-default-5b7f8559b7-hg9ct\" (UID: \"de3d00f1-3817-43ef-95ac-21c1f620905f\") " pod="openshift-ingress/e2e-ait-1f1d4907-openshift-default-5b7f8559b7-hg9ct"
Jul 07 18:06:19.246241 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:06:19.246010    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/de3d00f1-3817-43ef-95ac-21c1f620905f-istio-token\") pod \"e2e-ait-1f1d4907-openshift-default-5b7f8559b7-hg9ct\" (UID: \"de3d00f1-3817-43ef-95ac-21c1f620905f\") " pod="openshift-ingress/e2e-ait-1f1d4907-openshift-default-5b7f8559b7-hg9ct"
Jul 07 18:06:19.246241 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:06:19.246093    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/de3d00f1-3817-43ef-95ac-21c1f620905f-istio-podinfo\") pod \"e2e-ait-1f1d4907-openshift-default-5b7f8559b7-hg9ct\" (UID: \"de3d00f1-3817-43ef-95ac-21c1f620905f\") " pod="openshift-ingress/e2e-ait-1f1d4907-openshift-default-5b7f8559b7-hg9ct"
Jul 07 18:06:19.246241 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:06:19.246117    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/de3d00f1-3817-43ef-95ac-21c1f620905f-istiod-ca-cert\") pod \"e2e-ait-1f1d4907-openshift-default-5b7f8559b7-hg9ct\" (UID: \"de3d00f1-3817-43ef-95ac-21c1f620905f\") " pod="openshift-ingress/e2e-ait-1f1d4907-openshift-default-5b7f8559b7-hg9ct"
Jul 07 18:06:19.246241 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:06:19.246139    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/de3d00f1-3817-43ef-95ac-21c1f620905f-credential-socket\") pod \"e2e-ait-1f1d4907-openshift-default-5b7f8559b7-hg9ct\" (UID: \"de3d00f1-3817-43ef-95ac-21c1f620905f\") " pod="openshift-ingress/e2e-ait-1f1d4907-openshift-default-5b7f8559b7-hg9ct"
Jul 07 18:06:19.246241 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:06:19.246156    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/de3d00f1-3817-43ef-95ac-21c1f620905f-workload-certs\") pod \"e2e-ait-1f1d4907-openshift-default-5b7f8559b7-hg9ct\" (UID: \"de3d00f1-3817-43ef-95ac-21c1f620905f\") " pod="openshift-ingress/e2e-ait-1f1d4907-openshift-default-5b7f8559b7-hg9ct"
Jul 07 18:06:19.246241 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:06:19.246209    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/de3d00f1-3817-43ef-95ac-21c1f620905f-workload-socket\") pod \"e2e-ait-1f1d4907-openshift-default-5b7f8559b7-hg9ct\" (UID: \"de3d00f1-3817-43ef-95ac-21c1f620905f\") " pod="openshift-ingress/e2e-ait-1f1d4907-openshift-default-5b7f8559b7-hg9ct"
Jul 07 18:06:19.246241 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:06:19.246226    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/de3d00f1-3817-43ef-95ac-21c1f620905f-istio-envoy\") pod \"e2e-ait-1f1d4907-openshift-default-5b7f8559b7-hg9ct\" (UID: \"de3d00f1-3817-43ef-95ac-21c1f620905f\") " pod="openshift-ingress/e2e-ait-1f1d4907-openshift-default-5b7f8559b7-hg9ct"
Jul 07 18:06:19.246534 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:06:19.246299    2561 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/628ca45b-75fd-4048-bfa8-4a5811182937-istio-token\") on node \"ip-10-0-139-31.ec2.internal\" DevicePath \"\""
Jul 07 18:06:19.246534 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:06:19.246310    2561 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/628ca45b-75fd-4048-bfa8-4a5811182937-istio-podinfo\") on node \"ip-10-0-139-31.ec2.internal\" DevicePath \"\""
Jul 07 18:06:19.246534 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:06:19.246318    2561 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/628ca45b-75fd-4048-bfa8-4a5811182937-istio-envoy\") on node \"ip-10-0-139-31.ec2.internal\" DevicePath \"\""
Jul 07 18:06:19.246534 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:06:19.246327    2561 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/628ca45b-75fd-4048-bfa8-4a5811182937-istiod-ca-cert\") on node \"ip-10-0-139-31.ec2.internal\" DevicePath \"\""
Jul 07 18:06:19.246534 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:06:19.246337    2561 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/628ca45b-75fd-4048-bfa8-4a5811182937-workload-socket\") on node \"ip-10-0-139-31.ec2.internal\" DevicePath \"\""
Jul 07 18:06:19.246534 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:06:19.246344    2561 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/628ca45b-75fd-4048-bfa8-4a5811182937-istio-data\") on node \"ip-10-0-139-31.ec2.internal\" DevicePath \"\""
Jul 07 18:06:19.246534 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:06:19.246352    2561 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/628ca45b-75fd-4048-bfa8-4a5811182937-workload-certs\") on node \"ip-10-0-139-31.ec2.internal\" DevicePath \"\""
Jul 07 18:06:19.246534 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:06:19.246360    2561 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/628ca45b-75fd-4048-bfa8-4a5811182937-credential-socket\") on node \"ip-10-0-139-31.ec2.internal\" DevicePath \"\""
Jul 07 18:06:19.246534 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:06:19.246369    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-296gn\" (UniqueName: \"kubernetes.io/projected/628ca45b-75fd-4048-bfa8-4a5811182937-kube-api-access-296gn\") on node \"ip-10-0-139-31.ec2.internal\" DevicePath \"\""
Jul 07 18:06:19.347440 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:06:19.347397    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/de3d00f1-3817-43ef-95ac-21c1f620905f-istio-token\") pod \"e2e-ait-1f1d4907-openshift-default-5b7f8559b7-hg9ct\" (UID: \"de3d00f1-3817-43ef-95ac-21c1f620905f\") " pod="openshift-ingress/e2e-ait-1f1d4907-openshift-default-5b7f8559b7-hg9ct"
Jul 07 18:06:19.347672 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:06:19.347521    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/de3d00f1-3817-43ef-95ac-21c1f620905f-istio-podinfo\") pod \"e2e-ait-1f1d4907-openshift-default-5b7f8559b7-hg9ct\" (UID: \"de3d00f1-3817-43ef-95ac-21c1f620905f\") " pod="openshift-ingress/e2e-ait-1f1d4907-openshift-default-5b7f8559b7-hg9ct"
Jul 07 18:06:19.347672 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:06:19.347548    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/de3d00f1-3817-43ef-95ac-21c1f620905f-istiod-ca-cert\") pod \"e2e-ait-1f1d4907-openshift-default-5b7f8559b7-hg9ct\" (UID: \"de3d00f1-3817-43ef-95ac-21c1f620905f\") " pod="openshift-ingress/e2e-ait-1f1d4907-openshift-default-5b7f8559b7-hg9ct"
Jul 07 18:06:19.347672 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:06:19.347578    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/de3d00f1-3817-43ef-95ac-21c1f620905f-credential-socket\") pod \"e2e-ait-1f1d4907-openshift-default-5b7f8559b7-hg9ct\" (UID: \"de3d00f1-3817-43ef-95ac-21c1f620905f\") " pod="openshift-ingress/e2e-ait-1f1d4907-openshift-default-5b7f8559b7-hg9ct"
Jul 07 18:06:19.347869 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:06:19.347787    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/de3d00f1-3817-43ef-95ac-21c1f620905f-workload-certs\") pod \"e2e-ait-1f1d4907-openshift-default-5b7f8559b7-hg9ct\" (UID: \"de3d00f1-3817-43ef-95ac-21c1f620905f\") " pod="openshift-ingress/e2e-ait-1f1d4907-openshift-default-5b7f8559b7-hg9ct"
Jul 07 18:06:19.347869 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:06:19.347859    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/de3d00f1-3817-43ef-95ac-21c1f620905f-workload-socket\") pod \"e2e-ait-1f1d4907-openshift-default-5b7f8559b7-hg9ct\" (UID: \"de3d00f1-3817-43ef-95ac-21c1f620905f\") " pod="openshift-ingress/e2e-ait-1f1d4907-openshift-default-5b7f8559b7-hg9ct"
Jul 07 18:06:19.347973 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:06:19.347889    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/de3d00f1-3817-43ef-95ac-21c1f620905f-istio-envoy\") pod \"e2e-ait-1f1d4907-openshift-default-5b7f8559b7-hg9ct\" (UID: \"de3d00f1-3817-43ef-95ac-21c1f620905f\") " pod="openshift-ingress/e2e-ait-1f1d4907-openshift-default-5b7f8559b7-hg9ct"
Jul 07 18:06:19.347973 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:06:19.347951    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/de3d00f1-3817-43ef-95ac-21c1f620905f-istio-data\") pod \"e2e-ait-1f1d4907-openshift-default-5b7f8559b7-hg9ct\" (UID: \"de3d00f1-3817-43ef-95ac-21c1f620905f\") " pod="openshift-ingress/e2e-ait-1f1d4907-openshift-default-5b7f8559b7-hg9ct"
Jul 07 18:06:19.348072 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:06:19.347991    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/de3d00f1-3817-43ef-95ac-21c1f620905f-credential-socket\") pod \"e2e-ait-1f1d4907-openshift-default-5b7f8559b7-hg9ct\" (UID: \"de3d00f1-3817-43ef-95ac-21c1f620905f\") " pod="openshift-ingress/e2e-ait-1f1d4907-openshift-default-5b7f8559b7-hg9ct"
Jul 07 18:06:19.348072 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:06:19.348027    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gs6zf\" (UniqueName: \"kubernetes.io/projected/de3d00f1-3817-43ef-95ac-21c1f620905f-kube-api-access-gs6zf\") pod \"e2e-ait-1f1d4907-openshift-default-5b7f8559b7-hg9ct\" (UID: \"de3d00f1-3817-43ef-95ac-21c1f620905f\") " pod="openshift-ingress/e2e-ait-1f1d4907-openshift-default-5b7f8559b7-hg9ct"
Jul 07 18:06:19.348186 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:06:19.348065    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/de3d00f1-3817-43ef-95ac-21c1f620905f-workload-certs\") pod \"e2e-ait-1f1d4907-openshift-default-5b7f8559b7-hg9ct\" (UID: \"de3d00f1-3817-43ef-95ac-21c1f620905f\") " pod="openshift-ingress/e2e-ait-1f1d4907-openshift-default-5b7f8559b7-hg9ct"
Jul 07 18:06:19.348239 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:06:19.348188    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/de3d00f1-3817-43ef-95ac-21c1f620905f-istio-data\") pod \"e2e-ait-1f1d4907-openshift-default-5b7f8559b7-hg9ct\" (UID: \"de3d00f1-3817-43ef-95ac-21c1f620905f\") " pod="openshift-ingress/e2e-ait-1f1d4907-openshift-default-5b7f8559b7-hg9ct"
Jul 07 18:06:19.348299 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:06:19.348285    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/de3d00f1-3817-43ef-95ac-21c1f620905f-workload-socket\") pod \"e2e-ait-1f1d4907-openshift-default-5b7f8559b7-hg9ct\" (UID: \"de3d00f1-3817-43ef-95ac-21c1f620905f\") " pod="openshift-ingress/e2e-ait-1f1d4907-openshift-default-5b7f8559b7-hg9ct"
Jul 07 18:06:19.348361 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:06:19.348343    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/de3d00f1-3817-43ef-95ac-21c1f620905f-istiod-ca-cert\") pod \"e2e-ait-1f1d4907-openshift-default-5b7f8559b7-hg9ct\" (UID: \"de3d00f1-3817-43ef-95ac-21c1f620905f\") " pod="openshift-ingress/e2e-ait-1f1d4907-openshift-default-5b7f8559b7-hg9ct"
Jul 07 18:06:19.350030 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:06:19.350007    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/de3d00f1-3817-43ef-95ac-21c1f620905f-istio-envoy\") pod \"e2e-ait-1f1d4907-openshift-default-5b7f8559b7-hg9ct\" (UID: \"de3d00f1-3817-43ef-95ac-21c1f620905f\") " pod="openshift-ingress/e2e-ait-1f1d4907-openshift-default-5b7f8559b7-hg9ct"
Jul 07 18:06:19.350264 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:06:19.350246    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/de3d00f1-3817-43ef-95ac-21c1f620905f-istio-podinfo\") pod \"e2e-ait-1f1d4907-openshift-default-5b7f8559b7-hg9ct\" (UID: \"de3d00f1-3817-43ef-95ac-21c1f620905f\") " pod="openshift-ingress/e2e-ait-1f1d4907-openshift-default-5b7f8559b7-hg9ct"
Jul 07 18:06:19.359006 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:06:19.358974    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gs6zf\" (UniqueName: \"kubernetes.io/projected/de3d00f1-3817-43ef-95ac-21c1f620905f-kube-api-access-gs6zf\") pod \"e2e-ait-1f1d4907-openshift-default-5b7f8559b7-hg9ct\" (UID: \"de3d00f1-3817-43ef-95ac-21c1f620905f\") " pod="openshift-ingress/e2e-ait-1f1d4907-openshift-default-5b7f8559b7-hg9ct"
Jul 07 18:06:19.359375 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:06:19.359356    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/de3d00f1-3817-43ef-95ac-21c1f620905f-istio-token\") pod \"e2e-ait-1f1d4907-openshift-default-5b7f8559b7-hg9ct\" (UID: \"de3d00f1-3817-43ef-95ac-21c1f620905f\") " pod="openshift-ingress/e2e-ait-1f1d4907-openshift-default-5b7f8559b7-hg9ct"
Jul 07 18:06:19.394380 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:06:19.394348    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-1f1d4907-openshift-default-5b7f8559b7-hg9ct"
Jul 07 18:06:19.546305 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:06:19.546278    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-1f1d4907-openshift-default-5b7f8559b7-hg9ct"]
Jul 07 18:06:19.547910 ip-10-0-139-31 kubenswrapper[2561]: W0707 18:06:19.547878    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podde3d00f1_3817_43ef_95ac_21c1f620905f.slice/crio-a0a846d201d95b82ef46b5d2ee519bc5148e8f6b797646a55f5176f3cbcaca8c WatchSource:0}: Error finding container a0a846d201d95b82ef46b5d2ee519bc5148e8f6b797646a55f5176f3cbcaca8c: Status 404 returned error can't find the container with id a0a846d201d95b82ef46b5d2ee519bc5148e8f6b797646a55f5176f3cbcaca8c
Jul 07 18:06:19.549991 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:06:19.549961    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 07 18:06:19.550041 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:06:19.550028    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 07 18:06:19.550072 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:06:19.550060    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 07 18:06:19.852643 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:06:19.852604    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-1f1d4907-openshift-default-5b7f8559b7-hg9ct" event={"ID":"de3d00f1-3817-43ef-95ac-21c1f620905f","Type":"ContainerStarted","Data":"64073b340a8a0fc7c6a97b33743b8a66c686251fe8de3193b6e11613364e1cb3"}
Jul 07 18:06:19.853130 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:06:19.852662    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-1f1d4907-openshift-default-5b7f8559b7-hg9ct" event={"ID":"de3d00f1-3817-43ef-95ac-21c1f620905f","Type":"ContainerStarted","Data":"a0a846d201d95b82ef46b5d2ee519bc5148e8f6b797646a55f5176f3cbcaca8c"}
Jul 07 18:06:19.853931 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:06:19.853906    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-1acf7f3b-openshift-default-684f948689-nvmz4" event={"ID":"628ca45b-75fd-4048-bfa8-4a5811182937","Type":"ContainerDied","Data":"9b19fe95f5f540f7a95d4953f89c5339eb367ac4d79fe881edaa3d5c25c08607"}
Jul 07 18:06:19.854059 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:06:19.853945    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-1acf7f3b-openshift-default-684f948689-nvmz4"
Jul 07 18:06:19.854059 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:06:19.853957    2561 scope.go:117] "RemoveContainer" containerID="ea47448d2098653d9499d5d7d1b695d1dd47c1604e5b5c5188981128fd36f032"
Jul 07 18:06:19.875695 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:06:19.875643    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-1f1d4907-openshift-default-5b7f8559b7-hg9ct" podStartSLOduration=0.875626837 podStartE2EDuration="875.626837ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 18:06:19 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 18:06:19.874659037 +0000 UTC m=+1571.025783461" watchObservedRunningTime="2026-07-07 18:06:19.875626837 +0000 UTC m=+1571.026751235"
Jul 07 18:06:19.893341 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:06:19.893306    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-1acf7f3b-openshift-default-684f948689-nvmz4"]
Jul 07 18:06:19.897049 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:06:19.897024    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-1acf7f3b-openshift-default-684f948689-nvmz4"]
Jul 07 18:06:20.395321 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:06:20.395279    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-1f1d4907-openshift-default-5b7f8559b7-hg9ct"
Jul 07 18:06:20.399942 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:06:20.399916    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-1f1d4907-openshift-default-5b7f8559b7-hg9ct"
Jul 07 18:06:20.859756 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:06:20.859727    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-1f1d4907-openshift-default-5b7f8559b7-hg9ct"
Jul 07 18:06:20.860608 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:06:20.860588    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-1f1d4907-openshift-default-5b7f8559b7-hg9ct"
Jul 07 18:06:21.521463 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:06:21.521410    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="628ca45b-75fd-4048-bfa8-4a5811182937" path="/var/lib/kubelet/pods/628ca45b-75fd-4048-bfa8-4a5811182937/volumes"
Jul 07 18:06:31.523176 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:06:31.523143    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-1f1d4907-openshift-default-5b7f8559b7-hg9ct"]
Jul 07 18:06:31.525622 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:06:31.523336    2561 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-1f1d4907-openshift-default-5b7f8559b7-hg9ct" podUID="de3d00f1-3817-43ef-95ac-21c1f620905f" containerName="istio-proxy" containerID="cri-o://64073b340a8a0fc7c6a97b33743b8a66c686251fe8de3193b6e11613364e1cb3" gracePeriod=30
Jul 07 18:06:31.776210 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:06:31.776146    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-1f1d4907-openshift-default-5b7f8559b7-hg9ct"
Jul 07 18:06:31.867521 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:06:31.867495    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/de3d00f1-3817-43ef-95ac-21c1f620905f-istio-token\") pod \"de3d00f1-3817-43ef-95ac-21c1f620905f\" (UID: \"de3d00f1-3817-43ef-95ac-21c1f620905f\") "
Jul 07 18:06:31.867663 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:06:31.867550    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gs6zf\" (UniqueName: \"kubernetes.io/projected/de3d00f1-3817-43ef-95ac-21c1f620905f-kube-api-access-gs6zf\") pod \"de3d00f1-3817-43ef-95ac-21c1f620905f\" (UID: \"de3d00f1-3817-43ef-95ac-21c1f620905f\") "
Jul 07 18:06:31.867663 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:06:31.867568    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/de3d00f1-3817-43ef-95ac-21c1f620905f-istio-podinfo\") pod \"de3d00f1-3817-43ef-95ac-21c1f620905f\" (UID: \"de3d00f1-3817-43ef-95ac-21c1f620905f\") "
Jul 07 18:06:31.867663 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:06:31.867591    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/de3d00f1-3817-43ef-95ac-21c1f620905f-istio-envoy\") pod \"de3d00f1-3817-43ef-95ac-21c1f620905f\" (UID: \"de3d00f1-3817-43ef-95ac-21c1f620905f\") "
Jul 07 18:06:31.867663 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:06:31.867627    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/de3d00f1-3817-43ef-95ac-21c1f620905f-workload-certs\") pod \"de3d00f1-3817-43ef-95ac-21c1f620905f\" (UID: \"de3d00f1-3817-43ef-95ac-21c1f620905f\") "
Jul 07 18:06:31.867882 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:06:31.867679    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/de3d00f1-3817-43ef-95ac-21c1f620905f-workload-socket\") pod \"de3d00f1-3817-43ef-95ac-21c1f620905f\" (UID: \"de3d00f1-3817-43ef-95ac-21c1f620905f\") "
Jul 07 18:06:31.867882 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:06:31.867707    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/de3d00f1-3817-43ef-95ac-21c1f620905f-istio-data\") pod \"de3d00f1-3817-43ef-95ac-21c1f620905f\" (UID: \"de3d00f1-3817-43ef-95ac-21c1f620905f\") "
Jul 07 18:06:31.867882 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:06:31.867734    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/de3d00f1-3817-43ef-95ac-21c1f620905f-istiod-ca-cert\") pod \"de3d00f1-3817-43ef-95ac-21c1f620905f\" (UID: \"de3d00f1-3817-43ef-95ac-21c1f620905f\") "
Jul 07 18:06:31.867882 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:06:31.867765    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/de3d00f1-3817-43ef-95ac-21c1f620905f-credential-socket\") pod \"de3d00f1-3817-43ef-95ac-21c1f620905f\" (UID: \"de3d00f1-3817-43ef-95ac-21c1f620905f\") "
Jul 07 18:06:31.868096 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:06:31.867979    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/de3d00f1-3817-43ef-95ac-21c1f620905f-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "de3d00f1-3817-43ef-95ac-21c1f620905f" (UID: "de3d00f1-3817-43ef-95ac-21c1f620905f"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 18:06:31.868096 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:06:31.868087    2561 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/de3d00f1-3817-43ef-95ac-21c1f620905f-workload-certs\") on node \"ip-10-0-139-31.ec2.internal\" DevicePath \"\""
Jul 07 18:06:31.868204 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:06:31.868186    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/de3d00f1-3817-43ef-95ac-21c1f620905f-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "de3d00f1-3817-43ef-95ac-21c1f620905f" (UID: "de3d00f1-3817-43ef-95ac-21c1f620905f"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 18:06:31.868348 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:06:31.868305    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/de3d00f1-3817-43ef-95ac-21c1f620905f-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "de3d00f1-3817-43ef-95ac-21c1f620905f" (UID: "de3d00f1-3817-43ef-95ac-21c1f620905f"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 18:06:31.868924 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:06:31.868897    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/de3d00f1-3817-43ef-95ac-21c1f620905f-istio-data" (OuterVolumeSpecName: "istio-data") pod "de3d00f1-3817-43ef-95ac-21c1f620905f" (UID: "de3d00f1-3817-43ef-95ac-21c1f620905f"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 18:06:31.869095 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:06:31.869070    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/de3d00f1-3817-43ef-95ac-21c1f620905f-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "de3d00f1-3817-43ef-95ac-21c1f620905f" (UID: "de3d00f1-3817-43ef-95ac-21c1f620905f"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 18:06:31.869918 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:06:31.869893    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/de3d00f1-3817-43ef-95ac-21c1f620905f-kube-api-access-gs6zf" (OuterVolumeSpecName: "kube-api-access-gs6zf") pod "de3d00f1-3817-43ef-95ac-21c1f620905f" (UID: "de3d00f1-3817-43ef-95ac-21c1f620905f"). InnerVolumeSpecName "kube-api-access-gs6zf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 18:06:31.870006 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:06:31.869988    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/de3d00f1-3817-43ef-95ac-21c1f620905f-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "de3d00f1-3817-43ef-95ac-21c1f620905f" (UID: "de3d00f1-3817-43ef-95ac-21c1f620905f"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 07 18:06:31.870086 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:06:31.870069    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/de3d00f1-3817-43ef-95ac-21c1f620905f-istio-token" (OuterVolumeSpecName: "istio-token") pod "de3d00f1-3817-43ef-95ac-21c1f620905f" (UID: "de3d00f1-3817-43ef-95ac-21c1f620905f"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 18:06:31.870196 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:06:31.870181    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/de3d00f1-3817-43ef-95ac-21c1f620905f-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "de3d00f1-3817-43ef-95ac-21c1f620905f" (UID: "de3d00f1-3817-43ef-95ac-21c1f620905f"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 18:06:31.923944 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:06:31.923908    2561 generic.go:356] "Generic (PLEG): container finished" podID="de3d00f1-3817-43ef-95ac-21c1f620905f" containerID="64073b340a8a0fc7c6a97b33743b8a66c686251fe8de3193b6e11613364e1cb3" exitCode=0
Jul 07 18:06:31.924121 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:06:31.923962    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-1f1d4907-openshift-default-5b7f8559b7-hg9ct"
Jul 07 18:06:31.924121 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:06:31.923996    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-1f1d4907-openshift-default-5b7f8559b7-hg9ct" event={"ID":"de3d00f1-3817-43ef-95ac-21c1f620905f","Type":"ContainerDied","Data":"64073b340a8a0fc7c6a97b33743b8a66c686251fe8de3193b6e11613364e1cb3"}
Jul 07 18:06:31.924121 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:06:31.924051    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-1f1d4907-openshift-default-5b7f8559b7-hg9ct" event={"ID":"de3d00f1-3817-43ef-95ac-21c1f620905f","Type":"ContainerDied","Data":"a0a846d201d95b82ef46b5d2ee519bc5148e8f6b797646a55f5176f3cbcaca8c"}
Jul 07 18:06:31.924121 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:06:31.924077    2561 scope.go:117] "RemoveContainer" containerID="64073b340a8a0fc7c6a97b33743b8a66c686251fe8de3193b6e11613364e1cb3"
Jul 07 18:06:31.939463 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:06:31.939429    2561 scope.go:117] "RemoveContainer" containerID="64073b340a8a0fc7c6a97b33743b8a66c686251fe8de3193b6e11613364e1cb3"
Jul 07 18:06:31.939722 ip-10-0-139-31 kubenswrapper[2561]: E0707 18:06:31.939703    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"64073b340a8a0fc7c6a97b33743b8a66c686251fe8de3193b6e11613364e1cb3\": container with ID starting with 64073b340a8a0fc7c6a97b33743b8a66c686251fe8de3193b6e11613364e1cb3 not found: ID does not exist" containerID="64073b340a8a0fc7c6a97b33743b8a66c686251fe8de3193b6e11613364e1cb3"
Jul 07 18:06:31.939760 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:06:31.939729    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"64073b340a8a0fc7c6a97b33743b8a66c686251fe8de3193b6e11613364e1cb3"} err="failed to get container status \"64073b340a8a0fc7c6a97b33743b8a66c686251fe8de3193b6e11613364e1cb3\": rpc error: code = NotFound desc = could not find container \"64073b340a8a0fc7c6a97b33743b8a66c686251fe8de3193b6e11613364e1cb3\": container with ID starting with 64073b340a8a0fc7c6a97b33743b8a66c686251fe8de3193b6e11613364e1cb3 not found: ID does not exist"
Jul 07 18:06:31.953121 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:06:31.953094    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-1f1d4907-openshift-default-5b7f8559b7-hg9ct"]
Jul 07 18:06:31.958547 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:06:31.958522    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-1f1d4907-openshift-default-5b7f8559b7-hg9ct"]
Jul 07 18:06:31.969254 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:06:31.969226    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gs6zf\" (UniqueName: \"kubernetes.io/projected/de3d00f1-3817-43ef-95ac-21c1f620905f-kube-api-access-gs6zf\") on node \"ip-10-0-139-31.ec2.internal\" DevicePath \"\""
Jul 07 18:06:31.969254 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:06:31.969251    2561 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/de3d00f1-3817-43ef-95ac-21c1f620905f-istio-podinfo\") on node \"ip-10-0-139-31.ec2.internal\" DevicePath \"\""
Jul 07 18:06:31.969403 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:06:31.969262    2561 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/de3d00f1-3817-43ef-95ac-21c1f620905f-istio-envoy\") on node \"ip-10-0-139-31.ec2.internal\" DevicePath \"\""
Jul 07 18:06:31.969403 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:06:31.969270    2561 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/de3d00f1-3817-43ef-95ac-21c1f620905f-workload-socket\") on node \"ip-10-0-139-31.ec2.internal\" DevicePath \"\""
Jul 07 18:06:31.969403 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:06:31.969278    2561 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/de3d00f1-3817-43ef-95ac-21c1f620905f-istio-data\") on node \"ip-10-0-139-31.ec2.internal\" DevicePath \"\""
Jul 07 18:06:31.969403 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:06:31.969286    2561 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/de3d00f1-3817-43ef-95ac-21c1f620905f-istiod-ca-cert\") on node \"ip-10-0-139-31.ec2.internal\" DevicePath \"\""
Jul 07 18:06:31.969403 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:06:31.969294    2561 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/de3d00f1-3817-43ef-95ac-21c1f620905f-credential-socket\") on node \"ip-10-0-139-31.ec2.internal\" DevicePath \"\""
Jul 07 18:06:31.969403 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:06:31.969301    2561 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/de3d00f1-3817-43ef-95ac-21c1f620905f-istio-token\") on node \"ip-10-0-139-31.ec2.internal\" DevicePath \"\""
Jul 07 18:06:33.520933 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:06:33.520899    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="de3d00f1-3817-43ef-95ac-21c1f620905f" path="/var/lib/kubelet/pods/de3d00f1-3817-43ef-95ac-21c1f620905f/volumes"
Jul 07 18:06:38.185567 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:06:38.185532    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-derive-328d291c-openshift-default-665bd5c567-z288v"]
Jul 07 18:06:38.186073 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:06:38.185953    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="de3d00f1-3817-43ef-95ac-21c1f620905f" containerName="istio-proxy"
Jul 07 18:06:38.186073 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:06:38.185967    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="de3d00f1-3817-43ef-95ac-21c1f620905f" containerName="istio-proxy"
Jul 07 18:06:38.186073 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:06:38.186037    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="de3d00f1-3817-43ef-95ac-21c1f620905f" containerName="istio-proxy"
Jul 07 18:06:38.190581 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:06:38.190551    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-328d291c-openshift-default-665bd5c567-z288v"
Jul 07 18:06:38.195652 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:06:38.195619    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-derive-328d291c-openshift-default-dockercfg-bkppr\""
Jul 07 18:06:38.195839 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:06:38.195823    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Jul 07 18:06:38.204744 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:06:38.204712    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-328d291c-openshift-default-665bd5c567-z288v"]
Jul 07 18:06:38.226941 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:06:38.226904    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/119a8927-ed71-4712-9777-f6cee47c4a93-credential-socket\") pod \"e2e-derive-328d291c-openshift-default-665bd5c567-z288v\" (UID: \"119a8927-ed71-4712-9777-f6cee47c4a93\") " pod="openshift-ingress/e2e-derive-328d291c-openshift-default-665bd5c567-z288v"
Jul 07 18:06:38.226941 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:06:38.226946    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/119a8927-ed71-4712-9777-f6cee47c4a93-istio-data\") pod \"e2e-derive-328d291c-openshift-default-665bd5c567-z288v\" (UID: \"119a8927-ed71-4712-9777-f6cee47c4a93\") " pod="openshift-ingress/e2e-derive-328d291c-openshift-default-665bd5c567-z288v"
Jul 07 18:06:38.227182 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:06:38.226970    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/119a8927-ed71-4712-9777-f6cee47c4a93-workload-certs\") pod \"e2e-derive-328d291c-openshift-default-665bd5c567-z288v\" (UID: \"119a8927-ed71-4712-9777-f6cee47c4a93\") " pod="openshift-ingress/e2e-derive-328d291c-openshift-default-665bd5c567-z288v"
Jul 07 18:06:38.227182 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:06:38.227060    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/119a8927-ed71-4712-9777-f6cee47c4a93-istio-token\") pod \"e2e-derive-328d291c-openshift-default-665bd5c567-z288v\" (UID: \"119a8927-ed71-4712-9777-f6cee47c4a93\") " pod="openshift-ingress/e2e-derive-328d291c-openshift-default-665bd5c567-z288v"
Jul 07 18:06:38.227182 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:06:38.227097    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8lvsd\" (UniqueName: \"kubernetes.io/projected/119a8927-ed71-4712-9777-f6cee47c4a93-kube-api-access-8lvsd\") pod \"e2e-derive-328d291c-openshift-default-665bd5c567-z288v\" (UID: \"119a8927-ed71-4712-9777-f6cee47c4a93\") " pod="openshift-ingress/e2e-derive-328d291c-openshift-default-665bd5c567-z288v"
Jul 07 18:06:38.227182 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:06:38.227132    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/119a8927-ed71-4712-9777-f6cee47c4a93-istio-envoy\") pod \"e2e-derive-328d291c-openshift-default-665bd5c567-z288v\" (UID: \"119a8927-ed71-4712-9777-f6cee47c4a93\") " pod="openshift-ingress/e2e-derive-328d291c-openshift-default-665bd5c567-z288v"
Jul 07 18:06:38.227182 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:06:38.227156    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/119a8927-ed71-4712-9777-f6cee47c4a93-istiod-ca-cert\") pod \"e2e-derive-328d291c-openshift-default-665bd5c567-z288v\" (UID: \"119a8927-ed71-4712-9777-f6cee47c4a93\") " pod="openshift-ingress/e2e-derive-328d291c-openshift-default-665bd5c567-z288v"
Jul 07 18:06:38.227364 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:06:38.227243    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/119a8927-ed71-4712-9777-f6cee47c4a93-workload-socket\") pod \"e2e-derive-328d291c-openshift-default-665bd5c567-z288v\" (UID: \"119a8927-ed71-4712-9777-f6cee47c4a93\") " pod="openshift-ingress/e2e-derive-328d291c-openshift-default-665bd5c567-z288v"
Jul 07 18:06:38.227364 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:06:38.227275    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/119a8927-ed71-4712-9777-f6cee47c4a93-istio-podinfo\") pod \"e2e-derive-328d291c-openshift-default-665bd5c567-z288v\" (UID: \"119a8927-ed71-4712-9777-f6cee47c4a93\") " pod="openshift-ingress/e2e-derive-328d291c-openshift-default-665bd5c567-z288v"
Jul 07 18:06:38.328366 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:06:38.328330    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/119a8927-ed71-4712-9777-f6cee47c4a93-istio-data\") pod \"e2e-derive-328d291c-openshift-default-665bd5c567-z288v\" (UID: \"119a8927-ed71-4712-9777-f6cee47c4a93\") " pod="openshift-ingress/e2e-derive-328d291c-openshift-default-665bd5c567-z288v"
Jul 07 18:06:38.328366 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:06:38.328372    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/119a8927-ed71-4712-9777-f6cee47c4a93-workload-certs\") pod \"e2e-derive-328d291c-openshift-default-665bd5c567-z288v\" (UID: \"119a8927-ed71-4712-9777-f6cee47c4a93\") " pod="openshift-ingress/e2e-derive-328d291c-openshift-default-665bd5c567-z288v"
Jul 07 18:06:38.328685 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:06:38.328412    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/119a8927-ed71-4712-9777-f6cee47c4a93-istio-token\") pod \"e2e-derive-328d291c-openshift-default-665bd5c567-z288v\" (UID: \"119a8927-ed71-4712-9777-f6cee47c4a93\") " pod="openshift-ingress/e2e-derive-328d291c-openshift-default-665bd5c567-z288v"
Jul 07 18:06:38.328685 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:06:38.328436    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8lvsd\" (UniqueName: \"kubernetes.io/projected/119a8927-ed71-4712-9777-f6cee47c4a93-kube-api-access-8lvsd\") pod \"e2e-derive-328d291c-openshift-default-665bd5c567-z288v\" (UID: \"119a8927-ed71-4712-9777-f6cee47c4a93\") " pod="openshift-ingress/e2e-derive-328d291c-openshift-default-665bd5c567-z288v"
Jul 07 18:06:38.328685 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:06:38.328497    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/119a8927-ed71-4712-9777-f6cee47c4a93-istio-envoy\") pod \"e2e-derive-328d291c-openshift-default-665bd5c567-z288v\" (UID: \"119a8927-ed71-4712-9777-f6cee47c4a93\") " pod="openshift-ingress/e2e-derive-328d291c-openshift-default-665bd5c567-z288v"
Jul 07 18:06:38.328685 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:06:38.328513    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/119a8927-ed71-4712-9777-f6cee47c4a93-istiod-ca-cert\") pod \"e2e-derive-328d291c-openshift-default-665bd5c567-z288v\" (UID: \"119a8927-ed71-4712-9777-f6cee47c4a93\") " pod="openshift-ingress/e2e-derive-328d291c-openshift-default-665bd5c567-z288v"
Jul 07 18:06:38.328685 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:06:38.328564    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/119a8927-ed71-4712-9777-f6cee47c4a93-workload-socket\") pod \"e2e-derive-328d291c-openshift-default-665bd5c567-z288v\" (UID: \"119a8927-ed71-4712-9777-f6cee47c4a93\") " pod="openshift-ingress/e2e-derive-328d291c-openshift-default-665bd5c567-z288v"
Jul 07 18:06:38.328685 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:06:38.328584    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/119a8927-ed71-4712-9777-f6cee47c4a93-istio-podinfo\") pod \"e2e-derive-328d291c-openshift-default-665bd5c567-z288v\" (UID: \"119a8927-ed71-4712-9777-f6cee47c4a93\") " pod="openshift-ingress/e2e-derive-328d291c-openshift-default-665bd5c567-z288v"
Jul 07 18:06:38.328685 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:06:38.328619    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/119a8927-ed71-4712-9777-f6cee47c4a93-credential-socket\") pod \"e2e-derive-328d291c-openshift-default-665bd5c567-z288v\" (UID: \"119a8927-ed71-4712-9777-f6cee47c4a93\") " pod="openshift-ingress/e2e-derive-328d291c-openshift-default-665bd5c567-z288v"
Jul 07 18:06:38.329033 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:06:38.328814    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/119a8927-ed71-4712-9777-f6cee47c4a93-workload-certs\") pod \"e2e-derive-328d291c-openshift-default-665bd5c567-z288v\" (UID: \"119a8927-ed71-4712-9777-f6cee47c4a93\") " pod="openshift-ingress/e2e-derive-328d291c-openshift-default-665bd5c567-z288v"
Jul 07 18:06:38.329033 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:06:38.328868    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/119a8927-ed71-4712-9777-f6cee47c4a93-istio-data\") pod \"e2e-derive-328d291c-openshift-default-665bd5c567-z288v\" (UID: \"119a8927-ed71-4712-9777-f6cee47c4a93\") " pod="openshift-ingress/e2e-derive-328d291c-openshift-default-665bd5c567-z288v"
Jul 07 18:06:38.329033 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:06:38.328954    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/119a8927-ed71-4712-9777-f6cee47c4a93-credential-socket\") pod \"e2e-derive-328d291c-openshift-default-665bd5c567-z288v\" (UID: \"119a8927-ed71-4712-9777-f6cee47c4a93\") " pod="openshift-ingress/e2e-derive-328d291c-openshift-default-665bd5c567-z288v"
Jul 07 18:06:38.329189 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:06:38.329029    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/119a8927-ed71-4712-9777-f6cee47c4a93-workload-socket\") pod \"e2e-derive-328d291c-openshift-default-665bd5c567-z288v\" (UID: \"119a8927-ed71-4712-9777-f6cee47c4a93\") " pod="openshift-ingress/e2e-derive-328d291c-openshift-default-665bd5c567-z288v"
Jul 07 18:06:38.329262 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:06:38.329242    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/119a8927-ed71-4712-9777-f6cee47c4a93-istiod-ca-cert\") pod \"e2e-derive-328d291c-openshift-default-665bd5c567-z288v\" (UID: \"119a8927-ed71-4712-9777-f6cee47c4a93\") " pod="openshift-ingress/e2e-derive-328d291c-openshift-default-665bd5c567-z288v"
Jul 07 18:06:38.330975 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:06:38.330952    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/119a8927-ed71-4712-9777-f6cee47c4a93-istio-envoy\") pod \"e2e-derive-328d291c-openshift-default-665bd5c567-z288v\" (UID: \"119a8927-ed71-4712-9777-f6cee47c4a93\") " pod="openshift-ingress/e2e-derive-328d291c-openshift-default-665bd5c567-z288v"
Jul 07 18:06:38.331244 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:06:38.331226    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/119a8927-ed71-4712-9777-f6cee47c4a93-istio-podinfo\") pod \"e2e-derive-328d291c-openshift-default-665bd5c567-z288v\" (UID: \"119a8927-ed71-4712-9777-f6cee47c4a93\") " pod="openshift-ingress/e2e-derive-328d291c-openshift-default-665bd5c567-z288v"
Jul 07 18:06:38.338161 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:06:38.338137    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8lvsd\" (UniqueName: \"kubernetes.io/projected/119a8927-ed71-4712-9777-f6cee47c4a93-kube-api-access-8lvsd\") pod \"e2e-derive-328d291c-openshift-default-665bd5c567-z288v\" (UID: \"119a8927-ed71-4712-9777-f6cee47c4a93\") " pod="openshift-ingress/e2e-derive-328d291c-openshift-default-665bd5c567-z288v"
Jul 07 18:06:38.338285 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:06:38.338184    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/119a8927-ed71-4712-9777-f6cee47c4a93-istio-token\") pod \"e2e-derive-328d291c-openshift-default-665bd5c567-z288v\" (UID: \"119a8927-ed71-4712-9777-f6cee47c4a93\") " pod="openshift-ingress/e2e-derive-328d291c-openshift-default-665bd5c567-z288v"
Jul 07 18:06:38.501354 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:06:38.501251    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-328d291c-openshift-default-665bd5c567-z288v"
Jul 07 18:06:38.659281 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:06:38.659242    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-328d291c-openshift-default-665bd5c567-z288v"]
Jul 07 18:06:38.665916 ip-10-0-139-31 kubenswrapper[2561]: W0707 18:06:38.665879    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod119a8927_ed71_4712_9777_f6cee47c4a93.slice/crio-673dcf2a429875b9f3f586032f0a9e21b9012be61eda8e2d77828eef72cc6a37 WatchSource:0}: Error finding container 673dcf2a429875b9f3f586032f0a9e21b9012be61eda8e2d77828eef72cc6a37: Status 404 returned error can't find the container with id 673dcf2a429875b9f3f586032f0a9e21b9012be61eda8e2d77828eef72cc6a37
Jul 07 18:06:38.668011 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:06:38.667980    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 07 18:06:38.668141 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:06:38.668042    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 07 18:06:38.668141 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:06:38.668069    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 07 18:06:38.958363 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:06:38.958327    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-328d291c-openshift-default-665bd5c567-z288v" event={"ID":"119a8927-ed71-4712-9777-f6cee47c4a93","Type":"ContainerStarted","Data":"0819a706a64b04076e5690e98598115b2cb93c36945939abace0e79c2ea13ab5"}
Jul 07 18:06:38.958576 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:06:38.958385    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-328d291c-openshift-default-665bd5c567-z288v" event={"ID":"119a8927-ed71-4712-9777-f6cee47c4a93","Type":"ContainerStarted","Data":"673dcf2a429875b9f3f586032f0a9e21b9012be61eda8e2d77828eef72cc6a37"}
Jul 07 18:06:38.992361 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:06:38.992303    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-derive-328d291c-openshift-default-665bd5c567-z288v" podStartSLOduration=0.992286309 podStartE2EDuration="992.286309ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 18:06:38 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 18:06:38.989514927 +0000 UTC m=+1590.140639327" watchObservedRunningTime="2026-07-07 18:06:38.992286309 +0000 UTC m=+1590.143410762"
Jul 07 18:06:39.501553 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:06:39.501509    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-328d291c-openshift-default-665bd5c567-z288v"
Jul 07 18:06:39.506716 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:06:39.506685    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-328d291c-openshift-default-665bd5c567-z288v"
Jul 07 18:06:39.962800 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:06:39.962770    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-328d291c-openshift-default-665bd5c567-z288v"
Jul 07 18:06:39.963832 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:06:39.963808    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-328d291c-openshift-default-665bd5c567-z288v"
Jul 07 18:06:43.944194 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:06:43.944147    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-328d291c-openshift-default-665bd5c567-z288v"]
Jul 07 18:06:43.944889 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:06:43.944370    2561 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-derive-328d291c-openshift-default-665bd5c567-z288v" podUID="119a8927-ed71-4712-9777-f6cee47c4a93" containerName="istio-proxy" containerID="cri-o://0819a706a64b04076e5690e98598115b2cb93c36945939abace0e79c2ea13ab5" gracePeriod=30
Jul 07 18:06:49.902007 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:06:49.901945    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-328d291c-openshift-default-665bd5c567-z288v"
Jul 07 18:06:50.018254 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:06:50.018217    2561 generic.go:356] "Generic (PLEG): container finished" podID="119a8927-ed71-4712-9777-f6cee47c4a93" containerID="0819a706a64b04076e5690e98598115b2cb93c36945939abace0e79c2ea13ab5" exitCode=0
Jul 07 18:06:50.018487 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:06:50.018278    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-328d291c-openshift-default-665bd5c567-z288v"
Jul 07 18:06:50.018487 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:06:50.018277    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-328d291c-openshift-default-665bd5c567-z288v" event={"ID":"119a8927-ed71-4712-9777-f6cee47c4a93","Type":"ContainerDied","Data":"0819a706a64b04076e5690e98598115b2cb93c36945939abace0e79c2ea13ab5"}
Jul 07 18:06:50.018487 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:06:50.018330    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-328d291c-openshift-default-665bd5c567-z288v" event={"ID":"119a8927-ed71-4712-9777-f6cee47c4a93","Type":"ContainerDied","Data":"673dcf2a429875b9f3f586032f0a9e21b9012be61eda8e2d77828eef72cc6a37"}
Jul 07 18:06:50.018487 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:06:50.018351    2561 scope.go:117] "RemoveContainer" containerID="0819a706a64b04076e5690e98598115b2cb93c36945939abace0e79c2ea13ab5"
Jul 07 18:06:50.029383 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:06:50.029358    2561 scope.go:117] "RemoveContainer" containerID="0819a706a64b04076e5690e98598115b2cb93c36945939abace0e79c2ea13ab5"
Jul 07 18:06:50.029748 ip-10-0-139-31 kubenswrapper[2561]: E0707 18:06:50.029727    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0819a706a64b04076e5690e98598115b2cb93c36945939abace0e79c2ea13ab5\": container with ID starting with 0819a706a64b04076e5690e98598115b2cb93c36945939abace0e79c2ea13ab5 not found: ID does not exist" containerID="0819a706a64b04076e5690e98598115b2cb93c36945939abace0e79c2ea13ab5"
Jul 07 18:06:50.029794 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:06:50.029759    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0819a706a64b04076e5690e98598115b2cb93c36945939abace0e79c2ea13ab5"} err="failed to get container status \"0819a706a64b04076e5690e98598115b2cb93c36945939abace0e79c2ea13ab5\": rpc error: code = NotFound desc = could not find container \"0819a706a64b04076e5690e98598115b2cb93c36945939abace0e79c2ea13ab5\": container with ID starting with 0819a706a64b04076e5690e98598115b2cb93c36945939abace0e79c2ea13ab5 not found: ID does not exist"
Jul 07 18:06:50.046086 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:06:50.046055    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8lvsd\" (UniqueName: \"kubernetes.io/projected/119a8927-ed71-4712-9777-f6cee47c4a93-kube-api-access-8lvsd\") pod \"119a8927-ed71-4712-9777-f6cee47c4a93\" (UID: \"119a8927-ed71-4712-9777-f6cee47c4a93\") "
Jul 07 18:06:50.046274 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:06:50.046131    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/119a8927-ed71-4712-9777-f6cee47c4a93-credential-socket\") pod \"119a8927-ed71-4712-9777-f6cee47c4a93\" (UID: \"119a8927-ed71-4712-9777-f6cee47c4a93\") "
Jul 07 18:06:50.046274 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:06:50.046163    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/119a8927-ed71-4712-9777-f6cee47c4a93-istio-podinfo\") pod \"119a8927-ed71-4712-9777-f6cee47c4a93\" (UID: \"119a8927-ed71-4712-9777-f6cee47c4a93\") "
Jul 07 18:06:50.046274 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:06:50.046190    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/119a8927-ed71-4712-9777-f6cee47c4a93-istio-envoy\") pod \"119a8927-ed71-4712-9777-f6cee47c4a93\" (UID: \"119a8927-ed71-4712-9777-f6cee47c4a93\") "
Jul 07 18:06:50.046274 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:06:50.046254    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/119a8927-ed71-4712-9777-f6cee47c4a93-istio-token\") pod \"119a8927-ed71-4712-9777-f6cee47c4a93\" (UID: \"119a8927-ed71-4712-9777-f6cee47c4a93\") "
Jul 07 18:06:50.046576 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:06:50.046300    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/119a8927-ed71-4712-9777-f6cee47c4a93-istio-data\") pod \"119a8927-ed71-4712-9777-f6cee47c4a93\" (UID: \"119a8927-ed71-4712-9777-f6cee47c4a93\") "
Jul 07 18:06:50.046576 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:06:50.046331    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/119a8927-ed71-4712-9777-f6cee47c4a93-istiod-ca-cert\") pod \"119a8927-ed71-4712-9777-f6cee47c4a93\" (UID: \"119a8927-ed71-4712-9777-f6cee47c4a93\") "
Jul 07 18:06:50.046576 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:06:50.046359    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/119a8927-ed71-4712-9777-f6cee47c4a93-workload-socket\") pod \"119a8927-ed71-4712-9777-f6cee47c4a93\" (UID: \"119a8927-ed71-4712-9777-f6cee47c4a93\") "
Jul 07 18:06:50.046576 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:06:50.046400    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/119a8927-ed71-4712-9777-f6cee47c4a93-workload-certs\") pod \"119a8927-ed71-4712-9777-f6cee47c4a93\" (UID: \"119a8927-ed71-4712-9777-f6cee47c4a93\") "
Jul 07 18:06:50.046576 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:06:50.046555    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/119a8927-ed71-4712-9777-f6cee47c4a93-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "119a8927-ed71-4712-9777-f6cee47c4a93" (UID: "119a8927-ed71-4712-9777-f6cee47c4a93"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 18:06:50.046831 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:06:50.046785    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/119a8927-ed71-4712-9777-f6cee47c4a93-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "119a8927-ed71-4712-9777-f6cee47c4a93" (UID: "119a8927-ed71-4712-9777-f6cee47c4a93"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 18:06:50.046831 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:06:50.046807    2561 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/119a8927-ed71-4712-9777-f6cee47c4a93-credential-socket\") on node \"ip-10-0-139-31.ec2.internal\" DevicePath \"\""
Jul 07 18:06:50.046831 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:06:50.046816    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/119a8927-ed71-4712-9777-f6cee47c4a93-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "119a8927-ed71-4712-9777-f6cee47c4a93" (UID: "119a8927-ed71-4712-9777-f6cee47c4a93"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 18:06:50.047015 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:06:50.046995    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/119a8927-ed71-4712-9777-f6cee47c4a93-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "119a8927-ed71-4712-9777-f6cee47c4a93" (UID: "119a8927-ed71-4712-9777-f6cee47c4a93"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 18:06:50.047619 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:06:50.047596    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/119a8927-ed71-4712-9777-f6cee47c4a93-istio-data" (OuterVolumeSpecName: "istio-data") pod "119a8927-ed71-4712-9777-f6cee47c4a93" (UID: "119a8927-ed71-4712-9777-f6cee47c4a93"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 18:06:50.048581 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:06:50.048556    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/119a8927-ed71-4712-9777-f6cee47c4a93-kube-api-access-8lvsd" (OuterVolumeSpecName: "kube-api-access-8lvsd") pod "119a8927-ed71-4712-9777-f6cee47c4a93" (UID: "119a8927-ed71-4712-9777-f6cee47c4a93"). InnerVolumeSpecName "kube-api-access-8lvsd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 18:06:50.048690 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:06:50.048613    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/119a8927-ed71-4712-9777-f6cee47c4a93-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "119a8927-ed71-4712-9777-f6cee47c4a93" (UID: "119a8927-ed71-4712-9777-f6cee47c4a93"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 07 18:06:50.048862 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:06:50.048836    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/119a8927-ed71-4712-9777-f6cee47c4a93-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "119a8927-ed71-4712-9777-f6cee47c4a93" (UID: "119a8927-ed71-4712-9777-f6cee47c4a93"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 18:06:50.048907 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:06:50.048862    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/119a8927-ed71-4712-9777-f6cee47c4a93-istio-token" (OuterVolumeSpecName: "istio-token") pod "119a8927-ed71-4712-9777-f6cee47c4a93" (UID: "119a8927-ed71-4712-9777-f6cee47c4a93"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 18:06:50.148260 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:06:50.148226    2561 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/119a8927-ed71-4712-9777-f6cee47c4a93-workload-certs\") on node \"ip-10-0-139-31.ec2.internal\" DevicePath \"\""
Jul 07 18:06:50.148260 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:06:50.148257    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8lvsd\" (UniqueName: \"kubernetes.io/projected/119a8927-ed71-4712-9777-f6cee47c4a93-kube-api-access-8lvsd\") on node \"ip-10-0-139-31.ec2.internal\" DevicePath \"\""
Jul 07 18:06:50.148260 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:06:50.148267    2561 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/119a8927-ed71-4712-9777-f6cee47c4a93-istio-podinfo\") on node \"ip-10-0-139-31.ec2.internal\" DevicePath \"\""
Jul 07 18:06:50.148260 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:06:50.148275    2561 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/119a8927-ed71-4712-9777-f6cee47c4a93-istio-envoy\") on node \"ip-10-0-139-31.ec2.internal\" DevicePath \"\""
Jul 07 18:06:50.148565 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:06:50.148283    2561 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/119a8927-ed71-4712-9777-f6cee47c4a93-istio-token\") on node \"ip-10-0-139-31.ec2.internal\" DevicePath \"\""
Jul 07 18:06:50.148565 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:06:50.148292    2561 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/119a8927-ed71-4712-9777-f6cee47c4a93-istio-data\") on node \"ip-10-0-139-31.ec2.internal\" DevicePath \"\""
Jul 07 18:06:50.148565 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:06:50.148300    2561 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/119a8927-ed71-4712-9777-f6cee47c4a93-istiod-ca-cert\") on node \"ip-10-0-139-31.ec2.internal\" DevicePath \"\""
Jul 07 18:06:50.148565 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:06:50.148307    2561 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/119a8927-ed71-4712-9777-f6cee47c4a93-workload-socket\") on node \"ip-10-0-139-31.ec2.internal\" DevicePath \"\""
Jul 07 18:06:50.345499 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:06:50.345462    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-328d291c-openshift-default-665bd5c567-z288v"]
Jul 07 18:06:50.350099 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:06:50.350068    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-derive-328d291c-openshift-default-665bd5c567-z288v"]
Jul 07 18:06:51.521119 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:06:51.521081    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="119a8927-ed71-4712-9777-f6cee47c4a93" path="/var/lib/kubelet/pods/119a8927-ed71-4712-9777-f6cee47c4a93/volumes"
Jul 07 18:08:30.264962 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:08:30.264922    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-5f0553bb-openshift-default-75d6cd9bc9-rpt8x"]
Jul 07 18:08:30.265498 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:08:30.265299    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="119a8927-ed71-4712-9777-f6cee47c4a93" containerName="istio-proxy"
Jul 07 18:08:30.265498 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:08:30.265310    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="119a8927-ed71-4712-9777-f6cee47c4a93" containerName="istio-proxy"
Jul 07 18:08:30.265498 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:08:30.265378    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="119a8927-ed71-4712-9777-f6cee47c4a93" containerName="istio-proxy"
Jul 07 18:08:30.268387 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:08:30.268367    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-5f0553bb-openshift-default-75d6cd9bc9-rpt8x"
Jul 07 18:08:30.272034 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:08:30.272016    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-5f0553bb-openshift-default-dockercfg-rllgg\""
Jul 07 18:08:30.272500 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:08:30.272482    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Jul 07 18:08:30.284556 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:08:30.284530    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f3b62292-ebbb-4034-bf31-4a9a7d5c0412-istiod-ca-cert\") pod \"e2e-mt-5f0553bb-openshift-default-75d6cd9bc9-rpt8x\" (UID: \"f3b62292-ebbb-4034-bf31-4a9a7d5c0412\") " pod="openshift-ingress/e2e-mt-5f0553bb-openshift-default-75d6cd9bc9-rpt8x"
Jul 07 18:08:30.284692 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:08:30.284563    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f3b62292-ebbb-4034-bf31-4a9a7d5c0412-istio-podinfo\") pod \"e2e-mt-5f0553bb-openshift-default-75d6cd9bc9-rpt8x\" (UID: \"f3b62292-ebbb-4034-bf31-4a9a7d5c0412\") " pod="openshift-ingress/e2e-mt-5f0553bb-openshift-default-75d6cd9bc9-rpt8x"
Jul 07 18:08:30.284692 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:08:30.284593    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f3b62292-ebbb-4034-bf31-4a9a7d5c0412-workload-socket\") pod \"e2e-mt-5f0553bb-openshift-default-75d6cd9bc9-rpt8x\" (UID: \"f3b62292-ebbb-4034-bf31-4a9a7d5c0412\") " pod="openshift-ingress/e2e-mt-5f0553bb-openshift-default-75d6cd9bc9-rpt8x"
Jul 07 18:08:30.284692 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:08:30.284661    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f3b62292-ebbb-4034-bf31-4a9a7d5c0412-istio-data\") pod \"e2e-mt-5f0553bb-openshift-default-75d6cd9bc9-rpt8x\" (UID: \"f3b62292-ebbb-4034-bf31-4a9a7d5c0412\") " pod="openshift-ingress/e2e-mt-5f0553bb-openshift-default-75d6cd9bc9-rpt8x"
Jul 07 18:08:30.284692 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:08:30.284691    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f3b62292-ebbb-4034-bf31-4a9a7d5c0412-istio-token\") pod \"e2e-mt-5f0553bb-openshift-default-75d6cd9bc9-rpt8x\" (UID: \"f3b62292-ebbb-4034-bf31-4a9a7d5c0412\") " pod="openshift-ingress/e2e-mt-5f0553bb-openshift-default-75d6cd9bc9-rpt8x"
Jul 07 18:08:30.284856 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:08:30.284716    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f3b62292-ebbb-4034-bf31-4a9a7d5c0412-credential-socket\") pod \"e2e-mt-5f0553bb-openshift-default-75d6cd9bc9-rpt8x\" (UID: \"f3b62292-ebbb-4034-bf31-4a9a7d5c0412\") " pod="openshift-ingress/e2e-mt-5f0553bb-openshift-default-75d6cd9bc9-rpt8x"
Jul 07 18:08:30.284856 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:08:30.284731    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hcdz7\" (UniqueName: \"kubernetes.io/projected/f3b62292-ebbb-4034-bf31-4a9a7d5c0412-kube-api-access-hcdz7\") pod \"e2e-mt-5f0553bb-openshift-default-75d6cd9bc9-rpt8x\" (UID: \"f3b62292-ebbb-4034-bf31-4a9a7d5c0412\") " pod="openshift-ingress/e2e-mt-5f0553bb-openshift-default-75d6cd9bc9-rpt8x"
Jul 07 18:08:30.284856 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:08:30.284757    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f3b62292-ebbb-4034-bf31-4a9a7d5c0412-workload-certs\") pod \"e2e-mt-5f0553bb-openshift-default-75d6cd9bc9-rpt8x\" (UID: \"f3b62292-ebbb-4034-bf31-4a9a7d5c0412\") " pod="openshift-ingress/e2e-mt-5f0553bb-openshift-default-75d6cd9bc9-rpt8x"
Jul 07 18:08:30.284856 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:08:30.284794    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f3b62292-ebbb-4034-bf31-4a9a7d5c0412-istio-envoy\") pod \"e2e-mt-5f0553bb-openshift-default-75d6cd9bc9-rpt8x\" (UID: \"f3b62292-ebbb-4034-bf31-4a9a7d5c0412\") " pod="openshift-ingress/e2e-mt-5f0553bb-openshift-default-75d6cd9bc9-rpt8x"
Jul 07 18:08:30.351903 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:08:30.351860    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-5f0553bb-openshift-default-75d6cd9bc9-rpt8x"]
Jul 07 18:08:30.385456 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:08:30.385403    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f3b62292-ebbb-4034-bf31-4a9a7d5c0412-istio-data\") pod \"e2e-mt-5f0553bb-openshift-default-75d6cd9bc9-rpt8x\" (UID: \"f3b62292-ebbb-4034-bf31-4a9a7d5c0412\") " pod="openshift-ingress/e2e-mt-5f0553bb-openshift-default-75d6cd9bc9-rpt8x"
Jul 07 18:08:30.385635 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:08:30.385488    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f3b62292-ebbb-4034-bf31-4a9a7d5c0412-istio-token\") pod \"e2e-mt-5f0553bb-openshift-default-75d6cd9bc9-rpt8x\" (UID: \"f3b62292-ebbb-4034-bf31-4a9a7d5c0412\") " pod="openshift-ingress/e2e-mt-5f0553bb-openshift-default-75d6cd9bc9-rpt8x"
Jul 07 18:08:30.385635 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:08:30.385522    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f3b62292-ebbb-4034-bf31-4a9a7d5c0412-credential-socket\") pod \"e2e-mt-5f0553bb-openshift-default-75d6cd9bc9-rpt8x\" (UID: \"f3b62292-ebbb-4034-bf31-4a9a7d5c0412\") " pod="openshift-ingress/e2e-mt-5f0553bb-openshift-default-75d6cd9bc9-rpt8x"
Jul 07 18:08:30.385635 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:08:30.385539    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hcdz7\" (UniqueName: \"kubernetes.io/projected/f3b62292-ebbb-4034-bf31-4a9a7d5c0412-kube-api-access-hcdz7\") pod \"e2e-mt-5f0553bb-openshift-default-75d6cd9bc9-rpt8x\" (UID: \"f3b62292-ebbb-4034-bf31-4a9a7d5c0412\") " pod="openshift-ingress/e2e-mt-5f0553bb-openshift-default-75d6cd9bc9-rpt8x"
Jul 07 18:08:30.385635 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:08:30.385574    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f3b62292-ebbb-4034-bf31-4a9a7d5c0412-workload-certs\") pod \"e2e-mt-5f0553bb-openshift-default-75d6cd9bc9-rpt8x\" (UID: \"f3b62292-ebbb-4034-bf31-4a9a7d5c0412\") " pod="openshift-ingress/e2e-mt-5f0553bb-openshift-default-75d6cd9bc9-rpt8x"
Jul 07 18:08:30.385635 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:08:30.385599    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f3b62292-ebbb-4034-bf31-4a9a7d5c0412-istio-envoy\") pod \"e2e-mt-5f0553bb-openshift-default-75d6cd9bc9-rpt8x\" (UID: \"f3b62292-ebbb-4034-bf31-4a9a7d5c0412\") " pod="openshift-ingress/e2e-mt-5f0553bb-openshift-default-75d6cd9bc9-rpt8x"
Jul 07 18:08:30.385916 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:08:30.385637    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f3b62292-ebbb-4034-bf31-4a9a7d5c0412-istiod-ca-cert\") pod \"e2e-mt-5f0553bb-openshift-default-75d6cd9bc9-rpt8x\" (UID: \"f3b62292-ebbb-4034-bf31-4a9a7d5c0412\") " pod="openshift-ingress/e2e-mt-5f0553bb-openshift-default-75d6cd9bc9-rpt8x"
Jul 07 18:08:30.385916 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:08:30.385663    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f3b62292-ebbb-4034-bf31-4a9a7d5c0412-istio-podinfo\") pod \"e2e-mt-5f0553bb-openshift-default-75d6cd9bc9-rpt8x\" (UID: \"f3b62292-ebbb-4034-bf31-4a9a7d5c0412\") " pod="openshift-ingress/e2e-mt-5f0553bb-openshift-default-75d6cd9bc9-rpt8x"
Jul 07 18:08:30.385916 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:08:30.385710    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f3b62292-ebbb-4034-bf31-4a9a7d5c0412-workload-socket\") pod \"e2e-mt-5f0553bb-openshift-default-75d6cd9bc9-rpt8x\" (UID: \"f3b62292-ebbb-4034-bf31-4a9a7d5c0412\") " pod="openshift-ingress/e2e-mt-5f0553bb-openshift-default-75d6cd9bc9-rpt8x"
Jul 07 18:08:30.385916 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:08:30.385840    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f3b62292-ebbb-4034-bf31-4a9a7d5c0412-istio-data\") pod \"e2e-mt-5f0553bb-openshift-default-75d6cd9bc9-rpt8x\" (UID: \"f3b62292-ebbb-4034-bf31-4a9a7d5c0412\") " pod="openshift-ingress/e2e-mt-5f0553bb-openshift-default-75d6cd9bc9-rpt8x"
Jul 07 18:08:30.385916 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:08:30.385881    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f3b62292-ebbb-4034-bf31-4a9a7d5c0412-workload-certs\") pod \"e2e-mt-5f0553bb-openshift-default-75d6cd9bc9-rpt8x\" (UID: \"f3b62292-ebbb-4034-bf31-4a9a7d5c0412\") " pod="openshift-ingress/e2e-mt-5f0553bb-openshift-default-75d6cd9bc9-rpt8x"
Jul 07 18:08:30.386188 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:08:30.385974    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f3b62292-ebbb-4034-bf31-4a9a7d5c0412-credential-socket\") pod \"e2e-mt-5f0553bb-openshift-default-75d6cd9bc9-rpt8x\" (UID: \"f3b62292-ebbb-4034-bf31-4a9a7d5c0412\") " pod="openshift-ingress/e2e-mt-5f0553bb-openshift-default-75d6cd9bc9-rpt8x"
Jul 07 18:08:30.386188 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:08:30.386117    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f3b62292-ebbb-4034-bf31-4a9a7d5c0412-workload-socket\") pod \"e2e-mt-5f0553bb-openshift-default-75d6cd9bc9-rpt8x\" (UID: \"f3b62292-ebbb-4034-bf31-4a9a7d5c0412\") " pod="openshift-ingress/e2e-mt-5f0553bb-openshift-default-75d6cd9bc9-rpt8x"
Jul 07 18:08:30.386497 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:08:30.386477    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f3b62292-ebbb-4034-bf31-4a9a7d5c0412-istiod-ca-cert\") pod \"e2e-mt-5f0553bb-openshift-default-75d6cd9bc9-rpt8x\" (UID: \"f3b62292-ebbb-4034-bf31-4a9a7d5c0412\") " pod="openshift-ingress/e2e-mt-5f0553bb-openshift-default-75d6cd9bc9-rpt8x"
Jul 07 18:08:30.387981 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:08:30.387962    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f3b62292-ebbb-4034-bf31-4a9a7d5c0412-istio-envoy\") pod \"e2e-mt-5f0553bb-openshift-default-75d6cd9bc9-rpt8x\" (UID: \"f3b62292-ebbb-4034-bf31-4a9a7d5c0412\") " pod="openshift-ingress/e2e-mt-5f0553bb-openshift-default-75d6cd9bc9-rpt8x"
Jul 07 18:08:30.388301 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:08:30.388278    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f3b62292-ebbb-4034-bf31-4a9a7d5c0412-istio-podinfo\") pod \"e2e-mt-5f0553bb-openshift-default-75d6cd9bc9-rpt8x\" (UID: \"f3b62292-ebbb-4034-bf31-4a9a7d5c0412\") " pod="openshift-ingress/e2e-mt-5f0553bb-openshift-default-75d6cd9bc9-rpt8x"
Jul 07 18:08:30.397713 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:08:30.397680    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f3b62292-ebbb-4034-bf31-4a9a7d5c0412-istio-token\") pod \"e2e-mt-5f0553bb-openshift-default-75d6cd9bc9-rpt8x\" (UID: \"f3b62292-ebbb-4034-bf31-4a9a7d5c0412\") " pod="openshift-ingress/e2e-mt-5f0553bb-openshift-default-75d6cd9bc9-rpt8x"
Jul 07 18:08:30.397862 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:08:30.397839    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hcdz7\" (UniqueName: \"kubernetes.io/projected/f3b62292-ebbb-4034-bf31-4a9a7d5c0412-kube-api-access-hcdz7\") pod \"e2e-mt-5f0553bb-openshift-default-75d6cd9bc9-rpt8x\" (UID: \"f3b62292-ebbb-4034-bf31-4a9a7d5c0412\") " pod="openshift-ingress/e2e-mt-5f0553bb-openshift-default-75d6cd9bc9-rpt8x"
Jul 07 18:08:30.579518 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:08:30.579480    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-5f0553bb-openshift-default-75d6cd9bc9-rpt8x"
Jul 07 18:08:30.728898 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:08:30.728753    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-5f0553bb-openshift-default-75d6cd9bc9-rpt8x"]
Jul 07 18:08:30.731649 ip-10-0-139-31 kubenswrapper[2561]: W0707 18:08:30.731621    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf3b62292_ebbb_4034_bf31_4a9a7d5c0412.slice/crio-aef82e5137700194f1980cfad39f6a261e63dcb271cc09047e3127dadd6bd2cb WatchSource:0}: Error finding container aef82e5137700194f1980cfad39f6a261e63dcb271cc09047e3127dadd6bd2cb: Status 404 returned error can't find the container with id aef82e5137700194f1980cfad39f6a261e63dcb271cc09047e3127dadd6bd2cb
Jul 07 18:08:30.733996 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:08:30.733965    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 07 18:08:30.734102 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:08:30.734054    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 07 18:08:30.734102 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:08:30.734087    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 07 18:08:31.486472 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:08:31.486367    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-5f0553bb-openshift-default-75d6cd9bc9-rpt8x" event={"ID":"f3b62292-ebbb-4034-bf31-4a9a7d5c0412","Type":"ContainerStarted","Data":"19701f85d668d57bb9df18ce27a287a89f3a3982ea48932e20e671acf5016042"}
Jul 07 18:08:31.486472 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:08:31.486419    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-5f0553bb-openshift-default-75d6cd9bc9-rpt8x" event={"ID":"f3b62292-ebbb-4034-bf31-4a9a7d5c0412","Type":"ContainerStarted","Data":"aef82e5137700194f1980cfad39f6a261e63dcb271cc09047e3127dadd6bd2cb"}
Jul 07 18:08:31.580340 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:08:31.580295    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-5f0553bb-openshift-default-75d6cd9bc9-rpt8x"
Jul 07 18:08:31.586252 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:08:31.586221    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-5f0553bb-openshift-default-75d6cd9bc9-rpt8x"
Jul 07 18:08:31.619776 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:08:31.619720    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-5f0553bb-openshift-default-75d6cd9bc9-rpt8x" podStartSLOduration=1.619702117 podStartE2EDuration="1.619702117s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 18:08:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 18:08:31.526101315 +0000 UTC m=+1702.677225713" watchObservedRunningTime="2026-07-07 18:08:31.619702117 +0000 UTC m=+1702.770826514"
Jul 07 18:08:32.491262 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:08:32.491229    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-5f0553bb-openshift-default-75d6cd9bc9-rpt8x"
Jul 07 18:08:32.492236 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:08:32.492216    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-5f0553bb-openshift-default-75d6cd9bc9-rpt8x"
Jul 07 18:08:45.553718 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:08:45.553682    2561 generic.go:356] "Generic (PLEG): container finished" podID="f3b62292-ebbb-4034-bf31-4a9a7d5c0412" containerID="19701f85d668d57bb9df18ce27a287a89f3a3982ea48932e20e671acf5016042" exitCode=0
Jul 07 18:08:45.554149 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:08:45.553766    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-5f0553bb-openshift-default-75d6cd9bc9-rpt8x" event={"ID":"f3b62292-ebbb-4034-bf31-4a9a7d5c0412","Type":"ContainerDied","Data":"19701f85d668d57bb9df18ce27a287a89f3a3982ea48932e20e671acf5016042"}
Jul 07 18:08:45.554272 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:08:45.554256    2561 scope.go:117] "RemoveContainer" containerID="19701f85d668d57bb9df18ce27a287a89f3a3982ea48932e20e671acf5016042"
Jul 07 18:08:45.555343 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:08:45.555315    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 07 18:08:45.555462 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:08:45.555381    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 07 18:08:45.555462 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:08:45.555411    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 07 18:08:46.561220 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:08:46.561187    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-5f0553bb-openshift-default-75d6cd9bc9-rpt8x" event={"ID":"f3b62292-ebbb-4034-bf31-4a9a7d5c0412","Type":"ContainerStarted","Data":"d5179186c98c799cade5745d9062d3ecde83d0119d5ac62a3c5931dfc3f05133"}
Jul 07 18:08:46.580109 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:08:46.579756    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-5f0553bb-openshift-default-75d6cd9bc9-rpt8x"
Jul 07 18:08:46.581402 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:08:46.581361    2561 patch_prober.go:28] interesting pod/e2e-mt-5f0553bb-openshift-default-75d6cd9bc9-rpt8x container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.37:15021/healthz/ready\": dial tcp 10.132.0.37:15021: connect: connection refused" start-of-body=
Jul 07 18:08:46.581546 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:08:46.581489    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-5f0553bb-openshift-default-75d6cd9bc9-rpt8x" podUID="f3b62292-ebbb-4034-bf31-4a9a7d5c0412" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.37:15021/healthz/ready\": dial tcp 10.132.0.37:15021: connect: connection refused"
Jul 07 18:08:47.492214 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:08:47.492154    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-5f0553bb-openshift-default-75d6cd9bc9-rpt8x"
Jul 07 18:08:47.580529 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:08:47.580487    2561 patch_prober.go:28] interesting pod/e2e-mt-5f0553bb-openshift-default-75d6cd9bc9-rpt8x container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.37:15021/healthz/ready\": dial tcp 10.132.0.37:15021: connect: connection refused" start-of-body=
Jul 07 18:08:47.581041 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:08:47.580569    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-5f0553bb-openshift-default-75d6cd9bc9-rpt8x" podUID="f3b62292-ebbb-4034-bf31-4a9a7d5c0412" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.37:15021/healthz/ready\": dial tcp 10.132.0.37:15021: connect: connection refused"
Jul 07 18:08:48.582470 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:08:48.580471    2561 patch_prober.go:28] interesting pod/e2e-mt-5f0553bb-openshift-default-75d6cd9bc9-rpt8x container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.37:15021/healthz/ready\": dial tcp 10.132.0.37:15021: connect: connection refused" start-of-body=
Jul 07 18:08:48.582470 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:08:48.580535    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-5f0553bb-openshift-default-75d6cd9bc9-rpt8x" podUID="f3b62292-ebbb-4034-bf31-4a9a7d5c0412" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.37:15021/healthz/ready\": dial tcp 10.132.0.37:15021: connect: connection refused"
Jul 07 18:08:49.580761 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:08:49.580716    2561 patch_prober.go:28] interesting pod/e2e-mt-5f0553bb-openshift-default-75d6cd9bc9-rpt8x container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.37:15021/healthz/ready\": dial tcp 10.132.0.37:15021: connect: connection refused" start-of-body=
Jul 07 18:08:49.580982 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:08:49.580782    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-5f0553bb-openshift-default-75d6cd9bc9-rpt8x" podUID="f3b62292-ebbb-4034-bf31-4a9a7d5c0412" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.37:15021/healthz/ready\": dial tcp 10.132.0.37:15021: connect: connection refused"
Jul 07 18:08:50.584006 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:08:50.583970    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-5f0553bb-openshift-default-75d6cd9bc9-rpt8x"
Jul 07 18:08:50.585120 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:08:50.585101    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-5f0553bb-openshift-default-75d6cd9bc9-rpt8x"
Jul 07 18:08:53.362411 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:08:53.362364    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-5f0553bb-openshift-default-75d6cd9bc9-rpt8x"]
Jul 07 18:08:53.362905 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:08:53.362616    2561 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-5f0553bb-openshift-default-75d6cd9bc9-rpt8x" podUID="f3b62292-ebbb-4034-bf31-4a9a7d5c0412" containerName="istio-proxy" containerID="cri-o://d5179186c98c799cade5745d9062d3ecde83d0119d5ac62a3c5931dfc3f05133" gracePeriod=30
Jul 07 18:08:58.619598 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:08:58.619570    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-5f0553bb-openshift-default-75d6cd9bc9-rpt8x"
Jul 07 18:08:58.620368 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:08:58.620344    2561 generic.go:356] "Generic (PLEG): container finished" podID="f3b62292-ebbb-4034-bf31-4a9a7d5c0412" containerID="d5179186c98c799cade5745d9062d3ecde83d0119d5ac62a3c5931dfc3f05133" exitCode=0
Jul 07 18:08:58.620478 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:08:58.620412    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-5f0553bb-openshift-default-75d6cd9bc9-rpt8x" event={"ID":"f3b62292-ebbb-4034-bf31-4a9a7d5c0412","Type":"ContainerDied","Data":"d5179186c98c799cade5745d9062d3ecde83d0119d5ac62a3c5931dfc3f05133"}
Jul 07 18:08:58.620526 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:08:58.620478    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-5f0553bb-openshift-default-75d6cd9bc9-rpt8x" event={"ID":"f3b62292-ebbb-4034-bf31-4a9a7d5c0412","Type":"ContainerDied","Data":"aef82e5137700194f1980cfad39f6a261e63dcb271cc09047e3127dadd6bd2cb"}
Jul 07 18:08:58.620526 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:08:58.620502    2561 scope.go:117] "RemoveContainer" containerID="d5179186c98c799cade5745d9062d3ecde83d0119d5ac62a3c5931dfc3f05133"
Jul 07 18:08:58.629066 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:08:58.629045    2561 scope.go:117] "RemoveContainer" containerID="19701f85d668d57bb9df18ce27a287a89f3a3982ea48932e20e671acf5016042"
Jul 07 18:08:58.639071 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:08:58.639050    2561 scope.go:117] "RemoveContainer" containerID="d5179186c98c799cade5745d9062d3ecde83d0119d5ac62a3c5931dfc3f05133"
Jul 07 18:08:58.639386 ip-10-0-139-31 kubenswrapper[2561]: E0707 18:08:58.639365    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d5179186c98c799cade5745d9062d3ecde83d0119d5ac62a3c5931dfc3f05133\": container with ID starting with d5179186c98c799cade5745d9062d3ecde83d0119d5ac62a3c5931dfc3f05133 not found: ID does not exist" containerID="d5179186c98c799cade5745d9062d3ecde83d0119d5ac62a3c5931dfc3f05133"
Jul 07 18:08:58.639440 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:08:58.639397    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d5179186c98c799cade5745d9062d3ecde83d0119d5ac62a3c5931dfc3f05133"} err="failed to get container status \"d5179186c98c799cade5745d9062d3ecde83d0119d5ac62a3c5931dfc3f05133\": rpc error: code = NotFound desc = could not find container \"d5179186c98c799cade5745d9062d3ecde83d0119d5ac62a3c5931dfc3f05133\": container with ID starting with d5179186c98c799cade5745d9062d3ecde83d0119d5ac62a3c5931dfc3f05133 not found: ID does not exist"
Jul 07 18:08:58.639440 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:08:58.639416    2561 scope.go:117] "RemoveContainer" containerID="19701f85d668d57bb9df18ce27a287a89f3a3982ea48932e20e671acf5016042"
Jul 07 18:08:58.639685 ip-10-0-139-31 kubenswrapper[2561]: E0707 18:08:58.639664    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"19701f85d668d57bb9df18ce27a287a89f3a3982ea48932e20e671acf5016042\": container with ID starting with 19701f85d668d57bb9df18ce27a287a89f3a3982ea48932e20e671acf5016042 not found: ID does not exist" containerID="19701f85d668d57bb9df18ce27a287a89f3a3982ea48932e20e671acf5016042"
Jul 07 18:08:58.639745 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:08:58.639691    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"19701f85d668d57bb9df18ce27a287a89f3a3982ea48932e20e671acf5016042"} err="failed to get container status \"19701f85d668d57bb9df18ce27a287a89f3a3982ea48932e20e671acf5016042\": rpc error: code = NotFound desc = could not find container \"19701f85d668d57bb9df18ce27a287a89f3a3982ea48932e20e671acf5016042\": container with ID starting with 19701f85d668d57bb9df18ce27a287a89f3a3982ea48932e20e671acf5016042 not found: ID does not exist"
Jul 07 18:08:58.770508 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:08:58.770438    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f3b62292-ebbb-4034-bf31-4a9a7d5c0412-istio-data\") pod \"f3b62292-ebbb-4034-bf31-4a9a7d5c0412\" (UID: \"f3b62292-ebbb-4034-bf31-4a9a7d5c0412\") "
Jul 07 18:08:58.770685 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:08:58.770537    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f3b62292-ebbb-4034-bf31-4a9a7d5c0412-workload-socket\") pod \"f3b62292-ebbb-4034-bf31-4a9a7d5c0412\" (UID: \"f3b62292-ebbb-4034-bf31-4a9a7d5c0412\") "
Jul 07 18:08:58.770685 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:08:58.770581    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f3b62292-ebbb-4034-bf31-4a9a7d5c0412-istio-envoy\") pod \"f3b62292-ebbb-4034-bf31-4a9a7d5c0412\" (UID: \"f3b62292-ebbb-4034-bf31-4a9a7d5c0412\") "
Jul 07 18:08:58.770685 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:08:58.770610    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f3b62292-ebbb-4034-bf31-4a9a7d5c0412-workload-certs\") pod \"f3b62292-ebbb-4034-bf31-4a9a7d5c0412\" (UID: \"f3b62292-ebbb-4034-bf31-4a9a7d5c0412\") "
Jul 07 18:08:58.770685 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:08:58.770647    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f3b62292-ebbb-4034-bf31-4a9a7d5c0412-istiod-ca-cert\") pod \"f3b62292-ebbb-4034-bf31-4a9a7d5c0412\" (UID: \"f3b62292-ebbb-4034-bf31-4a9a7d5c0412\") "
Jul 07 18:08:58.770877 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:08:58.770696    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f3b62292-ebbb-4034-bf31-4a9a7d5c0412-istio-token\") pod \"f3b62292-ebbb-4034-bf31-4a9a7d5c0412\" (UID: \"f3b62292-ebbb-4034-bf31-4a9a7d5c0412\") "
Jul 07 18:08:58.770877 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:08:58.770723    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hcdz7\" (UniqueName: \"kubernetes.io/projected/f3b62292-ebbb-4034-bf31-4a9a7d5c0412-kube-api-access-hcdz7\") pod \"f3b62292-ebbb-4034-bf31-4a9a7d5c0412\" (UID: \"f3b62292-ebbb-4034-bf31-4a9a7d5c0412\") "
Jul 07 18:08:58.770877 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:08:58.770766    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f3b62292-ebbb-4034-bf31-4a9a7d5c0412-istio-podinfo\") pod \"f3b62292-ebbb-4034-bf31-4a9a7d5c0412\" (UID: \"f3b62292-ebbb-4034-bf31-4a9a7d5c0412\") "
Jul 07 18:08:58.770877 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:08:58.770827    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f3b62292-ebbb-4034-bf31-4a9a7d5c0412-credential-socket\") pod \"f3b62292-ebbb-4034-bf31-4a9a7d5c0412\" (UID: \"f3b62292-ebbb-4034-bf31-4a9a7d5c0412\") "
Jul 07 18:08:58.771180 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:08:58.770879    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f3b62292-ebbb-4034-bf31-4a9a7d5c0412-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "f3b62292-ebbb-4034-bf31-4a9a7d5c0412" (UID: "f3b62292-ebbb-4034-bf31-4a9a7d5c0412"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 18:08:58.771180 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:08:58.770974    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f3b62292-ebbb-4034-bf31-4a9a7d5c0412-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "f3b62292-ebbb-4034-bf31-4a9a7d5c0412" (UID: "f3b62292-ebbb-4034-bf31-4a9a7d5c0412"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 18:08:58.771180 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:08:58.771090    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f3b62292-ebbb-4034-bf31-4a9a7d5c0412-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "f3b62292-ebbb-4034-bf31-4a9a7d5c0412" (UID: "f3b62292-ebbb-4034-bf31-4a9a7d5c0412"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 18:08:58.771180 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:08:58.771147    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f3b62292-ebbb-4034-bf31-4a9a7d5c0412-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "f3b62292-ebbb-4034-bf31-4a9a7d5c0412" (UID: "f3b62292-ebbb-4034-bf31-4a9a7d5c0412"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 18:08:58.771389 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:08:58.771204    2561 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f3b62292-ebbb-4034-bf31-4a9a7d5c0412-workload-socket\") on node \"ip-10-0-139-31.ec2.internal\" DevicePath \"\""
Jul 07 18:08:58.771389 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:08:58.771219    2561 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f3b62292-ebbb-4034-bf31-4a9a7d5c0412-workload-certs\") on node \"ip-10-0-139-31.ec2.internal\" DevicePath \"\""
Jul 07 18:08:58.771389 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:08:58.771232    2561 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f3b62292-ebbb-4034-bf31-4a9a7d5c0412-credential-socket\") on node \"ip-10-0-139-31.ec2.internal\" DevicePath \"\""
Jul 07 18:08:58.771584 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:08:58.771405    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f3b62292-ebbb-4034-bf31-4a9a7d5c0412-istio-data" (OuterVolumeSpecName: "istio-data") pod "f3b62292-ebbb-4034-bf31-4a9a7d5c0412" (UID: "f3b62292-ebbb-4034-bf31-4a9a7d5c0412"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 18:08:58.772932 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:08:58.772902    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f3b62292-ebbb-4034-bf31-4a9a7d5c0412-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "f3b62292-ebbb-4034-bf31-4a9a7d5c0412" (UID: "f3b62292-ebbb-4034-bf31-4a9a7d5c0412"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 18:08:58.773050 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:08:58.772970    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f3b62292-ebbb-4034-bf31-4a9a7d5c0412-istio-token" (OuterVolumeSpecName: "istio-token") pod "f3b62292-ebbb-4034-bf31-4a9a7d5c0412" (UID: "f3b62292-ebbb-4034-bf31-4a9a7d5c0412"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 18:08:58.773050 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:08:58.772992    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/f3b62292-ebbb-4034-bf31-4a9a7d5c0412-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "f3b62292-ebbb-4034-bf31-4a9a7d5c0412" (UID: "f3b62292-ebbb-4034-bf31-4a9a7d5c0412"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 07 18:08:58.773050 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:08:58.772988    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f3b62292-ebbb-4034-bf31-4a9a7d5c0412-kube-api-access-hcdz7" (OuterVolumeSpecName: "kube-api-access-hcdz7") pod "f3b62292-ebbb-4034-bf31-4a9a7d5c0412" (UID: "f3b62292-ebbb-4034-bf31-4a9a7d5c0412"). InnerVolumeSpecName "kube-api-access-hcdz7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 18:08:58.872083 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:08:58.872047    2561 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f3b62292-ebbb-4034-bf31-4a9a7d5c0412-istio-data\") on node \"ip-10-0-139-31.ec2.internal\" DevicePath \"\""
Jul 07 18:08:58.872083 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:08:58.872079    2561 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f3b62292-ebbb-4034-bf31-4a9a7d5c0412-istio-envoy\") on node \"ip-10-0-139-31.ec2.internal\" DevicePath \"\""
Jul 07 18:08:58.872083 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:08:58.872088    2561 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f3b62292-ebbb-4034-bf31-4a9a7d5c0412-istiod-ca-cert\") on node \"ip-10-0-139-31.ec2.internal\" DevicePath \"\""
Jul 07 18:08:58.872083 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:08:58.872096    2561 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f3b62292-ebbb-4034-bf31-4a9a7d5c0412-istio-token\") on node \"ip-10-0-139-31.ec2.internal\" DevicePath \"\""
Jul 07 18:08:58.872360 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:08:58.872104    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hcdz7\" (UniqueName: \"kubernetes.io/projected/f3b62292-ebbb-4034-bf31-4a9a7d5c0412-kube-api-access-hcdz7\") on node \"ip-10-0-139-31.ec2.internal\" DevicePath \"\""
Jul 07 18:08:58.872360 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:08:58.872113    2561 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f3b62292-ebbb-4034-bf31-4a9a7d5c0412-istio-podinfo\") on node \"ip-10-0-139-31.ec2.internal\" DevicePath \"\""
Jul 07 18:08:59.626695 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:08:59.626660    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-5f0553bb-openshift-default-75d6cd9bc9-rpt8x"
Jul 07 18:08:59.645151 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:08:59.645112    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-5f0553bb-openshift-default-75d6cd9bc9-rpt8x"]
Jul 07 18:08:59.650015 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:08:59.649987    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-5f0553bb-openshift-default-75d6cd9bc9-rpt8x"]
Jul 07 18:09:01.521125 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:09:01.521078    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f3b62292-ebbb-4034-bf31-4a9a7d5c0412" path="/var/lib/kubelet/pods/f3b62292-ebbb-4034-bf31-4a9a7d5c0412/volumes"
Jul 07 18:09:14.063573 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:09:14.063540    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-882c1dd4-openshift-default-7b495fd96c-b7fg2"]
Jul 07 18:09:14.064025 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:09:14.063921    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f3b62292-ebbb-4034-bf31-4a9a7d5c0412" containerName="istio-proxy"
Jul 07 18:09:14.064025 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:09:14.063932    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="f3b62292-ebbb-4034-bf31-4a9a7d5c0412" containerName="istio-proxy"
Jul 07 18:09:14.064025 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:09:14.063942    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f3b62292-ebbb-4034-bf31-4a9a7d5c0412" containerName="istio-proxy"
Jul 07 18:09:14.064025 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:09:14.063947    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="f3b62292-ebbb-4034-bf31-4a9a7d5c0412" containerName="istio-proxy"
Jul 07 18:09:14.064025 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:09:14.064002    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="f3b62292-ebbb-4034-bf31-4a9a7d5c0412" containerName="istio-proxy"
Jul 07 18:09:14.064025 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:09:14.064011    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="f3b62292-ebbb-4034-bf31-4a9a7d5c0412" containerName="istio-proxy"
Jul 07 18:09:14.067134 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:09:14.067112    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-882c1dd4-openshift-default-7b495fd96c-b7fg2"
Jul 07 18:09:14.070665 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:09:14.070644    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Jul 07 18:09:14.070787 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:09:14.070767    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-882c1dd4-openshift-default-dockercfg-tw962\""
Jul 07 18:09:14.083196 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:09:14.083167    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-882c1dd4-openshift-default-7b495fd96c-b7fg2"]
Jul 07 18:09:14.098638 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:09:14.098604    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/79e6065f-a560-4d11-a793-f699604675b8-istio-envoy\") pod \"e2e-mt-882c1dd4-openshift-default-7b495fd96c-b7fg2\" (UID: \"79e6065f-a560-4d11-a793-f699604675b8\") " pod="openshift-ingress/e2e-mt-882c1dd4-openshift-default-7b495fd96c-b7fg2"
Jul 07 18:09:14.098782 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:09:14.098668    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/79e6065f-a560-4d11-a793-f699604675b8-istio-podinfo\") pod \"e2e-mt-882c1dd4-openshift-default-7b495fd96c-b7fg2\" (UID: \"79e6065f-a560-4d11-a793-f699604675b8\") " pod="openshift-ingress/e2e-mt-882c1dd4-openshift-default-7b495fd96c-b7fg2"
Jul 07 18:09:14.098782 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:09:14.098712    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/79e6065f-a560-4d11-a793-f699604675b8-credential-socket\") pod \"e2e-mt-882c1dd4-openshift-default-7b495fd96c-b7fg2\" (UID: \"79e6065f-a560-4d11-a793-f699604675b8\") " pod="openshift-ingress/e2e-mt-882c1dd4-openshift-default-7b495fd96c-b7fg2"
Jul 07 18:09:14.098782 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:09:14.098744    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/79e6065f-a560-4d11-a793-f699604675b8-istio-data\") pod \"e2e-mt-882c1dd4-openshift-default-7b495fd96c-b7fg2\" (UID: \"79e6065f-a560-4d11-a793-f699604675b8\") " pod="openshift-ingress/e2e-mt-882c1dd4-openshift-default-7b495fd96c-b7fg2"
Jul 07 18:09:14.098782 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:09:14.098776    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/79e6065f-a560-4d11-a793-f699604675b8-istio-token\") pod \"e2e-mt-882c1dd4-openshift-default-7b495fd96c-b7fg2\" (UID: \"79e6065f-a560-4d11-a793-f699604675b8\") " pod="openshift-ingress/e2e-mt-882c1dd4-openshift-default-7b495fd96c-b7fg2"
Jul 07 18:09:14.098941 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:09:14.098801    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/79e6065f-a560-4d11-a793-f699604675b8-workload-certs\") pod \"e2e-mt-882c1dd4-openshift-default-7b495fd96c-b7fg2\" (UID: \"79e6065f-a560-4d11-a793-f699604675b8\") " pod="openshift-ingress/e2e-mt-882c1dd4-openshift-default-7b495fd96c-b7fg2"
Jul 07 18:09:14.098941 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:09:14.098823    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/79e6065f-a560-4d11-a793-f699604675b8-workload-socket\") pod \"e2e-mt-882c1dd4-openshift-default-7b495fd96c-b7fg2\" (UID: \"79e6065f-a560-4d11-a793-f699604675b8\") " pod="openshift-ingress/e2e-mt-882c1dd4-openshift-default-7b495fd96c-b7fg2"
Jul 07 18:09:14.098941 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:09:14.098839    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/79e6065f-a560-4d11-a793-f699604675b8-istiod-ca-cert\") pod \"e2e-mt-882c1dd4-openshift-default-7b495fd96c-b7fg2\" (UID: \"79e6065f-a560-4d11-a793-f699604675b8\") " pod="openshift-ingress/e2e-mt-882c1dd4-openshift-default-7b495fd96c-b7fg2"
Jul 07 18:09:14.098941 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:09:14.098853    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2rxz7\" (UniqueName: \"kubernetes.io/projected/79e6065f-a560-4d11-a793-f699604675b8-kube-api-access-2rxz7\") pod \"e2e-mt-882c1dd4-openshift-default-7b495fd96c-b7fg2\" (UID: \"79e6065f-a560-4d11-a793-f699604675b8\") " pod="openshift-ingress/e2e-mt-882c1dd4-openshift-default-7b495fd96c-b7fg2"
Jul 07 18:09:14.199484 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:09:14.199415    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/79e6065f-a560-4d11-a793-f699604675b8-workload-certs\") pod \"e2e-mt-882c1dd4-openshift-default-7b495fd96c-b7fg2\" (UID: \"79e6065f-a560-4d11-a793-f699604675b8\") " pod="openshift-ingress/e2e-mt-882c1dd4-openshift-default-7b495fd96c-b7fg2"
Jul 07 18:09:14.199484 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:09:14.199489    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/79e6065f-a560-4d11-a793-f699604675b8-workload-socket\") pod \"e2e-mt-882c1dd4-openshift-default-7b495fd96c-b7fg2\" (UID: \"79e6065f-a560-4d11-a793-f699604675b8\") " pod="openshift-ingress/e2e-mt-882c1dd4-openshift-default-7b495fd96c-b7fg2"
Jul 07 18:09:14.199739 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:09:14.199516    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/79e6065f-a560-4d11-a793-f699604675b8-istiod-ca-cert\") pod \"e2e-mt-882c1dd4-openshift-default-7b495fd96c-b7fg2\" (UID: \"79e6065f-a560-4d11-a793-f699604675b8\") " pod="openshift-ingress/e2e-mt-882c1dd4-openshift-default-7b495fd96c-b7fg2"
Jul 07 18:09:14.199739 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:09:14.199535    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2rxz7\" (UniqueName: \"kubernetes.io/projected/79e6065f-a560-4d11-a793-f699604675b8-kube-api-access-2rxz7\") pod \"e2e-mt-882c1dd4-openshift-default-7b495fd96c-b7fg2\" (UID: \"79e6065f-a560-4d11-a793-f699604675b8\") " pod="openshift-ingress/e2e-mt-882c1dd4-openshift-default-7b495fd96c-b7fg2"
Jul 07 18:09:14.199739 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:09:14.199558    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/79e6065f-a560-4d11-a793-f699604675b8-istio-envoy\") pod \"e2e-mt-882c1dd4-openshift-default-7b495fd96c-b7fg2\" (UID: \"79e6065f-a560-4d11-a793-f699604675b8\") " pod="openshift-ingress/e2e-mt-882c1dd4-openshift-default-7b495fd96c-b7fg2"
Jul 07 18:09:14.199739 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:09:14.199619    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/79e6065f-a560-4d11-a793-f699604675b8-istio-podinfo\") pod \"e2e-mt-882c1dd4-openshift-default-7b495fd96c-b7fg2\" (UID: \"79e6065f-a560-4d11-a793-f699604675b8\") " pod="openshift-ingress/e2e-mt-882c1dd4-openshift-default-7b495fd96c-b7fg2"
Jul 07 18:09:14.199739 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:09:14.199657    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/79e6065f-a560-4d11-a793-f699604675b8-credential-socket\") pod \"e2e-mt-882c1dd4-openshift-default-7b495fd96c-b7fg2\" (UID: \"79e6065f-a560-4d11-a793-f699604675b8\") " pod="openshift-ingress/e2e-mt-882c1dd4-openshift-default-7b495fd96c-b7fg2"
Jul 07 18:09:14.199739 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:09:14.199701    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/79e6065f-a560-4d11-a793-f699604675b8-istio-data\") pod \"e2e-mt-882c1dd4-openshift-default-7b495fd96c-b7fg2\" (UID: \"79e6065f-a560-4d11-a793-f699604675b8\") " pod="openshift-ingress/e2e-mt-882c1dd4-openshift-default-7b495fd96c-b7fg2"
Jul 07 18:09:14.200030 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:09:14.199759    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/79e6065f-a560-4d11-a793-f699604675b8-istio-token\") pod \"e2e-mt-882c1dd4-openshift-default-7b495fd96c-b7fg2\" (UID: \"79e6065f-a560-4d11-a793-f699604675b8\") " pod="openshift-ingress/e2e-mt-882c1dd4-openshift-default-7b495fd96c-b7fg2"
Jul 07 18:09:14.200030 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:09:14.199838    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/79e6065f-a560-4d11-a793-f699604675b8-workload-certs\") pod \"e2e-mt-882c1dd4-openshift-default-7b495fd96c-b7fg2\" (UID: \"79e6065f-a560-4d11-a793-f699604675b8\") " pod="openshift-ingress/e2e-mt-882c1dd4-openshift-default-7b495fd96c-b7fg2"
Jul 07 18:09:14.200030 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:09:14.199885    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/79e6065f-a560-4d11-a793-f699604675b8-workload-socket\") pod \"e2e-mt-882c1dd4-openshift-default-7b495fd96c-b7fg2\" (UID: \"79e6065f-a560-4d11-a793-f699604675b8\") " pod="openshift-ingress/e2e-mt-882c1dd4-openshift-default-7b495fd96c-b7fg2"
Jul 07 18:09:14.200127 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:09:14.200055    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/79e6065f-a560-4d11-a793-f699604675b8-credential-socket\") pod \"e2e-mt-882c1dd4-openshift-default-7b495fd96c-b7fg2\" (UID: \"79e6065f-a560-4d11-a793-f699604675b8\") " pod="openshift-ingress/e2e-mt-882c1dd4-openshift-default-7b495fd96c-b7fg2"
Jul 07 18:09:14.200127 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:09:14.200072    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/79e6065f-a560-4d11-a793-f699604675b8-istio-data\") pod \"e2e-mt-882c1dd4-openshift-default-7b495fd96c-b7fg2\" (UID: \"79e6065f-a560-4d11-a793-f699604675b8\") " pod="openshift-ingress/e2e-mt-882c1dd4-openshift-default-7b495fd96c-b7fg2"
Jul 07 18:09:14.200403 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:09:14.200381    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/79e6065f-a560-4d11-a793-f699604675b8-istiod-ca-cert\") pod \"e2e-mt-882c1dd4-openshift-default-7b495fd96c-b7fg2\" (UID: \"79e6065f-a560-4d11-a793-f699604675b8\") " pod="openshift-ingress/e2e-mt-882c1dd4-openshift-default-7b495fd96c-b7fg2"
Jul 07 18:09:14.201958 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:09:14.201936    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/79e6065f-a560-4d11-a793-f699604675b8-istio-envoy\") pod \"e2e-mt-882c1dd4-openshift-default-7b495fd96c-b7fg2\" (UID: \"79e6065f-a560-4d11-a793-f699604675b8\") " pod="openshift-ingress/e2e-mt-882c1dd4-openshift-default-7b495fd96c-b7fg2"
Jul 07 18:09:14.202056 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:09:14.201992    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/79e6065f-a560-4d11-a793-f699604675b8-istio-podinfo\") pod \"e2e-mt-882c1dd4-openshift-default-7b495fd96c-b7fg2\" (UID: \"79e6065f-a560-4d11-a793-f699604675b8\") " pod="openshift-ingress/e2e-mt-882c1dd4-openshift-default-7b495fd96c-b7fg2"
Jul 07 18:09:14.213312 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:09:14.209372    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/79e6065f-a560-4d11-a793-f699604675b8-istio-token\") pod \"e2e-mt-882c1dd4-openshift-default-7b495fd96c-b7fg2\" (UID: \"79e6065f-a560-4d11-a793-f699604675b8\") " pod="openshift-ingress/e2e-mt-882c1dd4-openshift-default-7b495fd96c-b7fg2"
Jul 07 18:09:14.213312 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:09:14.209465    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2rxz7\" (UniqueName: \"kubernetes.io/projected/79e6065f-a560-4d11-a793-f699604675b8-kube-api-access-2rxz7\") pod \"e2e-mt-882c1dd4-openshift-default-7b495fd96c-b7fg2\" (UID: \"79e6065f-a560-4d11-a793-f699604675b8\") " pod="openshift-ingress/e2e-mt-882c1dd4-openshift-default-7b495fd96c-b7fg2"
Jul 07 18:09:14.377329 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:09:14.377230    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-882c1dd4-openshift-default-7b495fd96c-b7fg2"
Jul 07 18:09:14.525174 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:09:14.525147    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-882c1dd4-openshift-default-7b495fd96c-b7fg2"]
Jul 07 18:09:14.527810 ip-10-0-139-31 kubenswrapper[2561]: W0707 18:09:14.527774    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod79e6065f_a560_4d11_a793_f699604675b8.slice/crio-56b97c2eca76c84044ccde0a0d3c8f3c387766662c05fcf81c23f7a239df32b1 WatchSource:0}: Error finding container 56b97c2eca76c84044ccde0a0d3c8f3c387766662c05fcf81c23f7a239df32b1: Status 404 returned error can't find the container with id 56b97c2eca76c84044ccde0a0d3c8f3c387766662c05fcf81c23f7a239df32b1
Jul 07 18:09:14.529996 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:09:14.529951    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 07 18:09:14.530057 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:09:14.530032    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 07 18:09:14.530093 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:09:14.530067    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 07 18:09:14.698061 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:09:14.697970    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-882c1dd4-openshift-default-7b495fd96c-b7fg2" event={"ID":"79e6065f-a560-4d11-a793-f699604675b8","Type":"ContainerStarted","Data":"315b54d2a0598733604fbfc8cec2b0ef439d5c597b3581201f7254c1671db9d2"}
Jul 07 18:09:14.698061 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:09:14.698028    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-882c1dd4-openshift-default-7b495fd96c-b7fg2" event={"ID":"79e6065f-a560-4d11-a793-f699604675b8","Type":"ContainerStarted","Data":"56b97c2eca76c84044ccde0a0d3c8f3c387766662c05fcf81c23f7a239df32b1"}
Jul 07 18:09:14.731276 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:09:14.731224    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-882c1dd4-openshift-default-7b495fd96c-b7fg2" podStartSLOduration=0.731205266 podStartE2EDuration="731.205266ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 18:09:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 18:09:14.727744375 +0000 UTC m=+1745.878868773" watchObservedRunningTime="2026-07-07 18:09:14.731205266 +0000 UTC m=+1745.882329663"
Jul 07 18:09:15.378462 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:09:15.378422    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-882c1dd4-openshift-default-7b495fd96c-b7fg2"
Jul 07 18:09:15.383287 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:09:15.383262    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-882c1dd4-openshift-default-7b495fd96c-b7fg2"
Jul 07 18:09:15.702304 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:09:15.702218    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-882c1dd4-openshift-default-7b495fd96c-b7fg2"
Jul 07 18:09:15.703261 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:09:15.703242    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-882c1dd4-openshift-default-7b495fd96c-b7fg2"
Jul 07 18:09:29.772303 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:09:29.772265    2561 generic.go:356] "Generic (PLEG): container finished" podID="79e6065f-a560-4d11-a793-f699604675b8" containerID="315b54d2a0598733604fbfc8cec2b0ef439d5c597b3581201f7254c1671db9d2" exitCode=0
Jul 07 18:09:29.772854 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:09:29.772338    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-882c1dd4-openshift-default-7b495fd96c-b7fg2" event={"ID":"79e6065f-a560-4d11-a793-f699604675b8","Type":"ContainerDied","Data":"315b54d2a0598733604fbfc8cec2b0ef439d5c597b3581201f7254c1671db9d2"}
Jul 07 18:09:29.772924 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:09:29.772858    2561 scope.go:117] "RemoveContainer" containerID="315b54d2a0598733604fbfc8cec2b0ef439d5c597b3581201f7254c1671db9d2"
Jul 07 18:09:29.773946 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:09:29.773919    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 07 18:09:29.774009 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:09:29.773988    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 07 18:09:29.774045 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:09:29.774023    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 07 18:09:30.702170 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:09:30.702132    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-882c1dd4-openshift-default-7b495fd96c-b7fg2"
Jul 07 18:09:30.780092 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:09:30.780041    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-882c1dd4-openshift-default-7b495fd96c-b7fg2" event={"ID":"79e6065f-a560-4d11-a793-f699604675b8","Type":"ContainerStarted","Data":"f0b09eb6cbbdbfcac3dec10c8434b40da99619cb62996974c92b4b5db021ce7e"}
Jul 07 18:09:31.378517 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:09:31.378472    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-882c1dd4-openshift-default-7b495fd96c-b7fg2"
Jul 07 18:09:31.379677 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:09:31.379630    2561 patch_prober.go:28] interesting pod/e2e-mt-882c1dd4-openshift-default-7b495fd96c-b7fg2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.38:15021/healthz/ready\": dial tcp 10.132.0.38:15021: connect: connection refused" start-of-body=
Jul 07 18:09:31.379819 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:09:31.379709    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-882c1dd4-openshift-default-7b495fd96c-b7fg2" podUID="79e6065f-a560-4d11-a793-f699604675b8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.38:15021/healthz/ready\": dial tcp 10.132.0.38:15021: connect: connection refused"
Jul 07 18:09:32.378083 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:09:32.378033    2561 patch_prober.go:28] interesting pod/e2e-mt-882c1dd4-openshift-default-7b495fd96c-b7fg2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.38:15021/healthz/ready\": dial tcp 10.132.0.38:15021: connect: connection refused" start-of-body=
Jul 07 18:09:32.378655 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:09:32.378105    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-882c1dd4-openshift-default-7b495fd96c-b7fg2" podUID="79e6065f-a560-4d11-a793-f699604675b8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.38:15021/healthz/ready\": dial tcp 10.132.0.38:15021: connect: connection refused"
Jul 07 18:09:33.003220 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:09:33.003162    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-mt-882c1dd4/e2e-lifecycle-model-882c1dd4-kserve-68b46cb687-bjz59"]
Jul 07 18:09:33.011676 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:09:33.011634    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-mt-882c1dd4/e2e-lifecycle-model-882c1dd4-kserve-68b46cb687-bjz59"]
Jul 07 18:09:33.011851 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:09:33.011732    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-882c1dd4/e2e-lifecycle-model-882c1dd4-kserve-68b46cb687-bjz59"
Jul 07 18:09:33.014866 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:09:33.014832    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-mt-882c1dd4\"/\"default-dockercfg-dv52b\""
Jul 07 18:09:33.015125 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:09:33.015095    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-mt-882c1dd4\"/\"e2e-lifecycle-model-882c1dd4-kserve-self-signed-certs\""
Jul 07 18:09:33.015237 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:09:33.015095    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-mt-882c1dd4\"/\"openshift-service-ca.crt\""
Jul 07 18:09:33.015932 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:09:33.015912    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-mt-882c1dd4\"/\"kube-root-ca.crt\""
Jul 07 18:09:33.096657 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:09:33.096607    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/983a5562-255c-4180-ae5f-c16718e00294-tls-certs\") pod \"e2e-lifecycle-model-882c1dd4-kserve-68b46cb687-bjz59\" (UID: \"983a5562-255c-4180-ae5f-c16718e00294\") " pod="ai-tenant-e2e-mt-882c1dd4/e2e-lifecycle-model-882c1dd4-kserve-68b46cb687-bjz59"
Jul 07 18:09:33.096874 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:09:33.096675    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/983a5562-255c-4180-ae5f-c16718e00294-dshm\") pod \"e2e-lifecycle-model-882c1dd4-kserve-68b46cb687-bjz59\" (UID: \"983a5562-255c-4180-ae5f-c16718e00294\") " pod="ai-tenant-e2e-mt-882c1dd4/e2e-lifecycle-model-882c1dd4-kserve-68b46cb687-bjz59"
Jul 07 18:09:33.096874 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:09:33.096710    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/983a5562-255c-4180-ae5f-c16718e00294-tmp-dir\") pod \"e2e-lifecycle-model-882c1dd4-kserve-68b46cb687-bjz59\" (UID: \"983a5562-255c-4180-ae5f-c16718e00294\") " pod="ai-tenant-e2e-mt-882c1dd4/e2e-lifecycle-model-882c1dd4-kserve-68b46cb687-bjz59"
Jul 07 18:09:33.096874 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:09:33.096739    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/983a5562-255c-4180-ae5f-c16718e00294-model-cache\") pod \"e2e-lifecycle-model-882c1dd4-kserve-68b46cb687-bjz59\" (UID: \"983a5562-255c-4180-ae5f-c16718e00294\") " pod="ai-tenant-e2e-mt-882c1dd4/e2e-lifecycle-model-882c1dd4-kserve-68b46cb687-bjz59"
Jul 07 18:09:33.096874 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:09:33.096768    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/983a5562-255c-4180-ae5f-c16718e00294-home\") pod \"e2e-lifecycle-model-882c1dd4-kserve-68b46cb687-bjz59\" (UID: \"983a5562-255c-4180-ae5f-c16718e00294\") " pod="ai-tenant-e2e-mt-882c1dd4/e2e-lifecycle-model-882c1dd4-kserve-68b46cb687-bjz59"
Jul 07 18:09:33.096874 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:09:33.096811    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kzdrr\" (UniqueName: \"kubernetes.io/projected/983a5562-255c-4180-ae5f-c16718e00294-kube-api-access-kzdrr\") pod \"e2e-lifecycle-model-882c1dd4-kserve-68b46cb687-bjz59\" (UID: \"983a5562-255c-4180-ae5f-c16718e00294\") " pod="ai-tenant-e2e-mt-882c1dd4/e2e-lifecycle-model-882c1dd4-kserve-68b46cb687-bjz59"
Jul 07 18:09:33.202117 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:09:33.202061    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/983a5562-255c-4180-ae5f-c16718e00294-tls-certs\") pod \"e2e-lifecycle-model-882c1dd4-kserve-68b46cb687-bjz59\" (UID: \"983a5562-255c-4180-ae5f-c16718e00294\") " pod="ai-tenant-e2e-mt-882c1dd4/e2e-lifecycle-model-882c1dd4-kserve-68b46cb687-bjz59"
Jul 07 18:09:33.202423 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:09:33.202396    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/983a5562-255c-4180-ae5f-c16718e00294-dshm\") pod \"e2e-lifecycle-model-882c1dd4-kserve-68b46cb687-bjz59\" (UID: \"983a5562-255c-4180-ae5f-c16718e00294\") " pod="ai-tenant-e2e-mt-882c1dd4/e2e-lifecycle-model-882c1dd4-kserve-68b46cb687-bjz59"
Jul 07 18:09:33.202643 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:09:33.202617    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/983a5562-255c-4180-ae5f-c16718e00294-tmp-dir\") pod \"e2e-lifecycle-model-882c1dd4-kserve-68b46cb687-bjz59\" (UID: \"983a5562-255c-4180-ae5f-c16718e00294\") " pod="ai-tenant-e2e-mt-882c1dd4/e2e-lifecycle-model-882c1dd4-kserve-68b46cb687-bjz59"
Jul 07 18:09:33.202794 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:09:33.202776    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/983a5562-255c-4180-ae5f-c16718e00294-model-cache\") pod \"e2e-lifecycle-model-882c1dd4-kserve-68b46cb687-bjz59\" (UID: \"983a5562-255c-4180-ae5f-c16718e00294\") " pod="ai-tenant-e2e-mt-882c1dd4/e2e-lifecycle-model-882c1dd4-kserve-68b46cb687-bjz59"
Jul 07 18:09:33.202941 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:09:33.202927    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/983a5562-255c-4180-ae5f-c16718e00294-home\") pod \"e2e-lifecycle-model-882c1dd4-kserve-68b46cb687-bjz59\" (UID: \"983a5562-255c-4180-ae5f-c16718e00294\") " pod="ai-tenant-e2e-mt-882c1dd4/e2e-lifecycle-model-882c1dd4-kserve-68b46cb687-bjz59"
Jul 07 18:09:33.203126 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:09:33.203089    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kzdrr\" (UniqueName: \"kubernetes.io/projected/983a5562-255c-4180-ae5f-c16718e00294-kube-api-access-kzdrr\") pod \"e2e-lifecycle-model-882c1dd4-kserve-68b46cb687-bjz59\" (UID: \"983a5562-255c-4180-ae5f-c16718e00294\") " pod="ai-tenant-e2e-mt-882c1dd4/e2e-lifecycle-model-882c1dd4-kserve-68b46cb687-bjz59"
Jul 07 18:09:33.203761 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:09:33.203741    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/983a5562-255c-4180-ae5f-c16718e00294-tmp-dir\") pod \"e2e-lifecycle-model-882c1dd4-kserve-68b46cb687-bjz59\" (UID: \"983a5562-255c-4180-ae5f-c16718e00294\") " pod="ai-tenant-e2e-mt-882c1dd4/e2e-lifecycle-model-882c1dd4-kserve-68b46cb687-bjz59"
Jul 07 18:09:33.203939 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:09:33.203850    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/983a5562-255c-4180-ae5f-c16718e00294-model-cache\") pod \"e2e-lifecycle-model-882c1dd4-kserve-68b46cb687-bjz59\" (UID: \"983a5562-255c-4180-ae5f-c16718e00294\") " pod="ai-tenant-e2e-mt-882c1dd4/e2e-lifecycle-model-882c1dd4-kserve-68b46cb687-bjz59"
Jul 07 18:09:33.204056 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:09:33.203992    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/983a5562-255c-4180-ae5f-c16718e00294-home\") pod \"e2e-lifecycle-model-882c1dd4-kserve-68b46cb687-bjz59\" (UID: \"983a5562-255c-4180-ae5f-c16718e00294\") " pod="ai-tenant-e2e-mt-882c1dd4/e2e-lifecycle-model-882c1dd4-kserve-68b46cb687-bjz59"
Jul 07 18:09:33.205924 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:09:33.205904    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/983a5562-255c-4180-ae5f-c16718e00294-dshm\") pod \"e2e-lifecycle-model-882c1dd4-kserve-68b46cb687-bjz59\" (UID: \"983a5562-255c-4180-ae5f-c16718e00294\") " pod="ai-tenant-e2e-mt-882c1dd4/e2e-lifecycle-model-882c1dd4-kserve-68b46cb687-bjz59"
Jul 07 18:09:33.206154 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:09:33.206134    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/983a5562-255c-4180-ae5f-c16718e00294-tls-certs\") pod \"e2e-lifecycle-model-882c1dd4-kserve-68b46cb687-bjz59\" (UID: \"983a5562-255c-4180-ae5f-c16718e00294\") " pod="ai-tenant-e2e-mt-882c1dd4/e2e-lifecycle-model-882c1dd4-kserve-68b46cb687-bjz59"
Jul 07 18:09:33.213729 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:09:33.213698    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kzdrr\" (UniqueName: \"kubernetes.io/projected/983a5562-255c-4180-ae5f-c16718e00294-kube-api-access-kzdrr\") pod \"e2e-lifecycle-model-882c1dd4-kserve-68b46cb687-bjz59\" (UID: \"983a5562-255c-4180-ae5f-c16718e00294\") " pod="ai-tenant-e2e-mt-882c1dd4/e2e-lifecycle-model-882c1dd4-kserve-68b46cb687-bjz59"
Jul 07 18:09:33.321986 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:09:33.321948    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-882c1dd4/e2e-lifecycle-model-882c1dd4-kserve-68b46cb687-bjz59"
Jul 07 18:09:33.386470 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:09:33.385928    2561 patch_prober.go:28] interesting pod/e2e-mt-882c1dd4-openshift-default-7b495fd96c-b7fg2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.38:15021/healthz/ready\": dial tcp 10.132.0.38:15021: connect: connection refused" start-of-body=
Jul 07 18:09:33.386470 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:09:33.385996    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-882c1dd4-openshift-default-7b495fd96c-b7fg2" podUID="79e6065f-a560-4d11-a793-f699604675b8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.38:15021/healthz/ready\": dial tcp 10.132.0.38:15021: connect: connection refused"
Jul 07 18:09:33.488903 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:09:33.488813    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-mt-882c1dd4/e2e-lifecycle-model-882c1dd4-kserve-68b46cb687-bjz59"]
Jul 07 18:09:33.504545 ip-10-0-139-31 kubenswrapper[2561]: W0707 18:09:33.504028    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod983a5562_255c_4180_ae5f_c16718e00294.slice/crio-6dc797c28239e3ba8c97064f59508ca4fbe3bb6810516333757b5f77e0be09dc WatchSource:0}: Error finding container 6dc797c28239e3ba8c97064f59508ca4fbe3bb6810516333757b5f77e0be09dc: Status 404 returned error can't find the container with id 6dc797c28239e3ba8c97064f59508ca4fbe3bb6810516333757b5f77e0be09dc
Jul 07 18:09:33.804917 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:09:33.804870    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-882c1dd4/e2e-lifecycle-model-882c1dd4-kserve-68b46cb687-bjz59" event={"ID":"983a5562-255c-4180-ae5f-c16718e00294","Type":"ContainerStarted","Data":"9d84b548a8fe0c87da65c0d7d54d5d0d5e7686dff7e517227707d492419049d0"}
Jul 07 18:09:33.804917 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:09:33.804923    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-882c1dd4/e2e-lifecycle-model-882c1dd4-kserve-68b46cb687-bjz59" event={"ID":"983a5562-255c-4180-ae5f-c16718e00294","Type":"ContainerStarted","Data":"6dc797c28239e3ba8c97064f59508ca4fbe3bb6810516333757b5f77e0be09dc"}
Jul 07 18:09:33.828987 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:09:33.828923    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-mt-882c1dd4/e2e-lifecycle-model-882c1dd4-kserve-68b46cb687-bjz59" podStartSLOduration=1.828907916 podStartE2EDuration="1.828907916s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 18:09:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 18:09:33.827725596 +0000 UTC m=+1764.978849995" watchObservedRunningTime="2026-07-07 18:09:33.828907916 +0000 UTC m=+1764.980032321"
Jul 07 18:09:34.377874 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:09:34.377832    2561 patch_prober.go:28] interesting pod/e2e-mt-882c1dd4-openshift-default-7b495fd96c-b7fg2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.38:15021/healthz/ready\": dial tcp 10.132.0.38:15021: connect: connection refused" start-of-body=
Jul 07 18:09:34.378172 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:09:34.378136    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-882c1dd4-openshift-default-7b495fd96c-b7fg2" podUID="79e6065f-a560-4d11-a793-f699604675b8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.38:15021/healthz/ready\": dial tcp 10.132.0.38:15021: connect: connection refused"
Jul 07 18:09:35.382084 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:09:35.382053    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-882c1dd4-openshift-default-7b495fd96c-b7fg2"
Jul 07 18:09:35.382587 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:09:35.382342    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-882c1dd4-openshift-default-7b495fd96c-b7fg2"
Jul 07 18:09:35.383120 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:09:35.383097    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-882c1dd4-openshift-default-7b495fd96c-b7fg2"
Jul 07 18:09:43.322769 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:09:43.322725    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-mt-882c1dd4/e2e-lifecycle-model-882c1dd4-kserve-68b46cb687-bjz59"
Jul 07 18:09:43.323210 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:09:43.322791    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-mt-882c1dd4/e2e-lifecycle-model-882c1dd4-kserve-68b46cb687-bjz59"
Jul 07 18:09:43.335564 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:09:43.335537    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-mt-882c1dd4/e2e-lifecycle-model-882c1dd4-kserve-68b46cb687-bjz59"
Jul 07 18:09:43.863464 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:09:43.863419    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-mt-882c1dd4/e2e-lifecycle-model-882c1dd4-kserve-68b46cb687-bjz59"
Jul 07 18:10:09.435525 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:10:09.435493    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-bjl48_805597ff-168d-4099-95b8-0037b0ceba2f/console-operator/1.log"
Jul 07 18:10:09.440224 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:10:09.440195    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-bjl48_805597ff-168d-4099-95b8-0037b0ceba2f/console-operator/1.log"
Jul 07 18:10:14.984006 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:10:14.983965    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-mt-882c1dd4/e2e-lifecycle-model-882c1dd4-kserve-68b46cb687-bjz59"]
Jul 07 18:10:30.005282 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:10:30.005226    2561 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-mt-882c1dd4/e2e-lifecycle-model-882c1dd4-kserve-68b46cb687-bjz59" podUID="983a5562-255c-4180-ae5f-c16718e00294" containerName="main" containerID="cri-o://9d84b548a8fe0c87da65c0d7d54d5d0d5e7686dff7e517227707d492419049d0" gracePeriod=45
Jul 07 18:10:30.266372 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:10:30.266311    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-882c1dd4/e2e-lifecycle-model-882c1dd4-kserve-68b46cb687-bjz59"
Jul 07 18:10:30.341003 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:10:30.340968    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/983a5562-255c-4180-ae5f-c16718e00294-dshm\") pod \"983a5562-255c-4180-ae5f-c16718e00294\" (UID: \"983a5562-255c-4180-ae5f-c16718e00294\") "
Jul 07 18:10:30.341003 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:10:30.341010    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/983a5562-255c-4180-ae5f-c16718e00294-home\") pod \"983a5562-255c-4180-ae5f-c16718e00294\" (UID: \"983a5562-255c-4180-ae5f-c16718e00294\") "
Jul 07 18:10:30.341227 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:10:30.341118    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/983a5562-255c-4180-ae5f-c16718e00294-tls-certs\") pod \"983a5562-255c-4180-ae5f-c16718e00294\" (UID: \"983a5562-255c-4180-ae5f-c16718e00294\") "
Jul 07 18:10:30.341227 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:10:30.341163    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/983a5562-255c-4180-ae5f-c16718e00294-model-cache\") pod \"983a5562-255c-4180-ae5f-c16718e00294\" (UID: \"983a5562-255c-4180-ae5f-c16718e00294\") "
Jul 07 18:10:30.341321 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:10:30.341288    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/983a5562-255c-4180-ae5f-c16718e00294-home" (OuterVolumeSpecName: "home") pod "983a5562-255c-4180-ae5f-c16718e00294" (UID: "983a5562-255c-4180-ae5f-c16718e00294"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 18:10:30.341378 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:10:30.341316    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kzdrr\" (UniqueName: \"kubernetes.io/projected/983a5562-255c-4180-ae5f-c16718e00294-kube-api-access-kzdrr\") pod \"983a5562-255c-4180-ae5f-c16718e00294\" (UID: \"983a5562-255c-4180-ae5f-c16718e00294\") "
Jul 07 18:10:30.341378 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:10:30.341367    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/983a5562-255c-4180-ae5f-c16718e00294-tmp-dir\") pod \"983a5562-255c-4180-ae5f-c16718e00294\" (UID: \"983a5562-255c-4180-ae5f-c16718e00294\") "
Jul 07 18:10:30.341520 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:10:30.341381    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/983a5562-255c-4180-ae5f-c16718e00294-model-cache" (OuterVolumeSpecName: "model-cache") pod "983a5562-255c-4180-ae5f-c16718e00294" (UID: "983a5562-255c-4180-ae5f-c16718e00294"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 18:10:30.341694 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:10:30.341661    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/983a5562-255c-4180-ae5f-c16718e00294-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "983a5562-255c-4180-ae5f-c16718e00294" (UID: "983a5562-255c-4180-ae5f-c16718e00294"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 18:10:30.341749 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:10:30.341686    2561 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/983a5562-255c-4180-ae5f-c16718e00294-model-cache\") on node \"ip-10-0-139-31.ec2.internal\" DevicePath \"\""
Jul 07 18:10:30.341749 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:10:30.341722    2561 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/983a5562-255c-4180-ae5f-c16718e00294-home\") on node \"ip-10-0-139-31.ec2.internal\" DevicePath \"\""
Jul 07 18:10:30.343293 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:10:30.343270    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/983a5562-255c-4180-ae5f-c16718e00294-dshm" (OuterVolumeSpecName: "dshm") pod "983a5562-255c-4180-ae5f-c16718e00294" (UID: "983a5562-255c-4180-ae5f-c16718e00294"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 18:10:30.343408 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:10:30.343297    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/983a5562-255c-4180-ae5f-c16718e00294-kube-api-access-kzdrr" (OuterVolumeSpecName: "kube-api-access-kzdrr") pod "983a5562-255c-4180-ae5f-c16718e00294" (UID: "983a5562-255c-4180-ae5f-c16718e00294"). InnerVolumeSpecName "kube-api-access-kzdrr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 18:10:30.343408 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:10:30.343356    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/983a5562-255c-4180-ae5f-c16718e00294-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "983a5562-255c-4180-ae5f-c16718e00294" (UID: "983a5562-255c-4180-ae5f-c16718e00294"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 18:10:30.443081 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:10:30.443043    2561 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/983a5562-255c-4180-ae5f-c16718e00294-tls-certs\") on node \"ip-10-0-139-31.ec2.internal\" DevicePath \"\""
Jul 07 18:10:30.443081 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:10:30.443074    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kzdrr\" (UniqueName: \"kubernetes.io/projected/983a5562-255c-4180-ae5f-c16718e00294-kube-api-access-kzdrr\") on node \"ip-10-0-139-31.ec2.internal\" DevicePath \"\""
Jul 07 18:10:30.443081 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:10:30.443084    2561 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/983a5562-255c-4180-ae5f-c16718e00294-tmp-dir\") on node \"ip-10-0-139-31.ec2.internal\" DevicePath \"\""
Jul 07 18:10:30.443081 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:10:30.443092    2561 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/983a5562-255c-4180-ae5f-c16718e00294-dshm\") on node \"ip-10-0-139-31.ec2.internal\" DevicePath \"\""
Jul 07 18:10:31.076585 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:10:31.076549    2561 generic.go:356] "Generic (PLEG): container finished" podID="983a5562-255c-4180-ae5f-c16718e00294" containerID="9d84b548a8fe0c87da65c0d7d54d5d0d5e7686dff7e517227707d492419049d0" exitCode=0
Jul 07 18:10:31.076585 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:10:31.076590    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-882c1dd4/e2e-lifecycle-model-882c1dd4-kserve-68b46cb687-bjz59"
Jul 07 18:10:31.077141 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:10:31.076636    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-882c1dd4/e2e-lifecycle-model-882c1dd4-kserve-68b46cb687-bjz59" event={"ID":"983a5562-255c-4180-ae5f-c16718e00294","Type":"ContainerDied","Data":"9d84b548a8fe0c87da65c0d7d54d5d0d5e7686dff7e517227707d492419049d0"}
Jul 07 18:10:31.077141 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:10:31.076685    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-882c1dd4/e2e-lifecycle-model-882c1dd4-kserve-68b46cb687-bjz59" event={"ID":"983a5562-255c-4180-ae5f-c16718e00294","Type":"ContainerDied","Data":"6dc797c28239e3ba8c97064f59508ca4fbe3bb6810516333757b5f77e0be09dc"}
Jul 07 18:10:31.077141 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:10:31.076713    2561 scope.go:117] "RemoveContainer" containerID="9d84b548a8fe0c87da65c0d7d54d5d0d5e7686dff7e517227707d492419049d0"
Jul 07 18:10:31.086002 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:10:31.085985    2561 scope.go:117] "RemoveContainer" containerID="9d84b548a8fe0c87da65c0d7d54d5d0d5e7686dff7e517227707d492419049d0"
Jul 07 18:10:31.086287 ip-10-0-139-31 kubenswrapper[2561]: E0707 18:10:31.086265    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9d84b548a8fe0c87da65c0d7d54d5d0d5e7686dff7e517227707d492419049d0\": container with ID starting with 9d84b548a8fe0c87da65c0d7d54d5d0d5e7686dff7e517227707d492419049d0 not found: ID does not exist" containerID="9d84b548a8fe0c87da65c0d7d54d5d0d5e7686dff7e517227707d492419049d0"
Jul 07 18:10:31.086358 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:10:31.086294    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9d84b548a8fe0c87da65c0d7d54d5d0d5e7686dff7e517227707d492419049d0"} err="failed to get container status \"9d84b548a8fe0c87da65c0d7d54d5d0d5e7686dff7e517227707d492419049d0\": rpc error: code = NotFound desc = could not find container \"9d84b548a8fe0c87da65c0d7d54d5d0d5e7686dff7e517227707d492419049d0\": container with ID starting with 9d84b548a8fe0c87da65c0d7d54d5d0d5e7686dff7e517227707d492419049d0 not found: ID does not exist"
Jul 07 18:10:31.100565 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:10:31.100535    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-mt-882c1dd4/e2e-lifecycle-model-882c1dd4-kserve-68b46cb687-bjz59"]
Jul 07 18:10:31.106713 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:10:31.106689    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-mt-882c1dd4/e2e-lifecycle-model-882c1dd4-kserve-68b46cb687-bjz59"]
Jul 07 18:10:31.521395 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:10:31.521299    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="983a5562-255c-4180-ae5f-c16718e00294" path="/var/lib/kubelet/pods/983a5562-255c-4180-ae5f-c16718e00294/volumes"
Jul 07 18:11:22.296354 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:11:22.296316    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-882c1dd4-openshift-default-7b495fd96c-b7fg2"]
Jul 07 18:11:22.297021 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:11:22.296589    2561 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-882c1dd4-openshift-default-7b495fd96c-b7fg2" podUID="79e6065f-a560-4d11-a793-f699604675b8" containerName="istio-proxy" containerID="cri-o://f0b09eb6cbbdbfcac3dec10c8434b40da99619cb62996974c92b4b5db021ce7e" gracePeriod=30
Jul 07 18:11:27.552203 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:11:27.552175    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-882c1dd4-openshift-default-7b495fd96c-b7fg2"
Jul 07 18:11:27.667782 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:11:27.667690    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/79e6065f-a560-4d11-a793-f699604675b8-istio-token\") pod \"79e6065f-a560-4d11-a793-f699604675b8\" (UID: \"79e6065f-a560-4d11-a793-f699604675b8\") "
Jul 07 18:11:27.667782 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:11:27.667753    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/79e6065f-a560-4d11-a793-f699604675b8-workload-socket\") pod \"79e6065f-a560-4d11-a793-f699604675b8\" (UID: \"79e6065f-a560-4d11-a793-f699604675b8\") "
Jul 07 18:11:27.667782 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:11:27.667785    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/79e6065f-a560-4d11-a793-f699604675b8-credential-socket\") pod \"79e6065f-a560-4d11-a793-f699604675b8\" (UID: \"79e6065f-a560-4d11-a793-f699604675b8\") "
Jul 07 18:11:27.668055 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:11:27.667812    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2rxz7\" (UniqueName: \"kubernetes.io/projected/79e6065f-a560-4d11-a793-f699604675b8-kube-api-access-2rxz7\") pod \"79e6065f-a560-4d11-a793-f699604675b8\" (UID: \"79e6065f-a560-4d11-a793-f699604675b8\") "
Jul 07 18:11:27.668055 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:11:27.667830    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/79e6065f-a560-4d11-a793-f699604675b8-istio-envoy\") pod \"79e6065f-a560-4d11-a793-f699604675b8\" (UID: \"79e6065f-a560-4d11-a793-f699604675b8\") "
Jul 07 18:11:27.668055 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:11:27.667852    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/79e6065f-a560-4d11-a793-f699604675b8-workload-certs\") pod \"79e6065f-a560-4d11-a793-f699604675b8\" (UID: \"79e6065f-a560-4d11-a793-f699604675b8\") "
Jul 07 18:11:27.668055 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:11:27.667880    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/79e6065f-a560-4d11-a793-f699604675b8-istio-podinfo\") pod \"79e6065f-a560-4d11-a793-f699604675b8\" (UID: \"79e6065f-a560-4d11-a793-f699604675b8\") "
Jul 07 18:11:27.668055 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:11:27.667919    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/79e6065f-a560-4d11-a793-f699604675b8-istio-data\") pod \"79e6065f-a560-4d11-a793-f699604675b8\" (UID: \"79e6065f-a560-4d11-a793-f699604675b8\") "
Jul 07 18:11:27.668055 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:11:27.667940    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/79e6065f-a560-4d11-a793-f699604675b8-istiod-ca-cert\") pod \"79e6065f-a560-4d11-a793-f699604675b8\" (UID: \"79e6065f-a560-4d11-a793-f699604675b8\") "
Jul 07 18:11:27.668353 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:11:27.668084    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/79e6065f-a560-4d11-a793-f699604675b8-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "79e6065f-a560-4d11-a793-f699604675b8" (UID: "79e6065f-a560-4d11-a793-f699604675b8"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 18:11:27.668353 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:11:27.668177    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/79e6065f-a560-4d11-a793-f699604675b8-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "79e6065f-a560-4d11-a793-f699604675b8" (UID: "79e6065f-a560-4d11-a793-f699604675b8"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 18:11:27.668353 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:11:27.668204    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/79e6065f-a560-4d11-a793-f699604675b8-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "79e6065f-a560-4d11-a793-f699604675b8" (UID: "79e6065f-a560-4d11-a793-f699604675b8"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 18:11:27.668530 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:11:27.668359    2561 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/79e6065f-a560-4d11-a793-f699604675b8-workload-socket\") on node \"ip-10-0-139-31.ec2.internal\" DevicePath \"\""
Jul 07 18:11:27.668530 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:11:27.668379    2561 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/79e6065f-a560-4d11-a793-f699604675b8-credential-socket\") on node \"ip-10-0-139-31.ec2.internal\" DevicePath \"\""
Jul 07 18:11:27.668530 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:11:27.668395    2561 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/79e6065f-a560-4d11-a793-f699604675b8-workload-certs\") on node \"ip-10-0-139-31.ec2.internal\" DevicePath \"\""
Jul 07 18:11:27.668530 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:11:27.668422    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/79e6065f-a560-4d11-a793-f699604675b8-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "79e6065f-a560-4d11-a793-f699604675b8" (UID: "79e6065f-a560-4d11-a793-f699604675b8"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 18:11:27.669189 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:11:27.669164    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/79e6065f-a560-4d11-a793-f699604675b8-istio-data" (OuterVolumeSpecName: "istio-data") pod "79e6065f-a560-4d11-a793-f699604675b8" (UID: "79e6065f-a560-4d11-a793-f699604675b8"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 18:11:27.670102 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:11:27.670067    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/79e6065f-a560-4d11-a793-f699604675b8-istio-token" (OuterVolumeSpecName: "istio-token") pod "79e6065f-a560-4d11-a793-f699604675b8" (UID: "79e6065f-a560-4d11-a793-f699604675b8"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 18:11:27.670214 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:11:27.670105    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/79e6065f-a560-4d11-a793-f699604675b8-kube-api-access-2rxz7" (OuterVolumeSpecName: "kube-api-access-2rxz7") pod "79e6065f-a560-4d11-a793-f699604675b8" (UID: "79e6065f-a560-4d11-a793-f699604675b8"). InnerVolumeSpecName "kube-api-access-2rxz7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 18:11:27.670541 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:11:27.670521    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/79e6065f-a560-4d11-a793-f699604675b8-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "79e6065f-a560-4d11-a793-f699604675b8" (UID: "79e6065f-a560-4d11-a793-f699604675b8"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 18:11:27.670590 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:11:27.670542    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/79e6065f-a560-4d11-a793-f699604675b8-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "79e6065f-a560-4d11-a793-f699604675b8" (UID: "79e6065f-a560-4d11-a793-f699604675b8"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 07 18:11:27.769905 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:11:27.769866    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2rxz7\" (UniqueName: \"kubernetes.io/projected/79e6065f-a560-4d11-a793-f699604675b8-kube-api-access-2rxz7\") on node \"ip-10-0-139-31.ec2.internal\" DevicePath \"\""
Jul 07 18:11:27.769905 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:11:27.769899    2561 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/79e6065f-a560-4d11-a793-f699604675b8-istio-envoy\") on node \"ip-10-0-139-31.ec2.internal\" DevicePath \"\""
Jul 07 18:11:27.769905 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:11:27.769908    2561 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/79e6065f-a560-4d11-a793-f699604675b8-istio-podinfo\") on node \"ip-10-0-139-31.ec2.internal\" DevicePath \"\""
Jul 07 18:11:27.769905 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:11:27.769916    2561 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/79e6065f-a560-4d11-a793-f699604675b8-istio-data\") on node \"ip-10-0-139-31.ec2.internal\" DevicePath \"\""
Jul 07 18:11:27.770173 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:11:27.769923    2561 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/79e6065f-a560-4d11-a793-f699604675b8-istiod-ca-cert\") on node \"ip-10-0-139-31.ec2.internal\" DevicePath \"\""
Jul 07 18:11:27.770173 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:11:27.769931    2561 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/79e6065f-a560-4d11-a793-f699604675b8-istio-token\") on node \"ip-10-0-139-31.ec2.internal\" DevicePath \"\""
Jul 07 18:11:28.342700 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:11:28.342664    2561 generic.go:356] "Generic (PLEG): container finished" podID="79e6065f-a560-4d11-a793-f699604675b8" containerID="f0b09eb6cbbdbfcac3dec10c8434b40da99619cb62996974c92b4b5db021ce7e" exitCode=0
Jul 07 18:11:28.342877 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:11:28.342712    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-882c1dd4-openshift-default-7b495fd96c-b7fg2"
Jul 07 18:11:28.342877 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:11:28.342761    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-882c1dd4-openshift-default-7b495fd96c-b7fg2" event={"ID":"79e6065f-a560-4d11-a793-f699604675b8","Type":"ContainerDied","Data":"f0b09eb6cbbdbfcac3dec10c8434b40da99619cb62996974c92b4b5db021ce7e"}
Jul 07 18:11:28.342877 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:11:28.342811    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-882c1dd4-openshift-default-7b495fd96c-b7fg2" event={"ID":"79e6065f-a560-4d11-a793-f699604675b8","Type":"ContainerDied","Data":"56b97c2eca76c84044ccde0a0d3c8f3c387766662c05fcf81c23f7a239df32b1"}
Jul 07 18:11:28.342877 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:11:28.342836    2561 scope.go:117] "RemoveContainer" containerID="f0b09eb6cbbdbfcac3dec10c8434b40da99619cb62996974c92b4b5db021ce7e"
Jul 07 18:11:28.352011 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:11:28.351991    2561 scope.go:117] "RemoveContainer" containerID="315b54d2a0598733604fbfc8cec2b0ef439d5c597b3581201f7254c1671db9d2"
Jul 07 18:11:28.360426 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:11:28.360403    2561 scope.go:117] "RemoveContainer" containerID="f0b09eb6cbbdbfcac3dec10c8434b40da99619cb62996974c92b4b5db021ce7e"
Jul 07 18:11:28.360737 ip-10-0-139-31 kubenswrapper[2561]: E0707 18:11:28.360718    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f0b09eb6cbbdbfcac3dec10c8434b40da99619cb62996974c92b4b5db021ce7e\": container with ID starting with f0b09eb6cbbdbfcac3dec10c8434b40da99619cb62996974c92b4b5db021ce7e not found: ID does not exist" containerID="f0b09eb6cbbdbfcac3dec10c8434b40da99619cb62996974c92b4b5db021ce7e"
Jul 07 18:11:28.360783 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:11:28.360749    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f0b09eb6cbbdbfcac3dec10c8434b40da99619cb62996974c92b4b5db021ce7e"} err="failed to get container status \"f0b09eb6cbbdbfcac3dec10c8434b40da99619cb62996974c92b4b5db021ce7e\": rpc error: code = NotFound desc = could not find container \"f0b09eb6cbbdbfcac3dec10c8434b40da99619cb62996974c92b4b5db021ce7e\": container with ID starting with f0b09eb6cbbdbfcac3dec10c8434b40da99619cb62996974c92b4b5db021ce7e not found: ID does not exist"
Jul 07 18:11:28.360783 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:11:28.360768    2561 scope.go:117] "RemoveContainer" containerID="315b54d2a0598733604fbfc8cec2b0ef439d5c597b3581201f7254c1671db9d2"
Jul 07 18:11:28.361013 ip-10-0-139-31 kubenswrapper[2561]: E0707 18:11:28.360995    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"315b54d2a0598733604fbfc8cec2b0ef439d5c597b3581201f7254c1671db9d2\": container with ID starting with 315b54d2a0598733604fbfc8cec2b0ef439d5c597b3581201f7254c1671db9d2 not found: ID does not exist" containerID="315b54d2a0598733604fbfc8cec2b0ef439d5c597b3581201f7254c1671db9d2"
Jul 07 18:11:28.361053 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:11:28.361019    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"315b54d2a0598733604fbfc8cec2b0ef439d5c597b3581201f7254c1671db9d2"} err="failed to get container status \"315b54d2a0598733604fbfc8cec2b0ef439d5c597b3581201f7254c1671db9d2\": rpc error: code = NotFound desc = could not find container \"315b54d2a0598733604fbfc8cec2b0ef439d5c597b3581201f7254c1671db9d2\": container with ID starting with 315b54d2a0598733604fbfc8cec2b0ef439d5c597b3581201f7254c1671db9d2 not found: ID does not exist"
Jul 07 18:11:28.369552 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:11:28.369525    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-882c1dd4-openshift-default-7b495fd96c-b7fg2"]
Jul 07 18:11:28.374016 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:11:28.373991    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-882c1dd4-openshift-default-7b495fd96c-b7fg2"]
Jul 07 18:11:29.526783 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:11:29.526748    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="79e6065f-a560-4d11-a793-f699604675b8" path="/var/lib/kubelet/pods/79e6065f-a560-4d11-a793-f699604675b8/volumes"
Jul 07 18:12:18.069844 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:12:18.069809    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-a-fffc51-openshift-default-6844fbbff-v9m47"]
Jul 07 18:12:18.070296 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:12:18.070155    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="79e6065f-a560-4d11-a793-f699604675b8" containerName="istio-proxy"
Jul 07 18:12:18.070296 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:12:18.070168    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="79e6065f-a560-4d11-a793-f699604675b8" containerName="istio-proxy"
Jul 07 18:12:18.070296 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:12:18.070176    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="983a5562-255c-4180-ae5f-c16718e00294" containerName="main"
Jul 07 18:12:18.070296 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:12:18.070182    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="983a5562-255c-4180-ae5f-c16718e00294" containerName="main"
Jul 07 18:12:18.070296 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:12:18.070266    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="79e6065f-a560-4d11-a793-f699604675b8" containerName="istio-proxy"
Jul 07 18:12:18.070296 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:12:18.070276    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="79e6065f-a560-4d11-a793-f699604675b8" containerName="istio-proxy"
Jul 07 18:12:18.070296 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:12:18.070285    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="983a5562-255c-4180-ae5f-c16718e00294" containerName="main"
Jul 07 18:12:18.073324 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:12:18.073308    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-fffc51-openshift-default-6844fbbff-v9m47"
Jul 07 18:12:18.077317 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:12:18.077295    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Jul 07 18:12:18.080536 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:12:18.080515    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-a-fffc51-openshift-default-dockercfg-2xclt\""
Jul 07 18:12:18.101854 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:12:18.101819    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-fffc51-openshift-default-6844fbbff-v9m47"]
Jul 07 18:12:18.254179 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:12:18.254140    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cjsrf\" (UniqueName: \"kubernetes.io/projected/e067b326-842e-477e-af74-9023652530e6-kube-api-access-cjsrf\") pod \"e2e-inf-a-fffc51-openshift-default-6844fbbff-v9m47\" (UID: \"e067b326-842e-477e-af74-9023652530e6\") " pod="openshift-ingress/e2e-inf-a-fffc51-openshift-default-6844fbbff-v9m47"
Jul 07 18:12:18.254376 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:12:18.254185    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e067b326-842e-477e-af74-9023652530e6-istio-podinfo\") pod \"e2e-inf-a-fffc51-openshift-default-6844fbbff-v9m47\" (UID: \"e067b326-842e-477e-af74-9023652530e6\") " pod="openshift-ingress/e2e-inf-a-fffc51-openshift-default-6844fbbff-v9m47"
Jul 07 18:12:18.254376 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:12:18.254243    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e067b326-842e-477e-af74-9023652530e6-istio-envoy\") pod \"e2e-inf-a-fffc51-openshift-default-6844fbbff-v9m47\" (UID: \"e067b326-842e-477e-af74-9023652530e6\") " pod="openshift-ingress/e2e-inf-a-fffc51-openshift-default-6844fbbff-v9m47"
Jul 07 18:12:18.254376 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:12:18.254276    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e067b326-842e-477e-af74-9023652530e6-istiod-ca-cert\") pod \"e2e-inf-a-fffc51-openshift-default-6844fbbff-v9m47\" (UID: \"e067b326-842e-477e-af74-9023652530e6\") " pod="openshift-ingress/e2e-inf-a-fffc51-openshift-default-6844fbbff-v9m47"
Jul 07 18:12:18.254376 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:12:18.254305    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e067b326-842e-477e-af74-9023652530e6-credential-socket\") pod \"e2e-inf-a-fffc51-openshift-default-6844fbbff-v9m47\" (UID: \"e067b326-842e-477e-af74-9023652530e6\") " pod="openshift-ingress/e2e-inf-a-fffc51-openshift-default-6844fbbff-v9m47"
Jul 07 18:12:18.254376 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:12:18.254320    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e067b326-842e-477e-af74-9023652530e6-istio-data\") pod \"e2e-inf-a-fffc51-openshift-default-6844fbbff-v9m47\" (UID: \"e067b326-842e-477e-af74-9023652530e6\") " pod="openshift-ingress/e2e-inf-a-fffc51-openshift-default-6844fbbff-v9m47"
Jul 07 18:12:18.254376 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:12:18.254338    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e067b326-842e-477e-af74-9023652530e6-istio-token\") pod \"e2e-inf-a-fffc51-openshift-default-6844fbbff-v9m47\" (UID: \"e067b326-842e-477e-af74-9023652530e6\") " pod="openshift-ingress/e2e-inf-a-fffc51-openshift-default-6844fbbff-v9m47"
Jul 07 18:12:18.254644 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:12:18.254434    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e067b326-842e-477e-af74-9023652530e6-workload-certs\") pod \"e2e-inf-a-fffc51-openshift-default-6844fbbff-v9m47\" (UID: \"e067b326-842e-477e-af74-9023652530e6\") " pod="openshift-ingress/e2e-inf-a-fffc51-openshift-default-6844fbbff-v9m47"
Jul 07 18:12:18.254644 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:12:18.254493    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e067b326-842e-477e-af74-9023652530e6-workload-socket\") pod \"e2e-inf-a-fffc51-openshift-default-6844fbbff-v9m47\" (UID: \"e067b326-842e-477e-af74-9023652530e6\") " pod="openshift-ingress/e2e-inf-a-fffc51-openshift-default-6844fbbff-v9m47"
Jul 07 18:12:18.355678 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:12:18.355579    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e067b326-842e-477e-af74-9023652530e6-credential-socket\") pod \"e2e-inf-a-fffc51-openshift-default-6844fbbff-v9m47\" (UID: \"e067b326-842e-477e-af74-9023652530e6\") " pod="openshift-ingress/e2e-inf-a-fffc51-openshift-default-6844fbbff-v9m47"
Jul 07 18:12:18.355678 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:12:18.355617    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e067b326-842e-477e-af74-9023652530e6-istio-data\") pod \"e2e-inf-a-fffc51-openshift-default-6844fbbff-v9m47\" (UID: \"e067b326-842e-477e-af74-9023652530e6\") " pod="openshift-ingress/e2e-inf-a-fffc51-openshift-default-6844fbbff-v9m47"
Jul 07 18:12:18.355678 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:12:18.355638    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e067b326-842e-477e-af74-9023652530e6-istio-token\") pod \"e2e-inf-a-fffc51-openshift-default-6844fbbff-v9m47\" (UID: \"e067b326-842e-477e-af74-9023652530e6\") " pod="openshift-ingress/e2e-inf-a-fffc51-openshift-default-6844fbbff-v9m47"
Jul 07 18:12:18.355678 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:12:18.355685    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e067b326-842e-477e-af74-9023652530e6-workload-certs\") pod \"e2e-inf-a-fffc51-openshift-default-6844fbbff-v9m47\" (UID: \"e067b326-842e-477e-af74-9023652530e6\") " pod="openshift-ingress/e2e-inf-a-fffc51-openshift-default-6844fbbff-v9m47"
Jul 07 18:12:18.356028 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:12:18.355704    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e067b326-842e-477e-af74-9023652530e6-workload-socket\") pod \"e2e-inf-a-fffc51-openshift-default-6844fbbff-v9m47\" (UID: \"e067b326-842e-477e-af74-9023652530e6\") " pod="openshift-ingress/e2e-inf-a-fffc51-openshift-default-6844fbbff-v9m47"
Jul 07 18:12:18.356028 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:12:18.355740    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cjsrf\" (UniqueName: \"kubernetes.io/projected/e067b326-842e-477e-af74-9023652530e6-kube-api-access-cjsrf\") pod \"e2e-inf-a-fffc51-openshift-default-6844fbbff-v9m47\" (UID: \"e067b326-842e-477e-af74-9023652530e6\") " pod="openshift-ingress/e2e-inf-a-fffc51-openshift-default-6844fbbff-v9m47"
Jul 07 18:12:18.356028 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:12:18.355758    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e067b326-842e-477e-af74-9023652530e6-istio-podinfo\") pod \"e2e-inf-a-fffc51-openshift-default-6844fbbff-v9m47\" (UID: \"e067b326-842e-477e-af74-9023652530e6\") " pod="openshift-ingress/e2e-inf-a-fffc51-openshift-default-6844fbbff-v9m47"
Jul 07 18:12:18.356028 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:12:18.355801    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e067b326-842e-477e-af74-9023652530e6-istio-envoy\") pod \"e2e-inf-a-fffc51-openshift-default-6844fbbff-v9m47\" (UID: \"e067b326-842e-477e-af74-9023652530e6\") " pod="openshift-ingress/e2e-inf-a-fffc51-openshift-default-6844fbbff-v9m47"
Jul 07 18:12:18.356028 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:12:18.355841    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e067b326-842e-477e-af74-9023652530e6-istiod-ca-cert\") pod \"e2e-inf-a-fffc51-openshift-default-6844fbbff-v9m47\" (UID: \"e067b326-842e-477e-af74-9023652530e6\") " pod="openshift-ingress/e2e-inf-a-fffc51-openshift-default-6844fbbff-v9m47"
Jul 07 18:12:18.356257 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:12:18.356056    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e067b326-842e-477e-af74-9023652530e6-istio-data\") pod \"e2e-inf-a-fffc51-openshift-default-6844fbbff-v9m47\" (UID: \"e067b326-842e-477e-af74-9023652530e6\") " pod="openshift-ingress/e2e-inf-a-fffc51-openshift-default-6844fbbff-v9m47"
Jul 07 18:12:18.356257 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:12:18.356074    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e067b326-842e-477e-af74-9023652530e6-credential-socket\") pod \"e2e-inf-a-fffc51-openshift-default-6844fbbff-v9m47\" (UID: \"e067b326-842e-477e-af74-9023652530e6\") " pod="openshift-ingress/e2e-inf-a-fffc51-openshift-default-6844fbbff-v9m47"
Jul 07 18:12:18.356257 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:12:18.356152    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e067b326-842e-477e-af74-9023652530e6-workload-certs\") pod \"e2e-inf-a-fffc51-openshift-default-6844fbbff-v9m47\" (UID: \"e067b326-842e-477e-af74-9023652530e6\") " pod="openshift-ingress/e2e-inf-a-fffc51-openshift-default-6844fbbff-v9m47"
Jul 07 18:12:18.356415 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:12:18.356356    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e067b326-842e-477e-af74-9023652530e6-workload-socket\") pod \"e2e-inf-a-fffc51-openshift-default-6844fbbff-v9m47\" (UID: \"e067b326-842e-477e-af74-9023652530e6\") " pod="openshift-ingress/e2e-inf-a-fffc51-openshift-default-6844fbbff-v9m47"
Jul 07 18:12:18.356585 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:12:18.356567    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e067b326-842e-477e-af74-9023652530e6-istiod-ca-cert\") pod \"e2e-inf-a-fffc51-openshift-default-6844fbbff-v9m47\" (UID: \"e067b326-842e-477e-af74-9023652530e6\") " pod="openshift-ingress/e2e-inf-a-fffc51-openshift-default-6844fbbff-v9m47"
Jul 07 18:12:18.358073 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:12:18.358048    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e067b326-842e-477e-af74-9023652530e6-istio-envoy\") pod \"e2e-inf-a-fffc51-openshift-default-6844fbbff-v9m47\" (UID: \"e067b326-842e-477e-af74-9023652530e6\") " pod="openshift-ingress/e2e-inf-a-fffc51-openshift-default-6844fbbff-v9m47"
Jul 07 18:12:18.358235 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:12:18.358220    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e067b326-842e-477e-af74-9023652530e6-istio-podinfo\") pod \"e2e-inf-a-fffc51-openshift-default-6844fbbff-v9m47\" (UID: \"e067b326-842e-477e-af74-9023652530e6\") " pod="openshift-ingress/e2e-inf-a-fffc51-openshift-default-6844fbbff-v9m47"
Jul 07 18:12:18.367380 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:12:18.367356    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e067b326-842e-477e-af74-9023652530e6-istio-token\") pod \"e2e-inf-a-fffc51-openshift-default-6844fbbff-v9m47\" (UID: \"e067b326-842e-477e-af74-9023652530e6\") " pod="openshift-ingress/e2e-inf-a-fffc51-openshift-default-6844fbbff-v9m47"
Jul 07 18:12:18.368639 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:12:18.368622    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cjsrf\" (UniqueName: \"kubernetes.io/projected/e067b326-842e-477e-af74-9023652530e6-kube-api-access-cjsrf\") pod \"e2e-inf-a-fffc51-openshift-default-6844fbbff-v9m47\" (UID: \"e067b326-842e-477e-af74-9023652530e6\") " pod="openshift-ingress/e2e-inf-a-fffc51-openshift-default-6844fbbff-v9m47"
Jul 07 18:12:18.383672 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:12:18.383652    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-fffc51-openshift-default-6844fbbff-v9m47"
Jul 07 18:12:18.530616 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:12:18.530529    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-fffc51-openshift-default-6844fbbff-v9m47"]
Jul 07 18:12:18.533388 ip-10-0-139-31 kubenswrapper[2561]: W0707 18:12:18.533363    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode067b326_842e_477e_af74_9023652530e6.slice/crio-22ef9d3a45b246d278d07103d20a7774837252da1f097af338ab329676dc83b1 WatchSource:0}: Error finding container 22ef9d3a45b246d278d07103d20a7774837252da1f097af338ab329676dc83b1: Status 404 returned error can't find the container with id 22ef9d3a45b246d278d07103d20a7774837252da1f097af338ab329676dc83b1
Jul 07 18:12:18.535498 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:12:18.535469    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 07 18:12:18.535576 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:12:18.535533    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 07 18:12:18.535576 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:12:18.535559    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 07 18:12:18.578238 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:12:18.578211    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-fffc51-openshift-default-6844fbbff-v9m47" event={"ID":"e067b326-842e-477e-af74-9023652530e6","Type":"ContainerStarted","Data":"22ef9d3a45b246d278d07103d20a7774837252da1f097af338ab329676dc83b1"}
Jul 07 18:12:19.584437 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:12:19.584401    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-fffc51-openshift-default-6844fbbff-v9m47" event={"ID":"e067b326-842e-477e-af74-9023652530e6","Type":"ContainerStarted","Data":"2d35cdb9d9b30c960c773f8d40305d9733b888e058b0eb32cae3b3e3a26eae56"}
Jul 07 18:12:19.607624 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:12:19.607576    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-a-fffc51-openshift-default-6844fbbff-v9m47" podStartSLOduration=1.607559945 podStartE2EDuration="1.607559945s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 18:12:18 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 18:12:19.605278807 +0000 UTC m=+1930.756403220" watchObservedRunningTime="2026-07-07 18:12:19.607559945 +0000 UTC m=+1930.758684342"
Jul 07 18:12:20.384885 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:12:20.384837    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-fffc51-openshift-default-6844fbbff-v9m47"
Jul 07 18:12:20.389917 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:12:20.389892    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-fffc51-openshift-default-6844fbbff-v9m47"
Jul 07 18:12:20.589769 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:12:20.589737    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-fffc51-openshift-default-6844fbbff-v9m47"
Jul 07 18:12:20.590850 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:12:20.590827    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-fffc51-openshift-default-6844fbbff-v9m47"
Jul 07 18:12:26.666150 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:12:26.666112    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-b-54d21f-openshift-default-5b945dc747-wkztr"]
Jul 07 18:12:26.666700 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:12:26.666679    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="79e6065f-a560-4d11-a793-f699604675b8" containerName="istio-proxy"
Jul 07 18:12:26.666778 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:12:26.666702    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="79e6065f-a560-4d11-a793-f699604675b8" containerName="istio-proxy"
Jul 07 18:12:26.670159 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:12:26.670136    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-54d21f-openshift-default-5b945dc747-wkztr"
Jul 07 18:12:26.672745 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:12:26.672723    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-b-54d21f-openshift-default-dockercfg-wvm89\""
Jul 07 18:12:26.681233 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:12:26.681212    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-54d21f-openshift-default-5b945dc747-wkztr"]
Jul 07 18:12:26.728395 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:12:26.728357    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9e1ba924-b03e-4426-b5a4-754a4882c737-istio-data\") pod \"e2e-inf-b-54d21f-openshift-default-5b945dc747-wkztr\" (UID: \"9e1ba924-b03e-4426-b5a4-754a4882c737\") " pod="openshift-ingress/e2e-inf-b-54d21f-openshift-default-5b945dc747-wkztr"
Jul 07 18:12:26.728395 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:12:26.728399    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9e1ba924-b03e-4426-b5a4-754a4882c737-istiod-ca-cert\") pod \"e2e-inf-b-54d21f-openshift-default-5b945dc747-wkztr\" (UID: \"9e1ba924-b03e-4426-b5a4-754a4882c737\") " pod="openshift-ingress/e2e-inf-b-54d21f-openshift-default-5b945dc747-wkztr"
Jul 07 18:12:26.728647 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:12:26.728420    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-62756\" (UniqueName: \"kubernetes.io/projected/9e1ba924-b03e-4426-b5a4-754a4882c737-kube-api-access-62756\") pod \"e2e-inf-b-54d21f-openshift-default-5b945dc747-wkztr\" (UID: \"9e1ba924-b03e-4426-b5a4-754a4882c737\") " pod="openshift-ingress/e2e-inf-b-54d21f-openshift-default-5b945dc747-wkztr"
Jul 07 18:12:26.728647 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:12:26.728468    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9e1ba924-b03e-4426-b5a4-754a4882c737-istio-envoy\") pod \"e2e-inf-b-54d21f-openshift-default-5b945dc747-wkztr\" (UID: \"9e1ba924-b03e-4426-b5a4-754a4882c737\") " pod="openshift-ingress/e2e-inf-b-54d21f-openshift-default-5b945dc747-wkztr"
Jul 07 18:12:26.728647 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:12:26.728496    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9e1ba924-b03e-4426-b5a4-754a4882c737-istio-token\") pod \"e2e-inf-b-54d21f-openshift-default-5b945dc747-wkztr\" (UID: \"9e1ba924-b03e-4426-b5a4-754a4882c737\") " pod="openshift-ingress/e2e-inf-b-54d21f-openshift-default-5b945dc747-wkztr"
Jul 07 18:12:26.728647 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:12:26.728512    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9e1ba924-b03e-4426-b5a4-754a4882c737-workload-certs\") pod \"e2e-inf-b-54d21f-openshift-default-5b945dc747-wkztr\" (UID: \"9e1ba924-b03e-4426-b5a4-754a4882c737\") " pod="openshift-ingress/e2e-inf-b-54d21f-openshift-default-5b945dc747-wkztr"
Jul 07 18:12:26.728647 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:12:26.728550    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9e1ba924-b03e-4426-b5a4-754a4882c737-istio-podinfo\") pod \"e2e-inf-b-54d21f-openshift-default-5b945dc747-wkztr\" (UID: \"9e1ba924-b03e-4426-b5a4-754a4882c737\") " pod="openshift-ingress/e2e-inf-b-54d21f-openshift-default-5b945dc747-wkztr"
Jul 07 18:12:26.728647 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:12:26.728598    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9e1ba924-b03e-4426-b5a4-754a4882c737-workload-socket\") pod \"e2e-inf-b-54d21f-openshift-default-5b945dc747-wkztr\" (UID: \"9e1ba924-b03e-4426-b5a4-754a4882c737\") " pod="openshift-ingress/e2e-inf-b-54d21f-openshift-default-5b945dc747-wkztr"
Jul 07 18:12:26.728862 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:12:26.728706    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9e1ba924-b03e-4426-b5a4-754a4882c737-credential-socket\") pod \"e2e-inf-b-54d21f-openshift-default-5b945dc747-wkztr\" (UID: \"9e1ba924-b03e-4426-b5a4-754a4882c737\") " pod="openshift-ingress/e2e-inf-b-54d21f-openshift-default-5b945dc747-wkztr"
Jul 07 18:12:26.829981 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:12:26.829944    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9e1ba924-b03e-4426-b5a4-754a4882c737-workload-socket\") pod \"e2e-inf-b-54d21f-openshift-default-5b945dc747-wkztr\" (UID: \"9e1ba924-b03e-4426-b5a4-754a4882c737\") " pod="openshift-ingress/e2e-inf-b-54d21f-openshift-default-5b945dc747-wkztr"
Jul 07 18:12:26.830178 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:12:26.830006    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9e1ba924-b03e-4426-b5a4-754a4882c737-credential-socket\") pod \"e2e-inf-b-54d21f-openshift-default-5b945dc747-wkztr\" (UID: \"9e1ba924-b03e-4426-b5a4-754a4882c737\") " pod="openshift-ingress/e2e-inf-b-54d21f-openshift-default-5b945dc747-wkztr"
Jul 07 18:12:26.830178 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:12:26.830031    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9e1ba924-b03e-4426-b5a4-754a4882c737-istio-data\") pod \"e2e-inf-b-54d21f-openshift-default-5b945dc747-wkztr\" (UID: \"9e1ba924-b03e-4426-b5a4-754a4882c737\") " pod="openshift-ingress/e2e-inf-b-54d21f-openshift-default-5b945dc747-wkztr"
Jul 07 18:12:26.830178 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:12:26.830050    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9e1ba924-b03e-4426-b5a4-754a4882c737-istiod-ca-cert\") pod \"e2e-inf-b-54d21f-openshift-default-5b945dc747-wkztr\" (UID: \"9e1ba924-b03e-4426-b5a4-754a4882c737\") " pod="openshift-ingress/e2e-inf-b-54d21f-openshift-default-5b945dc747-wkztr"
Jul 07 18:12:26.830178 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:12:26.830066    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-62756\" (UniqueName: \"kubernetes.io/projected/9e1ba924-b03e-4426-b5a4-754a4882c737-kube-api-access-62756\") pod \"e2e-inf-b-54d21f-openshift-default-5b945dc747-wkztr\" (UID: \"9e1ba924-b03e-4426-b5a4-754a4882c737\") " pod="openshift-ingress/e2e-inf-b-54d21f-openshift-default-5b945dc747-wkztr"
Jul 07 18:12:26.830178 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:12:26.830082    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9e1ba924-b03e-4426-b5a4-754a4882c737-istio-envoy\") pod \"e2e-inf-b-54d21f-openshift-default-5b945dc747-wkztr\" (UID: \"9e1ba924-b03e-4426-b5a4-754a4882c737\") " pod="openshift-ingress/e2e-inf-b-54d21f-openshift-default-5b945dc747-wkztr"
Jul 07 18:12:26.830178 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:12:26.830111    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9e1ba924-b03e-4426-b5a4-754a4882c737-istio-token\") pod \"e2e-inf-b-54d21f-openshift-default-5b945dc747-wkztr\" (UID: \"9e1ba924-b03e-4426-b5a4-754a4882c737\") " pod="openshift-ingress/e2e-inf-b-54d21f-openshift-default-5b945dc747-wkztr"
Jul 07 18:12:26.830520 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:12:26.830221    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9e1ba924-b03e-4426-b5a4-754a4882c737-workload-certs\") pod \"e2e-inf-b-54d21f-openshift-default-5b945dc747-wkztr\" (UID: \"9e1ba924-b03e-4426-b5a4-754a4882c737\") " pod="openshift-ingress/e2e-inf-b-54d21f-openshift-default-5b945dc747-wkztr"
Jul 07 18:12:26.830520 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:12:26.830259    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9e1ba924-b03e-4426-b5a4-754a4882c737-istio-podinfo\") pod \"e2e-inf-b-54d21f-openshift-default-5b945dc747-wkztr\" (UID: \"9e1ba924-b03e-4426-b5a4-754a4882c737\") " pod="openshift-ingress/e2e-inf-b-54d21f-openshift-default-5b945dc747-wkztr"
Jul 07 18:12:26.830520 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:12:26.830410    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9e1ba924-b03e-4426-b5a4-754a4882c737-workload-socket\") pod \"e2e-inf-b-54d21f-openshift-default-5b945dc747-wkztr\" (UID: \"9e1ba924-b03e-4426-b5a4-754a4882c737\") " pod="openshift-ingress/e2e-inf-b-54d21f-openshift-default-5b945dc747-wkztr"
Jul 07 18:12:26.830520 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:12:26.830427    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9e1ba924-b03e-4426-b5a4-754a4882c737-istio-data\") pod \"e2e-inf-b-54d21f-openshift-default-5b945dc747-wkztr\" (UID: \"9e1ba924-b03e-4426-b5a4-754a4882c737\") " pod="openshift-ingress/e2e-inf-b-54d21f-openshift-default-5b945dc747-wkztr"
Jul 07 18:12:26.830520 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:12:26.830516    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9e1ba924-b03e-4426-b5a4-754a4882c737-credential-socket\") pod \"e2e-inf-b-54d21f-openshift-default-5b945dc747-wkztr\" (UID: \"9e1ba924-b03e-4426-b5a4-754a4882c737\") " pod="openshift-ingress/e2e-inf-b-54d21f-openshift-default-5b945dc747-wkztr"
Jul 07 18:12:26.830711 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:12:26.830672    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9e1ba924-b03e-4426-b5a4-754a4882c737-workload-certs\") pod \"e2e-inf-b-54d21f-openshift-default-5b945dc747-wkztr\" (UID: \"9e1ba924-b03e-4426-b5a4-754a4882c737\") " pod="openshift-ingress/e2e-inf-b-54d21f-openshift-default-5b945dc747-wkztr"
Jul 07 18:12:26.831008 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:12:26.830990    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9e1ba924-b03e-4426-b5a4-754a4882c737-istiod-ca-cert\") pod \"e2e-inf-b-54d21f-openshift-default-5b945dc747-wkztr\" (UID: \"9e1ba924-b03e-4426-b5a4-754a4882c737\") " pod="openshift-ingress/e2e-inf-b-54d21f-openshift-default-5b945dc747-wkztr"
Jul 07 18:12:26.832763 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:12:26.832737    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9e1ba924-b03e-4426-b5a4-754a4882c737-istio-envoy\") pod \"e2e-inf-b-54d21f-openshift-default-5b945dc747-wkztr\" (UID: \"9e1ba924-b03e-4426-b5a4-754a4882c737\") " pod="openshift-ingress/e2e-inf-b-54d21f-openshift-default-5b945dc747-wkztr"
Jul 07 18:12:26.832873 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:12:26.832784    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9e1ba924-b03e-4426-b5a4-754a4882c737-istio-podinfo\") pod \"e2e-inf-b-54d21f-openshift-default-5b945dc747-wkztr\" (UID: \"9e1ba924-b03e-4426-b5a4-754a4882c737\") " pod="openshift-ingress/e2e-inf-b-54d21f-openshift-default-5b945dc747-wkztr"
Jul 07 18:12:26.841639 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:12:26.841611    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9e1ba924-b03e-4426-b5a4-754a4882c737-istio-token\") pod \"e2e-inf-b-54d21f-openshift-default-5b945dc747-wkztr\" (UID: \"9e1ba924-b03e-4426-b5a4-754a4882c737\") " pod="openshift-ingress/e2e-inf-b-54d21f-openshift-default-5b945dc747-wkztr"
Jul 07 18:12:26.841916 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:12:26.841893    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-62756\" (UniqueName: \"kubernetes.io/projected/9e1ba924-b03e-4426-b5a4-754a4882c737-kube-api-access-62756\") pod \"e2e-inf-b-54d21f-openshift-default-5b945dc747-wkztr\" (UID: \"9e1ba924-b03e-4426-b5a4-754a4882c737\") " pod="openshift-ingress/e2e-inf-b-54d21f-openshift-default-5b945dc747-wkztr"
Jul 07 18:12:26.982462 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:12:26.982356    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-54d21f-openshift-default-5b945dc747-wkztr"
Jul 07 18:12:27.125882 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:12:27.125858    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-54d21f-openshift-default-5b945dc747-wkztr"]
Jul 07 18:12:27.127775 ip-10-0-139-31 kubenswrapper[2561]: W0707 18:12:27.127739    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9e1ba924_b03e_4426_b5a4_754a4882c737.slice/crio-67d302d0dbfe4f4683080f3268cb141faa9cec8bd8d8f7be721cb891622d9018 WatchSource:0}: Error finding container 67d302d0dbfe4f4683080f3268cb141faa9cec8bd8d8f7be721cb891622d9018: Status 404 returned error can't find the container with id 67d302d0dbfe4f4683080f3268cb141faa9cec8bd8d8f7be721cb891622d9018
Jul 07 18:12:27.129789 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:12:27.129762    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 07 18:12:27.129855 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:12:27.129845    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 07 18:12:27.129892 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:12:27.129874    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 07 18:12:27.624928 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:12:27.624893    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-54d21f-openshift-default-5b945dc747-wkztr" event={"ID":"9e1ba924-b03e-4426-b5a4-754a4882c737","Type":"ContainerStarted","Data":"f12582e425ad6469ccdd8a3671eaca04c1c41b23e92770d8d7103945d77bade0"}
Jul 07 18:12:27.625131 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:12:27.624961    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-54d21f-openshift-default-5b945dc747-wkztr" event={"ID":"9e1ba924-b03e-4426-b5a4-754a4882c737","Type":"ContainerStarted","Data":"67d302d0dbfe4f4683080f3268cb141faa9cec8bd8d8f7be721cb891622d9018"}
Jul 07 18:12:27.651045 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:12:27.650993    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-b-54d21f-openshift-default-5b945dc747-wkztr" podStartSLOduration=1.650976761 podStartE2EDuration="1.650976761s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 18:12:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 18:12:27.648546058 +0000 UTC m=+1938.799670458" watchObservedRunningTime="2026-07-07 18:12:27.650976761 +0000 UTC m=+1938.802101160"
Jul 07 18:12:27.983577 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:12:27.983386    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-54d21f-openshift-default-5b945dc747-wkztr"
Jul 07 18:12:29.001517 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:12:29.001476    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-54d21f-openshift-default-5b945dc747-wkztr"
Jul 07 18:12:29.634242 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:12:29.634215    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-54d21f-openshift-default-5b945dc747-wkztr"
Jul 07 18:12:29.635424 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:12:29.635400    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-54d21f-openshift-default-5b945dc747-wkztr"
Jul 07 18:12:35.371983 ip-10-0-139-31 kubenswrapper[2561]: E0707 18:12:35.371923    2561 cadvisor_stats_provider.go:567] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode067b326_842e_477e_af74_9023652530e6.slice/crio-2d35cdb9d9b30c960c773f8d40305d9733b888e058b0eb32cae3b3e3a26eae56.scope\": RecentStats: unable to find data in memory cache]"
Jul 07 18:12:35.592075 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:12:35.591973    2561 patch_prober.go:28] interesting pod/e2e-inf-a-fffc51-openshift-default-6844fbbff-v9m47 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.40:15021/healthz/ready\": dial tcp 10.132.0.40:15021: connect: connection refused" start-of-body=
Jul 07 18:12:35.592075 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:12:35.592045    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-a-fffc51-openshift-default-6844fbbff-v9m47" podUID="e067b326-842e-477e-af74-9023652530e6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.40:15021/healthz/ready\": dial tcp 10.132.0.40:15021: connect: connection refused"
Jul 07 18:12:35.663072 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:12:35.663039    2561 generic.go:356] "Generic (PLEG): container finished" podID="e067b326-842e-477e-af74-9023652530e6" containerID="2d35cdb9d9b30c960c773f8d40305d9733b888e058b0eb32cae3b3e3a26eae56" exitCode=0
Jul 07 18:12:35.663267 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:12:35.663118    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-fffc51-openshift-default-6844fbbff-v9m47" event={"ID":"e067b326-842e-477e-af74-9023652530e6","Type":"ContainerDied","Data":"2d35cdb9d9b30c960c773f8d40305d9733b888e058b0eb32cae3b3e3a26eae56"}
Jul 07 18:12:35.663540 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:12:35.663526    2561 scope.go:117] "RemoveContainer" containerID="2d35cdb9d9b30c960c773f8d40305d9733b888e058b0eb32cae3b3e3a26eae56"
Jul 07 18:12:35.664574 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:12:35.664547    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 07 18:12:35.664684 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:12:35.664643    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 07 18:12:35.664748 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:12:35.664695    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 07 18:12:36.669796 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:12:36.669765    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-fffc51-openshift-default-6844fbbff-v9m47" event={"ID":"e067b326-842e-477e-af74-9023652530e6","Type":"ContainerStarted","Data":"4cc19cf92b6f9a44a92f42c397f9700931ec49e455b98e801bd2483d1f727da0"}
Jul 07 18:12:37.384506 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:12:37.384386    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-fffc51-openshift-default-6844fbbff-v9m47"
Jul 07 18:12:37.384677 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:12:37.384514    2561 patch_prober.go:28] interesting pod/e2e-inf-a-fffc51-openshift-default-6844fbbff-v9m47 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.40:15021/healthz/ready\": dial tcp 10.132.0.40:15021: connect: connection refused" start-of-body=
Jul 07 18:12:37.384677 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:12:37.384567    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-fffc51-openshift-default-6844fbbff-v9m47" podUID="e067b326-842e-477e-af74-9023652530e6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.40:15021/healthz/ready\": dial tcp 10.132.0.40:15021: connect: connection refused"
Jul 07 18:12:38.385076 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:12:38.384581    2561 patch_prober.go:28] interesting pod/e2e-inf-a-fffc51-openshift-default-6844fbbff-v9m47 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.40:15021/healthz/ready\": dial tcp 10.132.0.40:15021: connect: connection refused" start-of-body=
Jul 07 18:12:38.385076 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:12:38.384648    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-fffc51-openshift-default-6844fbbff-v9m47" podUID="e067b326-842e-477e-af74-9023652530e6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.40:15021/healthz/ready\": dial tcp 10.132.0.40:15021: connect: connection refused"
Jul 07 18:12:39.384987 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:12:39.384945    2561 patch_prober.go:28] interesting pod/e2e-inf-a-fffc51-openshift-default-6844fbbff-v9m47 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.40:15021/healthz/ready\": dial tcp 10.132.0.40:15021: connect: connection refused" start-of-body=
Jul 07 18:12:39.385310 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:12:39.385278    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-fffc51-openshift-default-6844fbbff-v9m47" podUID="e067b326-842e-477e-af74-9023652530e6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.40:15021/healthz/ready\": dial tcp 10.132.0.40:15021: connect: connection refused"
Jul 07 18:12:40.384811 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:12:40.384271    2561 patch_prober.go:28] interesting pod/e2e-inf-a-fffc51-openshift-default-6844fbbff-v9m47 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.40:15021/healthz/ready\": dial tcp 10.132.0.40:15021: connect: connection refused" start-of-body=
Jul 07 18:12:40.384811 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:12:40.384338    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-fffc51-openshift-default-6844fbbff-v9m47" podUID="e067b326-842e-477e-af74-9023652530e6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.40:15021/healthz/ready\": dial tcp 10.132.0.40:15021: connect: connection refused"
Jul 07 18:12:41.388712 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:12:41.388681    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-fffc51-openshift-default-6844fbbff-v9m47"
Jul 07 18:12:41.389137 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:12:41.388951    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-fffc51-openshift-default-6844fbbff-v9m47"
Jul 07 18:12:41.389852 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:12:41.389831    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-fffc51-openshift-default-6844fbbff-v9m47"
Jul 07 18:12:41.702430 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:12:41.702338    2561 generic.go:356] "Generic (PLEG): container finished" podID="9e1ba924-b03e-4426-b5a4-754a4882c737" containerID="f12582e425ad6469ccdd8a3671eaca04c1c41b23e92770d8d7103945d77bade0" exitCode=0
Jul 07 18:12:41.702430 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:12:41.702413    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-54d21f-openshift-default-5b945dc747-wkztr" event={"ID":"9e1ba924-b03e-4426-b5a4-754a4882c737","Type":"ContainerDied","Data":"f12582e425ad6469ccdd8a3671eaca04c1c41b23e92770d8d7103945d77bade0"}
Jul 07 18:12:41.702931 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:12:41.702918    2561 scope.go:117] "RemoveContainer" containerID="f12582e425ad6469ccdd8a3671eaca04c1c41b23e92770d8d7103945d77bade0"
Jul 07 18:12:41.703920 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:12:41.703897    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 07 18:12:41.703973 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:12:41.703960    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 07 18:12:41.704009 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:12:41.703993    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 07 18:12:42.709921 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:12:42.709887    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-54d21f-openshift-default-5b945dc747-wkztr" event={"ID":"9e1ba924-b03e-4426-b5a4-754a4882c737","Type":"ContainerStarted","Data":"9cb0197953cd26fab20e6b821c1f84504c060106a5cb18f5efe2647586e850ae"}
Jul 07 18:12:42.983237 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:12:42.983132    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-54d21f-openshift-default-5b945dc747-wkztr"
Jul 07 18:12:42.984225 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:12:42.984190    2561 patch_prober.go:28] interesting pod/e2e-inf-b-54d21f-openshift-default-5b945dc747-wkztr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.41:15021/healthz/ready\": dial tcp 10.132.0.41:15021: connect: connection refused" start-of-body=
Jul 07 18:12:42.984343 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:12:42.984271    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-54d21f-openshift-default-5b945dc747-wkztr" podUID="9e1ba924-b03e-4426-b5a4-754a4882c737" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.41:15021/healthz/ready\": dial tcp 10.132.0.41:15021: connect: connection refused"
Jul 07 18:12:43.982944 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:12:43.982894    2561 patch_prober.go:28] interesting pod/e2e-inf-b-54d21f-openshift-default-5b945dc747-wkztr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.41:15021/healthz/ready\": dial tcp 10.132.0.41:15021: connect: connection refused" start-of-body=
Jul 07 18:12:43.983494 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:12:43.982980    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-54d21f-openshift-default-5b945dc747-wkztr" podUID="9e1ba924-b03e-4426-b5a4-754a4882c737" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.41:15021/healthz/ready\": dial tcp 10.132.0.41:15021: connect: connection refused"
Jul 07 18:12:44.029789 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:12:44.029746    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-a-fffc51/test-model-fffc51-kserve-657cfb867-nk9cx"]
Jul 07 18:12:44.033781 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:12:44.033753    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-fffc51/test-model-fffc51-kserve-657cfb867-nk9cx"
Jul 07 18:12:44.036904 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:12:44.036879    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-fffc51\"/\"kube-root-ca.crt\""
Jul 07 18:12:44.038162 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:12:44.038142    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-fffc51\"/\"default-dockercfg-ctt5p\""
Jul 07 18:12:44.038316 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:12:44.038208    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-fffc51\"/\"openshift-service-ca.crt\""
Jul 07 18:12:44.038400 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:12:44.038252    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-fffc51\"/\"test-model-fffc51-kserve-self-signed-certs\""
Jul 07 18:12:44.045557 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:12:44.045532    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-fffc51/test-model-fffc51-kserve-657cfb867-nk9cx"]
Jul 07 18:12:44.103982 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:12:44.103939    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b481a03e-64bc-4119-9357-867c2a034430-model-cache\") pod \"test-model-fffc51-kserve-657cfb867-nk9cx\" (UID: \"b481a03e-64bc-4119-9357-867c2a034430\") " pod="ai-tenant-e2e-inf-a-fffc51/test-model-fffc51-kserve-657cfb867-nk9cx"
Jul 07 18:12:44.103982 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:12:44.103990    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b481a03e-64bc-4119-9357-867c2a034430-tls-certs\") pod \"test-model-fffc51-kserve-657cfb867-nk9cx\" (UID: \"b481a03e-64bc-4119-9357-867c2a034430\") " pod="ai-tenant-e2e-inf-a-fffc51/test-model-fffc51-kserve-657cfb867-nk9cx"
Jul 07 18:12:44.104243 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:12:44.104007    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-khx64\" (UniqueName: \"kubernetes.io/projected/b481a03e-64bc-4119-9357-867c2a034430-kube-api-access-khx64\") pod \"test-model-fffc51-kserve-657cfb867-nk9cx\" (UID: \"b481a03e-64bc-4119-9357-867c2a034430\") " pod="ai-tenant-e2e-inf-a-fffc51/test-model-fffc51-kserve-657cfb867-nk9cx"
Jul 07 18:12:44.104243 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:12:44.104116    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b481a03e-64bc-4119-9357-867c2a034430-dshm\") pod \"test-model-fffc51-kserve-657cfb867-nk9cx\" (UID: \"b481a03e-64bc-4119-9357-867c2a034430\") " pod="ai-tenant-e2e-inf-a-fffc51/test-model-fffc51-kserve-657cfb867-nk9cx"
Jul 07 18:12:44.104243 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:12:44.104154    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b481a03e-64bc-4119-9357-867c2a034430-tmp-dir\") pod \"test-model-fffc51-kserve-657cfb867-nk9cx\" (UID: \"b481a03e-64bc-4119-9357-867c2a034430\") " pod="ai-tenant-e2e-inf-a-fffc51/test-model-fffc51-kserve-657cfb867-nk9cx"
Jul 07 18:12:44.104364 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:12:44.104247    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b481a03e-64bc-4119-9357-867c2a034430-home\") pod \"test-model-fffc51-kserve-657cfb867-nk9cx\" (UID: \"b481a03e-64bc-4119-9357-867c2a034430\") " pod="ai-tenant-e2e-inf-a-fffc51/test-model-fffc51-kserve-657cfb867-nk9cx"
Jul 07 18:12:44.205309 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:12:44.205270    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b481a03e-64bc-4119-9357-867c2a034430-dshm\") pod \"test-model-fffc51-kserve-657cfb867-nk9cx\" (UID: \"b481a03e-64bc-4119-9357-867c2a034430\") " pod="ai-tenant-e2e-inf-a-fffc51/test-model-fffc51-kserve-657cfb867-nk9cx"
Jul 07 18:12:44.205309 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:12:44.205308    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b481a03e-64bc-4119-9357-867c2a034430-tmp-dir\") pod \"test-model-fffc51-kserve-657cfb867-nk9cx\" (UID: \"b481a03e-64bc-4119-9357-867c2a034430\") " pod="ai-tenant-e2e-inf-a-fffc51/test-model-fffc51-kserve-657cfb867-nk9cx"
Jul 07 18:12:44.205603 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:12:44.205336    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b481a03e-64bc-4119-9357-867c2a034430-home\") pod \"test-model-fffc51-kserve-657cfb867-nk9cx\" (UID: \"b481a03e-64bc-4119-9357-867c2a034430\") " pod="ai-tenant-e2e-inf-a-fffc51/test-model-fffc51-kserve-657cfb867-nk9cx"
Jul 07 18:12:44.205603 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:12:44.205436    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b481a03e-64bc-4119-9357-867c2a034430-model-cache\") pod \"test-model-fffc51-kserve-657cfb867-nk9cx\" (UID: \"b481a03e-64bc-4119-9357-867c2a034430\") " pod="ai-tenant-e2e-inf-a-fffc51/test-model-fffc51-kserve-657cfb867-nk9cx"
Jul 07 18:12:44.205603 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:12:44.205512    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b481a03e-64bc-4119-9357-867c2a034430-tls-certs\") pod \"test-model-fffc51-kserve-657cfb867-nk9cx\" (UID: \"b481a03e-64bc-4119-9357-867c2a034430\") " pod="ai-tenant-e2e-inf-a-fffc51/test-model-fffc51-kserve-657cfb867-nk9cx"
Jul 07 18:12:44.205603 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:12:44.205535    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-khx64\" (UniqueName: \"kubernetes.io/projected/b481a03e-64bc-4119-9357-867c2a034430-kube-api-access-khx64\") pod \"test-model-fffc51-kserve-657cfb867-nk9cx\" (UID: \"b481a03e-64bc-4119-9357-867c2a034430\") " pod="ai-tenant-e2e-inf-a-fffc51/test-model-fffc51-kserve-657cfb867-nk9cx"
Jul 07 18:12:44.205836 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:12:44.205815    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b481a03e-64bc-4119-9357-867c2a034430-tmp-dir\") pod \"test-model-fffc51-kserve-657cfb867-nk9cx\" (UID: \"b481a03e-64bc-4119-9357-867c2a034430\") " pod="ai-tenant-e2e-inf-a-fffc51/test-model-fffc51-kserve-657cfb867-nk9cx"
Jul 07 18:12:44.205916 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:12:44.205836    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b481a03e-64bc-4119-9357-867c2a034430-home\") pod \"test-model-fffc51-kserve-657cfb867-nk9cx\" (UID: \"b481a03e-64bc-4119-9357-867c2a034430\") " pod="ai-tenant-e2e-inf-a-fffc51/test-model-fffc51-kserve-657cfb867-nk9cx"
Jul 07 18:12:44.205981 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:12:44.205913    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b481a03e-64bc-4119-9357-867c2a034430-model-cache\") pod \"test-model-fffc51-kserve-657cfb867-nk9cx\" (UID: \"b481a03e-64bc-4119-9357-867c2a034430\") " pod="ai-tenant-e2e-inf-a-fffc51/test-model-fffc51-kserve-657cfb867-nk9cx"
Jul 07 18:12:44.207821 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:12:44.207798    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b481a03e-64bc-4119-9357-867c2a034430-dshm\") pod \"test-model-fffc51-kserve-657cfb867-nk9cx\" (UID: \"b481a03e-64bc-4119-9357-867c2a034430\") " pod="ai-tenant-e2e-inf-a-fffc51/test-model-fffc51-kserve-657cfb867-nk9cx"
Jul 07 18:12:44.208213 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:12:44.208195    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b481a03e-64bc-4119-9357-867c2a034430-tls-certs\") pod \"test-model-fffc51-kserve-657cfb867-nk9cx\" (UID: \"b481a03e-64bc-4119-9357-867c2a034430\") " pod="ai-tenant-e2e-inf-a-fffc51/test-model-fffc51-kserve-657cfb867-nk9cx"
Jul 07 18:12:44.214777 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:12:44.214754    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-khx64\" (UniqueName: \"kubernetes.io/projected/b481a03e-64bc-4119-9357-867c2a034430-kube-api-access-khx64\") pod \"test-model-fffc51-kserve-657cfb867-nk9cx\" (UID: \"b481a03e-64bc-4119-9357-867c2a034430\") " pod="ai-tenant-e2e-inf-a-fffc51/test-model-fffc51-kserve-657cfb867-nk9cx"
Jul 07 18:12:44.345330 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:12:44.345296    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-fffc51/test-model-fffc51-kserve-657cfb867-nk9cx"
Jul 07 18:12:44.518555 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:12:44.518523    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-fffc51/test-model-fffc51-kserve-657cfb867-nk9cx"]
Jul 07 18:12:44.521988 ip-10-0-139-31 kubenswrapper[2561]: W0707 18:12:44.521956    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb481a03e_64bc_4119_9357_867c2a034430.slice/crio-56d2d38f4ffeff0f73f5beff9534ae2e5f0344df8606d403f4d8bbcde91830e5 WatchSource:0}: Error finding container 56d2d38f4ffeff0f73f5beff9534ae2e5f0344df8606d403f4d8bbcde91830e5: Status 404 returned error can't find the container with id 56d2d38f4ffeff0f73f5beff9534ae2e5f0344df8606d403f4d8bbcde91830e5
Jul 07 18:12:44.634845 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:12:44.634813    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-54d21f-openshift-default-5b945dc747-wkztr"
Jul 07 18:12:44.721230 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:12:44.721193    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-fffc51/test-model-fffc51-kserve-657cfb867-nk9cx" event={"ID":"b481a03e-64bc-4119-9357-867c2a034430","Type":"ContainerStarted","Data":"b2981bf16f053ed5fc47c18c54621150f8d0f4a054991408bb72c654fd2bbe18"}
Jul 07 18:12:44.721230 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:12:44.721237    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-fffc51/test-model-fffc51-kserve-657cfb867-nk9cx" event={"ID":"b481a03e-64bc-4119-9357-867c2a034430","Type":"ContainerStarted","Data":"56d2d38f4ffeff0f73f5beff9534ae2e5f0344df8606d403f4d8bbcde91830e5"}
Jul 07 18:12:44.743376 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:12:44.743324    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-a-fffc51/test-model-fffc51-kserve-657cfb867-nk9cx" podStartSLOduration=1.743307304 podStartE2EDuration="1.743307304s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 18:12:43 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 18:12:44.742821687 +0000 UTC m=+1955.893946085" watchObservedRunningTime="2026-07-07 18:12:44.743307304 +0000 UTC m=+1955.894431702"
Jul 07 18:12:44.983861 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:12:44.983754    2561 patch_prober.go:28] interesting pod/e2e-inf-b-54d21f-openshift-default-5b945dc747-wkztr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.41:15021/healthz/ready\": dial tcp 10.132.0.41:15021: connect: connection refused" start-of-body=
Jul 07 18:12:44.983861 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:12:44.983833    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-54d21f-openshift-default-5b945dc747-wkztr" podUID="9e1ba924-b03e-4426-b5a4-754a4882c737" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.41:15021/healthz/ready\": dial tcp 10.132.0.41:15021: connect: connection refused"
Jul 07 18:12:45.983260 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:12:45.983214    2561 patch_prober.go:28] interesting pod/e2e-inf-b-54d21f-openshift-default-5b945dc747-wkztr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.41:15021/healthz/ready\": dial tcp 10.132.0.41:15021: connect: connection refused" start-of-body=
Jul 07 18:12:45.983508 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:12:45.983282    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-54d21f-openshift-default-5b945dc747-wkztr" podUID="9e1ba924-b03e-4426-b5a4-754a4882c737" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.41:15021/healthz/ready\": dial tcp 10.132.0.41:15021: connect: connection refused"
Jul 07 18:12:46.983306 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:12:46.983266    2561 patch_prober.go:28] interesting pod/e2e-inf-b-54d21f-openshift-default-5b945dc747-wkztr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.41:15021/healthz/ready\": dial tcp 10.132.0.41:15021: connect: connection refused" start-of-body=
Jul 07 18:12:46.983804 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:12:46.983334    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-54d21f-openshift-default-5b945dc747-wkztr" podUID="9e1ba924-b03e-4426-b5a4-754a4882c737" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.41:15021/healthz/ready\": dial tcp 10.132.0.41:15021: connect: connection refused"
Jul 07 18:12:47.986924 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:12:47.986894    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-54d21f-openshift-default-5b945dc747-wkztr"
Jul 07 18:12:47.987994 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:12:47.987976    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-54d21f-openshift-default-5b945dc747-wkztr"
Jul 07 18:12:54.345922 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:12:54.345882    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-a-fffc51/test-model-fffc51-kserve-657cfb867-nk9cx"
Jul 07 18:12:54.346324 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:12:54.345935    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-a-fffc51/test-model-fffc51-kserve-657cfb867-nk9cx"
Jul 07 18:12:54.358207 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:12:54.358178    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-a-fffc51/test-model-fffc51-kserve-657cfb867-nk9cx"
Jul 07 18:12:54.782309 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:12:54.782228    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-a-fffc51/test-model-fffc51-kserve-657cfb867-nk9cx"
Jul 07 18:13:32.538253 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:13:32.538159    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-fffc51/test-model-fffc51-kserve-657cfb867-nk9cx"]
Jul 07 18:13:47.559316 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:13:47.559239    2561 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-inf-a-fffc51/test-model-fffc51-kserve-657cfb867-nk9cx" podUID="b481a03e-64bc-4119-9357-867c2a034430" containerName="main" containerID="cri-o://b2981bf16f053ed5fc47c18c54621150f8d0f4a054991408bb72c654fd2bbe18" gracePeriod=45
Jul 07 18:13:47.812933 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:13:47.812864    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-fffc51/test-model-fffc51-kserve-657cfb867-nk9cx"
Jul 07 18:13:47.906666 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:13:47.906626    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b481a03e-64bc-4119-9357-867c2a034430-tls-certs\") pod \"b481a03e-64bc-4119-9357-867c2a034430\" (UID: \"b481a03e-64bc-4119-9357-867c2a034430\") "
Jul 07 18:13:47.906855 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:13:47.906689    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-khx64\" (UniqueName: \"kubernetes.io/projected/b481a03e-64bc-4119-9357-867c2a034430-kube-api-access-khx64\") pod \"b481a03e-64bc-4119-9357-867c2a034430\" (UID: \"b481a03e-64bc-4119-9357-867c2a034430\") "
Jul 07 18:13:47.906855 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:13:47.906750    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b481a03e-64bc-4119-9357-867c2a034430-tmp-dir\") pod \"b481a03e-64bc-4119-9357-867c2a034430\" (UID: \"b481a03e-64bc-4119-9357-867c2a034430\") "
Jul 07 18:13:47.906855 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:13:47.906782    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b481a03e-64bc-4119-9357-867c2a034430-home\") pod \"b481a03e-64bc-4119-9357-867c2a034430\" (UID: \"b481a03e-64bc-4119-9357-867c2a034430\") "
Jul 07 18:13:47.906855 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:13:47.906801    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b481a03e-64bc-4119-9357-867c2a034430-model-cache\") pod \"b481a03e-64bc-4119-9357-867c2a034430\" (UID: \"b481a03e-64bc-4119-9357-867c2a034430\") "
Jul 07 18:13:47.906855 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:13:47.906850    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b481a03e-64bc-4119-9357-867c2a034430-dshm\") pod \"b481a03e-64bc-4119-9357-867c2a034430\" (UID: \"b481a03e-64bc-4119-9357-867c2a034430\") "
Jul 07 18:13:47.907154 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:13:47.907121    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b481a03e-64bc-4119-9357-867c2a034430-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "b481a03e-64bc-4119-9357-867c2a034430" (UID: "b481a03e-64bc-4119-9357-867c2a034430"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 18:13:47.907215 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:13:47.907163    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b481a03e-64bc-4119-9357-867c2a034430-home" (OuterVolumeSpecName: "home") pod "b481a03e-64bc-4119-9357-867c2a034430" (UID: "b481a03e-64bc-4119-9357-867c2a034430"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 18:13:47.907215 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:13:47.907179    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b481a03e-64bc-4119-9357-867c2a034430-model-cache" (OuterVolumeSpecName: "model-cache") pod "b481a03e-64bc-4119-9357-867c2a034430" (UID: "b481a03e-64bc-4119-9357-867c2a034430"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 18:13:47.908996 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:13:47.908964    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b481a03e-64bc-4119-9357-867c2a034430-dshm" (OuterVolumeSpecName: "dshm") pod "b481a03e-64bc-4119-9357-867c2a034430" (UID: "b481a03e-64bc-4119-9357-867c2a034430"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 18:13:47.909102 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:13:47.908995    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b481a03e-64bc-4119-9357-867c2a034430-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "b481a03e-64bc-4119-9357-867c2a034430" (UID: "b481a03e-64bc-4119-9357-867c2a034430"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 18:13:47.909147 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:13:47.909103    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b481a03e-64bc-4119-9357-867c2a034430-kube-api-access-khx64" (OuterVolumeSpecName: "kube-api-access-khx64") pod "b481a03e-64bc-4119-9357-867c2a034430" (UID: "b481a03e-64bc-4119-9357-867c2a034430"). InnerVolumeSpecName "kube-api-access-khx64". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 18:13:48.008300 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:13:48.008268    2561 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b481a03e-64bc-4119-9357-867c2a034430-tmp-dir\") on node \"ip-10-0-139-31.ec2.internal\" DevicePath \"\""
Jul 07 18:13:48.008300 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:13:48.008294    2561 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b481a03e-64bc-4119-9357-867c2a034430-home\") on node \"ip-10-0-139-31.ec2.internal\" DevicePath \"\""
Jul 07 18:13:48.008300 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:13:48.008303    2561 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b481a03e-64bc-4119-9357-867c2a034430-model-cache\") on node \"ip-10-0-139-31.ec2.internal\" DevicePath \"\""
Jul 07 18:13:48.008300 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:13:48.008312    2561 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b481a03e-64bc-4119-9357-867c2a034430-dshm\") on node \"ip-10-0-139-31.ec2.internal\" DevicePath \"\""
Jul 07 18:13:48.008604 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:13:48.008320    2561 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b481a03e-64bc-4119-9357-867c2a034430-tls-certs\") on node \"ip-10-0-139-31.ec2.internal\" DevicePath \"\""
Jul 07 18:13:48.008604 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:13:48.008328    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-khx64\" (UniqueName: \"kubernetes.io/projected/b481a03e-64bc-4119-9357-867c2a034430-kube-api-access-khx64\") on node \"ip-10-0-139-31.ec2.internal\" DevicePath \"\""
Jul 07 18:13:48.035665 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:13:48.035630    2561 generic.go:356] "Generic (PLEG): container finished" podID="b481a03e-64bc-4119-9357-867c2a034430" containerID="b2981bf16f053ed5fc47c18c54621150f8d0f4a054991408bb72c654fd2bbe18" exitCode=0
Jul 07 18:13:48.035852 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:13:48.035677    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-fffc51/test-model-fffc51-kserve-657cfb867-nk9cx"
Jul 07 18:13:48.035852 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:13:48.035719    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-fffc51/test-model-fffc51-kserve-657cfb867-nk9cx" event={"ID":"b481a03e-64bc-4119-9357-867c2a034430","Type":"ContainerDied","Data":"b2981bf16f053ed5fc47c18c54621150f8d0f4a054991408bb72c654fd2bbe18"}
Jul 07 18:13:48.035852 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:13:48.035768    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-fffc51/test-model-fffc51-kserve-657cfb867-nk9cx" event={"ID":"b481a03e-64bc-4119-9357-867c2a034430","Type":"ContainerDied","Data":"56d2d38f4ffeff0f73f5beff9534ae2e5f0344df8606d403f4d8bbcde91830e5"}
Jul 07 18:13:48.035852 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:13:48.035792    2561 scope.go:117] "RemoveContainer" containerID="b2981bf16f053ed5fc47c18c54621150f8d0f4a054991408bb72c654fd2bbe18"
Jul 07 18:13:48.045512 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:13:48.045492    2561 scope.go:117] "RemoveContainer" containerID="b2981bf16f053ed5fc47c18c54621150f8d0f4a054991408bb72c654fd2bbe18"
Jul 07 18:13:48.045776 ip-10-0-139-31 kubenswrapper[2561]: E0707 18:13:48.045759    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b2981bf16f053ed5fc47c18c54621150f8d0f4a054991408bb72c654fd2bbe18\": container with ID starting with b2981bf16f053ed5fc47c18c54621150f8d0f4a054991408bb72c654fd2bbe18 not found: ID does not exist" containerID="b2981bf16f053ed5fc47c18c54621150f8d0f4a054991408bb72c654fd2bbe18"
Jul 07 18:13:48.045844 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:13:48.045783    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b2981bf16f053ed5fc47c18c54621150f8d0f4a054991408bb72c654fd2bbe18"} err="failed to get container status \"b2981bf16f053ed5fc47c18c54621150f8d0f4a054991408bb72c654fd2bbe18\": rpc error: code = NotFound desc = could not find container \"b2981bf16f053ed5fc47c18c54621150f8d0f4a054991408bb72c654fd2bbe18\": container with ID starting with b2981bf16f053ed5fc47c18c54621150f8d0f4a054991408bb72c654fd2bbe18 not found: ID does not exist"
Jul 07 18:13:48.060093 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:13:48.060063    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-fffc51/test-model-fffc51-kserve-657cfb867-nk9cx"]
Jul 07 18:13:48.064965 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:13:48.064898    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-a-fffc51/test-model-fffc51-kserve-657cfb867-nk9cx"]
Jul 07 18:13:49.521345 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:13:49.521312    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b481a03e-64bc-4119-9357-867c2a034430" path="/var/lib/kubelet/pods/b481a03e-64bc-4119-9357-867c2a034430/volumes"
Jul 07 18:14:18.369417 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:14:18.369381    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-fffc51-openshift-default-6844fbbff-v9m47"]
Jul 07 18:14:18.369967 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:14:18.369645    2561 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-a-fffc51-openshift-default-6844fbbff-v9m47" podUID="e067b326-842e-477e-af74-9023652530e6" containerName="istio-proxy" containerID="cri-o://4cc19cf92b6f9a44a92f42c397f9700931ec49e455b98e801bd2483d1f727da0" gracePeriod=30
Jul 07 18:14:23.625170 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:14:23.625145    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-fffc51-openshift-default-6844fbbff-v9m47"
Jul 07 18:14:23.648900 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:14:23.648817    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e067b326-842e-477e-af74-9023652530e6-istio-token\") pod \"e067b326-842e-477e-af74-9023652530e6\" (UID: \"e067b326-842e-477e-af74-9023652530e6\") "
Jul 07 18:14:23.648900 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:14:23.648891    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e067b326-842e-477e-af74-9023652530e6-workload-certs\") pod \"e067b326-842e-477e-af74-9023652530e6\" (UID: \"e067b326-842e-477e-af74-9023652530e6\") "
Jul 07 18:14:23.649223 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:14:23.649146    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e067b326-842e-477e-af74-9023652530e6-credential-socket\") pod \"e067b326-842e-477e-af74-9023652530e6\" (UID: \"e067b326-842e-477e-af74-9023652530e6\") "
Jul 07 18:14:23.649223 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:14:23.649184    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e067b326-842e-477e-af74-9023652530e6-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "e067b326-842e-477e-af74-9023652530e6" (UID: "e067b326-842e-477e-af74-9023652530e6"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 18:14:23.649223 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:14:23.649217    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e067b326-842e-477e-af74-9023652530e6-istio-podinfo\") pod \"e067b326-842e-477e-af74-9023652530e6\" (UID: \"e067b326-842e-477e-af74-9023652530e6\") "
Jul 07 18:14:23.649428 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:14:23.649243    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e067b326-842e-477e-af74-9023652530e6-istio-data\") pod \"e067b326-842e-477e-af74-9023652530e6\" (UID: \"e067b326-842e-477e-af74-9023652530e6\") "
Jul 07 18:14:23.649428 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:14:23.649294    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cjsrf\" (UniqueName: \"kubernetes.io/projected/e067b326-842e-477e-af74-9023652530e6-kube-api-access-cjsrf\") pod \"e067b326-842e-477e-af74-9023652530e6\" (UID: \"e067b326-842e-477e-af74-9023652530e6\") "
Jul 07 18:14:23.649428 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:14:23.649319    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e067b326-842e-477e-af74-9023652530e6-workload-socket\") pod \"e067b326-842e-477e-af74-9023652530e6\" (UID: \"e067b326-842e-477e-af74-9023652530e6\") "
Jul 07 18:14:23.649428 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:14:23.649362    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e067b326-842e-477e-af74-9023652530e6-istiod-ca-cert\") pod \"e067b326-842e-477e-af74-9023652530e6\" (UID: \"e067b326-842e-477e-af74-9023652530e6\") "
Jul 07 18:14:23.649670 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:14:23.649466    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e067b326-842e-477e-af74-9023652530e6-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "e067b326-842e-477e-af74-9023652530e6" (UID: "e067b326-842e-477e-af74-9023652530e6"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 18:14:23.650124 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:14:23.649744    2561 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e067b326-842e-477e-af74-9023652530e6-workload-certs\") on node \"ip-10-0-139-31.ec2.internal\" DevicePath \"\""
Jul 07 18:14:23.650124 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:14:23.649768    2561 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e067b326-842e-477e-af74-9023652530e6-credential-socket\") on node \"ip-10-0-139-31.ec2.internal\" DevicePath \"\""
Jul 07 18:14:23.650124 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:14:23.650035    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e067b326-842e-477e-af74-9023652530e6-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "e067b326-842e-477e-af74-9023652530e6" (UID: "e067b326-842e-477e-af74-9023652530e6"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 18:14:23.650634 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:14:23.650609    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e067b326-842e-477e-af74-9023652530e6-istio-data" (OuterVolumeSpecName: "istio-data") pod "e067b326-842e-477e-af74-9023652530e6" (UID: "e067b326-842e-477e-af74-9023652530e6"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 18:14:23.650724 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:14:23.650687    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e067b326-842e-477e-af74-9023652530e6-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "e067b326-842e-477e-af74-9023652530e6" (UID: "e067b326-842e-477e-af74-9023652530e6"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 18:14:23.651893 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:14:23.651868    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e067b326-842e-477e-af74-9023652530e6-istio-token" (OuterVolumeSpecName: "istio-token") pod "e067b326-842e-477e-af74-9023652530e6" (UID: "e067b326-842e-477e-af74-9023652530e6"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 18:14:23.652028 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:14:23.651868    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e067b326-842e-477e-af74-9023652530e6-kube-api-access-cjsrf" (OuterVolumeSpecName: "kube-api-access-cjsrf") pod "e067b326-842e-477e-af74-9023652530e6" (UID: "e067b326-842e-477e-af74-9023652530e6"). InnerVolumeSpecName "kube-api-access-cjsrf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 18:14:23.652028 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:14:23.651959    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/e067b326-842e-477e-af74-9023652530e6-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "e067b326-842e-477e-af74-9023652530e6" (UID: "e067b326-842e-477e-af74-9023652530e6"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 07 18:14:23.750824 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:14:23.750785    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e067b326-842e-477e-af74-9023652530e6-istio-envoy\") pod \"e067b326-842e-477e-af74-9023652530e6\" (UID: \"e067b326-842e-477e-af74-9023652530e6\") "
Jul 07 18:14:23.751005 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:14:23.750992    2561 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e067b326-842e-477e-af74-9023652530e6-istio-token\") on node \"ip-10-0-139-31.ec2.internal\" DevicePath \"\""
Jul 07 18:14:23.751050 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:14:23.751008    2561 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e067b326-842e-477e-af74-9023652530e6-istio-podinfo\") on node \"ip-10-0-139-31.ec2.internal\" DevicePath \"\""
Jul 07 18:14:23.751050 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:14:23.751017    2561 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e067b326-842e-477e-af74-9023652530e6-istio-data\") on node \"ip-10-0-139-31.ec2.internal\" DevicePath \"\""
Jul 07 18:14:23.751050 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:14:23.751025    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cjsrf\" (UniqueName: \"kubernetes.io/projected/e067b326-842e-477e-af74-9023652530e6-kube-api-access-cjsrf\") on node \"ip-10-0-139-31.ec2.internal\" DevicePath \"\""
Jul 07 18:14:23.751050 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:14:23.751033    2561 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e067b326-842e-477e-af74-9023652530e6-workload-socket\") on node \"ip-10-0-139-31.ec2.internal\" DevicePath \"\""
Jul 07 18:14:23.751050 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:14:23.751041    2561 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e067b326-842e-477e-af74-9023652530e6-istiod-ca-cert\") on node \"ip-10-0-139-31.ec2.internal\" DevicePath \"\""
Jul 07 18:14:23.752849 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:14:23.752823    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e067b326-842e-477e-af74-9023652530e6-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "e067b326-842e-477e-af74-9023652530e6" (UID: "e067b326-842e-477e-af74-9023652530e6"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 18:14:23.851930 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:14:23.851899    2561 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e067b326-842e-477e-af74-9023652530e6-istio-envoy\") on node \"ip-10-0-139-31.ec2.internal\" DevicePath \"\""
Jul 07 18:14:24.211049 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:14:24.211014    2561 generic.go:356] "Generic (PLEG): container finished" podID="e067b326-842e-477e-af74-9023652530e6" containerID="4cc19cf92b6f9a44a92f42c397f9700931ec49e455b98e801bd2483d1f727da0" exitCode=0
Jul 07 18:14:24.211267 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:14:24.211051    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-fffc51-openshift-default-6844fbbff-v9m47" event={"ID":"e067b326-842e-477e-af74-9023652530e6","Type":"ContainerDied","Data":"4cc19cf92b6f9a44a92f42c397f9700931ec49e455b98e801bd2483d1f727da0"}
Jul 07 18:14:24.211267 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:14:24.211073    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-fffc51-openshift-default-6844fbbff-v9m47"
Jul 07 18:14:24.211267 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:14:24.211107    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-fffc51-openshift-default-6844fbbff-v9m47" event={"ID":"e067b326-842e-477e-af74-9023652530e6","Type":"ContainerDied","Data":"22ef9d3a45b246d278d07103d20a7774837252da1f097af338ab329676dc83b1"}
Jul 07 18:14:24.211267 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:14:24.211139    2561 scope.go:117] "RemoveContainer" containerID="4cc19cf92b6f9a44a92f42c397f9700931ec49e455b98e801bd2483d1f727da0"
Jul 07 18:14:24.220592 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:14:24.220575    2561 scope.go:117] "RemoveContainer" containerID="2d35cdb9d9b30c960c773f8d40305d9733b888e058b0eb32cae3b3e3a26eae56"
Jul 07 18:14:24.228864 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:14:24.228846    2561 scope.go:117] "RemoveContainer" containerID="4cc19cf92b6f9a44a92f42c397f9700931ec49e455b98e801bd2483d1f727da0"
Jul 07 18:14:24.229132 ip-10-0-139-31 kubenswrapper[2561]: E0707 18:14:24.229114    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4cc19cf92b6f9a44a92f42c397f9700931ec49e455b98e801bd2483d1f727da0\": container with ID starting with 4cc19cf92b6f9a44a92f42c397f9700931ec49e455b98e801bd2483d1f727da0 not found: ID does not exist" containerID="4cc19cf92b6f9a44a92f42c397f9700931ec49e455b98e801bd2483d1f727da0"
Jul 07 18:14:24.229180 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:14:24.229141    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4cc19cf92b6f9a44a92f42c397f9700931ec49e455b98e801bd2483d1f727da0"} err="failed to get container status \"4cc19cf92b6f9a44a92f42c397f9700931ec49e455b98e801bd2483d1f727da0\": rpc error: code = NotFound desc = could not find container \"4cc19cf92b6f9a44a92f42c397f9700931ec49e455b98e801bd2483d1f727da0\": container with ID starting with 4cc19cf92b6f9a44a92f42c397f9700931ec49e455b98e801bd2483d1f727da0 not found: ID does not exist"
Jul 07 18:14:24.229180 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:14:24.229162    2561 scope.go:117] "RemoveContainer" containerID="2d35cdb9d9b30c960c773f8d40305d9733b888e058b0eb32cae3b3e3a26eae56"
Jul 07 18:14:24.229419 ip-10-0-139-31 kubenswrapper[2561]: E0707 18:14:24.229400    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2d35cdb9d9b30c960c773f8d40305d9733b888e058b0eb32cae3b3e3a26eae56\": container with ID starting with 2d35cdb9d9b30c960c773f8d40305d9733b888e058b0eb32cae3b3e3a26eae56 not found: ID does not exist" containerID="2d35cdb9d9b30c960c773f8d40305d9733b888e058b0eb32cae3b3e3a26eae56"
Jul 07 18:14:24.229492 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:14:24.229425    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2d35cdb9d9b30c960c773f8d40305d9733b888e058b0eb32cae3b3e3a26eae56"} err="failed to get container status \"2d35cdb9d9b30c960c773f8d40305d9733b888e058b0eb32cae3b3e3a26eae56\": rpc error: code = NotFound desc = could not find container \"2d35cdb9d9b30c960c773f8d40305d9733b888e058b0eb32cae3b3e3a26eae56\": container with ID starting with 2d35cdb9d9b30c960c773f8d40305d9733b888e058b0eb32cae3b3e3a26eae56 not found: ID does not exist"
Jul 07 18:14:24.236038 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:14:24.236012    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-fffc51-openshift-default-6844fbbff-v9m47"]
Jul 07 18:14:24.239582 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:14:24.239562    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-a-fffc51-openshift-default-6844fbbff-v9m47"]
Jul 07 18:14:25.522069 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:14:25.522033    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e067b326-842e-477e-af74-9023652530e6" path="/var/lib/kubelet/pods/e067b326-842e-477e-af74-9023652530e6/volumes"
Jul 07 18:14:26.079210 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:14:26.079173    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-54d21f-openshift-default-5b945dc747-wkztr"]
Jul 07 18:14:26.079413 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:14:26.079384    2561 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-b-54d21f-openshift-default-5b945dc747-wkztr" podUID="9e1ba924-b03e-4426-b5a4-754a4882c737" containerName="istio-proxy" containerID="cri-o://9cb0197953cd26fab20e6b821c1f84504c060106a5cb18f5efe2647586e850ae" gracePeriod=30
Jul 07 18:14:26.984842 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:14:26.984810    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-a-b5c161-openshift-default-658c9f64c5-vj9n2"]
Jul 07 18:14:26.985213 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:14:26.985175    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b481a03e-64bc-4119-9357-867c2a034430" containerName="main"
Jul 07 18:14:26.985213 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:14:26.985186    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="b481a03e-64bc-4119-9357-867c2a034430" containerName="main"
Jul 07 18:14:26.985213 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:14:26.985206    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e067b326-842e-477e-af74-9023652530e6" containerName="istio-proxy"
Jul 07 18:14:26.985213 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:14:26.985212    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="e067b326-842e-477e-af74-9023652530e6" containerName="istio-proxy"
Jul 07 18:14:26.985365 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:14:26.985219    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e067b326-842e-477e-af74-9023652530e6" containerName="istio-proxy"
Jul 07 18:14:26.985365 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:14:26.985225    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="e067b326-842e-477e-af74-9023652530e6" containerName="istio-proxy"
Jul 07 18:14:26.985365 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:14:26.985280    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="e067b326-842e-477e-af74-9023652530e6" containerName="istio-proxy"
Jul 07 18:14:26.985365 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:14:26.985288    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="b481a03e-64bc-4119-9357-867c2a034430" containerName="main"
Jul 07 18:14:26.989722 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:14:26.989705    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-b5c161-openshift-default-658c9f64c5-vj9n2"
Jul 07 18:14:26.992578 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:14:26.992557    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-a-b5c161-openshift-default-dockercfg-677vv\""
Jul 07 18:14:27.001961 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:14:27.001938    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-b5c161-openshift-default-658c9f64c5-vj9n2"]
Jul 07 18:14:27.088394 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:14:27.082762    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b6aac632-65c2-4b1a-aeb2-e012f16d100d-istiod-ca-cert\") pod \"e2e-api-a-b5c161-openshift-default-658c9f64c5-vj9n2\" (UID: \"b6aac632-65c2-4b1a-aeb2-e012f16d100d\") " pod="openshift-ingress/e2e-api-a-b5c161-openshift-default-658c9f64c5-vj9n2"
Jul 07 18:14:27.088394 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:14:27.082861    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b6aac632-65c2-4b1a-aeb2-e012f16d100d-istio-token\") pod \"e2e-api-a-b5c161-openshift-default-658c9f64c5-vj9n2\" (UID: \"b6aac632-65c2-4b1a-aeb2-e012f16d100d\") " pod="openshift-ingress/e2e-api-a-b5c161-openshift-default-658c9f64c5-vj9n2"
Jul 07 18:14:27.088394 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:14:27.082898    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b6aac632-65c2-4b1a-aeb2-e012f16d100d-workload-socket\") pod \"e2e-api-a-b5c161-openshift-default-658c9f64c5-vj9n2\" (UID: \"b6aac632-65c2-4b1a-aeb2-e012f16d100d\") " pod="openshift-ingress/e2e-api-a-b5c161-openshift-default-658c9f64c5-vj9n2"
Jul 07 18:14:27.088394 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:14:27.082953    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b6aac632-65c2-4b1a-aeb2-e012f16d100d-credential-socket\") pod \"e2e-api-a-b5c161-openshift-default-658c9f64c5-vj9n2\" (UID: \"b6aac632-65c2-4b1a-aeb2-e012f16d100d\") " pod="openshift-ingress/e2e-api-a-b5c161-openshift-default-658c9f64c5-vj9n2"
Jul 07 18:14:27.088394 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:14:27.082987    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b6aac632-65c2-4b1a-aeb2-e012f16d100d-istio-envoy\") pod \"e2e-api-a-b5c161-openshift-default-658c9f64c5-vj9n2\" (UID: \"b6aac632-65c2-4b1a-aeb2-e012f16d100d\") " pod="openshift-ingress/e2e-api-a-b5c161-openshift-default-658c9f64c5-vj9n2"
Jul 07 18:14:27.088394 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:14:27.083016    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b6aac632-65c2-4b1a-aeb2-e012f16d100d-istio-data\") pod \"e2e-api-a-b5c161-openshift-default-658c9f64c5-vj9n2\" (UID: \"b6aac632-65c2-4b1a-aeb2-e012f16d100d\") " pod="openshift-ingress/e2e-api-a-b5c161-openshift-default-658c9f64c5-vj9n2"
Jul 07 18:14:27.088394 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:14:27.083055    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b6aac632-65c2-4b1a-aeb2-e012f16d100d-workload-certs\") pod \"e2e-api-a-b5c161-openshift-default-658c9f64c5-vj9n2\" (UID: \"b6aac632-65c2-4b1a-aeb2-e012f16d100d\") " pod="openshift-ingress/e2e-api-a-b5c161-openshift-default-658c9f64c5-vj9n2"
Jul 07 18:14:27.088394 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:14:27.083098    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xldq9\" (UniqueName: \"kubernetes.io/projected/b6aac632-65c2-4b1a-aeb2-e012f16d100d-kube-api-access-xldq9\") pod \"e2e-api-a-b5c161-openshift-default-658c9f64c5-vj9n2\" (UID: \"b6aac632-65c2-4b1a-aeb2-e012f16d100d\") " pod="openshift-ingress/e2e-api-a-b5c161-openshift-default-658c9f64c5-vj9n2"
Jul 07 18:14:27.088394 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:14:27.083167    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b6aac632-65c2-4b1a-aeb2-e012f16d100d-istio-podinfo\") pod \"e2e-api-a-b5c161-openshift-default-658c9f64c5-vj9n2\" (UID: \"b6aac632-65c2-4b1a-aeb2-e012f16d100d\") " pod="openshift-ingress/e2e-api-a-b5c161-openshift-default-658c9f64c5-vj9n2"
Jul 07 18:14:27.184778 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:14:27.184739    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b6aac632-65c2-4b1a-aeb2-e012f16d100d-istio-podinfo\") pod \"e2e-api-a-b5c161-openshift-default-658c9f64c5-vj9n2\" (UID: \"b6aac632-65c2-4b1a-aeb2-e012f16d100d\") " pod="openshift-ingress/e2e-api-a-b5c161-openshift-default-658c9f64c5-vj9n2"
Jul 07 18:14:27.184968 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:14:27.184800    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b6aac632-65c2-4b1a-aeb2-e012f16d100d-istiod-ca-cert\") pod \"e2e-api-a-b5c161-openshift-default-658c9f64c5-vj9n2\" (UID: \"b6aac632-65c2-4b1a-aeb2-e012f16d100d\") " pod="openshift-ingress/e2e-api-a-b5c161-openshift-default-658c9f64c5-vj9n2"
Jul 07 18:14:27.184968 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:14:27.184844    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b6aac632-65c2-4b1a-aeb2-e012f16d100d-istio-token\") pod \"e2e-api-a-b5c161-openshift-default-658c9f64c5-vj9n2\" (UID: \"b6aac632-65c2-4b1a-aeb2-e012f16d100d\") " pod="openshift-ingress/e2e-api-a-b5c161-openshift-default-658c9f64c5-vj9n2"
Jul 07 18:14:27.184968 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:14:27.184865    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b6aac632-65c2-4b1a-aeb2-e012f16d100d-workload-socket\") pod \"e2e-api-a-b5c161-openshift-default-658c9f64c5-vj9n2\" (UID: \"b6aac632-65c2-4b1a-aeb2-e012f16d100d\") " pod="openshift-ingress/e2e-api-a-b5c161-openshift-default-658c9f64c5-vj9n2"
Jul 07 18:14:27.184968 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:14:27.184894    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b6aac632-65c2-4b1a-aeb2-e012f16d100d-credential-socket\") pod \"e2e-api-a-b5c161-openshift-default-658c9f64c5-vj9n2\" (UID: \"b6aac632-65c2-4b1a-aeb2-e012f16d100d\") " pod="openshift-ingress/e2e-api-a-b5c161-openshift-default-658c9f64c5-vj9n2"
Jul 07 18:14:27.184968 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:14:27.184909    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b6aac632-65c2-4b1a-aeb2-e012f16d100d-istio-envoy\") pod \"e2e-api-a-b5c161-openshift-default-658c9f64c5-vj9n2\" (UID: \"b6aac632-65c2-4b1a-aeb2-e012f16d100d\") " pod="openshift-ingress/e2e-api-a-b5c161-openshift-default-658c9f64c5-vj9n2"
Jul 07 18:14:27.184968 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:14:27.184927    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b6aac632-65c2-4b1a-aeb2-e012f16d100d-istio-data\") pod \"e2e-api-a-b5c161-openshift-default-658c9f64c5-vj9n2\" (UID: \"b6aac632-65c2-4b1a-aeb2-e012f16d100d\") " pod="openshift-ingress/e2e-api-a-b5c161-openshift-default-658c9f64c5-vj9n2"
Jul 07 18:14:27.185318 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:14:27.184983    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b6aac632-65c2-4b1a-aeb2-e012f16d100d-workload-certs\") pod \"e2e-api-a-b5c161-openshift-default-658c9f64c5-vj9n2\" (UID: \"b6aac632-65c2-4b1a-aeb2-e012f16d100d\") " pod="openshift-ingress/e2e-api-a-b5c161-openshift-default-658c9f64c5-vj9n2"
Jul 07 18:14:27.185318 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:14:27.185039    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xldq9\" (UniqueName: \"kubernetes.io/projected/b6aac632-65c2-4b1a-aeb2-e012f16d100d-kube-api-access-xldq9\") pod \"e2e-api-a-b5c161-openshift-default-658c9f64c5-vj9n2\" (UID: \"b6aac632-65c2-4b1a-aeb2-e012f16d100d\") " pod="openshift-ingress/e2e-api-a-b5c161-openshift-default-658c9f64c5-vj9n2"
Jul 07 18:14:27.185476 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:14:27.185399    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b6aac632-65c2-4b1a-aeb2-e012f16d100d-workload-socket\") pod \"e2e-api-a-b5c161-openshift-default-658c9f64c5-vj9n2\" (UID: \"b6aac632-65c2-4b1a-aeb2-e012f16d100d\") " pod="openshift-ingress/e2e-api-a-b5c161-openshift-default-658c9f64c5-vj9n2"
Jul 07 18:14:27.185539 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:14:27.185474    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b6aac632-65c2-4b1a-aeb2-e012f16d100d-workload-certs\") pod \"e2e-api-a-b5c161-openshift-default-658c9f64c5-vj9n2\" (UID: \"b6aac632-65c2-4b1a-aeb2-e012f16d100d\") " pod="openshift-ingress/e2e-api-a-b5c161-openshift-default-658c9f64c5-vj9n2"
Jul 07 18:14:27.185598 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:14:27.185580    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b6aac632-65c2-4b1a-aeb2-e012f16d100d-credential-socket\") pod \"e2e-api-a-b5c161-openshift-default-658c9f64c5-vj9n2\" (UID: \"b6aac632-65c2-4b1a-aeb2-e012f16d100d\") " pod="openshift-ingress/e2e-api-a-b5c161-openshift-default-658c9f64c5-vj9n2"
Jul 07 18:14:27.185652 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:14:27.185624    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b6aac632-65c2-4b1a-aeb2-e012f16d100d-istiod-ca-cert\") pod \"e2e-api-a-b5c161-openshift-default-658c9f64c5-vj9n2\" (UID: \"b6aac632-65c2-4b1a-aeb2-e012f16d100d\") " pod="openshift-ingress/e2e-api-a-b5c161-openshift-default-658c9f64c5-vj9n2"
Jul 07 18:14:27.185711 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:14:27.185624    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b6aac632-65c2-4b1a-aeb2-e012f16d100d-istio-data\") pod \"e2e-api-a-b5c161-openshift-default-658c9f64c5-vj9n2\" (UID: \"b6aac632-65c2-4b1a-aeb2-e012f16d100d\") " pod="openshift-ingress/e2e-api-a-b5c161-openshift-default-658c9f64c5-vj9n2"
Jul 07 18:14:27.187342 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:14:27.187320    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b6aac632-65c2-4b1a-aeb2-e012f16d100d-istio-envoy\") pod \"e2e-api-a-b5c161-openshift-default-658c9f64c5-vj9n2\" (UID: \"b6aac632-65c2-4b1a-aeb2-e012f16d100d\") " pod="openshift-ingress/e2e-api-a-b5c161-openshift-default-658c9f64c5-vj9n2"
Jul 07 18:14:27.187526 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:14:27.187506    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b6aac632-65c2-4b1a-aeb2-e012f16d100d-istio-podinfo\") pod \"e2e-api-a-b5c161-openshift-default-658c9f64c5-vj9n2\" (UID: \"b6aac632-65c2-4b1a-aeb2-e012f16d100d\") " pod="openshift-ingress/e2e-api-a-b5c161-openshift-default-658c9f64c5-vj9n2"
Jul 07 18:14:27.195420 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:14:27.195394    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b6aac632-65c2-4b1a-aeb2-e012f16d100d-istio-token\") pod \"e2e-api-a-b5c161-openshift-default-658c9f64c5-vj9n2\" (UID: \"b6aac632-65c2-4b1a-aeb2-e012f16d100d\") " pod="openshift-ingress/e2e-api-a-b5c161-openshift-default-658c9f64c5-vj9n2"
Jul 07 18:14:27.195578 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:14:27.195555    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xldq9\" (UniqueName: \"kubernetes.io/projected/b6aac632-65c2-4b1a-aeb2-e012f16d100d-kube-api-access-xldq9\") pod \"e2e-api-a-b5c161-openshift-default-658c9f64c5-vj9n2\" (UID: \"b6aac632-65c2-4b1a-aeb2-e012f16d100d\") " pod="openshift-ingress/e2e-api-a-b5c161-openshift-default-658c9f64c5-vj9n2"
Jul 07 18:14:27.300108 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:14:27.300081    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-b5c161-openshift-default-658c9f64c5-vj9n2"
Jul 07 18:14:27.448099 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:14:27.448076    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-b5c161-openshift-default-658c9f64c5-vj9n2"]
Jul 07 18:14:27.450455 ip-10-0-139-31 kubenswrapper[2561]: W0707 18:14:27.450415    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb6aac632_65c2_4b1a_aeb2_e012f16d100d.slice/crio-cf3bba5ba48ba7125502cceb5773d7c1e1cc93bbe6aa2c9449ba39c1ee18ed89 WatchSource:0}: Error finding container cf3bba5ba48ba7125502cceb5773d7c1e1cc93bbe6aa2c9449ba39c1ee18ed89: Status 404 returned error can't find the container with id cf3bba5ba48ba7125502cceb5773d7c1e1cc93bbe6aa2c9449ba39c1ee18ed89
Jul 07 18:14:27.452650 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:14:27.452615    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 07 18:14:27.452758 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:14:27.452698    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 07 18:14:27.452758 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:14:27.452743    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 07 18:14:28.232517 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:14:28.232476    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-b5c161-openshift-default-658c9f64c5-vj9n2" event={"ID":"b6aac632-65c2-4b1a-aeb2-e012f16d100d","Type":"ContainerStarted","Data":"f8ea0d34ad08945c365b52af1397ff6fc789036709f31660b17dc34d69437cda"}
Jul 07 18:14:28.232970 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:14:28.232535    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-b5c161-openshift-default-658c9f64c5-vj9n2" event={"ID":"b6aac632-65c2-4b1a-aeb2-e012f16d100d","Type":"ContainerStarted","Data":"cf3bba5ba48ba7125502cceb5773d7c1e1cc93bbe6aa2c9449ba39c1ee18ed89"}
Jul 07 18:14:28.257073 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:14:28.257023    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-a-b5c161-openshift-default-658c9f64c5-vj9n2" podStartSLOduration=2.257006946 podStartE2EDuration="2.257006946s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 18:14:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 18:14:28.254914866 +0000 UTC m=+2059.406039266" watchObservedRunningTime="2026-07-07 18:14:28.257006946 +0000 UTC m=+2059.408131344"
Jul 07 18:14:28.301201 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:14:28.301166    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-b5c161-openshift-default-658c9f64c5-vj9n2"
Jul 07 18:14:28.305963 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:14:28.305940    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-b5c161-openshift-default-658c9f64c5-vj9n2"
Jul 07 18:14:29.237797 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:14:29.237767    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-b5c161-openshift-default-658c9f64c5-vj9n2"
Jul 07 18:14:29.238855 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:14:29.238833    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-b5c161-openshift-default-658c9f64c5-vj9n2"
Jul 07 18:14:31.249697 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:14:31.249662    2561 generic.go:356] "Generic (PLEG): container finished" podID="9e1ba924-b03e-4426-b5a4-754a4882c737" containerID="9cb0197953cd26fab20e6b821c1f84504c060106a5cb18f5efe2647586e850ae" exitCode=0
Jul 07 18:14:31.250122 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:14:31.249732    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-54d21f-openshift-default-5b945dc747-wkztr" event={"ID":"9e1ba924-b03e-4426-b5a4-754a4882c737","Type":"ContainerDied","Data":"9cb0197953cd26fab20e6b821c1f84504c060106a5cb18f5efe2647586e850ae"}
Jul 07 18:14:31.250122 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:14:31.249784    2561 scope.go:117] "RemoveContainer" containerID="f12582e425ad6469ccdd8a3671eaca04c1c41b23e92770d8d7103945d77bade0"
Jul 07 18:14:31.344948 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:14:31.344881    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-54d21f-openshift-default-5b945dc747-wkztr"
Jul 07 18:14:31.424248 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:14:31.424215    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9e1ba924-b03e-4426-b5a4-754a4882c737-istiod-ca-cert\") pod \"9e1ba924-b03e-4426-b5a4-754a4882c737\" (UID: \"9e1ba924-b03e-4426-b5a4-754a4882c737\") "
Jul 07 18:14:31.424248 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:14:31.424247    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9e1ba924-b03e-4426-b5a4-754a4882c737-istio-token\") pod \"9e1ba924-b03e-4426-b5a4-754a4882c737\" (UID: \"9e1ba924-b03e-4426-b5a4-754a4882c737\") "
Jul 07 18:14:31.424536 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:14:31.424265    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9e1ba924-b03e-4426-b5a4-754a4882c737-workload-socket\") pod \"9e1ba924-b03e-4426-b5a4-754a4882c737\" (UID: \"9e1ba924-b03e-4426-b5a4-754a4882c737\") "
Jul 07 18:14:31.424536 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:14:31.424306    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9e1ba924-b03e-4426-b5a4-754a4882c737-istio-data\") pod \"9e1ba924-b03e-4426-b5a4-754a4882c737\" (UID: \"9e1ba924-b03e-4426-b5a4-754a4882c737\") "
Jul 07 18:14:31.424536 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:14:31.424321    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9e1ba924-b03e-4426-b5a4-754a4882c737-istio-podinfo\") pod \"9e1ba924-b03e-4426-b5a4-754a4882c737\" (UID: \"9e1ba924-b03e-4426-b5a4-754a4882c737\") "
Jul 07 18:14:31.424536 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:14:31.424404    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-62756\" (UniqueName: \"kubernetes.io/projected/9e1ba924-b03e-4426-b5a4-754a4882c737-kube-api-access-62756\") pod \"9e1ba924-b03e-4426-b5a4-754a4882c737\" (UID: \"9e1ba924-b03e-4426-b5a4-754a4882c737\") "
Jul 07 18:14:31.424536 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:14:31.424428    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9e1ba924-b03e-4426-b5a4-754a4882c737-istio-envoy\") pod \"9e1ba924-b03e-4426-b5a4-754a4882c737\" (UID: \"9e1ba924-b03e-4426-b5a4-754a4882c737\") "
Jul 07 18:14:31.424536 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:14:31.424489    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9e1ba924-b03e-4426-b5a4-754a4882c737-credential-socket\") pod \"9e1ba924-b03e-4426-b5a4-754a4882c737\" (UID: \"9e1ba924-b03e-4426-b5a4-754a4882c737\") "
Jul 07 18:14:31.424536 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:14:31.424529    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9e1ba924-b03e-4426-b5a4-754a4882c737-workload-certs\") pod \"9e1ba924-b03e-4426-b5a4-754a4882c737\" (UID: \"9e1ba924-b03e-4426-b5a4-754a4882c737\") "
Jul 07 18:14:31.424898 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:14:31.424659    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9e1ba924-b03e-4426-b5a4-754a4882c737-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "9e1ba924-b03e-4426-b5a4-754a4882c737" (UID: "9e1ba924-b03e-4426-b5a4-754a4882c737"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 18:14:31.424898 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:14:31.424660    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9e1ba924-b03e-4426-b5a4-754a4882c737-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "9e1ba924-b03e-4426-b5a4-754a4882c737" (UID: "9e1ba924-b03e-4426-b5a4-754a4882c737"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 18:14:31.424898 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:14:31.424850    2561 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9e1ba924-b03e-4426-b5a4-754a4882c737-istiod-ca-cert\") on node \"ip-10-0-139-31.ec2.internal\" DevicePath \"\""
Jul 07 18:14:31.424898 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:14:31.424871    2561 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9e1ba924-b03e-4426-b5a4-754a4882c737-workload-socket\") on node \"ip-10-0-139-31.ec2.internal\" DevicePath \"\""
Jul 07 18:14:31.425070 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:14:31.424896    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9e1ba924-b03e-4426-b5a4-754a4882c737-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "9e1ba924-b03e-4426-b5a4-754a4882c737" (UID: "9e1ba924-b03e-4426-b5a4-754a4882c737"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 18:14:31.425070 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:14:31.424938    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9e1ba924-b03e-4426-b5a4-754a4882c737-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "9e1ba924-b03e-4426-b5a4-754a4882c737" (UID: "9e1ba924-b03e-4426-b5a4-754a4882c737"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 18:14:31.425276 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:14:31.425252    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9e1ba924-b03e-4426-b5a4-754a4882c737-istio-data" (OuterVolumeSpecName: "istio-data") pod "9e1ba924-b03e-4426-b5a4-754a4882c737" (UID: "9e1ba924-b03e-4426-b5a4-754a4882c737"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 18:14:31.426593 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:14:31.426570    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9e1ba924-b03e-4426-b5a4-754a4882c737-istio-token" (OuterVolumeSpecName: "istio-token") pod "9e1ba924-b03e-4426-b5a4-754a4882c737" (UID: "9e1ba924-b03e-4426-b5a4-754a4882c737"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 18:14:31.426688 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:14:31.426593    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9e1ba924-b03e-4426-b5a4-754a4882c737-kube-api-access-62756" (OuterVolumeSpecName: "kube-api-access-62756") pod "9e1ba924-b03e-4426-b5a4-754a4882c737" (UID: "9e1ba924-b03e-4426-b5a4-754a4882c737"). InnerVolumeSpecName "kube-api-access-62756". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 18:14:31.426855 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:14:31.426841    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/9e1ba924-b03e-4426-b5a4-754a4882c737-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "9e1ba924-b03e-4426-b5a4-754a4882c737" (UID: "9e1ba924-b03e-4426-b5a4-754a4882c737"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 07 18:14:31.426915 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:14:31.426863    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9e1ba924-b03e-4426-b5a4-754a4882c737-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "9e1ba924-b03e-4426-b5a4-754a4882c737" (UID: "9e1ba924-b03e-4426-b5a4-754a4882c737"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 18:14:31.525739 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:14:31.525655    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-62756\" (UniqueName: \"kubernetes.io/projected/9e1ba924-b03e-4426-b5a4-754a4882c737-kube-api-access-62756\") on node \"ip-10-0-139-31.ec2.internal\" DevicePath \"\""
Jul 07 18:14:31.525739 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:14:31.525685    2561 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9e1ba924-b03e-4426-b5a4-754a4882c737-istio-envoy\") on node \"ip-10-0-139-31.ec2.internal\" DevicePath \"\""
Jul 07 18:14:31.525739 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:14:31.525697    2561 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9e1ba924-b03e-4426-b5a4-754a4882c737-credential-socket\") on node \"ip-10-0-139-31.ec2.internal\" DevicePath \"\""
Jul 07 18:14:31.525739 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:14:31.525709    2561 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9e1ba924-b03e-4426-b5a4-754a4882c737-workload-certs\") on node \"ip-10-0-139-31.ec2.internal\" DevicePath \"\""
Jul 07 18:14:31.525739 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:14:31.525722    2561 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9e1ba924-b03e-4426-b5a4-754a4882c737-istio-token\") on node \"ip-10-0-139-31.ec2.internal\" DevicePath \"\""
Jul 07 18:14:31.525739 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:14:31.525734    2561 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9e1ba924-b03e-4426-b5a4-754a4882c737-istio-data\") on node \"ip-10-0-139-31.ec2.internal\" DevicePath \"\""
Jul 07 18:14:31.526050 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:14:31.525748    2561 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9e1ba924-b03e-4426-b5a4-754a4882c737-istio-podinfo\") on node \"ip-10-0-139-31.ec2.internal\" DevicePath \"\""
Jul 07 18:14:32.255526 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:14:32.255495    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-54d21f-openshift-default-5b945dc747-wkztr"
Jul 07 18:14:32.256060 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:14:32.255496    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-54d21f-openshift-default-5b945dc747-wkztr" event={"ID":"9e1ba924-b03e-4426-b5a4-754a4882c737","Type":"ContainerDied","Data":"67d302d0dbfe4f4683080f3268cb141faa9cec8bd8d8f7be721cb891622d9018"}
Jul 07 18:14:32.256060 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:14:32.255656    2561 scope.go:117] "RemoveContainer" containerID="9cb0197953cd26fab20e6b821c1f84504c060106a5cb18f5efe2647586e850ae"
Jul 07 18:14:32.278314 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:14:32.278284    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-54d21f-openshift-default-5b945dc747-wkztr"]
Jul 07 18:14:32.284981 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:14:32.284949    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-b-54d21f-openshift-default-5b945dc747-wkztr"]
Jul 07 18:14:33.521510 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:14:33.521469    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9e1ba924-b03e-4426-b5a4-754a4882c737" path="/var/lib/kubelet/pods/9e1ba924-b03e-4426-b5a4-754a4882c737/volumes"
Jul 07 18:14:35.463868 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:14:35.463832    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-b-239e66-openshift-default-75789c6675-9xqd5"]
Jul 07 18:14:35.464401 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:14:35.464386    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9e1ba924-b03e-4426-b5a4-754a4882c737" containerName="istio-proxy"
Jul 07 18:14:35.464470 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:14:35.464405    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="9e1ba924-b03e-4426-b5a4-754a4882c737" containerName="istio-proxy"
Jul 07 18:14:35.464470 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:14:35.464435    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9e1ba924-b03e-4426-b5a4-754a4882c737" containerName="istio-proxy"
Jul 07 18:14:35.464470 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:14:35.464460    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="9e1ba924-b03e-4426-b5a4-754a4882c737" containerName="istio-proxy"
Jul 07 18:14:35.464584 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:14:35.464547    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="9e1ba924-b03e-4426-b5a4-754a4882c737" containerName="istio-proxy"
Jul 07 18:14:35.464584 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:14:35.464559    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="9e1ba924-b03e-4426-b5a4-754a4882c737" containerName="istio-proxy"
Jul 07 18:14:35.464584 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:14:35.464571    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="e067b326-842e-477e-af74-9023652530e6" containerName="istio-proxy"
Jul 07 18:14:35.469176 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:14:35.469154    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-239e66-openshift-default-75789c6675-9xqd5"
Jul 07 18:14:35.472886 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:14:35.472863    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-b-239e66-openshift-default-dockercfg-66sz7\""
Jul 07 18:14:35.480514 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:14:35.480492    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-239e66-openshift-default-75789c6675-9xqd5"]
Jul 07 18:14:35.567156 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:14:35.567104    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3c1055c9-d43b-4b3c-be86-a937b219f49d-istio-podinfo\") pod \"e2e-api-b-239e66-openshift-default-75789c6675-9xqd5\" (UID: \"3c1055c9-d43b-4b3c-be86-a937b219f49d\") " pod="openshift-ingress/e2e-api-b-239e66-openshift-default-75789c6675-9xqd5"
Jul 07 18:14:35.567381 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:14:35.567168    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3c1055c9-d43b-4b3c-be86-a937b219f49d-istio-data\") pod \"e2e-api-b-239e66-openshift-default-75789c6675-9xqd5\" (UID: \"3c1055c9-d43b-4b3c-be86-a937b219f49d\") " pod="openshift-ingress/e2e-api-b-239e66-openshift-default-75789c6675-9xqd5"
Jul 07 18:14:35.567381 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:14:35.567203    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3c1055c9-d43b-4b3c-be86-a937b219f49d-credential-socket\") pod \"e2e-api-b-239e66-openshift-default-75789c6675-9xqd5\" (UID: \"3c1055c9-d43b-4b3c-be86-a937b219f49d\") " pod="openshift-ingress/e2e-api-b-239e66-openshift-default-75789c6675-9xqd5"
Jul 07 18:14:35.567381 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:14:35.567245    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3c1055c9-d43b-4b3c-be86-a937b219f49d-istio-envoy\") pod \"e2e-api-b-239e66-openshift-default-75789c6675-9xqd5\" (UID: \"3c1055c9-d43b-4b3c-be86-a937b219f49d\") " pod="openshift-ingress/e2e-api-b-239e66-openshift-default-75789c6675-9xqd5"
Jul 07 18:14:35.567381 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:14:35.567275    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3c1055c9-d43b-4b3c-be86-a937b219f49d-workload-socket\") pod \"e2e-api-b-239e66-openshift-default-75789c6675-9xqd5\" (UID: \"3c1055c9-d43b-4b3c-be86-a937b219f49d\") " pod="openshift-ingress/e2e-api-b-239e66-openshift-default-75789c6675-9xqd5"
Jul 07 18:14:35.567381 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:14:35.567370    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3c1055c9-d43b-4b3c-be86-a937b219f49d-istiod-ca-cert\") pod \"e2e-api-b-239e66-openshift-default-75789c6675-9xqd5\" (UID: \"3c1055c9-d43b-4b3c-be86-a937b219f49d\") " pod="openshift-ingress/e2e-api-b-239e66-openshift-default-75789c6675-9xqd5"
Jul 07 18:14:35.567682 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:14:35.567407    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sr2t9\" (UniqueName: \"kubernetes.io/projected/3c1055c9-d43b-4b3c-be86-a937b219f49d-kube-api-access-sr2t9\") pod \"e2e-api-b-239e66-openshift-default-75789c6675-9xqd5\" (UID: \"3c1055c9-d43b-4b3c-be86-a937b219f49d\") " pod="openshift-ingress/e2e-api-b-239e66-openshift-default-75789c6675-9xqd5"
Jul 07 18:14:35.567682 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:14:35.567537    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3c1055c9-d43b-4b3c-be86-a937b219f49d-istio-token\") pod \"e2e-api-b-239e66-openshift-default-75789c6675-9xqd5\" (UID: \"3c1055c9-d43b-4b3c-be86-a937b219f49d\") " pod="openshift-ingress/e2e-api-b-239e66-openshift-default-75789c6675-9xqd5"
Jul 07 18:14:35.567682 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:14:35.567563    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3c1055c9-d43b-4b3c-be86-a937b219f49d-workload-certs\") pod \"e2e-api-b-239e66-openshift-default-75789c6675-9xqd5\" (UID: \"3c1055c9-d43b-4b3c-be86-a937b219f49d\") " pod="openshift-ingress/e2e-api-b-239e66-openshift-default-75789c6675-9xqd5"
Jul 07 18:14:35.669086 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:14:35.669039    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3c1055c9-d43b-4b3c-be86-a937b219f49d-istio-envoy\") pod \"e2e-api-b-239e66-openshift-default-75789c6675-9xqd5\" (UID: \"3c1055c9-d43b-4b3c-be86-a937b219f49d\") " pod="openshift-ingress/e2e-api-b-239e66-openshift-default-75789c6675-9xqd5"
Jul 07 18:14:35.669086 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:14:35.669091    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3c1055c9-d43b-4b3c-be86-a937b219f49d-workload-socket\") pod \"e2e-api-b-239e66-openshift-default-75789c6675-9xqd5\" (UID: \"3c1055c9-d43b-4b3c-be86-a937b219f49d\") " pod="openshift-ingress/e2e-api-b-239e66-openshift-default-75789c6675-9xqd5"
Jul 07 18:14:35.669355 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:14:35.669123    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3c1055c9-d43b-4b3c-be86-a937b219f49d-istiod-ca-cert\") pod \"e2e-api-b-239e66-openshift-default-75789c6675-9xqd5\" (UID: \"3c1055c9-d43b-4b3c-be86-a937b219f49d\") " pod="openshift-ingress/e2e-api-b-239e66-openshift-default-75789c6675-9xqd5"
Jul 07 18:14:35.669355 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:14:35.669144    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sr2t9\" (UniqueName: \"kubernetes.io/projected/3c1055c9-d43b-4b3c-be86-a937b219f49d-kube-api-access-sr2t9\") pod \"e2e-api-b-239e66-openshift-default-75789c6675-9xqd5\" (UID: \"3c1055c9-d43b-4b3c-be86-a937b219f49d\") " pod="openshift-ingress/e2e-api-b-239e66-openshift-default-75789c6675-9xqd5"
Jul 07 18:14:35.669355 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:14:35.669194    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3c1055c9-d43b-4b3c-be86-a937b219f49d-istio-token\") pod \"e2e-api-b-239e66-openshift-default-75789c6675-9xqd5\" (UID: \"3c1055c9-d43b-4b3c-be86-a937b219f49d\") " pod="openshift-ingress/e2e-api-b-239e66-openshift-default-75789c6675-9xqd5"
Jul 07 18:14:35.669355 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:14:35.669216    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3c1055c9-d43b-4b3c-be86-a937b219f49d-workload-certs\") pod \"e2e-api-b-239e66-openshift-default-75789c6675-9xqd5\" (UID: \"3c1055c9-d43b-4b3c-be86-a937b219f49d\") " pod="openshift-ingress/e2e-api-b-239e66-openshift-default-75789c6675-9xqd5"
Jul 07 18:14:35.669355 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:14:35.669340    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3c1055c9-d43b-4b3c-be86-a937b219f49d-istio-podinfo\") pod \"e2e-api-b-239e66-openshift-default-75789c6675-9xqd5\" (UID: \"3c1055c9-d43b-4b3c-be86-a937b219f49d\") " pod="openshift-ingress/e2e-api-b-239e66-openshift-default-75789c6675-9xqd5"
Jul 07 18:14:35.669651 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:14:35.669369    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3c1055c9-d43b-4b3c-be86-a937b219f49d-istio-data\") pod \"e2e-api-b-239e66-openshift-default-75789c6675-9xqd5\" (UID: \"3c1055c9-d43b-4b3c-be86-a937b219f49d\") " pod="openshift-ingress/e2e-api-b-239e66-openshift-default-75789c6675-9xqd5"
Jul 07 18:14:35.669651 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:14:35.669401    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3c1055c9-d43b-4b3c-be86-a937b219f49d-credential-socket\") pod \"e2e-api-b-239e66-openshift-default-75789c6675-9xqd5\" (UID: \"3c1055c9-d43b-4b3c-be86-a937b219f49d\") " pod="openshift-ingress/e2e-api-b-239e66-openshift-default-75789c6675-9xqd5"
Jul 07 18:14:35.669651 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:14:35.669616    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3c1055c9-d43b-4b3c-be86-a937b219f49d-workload-socket\") pod \"e2e-api-b-239e66-openshift-default-75789c6675-9xqd5\" (UID: \"3c1055c9-d43b-4b3c-be86-a937b219f49d\") " pod="openshift-ingress/e2e-api-b-239e66-openshift-default-75789c6675-9xqd5"
Jul 07 18:14:35.669810 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:14:35.669669    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3c1055c9-d43b-4b3c-be86-a937b219f49d-workload-certs\") pod \"e2e-api-b-239e66-openshift-default-75789c6675-9xqd5\" (UID: \"3c1055c9-d43b-4b3c-be86-a937b219f49d\") " pod="openshift-ingress/e2e-api-b-239e66-openshift-default-75789c6675-9xqd5"
Jul 07 18:14:35.669810 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:14:35.669758    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3c1055c9-d43b-4b3c-be86-a937b219f49d-credential-socket\") pod \"e2e-api-b-239e66-openshift-default-75789c6675-9xqd5\" (UID: \"3c1055c9-d43b-4b3c-be86-a937b219f49d\") " pod="openshift-ingress/e2e-api-b-239e66-openshift-default-75789c6675-9xqd5"
Jul 07 18:14:35.669810 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:14:35.669792    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3c1055c9-d43b-4b3c-be86-a937b219f49d-istio-data\") pod \"e2e-api-b-239e66-openshift-default-75789c6675-9xqd5\" (UID: \"3c1055c9-d43b-4b3c-be86-a937b219f49d\") " pod="openshift-ingress/e2e-api-b-239e66-openshift-default-75789c6675-9xqd5"
Jul 07 18:14:35.670107 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:14:35.670090    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3c1055c9-d43b-4b3c-be86-a937b219f49d-istiod-ca-cert\") pod \"e2e-api-b-239e66-openshift-default-75789c6675-9xqd5\" (UID: \"3c1055c9-d43b-4b3c-be86-a937b219f49d\") " pod="openshift-ingress/e2e-api-b-239e66-openshift-default-75789c6675-9xqd5"
Jul 07 18:14:35.671406 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:14:35.671388    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3c1055c9-d43b-4b3c-be86-a937b219f49d-istio-envoy\") pod \"e2e-api-b-239e66-openshift-default-75789c6675-9xqd5\" (UID: \"3c1055c9-d43b-4b3c-be86-a937b219f49d\") " pod="openshift-ingress/e2e-api-b-239e66-openshift-default-75789c6675-9xqd5"
Jul 07 18:14:35.671722 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:14:35.671706    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3c1055c9-d43b-4b3c-be86-a937b219f49d-istio-podinfo\") pod \"e2e-api-b-239e66-openshift-default-75789c6675-9xqd5\" (UID: \"3c1055c9-d43b-4b3c-be86-a937b219f49d\") " pod="openshift-ingress/e2e-api-b-239e66-openshift-default-75789c6675-9xqd5"
Jul 07 18:14:35.681949 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:14:35.681913    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3c1055c9-d43b-4b3c-be86-a937b219f49d-istio-token\") pod \"e2e-api-b-239e66-openshift-default-75789c6675-9xqd5\" (UID: \"3c1055c9-d43b-4b3c-be86-a937b219f49d\") " pod="openshift-ingress/e2e-api-b-239e66-openshift-default-75789c6675-9xqd5"
Jul 07 18:14:35.682085 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:14:35.682030    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sr2t9\" (UniqueName: \"kubernetes.io/projected/3c1055c9-d43b-4b3c-be86-a937b219f49d-kube-api-access-sr2t9\") pod \"e2e-api-b-239e66-openshift-default-75789c6675-9xqd5\" (UID: \"3c1055c9-d43b-4b3c-be86-a937b219f49d\") " pod="openshift-ingress/e2e-api-b-239e66-openshift-default-75789c6675-9xqd5"
Jul 07 18:14:35.779218 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:14:35.779124    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-239e66-openshift-default-75789c6675-9xqd5"
Jul 07 18:14:35.941398 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:14:35.941375    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-239e66-openshift-default-75789c6675-9xqd5"]
Jul 07 18:14:35.943523 ip-10-0-139-31 kubenswrapper[2561]: W0707 18:14:35.943493    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3c1055c9_d43b_4b3c_be86_a937b219f49d.slice/crio-49b5be10cb0df49130a43cfafe76db52cef2dcea06dfcb540c387040eeb3814b WatchSource:0}: Error finding container 49b5be10cb0df49130a43cfafe76db52cef2dcea06dfcb540c387040eeb3814b: Status 404 returned error can't find the container with id 49b5be10cb0df49130a43cfafe76db52cef2dcea06dfcb540c387040eeb3814b
Jul 07 18:14:35.945579 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:14:35.945548    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 07 18:14:35.945680 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:14:35.945624    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 07 18:14:35.945680 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:14:35.945669    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 07 18:14:36.277243 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:14:36.277196    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-239e66-openshift-default-75789c6675-9xqd5" event={"ID":"3c1055c9-d43b-4b3c-be86-a937b219f49d","Type":"ContainerStarted","Data":"8f2d94c65a15c6a47b394110b59a83e6c30be70f864a925597f4d73e1cedd6f1"}
Jul 07 18:14:36.277441 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:14:36.277268    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-239e66-openshift-default-75789c6675-9xqd5" event={"ID":"3c1055c9-d43b-4b3c-be86-a937b219f49d","Type":"ContainerStarted","Data":"49b5be10cb0df49130a43cfafe76db52cef2dcea06dfcb540c387040eeb3814b"}
Jul 07 18:14:36.779994 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:14:36.779952    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-239e66-openshift-default-75789c6675-9xqd5"
Jul 07 18:14:37.804356 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:14:37.804321    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-239e66-openshift-default-75789c6675-9xqd5"
Jul 07 18:14:37.839943 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:14:37.839892    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-b-239e66-openshift-default-75789c6675-9xqd5" podStartSLOduration=2.83987429 podStartE2EDuration="2.83987429s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 18:14:35 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 18:14:36.30375661 +0000 UTC m=+2067.454881009" watchObservedRunningTime="2026-07-07 18:14:37.83987429 +0000 UTC m=+2068.990998688"
Jul 07 18:14:38.293707 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:14:38.293613    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-239e66-openshift-default-75789c6675-9xqd5"
Jul 07 18:14:38.303934 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:14:38.303902    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-239e66-openshift-default-75789c6675-9xqd5"
Jul 07 18:14:43.322804 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:14:43.322776    2561 generic.go:356] "Generic (PLEG): container finished" podID="b6aac632-65c2-4b1a-aeb2-e012f16d100d" containerID="f8ea0d34ad08945c365b52af1397ff6fc789036709f31660b17dc34d69437cda" exitCode=0
Jul 07 18:14:43.323218 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:14:43.322814    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-b5c161-openshift-default-658c9f64c5-vj9n2" event={"ID":"b6aac632-65c2-4b1a-aeb2-e012f16d100d","Type":"ContainerDied","Data":"f8ea0d34ad08945c365b52af1397ff6fc789036709f31660b17dc34d69437cda"}
Jul 07 18:14:43.323218 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:14:43.323179    2561 scope.go:117] "RemoveContainer" containerID="f8ea0d34ad08945c365b52af1397ff6fc789036709f31660b17dc34d69437cda"
Jul 07 18:14:43.324185 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:14:43.324160    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 07 18:14:43.324237 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:14:43.324224    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 07 18:14:43.324271 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:14:43.324253    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 07 18:14:44.238255 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:14:44.238211    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-b5c161-openshift-default-658c9f64c5-vj9n2"
Jul 07 18:14:44.330174 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:14:44.330133    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-b5c161-openshift-default-658c9f64c5-vj9n2" event={"ID":"b6aac632-65c2-4b1a-aeb2-e012f16d100d","Type":"ContainerStarted","Data":"6190b231c7a462efa949efaed7b1aecb67fd413748c4db826cc99d366fe3ff67"}
Jul 07 18:14:45.301805 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:14:45.301767    2561 patch_prober.go:28] interesting pod/e2e-api-a-b5c161-openshift-default-658c9f64c5-vj9n2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.43:15021/healthz/ready\": dial tcp 10.132.0.43:15021: connect: connection refused" start-of-body=
Jul 07 18:14:45.302115 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:14:45.302073    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-b5c161-openshift-default-658c9f64c5-vj9n2" podUID="b6aac632-65c2-4b1a-aeb2-e012f16d100d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.43:15021/healthz/ready\": dial tcp 10.132.0.43:15021: connect: connection refused"
Jul 07 18:14:45.302594 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:14:45.302575    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-b5c161-openshift-default-658c9f64c5-vj9n2"
Jul 07 18:14:46.303485 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:14:46.302998    2561 patch_prober.go:28] interesting pod/e2e-api-a-b5c161-openshift-default-658c9f64c5-vj9n2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.43:15021/healthz/ready\": dial tcp 10.132.0.43:15021: connect: connection refused" start-of-body=
Jul 07 18:14:46.303485 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:14:46.303069    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-b5c161-openshift-default-658c9f64c5-vj9n2" podUID="b6aac632-65c2-4b1a-aeb2-e012f16d100d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.43:15021/healthz/ready\": dial tcp 10.132.0.43:15021: connect: connection refused"
Jul 07 18:14:47.301029 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:14:47.300988    2561 patch_prober.go:28] interesting pod/e2e-api-a-b5c161-openshift-default-658c9f64c5-vj9n2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.43:15021/healthz/ready\": dial tcp 10.132.0.43:15021: connect: connection refused" start-of-body=
Jul 07 18:14:47.301343 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:14:47.301313    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-b5c161-openshift-default-658c9f64c5-vj9n2" podUID="b6aac632-65c2-4b1a-aeb2-e012f16d100d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.43:15021/healthz/ready\": dial tcp 10.132.0.43:15021: connect: connection refused"
Jul 07 18:14:48.314815 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:14:48.314776    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-b5c161-openshift-default-658c9f64c5-vj9n2"
Jul 07 18:14:48.315305 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:14:48.315206    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-b5c161-openshift-default-658c9f64c5-vj9n2"
Jul 07 18:14:48.317514 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:14:48.317491    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-b5c161-openshift-default-658c9f64c5-vj9n2"
Jul 07 18:14:51.375380 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:14:51.375349    2561 generic.go:356] "Generic (PLEG): container finished" podID="3c1055c9-d43b-4b3c-be86-a937b219f49d" containerID="8f2d94c65a15c6a47b394110b59a83e6c30be70f864a925597f4d73e1cedd6f1" exitCode=0
Jul 07 18:14:51.375927 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:14:51.375422    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-239e66-openshift-default-75789c6675-9xqd5" event={"ID":"3c1055c9-d43b-4b3c-be86-a937b219f49d","Type":"ContainerDied","Data":"8f2d94c65a15c6a47b394110b59a83e6c30be70f864a925597f4d73e1cedd6f1"}
Jul 07 18:14:51.376112 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:14:51.376095    2561 scope.go:117] "RemoveContainer" containerID="8f2d94c65a15c6a47b394110b59a83e6c30be70f864a925597f4d73e1cedd6f1"
Jul 07 18:14:51.377346 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:14:51.377319    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 07 18:14:51.377412 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:14:51.377393    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 07 18:14:51.377487 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:14:51.377472    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 07 18:14:52.382215 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:14:52.382181    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-239e66-openshift-default-75789c6675-9xqd5" event={"ID":"3c1055c9-d43b-4b3c-be86-a937b219f49d","Type":"ContainerStarted","Data":"d5ccf5e54ac7b6d7b9213d35a1cb845bf84e4651afc0d57f7bca3174935b5a87"}
Jul 07 18:14:52.780483 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:14:52.780359    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-239e66-openshift-default-75789c6675-9xqd5"
Jul 07 18:14:52.781614 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:14:52.781580    2561 patch_prober.go:28] interesting pod/e2e-api-b-239e66-openshift-default-75789c6675-9xqd5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.44:15021/healthz/ready\": dial tcp 10.132.0.44:15021: connect: connection refused" start-of-body=
Jul 07 18:14:52.781762 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:14:52.781641    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-239e66-openshift-default-75789c6675-9xqd5" podUID="3c1055c9-d43b-4b3c-be86-a937b219f49d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.44:15021/healthz/ready\": dial tcp 10.132.0.44:15021: connect: connection refused"
Jul 07 18:14:53.293788 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:14:53.293742    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-239e66-openshift-default-75789c6675-9xqd5"
Jul 07 18:14:53.779640 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:14:53.779599    2561 patch_prober.go:28] interesting pod/e2e-api-b-239e66-openshift-default-75789c6675-9xqd5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.44:15021/healthz/ready\": dial tcp 10.132.0.44:15021: connect: connection refused" start-of-body=
Jul 07 18:14:53.780138 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:14:53.779674    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-239e66-openshift-default-75789c6675-9xqd5" podUID="3c1055c9-d43b-4b3c-be86-a937b219f49d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.44:15021/healthz/ready\": dial tcp 10.132.0.44:15021: connect: connection refused"
Jul 07 18:14:54.779888 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:14:54.779843    2561 patch_prober.go:28] interesting pod/e2e-api-b-239e66-openshift-default-75789c6675-9xqd5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.44:15021/healthz/ready\": dial tcp 10.132.0.44:15021: connect: connection refused" start-of-body=
Jul 07 18:14:54.780393 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:14:54.779911    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-239e66-openshift-default-75789c6675-9xqd5" podUID="3c1055c9-d43b-4b3c-be86-a937b219f49d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.44:15021/healthz/ready\": dial tcp 10.132.0.44:15021: connect: connection refused"
Jul 07 18:14:55.779940 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:14:55.779896    2561 patch_prober.go:28] interesting pod/e2e-api-b-239e66-openshift-default-75789c6675-9xqd5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.44:15021/healthz/ready\": dial tcp 10.132.0.44:15021: connect: connection refused" start-of-body=
Jul 07 18:14:55.780482 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:14:55.779985    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-239e66-openshift-default-75789c6675-9xqd5" podUID="3c1055c9-d43b-4b3c-be86-a937b219f49d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.44:15021/healthz/ready\": dial tcp 10.132.0.44:15021: connect: connection refused"
Jul 07 18:14:56.783667 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:14:56.783636    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-239e66-openshift-default-75789c6675-9xqd5"
Jul 07 18:14:56.784758 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:14:56.784738    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-239e66-openshift-default-75789c6675-9xqd5"
Jul 07 18:14:57.779917 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:14:57.779880    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-b5c161-openshift-default-658c9f64c5-vj9n2"]
Jul 07 18:14:57.780118 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:14:57.780093    2561 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-api-a-b5c161-openshift-default-658c9f64c5-vj9n2" podUID="b6aac632-65c2-4b1a-aeb2-e012f16d100d" containerName="istio-proxy" containerID="cri-o://6190b231c7a462efa949efaed7b1aecb67fd413748c4db826cc99d366fe3ff67" gracePeriod=30
Jul 07 18:15:00.142015 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:15:00.141977    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29724135-tlw5j"]
Jul 07 18:15:00.145982 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:15:00.145963    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29724135-tlw5j"
Jul 07 18:15:00.149298 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:15:00.149275    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 07 18:15:00.149440 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:15:00.149422    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 07 18:15:00.149440 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:15:00.149423    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-mg6kl\""
Jul 07 18:15:00.157691 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:15:00.157668    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29724135-tlw5j"]
Jul 07 18:15:00.226226 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:15:00.226181    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kncf9\" (UniqueName: \"kubernetes.io/projected/76f16250-36f6-46cf-a2ce-6a9ef0d3e477-kube-api-access-kncf9\") pod \"maas-api-key-cleanup-29724135-tlw5j\" (UID: \"76f16250-36f6-46cf-a2ce-6a9ef0d3e477\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-29724135-tlw5j"
Jul 07 18:15:00.327647 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:15:00.327612    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kncf9\" (UniqueName: \"kubernetes.io/projected/76f16250-36f6-46cf-a2ce-6a9ef0d3e477-kube-api-access-kncf9\") pod \"maas-api-key-cleanup-29724135-tlw5j\" (UID: \"76f16250-36f6-46cf-a2ce-6a9ef0d3e477\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-29724135-tlw5j"
Jul 07 18:15:00.338006 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:15:00.337974    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kncf9\" (UniqueName: \"kubernetes.io/projected/76f16250-36f6-46cf-a2ce-6a9ef0d3e477-kube-api-access-kncf9\") pod \"maas-api-key-cleanup-29724135-tlw5j\" (UID: \"76f16250-36f6-46cf-a2ce-6a9ef0d3e477\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-29724135-tlw5j"
Jul 07 18:15:00.456292 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:15:00.456197    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29724135-tlw5j"
Jul 07 18:15:00.590012 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:15:00.589946    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29724135-tlw5j"]
Jul 07 18:15:00.592377 ip-10-0-139-31 kubenswrapper[2561]: W0707 18:15:00.592350    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod76f16250_36f6_46cf_a2ce_6a9ef0d3e477.slice/crio-199c5d161ade4a7f691035a069d53e893c6d5a5a4071907337da629cd4e5122c WatchSource:0}: Error finding container 199c5d161ade4a7f691035a069d53e893c6d5a5a4071907337da629cd4e5122c: Status 404 returned error can't find the container with id 199c5d161ade4a7f691035a069d53e893c6d5a5a4071907337da629cd4e5122c
Jul 07 18:15:01.433402 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:15:01.433364    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29724135-tlw5j" event={"ID":"76f16250-36f6-46cf-a2ce-6a9ef0d3e477","Type":"ContainerStarted","Data":"a7d1e60a5683d9e7ee7e69dcd439779f4300afdc1b030c8171c326bf48dd6b19"}
Jul 07 18:15:01.433829 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:15:01.433471    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29724135-tlw5j" event={"ID":"76f16250-36f6-46cf-a2ce-6a9ef0d3e477","Type":"ContainerStarted","Data":"199c5d161ade4a7f691035a069d53e893c6d5a5a4071907337da629cd4e5122c"}
Jul 07 18:15:01.453716 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:15:01.453663    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29724135-tlw5j" podStartSLOduration=1.453647212 podStartE2EDuration="1.453647212s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 18:15:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 18:15:01.451225482 +0000 UTC m=+2092.602349881" watchObservedRunningTime="2026-07-07 18:15:01.453647212 +0000 UTC m=+2092.604771613"
Jul 07 18:15:03.044725 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:15:03.044654    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-b5c161-openshift-default-658c9f64c5-vj9n2"
Jul 07 18:15:03.154854 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:15:03.154813    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b6aac632-65c2-4b1a-aeb2-e012f16d100d-workload-socket\") pod \"b6aac632-65c2-4b1a-aeb2-e012f16d100d\" (UID: \"b6aac632-65c2-4b1a-aeb2-e012f16d100d\") "
Jul 07 18:15:03.154854 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:15:03.154851    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b6aac632-65c2-4b1a-aeb2-e012f16d100d-istio-data\") pod \"b6aac632-65c2-4b1a-aeb2-e012f16d100d\" (UID: \"b6aac632-65c2-4b1a-aeb2-e012f16d100d\") "
Jul 07 18:15:03.155104 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:15:03.154872    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b6aac632-65c2-4b1a-aeb2-e012f16d100d-istiod-ca-cert\") pod \"b6aac632-65c2-4b1a-aeb2-e012f16d100d\" (UID: \"b6aac632-65c2-4b1a-aeb2-e012f16d100d\") "
Jul 07 18:15:03.155104 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:15:03.154899    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b6aac632-65c2-4b1a-aeb2-e012f16d100d-istio-token\") pod \"b6aac632-65c2-4b1a-aeb2-e012f16d100d\" (UID: \"b6aac632-65c2-4b1a-aeb2-e012f16d100d\") "
Jul 07 18:15:03.155104 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:15:03.154924    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b6aac632-65c2-4b1a-aeb2-e012f16d100d-workload-certs\") pod \"b6aac632-65c2-4b1a-aeb2-e012f16d100d\" (UID: \"b6aac632-65c2-4b1a-aeb2-e012f16d100d\") "
Jul 07 18:15:03.155104 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:15:03.154963    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b6aac632-65c2-4b1a-aeb2-e012f16d100d-istio-podinfo\") pod \"b6aac632-65c2-4b1a-aeb2-e012f16d100d\" (UID: \"b6aac632-65c2-4b1a-aeb2-e012f16d100d\") "
Jul 07 18:15:03.155104 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:15:03.155010    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b6aac632-65c2-4b1a-aeb2-e012f16d100d-istio-envoy\") pod \"b6aac632-65c2-4b1a-aeb2-e012f16d100d\" (UID: \"b6aac632-65c2-4b1a-aeb2-e012f16d100d\") "
Jul 07 18:15:03.155104 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:15:03.155048    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b6aac632-65c2-4b1a-aeb2-e012f16d100d-credential-socket\") pod \"b6aac632-65c2-4b1a-aeb2-e012f16d100d\" (UID: \"b6aac632-65c2-4b1a-aeb2-e012f16d100d\") "
Jul 07 18:15:03.155104 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:15:03.155071    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xldq9\" (UniqueName: \"kubernetes.io/projected/b6aac632-65c2-4b1a-aeb2-e012f16d100d-kube-api-access-xldq9\") pod \"b6aac632-65c2-4b1a-aeb2-e012f16d100d\" (UID: \"b6aac632-65c2-4b1a-aeb2-e012f16d100d\") "
Jul 07 18:15:03.155440 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:15:03.155283    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b6aac632-65c2-4b1a-aeb2-e012f16d100d-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "b6aac632-65c2-4b1a-aeb2-e012f16d100d" (UID: "b6aac632-65c2-4b1a-aeb2-e012f16d100d"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 18:15:03.155440 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:15:03.155289    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b6aac632-65c2-4b1a-aeb2-e012f16d100d-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "b6aac632-65c2-4b1a-aeb2-e012f16d100d" (UID: "b6aac632-65c2-4b1a-aeb2-e012f16d100d"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 18:15:03.155593 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:15:03.155558    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b6aac632-65c2-4b1a-aeb2-e012f16d100d-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "b6aac632-65c2-4b1a-aeb2-e012f16d100d" (UID: "b6aac632-65c2-4b1a-aeb2-e012f16d100d"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 18:15:03.155711 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:15:03.155662    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b6aac632-65c2-4b1a-aeb2-e012f16d100d-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "b6aac632-65c2-4b1a-aeb2-e012f16d100d" (UID: "b6aac632-65c2-4b1a-aeb2-e012f16d100d"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 18:15:03.155945 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:15:03.155925    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b6aac632-65c2-4b1a-aeb2-e012f16d100d-istio-data" (OuterVolumeSpecName: "istio-data") pod "b6aac632-65c2-4b1a-aeb2-e012f16d100d" (UID: "b6aac632-65c2-4b1a-aeb2-e012f16d100d"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 18:15:03.157399 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:15:03.157373    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b6aac632-65c2-4b1a-aeb2-e012f16d100d-kube-api-access-xldq9" (OuterVolumeSpecName: "kube-api-access-xldq9") pod "b6aac632-65c2-4b1a-aeb2-e012f16d100d" (UID: "b6aac632-65c2-4b1a-aeb2-e012f16d100d"). InnerVolumeSpecName "kube-api-access-xldq9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 18:15:03.157399 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:15:03.157377    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/b6aac632-65c2-4b1a-aeb2-e012f16d100d-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "b6aac632-65c2-4b1a-aeb2-e012f16d100d" (UID: "b6aac632-65c2-4b1a-aeb2-e012f16d100d"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 07 18:15:03.157567 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:15:03.157552    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b6aac632-65c2-4b1a-aeb2-e012f16d100d-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "b6aac632-65c2-4b1a-aeb2-e012f16d100d" (UID: "b6aac632-65c2-4b1a-aeb2-e012f16d100d"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 18:15:03.157711 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:15:03.157691    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b6aac632-65c2-4b1a-aeb2-e012f16d100d-istio-token" (OuterVolumeSpecName: "istio-token") pod "b6aac632-65c2-4b1a-aeb2-e012f16d100d" (UID: "b6aac632-65c2-4b1a-aeb2-e012f16d100d"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 18:15:03.256683 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:15:03.256643    2561 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b6aac632-65c2-4b1a-aeb2-e012f16d100d-istio-envoy\") on node \"ip-10-0-139-31.ec2.internal\" DevicePath \"\""
Jul 07 18:15:03.256683 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:15:03.256677    2561 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b6aac632-65c2-4b1a-aeb2-e012f16d100d-credential-socket\") on node \"ip-10-0-139-31.ec2.internal\" DevicePath \"\""
Jul 07 18:15:03.256683 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:15:03.256690    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xldq9\" (UniqueName: \"kubernetes.io/projected/b6aac632-65c2-4b1a-aeb2-e012f16d100d-kube-api-access-xldq9\") on node \"ip-10-0-139-31.ec2.internal\" DevicePath \"\""
Jul 07 18:15:03.256940 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:15:03.256705    2561 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b6aac632-65c2-4b1a-aeb2-e012f16d100d-workload-socket\") on node \"ip-10-0-139-31.ec2.internal\" DevicePath \"\""
Jul 07 18:15:03.256940 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:15:03.256716    2561 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b6aac632-65c2-4b1a-aeb2-e012f16d100d-istio-data\") on node \"ip-10-0-139-31.ec2.internal\" DevicePath \"\""
Jul 07 18:15:03.256940 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:15:03.256727    2561 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b6aac632-65c2-4b1a-aeb2-e012f16d100d-istiod-ca-cert\") on node \"ip-10-0-139-31.ec2.internal\" DevicePath \"\""
Jul 07 18:15:03.256940 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:15:03.256737    2561 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b6aac632-65c2-4b1a-aeb2-e012f16d100d-istio-token\") on node \"ip-10-0-139-31.ec2.internal\" DevicePath \"\""
Jul 07 18:15:03.256940 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:15:03.256748    2561 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b6aac632-65c2-4b1a-aeb2-e012f16d100d-workload-certs\") on node \"ip-10-0-139-31.ec2.internal\" DevicePath \"\""
Jul 07 18:15:03.256940 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:15:03.256758    2561 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b6aac632-65c2-4b1a-aeb2-e012f16d100d-istio-podinfo\") on node \"ip-10-0-139-31.ec2.internal\" DevicePath \"\""
Jul 07 18:15:03.444938 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:15:03.444906    2561 generic.go:356] "Generic (PLEG): container finished" podID="b6aac632-65c2-4b1a-aeb2-e012f16d100d" containerID="6190b231c7a462efa949efaed7b1aecb67fd413748c4db826cc99d366fe3ff67" exitCode=0
Jul 07 18:15:03.445120 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:15:03.444949    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-b5c161-openshift-default-658c9f64c5-vj9n2"
Jul 07 18:15:03.445120 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:15:03.445003    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-b5c161-openshift-default-658c9f64c5-vj9n2" event={"ID":"b6aac632-65c2-4b1a-aeb2-e012f16d100d","Type":"ContainerDied","Data":"6190b231c7a462efa949efaed7b1aecb67fd413748c4db826cc99d366fe3ff67"}
Jul 07 18:15:03.445120 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:15:03.445060    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-b5c161-openshift-default-658c9f64c5-vj9n2" event={"ID":"b6aac632-65c2-4b1a-aeb2-e012f16d100d","Type":"ContainerDied","Data":"cf3bba5ba48ba7125502cceb5773d7c1e1cc93bbe6aa2c9449ba39c1ee18ed89"}
Jul 07 18:15:03.445120 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:15:03.445084    2561 scope.go:117] "RemoveContainer" containerID="6190b231c7a462efa949efaed7b1aecb67fd413748c4db826cc99d366fe3ff67"
Jul 07 18:15:03.454537 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:15:03.454520    2561 scope.go:117] "RemoveContainer" containerID="f8ea0d34ad08945c365b52af1397ff6fc789036709f31660b17dc34d69437cda"
Jul 07 18:15:03.464196 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:15:03.464177    2561 scope.go:117] "RemoveContainer" containerID="6190b231c7a462efa949efaed7b1aecb67fd413748c4db826cc99d366fe3ff67"
Jul 07 18:15:03.464538 ip-10-0-139-31 kubenswrapper[2561]: E0707 18:15:03.464516    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6190b231c7a462efa949efaed7b1aecb67fd413748c4db826cc99d366fe3ff67\": container with ID starting with 6190b231c7a462efa949efaed7b1aecb67fd413748c4db826cc99d366fe3ff67 not found: ID does not exist" containerID="6190b231c7a462efa949efaed7b1aecb67fd413748c4db826cc99d366fe3ff67"
Jul 07 18:15:03.464633 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:15:03.464571    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6190b231c7a462efa949efaed7b1aecb67fd413748c4db826cc99d366fe3ff67"} err="failed to get container status \"6190b231c7a462efa949efaed7b1aecb67fd413748c4db826cc99d366fe3ff67\": rpc error: code = NotFound desc = could not find container \"6190b231c7a462efa949efaed7b1aecb67fd413748c4db826cc99d366fe3ff67\": container with ID starting with 6190b231c7a462efa949efaed7b1aecb67fd413748c4db826cc99d366fe3ff67 not found: ID does not exist"
Jul 07 18:15:03.464633 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:15:03.464591    2561 scope.go:117] "RemoveContainer" containerID="f8ea0d34ad08945c365b52af1397ff6fc789036709f31660b17dc34d69437cda"
Jul 07 18:15:03.464888 ip-10-0-139-31 kubenswrapper[2561]: E0707 18:15:03.464869    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f8ea0d34ad08945c365b52af1397ff6fc789036709f31660b17dc34d69437cda\": container with ID starting with f8ea0d34ad08945c365b52af1397ff6fc789036709f31660b17dc34d69437cda not found: ID does not exist" containerID="f8ea0d34ad08945c365b52af1397ff6fc789036709f31660b17dc34d69437cda"
Jul 07 18:15:03.464946 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:15:03.464892    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f8ea0d34ad08945c365b52af1397ff6fc789036709f31660b17dc34d69437cda"} err="failed to get container status \"f8ea0d34ad08945c365b52af1397ff6fc789036709f31660b17dc34d69437cda\": rpc error: code = NotFound desc = could not find container \"f8ea0d34ad08945c365b52af1397ff6fc789036709f31660b17dc34d69437cda\": container with ID starting with f8ea0d34ad08945c365b52af1397ff6fc789036709f31660b17dc34d69437cda not found: ID does not exist"
Jul 07 18:15:03.473268 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:15:03.473235    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-b5c161-openshift-default-658c9f64c5-vj9n2"]
Jul 07 18:15:03.480541 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:15:03.480513    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-a-b5c161-openshift-default-658c9f64c5-vj9n2"]
Jul 07 18:15:03.521719 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:15:03.521679    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b6aac632-65c2-4b1a-aeb2-e012f16d100d" path="/var/lib/kubelet/pods/b6aac632-65c2-4b1a-aeb2-e012f16d100d/volumes"
Jul 07 18:15:05.252531 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:15:05.252495    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-239e66-openshift-default-75789c6675-9xqd5"]
Jul 07 18:15:05.252978 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:15:05.252723    2561 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-api-b-239e66-openshift-default-75789c6675-9xqd5" podUID="3c1055c9-d43b-4b3c-be86-a937b219f49d" containerName="istio-proxy" containerID="cri-o://d5ccf5e54ac7b6d7b9213d35a1cb845bf84e4651afc0d57f7bca3174935b5a87" gracePeriod=30
Jul 07 18:15:06.187382 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:15:06.187343    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-a-21f62c-openshift-default-9b4fd55ff-cmgvf"]
Jul 07 18:15:06.187842 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:15:06.187826    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b6aac632-65c2-4b1a-aeb2-e012f16d100d" containerName="istio-proxy"
Jul 07 18:15:06.187901 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:15:06.187846    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="b6aac632-65c2-4b1a-aeb2-e012f16d100d" containerName="istio-proxy"
Jul 07 18:15:06.187901 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:15:06.187869    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b6aac632-65c2-4b1a-aeb2-e012f16d100d" containerName="istio-proxy"
Jul 07 18:15:06.187901 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:15:06.187876    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="b6aac632-65c2-4b1a-aeb2-e012f16d100d" containerName="istio-proxy"
Jul 07 18:15:06.188015 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:15:06.187991    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="b6aac632-65c2-4b1a-aeb2-e012f16d100d" containerName="istio-proxy"
Jul 07 18:15:06.188015 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:15:06.188007    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="b6aac632-65c2-4b1a-aeb2-e012f16d100d" containerName="istio-proxy"
Jul 07 18:15:06.192769 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:15:06.192748    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-21f62c-openshift-default-9b4fd55ff-cmgvf"
Jul 07 18:15:06.197188 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:15:06.197169    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-a-21f62c-openshift-default-dockercfg-l6bnf\""
Jul 07 18:15:06.212142 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:15:06.212111    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-21f62c-openshift-default-9b4fd55ff-cmgvf"]
Jul 07 18:15:06.290093 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:15:06.290049    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ced5755d-ed11-4d78-b647-9b5ee29156ad-istio-envoy\") pod \"e2e-shared-a-21f62c-openshift-default-9b4fd55ff-cmgvf\" (UID: \"ced5755d-ed11-4d78-b647-9b5ee29156ad\") " pod="openshift-ingress/e2e-shared-a-21f62c-openshift-default-9b4fd55ff-cmgvf"
Jul 07 18:15:06.290576 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:15:06.290117    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4xdz5\" (UniqueName: \"kubernetes.io/projected/ced5755d-ed11-4d78-b647-9b5ee29156ad-kube-api-access-4xdz5\") pod \"e2e-shared-a-21f62c-openshift-default-9b4fd55ff-cmgvf\" (UID: \"ced5755d-ed11-4d78-b647-9b5ee29156ad\") " pod="openshift-ingress/e2e-shared-a-21f62c-openshift-default-9b4fd55ff-cmgvf"
Jul 07 18:15:06.290576 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:15:06.290156    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ced5755d-ed11-4d78-b647-9b5ee29156ad-istiod-ca-cert\") pod \"e2e-shared-a-21f62c-openshift-default-9b4fd55ff-cmgvf\" (UID: \"ced5755d-ed11-4d78-b647-9b5ee29156ad\") " pod="openshift-ingress/e2e-shared-a-21f62c-openshift-default-9b4fd55ff-cmgvf"
Jul 07 18:15:06.290576 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:15:06.290185    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ced5755d-ed11-4d78-b647-9b5ee29156ad-istio-data\") pod \"e2e-shared-a-21f62c-openshift-default-9b4fd55ff-cmgvf\" (UID: \"ced5755d-ed11-4d78-b647-9b5ee29156ad\") " pod="openshift-ingress/e2e-shared-a-21f62c-openshift-default-9b4fd55ff-cmgvf"
Jul 07 18:15:06.290576 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:15:06.290208    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ced5755d-ed11-4d78-b647-9b5ee29156ad-istio-podinfo\") pod \"e2e-shared-a-21f62c-openshift-default-9b4fd55ff-cmgvf\" (UID: \"ced5755d-ed11-4d78-b647-9b5ee29156ad\") " pod="openshift-ingress/e2e-shared-a-21f62c-openshift-default-9b4fd55ff-cmgvf"
Jul 07 18:15:06.290576 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:15:06.290287    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ced5755d-ed11-4d78-b647-9b5ee29156ad-workload-socket\") pod \"e2e-shared-a-21f62c-openshift-default-9b4fd55ff-cmgvf\" (UID: \"ced5755d-ed11-4d78-b647-9b5ee29156ad\") " pod="openshift-ingress/e2e-shared-a-21f62c-openshift-default-9b4fd55ff-cmgvf"
Jul 07 18:15:06.290576 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:15:06.290336    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ced5755d-ed11-4d78-b647-9b5ee29156ad-workload-certs\") pod \"e2e-shared-a-21f62c-openshift-default-9b4fd55ff-cmgvf\" (UID: \"ced5755d-ed11-4d78-b647-9b5ee29156ad\") " pod="openshift-ingress/e2e-shared-a-21f62c-openshift-default-9b4fd55ff-cmgvf"
Jul 07 18:15:06.290576 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:15:06.290373    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ced5755d-ed11-4d78-b647-9b5ee29156ad-istio-token\") pod \"e2e-shared-a-21f62c-openshift-default-9b4fd55ff-cmgvf\" (UID: \"ced5755d-ed11-4d78-b647-9b5ee29156ad\") " pod="openshift-ingress/e2e-shared-a-21f62c-openshift-default-9b4fd55ff-cmgvf"
Jul 07 18:15:06.290576 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:15:06.290398    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ced5755d-ed11-4d78-b647-9b5ee29156ad-credential-socket\") pod \"e2e-shared-a-21f62c-openshift-default-9b4fd55ff-cmgvf\" (UID: \"ced5755d-ed11-4d78-b647-9b5ee29156ad\") " pod="openshift-ingress/e2e-shared-a-21f62c-openshift-default-9b4fd55ff-cmgvf"
Jul 07 18:15:06.391276 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:15:06.391235    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ced5755d-ed11-4d78-b647-9b5ee29156ad-istio-envoy\") pod \"e2e-shared-a-21f62c-openshift-default-9b4fd55ff-cmgvf\" (UID: \"ced5755d-ed11-4d78-b647-9b5ee29156ad\") " pod="openshift-ingress/e2e-shared-a-21f62c-openshift-default-9b4fd55ff-cmgvf"
Jul 07 18:15:06.391276 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:15:06.391281    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4xdz5\" (UniqueName: \"kubernetes.io/projected/ced5755d-ed11-4d78-b647-9b5ee29156ad-kube-api-access-4xdz5\") pod \"e2e-shared-a-21f62c-openshift-default-9b4fd55ff-cmgvf\" (UID: \"ced5755d-ed11-4d78-b647-9b5ee29156ad\") " pod="openshift-ingress/e2e-shared-a-21f62c-openshift-default-9b4fd55ff-cmgvf"
Jul 07 18:15:06.391589 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:15:06.391305    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ced5755d-ed11-4d78-b647-9b5ee29156ad-istiod-ca-cert\") pod \"e2e-shared-a-21f62c-openshift-default-9b4fd55ff-cmgvf\" (UID: \"ced5755d-ed11-4d78-b647-9b5ee29156ad\") " pod="openshift-ingress/e2e-shared-a-21f62c-openshift-default-9b4fd55ff-cmgvf"
Jul 07 18:15:06.391589 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:15:06.391323    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ced5755d-ed11-4d78-b647-9b5ee29156ad-istio-data\") pod \"e2e-shared-a-21f62c-openshift-default-9b4fd55ff-cmgvf\" (UID: \"ced5755d-ed11-4d78-b647-9b5ee29156ad\") " pod="openshift-ingress/e2e-shared-a-21f62c-openshift-default-9b4fd55ff-cmgvf"
Jul 07 18:15:06.391589 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:15:06.391340    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ced5755d-ed11-4d78-b647-9b5ee29156ad-istio-podinfo\") pod \"e2e-shared-a-21f62c-openshift-default-9b4fd55ff-cmgvf\" (UID: \"ced5755d-ed11-4d78-b647-9b5ee29156ad\") " pod="openshift-ingress/e2e-shared-a-21f62c-openshift-default-9b4fd55ff-cmgvf"
Jul 07 18:15:06.391589 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:15:06.391393    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ced5755d-ed11-4d78-b647-9b5ee29156ad-workload-socket\") pod \"e2e-shared-a-21f62c-openshift-default-9b4fd55ff-cmgvf\" (UID: \"ced5755d-ed11-4d78-b647-9b5ee29156ad\") " pod="openshift-ingress/e2e-shared-a-21f62c-openshift-default-9b4fd55ff-cmgvf"
Jul 07 18:15:06.391589 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:15:06.391425    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ced5755d-ed11-4d78-b647-9b5ee29156ad-workload-certs\") pod \"e2e-shared-a-21f62c-openshift-default-9b4fd55ff-cmgvf\" (UID: \"ced5755d-ed11-4d78-b647-9b5ee29156ad\") " pod="openshift-ingress/e2e-shared-a-21f62c-openshift-default-9b4fd55ff-cmgvf"
Jul 07 18:15:06.391589 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:15:06.391493    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ced5755d-ed11-4d78-b647-9b5ee29156ad-istio-token\") pod \"e2e-shared-a-21f62c-openshift-default-9b4fd55ff-cmgvf\" (UID: \"ced5755d-ed11-4d78-b647-9b5ee29156ad\") " pod="openshift-ingress/e2e-shared-a-21f62c-openshift-default-9b4fd55ff-cmgvf"
Jul 07 18:15:06.391589 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:15:06.391518    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ced5755d-ed11-4d78-b647-9b5ee29156ad-credential-socket\") pod \"e2e-shared-a-21f62c-openshift-default-9b4fd55ff-cmgvf\" (UID: \"ced5755d-ed11-4d78-b647-9b5ee29156ad\") " pod="openshift-ingress/e2e-shared-a-21f62c-openshift-default-9b4fd55ff-cmgvf"
Jul 07 18:15:06.391955 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:15:06.391811    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ced5755d-ed11-4d78-b647-9b5ee29156ad-istio-data\") pod \"e2e-shared-a-21f62c-openshift-default-9b4fd55ff-cmgvf\" (UID: \"ced5755d-ed11-4d78-b647-9b5ee29156ad\") " pod="openshift-ingress/e2e-shared-a-21f62c-openshift-default-9b4fd55ff-cmgvf"
Jul 07 18:15:06.391955 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:15:06.391910    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ced5755d-ed11-4d78-b647-9b5ee29156ad-workload-certs\") pod \"e2e-shared-a-21f62c-openshift-default-9b4fd55ff-cmgvf\" (UID: \"ced5755d-ed11-4d78-b647-9b5ee29156ad\") " pod="openshift-ingress/e2e-shared-a-21f62c-openshift-default-9b4fd55ff-cmgvf"
Jul 07 18:15:06.392138 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:15:06.392106    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ced5755d-ed11-4d78-b647-9b5ee29156ad-credential-socket\") pod \"e2e-shared-a-21f62c-openshift-default-9b4fd55ff-cmgvf\" (UID: \"ced5755d-ed11-4d78-b647-9b5ee29156ad\") " pod="openshift-ingress/e2e-shared-a-21f62c-openshift-default-9b4fd55ff-cmgvf"
Jul 07 18:15:06.392249 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:15:06.392185    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ced5755d-ed11-4d78-b647-9b5ee29156ad-workload-socket\") pod \"e2e-shared-a-21f62c-openshift-default-9b4fd55ff-cmgvf\" (UID: \"ced5755d-ed11-4d78-b647-9b5ee29156ad\") " pod="openshift-ingress/e2e-shared-a-21f62c-openshift-default-9b4fd55ff-cmgvf"
Jul 07 18:15:06.392249 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:15:06.392191    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ced5755d-ed11-4d78-b647-9b5ee29156ad-istiod-ca-cert\") pod \"e2e-shared-a-21f62c-openshift-default-9b4fd55ff-cmgvf\" (UID: \"ced5755d-ed11-4d78-b647-9b5ee29156ad\") " pod="openshift-ingress/e2e-shared-a-21f62c-openshift-default-9b4fd55ff-cmgvf"
Jul 07 18:15:06.393549 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:15:06.393531    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ced5755d-ed11-4d78-b647-9b5ee29156ad-istio-envoy\") pod \"e2e-shared-a-21f62c-openshift-default-9b4fd55ff-cmgvf\" (UID: \"ced5755d-ed11-4d78-b647-9b5ee29156ad\") " pod="openshift-ingress/e2e-shared-a-21f62c-openshift-default-9b4fd55ff-cmgvf"
Jul 07 18:15:06.393966 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:15:06.393943    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ced5755d-ed11-4d78-b647-9b5ee29156ad-istio-podinfo\") pod \"e2e-shared-a-21f62c-openshift-default-9b4fd55ff-cmgvf\" (UID: \"ced5755d-ed11-4d78-b647-9b5ee29156ad\") " pod="openshift-ingress/e2e-shared-a-21f62c-openshift-default-9b4fd55ff-cmgvf"
Jul 07 18:15:06.400761 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:15:06.400740    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ced5755d-ed11-4d78-b647-9b5ee29156ad-istio-token\") pod \"e2e-shared-a-21f62c-openshift-default-9b4fd55ff-cmgvf\" (UID: \"ced5755d-ed11-4d78-b647-9b5ee29156ad\") " pod="openshift-ingress/e2e-shared-a-21f62c-openshift-default-9b4fd55ff-cmgvf"
Jul 07 18:15:06.401076 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:15:06.401057    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4xdz5\" (UniqueName: \"kubernetes.io/projected/ced5755d-ed11-4d78-b647-9b5ee29156ad-kube-api-access-4xdz5\") pod \"e2e-shared-a-21f62c-openshift-default-9b4fd55ff-cmgvf\" (UID: \"ced5755d-ed11-4d78-b647-9b5ee29156ad\") " pod="openshift-ingress/e2e-shared-a-21f62c-openshift-default-9b4fd55ff-cmgvf"
Jul 07 18:15:06.502521 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:15:06.502422    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-21f62c-openshift-default-9b4fd55ff-cmgvf"
Jul 07 18:15:06.658407 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:15:06.658356    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-21f62c-openshift-default-9b4fd55ff-cmgvf"]
Jul 07 18:15:06.661383 ip-10-0-139-31 kubenswrapper[2561]: W0707 18:15:06.661358    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podced5755d_ed11_4d78_b647_9b5ee29156ad.slice/crio-fd1f0a55c6ed6d3aa24bfacac8a6b0e326b146d40a90f0837831e8f09849f5c9 WatchSource:0}: Error finding container fd1f0a55c6ed6d3aa24bfacac8a6b0e326b146d40a90f0837831e8f09849f5c9: Status 404 returned error can't find the container with id fd1f0a55c6ed6d3aa24bfacac8a6b0e326b146d40a90f0837831e8f09849f5c9
Jul 07 18:15:06.663564 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:15:06.663532    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 07 18:15:06.663666 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:15:06.663613    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 07 18:15:06.663666 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:15:06.663657    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 07 18:15:07.468580 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:15:07.468539    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-21f62c-openshift-default-9b4fd55ff-cmgvf" event={"ID":"ced5755d-ed11-4d78-b647-9b5ee29156ad","Type":"ContainerStarted","Data":"14a157a5056c93169b6f9bcef983e5dbfe5994918e8523f275b3a7a49597fdc7"}
Jul 07 18:15:07.468982 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:15:07.468601    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-21f62c-openshift-default-9b4fd55ff-cmgvf" event={"ID":"ced5755d-ed11-4d78-b647-9b5ee29156ad","Type":"ContainerStarted","Data":"fd1f0a55c6ed6d3aa24bfacac8a6b0e326b146d40a90f0837831e8f09849f5c9"}
Jul 07 18:15:07.494255 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:15:07.494199    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-a-21f62c-openshift-default-9b4fd55ff-cmgvf" podStartSLOduration=1.494180231 podStartE2EDuration="1.494180231s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 18:15:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 18:15:07.49243499 +0000 UTC m=+2098.643559388" watchObservedRunningTime="2026-07-07 18:15:07.494180231 +0000 UTC m=+2098.645304703"
Jul 07 18:15:07.503496 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:15:07.503469    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-21f62c-openshift-default-9b4fd55ff-cmgvf"
Jul 07 18:15:07.509203 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:15:07.509178    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-21f62c-openshift-default-9b4fd55ff-cmgvf"
Jul 07 18:15:08.473691 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:15:08.473662    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-21f62c-openshift-default-9b4fd55ff-cmgvf"
Jul 07 18:15:08.474739 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:15:08.474721    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-21f62c-openshift-default-9b4fd55ff-cmgvf"
Jul 07 18:15:09.466016 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:15:09.465983    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-bjl48_805597ff-168d-4099-95b8-0037b0ceba2f/console-operator/1.log"
Jul 07 18:15:09.472045 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:15:09.472020    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-bjl48_805597ff-168d-4099-95b8-0037b0ceba2f/console-operator/1.log"
Jul 07 18:15:10.485187 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:15:10.485154    2561 generic.go:356] "Generic (PLEG): container finished" podID="3c1055c9-d43b-4b3c-be86-a937b219f49d" containerID="d5ccf5e54ac7b6d7b9213d35a1cb845bf84e4651afc0d57f7bca3174935b5a87" exitCode=0
Jul 07 18:15:10.485737 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:15:10.485341    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-239e66-openshift-default-75789c6675-9xqd5" event={"ID":"3c1055c9-d43b-4b3c-be86-a937b219f49d","Type":"ContainerDied","Data":"d5ccf5e54ac7b6d7b9213d35a1cb845bf84e4651afc0d57f7bca3174935b5a87"}
Jul 07 18:15:10.485737 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:15:10.485421    2561 scope.go:117] "RemoveContainer" containerID="8f2d94c65a15c6a47b394110b59a83e6c30be70f864a925597f4d73e1cedd6f1"
Jul 07 18:15:10.509029 ip-10-0-139-31 kubenswrapper[2561]: E0707 18:15:10.509005    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8f2d94c65a15c6a47b394110b59a83e6c30be70f864a925597f4d73e1cedd6f1\": container with ID starting with 8f2d94c65a15c6a47b394110b59a83e6c30be70f864a925597f4d73e1cedd6f1 not found: ID does not exist" containerID="8f2d94c65a15c6a47b394110b59a83e6c30be70f864a925597f4d73e1cedd6f1"
Jul 07 18:15:10.512402 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:15:10.512351    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-239e66-openshift-default-75789c6675-9xqd5"
Jul 07 18:15:10.635754 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:15:10.635705    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3c1055c9-d43b-4b3c-be86-a937b219f49d-istio-envoy\") pod \"3c1055c9-d43b-4b3c-be86-a937b219f49d\" (UID: \"3c1055c9-d43b-4b3c-be86-a937b219f49d\") "
Jul 07 18:15:10.635954 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:15:10.635773    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3c1055c9-d43b-4b3c-be86-a937b219f49d-workload-certs\") pod \"3c1055c9-d43b-4b3c-be86-a937b219f49d\" (UID: \"3c1055c9-d43b-4b3c-be86-a937b219f49d\") "
Jul 07 18:15:10.635954 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:15:10.635809    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3c1055c9-d43b-4b3c-be86-a937b219f49d-istiod-ca-cert\") pod \"3c1055c9-d43b-4b3c-be86-a937b219f49d\" (UID: \"3c1055c9-d43b-4b3c-be86-a937b219f49d\") "
Jul 07 18:15:10.635954 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:15:10.635866    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3c1055c9-d43b-4b3c-be86-a937b219f49d-istio-podinfo\") pod \"3c1055c9-d43b-4b3c-be86-a937b219f49d\" (UID: \"3c1055c9-d43b-4b3c-be86-a937b219f49d\") "
Jul 07 18:15:10.636127 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:15:10.636004    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3c1055c9-d43b-4b3c-be86-a937b219f49d-istio-data\") pod \"3c1055c9-d43b-4b3c-be86-a937b219f49d\" (UID: \"3c1055c9-d43b-4b3c-be86-a937b219f49d\") "
Jul 07 18:15:10.636127 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:15:10.636090    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sr2t9\" (UniqueName: \"kubernetes.io/projected/3c1055c9-d43b-4b3c-be86-a937b219f49d-kube-api-access-sr2t9\") pod \"3c1055c9-d43b-4b3c-be86-a937b219f49d\" (UID: \"3c1055c9-d43b-4b3c-be86-a937b219f49d\") "
Jul 07 18:15:10.636234 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:15:10.636125    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3c1055c9-d43b-4b3c-be86-a937b219f49d-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "3c1055c9-d43b-4b3c-be86-a937b219f49d" (UID: "3c1055c9-d43b-4b3c-be86-a937b219f49d"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 18:15:10.636234 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:15:10.636141    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3c1055c9-d43b-4b3c-be86-a937b219f49d-credential-socket\") pod \"3c1055c9-d43b-4b3c-be86-a937b219f49d\" (UID: \"3c1055c9-d43b-4b3c-be86-a937b219f49d\") "
Jul 07 18:15:10.636234 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:15:10.636167    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3c1055c9-d43b-4b3c-be86-a937b219f49d-istio-token\") pod \"3c1055c9-d43b-4b3c-be86-a937b219f49d\" (UID: \"3c1055c9-d43b-4b3c-be86-a937b219f49d\") "
Jul 07 18:15:10.636234 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:15:10.636197    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3c1055c9-d43b-4b3c-be86-a937b219f49d-workload-socket\") pod \"3c1055c9-d43b-4b3c-be86-a937b219f49d\" (UID: \"3c1055c9-d43b-4b3c-be86-a937b219f49d\") "
Jul 07 18:15:10.636507 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:15:10.636318    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3c1055c9-d43b-4b3c-be86-a937b219f49d-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "3c1055c9-d43b-4b3c-be86-a937b219f49d" (UID: "3c1055c9-d43b-4b3c-be86-a937b219f49d"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 18:15:10.636507 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:15:10.636360    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3c1055c9-d43b-4b3c-be86-a937b219f49d-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "3c1055c9-d43b-4b3c-be86-a937b219f49d" (UID: "3c1055c9-d43b-4b3c-be86-a937b219f49d"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 18:15:10.636620 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:15:10.636586    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3c1055c9-d43b-4b3c-be86-a937b219f49d-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "3c1055c9-d43b-4b3c-be86-a937b219f49d" (UID: "3c1055c9-d43b-4b3c-be86-a937b219f49d"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 18:15:10.636757 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:15:10.636741    2561 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3c1055c9-d43b-4b3c-be86-a937b219f49d-credential-socket\") on node \"ip-10-0-139-31.ec2.internal\" DevicePath \"\""
Jul 07 18:15:10.636816 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:15:10.636763    2561 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3c1055c9-d43b-4b3c-be86-a937b219f49d-workload-socket\") on node \"ip-10-0-139-31.ec2.internal\" DevicePath \"\""
Jul 07 18:15:10.636816 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:15:10.636776    2561 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3c1055c9-d43b-4b3c-be86-a937b219f49d-workload-certs\") on node \"ip-10-0-139-31.ec2.internal\" DevicePath \"\""
Jul 07 18:15:10.636816 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:15:10.636791    2561 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3c1055c9-d43b-4b3c-be86-a937b219f49d-istiod-ca-cert\") on node \"ip-10-0-139-31.ec2.internal\" DevicePath \"\""
Jul 07 18:15:10.637143 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:15:10.637085    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3c1055c9-d43b-4b3c-be86-a937b219f49d-istio-data" (OuterVolumeSpecName: "istio-data") pod "3c1055c9-d43b-4b3c-be86-a937b219f49d" (UID: "3c1055c9-d43b-4b3c-be86-a937b219f49d"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 18:15:10.638581 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:15:10.638558    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/3c1055c9-d43b-4b3c-be86-a937b219f49d-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "3c1055c9-d43b-4b3c-be86-a937b219f49d" (UID: "3c1055c9-d43b-4b3c-be86-a937b219f49d"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 07 18:15:10.638703 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:15:10.638564    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3c1055c9-d43b-4b3c-be86-a937b219f49d-istio-token" (OuterVolumeSpecName: "istio-token") pod "3c1055c9-d43b-4b3c-be86-a937b219f49d" (UID: "3c1055c9-d43b-4b3c-be86-a937b219f49d"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 18:15:10.638703 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:15:10.638691    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3c1055c9-d43b-4b3c-be86-a937b219f49d-kube-api-access-sr2t9" (OuterVolumeSpecName: "kube-api-access-sr2t9") pod "3c1055c9-d43b-4b3c-be86-a937b219f49d" (UID: "3c1055c9-d43b-4b3c-be86-a937b219f49d"). InnerVolumeSpecName "kube-api-access-sr2t9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 18:15:10.638840 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:15:10.638826    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3c1055c9-d43b-4b3c-be86-a937b219f49d-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "3c1055c9-d43b-4b3c-be86-a937b219f49d" (UID: "3c1055c9-d43b-4b3c-be86-a937b219f49d"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 18:15:10.738005 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:15:10.737974    2561 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3c1055c9-d43b-4b3c-be86-a937b219f49d-istio-podinfo\") on node \"ip-10-0-139-31.ec2.internal\" DevicePath \"\""
Jul 07 18:15:10.738005 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:15:10.738000    2561 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3c1055c9-d43b-4b3c-be86-a937b219f49d-istio-data\") on node \"ip-10-0-139-31.ec2.internal\" DevicePath \"\""
Jul 07 18:15:10.738005 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:15:10.738009    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sr2t9\" (UniqueName: \"kubernetes.io/projected/3c1055c9-d43b-4b3c-be86-a937b219f49d-kube-api-access-sr2t9\") on node \"ip-10-0-139-31.ec2.internal\" DevicePath \"\""
Jul 07 18:15:10.738255 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:15:10.738018    2561 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3c1055c9-d43b-4b3c-be86-a937b219f49d-istio-token\") on node \"ip-10-0-139-31.ec2.internal\" DevicePath \"\""
Jul 07 18:15:10.738255 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:15:10.738028    2561 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3c1055c9-d43b-4b3c-be86-a937b219f49d-istio-envoy\") on node \"ip-10-0-139-31.ec2.internal\" DevicePath \"\""
Jul 07 18:15:11.495030 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:15:11.495002    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-239e66-openshift-default-75789c6675-9xqd5"
Jul 07 18:15:11.495570 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:15:11.495002    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-239e66-openshift-default-75789c6675-9xqd5" event={"ID":"3c1055c9-d43b-4b3c-be86-a937b219f49d","Type":"ContainerDied","Data":"49b5be10cb0df49130a43cfafe76db52cef2dcea06dfcb540c387040eeb3814b"}
Jul 07 18:15:11.495570 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:15:11.495140    2561 scope.go:117] "RemoveContainer" containerID="d5ccf5e54ac7b6d7b9213d35a1cb845bf84e4651afc0d57f7bca3174935b5a87"
Jul 07 18:15:11.521306 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:15:11.521278    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-239e66-openshift-default-75789c6675-9xqd5"]
Jul 07 18:15:11.526506 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:15:11.526480    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-b-239e66-openshift-default-75789c6675-9xqd5"]
Jul 07 18:15:13.522067 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:15:13.522029    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3c1055c9-d43b-4b3c-be86-a937b219f49d" path="/var/lib/kubelet/pods/3c1055c9-d43b-4b3c-be86-a937b219f49d/volumes"
Jul 07 18:15:14.634806 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:15:14.634775    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-b-fad388-openshift-default-56449b5455-qdxwg"]
Jul 07 18:15:14.635361 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:15:14.635340    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3c1055c9-d43b-4b3c-be86-a937b219f49d" containerName="istio-proxy"
Jul 07 18:15:14.635473 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:15:14.635365    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="3c1055c9-d43b-4b3c-be86-a937b219f49d" containerName="istio-proxy"
Jul 07 18:15:14.635473 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:15:14.635391    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3c1055c9-d43b-4b3c-be86-a937b219f49d" containerName="istio-proxy"
Jul 07 18:15:14.635473 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:15:14.635399    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="3c1055c9-d43b-4b3c-be86-a937b219f49d" containerName="istio-proxy"
Jul 07 18:15:14.635632 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:15:14.635506    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="3c1055c9-d43b-4b3c-be86-a937b219f49d" containerName="istio-proxy"
Jul 07 18:15:14.635632 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:15:14.635520    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="3c1055c9-d43b-4b3c-be86-a937b219f49d" containerName="istio-proxy"
Jul 07 18:15:14.638538 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:15:14.638518    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-fad388-openshift-default-56449b5455-qdxwg"
Jul 07 18:15:14.641942 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:15:14.641923    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-b-fad388-openshift-default-dockercfg-zg52m\""
Jul 07 18:15:14.742707 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:15:14.742671    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-fad388-openshift-default-56449b5455-qdxwg"]
Jul 07 18:15:14.776254 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:15:14.776223    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ddde9e74-62d8-4bf1-bd4d-df4f86eb15b4-istio-envoy\") pod \"e2e-shared-b-fad388-openshift-default-56449b5455-qdxwg\" (UID: \"ddde9e74-62d8-4bf1-bd4d-df4f86eb15b4\") " pod="openshift-ingress/e2e-shared-b-fad388-openshift-default-56449b5455-qdxwg"
Jul 07 18:15:14.776406 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:15:14.776260    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ddde9e74-62d8-4bf1-bd4d-df4f86eb15b4-credential-socket\") pod \"e2e-shared-b-fad388-openshift-default-56449b5455-qdxwg\" (UID: \"ddde9e74-62d8-4bf1-bd4d-df4f86eb15b4\") " pod="openshift-ingress/e2e-shared-b-fad388-openshift-default-56449b5455-qdxwg"
Jul 07 18:15:14.776406 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:15:14.776279    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ddde9e74-62d8-4bf1-bd4d-df4f86eb15b4-workload-certs\") pod \"e2e-shared-b-fad388-openshift-default-56449b5455-qdxwg\" (UID: \"ddde9e74-62d8-4bf1-bd4d-df4f86eb15b4\") " pod="openshift-ingress/e2e-shared-b-fad388-openshift-default-56449b5455-qdxwg"
Jul 07 18:15:14.776406 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:15:14.776303    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ddde9e74-62d8-4bf1-bd4d-df4f86eb15b4-istio-podinfo\") pod \"e2e-shared-b-fad388-openshift-default-56449b5455-qdxwg\" (UID: \"ddde9e74-62d8-4bf1-bd4d-df4f86eb15b4\") " pod="openshift-ingress/e2e-shared-b-fad388-openshift-default-56449b5455-qdxwg"
Jul 07 18:15:14.776406 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:15:14.776350    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ddde9e74-62d8-4bf1-bd4d-df4f86eb15b4-istio-data\") pod \"e2e-shared-b-fad388-openshift-default-56449b5455-qdxwg\" (UID: \"ddde9e74-62d8-4bf1-bd4d-df4f86eb15b4\") " pod="openshift-ingress/e2e-shared-b-fad388-openshift-default-56449b5455-qdxwg"
Jul 07 18:15:14.776710 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:15:14.776422    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ddde9e74-62d8-4bf1-bd4d-df4f86eb15b4-istio-token\") pod \"e2e-shared-b-fad388-openshift-default-56449b5455-qdxwg\" (UID: \"ddde9e74-62d8-4bf1-bd4d-df4f86eb15b4\") " pod="openshift-ingress/e2e-shared-b-fad388-openshift-default-56449b5455-qdxwg"
Jul 07 18:15:14.776710 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:15:14.776517    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ddde9e74-62d8-4bf1-bd4d-df4f86eb15b4-workload-socket\") pod \"e2e-shared-b-fad388-openshift-default-56449b5455-qdxwg\" (UID: \"ddde9e74-62d8-4bf1-bd4d-df4f86eb15b4\") " pod="openshift-ingress/e2e-shared-b-fad388-openshift-default-56449b5455-qdxwg"
Jul 07 18:15:14.776710 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:15:14.776550    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ddde9e74-62d8-4bf1-bd4d-df4f86eb15b4-istiod-ca-cert\") pod \"e2e-shared-b-fad388-openshift-default-56449b5455-qdxwg\" (UID: \"ddde9e74-62d8-4bf1-bd4d-df4f86eb15b4\") " pod="openshift-ingress/e2e-shared-b-fad388-openshift-default-56449b5455-qdxwg"
Jul 07 18:15:14.776710 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:15:14.776597    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xkw42\" (UniqueName: \"kubernetes.io/projected/ddde9e74-62d8-4bf1-bd4d-df4f86eb15b4-kube-api-access-xkw42\") pod \"e2e-shared-b-fad388-openshift-default-56449b5455-qdxwg\" (UID: \"ddde9e74-62d8-4bf1-bd4d-df4f86eb15b4\") " pod="openshift-ingress/e2e-shared-b-fad388-openshift-default-56449b5455-qdxwg"
Jul 07 18:15:14.877262 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:15:14.877220    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xkw42\" (UniqueName: \"kubernetes.io/projected/ddde9e74-62d8-4bf1-bd4d-df4f86eb15b4-kube-api-access-xkw42\") pod \"e2e-shared-b-fad388-openshift-default-56449b5455-qdxwg\" (UID: \"ddde9e74-62d8-4bf1-bd4d-df4f86eb15b4\") " pod="openshift-ingress/e2e-shared-b-fad388-openshift-default-56449b5455-qdxwg"
Jul 07 18:15:14.878576 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:15:14.878549    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ddde9e74-62d8-4bf1-bd4d-df4f86eb15b4-istio-envoy\") pod \"e2e-shared-b-fad388-openshift-default-56449b5455-qdxwg\" (UID: \"ddde9e74-62d8-4bf1-bd4d-df4f86eb15b4\") " pod="openshift-ingress/e2e-shared-b-fad388-openshift-default-56449b5455-qdxwg"
Jul 07 18:15:14.879210 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:15:14.879191    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ddde9e74-62d8-4bf1-bd4d-df4f86eb15b4-credential-socket\") pod \"e2e-shared-b-fad388-openshift-default-56449b5455-qdxwg\" (UID: \"ddde9e74-62d8-4bf1-bd4d-df4f86eb15b4\") " pod="openshift-ingress/e2e-shared-b-fad388-openshift-default-56449b5455-qdxwg"
Jul 07 18:15:14.879724 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:15:14.879707    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ddde9e74-62d8-4bf1-bd4d-df4f86eb15b4-workload-certs\") pod \"e2e-shared-b-fad388-openshift-default-56449b5455-qdxwg\" (UID: \"ddde9e74-62d8-4bf1-bd4d-df4f86eb15b4\") " pod="openshift-ingress/e2e-shared-b-fad388-openshift-default-56449b5455-qdxwg"
Jul 07 18:15:14.880161 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:15:14.880135    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ddde9e74-62d8-4bf1-bd4d-df4f86eb15b4-istio-podinfo\") pod \"e2e-shared-b-fad388-openshift-default-56449b5455-qdxwg\" (UID: \"ddde9e74-62d8-4bf1-bd4d-df4f86eb15b4\") " pod="openshift-ingress/e2e-shared-b-fad388-openshift-default-56449b5455-qdxwg"
Jul 07 18:15:14.880711 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:15:14.880694    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ddde9e74-62d8-4bf1-bd4d-df4f86eb15b4-istio-data\") pod \"e2e-shared-b-fad388-openshift-default-56449b5455-qdxwg\" (UID: \"ddde9e74-62d8-4bf1-bd4d-df4f86eb15b4\") " pod="openshift-ingress/e2e-shared-b-fad388-openshift-default-56449b5455-qdxwg"
Jul 07 18:15:14.881858 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:15:14.879651    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ddde9e74-62d8-4bf1-bd4d-df4f86eb15b4-credential-socket\") pod \"e2e-shared-b-fad388-openshift-default-56449b5455-qdxwg\" (UID: \"ddde9e74-62d8-4bf1-bd4d-df4f86eb15b4\") " pod="openshift-ingress/e2e-shared-b-fad388-openshift-default-56449b5455-qdxwg"
Jul 07 18:15:14.881858 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:15:14.880970    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ddde9e74-62d8-4bf1-bd4d-df4f86eb15b4-istio-token\") pod \"e2e-shared-b-fad388-openshift-default-56449b5455-qdxwg\" (UID: \"ddde9e74-62d8-4bf1-bd4d-df4f86eb15b4\") " pod="openshift-ingress/e2e-shared-b-fad388-openshift-default-56449b5455-qdxwg"
Jul 07 18:15:14.881858 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:15:14.881029    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ddde9e74-62d8-4bf1-bd4d-df4f86eb15b4-workload-socket\") pod \"e2e-shared-b-fad388-openshift-default-56449b5455-qdxwg\" (UID: \"ddde9e74-62d8-4bf1-bd4d-df4f86eb15b4\") " pod="openshift-ingress/e2e-shared-b-fad388-openshift-default-56449b5455-qdxwg"
Jul 07 18:15:14.881858 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:15:14.881070    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ddde9e74-62d8-4bf1-bd4d-df4f86eb15b4-istiod-ca-cert\") pod \"e2e-shared-b-fad388-openshift-default-56449b5455-qdxwg\" (UID: \"ddde9e74-62d8-4bf1-bd4d-df4f86eb15b4\") " pod="openshift-ingress/e2e-shared-b-fad388-openshift-default-56449b5455-qdxwg"
Jul 07 18:15:14.881858 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:15:14.881808    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ddde9e74-62d8-4bf1-bd4d-df4f86eb15b4-istiod-ca-cert\") pod \"e2e-shared-b-fad388-openshift-default-56449b5455-qdxwg\" (UID: \"ddde9e74-62d8-4bf1-bd4d-df4f86eb15b4\") " pod="openshift-ingress/e2e-shared-b-fad388-openshift-default-56449b5455-qdxwg"
Jul 07 18:15:14.882482 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:15:14.882421    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ddde9e74-62d8-4bf1-bd4d-df4f86eb15b4-workload-socket\") pod \"e2e-shared-b-fad388-openshift-default-56449b5455-qdxwg\" (UID: \"ddde9e74-62d8-4bf1-bd4d-df4f86eb15b4\") " pod="openshift-ingress/e2e-shared-b-fad388-openshift-default-56449b5455-qdxwg"
Jul 07 18:15:14.882766 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:15:14.882745    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ddde9e74-62d8-4bf1-bd4d-df4f86eb15b4-istio-data\") pod \"e2e-shared-b-fad388-openshift-default-56449b5455-qdxwg\" (UID: \"ddde9e74-62d8-4bf1-bd4d-df4f86eb15b4\") " pod="openshift-ingress/e2e-shared-b-fad388-openshift-default-56449b5455-qdxwg"
Jul 07 18:15:14.882876 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:15:14.880079    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ddde9e74-62d8-4bf1-bd4d-df4f86eb15b4-workload-certs\") pod \"e2e-shared-b-fad388-openshift-default-56449b5455-qdxwg\" (UID: \"ddde9e74-62d8-4bf1-bd4d-df4f86eb15b4\") " pod="openshift-ingress/e2e-shared-b-fad388-openshift-default-56449b5455-qdxwg"
Jul 07 18:15:14.883972 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:15:14.883945    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ddde9e74-62d8-4bf1-bd4d-df4f86eb15b4-istio-envoy\") pod \"e2e-shared-b-fad388-openshift-default-56449b5455-qdxwg\" (UID: \"ddde9e74-62d8-4bf1-bd4d-df4f86eb15b4\") " pod="openshift-ingress/e2e-shared-b-fad388-openshift-default-56449b5455-qdxwg"
Jul 07 18:15:14.886299 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:15:14.886231    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ddde9e74-62d8-4bf1-bd4d-df4f86eb15b4-istio-podinfo\") pod \"e2e-shared-b-fad388-openshift-default-56449b5455-qdxwg\" (UID: \"ddde9e74-62d8-4bf1-bd4d-df4f86eb15b4\") " pod="openshift-ingress/e2e-shared-b-fad388-openshift-default-56449b5455-qdxwg"
Jul 07 18:15:14.895912 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:15:14.895849    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ddde9e74-62d8-4bf1-bd4d-df4f86eb15b4-istio-token\") pod \"e2e-shared-b-fad388-openshift-default-56449b5455-qdxwg\" (UID: \"ddde9e74-62d8-4bf1-bd4d-df4f86eb15b4\") " pod="openshift-ingress/e2e-shared-b-fad388-openshift-default-56449b5455-qdxwg"
Jul 07 18:15:14.896736 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:15:14.896693    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xkw42\" (UniqueName: \"kubernetes.io/projected/ddde9e74-62d8-4bf1-bd4d-df4f86eb15b4-kube-api-access-xkw42\") pod \"e2e-shared-b-fad388-openshift-default-56449b5455-qdxwg\" (UID: \"ddde9e74-62d8-4bf1-bd4d-df4f86eb15b4\") " pod="openshift-ingress/e2e-shared-b-fad388-openshift-default-56449b5455-qdxwg"
Jul 07 18:15:14.948384 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:15:14.948352    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-fad388-openshift-default-56449b5455-qdxwg"
Jul 07 18:15:15.131240 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:15:15.131214    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-fad388-openshift-default-56449b5455-qdxwg"]
Jul 07 18:15:15.132837 ip-10-0-139-31 kubenswrapper[2561]: W0707 18:15:15.132809    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podddde9e74_62d8_4bf1_bd4d_df4f86eb15b4.slice/crio-9b119d586acc210b604b7fdf085008d84f9279652a63e73ae988dd3404e2590f WatchSource:0}: Error finding container 9b119d586acc210b604b7fdf085008d84f9279652a63e73ae988dd3404e2590f: Status 404 returned error can't find the container with id 9b119d586acc210b604b7fdf085008d84f9279652a63e73ae988dd3404e2590f
Jul 07 18:15:15.135101 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:15:15.135067    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 07 18:15:15.135230 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:15:15.135137    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 07 18:15:15.135230 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:15:15.135179    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 07 18:15:15.522995 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:15:15.522900    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-fad388-openshift-default-56449b5455-qdxwg" event={"ID":"ddde9e74-62d8-4bf1-bd4d-df4f86eb15b4","Type":"ContainerStarted","Data":"320399bf1678f04bb5d1dd97947f4d29ec1015758b1eff04d5d21f8f9acbd143"}
Jul 07 18:15:15.522995 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:15:15.522971    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-fad388-openshift-default-56449b5455-qdxwg" event={"ID":"ddde9e74-62d8-4bf1-bd4d-df4f86eb15b4","Type":"ContainerStarted","Data":"9b119d586acc210b604b7fdf085008d84f9279652a63e73ae988dd3404e2590f"}
Jul 07 18:15:15.559699 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:15:15.559645    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-b-fad388-openshift-default-56449b5455-qdxwg" podStartSLOduration=1.559628024 podStartE2EDuration="1.559628024s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 18:15:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 18:15:15.55892456 +0000 UTC m=+2106.710048953" watchObservedRunningTime="2026-07-07 18:15:15.559628024 +0000 UTC m=+2106.710752422"
Jul 07 18:15:15.948487 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:15:15.948436    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-fad388-openshift-default-56449b5455-qdxwg"
Jul 07 18:15:16.954258 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:15:16.954223    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-fad388-openshift-default-56449b5455-qdxwg"
Jul 07 18:15:17.529199 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:15:17.529163    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-fad388-openshift-default-56449b5455-qdxwg"
Jul 07 18:15:17.530254 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:15:17.530233    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-fad388-openshift-default-56449b5455-qdxwg"
Jul 07 18:15:21.550040 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:15:21.550011    2561 generic.go:356] "Generic (PLEG): container finished" podID="ced5755d-ed11-4d78-b647-9b5ee29156ad" containerID="14a157a5056c93169b6f9bcef983e5dbfe5994918e8523f275b3a7a49597fdc7" exitCode=0
Jul 07 18:15:21.550461 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:15:21.550085    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-21f62c-openshift-default-9b4fd55ff-cmgvf" event={"ID":"ced5755d-ed11-4d78-b647-9b5ee29156ad","Type":"ContainerDied","Data":"14a157a5056c93169b6f9bcef983e5dbfe5994918e8523f275b3a7a49597fdc7"}
Jul 07 18:15:21.550528 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:15:21.550513    2561 scope.go:117] "RemoveContainer" containerID="14a157a5056c93169b6f9bcef983e5dbfe5994918e8523f275b3a7a49597fdc7"
Jul 07 18:15:21.551548 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:15:21.551523    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 07 18:15:21.551628 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:15:21.551591    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 07 18:15:21.551628 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:15:21.551625    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 07 18:15:22.559723 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:15:22.559682    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-21f62c-openshift-default-9b4fd55ff-cmgvf" event={"ID":"ced5755d-ed11-4d78-b647-9b5ee29156ad","Type":"ContainerStarted","Data":"e406124ed51db9a73e898ede44e335f020f8560a8709619444e7070d18e08f4f"}
Jul 07 18:15:23.474549 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:15:23.474518    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-21f62c-openshift-default-9b4fd55ff-cmgvf"
Jul 07 18:15:23.503089 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:15:23.503051    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-21f62c-openshift-default-9b4fd55ff-cmgvf"
Jul 07 18:15:23.504393 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:15:23.504371    2561 patch_prober.go:28] interesting pod/e2e-shared-a-21f62c-openshift-default-9b4fd55ff-cmgvf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.46:15021/healthz/ready\": dial tcp 10.132.0.46:15021: connect: connection refused" start-of-body=
Jul 07 18:15:23.504473 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:15:23.504432    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-21f62c-openshift-default-9b4fd55ff-cmgvf" podUID="ced5755d-ed11-4d78-b647-9b5ee29156ad" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.46:15021/healthz/ready\": dial tcp 10.132.0.46:15021: connect: connection refused"
Jul 07 18:15:24.503131 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:15:24.503090    2561 patch_prober.go:28] interesting pod/e2e-shared-a-21f62c-openshift-default-9b4fd55ff-cmgvf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.46:15021/healthz/ready\": dial tcp 10.132.0.46:15021: connect: connection refused" start-of-body=
Jul 07 18:15:24.503568 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:15:24.503152    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-21f62c-openshift-default-9b4fd55ff-cmgvf" podUID="ced5755d-ed11-4d78-b647-9b5ee29156ad" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.46:15021/healthz/ready\": dial tcp 10.132.0.46:15021: connect: connection refused"
Jul 07 18:15:25.503888 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:15:25.503843    2561 patch_prober.go:28] interesting pod/e2e-shared-a-21f62c-openshift-default-9b4fd55ff-cmgvf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.46:15021/healthz/ready\": dial tcp 10.132.0.46:15021: connect: connection refused" start-of-body=
Jul 07 18:15:25.504409 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:15:25.503908    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-21f62c-openshift-default-9b4fd55ff-cmgvf" podUID="ced5755d-ed11-4d78-b647-9b5ee29156ad" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.46:15021/healthz/ready\": dial tcp 10.132.0.46:15021: connect: connection refused"
Jul 07 18:15:26.503429 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:15:26.503385    2561 patch_prober.go:28] interesting pod/e2e-shared-a-21f62c-openshift-default-9b4fd55ff-cmgvf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.46:15021/healthz/ready\": dial tcp 10.132.0.46:15021: connect: connection refused" start-of-body=
Jul 07 18:15:26.503671 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:15:26.503466    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-21f62c-openshift-default-9b4fd55ff-cmgvf" podUID="ced5755d-ed11-4d78-b647-9b5ee29156ad" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.46:15021/healthz/ready\": dial tcp 10.132.0.46:15021: connect: connection refused"
Jul 07 18:15:27.506760 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:15:27.506725    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-21f62c-openshift-default-9b4fd55ff-cmgvf"
Jul 07 18:15:27.507855 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:15:27.507835    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-21f62c-openshift-default-9b4fd55ff-cmgvf"
Jul 07 18:15:29.088825 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:15:29.088777    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-21f62c/auth-test-model-21f62c-kserve-764858f595-4wtsg"]
Jul 07 18:15:29.093233 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:15:29.093204    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-21f62c/auth-test-model-21f62c-kserve-764858f595-4wtsg"
Jul 07 18:15:29.097676 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:15:29.097650    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-21f62c\"/\"auth-test-model-21f62c-kserve-self-signed-certs\""
Jul 07 18:15:29.098323 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:15:29.097981    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-21f62c\"/\"kube-root-ca.crt\""
Jul 07 18:15:29.099184 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:15:29.098041    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-21f62c\"/\"default-dockercfg-xvp6n\""
Jul 07 18:15:29.102760 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:15:29.098132    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-21f62c\"/\"openshift-service-ca.crt\""
Jul 07 18:15:29.102760 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:15:29.102680    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-21f62c/auth-test-model-21f62c-kserve-764858f595-4wtsg"]
Jul 07 18:15:29.142154 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:15:29.142115    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/32a3b3ef-aa2d-4b71-a4cb-9b6c3d2596c8-tmp-dir\") pod \"auth-test-model-21f62c-kserve-764858f595-4wtsg\" (UID: \"32a3b3ef-aa2d-4b71-a4cb-9b6c3d2596c8\") " pod="ai-tenant-e2e-shared-a-21f62c/auth-test-model-21f62c-kserve-764858f595-4wtsg"
Jul 07 18:15:29.142353 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:15:29.142168    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-srq26\" (UniqueName: \"kubernetes.io/projected/32a3b3ef-aa2d-4b71-a4cb-9b6c3d2596c8-kube-api-access-srq26\") pod \"auth-test-model-21f62c-kserve-764858f595-4wtsg\" (UID: \"32a3b3ef-aa2d-4b71-a4cb-9b6c3d2596c8\") " pod="ai-tenant-e2e-shared-a-21f62c/auth-test-model-21f62c-kserve-764858f595-4wtsg"
Jul 07 18:15:29.142353 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:15:29.142231    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/32a3b3ef-aa2d-4b71-a4cb-9b6c3d2596c8-model-cache\") pod \"auth-test-model-21f62c-kserve-764858f595-4wtsg\" (UID: \"32a3b3ef-aa2d-4b71-a4cb-9b6c3d2596c8\") " pod="ai-tenant-e2e-shared-a-21f62c/auth-test-model-21f62c-kserve-764858f595-4wtsg"
Jul 07 18:15:29.142353 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:15:29.142254    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/32a3b3ef-aa2d-4b71-a4cb-9b6c3d2596c8-dshm\") pod \"auth-test-model-21f62c-kserve-764858f595-4wtsg\" (UID: \"32a3b3ef-aa2d-4b71-a4cb-9b6c3d2596c8\") " pod="ai-tenant-e2e-shared-a-21f62c/auth-test-model-21f62c-kserve-764858f595-4wtsg"
Jul 07 18:15:29.142353 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:15:29.142279    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/32a3b3ef-aa2d-4b71-a4cb-9b6c3d2596c8-tls-certs\") pod \"auth-test-model-21f62c-kserve-764858f595-4wtsg\" (UID: \"32a3b3ef-aa2d-4b71-a4cb-9b6c3d2596c8\") " pod="ai-tenant-e2e-shared-a-21f62c/auth-test-model-21f62c-kserve-764858f595-4wtsg"
Jul 07 18:15:29.142645 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:15:29.142378    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/32a3b3ef-aa2d-4b71-a4cb-9b6c3d2596c8-home\") pod \"auth-test-model-21f62c-kserve-764858f595-4wtsg\" (UID: \"32a3b3ef-aa2d-4b71-a4cb-9b6c3d2596c8\") " pod="ai-tenant-e2e-shared-a-21f62c/auth-test-model-21f62c-kserve-764858f595-4wtsg"
Jul 07 18:15:29.243419 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:15:29.243364    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/32a3b3ef-aa2d-4b71-a4cb-9b6c3d2596c8-tmp-dir\") pod \"auth-test-model-21f62c-kserve-764858f595-4wtsg\" (UID: \"32a3b3ef-aa2d-4b71-a4cb-9b6c3d2596c8\") " pod="ai-tenant-e2e-shared-a-21f62c/auth-test-model-21f62c-kserve-764858f595-4wtsg"
Jul 07 18:15:29.243419 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:15:29.243416    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-srq26\" (UniqueName: \"kubernetes.io/projected/32a3b3ef-aa2d-4b71-a4cb-9b6c3d2596c8-kube-api-access-srq26\") pod \"auth-test-model-21f62c-kserve-764858f595-4wtsg\" (UID: \"32a3b3ef-aa2d-4b71-a4cb-9b6c3d2596c8\") " pod="ai-tenant-e2e-shared-a-21f62c/auth-test-model-21f62c-kserve-764858f595-4wtsg"
Jul 07 18:15:29.243715 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:15:29.243460    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/32a3b3ef-aa2d-4b71-a4cb-9b6c3d2596c8-model-cache\") pod \"auth-test-model-21f62c-kserve-764858f595-4wtsg\" (UID: \"32a3b3ef-aa2d-4b71-a4cb-9b6c3d2596c8\") " pod="ai-tenant-e2e-shared-a-21f62c/auth-test-model-21f62c-kserve-764858f595-4wtsg"
Jul 07 18:15:29.243715 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:15:29.243479    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/32a3b3ef-aa2d-4b71-a4cb-9b6c3d2596c8-dshm\") pod \"auth-test-model-21f62c-kserve-764858f595-4wtsg\" (UID: \"32a3b3ef-aa2d-4b71-a4cb-9b6c3d2596c8\") " pod="ai-tenant-e2e-shared-a-21f62c/auth-test-model-21f62c-kserve-764858f595-4wtsg"
Jul 07 18:15:29.243715 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:15:29.243502    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/32a3b3ef-aa2d-4b71-a4cb-9b6c3d2596c8-tls-certs\") pod \"auth-test-model-21f62c-kserve-764858f595-4wtsg\" (UID: \"32a3b3ef-aa2d-4b71-a4cb-9b6c3d2596c8\") " pod="ai-tenant-e2e-shared-a-21f62c/auth-test-model-21f62c-kserve-764858f595-4wtsg"
Jul 07 18:15:29.243715 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:15:29.243544    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/32a3b3ef-aa2d-4b71-a4cb-9b6c3d2596c8-home\") pod \"auth-test-model-21f62c-kserve-764858f595-4wtsg\" (UID: \"32a3b3ef-aa2d-4b71-a4cb-9b6c3d2596c8\") " pod="ai-tenant-e2e-shared-a-21f62c/auth-test-model-21f62c-kserve-764858f595-4wtsg"
Jul 07 18:15:29.243933 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:15:29.243821    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/32a3b3ef-aa2d-4b71-a4cb-9b6c3d2596c8-tmp-dir\") pod \"auth-test-model-21f62c-kserve-764858f595-4wtsg\" (UID: \"32a3b3ef-aa2d-4b71-a4cb-9b6c3d2596c8\") " pod="ai-tenant-e2e-shared-a-21f62c/auth-test-model-21f62c-kserve-764858f595-4wtsg"
Jul 07 18:15:29.244009 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:15:29.243974    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/32a3b3ef-aa2d-4b71-a4cb-9b6c3d2596c8-home\") pod \"auth-test-model-21f62c-kserve-764858f595-4wtsg\" (UID: \"32a3b3ef-aa2d-4b71-a4cb-9b6c3d2596c8\") " pod="ai-tenant-e2e-shared-a-21f62c/auth-test-model-21f62c-kserve-764858f595-4wtsg"
Jul 07 18:15:29.244070 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:15:29.244052    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/32a3b3ef-aa2d-4b71-a4cb-9b6c3d2596c8-model-cache\") pod \"auth-test-model-21f62c-kserve-764858f595-4wtsg\" (UID: \"32a3b3ef-aa2d-4b71-a4cb-9b6c3d2596c8\") " pod="ai-tenant-e2e-shared-a-21f62c/auth-test-model-21f62c-kserve-764858f595-4wtsg"
Jul 07 18:15:29.245776 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:15:29.245743    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/32a3b3ef-aa2d-4b71-a4cb-9b6c3d2596c8-dshm\") pod \"auth-test-model-21f62c-kserve-764858f595-4wtsg\" (UID: \"32a3b3ef-aa2d-4b71-a4cb-9b6c3d2596c8\") " pod="ai-tenant-e2e-shared-a-21f62c/auth-test-model-21f62c-kserve-764858f595-4wtsg"
Jul 07 18:15:29.246324 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:15:29.246290    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/32a3b3ef-aa2d-4b71-a4cb-9b6c3d2596c8-tls-certs\") pod \"auth-test-model-21f62c-kserve-764858f595-4wtsg\" (UID: \"32a3b3ef-aa2d-4b71-a4cb-9b6c3d2596c8\") " pod="ai-tenant-e2e-shared-a-21f62c/auth-test-model-21f62c-kserve-764858f595-4wtsg"
Jul 07 18:15:29.253289 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:15:29.253262    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-srq26\" (UniqueName: \"kubernetes.io/projected/32a3b3ef-aa2d-4b71-a4cb-9b6c3d2596c8-kube-api-access-srq26\") pod \"auth-test-model-21f62c-kserve-764858f595-4wtsg\" (UID: \"32a3b3ef-aa2d-4b71-a4cb-9b6c3d2596c8\") " pod="ai-tenant-e2e-shared-a-21f62c/auth-test-model-21f62c-kserve-764858f595-4wtsg"
Jul 07 18:15:29.410085 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:15:29.409979    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-21f62c/auth-test-model-21f62c-kserve-764858f595-4wtsg"
Jul 07 18:15:29.569322 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:15:29.569289    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-21f62c/auth-test-model-21f62c-kserve-764858f595-4wtsg"]
Jul 07 18:15:29.572387 ip-10-0-139-31 kubenswrapper[2561]: W0707 18:15:29.572348    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod32a3b3ef_aa2d_4b71_a4cb_9b6c3d2596c8.slice/crio-14b352b5c8e933e715dc31cc46c336898c8e2d6e5ee9781ae1441ed5ca3d04ba WatchSource:0}: Error finding container 14b352b5c8e933e715dc31cc46c336898c8e2d6e5ee9781ae1441ed5ca3d04ba: Status 404 returned error can't find the container with id 14b352b5c8e933e715dc31cc46c336898c8e2d6e5ee9781ae1441ed5ca3d04ba
Jul 07 18:15:29.610725 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:15:29.610691    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-21f62c/auth-test-model-21f62c-kserve-764858f595-4wtsg" event={"ID":"32a3b3ef-aa2d-4b71-a4cb-9b6c3d2596c8","Type":"ContainerStarted","Data":"14b352b5c8e933e715dc31cc46c336898c8e2d6e5ee9781ae1441ed5ca3d04ba"}
Jul 07 18:15:30.618253 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:15:30.618214    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-21f62c/auth-test-model-21f62c-kserve-764858f595-4wtsg" event={"ID":"32a3b3ef-aa2d-4b71-a4cb-9b6c3d2596c8","Type":"ContainerStarted","Data":"cdc592882dcfa41e7b1020ffe8e3e9fed54ff74ab42ba604edd8ebd0b6214e90"}
Jul 07 18:15:30.636977 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:15:30.636915    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-21f62c/auth-test-model-21f62c-kserve-764858f595-4wtsg" podStartSLOduration=1.6368922289999999 podStartE2EDuration="1.636892229s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 18:15:29 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 18:15:30.636053582 +0000 UTC m=+2121.787177981" watchObservedRunningTime="2026-07-07 18:15:30.636892229 +0000 UTC m=+2121.788016628"
Jul 07 18:15:32.968131 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:15:32.966712    2561 patch_prober.go:28] interesting pod/e2e-shared-b-fad388-openshift-default-56449b5455-qdxwg container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.47:15021/healthz/ready\": read tcp 10.132.0.2:41232->10.132.0.47:15021: read: connection reset by peer" start-of-body=
Jul 07 18:15:32.968131 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:15:32.966795    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-b-fad388-openshift-default-56449b5455-qdxwg" podUID="ddde9e74-62d8-4bf1-bd4d-df4f86eb15b4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.47:15021/healthz/ready\": read tcp 10.132.0.2:41232->10.132.0.47:15021: read: connection reset by peer"
Jul 07 18:15:33.634652 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:15:33.634617    2561 generic.go:356] "Generic (PLEG): container finished" podID="ddde9e74-62d8-4bf1-bd4d-df4f86eb15b4" containerID="320399bf1678f04bb5d1dd97947f4d29ec1015758b1eff04d5d21f8f9acbd143" exitCode=0
Jul 07 18:15:33.634830 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:15:33.634689    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-fad388-openshift-default-56449b5455-qdxwg" event={"ID":"ddde9e74-62d8-4bf1-bd4d-df4f86eb15b4","Type":"ContainerDied","Data":"320399bf1678f04bb5d1dd97947f4d29ec1015758b1eff04d5d21f8f9acbd143"}
Jul 07 18:15:33.635069 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:15:33.635055    2561 scope.go:117] "RemoveContainer" containerID="320399bf1678f04bb5d1dd97947f4d29ec1015758b1eff04d5d21f8f9acbd143"
Jul 07 18:15:33.636147 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:15:33.636123    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 07 18:15:33.636215 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:15:33.636188    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 07 18:15:33.636259 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:15:33.636221    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 07 18:15:34.641465 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:15:34.641403    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-fad388-openshift-default-56449b5455-qdxwg" event={"ID":"ddde9e74-62d8-4bf1-bd4d-df4f86eb15b4","Type":"ContainerStarted","Data":"10de3408a4cb8469c1a46917fb18689c08e9948f46a359c6ec1e9f7f1184f9eb"}
Jul 07 18:15:34.949283 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:15:34.949192    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-fad388-openshift-default-56449b5455-qdxwg"
Jul 07 18:15:34.949484 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:15:34.949459    2561 patch_prober.go:28] interesting pod/e2e-shared-b-fad388-openshift-default-56449b5455-qdxwg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.47:15021/healthz/ready\": dial tcp 10.132.0.47:15021: connect: connection refused" start-of-body=
Jul 07 18:15:34.949535 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:15:34.949511    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-fad388-openshift-default-56449b5455-qdxwg" podUID="ddde9e74-62d8-4bf1-bd4d-df4f86eb15b4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.47:15021/healthz/ready\": dial tcp 10.132.0.47:15021: connect: connection refused"
Jul 07 18:15:35.948785 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:15:35.948745    2561 patch_prober.go:28] interesting pod/e2e-shared-b-fad388-openshift-default-56449b5455-qdxwg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.47:15021/healthz/ready\": dial tcp 10.132.0.47:15021: connect: connection refused" start-of-body=
Jul 07 18:15:35.949198 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:15:35.948801    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-fad388-openshift-default-56449b5455-qdxwg" podUID="ddde9e74-62d8-4bf1-bd4d-df4f86eb15b4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.47:15021/healthz/ready\": dial tcp 10.132.0.47:15021: connect: connection refused"
Jul 07 18:15:36.948967 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:15:36.948922    2561 patch_prober.go:28] interesting pod/e2e-shared-b-fad388-openshift-default-56449b5455-qdxwg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.47:15021/healthz/ready\": dial tcp 10.132.0.47:15021: connect: connection refused" start-of-body=
Jul 07 18:15:36.949364 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:15:36.948991    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-fad388-openshift-default-56449b5455-qdxwg" podUID="ddde9e74-62d8-4bf1-bd4d-df4f86eb15b4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.47:15021/healthz/ready\": dial tcp 10.132.0.47:15021: connect: connection refused"
Jul 07 18:15:37.948994 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:15:37.948951    2561 patch_prober.go:28] interesting pod/e2e-shared-b-fad388-openshift-default-56449b5455-qdxwg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.47:15021/healthz/ready\": dial tcp 10.132.0.47:15021: connect: connection refused" start-of-body=
Jul 07 18:15:37.949495 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:15:37.949011    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-fad388-openshift-default-56449b5455-qdxwg" podUID="ddde9e74-62d8-4bf1-bd4d-df4f86eb15b4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.47:15021/healthz/ready\": dial tcp 10.132.0.47:15021: connect: connection refused"
Jul 07 18:15:38.952750 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:15:38.952717    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-fad388-openshift-default-56449b5455-qdxwg"
Jul 07 18:15:38.953181 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:15:38.952976    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-fad388-openshift-default-56449b5455-qdxwg"
Jul 07 18:15:38.953639 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:15:38.953623    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-fad388-openshift-default-56449b5455-qdxwg"
Jul 07 18:15:39.410904 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:15:39.410862    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-21f62c/auth-test-model-21f62c-kserve-764858f595-4wtsg"
Jul 07 18:15:39.411189 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:15:39.411158    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-21f62c/auth-test-model-21f62c-kserve-764858f595-4wtsg"
Jul 07 18:15:39.423822 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:15:39.423793    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-21f62c/auth-test-model-21f62c-kserve-764858f595-4wtsg"
Jul 07 18:15:39.676489 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:15:39.676387    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-21f62c/auth-test-model-21f62c-kserve-764858f595-4wtsg"
Jul 07 18:16:00.011630 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:16:00.011594    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29724135-tlw5j"]
Jul 07 18:16:00.012147 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:16:00.011806    2561 kuberuntime_container.go:872] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29724135-tlw5j" podUID="76f16250-36f6-46cf-a2ce-6a9ef0d3e477" containerName="cleanup" containerID="cri-o://a7d1e60a5683d9e7ee7e69dcd439779f4300afdc1b030c8171c326bf48dd6b19" gracePeriod=30
Jul 07 18:16:30.188097 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:16:30.188071    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29724135-tlw5j"
Jul 07 18:16:30.324537 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:16:30.324507    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kncf9\" (UniqueName: \"kubernetes.io/projected/76f16250-36f6-46cf-a2ce-6a9ef0d3e477-kube-api-access-kncf9\") pod \"76f16250-36f6-46cf-a2ce-6a9ef0d3e477\" (UID: \"76f16250-36f6-46cf-a2ce-6a9ef0d3e477\") "
Jul 07 18:16:30.326616 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:16:30.326590    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/76f16250-36f6-46cf-a2ce-6a9ef0d3e477-kube-api-access-kncf9" (OuterVolumeSpecName: "kube-api-access-kncf9") pod "76f16250-36f6-46cf-a2ce-6a9ef0d3e477" (UID: "76f16250-36f6-46cf-a2ce-6a9ef0d3e477"). InnerVolumeSpecName "kube-api-access-kncf9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 18:16:30.425402 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:16:30.425365    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kncf9\" (UniqueName: \"kubernetes.io/projected/76f16250-36f6-46cf-a2ce-6a9ef0d3e477-kube-api-access-kncf9\") on node \"ip-10-0-139-31.ec2.internal\" DevicePath \"\""
Jul 07 18:16:30.917439 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:16:30.917397    2561 generic.go:356] "Generic (PLEG): container finished" podID="76f16250-36f6-46cf-a2ce-6a9ef0d3e477" containerID="a7d1e60a5683d9e7ee7e69dcd439779f4300afdc1b030c8171c326bf48dd6b19" exitCode=137
Jul 07 18:16:30.917957 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:16:30.917474    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29724135-tlw5j"
Jul 07 18:16:30.917957 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:16:30.917483    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29724135-tlw5j" event={"ID":"76f16250-36f6-46cf-a2ce-6a9ef0d3e477","Type":"ContainerDied","Data":"a7d1e60a5683d9e7ee7e69dcd439779f4300afdc1b030c8171c326bf48dd6b19"}
Jul 07 18:16:30.917957 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:16:30.917558    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29724135-tlw5j" event={"ID":"76f16250-36f6-46cf-a2ce-6a9ef0d3e477","Type":"ContainerDied","Data":"199c5d161ade4a7f691035a069d53e893c6d5a5a4071907337da629cd4e5122c"}
Jul 07 18:16:30.917957 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:16:30.917583    2561 scope.go:117] "RemoveContainer" containerID="a7d1e60a5683d9e7ee7e69dcd439779f4300afdc1b030c8171c326bf48dd6b19"
Jul 07 18:16:30.926675 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:16:30.926657    2561 scope.go:117] "RemoveContainer" containerID="a7d1e60a5683d9e7ee7e69dcd439779f4300afdc1b030c8171c326bf48dd6b19"
Jul 07 18:16:30.926934 ip-10-0-139-31 kubenswrapper[2561]: E0707 18:16:30.926917    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a7d1e60a5683d9e7ee7e69dcd439779f4300afdc1b030c8171c326bf48dd6b19\": container with ID starting with a7d1e60a5683d9e7ee7e69dcd439779f4300afdc1b030c8171c326bf48dd6b19 not found: ID does not exist" containerID="a7d1e60a5683d9e7ee7e69dcd439779f4300afdc1b030c8171c326bf48dd6b19"
Jul 07 18:16:30.926972 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:16:30.926943    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a7d1e60a5683d9e7ee7e69dcd439779f4300afdc1b030c8171c326bf48dd6b19"} err="failed to get container status \"a7d1e60a5683d9e7ee7e69dcd439779f4300afdc1b030c8171c326bf48dd6b19\": rpc error: code = NotFound desc = could not find container \"a7d1e60a5683d9e7ee7e69dcd439779f4300afdc1b030c8171c326bf48dd6b19\": container with ID starting with a7d1e60a5683d9e7ee7e69dcd439779f4300afdc1b030c8171c326bf48dd6b19 not found: ID does not exist"
Jul 07 18:16:30.943411 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:16:30.943384    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29724135-tlw5j"]
Jul 07 18:16:30.949613 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:16:30.949585    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29724135-tlw5j"]
Jul 07 18:16:31.522172 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:16:31.522139    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="76f16250-36f6-46cf-a2ce-6a9ef0d3e477" path="/var/lib/kubelet/pods/76f16250-36f6-46cf-a2ce-6a9ef0d3e477/volumes"
Jul 07 18:17:43.005712 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:17:43.005673    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-21f62c/auth-test-model-21f62c-kserve-764858f595-4wtsg"]
Jul 07 18:17:58.028170 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:17:58.028103    2561 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-21f62c/auth-test-model-21f62c-kserve-764858f595-4wtsg" podUID="32a3b3ef-aa2d-4b71-a4cb-9b6c3d2596c8" containerName="main" containerID="cri-o://cdc592882dcfa41e7b1020ffe8e3e9fed54ff74ab42ba604edd8ebd0b6214e90" gracePeriod=45
Jul 07 18:17:58.276552 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:17:58.276528    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-21f62c/auth-test-model-21f62c-kserve-764858f595-4wtsg"
Jul 07 18:17:58.334967 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:17:58.334927    2561 generic.go:356] "Generic (PLEG): container finished" podID="32a3b3ef-aa2d-4b71-a4cb-9b6c3d2596c8" containerID="cdc592882dcfa41e7b1020ffe8e3e9fed54ff74ab42ba604edd8ebd0b6214e90" exitCode=0
Jul 07 18:17:58.335148 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:17:58.334977    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-21f62c/auth-test-model-21f62c-kserve-764858f595-4wtsg"
Jul 07 18:17:58.335148 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:17:58.335011    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-21f62c/auth-test-model-21f62c-kserve-764858f595-4wtsg" event={"ID":"32a3b3ef-aa2d-4b71-a4cb-9b6c3d2596c8","Type":"ContainerDied","Data":"cdc592882dcfa41e7b1020ffe8e3e9fed54ff74ab42ba604edd8ebd0b6214e90"}
Jul 07 18:17:58.335148 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:17:58.335061    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-21f62c/auth-test-model-21f62c-kserve-764858f595-4wtsg" event={"ID":"32a3b3ef-aa2d-4b71-a4cb-9b6c3d2596c8","Type":"ContainerDied","Data":"14b352b5c8e933e715dc31cc46c336898c8e2d6e5ee9781ae1441ed5ca3d04ba"}
Jul 07 18:17:58.335148 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:17:58.335085    2561 scope.go:117] "RemoveContainer" containerID="cdc592882dcfa41e7b1020ffe8e3e9fed54ff74ab42ba604edd8ebd0b6214e90"
Jul 07 18:17:58.346550 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:17:58.346530    2561 scope.go:117] "RemoveContainer" containerID="cdc592882dcfa41e7b1020ffe8e3e9fed54ff74ab42ba604edd8ebd0b6214e90"
Jul 07 18:17:58.346849 ip-10-0-139-31 kubenswrapper[2561]: E0707 18:17:58.346823    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cdc592882dcfa41e7b1020ffe8e3e9fed54ff74ab42ba604edd8ebd0b6214e90\": container with ID starting with cdc592882dcfa41e7b1020ffe8e3e9fed54ff74ab42ba604edd8ebd0b6214e90 not found: ID does not exist" containerID="cdc592882dcfa41e7b1020ffe8e3e9fed54ff74ab42ba604edd8ebd0b6214e90"
Jul 07 18:17:58.346950 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:17:58.346861    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cdc592882dcfa41e7b1020ffe8e3e9fed54ff74ab42ba604edd8ebd0b6214e90"} err="failed to get container status \"cdc592882dcfa41e7b1020ffe8e3e9fed54ff74ab42ba604edd8ebd0b6214e90\": rpc error: code = NotFound desc = could not find container \"cdc592882dcfa41e7b1020ffe8e3e9fed54ff74ab42ba604edd8ebd0b6214e90\": container with ID starting with cdc592882dcfa41e7b1020ffe8e3e9fed54ff74ab42ba604edd8ebd0b6214e90 not found: ID does not exist"
Jul 07 18:17:58.376867 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:17:58.376836    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/32a3b3ef-aa2d-4b71-a4cb-9b6c3d2596c8-home\") pod \"32a3b3ef-aa2d-4b71-a4cb-9b6c3d2596c8\" (UID: \"32a3b3ef-aa2d-4b71-a4cb-9b6c3d2596c8\") "
Jul 07 18:17:58.376992 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:17:58.376893    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/32a3b3ef-aa2d-4b71-a4cb-9b6c3d2596c8-model-cache\") pod \"32a3b3ef-aa2d-4b71-a4cb-9b6c3d2596c8\" (UID: \"32a3b3ef-aa2d-4b71-a4cb-9b6c3d2596c8\") "
Jul 07 18:17:58.376992 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:17:58.376917    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/32a3b3ef-aa2d-4b71-a4cb-9b6c3d2596c8-tls-certs\") pod \"32a3b3ef-aa2d-4b71-a4cb-9b6c3d2596c8\" (UID: \"32a3b3ef-aa2d-4b71-a4cb-9b6c3d2596c8\") "
Jul 07 18:17:58.376992 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:17:58.376949    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-srq26\" (UniqueName: \"kubernetes.io/projected/32a3b3ef-aa2d-4b71-a4cb-9b6c3d2596c8-kube-api-access-srq26\") pod \"32a3b3ef-aa2d-4b71-a4cb-9b6c3d2596c8\" (UID: \"32a3b3ef-aa2d-4b71-a4cb-9b6c3d2596c8\") "
Jul 07 18:17:58.377158 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:17:58.377011    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/32a3b3ef-aa2d-4b71-a4cb-9b6c3d2596c8-tmp-dir\") pod \"32a3b3ef-aa2d-4b71-a4cb-9b6c3d2596c8\" (UID: \"32a3b3ef-aa2d-4b71-a4cb-9b6c3d2596c8\") "
Jul 07 18:17:58.377158 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:17:58.377110    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/32a3b3ef-aa2d-4b71-a4cb-9b6c3d2596c8-home" (OuterVolumeSpecName: "home") pod "32a3b3ef-aa2d-4b71-a4cb-9b6c3d2596c8" (UID: "32a3b3ef-aa2d-4b71-a4cb-9b6c3d2596c8"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 18:17:58.377236 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:17:58.377198    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/32a3b3ef-aa2d-4b71-a4cb-9b6c3d2596c8-dshm\") pod \"32a3b3ef-aa2d-4b71-a4cb-9b6c3d2596c8\" (UID: \"32a3b3ef-aa2d-4b71-a4cb-9b6c3d2596c8\") "
Jul 07 18:17:58.377236 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:17:58.377224    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/32a3b3ef-aa2d-4b71-a4cb-9b6c3d2596c8-model-cache" (OuterVolumeSpecName: "model-cache") pod "32a3b3ef-aa2d-4b71-a4cb-9b6c3d2596c8" (UID: "32a3b3ef-aa2d-4b71-a4cb-9b6c3d2596c8"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 18:17:58.377301 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:17:58.377240    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/32a3b3ef-aa2d-4b71-a4cb-9b6c3d2596c8-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "32a3b3ef-aa2d-4b71-a4cb-9b6c3d2596c8" (UID: "32a3b3ef-aa2d-4b71-a4cb-9b6c3d2596c8"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 18:17:58.377574 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:17:58.377551    2561 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/32a3b3ef-aa2d-4b71-a4cb-9b6c3d2596c8-tmp-dir\") on node \"ip-10-0-139-31.ec2.internal\" DevicePath \"\""
Jul 07 18:17:58.377574 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:17:58.377572    2561 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/32a3b3ef-aa2d-4b71-a4cb-9b6c3d2596c8-home\") on node \"ip-10-0-139-31.ec2.internal\" DevicePath \"\""
Jul 07 18:17:58.377773 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:17:58.377581    2561 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/32a3b3ef-aa2d-4b71-a4cb-9b6c3d2596c8-model-cache\") on node \"ip-10-0-139-31.ec2.internal\" DevicePath \"\""
Jul 07 18:17:58.379330 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:17:58.379304    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/32a3b3ef-aa2d-4b71-a4cb-9b6c3d2596c8-dshm" (OuterVolumeSpecName: "dshm") pod "32a3b3ef-aa2d-4b71-a4cb-9b6c3d2596c8" (UID: "32a3b3ef-aa2d-4b71-a4cb-9b6c3d2596c8"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 18:17:58.379422 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:17:58.379344    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/32a3b3ef-aa2d-4b71-a4cb-9b6c3d2596c8-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "32a3b3ef-aa2d-4b71-a4cb-9b6c3d2596c8" (UID: "32a3b3ef-aa2d-4b71-a4cb-9b6c3d2596c8"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 18:17:58.379422 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:17:58.379345    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/32a3b3ef-aa2d-4b71-a4cb-9b6c3d2596c8-kube-api-access-srq26" (OuterVolumeSpecName: "kube-api-access-srq26") pod "32a3b3ef-aa2d-4b71-a4cb-9b6c3d2596c8" (UID: "32a3b3ef-aa2d-4b71-a4cb-9b6c3d2596c8"). InnerVolumeSpecName "kube-api-access-srq26". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 18:17:58.478569 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:17:58.478525    2561 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/32a3b3ef-aa2d-4b71-a4cb-9b6c3d2596c8-tls-certs\") on node \"ip-10-0-139-31.ec2.internal\" DevicePath \"\""
Jul 07 18:17:58.478569 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:17:58.478560    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-srq26\" (UniqueName: \"kubernetes.io/projected/32a3b3ef-aa2d-4b71-a4cb-9b6c3d2596c8-kube-api-access-srq26\") on node \"ip-10-0-139-31.ec2.internal\" DevicePath \"\""
Jul 07 18:17:58.478569 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:17:58.478570    2561 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/32a3b3ef-aa2d-4b71-a4cb-9b6c3d2596c8-dshm\") on node \"ip-10-0-139-31.ec2.internal\" DevicePath \"\""
Jul 07 18:17:58.659115 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:17:58.659080    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-21f62c/auth-test-model-21f62c-kserve-764858f595-4wtsg"]
Jul 07 18:17:58.663546 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:17:58.663522    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-21f62c/auth-test-model-21f62c-kserve-764858f595-4wtsg"]
Jul 07 18:17:59.521566 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:17:59.521535    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="32a3b3ef-aa2d-4b71-a4cb-9b6c3d2596c8" path="/var/lib/kubelet/pods/32a3b3ef-aa2d-4b71-a4cb-9b6c3d2596c8/volumes"
Jul 07 18:18:23.205394 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:18:23.205355    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-fad388/sub-test-model-fad388-kserve-75745ff495-nb76l"]
Jul 07 18:18:23.206092 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:18:23.205980    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="76f16250-36f6-46cf-a2ce-6a9ef0d3e477" containerName="cleanup"
Jul 07 18:18:23.206092 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:18:23.206002    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="76f16250-36f6-46cf-a2ce-6a9ef0d3e477" containerName="cleanup"
Jul 07 18:18:23.206092 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:18:23.206035    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="32a3b3ef-aa2d-4b71-a4cb-9b6c3d2596c8" containerName="main"
Jul 07 18:18:23.206092 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:18:23.206043    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="32a3b3ef-aa2d-4b71-a4cb-9b6c3d2596c8" containerName="main"
Jul 07 18:18:23.206310 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:18:23.206126    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="32a3b3ef-aa2d-4b71-a4cb-9b6c3d2596c8" containerName="main"
Jul 07 18:18:23.206310 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:18:23.206142    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="76f16250-36f6-46cf-a2ce-6a9ef0d3e477" containerName="cleanup"
Jul 07 18:18:23.209187 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:18:23.209167    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-fad388/sub-test-model-fad388-kserve-75745ff495-nb76l"
Jul 07 18:18:23.212179 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:18:23.212153    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-fad388\"/\"kube-root-ca.crt\""
Jul 07 18:18:23.213337 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:18:23.213316    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-fad388\"/\"openshift-service-ca.crt\""
Jul 07 18:18:23.213493 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:18:23.213318    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-fad388\"/\"default-dockercfg-qpg98\""
Jul 07 18:18:23.213559 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:18:23.213511    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-fad388\"/\"sub-test-model-fad388-kserve-self-signed-certs\""
Jul 07 18:18:23.230398 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:18:23.230366    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-fad388/sub-test-model-fad388-kserve-75745ff495-nb76l"]
Jul 07 18:18:23.318885 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:18:23.318841    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/04c8b87d-973f-4c8b-9624-0fb30a9b0675-model-cache\") pod \"sub-test-model-fad388-kserve-75745ff495-nb76l\" (UID: \"04c8b87d-973f-4c8b-9624-0fb30a9b0675\") " pod="ai-tenant-e2e-shared-b-fad388/sub-test-model-fad388-kserve-75745ff495-nb76l"
Jul 07 18:18:23.319063 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:18:23.318925    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/04c8b87d-973f-4c8b-9624-0fb30a9b0675-tmp-dir\") pod \"sub-test-model-fad388-kserve-75745ff495-nb76l\" (UID: \"04c8b87d-973f-4c8b-9624-0fb30a9b0675\") " pod="ai-tenant-e2e-shared-b-fad388/sub-test-model-fad388-kserve-75745ff495-nb76l"
Jul 07 18:18:23.319063 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:18:23.318955    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/04c8b87d-973f-4c8b-9624-0fb30a9b0675-tls-certs\") pod \"sub-test-model-fad388-kserve-75745ff495-nb76l\" (UID: \"04c8b87d-973f-4c8b-9624-0fb30a9b0675\") " pod="ai-tenant-e2e-shared-b-fad388/sub-test-model-fad388-kserve-75745ff495-nb76l"
Jul 07 18:18:23.319063 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:18:23.318986    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/04c8b87d-973f-4c8b-9624-0fb30a9b0675-dshm\") pod \"sub-test-model-fad388-kserve-75745ff495-nb76l\" (UID: \"04c8b87d-973f-4c8b-9624-0fb30a9b0675\") " pod="ai-tenant-e2e-shared-b-fad388/sub-test-model-fad388-kserve-75745ff495-nb76l"
Jul 07 18:18:23.319185 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:18:23.319079    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/04c8b87d-973f-4c8b-9624-0fb30a9b0675-home\") pod \"sub-test-model-fad388-kserve-75745ff495-nb76l\" (UID: \"04c8b87d-973f-4c8b-9624-0fb30a9b0675\") " pod="ai-tenant-e2e-shared-b-fad388/sub-test-model-fad388-kserve-75745ff495-nb76l"
Jul 07 18:18:23.319185 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:18:23.319111    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-brn98\" (UniqueName: \"kubernetes.io/projected/04c8b87d-973f-4c8b-9624-0fb30a9b0675-kube-api-access-brn98\") pod \"sub-test-model-fad388-kserve-75745ff495-nb76l\" (UID: \"04c8b87d-973f-4c8b-9624-0fb30a9b0675\") " pod="ai-tenant-e2e-shared-b-fad388/sub-test-model-fad388-kserve-75745ff495-nb76l"
Jul 07 18:18:23.419656 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:18:23.419625    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/04c8b87d-973f-4c8b-9624-0fb30a9b0675-tmp-dir\") pod \"sub-test-model-fad388-kserve-75745ff495-nb76l\" (UID: \"04c8b87d-973f-4c8b-9624-0fb30a9b0675\") " pod="ai-tenant-e2e-shared-b-fad388/sub-test-model-fad388-kserve-75745ff495-nb76l"
Jul 07 18:18:23.419852 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:18:23.419669    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/04c8b87d-973f-4c8b-9624-0fb30a9b0675-tls-certs\") pod \"sub-test-model-fad388-kserve-75745ff495-nb76l\" (UID: \"04c8b87d-973f-4c8b-9624-0fb30a9b0675\") " pod="ai-tenant-e2e-shared-b-fad388/sub-test-model-fad388-kserve-75745ff495-nb76l"
Jul 07 18:18:23.419852 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:18:23.419705    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/04c8b87d-973f-4c8b-9624-0fb30a9b0675-dshm\") pod \"sub-test-model-fad388-kserve-75745ff495-nb76l\" (UID: \"04c8b87d-973f-4c8b-9624-0fb30a9b0675\") " pod="ai-tenant-e2e-shared-b-fad388/sub-test-model-fad388-kserve-75745ff495-nb76l"
Jul 07 18:18:23.419852 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:18:23.419738    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/04c8b87d-973f-4c8b-9624-0fb30a9b0675-home\") pod \"sub-test-model-fad388-kserve-75745ff495-nb76l\" (UID: \"04c8b87d-973f-4c8b-9624-0fb30a9b0675\") " pod="ai-tenant-e2e-shared-b-fad388/sub-test-model-fad388-kserve-75745ff495-nb76l"
Jul 07 18:18:23.419852 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:18:23.419754    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-brn98\" (UniqueName: \"kubernetes.io/projected/04c8b87d-973f-4c8b-9624-0fb30a9b0675-kube-api-access-brn98\") pod \"sub-test-model-fad388-kserve-75745ff495-nb76l\" (UID: \"04c8b87d-973f-4c8b-9624-0fb30a9b0675\") " pod="ai-tenant-e2e-shared-b-fad388/sub-test-model-fad388-kserve-75745ff495-nb76l"
Jul 07 18:18:23.419852 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:18:23.419778    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/04c8b87d-973f-4c8b-9624-0fb30a9b0675-model-cache\") pod \"sub-test-model-fad388-kserve-75745ff495-nb76l\" (UID: \"04c8b87d-973f-4c8b-9624-0fb30a9b0675\") " pod="ai-tenant-e2e-shared-b-fad388/sub-test-model-fad388-kserve-75745ff495-nb76l"
Jul 07 18:18:23.420132 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:18:23.420074    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/04c8b87d-973f-4c8b-9624-0fb30a9b0675-tmp-dir\") pod \"sub-test-model-fad388-kserve-75745ff495-nb76l\" (UID: \"04c8b87d-973f-4c8b-9624-0fb30a9b0675\") " pod="ai-tenant-e2e-shared-b-fad388/sub-test-model-fad388-kserve-75745ff495-nb76l"
Jul 07 18:18:23.420132 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:18:23.420124    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/04c8b87d-973f-4c8b-9624-0fb30a9b0675-home\") pod \"sub-test-model-fad388-kserve-75745ff495-nb76l\" (UID: \"04c8b87d-973f-4c8b-9624-0fb30a9b0675\") " pod="ai-tenant-e2e-shared-b-fad388/sub-test-model-fad388-kserve-75745ff495-nb76l"
Jul 07 18:18:23.420218 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:18:23.420195    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/04c8b87d-973f-4c8b-9624-0fb30a9b0675-model-cache\") pod \"sub-test-model-fad388-kserve-75745ff495-nb76l\" (UID: \"04c8b87d-973f-4c8b-9624-0fb30a9b0675\") " pod="ai-tenant-e2e-shared-b-fad388/sub-test-model-fad388-kserve-75745ff495-nb76l"
Jul 07 18:18:23.421898 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:18:23.421878    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/04c8b87d-973f-4c8b-9624-0fb30a9b0675-dshm\") pod \"sub-test-model-fad388-kserve-75745ff495-nb76l\" (UID: \"04c8b87d-973f-4c8b-9624-0fb30a9b0675\") " pod="ai-tenant-e2e-shared-b-fad388/sub-test-model-fad388-kserve-75745ff495-nb76l"
Jul 07 18:18:23.422189 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:18:23.422165    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/04c8b87d-973f-4c8b-9624-0fb30a9b0675-tls-certs\") pod \"sub-test-model-fad388-kserve-75745ff495-nb76l\" (UID: \"04c8b87d-973f-4c8b-9624-0fb30a9b0675\") " pod="ai-tenant-e2e-shared-b-fad388/sub-test-model-fad388-kserve-75745ff495-nb76l"
Jul 07 18:18:23.431680 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:18:23.431657    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-brn98\" (UniqueName: \"kubernetes.io/projected/04c8b87d-973f-4c8b-9624-0fb30a9b0675-kube-api-access-brn98\") pod \"sub-test-model-fad388-kserve-75745ff495-nb76l\" (UID: \"04c8b87d-973f-4c8b-9624-0fb30a9b0675\") " pod="ai-tenant-e2e-shared-b-fad388/sub-test-model-fad388-kserve-75745ff495-nb76l"
Jul 07 18:18:23.518330 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:18:23.518234    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-fad388/sub-test-model-fad388-kserve-75745ff495-nb76l"
Jul 07 18:18:23.660738 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:18:23.660698    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-fad388/sub-test-model-fad388-kserve-75745ff495-nb76l"]
Jul 07 18:18:23.664665 ip-10-0-139-31 kubenswrapper[2561]: W0707 18:18:23.664640    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod04c8b87d_973f_4c8b_9624_0fb30a9b0675.slice/crio-60c5365a3b9f95a2b8bafda6283cf58b17fb7849b822a096ce8dc368d22275ff WatchSource:0}: Error finding container 60c5365a3b9f95a2b8bafda6283cf58b17fb7849b822a096ce8dc368d22275ff: Status 404 returned error can't find the container with id 60c5365a3b9f95a2b8bafda6283cf58b17fb7849b822a096ce8dc368d22275ff
Jul 07 18:18:24.461378 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:18:24.461336    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-fad388/sub-test-model-fad388-kserve-75745ff495-nb76l" event={"ID":"04c8b87d-973f-4c8b-9624-0fb30a9b0675","Type":"ContainerStarted","Data":"8810a072485524cf8992a140f746f7fec40144586f1c453f05873d59d8281829"}
Jul 07 18:18:24.461378 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:18:24.461381    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-fad388/sub-test-model-fad388-kserve-75745ff495-nb76l" event={"ID":"04c8b87d-973f-4c8b-9624-0fb30a9b0675","Type":"ContainerStarted","Data":"60c5365a3b9f95a2b8bafda6283cf58b17fb7849b822a096ce8dc368d22275ff"}
Jul 07 18:18:24.481398 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:18:24.481347    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-fad388/sub-test-model-fad388-kserve-75745ff495-nb76l" podStartSLOduration=1.48133156 podStartE2EDuration="1.48133156s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 18:18:23 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 18:18:24.479967409 +0000 UTC m=+2295.631091819" watchObservedRunningTime="2026-07-07 18:18:24.48133156 +0000 UTC m=+2295.632455962"
Jul 07 18:18:33.526279 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:18:33.524021    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-fad388/sub-test-model-fad388-kserve-75745ff495-nb76l"
Jul 07 18:18:33.526279 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:18:33.524081    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-fad388/sub-test-model-fad388-kserve-75745ff495-nb76l"
Jul 07 18:18:33.534594 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:18:33.534568    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-fad388/sub-test-model-fad388-kserve-75745ff495-nb76l"
Jul 07 18:18:34.523609 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:18:34.523579    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-fad388/sub-test-model-fad388-kserve-75745ff495-nb76l"
Jul 07 18:18:56.264826 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:18:56.264791    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-fad388/sub-test-model-fad388-kserve-75745ff495-nb76l"]
Jul 07 18:19:11.284933 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:19:11.284837    2561 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-fad388/sub-test-model-fad388-kserve-75745ff495-nb76l" podUID="04c8b87d-973f-4c8b-9624-0fb30a9b0675" containerName="main" containerID="cri-o://8810a072485524cf8992a140f746f7fec40144586f1c453f05873d59d8281829" gracePeriod=45
Jul 07 18:19:11.542499 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:19:11.542406    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-fad388/sub-test-model-fad388-kserve-75745ff495-nb76l"
Jul 07 18:19:11.685804 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:19:11.685774    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-brn98\" (UniqueName: \"kubernetes.io/projected/04c8b87d-973f-4c8b-9624-0fb30a9b0675-kube-api-access-brn98\") pod \"04c8b87d-973f-4c8b-9624-0fb30a9b0675\" (UID: \"04c8b87d-973f-4c8b-9624-0fb30a9b0675\") "
Jul 07 18:19:11.685981 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:19:11.685823    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/04c8b87d-973f-4c8b-9624-0fb30a9b0675-dshm\") pod \"04c8b87d-973f-4c8b-9624-0fb30a9b0675\" (UID: \"04c8b87d-973f-4c8b-9624-0fb30a9b0675\") "
Jul 07 18:19:11.685981 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:19:11.685866    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/04c8b87d-973f-4c8b-9624-0fb30a9b0675-tmp-dir\") pod \"04c8b87d-973f-4c8b-9624-0fb30a9b0675\" (UID: \"04c8b87d-973f-4c8b-9624-0fb30a9b0675\") "
Jul 07 18:19:11.685981 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:19:11.685885    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/04c8b87d-973f-4c8b-9624-0fb30a9b0675-home\") pod \"04c8b87d-973f-4c8b-9624-0fb30a9b0675\" (UID: \"04c8b87d-973f-4c8b-9624-0fb30a9b0675\") "
Jul 07 18:19:11.685981 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:19:11.685902    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/04c8b87d-973f-4c8b-9624-0fb30a9b0675-model-cache\") pod \"04c8b87d-973f-4c8b-9624-0fb30a9b0675\" (UID: \"04c8b87d-973f-4c8b-9624-0fb30a9b0675\") "
Jul 07 18:19:11.686209 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:19:11.686009    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/04c8b87d-973f-4c8b-9624-0fb30a9b0675-tls-certs\") pod \"04c8b87d-973f-4c8b-9624-0fb30a9b0675\" (UID: \"04c8b87d-973f-4c8b-9624-0fb30a9b0675\") "
Jul 07 18:19:11.686209 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:19:11.686164    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/04c8b87d-973f-4c8b-9624-0fb30a9b0675-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "04c8b87d-973f-4c8b-9624-0fb30a9b0675" (UID: "04c8b87d-973f-4c8b-9624-0fb30a9b0675"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 18:19:11.686338 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:19:11.686226    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/04c8b87d-973f-4c8b-9624-0fb30a9b0675-model-cache" (OuterVolumeSpecName: "model-cache") pod "04c8b87d-973f-4c8b-9624-0fb30a9b0675" (UID: "04c8b87d-973f-4c8b-9624-0fb30a9b0675"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 18:19:11.686393 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:19:11.686368    2561 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/04c8b87d-973f-4c8b-9624-0fb30a9b0675-tmp-dir\") on node \"ip-10-0-139-31.ec2.internal\" DevicePath \"\""
Jul 07 18:19:11.686393 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:19:11.686387    2561 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/04c8b87d-973f-4c8b-9624-0fb30a9b0675-model-cache\") on node \"ip-10-0-139-31.ec2.internal\" DevicePath \"\""
Jul 07 18:19:11.686603 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:19:11.686517    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/04c8b87d-973f-4c8b-9624-0fb30a9b0675-home" (OuterVolumeSpecName: "home") pod "04c8b87d-973f-4c8b-9624-0fb30a9b0675" (UID: "04c8b87d-973f-4c8b-9624-0fb30a9b0675"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 18:19:11.688207 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:19:11.688181    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/04c8b87d-973f-4c8b-9624-0fb30a9b0675-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "04c8b87d-973f-4c8b-9624-0fb30a9b0675" (UID: "04c8b87d-973f-4c8b-9624-0fb30a9b0675"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 18:19:11.688329 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:19:11.688188    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/04c8b87d-973f-4c8b-9624-0fb30a9b0675-dshm" (OuterVolumeSpecName: "dshm") pod "04c8b87d-973f-4c8b-9624-0fb30a9b0675" (UID: "04c8b87d-973f-4c8b-9624-0fb30a9b0675"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 18:19:11.688329 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:19:11.688243    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/04c8b87d-973f-4c8b-9624-0fb30a9b0675-kube-api-access-brn98" (OuterVolumeSpecName: "kube-api-access-brn98") pod "04c8b87d-973f-4c8b-9624-0fb30a9b0675" (UID: "04c8b87d-973f-4c8b-9624-0fb30a9b0675"). InnerVolumeSpecName "kube-api-access-brn98". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 18:19:11.694167 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:19:11.694142    2561 generic.go:356] "Generic (PLEG): container finished" podID="04c8b87d-973f-4c8b-9624-0fb30a9b0675" containerID="8810a072485524cf8992a140f746f7fec40144586f1c453f05873d59d8281829" exitCode=0
Jul 07 18:19:11.694291 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:19:11.694185    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-fad388/sub-test-model-fad388-kserve-75745ff495-nb76l"
Jul 07 18:19:11.694291 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:19:11.694220    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-fad388/sub-test-model-fad388-kserve-75745ff495-nb76l" event={"ID":"04c8b87d-973f-4c8b-9624-0fb30a9b0675","Type":"ContainerDied","Data":"8810a072485524cf8992a140f746f7fec40144586f1c453f05873d59d8281829"}
Jul 07 18:19:11.694291 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:19:11.694264    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-fad388/sub-test-model-fad388-kserve-75745ff495-nb76l" event={"ID":"04c8b87d-973f-4c8b-9624-0fb30a9b0675","Type":"ContainerDied","Data":"60c5365a3b9f95a2b8bafda6283cf58b17fb7849b822a096ce8dc368d22275ff"}
Jul 07 18:19:11.694419 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:19:11.694289    2561 scope.go:117] "RemoveContainer" containerID="8810a072485524cf8992a140f746f7fec40144586f1c453f05873d59d8281829"
Jul 07 18:19:11.709273 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:19:11.709252    2561 scope.go:117] "RemoveContainer" containerID="8810a072485524cf8992a140f746f7fec40144586f1c453f05873d59d8281829"
Jul 07 18:19:11.709593 ip-10-0-139-31 kubenswrapper[2561]: E0707 18:19:11.709573    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8810a072485524cf8992a140f746f7fec40144586f1c453f05873d59d8281829\": container with ID starting with 8810a072485524cf8992a140f746f7fec40144586f1c453f05873d59d8281829 not found: ID does not exist" containerID="8810a072485524cf8992a140f746f7fec40144586f1c453f05873d59d8281829"
Jul 07 18:19:11.709651 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:19:11.709603    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8810a072485524cf8992a140f746f7fec40144586f1c453f05873d59d8281829"} err="failed to get container status \"8810a072485524cf8992a140f746f7fec40144586f1c453f05873d59d8281829\": rpc error: code = NotFound desc = could not find container \"8810a072485524cf8992a140f746f7fec40144586f1c453f05873d59d8281829\": container with ID starting with 8810a072485524cf8992a140f746f7fec40144586f1c453f05873d59d8281829 not found: ID does not exist"
Jul 07 18:19:11.727260 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:19:11.727226    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-fad388/sub-test-model-fad388-kserve-75745ff495-nb76l"]
Jul 07 18:19:11.731637 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:19:11.731612    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-fad388/sub-test-model-fad388-kserve-75745ff495-nb76l"]
Jul 07 18:19:11.786918 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:19:11.786888    2561 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/04c8b87d-973f-4c8b-9624-0fb30a9b0675-home\") on node \"ip-10-0-139-31.ec2.internal\" DevicePath \"\""
Jul 07 18:19:11.786918 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:19:11.786914    2561 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/04c8b87d-973f-4c8b-9624-0fb30a9b0675-tls-certs\") on node \"ip-10-0-139-31.ec2.internal\" DevicePath \"\""
Jul 07 18:19:11.786918 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:19:11.786924    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-brn98\" (UniqueName: \"kubernetes.io/projected/04c8b87d-973f-4c8b-9624-0fb30a9b0675-kube-api-access-brn98\") on node \"ip-10-0-139-31.ec2.internal\" DevicePath \"\""
Jul 07 18:19:11.787162 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:19:11.786934    2561 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/04c8b87d-973f-4c8b-9624-0fb30a9b0675-dshm\") on node \"ip-10-0-139-31.ec2.internal\" DevicePath \"\""
Jul 07 18:19:13.521678 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:19:13.521635    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="04c8b87d-973f-4c8b-9624-0fb30a9b0675" path="/var/lib/kubelet/pods/04c8b87d-973f-4c8b-9624-0fb30a9b0675/volumes"
Jul 07 18:19:36.806559 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:19:36.806523    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-fad388/rate-test-model-fad388-kserve-5f4787f847-qt6w8"]
Jul 07 18:19:36.807060 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:19:36.806955    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="04c8b87d-973f-4c8b-9624-0fb30a9b0675" containerName="main"
Jul 07 18:19:36.807060 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:19:36.806967    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="04c8b87d-973f-4c8b-9624-0fb30a9b0675" containerName="main"
Jul 07 18:19:36.807060 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:19:36.807046    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="04c8b87d-973f-4c8b-9624-0fb30a9b0675" containerName="main"
Jul 07 18:19:36.810261 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:19:36.810242    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-fad388/rate-test-model-fad388-kserve-5f4787f847-qt6w8"
Jul 07 18:19:36.814689 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:19:36.814660    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-fad388\"/\"default-dockercfg-qpg98\""
Jul 07 18:19:36.814689 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:19:36.814679    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-fad388\"/\"openshift-service-ca.crt\""
Jul 07 18:19:36.814898 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:19:36.814707    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-fad388\"/\"rate-test-model-fad388-kserve-self-signed-certs\""
Jul 07 18:19:36.814898 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:19:36.814750    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-fad388\"/\"kube-root-ca.crt\""
Jul 07 18:19:36.824474 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:19:36.824434    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-fad388/rate-test-model-fad388-kserve-5f4787f847-qt6w8"]
Jul 07 18:19:36.929321 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:19:36.929284    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cw6vd\" (UniqueName: \"kubernetes.io/projected/b7c5cfa5-b2ae-4d57-8a2f-719b033c48d7-kube-api-access-cw6vd\") pod \"rate-test-model-fad388-kserve-5f4787f847-qt6w8\" (UID: \"b7c5cfa5-b2ae-4d57-8a2f-719b033c48d7\") " pod="ai-tenant-e2e-shared-b-fad388/rate-test-model-fad388-kserve-5f4787f847-qt6w8"
Jul 07 18:19:36.929321 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:19:36.929332    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b7c5cfa5-b2ae-4d57-8a2f-719b033c48d7-tls-certs\") pod \"rate-test-model-fad388-kserve-5f4787f847-qt6w8\" (UID: \"b7c5cfa5-b2ae-4d57-8a2f-719b033c48d7\") " pod="ai-tenant-e2e-shared-b-fad388/rate-test-model-fad388-kserve-5f4787f847-qt6w8"
Jul 07 18:19:36.929602 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:19:36.929355    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b7c5cfa5-b2ae-4d57-8a2f-719b033c48d7-home\") pod \"rate-test-model-fad388-kserve-5f4787f847-qt6w8\" (UID: \"b7c5cfa5-b2ae-4d57-8a2f-719b033c48d7\") " pod="ai-tenant-e2e-shared-b-fad388/rate-test-model-fad388-kserve-5f4787f847-qt6w8"
Jul 07 18:19:36.929602 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:19:36.929380    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b7c5cfa5-b2ae-4d57-8a2f-719b033c48d7-dshm\") pod \"rate-test-model-fad388-kserve-5f4787f847-qt6w8\" (UID: \"b7c5cfa5-b2ae-4d57-8a2f-719b033c48d7\") " pod="ai-tenant-e2e-shared-b-fad388/rate-test-model-fad388-kserve-5f4787f847-qt6w8"
Jul 07 18:19:36.929602 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:19:36.929417    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b7c5cfa5-b2ae-4d57-8a2f-719b033c48d7-model-cache\") pod \"rate-test-model-fad388-kserve-5f4787f847-qt6w8\" (UID: \"b7c5cfa5-b2ae-4d57-8a2f-719b033c48d7\") " pod="ai-tenant-e2e-shared-b-fad388/rate-test-model-fad388-kserve-5f4787f847-qt6w8"
Jul 07 18:19:36.929602 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:19:36.929492    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b7c5cfa5-b2ae-4d57-8a2f-719b033c48d7-tmp-dir\") pod \"rate-test-model-fad388-kserve-5f4787f847-qt6w8\" (UID: \"b7c5cfa5-b2ae-4d57-8a2f-719b033c48d7\") " pod="ai-tenant-e2e-shared-b-fad388/rate-test-model-fad388-kserve-5f4787f847-qt6w8"
Jul 07 18:19:37.030633 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:19:37.030590    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cw6vd\" (UniqueName: \"kubernetes.io/projected/b7c5cfa5-b2ae-4d57-8a2f-719b033c48d7-kube-api-access-cw6vd\") pod \"rate-test-model-fad388-kserve-5f4787f847-qt6w8\" (UID: \"b7c5cfa5-b2ae-4d57-8a2f-719b033c48d7\") " pod="ai-tenant-e2e-shared-b-fad388/rate-test-model-fad388-kserve-5f4787f847-qt6w8"
Jul 07 18:19:37.030869 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:19:37.030653    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b7c5cfa5-b2ae-4d57-8a2f-719b033c48d7-tls-certs\") pod \"rate-test-model-fad388-kserve-5f4787f847-qt6w8\" (UID: \"b7c5cfa5-b2ae-4d57-8a2f-719b033c48d7\") " pod="ai-tenant-e2e-shared-b-fad388/rate-test-model-fad388-kserve-5f4787f847-qt6w8"
Jul 07 18:19:37.030869 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:19:37.030683    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b7c5cfa5-b2ae-4d57-8a2f-719b033c48d7-home\") pod \"rate-test-model-fad388-kserve-5f4787f847-qt6w8\" (UID: \"b7c5cfa5-b2ae-4d57-8a2f-719b033c48d7\") " pod="ai-tenant-e2e-shared-b-fad388/rate-test-model-fad388-kserve-5f4787f847-qt6w8"
Jul 07 18:19:37.030869 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:19:37.030706    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b7c5cfa5-b2ae-4d57-8a2f-719b033c48d7-dshm\") pod \"rate-test-model-fad388-kserve-5f4787f847-qt6w8\" (UID: \"b7c5cfa5-b2ae-4d57-8a2f-719b033c48d7\") " pod="ai-tenant-e2e-shared-b-fad388/rate-test-model-fad388-kserve-5f4787f847-qt6w8"
Jul 07 18:19:37.030869 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:19:37.030729    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b7c5cfa5-b2ae-4d57-8a2f-719b033c48d7-model-cache\") pod \"rate-test-model-fad388-kserve-5f4787f847-qt6w8\" (UID: \"b7c5cfa5-b2ae-4d57-8a2f-719b033c48d7\") " pod="ai-tenant-e2e-shared-b-fad388/rate-test-model-fad388-kserve-5f4787f847-qt6w8"
Jul 07 18:19:37.030869 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:19:37.030751    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b7c5cfa5-b2ae-4d57-8a2f-719b033c48d7-tmp-dir\") pod \"rate-test-model-fad388-kserve-5f4787f847-qt6w8\" (UID: \"b7c5cfa5-b2ae-4d57-8a2f-719b033c48d7\") " pod="ai-tenant-e2e-shared-b-fad388/rate-test-model-fad388-kserve-5f4787f847-qt6w8"
Jul 07 18:19:37.031329 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:19:37.031299    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b7c5cfa5-b2ae-4d57-8a2f-719b033c48d7-home\") pod \"rate-test-model-fad388-kserve-5f4787f847-qt6w8\" (UID: \"b7c5cfa5-b2ae-4d57-8a2f-719b033c48d7\") " pod="ai-tenant-e2e-shared-b-fad388/rate-test-model-fad388-kserve-5f4787f847-qt6w8"
Jul 07 18:19:37.031402 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:19:37.031308    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b7c5cfa5-b2ae-4d57-8a2f-719b033c48d7-tmp-dir\") pod \"rate-test-model-fad388-kserve-5f4787f847-qt6w8\" (UID: \"b7c5cfa5-b2ae-4d57-8a2f-719b033c48d7\") " pod="ai-tenant-e2e-shared-b-fad388/rate-test-model-fad388-kserve-5f4787f847-qt6w8"
Jul 07 18:19:37.031480 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:19:37.031412    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b7c5cfa5-b2ae-4d57-8a2f-719b033c48d7-model-cache\") pod \"rate-test-model-fad388-kserve-5f4787f847-qt6w8\" (UID: \"b7c5cfa5-b2ae-4d57-8a2f-719b033c48d7\") " pod="ai-tenant-e2e-shared-b-fad388/rate-test-model-fad388-kserve-5f4787f847-qt6w8"
Jul 07 18:19:37.033738 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:19:37.033712    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b7c5cfa5-b2ae-4d57-8a2f-719b033c48d7-tls-certs\") pod \"rate-test-model-fad388-kserve-5f4787f847-qt6w8\" (UID: \"b7c5cfa5-b2ae-4d57-8a2f-719b033c48d7\") " pod="ai-tenant-e2e-shared-b-fad388/rate-test-model-fad388-kserve-5f4787f847-qt6w8"
Jul 07 18:19:37.033861 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:19:37.033742    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b7c5cfa5-b2ae-4d57-8a2f-719b033c48d7-dshm\") pod \"rate-test-model-fad388-kserve-5f4787f847-qt6w8\" (UID: \"b7c5cfa5-b2ae-4d57-8a2f-719b033c48d7\") " pod="ai-tenant-e2e-shared-b-fad388/rate-test-model-fad388-kserve-5f4787f847-qt6w8"
Jul 07 18:19:37.042071 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:19:37.042033    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cw6vd\" (UniqueName: \"kubernetes.io/projected/b7c5cfa5-b2ae-4d57-8a2f-719b033c48d7-kube-api-access-cw6vd\") pod \"rate-test-model-fad388-kserve-5f4787f847-qt6w8\" (UID: \"b7c5cfa5-b2ae-4d57-8a2f-719b033c48d7\") " pod="ai-tenant-e2e-shared-b-fad388/rate-test-model-fad388-kserve-5f4787f847-qt6w8"
Jul 07 18:19:37.120810 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:19:37.120718    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-fad388/rate-test-model-fad388-kserve-5f4787f847-qt6w8"
Jul 07 18:19:37.263946 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:19:37.263861    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-fad388/rate-test-model-fad388-kserve-5f4787f847-qt6w8"]
Jul 07 18:19:37.266223 ip-10-0-139-31 kubenswrapper[2561]: W0707 18:19:37.266196    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb7c5cfa5_b2ae_4d57_8a2f_719b033c48d7.slice/crio-b75ec2856f36d2218d774f57e6ccd4a8bfa7eb5966e455213ce78401d50ba528 WatchSource:0}: Error finding container b75ec2856f36d2218d774f57e6ccd4a8bfa7eb5966e455213ce78401d50ba528: Status 404 returned error can't find the container with id b75ec2856f36d2218d774f57e6ccd4a8bfa7eb5966e455213ce78401d50ba528
Jul 07 18:19:37.819535 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:19:37.819491    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-fad388/rate-test-model-fad388-kserve-5f4787f847-qt6w8" event={"ID":"b7c5cfa5-b2ae-4d57-8a2f-719b033c48d7","Type":"ContainerStarted","Data":"e6c0d70b9f1f0d8d4b2da883014390fea1e2af17b48d06c32db8f8a4252141ca"}
Jul 07 18:19:37.819535 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:19:37.819535    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-fad388/rate-test-model-fad388-kserve-5f4787f847-qt6w8" event={"ID":"b7c5cfa5-b2ae-4d57-8a2f-719b033c48d7","Type":"ContainerStarted","Data":"b75ec2856f36d2218d774f57e6ccd4a8bfa7eb5966e455213ce78401d50ba528"}
Jul 07 18:19:37.849976 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:19:37.849916    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-fad388/rate-test-model-fad388-kserve-5f4787f847-qt6w8" podStartSLOduration=1.849899017 podStartE2EDuration="1.849899017s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 18:19:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 18:19:37.848893862 +0000 UTC m=+2369.000018272" watchObservedRunningTime="2026-07-07 18:19:37.849899017 +0000 UTC m=+2369.001023417"
Jul 07 18:19:47.121066 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:19:47.121028    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-fad388/rate-test-model-fad388-kserve-5f4787f847-qt6w8"
Jul 07 18:19:47.121532 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:19:47.121103    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-fad388/rate-test-model-fad388-kserve-5f4787f847-qt6w8"
Jul 07 18:19:47.133698 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:19:47.133670    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-fad388/rate-test-model-fad388-kserve-5f4787f847-qt6w8"
Jul 07 18:19:47.876428 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:19:47.876400    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-fad388/rate-test-model-fad388-kserve-5f4787f847-qt6w8"
Jul 07 18:20:09.506735 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:20:09.506701    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-bjl48_805597ff-168d-4099-95b8-0037b0ceba2f/console-operator/1.log"
Jul 07 18:20:09.508938 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:20:09.508912    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-bjl48_805597ff-168d-4099-95b8-0037b0ceba2f/console-operator/1.log"
Jul 07 18:20:24.605758 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:20:24.605718    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-fad388/rate-test-model-fad388-kserve-5f4787f847-qt6w8"]
Jul 07 18:20:39.625539 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:20:39.625480    2561 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-fad388/rate-test-model-fad388-kserve-5f4787f847-qt6w8" podUID="b7c5cfa5-b2ae-4d57-8a2f-719b033c48d7" containerName="main" containerID="cri-o://e6c0d70b9f1f0d8d4b2da883014390fea1e2af17b48d06c32db8f8a4252141ca" gracePeriod=45
Jul 07 18:20:39.874414 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:20:39.874381    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-fad388/rate-test-model-fad388-kserve-5f4787f847-qt6w8"
Jul 07 18:20:40.024784 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:20:40.024685    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cw6vd\" (UniqueName: \"kubernetes.io/projected/b7c5cfa5-b2ae-4d57-8a2f-719b033c48d7-kube-api-access-cw6vd\") pod \"b7c5cfa5-b2ae-4d57-8a2f-719b033c48d7\" (UID: \"b7c5cfa5-b2ae-4d57-8a2f-719b033c48d7\") "
Jul 07 18:20:40.024784 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:20:40.024737    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b7c5cfa5-b2ae-4d57-8a2f-719b033c48d7-home\") pod \"b7c5cfa5-b2ae-4d57-8a2f-719b033c48d7\" (UID: \"b7c5cfa5-b2ae-4d57-8a2f-719b033c48d7\") "
Jul 07 18:20:40.024784 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:20:40.024780    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b7c5cfa5-b2ae-4d57-8a2f-719b033c48d7-model-cache\") pod \"b7c5cfa5-b2ae-4d57-8a2f-719b033c48d7\" (UID: \"b7c5cfa5-b2ae-4d57-8a2f-719b033c48d7\") "
Jul 07 18:20:40.025089 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:20:40.024822    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b7c5cfa5-b2ae-4d57-8a2f-719b033c48d7-tls-certs\") pod \"b7c5cfa5-b2ae-4d57-8a2f-719b033c48d7\" (UID: \"b7c5cfa5-b2ae-4d57-8a2f-719b033c48d7\") "
Jul 07 18:20:40.025089 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:20:40.024859    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b7c5cfa5-b2ae-4d57-8a2f-719b033c48d7-dshm\") pod \"b7c5cfa5-b2ae-4d57-8a2f-719b033c48d7\" (UID: \"b7c5cfa5-b2ae-4d57-8a2f-719b033c48d7\") "
Jul 07 18:20:40.025089 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:20:40.024882    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b7c5cfa5-b2ae-4d57-8a2f-719b033c48d7-tmp-dir\") pod \"b7c5cfa5-b2ae-4d57-8a2f-719b033c48d7\" (UID: \"b7c5cfa5-b2ae-4d57-8a2f-719b033c48d7\") "
Jul 07 18:20:40.025244 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:20:40.025091    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b7c5cfa5-b2ae-4d57-8a2f-719b033c48d7-home" (OuterVolumeSpecName: "home") pod "b7c5cfa5-b2ae-4d57-8a2f-719b033c48d7" (UID: "b7c5cfa5-b2ae-4d57-8a2f-719b033c48d7"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 18:20:40.025244 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:20:40.025105    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b7c5cfa5-b2ae-4d57-8a2f-719b033c48d7-model-cache" (OuterVolumeSpecName: "model-cache") pod "b7c5cfa5-b2ae-4d57-8a2f-719b033c48d7" (UID: "b7c5cfa5-b2ae-4d57-8a2f-719b033c48d7"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 18:20:40.025244 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:20:40.025181    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b7c5cfa5-b2ae-4d57-8a2f-719b033c48d7-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "b7c5cfa5-b2ae-4d57-8a2f-719b033c48d7" (UID: "b7c5cfa5-b2ae-4d57-8a2f-719b033c48d7"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 18:20:40.025385 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:20:40.025306    2561 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b7c5cfa5-b2ae-4d57-8a2f-719b033c48d7-home\") on node \"ip-10-0-139-31.ec2.internal\" DevicePath \"\""
Jul 07 18:20:40.025385 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:20:40.025328    2561 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b7c5cfa5-b2ae-4d57-8a2f-719b033c48d7-model-cache\") on node \"ip-10-0-139-31.ec2.internal\" DevicePath \"\""
Jul 07 18:20:40.025385 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:20:40.025343    2561 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b7c5cfa5-b2ae-4d57-8a2f-719b033c48d7-tmp-dir\") on node \"ip-10-0-139-31.ec2.internal\" DevicePath \"\""
Jul 07 18:20:40.026986 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:20:40.026958    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b7c5cfa5-b2ae-4d57-8a2f-719b033c48d7-dshm" (OuterVolumeSpecName: "dshm") pod "b7c5cfa5-b2ae-4d57-8a2f-719b033c48d7" (UID: "b7c5cfa5-b2ae-4d57-8a2f-719b033c48d7"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 18:20:40.026986 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:20:40.026962    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b7c5cfa5-b2ae-4d57-8a2f-719b033c48d7-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "b7c5cfa5-b2ae-4d57-8a2f-719b033c48d7" (UID: "b7c5cfa5-b2ae-4d57-8a2f-719b033c48d7"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 18:20:40.027147 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:20:40.027013    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b7c5cfa5-b2ae-4d57-8a2f-719b033c48d7-kube-api-access-cw6vd" (OuterVolumeSpecName: "kube-api-access-cw6vd") pod "b7c5cfa5-b2ae-4d57-8a2f-719b033c48d7" (UID: "b7c5cfa5-b2ae-4d57-8a2f-719b033c48d7"). InnerVolumeSpecName "kube-api-access-cw6vd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 18:20:40.116947 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:20:40.116908    2561 generic.go:356] "Generic (PLEG): container finished" podID="b7c5cfa5-b2ae-4d57-8a2f-719b033c48d7" containerID="e6c0d70b9f1f0d8d4b2da883014390fea1e2af17b48d06c32db8f8a4252141ca" exitCode=0
Jul 07 18:20:40.117153 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:20:40.116954    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-fad388/rate-test-model-fad388-kserve-5f4787f847-qt6w8"
Jul 07 18:20:40.117153 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:20:40.116993    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-fad388/rate-test-model-fad388-kserve-5f4787f847-qt6w8" event={"ID":"b7c5cfa5-b2ae-4d57-8a2f-719b033c48d7","Type":"ContainerDied","Data":"e6c0d70b9f1f0d8d4b2da883014390fea1e2af17b48d06c32db8f8a4252141ca"}
Jul 07 18:20:40.117153 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:20:40.117038    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-fad388/rate-test-model-fad388-kserve-5f4787f847-qt6w8" event={"ID":"b7c5cfa5-b2ae-4d57-8a2f-719b033c48d7","Type":"ContainerDied","Data":"b75ec2856f36d2218d774f57e6ccd4a8bfa7eb5966e455213ce78401d50ba528"}
Jul 07 18:20:40.117153 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:20:40.117060    2561 scope.go:117] "RemoveContainer" containerID="e6c0d70b9f1f0d8d4b2da883014390fea1e2af17b48d06c32db8f8a4252141ca"
Jul 07 18:20:40.126041 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:20:40.126011    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cw6vd\" (UniqueName: \"kubernetes.io/projected/b7c5cfa5-b2ae-4d57-8a2f-719b033c48d7-kube-api-access-cw6vd\") on node \"ip-10-0-139-31.ec2.internal\" DevicePath \"\""
Jul 07 18:20:40.126041 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:20:40.126039    2561 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b7c5cfa5-b2ae-4d57-8a2f-719b033c48d7-tls-certs\") on node \"ip-10-0-139-31.ec2.internal\" DevicePath \"\""
Jul 07 18:20:40.126278 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:20:40.126051    2561 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b7c5cfa5-b2ae-4d57-8a2f-719b033c48d7-dshm\") on node \"ip-10-0-139-31.ec2.internal\" DevicePath \"\""
Jul 07 18:20:40.127211 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:20:40.127185    2561 scope.go:117] "RemoveContainer" containerID="e6c0d70b9f1f0d8d4b2da883014390fea1e2af17b48d06c32db8f8a4252141ca"
Jul 07 18:20:40.127716 ip-10-0-139-31 kubenswrapper[2561]: E0707 18:20:40.127689    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e6c0d70b9f1f0d8d4b2da883014390fea1e2af17b48d06c32db8f8a4252141ca\": container with ID starting with e6c0d70b9f1f0d8d4b2da883014390fea1e2af17b48d06c32db8f8a4252141ca not found: ID does not exist" containerID="e6c0d70b9f1f0d8d4b2da883014390fea1e2af17b48d06c32db8f8a4252141ca"
Jul 07 18:20:40.127817 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:20:40.127726    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e6c0d70b9f1f0d8d4b2da883014390fea1e2af17b48d06c32db8f8a4252141ca"} err="failed to get container status \"e6c0d70b9f1f0d8d4b2da883014390fea1e2af17b48d06c32db8f8a4252141ca\": rpc error: code = NotFound desc = could not find container \"e6c0d70b9f1f0d8d4b2da883014390fea1e2af17b48d06c32db8f8a4252141ca\": container with ID starting with e6c0d70b9f1f0d8d4b2da883014390fea1e2af17b48d06c32db8f8a4252141ca not found: ID does not exist"
Jul 07 18:20:40.143919 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:20:40.143888    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-fad388/rate-test-model-fad388-kserve-5f4787f847-qt6w8"]
Jul 07 18:20:40.151366 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:20:40.151334    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-fad388/rate-test-model-fad388-kserve-5f4787f847-qt6w8"]
Jul 07 18:20:41.521523 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:20:41.521494    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b7c5cfa5-b2ae-4d57-8a2f-719b033c48d7" path="/var/lib/kubelet/pods/b7c5cfa5-b2ae-4d57-8a2f-719b033c48d7/volumes"
Jul 07 18:21:08.539689 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:21:08.539655    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-21f62c-openshift-default-9b4fd55ff-cmgvf"]
Jul 07 18:21:08.540243 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:21:08.539877    2561 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-a-21f62c-openshift-default-9b4fd55ff-cmgvf" podUID="ced5755d-ed11-4d78-b647-9b5ee29156ad" containerName="istio-proxy" containerID="cri-o://e406124ed51db9a73e898ede44e335f020f8560a8709619444e7070d18e08f4f" gracePeriod=30
Jul 07 18:21:12.509519 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:21:12.509478    2561 patch_prober.go:28] interesting pod/e2e-shared-a-21f62c-openshift-default-9b4fd55ff-cmgvf container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 07 18:21:12.509910 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:21:12.509555    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-a-21f62c-openshift-default-9b4fd55ff-cmgvf" podUID="ced5755d-ed11-4d78-b647-9b5ee29156ad" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 07 18:21:13.798249 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:21:13.798224    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-21f62c-openshift-default-9b4fd55ff-cmgvf"
Jul 07 18:21:13.944372 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:21:13.944288    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ced5755d-ed11-4d78-b647-9b5ee29156ad-credential-socket\") pod \"ced5755d-ed11-4d78-b647-9b5ee29156ad\" (UID: \"ced5755d-ed11-4d78-b647-9b5ee29156ad\") "
Jul 07 18:21:13.944372 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:21:13.944327    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ced5755d-ed11-4d78-b647-9b5ee29156ad-istio-data\") pod \"ced5755d-ed11-4d78-b647-9b5ee29156ad\" (UID: \"ced5755d-ed11-4d78-b647-9b5ee29156ad\") "
Jul 07 18:21:13.944372 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:21:13.944351    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ced5755d-ed11-4d78-b647-9b5ee29156ad-istio-podinfo\") pod \"ced5755d-ed11-4d78-b647-9b5ee29156ad\" (UID: \"ced5755d-ed11-4d78-b647-9b5ee29156ad\") "
Jul 07 18:21:13.944693 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:21:13.944392    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ced5755d-ed11-4d78-b647-9b5ee29156ad-workload-socket\") pod \"ced5755d-ed11-4d78-b647-9b5ee29156ad\" (UID: \"ced5755d-ed11-4d78-b647-9b5ee29156ad\") "
Jul 07 18:21:13.944693 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:21:13.944411    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ced5755d-ed11-4d78-b647-9b5ee29156ad-istio-token\") pod \"ced5755d-ed11-4d78-b647-9b5ee29156ad\" (UID: \"ced5755d-ed11-4d78-b647-9b5ee29156ad\") "
Jul 07 18:21:13.944693 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:21:13.944434    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ced5755d-ed11-4d78-b647-9b5ee29156ad-istiod-ca-cert\") pod \"ced5755d-ed11-4d78-b647-9b5ee29156ad\" (UID: \"ced5755d-ed11-4d78-b647-9b5ee29156ad\") "
Jul 07 18:21:13.944693 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:21:13.944482    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ced5755d-ed11-4d78-b647-9b5ee29156ad-istio-envoy\") pod \"ced5755d-ed11-4d78-b647-9b5ee29156ad\" (UID: \"ced5755d-ed11-4d78-b647-9b5ee29156ad\") "
Jul 07 18:21:13.944693 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:21:13.944568    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ced5755d-ed11-4d78-b647-9b5ee29156ad-workload-certs\") pod \"ced5755d-ed11-4d78-b647-9b5ee29156ad\" (UID: \"ced5755d-ed11-4d78-b647-9b5ee29156ad\") "
Jul 07 18:21:13.944693 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:21:13.944625    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4xdz5\" (UniqueName: \"kubernetes.io/projected/ced5755d-ed11-4d78-b647-9b5ee29156ad-kube-api-access-4xdz5\") pod \"ced5755d-ed11-4d78-b647-9b5ee29156ad\" (UID: \"ced5755d-ed11-4d78-b647-9b5ee29156ad\") "
Jul 07 18:21:13.945000 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:21:13.944693    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ced5755d-ed11-4d78-b647-9b5ee29156ad-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "ced5755d-ed11-4d78-b647-9b5ee29156ad" (UID: "ced5755d-ed11-4d78-b647-9b5ee29156ad"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 18:21:13.945000 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:21:13.944759    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ced5755d-ed11-4d78-b647-9b5ee29156ad-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "ced5755d-ed11-4d78-b647-9b5ee29156ad" (UID: "ced5755d-ed11-4d78-b647-9b5ee29156ad"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 18:21:13.945000 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:21:13.944953    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ced5755d-ed11-4d78-b647-9b5ee29156ad-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "ced5755d-ed11-4d78-b647-9b5ee29156ad" (UID: "ced5755d-ed11-4d78-b647-9b5ee29156ad"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 18:21:13.945149 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:21:13.945022    2561 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ced5755d-ed11-4d78-b647-9b5ee29156ad-credential-socket\") on node \"ip-10-0-139-31.ec2.internal\" DevicePath \"\""
Jul 07 18:21:13.945149 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:21:13.945072    2561 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ced5755d-ed11-4d78-b647-9b5ee29156ad-workload-socket\") on node \"ip-10-0-139-31.ec2.internal\" DevicePath \"\""
Jul 07 18:21:13.945264 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:21:13.945165    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ced5755d-ed11-4d78-b647-9b5ee29156ad-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "ced5755d-ed11-4d78-b647-9b5ee29156ad" (UID: "ced5755d-ed11-4d78-b647-9b5ee29156ad"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 18:21:13.945524 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:21:13.945497    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ced5755d-ed11-4d78-b647-9b5ee29156ad-istio-data" (OuterVolumeSpecName: "istio-data") pod "ced5755d-ed11-4d78-b647-9b5ee29156ad" (UID: "ced5755d-ed11-4d78-b647-9b5ee29156ad"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 18:21:13.946824 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:21:13.946796    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ced5755d-ed11-4d78-b647-9b5ee29156ad-istio-token" (OuterVolumeSpecName: "istio-token") pod "ced5755d-ed11-4d78-b647-9b5ee29156ad" (UID: "ced5755d-ed11-4d78-b647-9b5ee29156ad"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 18:21:13.946928 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:21:13.946845    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/ced5755d-ed11-4d78-b647-9b5ee29156ad-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "ced5755d-ed11-4d78-b647-9b5ee29156ad" (UID: "ced5755d-ed11-4d78-b647-9b5ee29156ad"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 07 18:21:13.946928 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:21:13.946854    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ced5755d-ed11-4d78-b647-9b5ee29156ad-kube-api-access-4xdz5" (OuterVolumeSpecName: "kube-api-access-4xdz5") pod "ced5755d-ed11-4d78-b647-9b5ee29156ad" (UID: "ced5755d-ed11-4d78-b647-9b5ee29156ad"). InnerVolumeSpecName "kube-api-access-4xdz5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 18:21:13.946928 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:21:13.946874    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ced5755d-ed11-4d78-b647-9b5ee29156ad-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "ced5755d-ed11-4d78-b647-9b5ee29156ad" (UID: "ced5755d-ed11-4d78-b647-9b5ee29156ad"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 18:21:14.045832 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:21:14.045792    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4xdz5\" (UniqueName: \"kubernetes.io/projected/ced5755d-ed11-4d78-b647-9b5ee29156ad-kube-api-access-4xdz5\") on node \"ip-10-0-139-31.ec2.internal\" DevicePath \"\""
Jul 07 18:21:14.045832 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:21:14.045831    2561 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ced5755d-ed11-4d78-b647-9b5ee29156ad-istio-data\") on node \"ip-10-0-139-31.ec2.internal\" DevicePath \"\""
Jul 07 18:21:14.045832 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:21:14.045843    2561 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ced5755d-ed11-4d78-b647-9b5ee29156ad-istio-podinfo\") on node \"ip-10-0-139-31.ec2.internal\" DevicePath \"\""
Jul 07 18:21:14.045832 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:21:14.045850    2561 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ced5755d-ed11-4d78-b647-9b5ee29156ad-istio-token\") on node \"ip-10-0-139-31.ec2.internal\" DevicePath \"\""
Jul 07 18:21:14.046113 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:21:14.045858    2561 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ced5755d-ed11-4d78-b647-9b5ee29156ad-istiod-ca-cert\") on node \"ip-10-0-139-31.ec2.internal\" DevicePath \"\""
Jul 07 18:21:14.046113 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:21:14.045866    2561 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ced5755d-ed11-4d78-b647-9b5ee29156ad-istio-envoy\") on node \"ip-10-0-139-31.ec2.internal\" DevicePath \"\""
Jul 07 18:21:14.046113 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:21:14.045873    2561 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ced5755d-ed11-4d78-b647-9b5ee29156ad-workload-certs\") on node \"ip-10-0-139-31.ec2.internal\" DevicePath \"\""
Jul 07 18:21:14.277875 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:21:14.277780    2561 generic.go:356] "Generic (PLEG): container finished" podID="ced5755d-ed11-4d78-b647-9b5ee29156ad" containerID="e406124ed51db9a73e898ede44e335f020f8560a8709619444e7070d18e08f4f" exitCode=0
Jul 07 18:21:14.277875 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:21:14.277826    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-21f62c-openshift-default-9b4fd55ff-cmgvf"
Jul 07 18:21:14.277875 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:21:14.277831    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-21f62c-openshift-default-9b4fd55ff-cmgvf" event={"ID":"ced5755d-ed11-4d78-b647-9b5ee29156ad","Type":"ContainerDied","Data":"e406124ed51db9a73e898ede44e335f020f8560a8709619444e7070d18e08f4f"}
Jul 07 18:21:14.278133 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:21:14.277881    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-21f62c-openshift-default-9b4fd55ff-cmgvf" event={"ID":"ced5755d-ed11-4d78-b647-9b5ee29156ad","Type":"ContainerDied","Data":"fd1f0a55c6ed6d3aa24bfacac8a6b0e326b146d40a90f0837831e8f09849f5c9"}
Jul 07 18:21:14.278133 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:21:14.277905    2561 scope.go:117] "RemoveContainer" containerID="e406124ed51db9a73e898ede44e335f020f8560a8709619444e7070d18e08f4f"
Jul 07 18:21:14.287314 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:21:14.287298    2561 scope.go:117] "RemoveContainer" containerID="14a157a5056c93169b6f9bcef983e5dbfe5994918e8523f275b3a7a49597fdc7"
Jul 07 18:21:14.294970 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:21:14.294953    2561 scope.go:117] "RemoveContainer" containerID="e406124ed51db9a73e898ede44e335f020f8560a8709619444e7070d18e08f4f"
Jul 07 18:21:14.295216 ip-10-0-139-31 kubenswrapper[2561]: E0707 18:21:14.295199    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e406124ed51db9a73e898ede44e335f020f8560a8709619444e7070d18e08f4f\": container with ID starting with e406124ed51db9a73e898ede44e335f020f8560a8709619444e7070d18e08f4f not found: ID does not exist" containerID="e406124ed51db9a73e898ede44e335f020f8560a8709619444e7070d18e08f4f"
Jul 07 18:21:14.295280 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:21:14.295224    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e406124ed51db9a73e898ede44e335f020f8560a8709619444e7070d18e08f4f"} err="failed to get container status \"e406124ed51db9a73e898ede44e335f020f8560a8709619444e7070d18e08f4f\": rpc error: code = NotFound desc = could not find container \"e406124ed51db9a73e898ede44e335f020f8560a8709619444e7070d18e08f4f\": container with ID starting with e406124ed51db9a73e898ede44e335f020f8560a8709619444e7070d18e08f4f not found: ID does not exist"
Jul 07 18:21:14.295280 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:21:14.295240    2561 scope.go:117] "RemoveContainer" containerID="14a157a5056c93169b6f9bcef983e5dbfe5994918e8523f275b3a7a49597fdc7"
Jul 07 18:21:14.295487 ip-10-0-139-31 kubenswrapper[2561]: E0707 18:21:14.295468    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"14a157a5056c93169b6f9bcef983e5dbfe5994918e8523f275b3a7a49597fdc7\": container with ID starting with 14a157a5056c93169b6f9bcef983e5dbfe5994918e8523f275b3a7a49597fdc7 not found: ID does not exist" containerID="14a157a5056c93169b6f9bcef983e5dbfe5994918e8523f275b3a7a49597fdc7"
Jul 07 18:21:14.295537 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:21:14.295495    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"14a157a5056c93169b6f9bcef983e5dbfe5994918e8523f275b3a7a49597fdc7"} err="failed to get container status \"14a157a5056c93169b6f9bcef983e5dbfe5994918e8523f275b3a7a49597fdc7\": rpc error: code = NotFound desc = could not find container \"14a157a5056c93169b6f9bcef983e5dbfe5994918e8523f275b3a7a49597fdc7\": container with ID starting with 14a157a5056c93169b6f9bcef983e5dbfe5994918e8523f275b3a7a49597fdc7 not found: ID does not exist"
Jul 07 18:21:14.303866 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:21:14.303828    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-21f62c-openshift-default-9b4fd55ff-cmgvf"]
Jul 07 18:21:14.306110 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:21:14.306089    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-a-21f62c-openshift-default-9b4fd55ff-cmgvf"]
Jul 07 18:21:15.521740 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:21:15.521705    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ced5755d-ed11-4d78-b647-9b5ee29156ad" path="/var/lib/kubelet/pods/ced5755d-ed11-4d78-b647-9b5ee29156ad/volumes"
Jul 07 18:21:16.362072 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:21:16.362039    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-fad388-openshift-default-56449b5455-qdxwg"]
Jul 07 18:21:16.362290 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:21:16.362250    2561 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-b-fad388-openshift-default-56449b5455-qdxwg" podUID="ddde9e74-62d8-4bf1-bd4d-df4f86eb15b4" containerName="istio-proxy" containerID="cri-o://10de3408a4cb8469c1a46917fb18689c08e9948f46a359c6ec1e9f7f1184f9eb" gracePeriod=30
Jul 07 18:21:21.623112 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:21:21.623041    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-fad388-openshift-default-56449b5455-qdxwg"
Jul 07 18:21:21.711472 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:21:21.711408    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ddde9e74-62d8-4bf1-bd4d-df4f86eb15b4-istio-token\") pod \"ddde9e74-62d8-4bf1-bd4d-df4f86eb15b4\" (UID: \"ddde9e74-62d8-4bf1-bd4d-df4f86eb15b4\") "
Jul 07 18:21:21.711651 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:21:21.711483    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ddde9e74-62d8-4bf1-bd4d-df4f86eb15b4-istio-podinfo\") pod \"ddde9e74-62d8-4bf1-bd4d-df4f86eb15b4\" (UID: \"ddde9e74-62d8-4bf1-bd4d-df4f86eb15b4\") "
Jul 07 18:21:21.711651 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:21:21.711512    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ddde9e74-62d8-4bf1-bd4d-df4f86eb15b4-istiod-ca-cert\") pod \"ddde9e74-62d8-4bf1-bd4d-df4f86eb15b4\" (UID: \"ddde9e74-62d8-4bf1-bd4d-df4f86eb15b4\") "
Jul 07 18:21:21.711651 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:21:21.711540    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xkw42\" (UniqueName: \"kubernetes.io/projected/ddde9e74-62d8-4bf1-bd4d-df4f86eb15b4-kube-api-access-xkw42\") pod \"ddde9e74-62d8-4bf1-bd4d-df4f86eb15b4\" (UID: \"ddde9e74-62d8-4bf1-bd4d-df4f86eb15b4\") "
Jul 07 18:21:21.711651 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:21:21.711596    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ddde9e74-62d8-4bf1-bd4d-df4f86eb15b4-istio-envoy\") pod \"ddde9e74-62d8-4bf1-bd4d-df4f86eb15b4\" (UID: \"ddde9e74-62d8-4bf1-bd4d-df4f86eb15b4\") "
Jul 07 18:21:21.711651 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:21:21.711636    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ddde9e74-62d8-4bf1-bd4d-df4f86eb15b4-workload-certs\") pod \"ddde9e74-62d8-4bf1-bd4d-df4f86eb15b4\" (UID: \"ddde9e74-62d8-4bf1-bd4d-df4f86eb15b4\") "
Jul 07 18:21:21.711936 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:21:21.711669    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ddde9e74-62d8-4bf1-bd4d-df4f86eb15b4-credential-socket\") pod \"ddde9e74-62d8-4bf1-bd4d-df4f86eb15b4\" (UID: \"ddde9e74-62d8-4bf1-bd4d-df4f86eb15b4\") "
Jul 07 18:21:21.711936 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:21:21.711711    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ddde9e74-62d8-4bf1-bd4d-df4f86eb15b4-workload-socket\") pod \"ddde9e74-62d8-4bf1-bd4d-df4f86eb15b4\" (UID: \"ddde9e74-62d8-4bf1-bd4d-df4f86eb15b4\") "
Jul 07 18:21:21.711936 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:21:21.711750    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ddde9e74-62d8-4bf1-bd4d-df4f86eb15b4-istio-data\") pod \"ddde9e74-62d8-4bf1-bd4d-df4f86eb15b4\" (UID: \"ddde9e74-62d8-4bf1-bd4d-df4f86eb15b4\") "
Jul 07 18:21:21.712101 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:21:21.711963    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ddde9e74-62d8-4bf1-bd4d-df4f86eb15b4-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "ddde9e74-62d8-4bf1-bd4d-df4f86eb15b4" (UID: "ddde9e74-62d8-4bf1-bd4d-df4f86eb15b4"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 18:21:21.712172 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:21:21.712135    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ddde9e74-62d8-4bf1-bd4d-df4f86eb15b4-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "ddde9e74-62d8-4bf1-bd4d-df4f86eb15b4" (UID: "ddde9e74-62d8-4bf1-bd4d-df4f86eb15b4"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 18:21:21.712230 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:21:21.712185    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ddde9e74-62d8-4bf1-bd4d-df4f86eb15b4-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "ddde9e74-62d8-4bf1-bd4d-df4f86eb15b4" (UID: "ddde9e74-62d8-4bf1-bd4d-df4f86eb15b4"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 18:21:21.712230 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:21:21.712214    2561 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ddde9e74-62d8-4bf1-bd4d-df4f86eb15b4-istiod-ca-cert\") on node \"ip-10-0-139-31.ec2.internal\" DevicePath \"\""
Jul 07 18:21:21.712331 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:21:21.712226    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ddde9e74-62d8-4bf1-bd4d-df4f86eb15b4-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "ddde9e74-62d8-4bf1-bd4d-df4f86eb15b4" (UID: "ddde9e74-62d8-4bf1-bd4d-df4f86eb15b4"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 18:21:21.712748 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:21:21.712727    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ddde9e74-62d8-4bf1-bd4d-df4f86eb15b4-istio-data" (OuterVolumeSpecName: "istio-data") pod "ddde9e74-62d8-4bf1-bd4d-df4f86eb15b4" (UID: "ddde9e74-62d8-4bf1-bd4d-df4f86eb15b4"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 18:21:21.713738 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:21:21.713712    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ddde9e74-62d8-4bf1-bd4d-df4f86eb15b4-istio-token" (OuterVolumeSpecName: "istio-token") pod "ddde9e74-62d8-4bf1-bd4d-df4f86eb15b4" (UID: "ddde9e74-62d8-4bf1-bd4d-df4f86eb15b4"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 18:21:21.713860 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:21:21.713810    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/ddde9e74-62d8-4bf1-bd4d-df4f86eb15b4-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "ddde9e74-62d8-4bf1-bd4d-df4f86eb15b4" (UID: "ddde9e74-62d8-4bf1-bd4d-df4f86eb15b4"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 07 18:21:21.714131 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:21:21.714111    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ddde9e74-62d8-4bf1-bd4d-df4f86eb15b4-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "ddde9e74-62d8-4bf1-bd4d-df4f86eb15b4" (UID: "ddde9e74-62d8-4bf1-bd4d-df4f86eb15b4"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 18:21:21.714190 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:21:21.714142    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ddde9e74-62d8-4bf1-bd4d-df4f86eb15b4-kube-api-access-xkw42" (OuterVolumeSpecName: "kube-api-access-xkw42") pod "ddde9e74-62d8-4bf1-bd4d-df4f86eb15b4" (UID: "ddde9e74-62d8-4bf1-bd4d-df4f86eb15b4"). InnerVolumeSpecName "kube-api-access-xkw42". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 18:21:21.813410 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:21:21.813370    2561 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ddde9e74-62d8-4bf1-bd4d-df4f86eb15b4-istio-envoy\") on node \"ip-10-0-139-31.ec2.internal\" DevicePath \"\""
Jul 07 18:21:21.813410 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:21:21.813405    2561 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ddde9e74-62d8-4bf1-bd4d-df4f86eb15b4-workload-certs\") on node \"ip-10-0-139-31.ec2.internal\" DevicePath \"\""
Jul 07 18:21:21.813410 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:21:21.813415    2561 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ddde9e74-62d8-4bf1-bd4d-df4f86eb15b4-credential-socket\") on node \"ip-10-0-139-31.ec2.internal\" DevicePath \"\""
Jul 07 18:21:21.813682 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:21:21.813424    2561 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ddde9e74-62d8-4bf1-bd4d-df4f86eb15b4-workload-socket\") on node \"ip-10-0-139-31.ec2.internal\" DevicePath \"\""
Jul 07 18:21:21.813682 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:21:21.813433    2561 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ddde9e74-62d8-4bf1-bd4d-df4f86eb15b4-istio-data\") on node \"ip-10-0-139-31.ec2.internal\" DevicePath \"\""
Jul 07 18:21:21.813682 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:21:21.813464    2561 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ddde9e74-62d8-4bf1-bd4d-df4f86eb15b4-istio-token\") on node \"ip-10-0-139-31.ec2.internal\" DevicePath \"\""
Jul 07 18:21:21.813682 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:21:21.813478    2561 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ddde9e74-62d8-4bf1-bd4d-df4f86eb15b4-istio-podinfo\") on node \"ip-10-0-139-31.ec2.internal\" DevicePath \"\""
Jul 07 18:21:21.813682 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:21:21.813492    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xkw42\" (UniqueName: \"kubernetes.io/projected/ddde9e74-62d8-4bf1-bd4d-df4f86eb15b4-kube-api-access-xkw42\") on node \"ip-10-0-139-31.ec2.internal\" DevicePath \"\""
Jul 07 18:21:22.317627 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:21:22.317592    2561 generic.go:356] "Generic (PLEG): container finished" podID="ddde9e74-62d8-4bf1-bd4d-df4f86eb15b4" containerID="10de3408a4cb8469c1a46917fb18689c08e9948f46a359c6ec1e9f7f1184f9eb" exitCode=0
Jul 07 18:21:22.317814 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:21:22.317656    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-fad388-openshift-default-56449b5455-qdxwg"
Jul 07 18:21:22.317814 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:21:22.317676    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-fad388-openshift-default-56449b5455-qdxwg" event={"ID":"ddde9e74-62d8-4bf1-bd4d-df4f86eb15b4","Type":"ContainerDied","Data":"10de3408a4cb8469c1a46917fb18689c08e9948f46a359c6ec1e9f7f1184f9eb"}
Jul 07 18:21:22.317814 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:21:22.317728    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-fad388-openshift-default-56449b5455-qdxwg" event={"ID":"ddde9e74-62d8-4bf1-bd4d-df4f86eb15b4","Type":"ContainerDied","Data":"9b119d586acc210b604b7fdf085008d84f9279652a63e73ae988dd3404e2590f"}
Jul 07 18:21:22.317814 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:21:22.317751    2561 scope.go:117] "RemoveContainer" containerID="10de3408a4cb8469c1a46917fb18689c08e9948f46a359c6ec1e9f7f1184f9eb"
Jul 07 18:21:22.327049 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:21:22.327027    2561 scope.go:117] "RemoveContainer" containerID="320399bf1678f04bb5d1dd97947f4d29ec1015758b1eff04d5d21f8f9acbd143"
Jul 07 18:21:22.335650 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:21:22.335628    2561 scope.go:117] "RemoveContainer" containerID="10de3408a4cb8469c1a46917fb18689c08e9948f46a359c6ec1e9f7f1184f9eb"
Jul 07 18:21:22.335948 ip-10-0-139-31 kubenswrapper[2561]: E0707 18:21:22.335929    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"10de3408a4cb8469c1a46917fb18689c08e9948f46a359c6ec1e9f7f1184f9eb\": container with ID starting with 10de3408a4cb8469c1a46917fb18689c08e9948f46a359c6ec1e9f7f1184f9eb not found: ID does not exist" containerID="10de3408a4cb8469c1a46917fb18689c08e9948f46a359c6ec1e9f7f1184f9eb"
Jul 07 18:21:22.336032 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:21:22.335960    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"10de3408a4cb8469c1a46917fb18689c08e9948f46a359c6ec1e9f7f1184f9eb"} err="failed to get container status \"10de3408a4cb8469c1a46917fb18689c08e9948f46a359c6ec1e9f7f1184f9eb\": rpc error: code = NotFound desc = could not find container \"10de3408a4cb8469c1a46917fb18689c08e9948f46a359c6ec1e9f7f1184f9eb\": container with ID starting with 10de3408a4cb8469c1a46917fb18689c08e9948f46a359c6ec1e9f7f1184f9eb not found: ID does not exist"
Jul 07 18:21:22.336032 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:21:22.335985    2561 scope.go:117] "RemoveContainer" containerID="320399bf1678f04bb5d1dd97947f4d29ec1015758b1eff04d5d21f8f9acbd143"
Jul 07 18:21:22.336258 ip-10-0-139-31 kubenswrapper[2561]: E0707 18:21:22.336237    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"320399bf1678f04bb5d1dd97947f4d29ec1015758b1eff04d5d21f8f9acbd143\": container with ID starting with 320399bf1678f04bb5d1dd97947f4d29ec1015758b1eff04d5d21f8f9acbd143 not found: ID does not exist" containerID="320399bf1678f04bb5d1dd97947f4d29ec1015758b1eff04d5d21f8f9acbd143"
Jul 07 18:21:22.336319 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:21:22.336264    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"320399bf1678f04bb5d1dd97947f4d29ec1015758b1eff04d5d21f8f9acbd143"} err="failed to get container status \"320399bf1678f04bb5d1dd97947f4d29ec1015758b1eff04d5d21f8f9acbd143\": rpc error: code = NotFound desc = could not find container \"320399bf1678f04bb5d1dd97947f4d29ec1015758b1eff04d5d21f8f9acbd143\": container with ID starting with 320399bf1678f04bb5d1dd97947f4d29ec1015758b1eff04d5d21f8f9acbd143 not found: ID does not exist"
Jul 07 18:21:22.342953 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:21:22.342929    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-fad388-openshift-default-56449b5455-qdxwg"]
Jul 07 18:21:22.349595 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:21:22.349571    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-b-fad388-openshift-default-56449b5455-qdxwg"]
Jul 07 18:21:22.470935 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:21:22.470903    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-d698b7b5d-4pznt_f7ec3e55-c3b6-485d-acde-df0c6790ce1e/copy-manifests/0.log"
Jul 07 18:21:22.480364 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:21:22.480334    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-d698b7b5d-4pznt_f7ec3e55-c3b6-485d-acde-df0c6790ce1e/manager/0.log"
Jul 07 18:21:23.522309 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:21:23.522275    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ddde9e74-62d8-4bf1-bd4d-df4f86eb15b4" path="/var/lib/kubelet/pods/ddde9e74-62d8-4bf1-bd4d-df4f86eb15b4/volumes"
Jul 07 18:21:24.336807 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:21:24.336778    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-btxxb_f72d56b4-96bd-46b1-83d0-b40c7802ea7f/manager/0.log"
Jul 07 18:21:24.445379 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:21:24.445349    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-l59dh_041ebf77-dd23-4183-9039-cde1734514f0/kuadrant-console-plugin/0.log"
Jul 07 18:21:24.960251 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:21:24.960215    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-bnj87_2c516c91-6b7b-440c-9554-dc60c8503394/manager/0.log"
Jul 07 18:21:25.550733 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:21:25.550706    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-544cc96c69-tj7pn_f4ce81ff-ae67-41c1-999e-d1768163a94e/kube-auth-proxy/0.log"
Jul 07 18:21:26.814712 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:21:26.814681    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-598466548d-4qhxv_ad3d0b26-4541-4dc8-9de5-9a1dd1e13694/main/0.log"
Jul 07 18:21:27.077293 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:21:27.077211    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-74b68447df-5hs2w_9c6028b9-0694-46e3-829f-fab255cc478d/main/0.log"
Jul 07 18:21:31.368218 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:21:31.368186    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-99zpf/must-gather-7z7kn"]
Jul 07 18:21:31.368660 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:21:31.368638    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ddde9e74-62d8-4bf1-bd4d-df4f86eb15b4" containerName="istio-proxy"
Jul 07 18:21:31.368660 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:21:31.368658    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="ddde9e74-62d8-4bf1-bd4d-df4f86eb15b4" containerName="istio-proxy"
Jul 07 18:21:31.368814 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:21:31.368673    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ddde9e74-62d8-4bf1-bd4d-df4f86eb15b4" containerName="istio-proxy"
Jul 07 18:21:31.368814 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:21:31.368678    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="ddde9e74-62d8-4bf1-bd4d-df4f86eb15b4" containerName="istio-proxy"
Jul 07 18:21:31.368814 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:21:31.368685    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ced5755d-ed11-4d78-b647-9b5ee29156ad" containerName="istio-proxy"
Jul 07 18:21:31.368814 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:21:31.368692    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="ced5755d-ed11-4d78-b647-9b5ee29156ad" containerName="istio-proxy"
Jul 07 18:21:31.368814 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:21:31.368704    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b7c5cfa5-b2ae-4d57-8a2f-719b033c48d7" containerName="main"
Jul 07 18:21:31.368814 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:21:31.368709    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="b7c5cfa5-b2ae-4d57-8a2f-719b033c48d7" containerName="main"
Jul 07 18:21:31.368814 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:21:31.368719    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ced5755d-ed11-4d78-b647-9b5ee29156ad" containerName="istio-proxy"
Jul 07 18:21:31.368814 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:21:31.368724    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="ced5755d-ed11-4d78-b647-9b5ee29156ad" containerName="istio-proxy"
Jul 07 18:21:31.368814 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:21:31.368782    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="ddde9e74-62d8-4bf1-bd4d-df4f86eb15b4" containerName="istio-proxy"
Jul 07 18:21:31.368814 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:21:31.368792    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="ddde9e74-62d8-4bf1-bd4d-df4f86eb15b4" containerName="istio-proxy"
Jul 07 18:21:31.368814 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:21:31.368799    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="ced5755d-ed11-4d78-b647-9b5ee29156ad" containerName="istio-proxy"
Jul 07 18:21:31.368814 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:21:31.368805    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="b7c5cfa5-b2ae-4d57-8a2f-719b033c48d7" containerName="main"
Jul 07 18:21:31.368814 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:21:31.368811    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="ced5755d-ed11-4d78-b647-9b5ee29156ad" containerName="istio-proxy"
Jul 07 18:21:31.373141 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:21:31.373118    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-99zpf/must-gather-7z7kn"
Jul 07 18:21:31.381168 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:21:31.381148    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-99zpf\"/\"kube-root-ca.crt\""
Jul 07 18:21:31.382094 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:21:31.382076    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-99zpf\"/\"default-dockercfg-bkmgk\""
Jul 07 18:21:31.385529 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:21:31.385510    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-99zpf\"/\"openshift-service-ca.crt\""
Jul 07 18:21:31.397867 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:21:31.397834    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-99zpf/must-gather-7z7kn"]
Jul 07 18:21:31.502720 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:21:31.502678    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/4c3b9459-e257-467e-835e-5e4743b09e27-must-gather-output\") pod \"must-gather-7z7kn\" (UID: \"4c3b9459-e257-467e-835e-5e4743b09e27\") " pod="openshift-must-gather-99zpf/must-gather-7z7kn"
Jul 07 18:21:31.502903 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:21:31.502756    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cfkzl\" (UniqueName: \"kubernetes.io/projected/4c3b9459-e257-467e-835e-5e4743b09e27-kube-api-access-cfkzl\") pod \"must-gather-7z7kn\" (UID: \"4c3b9459-e257-467e-835e-5e4743b09e27\") " pod="openshift-must-gather-99zpf/must-gather-7z7kn"
Jul 07 18:21:31.604346 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:21:31.604304    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cfkzl\" (UniqueName: \"kubernetes.io/projected/4c3b9459-e257-467e-835e-5e4743b09e27-kube-api-access-cfkzl\") pod \"must-gather-7z7kn\" (UID: \"4c3b9459-e257-467e-835e-5e4743b09e27\") " pod="openshift-must-gather-99zpf/must-gather-7z7kn"
Jul 07 18:21:31.604572 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:21:31.604548    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/4c3b9459-e257-467e-835e-5e4743b09e27-must-gather-output\") pod \"must-gather-7z7kn\" (UID: \"4c3b9459-e257-467e-835e-5e4743b09e27\") " pod="openshift-must-gather-99zpf/must-gather-7z7kn"
Jul 07 18:21:31.604907 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:21:31.604880    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/4c3b9459-e257-467e-835e-5e4743b09e27-must-gather-output\") pod \"must-gather-7z7kn\" (UID: \"4c3b9459-e257-467e-835e-5e4743b09e27\") " pod="openshift-must-gather-99zpf/must-gather-7z7kn"
Jul 07 18:21:31.614165 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:21:31.614140    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cfkzl\" (UniqueName: \"kubernetes.io/projected/4c3b9459-e257-467e-835e-5e4743b09e27-kube-api-access-cfkzl\") pod \"must-gather-7z7kn\" (UID: \"4c3b9459-e257-467e-835e-5e4743b09e27\") " pod="openshift-must-gather-99zpf/must-gather-7z7kn"
Jul 07 18:21:31.683047 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:21:31.682965    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-99zpf/must-gather-7z7kn"
Jul 07 18:21:31.831819 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:21:31.831794    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-99zpf/must-gather-7z7kn"]
Jul 07 18:21:31.833988 ip-10-0-139-31 kubenswrapper[2561]: W0707 18:21:31.833950    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod4c3b9459_e257_467e_835e_5e4743b09e27.slice/crio-9960583a30bda2af0c67f053d261f42c155629c8c1ece77fb64755eda0afeaf9 WatchSource:0}: Error finding container 9960583a30bda2af0c67f053d261f42c155629c8c1ece77fb64755eda0afeaf9: Status 404 returned error can't find the container with id 9960583a30bda2af0c67f053d261f42c155629c8c1ece77fb64755eda0afeaf9
Jul 07 18:21:31.836316 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:21:31.836296    2561 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 07 18:21:32.365909 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:21:32.365879    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-99zpf/must-gather-7z7kn" event={"ID":"4c3b9459-e257-467e-835e-5e4743b09e27","Type":"ContainerStarted","Data":"9960583a30bda2af0c67f053d261f42c155629c8c1ece77fb64755eda0afeaf9"}
Jul 07 18:21:33.373989 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:21:33.373957    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-99zpf/must-gather-7z7kn" event={"ID":"4c3b9459-e257-467e-835e-5e4743b09e27","Type":"ContainerStarted","Data":"653000bf513e8160ed5ea8db59521d434b77b66eb7453e5057a038bd1cf4b5e0"}
Jul 07 18:21:33.374514 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:21:33.374000    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-99zpf/must-gather-7z7kn" event={"ID":"4c3b9459-e257-467e-835e-5e4743b09e27","Type":"ContainerStarted","Data":"1d55ebc6576f4edaf4e41decd7d0f5e0a5482fb25a7ab97bc0eebca5614eca31"}
Jul 07 18:21:33.402681 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:21:33.402616    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-99zpf/must-gather-7z7kn" podStartSLOduration=1.6001976249999998 podStartE2EDuration="2.402590814s" totalImagesPullingTime="802.393189ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 18:21:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 18:21:33.400069437 +0000 UTC m=+2484.551193837" watchObservedRunningTime="2026-07-07 18:21:33.402590814 +0000 UTC m=+2484.553715213"
Jul 07 18:21:34.444046 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:21:34.444002    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-6cwrd_e54430cd-5514-416a-83cc-c3b1a549e576/global-pull-secret-syncer/0.log"
Jul 07 18:21:34.694280 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:21:34.694188    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-kks9r_2ef9c095-d303-40c3-920c-c9ff990f4032/konnectivity-agent/0.log"
Jul 07 18:21:34.752602 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:21:34.752567    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-139-31.ec2.internal_bc20af9d845b73d5b3a3fef90b1087f9/haproxy/0.log"
Jul 07 18:21:40.365272 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:21:40.365243    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-btxxb_f72d56b4-96bd-46b1-83d0-b40c7802ea7f/manager/0.log"
Jul 07 18:21:40.406112 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:21:40.406083    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-l59dh_041ebf77-dd23-4183-9039-cde1734514f0/kuadrant-console-plugin/0.log"
Jul 07 18:21:40.791701 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:21:40.791460    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-bnj87_2c516c91-6b7b-440c-9554-dc60c8503394/manager/0.log"
Jul 07 18:21:42.703868 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:21:42.703810    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-7c9dbb8b7d-jrgqd_ea719737-17e4-4de5-866a-f0283465c1d0/kube-state-metrics/0.log"
Jul 07 18:21:42.732057 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:21:42.732022    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-7c9dbb8b7d-jrgqd_ea719737-17e4-4de5-866a-f0283465c1d0/kube-rbac-proxy-main/0.log"
Jul 07 18:21:42.760652 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:21:42.760560    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-7c9dbb8b7d-jrgqd_ea719737-17e4-4de5-866a-f0283465c1d0/kube-rbac-proxy-self/0.log"
Jul 07 18:21:42.830038 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:21:42.830000    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-d5dcff7cf-4glsl_1ff7cd92-8eda-45ad-8ce7-a0f21132a220/monitoring-plugin/0.log"
Jul 07 18:21:42.993501 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:21:42.993473    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-ml5ss_df0a2c16-2d6c-4677-9338-7a72057544a6/node-exporter/0.log"
Jul 07 18:21:43.027642 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:21:43.027555    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-ml5ss_df0a2c16-2d6c-4677-9338-7a72057544a6/kube-rbac-proxy/0.log"
Jul 07 18:21:43.057949 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:21:43.057923    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-ml5ss_df0a2c16-2d6c-4677-9338-7a72057544a6/init-textfile/0.log"
Jul 07 18:21:43.302877 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:21:43.302840    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_74596f1d-2d37-4bae-824c-d3a4b90f6957/prometheus/0.log"
Jul 07 18:21:43.355345 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:21:43.355313    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_74596f1d-2d37-4bae-824c-d3a4b90f6957/config-reloader/0.log"
Jul 07 18:21:43.418164 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:21:43.418138    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_74596f1d-2d37-4bae-824c-d3a4b90f6957/thanos-sidecar/0.log"
Jul 07 18:21:43.473703 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:21:43.473658    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_74596f1d-2d37-4bae-824c-d3a4b90f6957/kube-rbac-proxy-web/0.log"
Jul 07 18:21:43.528153 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:21:43.528115    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_74596f1d-2d37-4bae-824c-d3a4b90f6957/kube-rbac-proxy/0.log"
Jul 07 18:21:43.569095 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:21:43.569008    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_74596f1d-2d37-4bae-824c-d3a4b90f6957/kube-rbac-proxy-thanos/0.log"
Jul 07 18:21:43.603681 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:21:43.603643    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_74596f1d-2d37-4bae-824c-d3a4b90f6957/init-config-reloader/0.log"
Jul 07 18:21:43.638648 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:21:43.638621    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-567f7b8b7c-wsp7f_aabcec3a-d52b-4805-b27a-8fdb9c56e8e0/prometheus-operator/0.log"
Jul 07 18:21:43.673068 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:21:43.673039    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-567f7b8b7c-wsp7f_aabcec3a-d52b-4805-b27a-8fdb9c56e8e0/kube-rbac-proxy/0.log"
Jul 07 18:21:43.900293 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:21:43.900198    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-c8f6776f7-v4fjv_16f0c9e3-ea28-4b17-970d-aea17a6d1f56/thanos-query/0.log"
Jul 07 18:21:43.942401 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:21:43.942366    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-c8f6776f7-v4fjv_16f0c9e3-ea28-4b17-970d-aea17a6d1f56/kube-rbac-proxy-web/0.log"
Jul 07 18:21:43.974052 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:21:43.974021    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-c8f6776f7-v4fjv_16f0c9e3-ea28-4b17-970d-aea17a6d1f56/kube-rbac-proxy/0.log"
Jul 07 18:21:44.011594 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:21:44.011565    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-c8f6776f7-v4fjv_16f0c9e3-ea28-4b17-970d-aea17a6d1f56/prom-label-proxy/0.log"
Jul 07 18:21:44.054080 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:21:44.054052    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-c8f6776f7-v4fjv_16f0c9e3-ea28-4b17-970d-aea17a6d1f56/kube-rbac-proxy-rules/0.log"
Jul 07 18:21:44.089797 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:21:44.089762    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-c8f6776f7-v4fjv_16f0c9e3-ea28-4b17-970d-aea17a6d1f56/kube-rbac-proxy-metrics/0.log"
Jul 07 18:21:44.471133 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:21:44.471091    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-99zpf/perf-node-gather-daemonset-6xgnm"]
Jul 07 18:21:44.480133 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:21:44.480096    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-99zpf/perf-node-gather-daemonset-6xgnm"
Jul 07 18:21:44.485693 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:21:44.485664    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-99zpf/perf-node-gather-daemonset-6xgnm"]
Jul 07 18:21:44.644540 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:21:44.644505    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/d268452e-47de-4ebe-a0b6-587fe5dfd800-proc\") pod \"perf-node-gather-daemonset-6xgnm\" (UID: \"d268452e-47de-4ebe-a0b6-587fe5dfd800\") " pod="openshift-must-gather-99zpf/perf-node-gather-daemonset-6xgnm"
Jul 07 18:21:44.644711 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:21:44.644556    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/d268452e-47de-4ebe-a0b6-587fe5dfd800-podres\") pod \"perf-node-gather-daemonset-6xgnm\" (UID: \"d268452e-47de-4ebe-a0b6-587fe5dfd800\") " pod="openshift-must-gather-99zpf/perf-node-gather-daemonset-6xgnm"
Jul 07 18:21:44.644711 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:21:44.644671    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fdxkl\" (UniqueName: \"kubernetes.io/projected/d268452e-47de-4ebe-a0b6-587fe5dfd800-kube-api-access-fdxkl\") pod \"perf-node-gather-daemonset-6xgnm\" (UID: \"d268452e-47de-4ebe-a0b6-587fe5dfd800\") " pod="openshift-must-gather-99zpf/perf-node-gather-daemonset-6xgnm"
Jul 07 18:21:44.644807 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:21:44.644721    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/d268452e-47de-4ebe-a0b6-587fe5dfd800-lib-modules\") pod \"perf-node-gather-daemonset-6xgnm\" (UID: \"d268452e-47de-4ebe-a0b6-587fe5dfd800\") " pod="openshift-must-gather-99zpf/perf-node-gather-daemonset-6xgnm"
Jul 07 18:21:44.644875 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:21:44.644849    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d268452e-47de-4ebe-a0b6-587fe5dfd800-sys\") pod \"perf-node-gather-daemonset-6xgnm\" (UID: \"d268452e-47de-4ebe-a0b6-587fe5dfd800\") " pod="openshift-must-gather-99zpf/perf-node-gather-daemonset-6xgnm"
Jul 07 18:21:44.745422 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:21:44.745321    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fdxkl\" (UniqueName: \"kubernetes.io/projected/d268452e-47de-4ebe-a0b6-587fe5dfd800-kube-api-access-fdxkl\") pod \"perf-node-gather-daemonset-6xgnm\" (UID: \"d268452e-47de-4ebe-a0b6-587fe5dfd800\") " pod="openshift-must-gather-99zpf/perf-node-gather-daemonset-6xgnm"
Jul 07 18:21:44.745422 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:21:44.745371    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/d268452e-47de-4ebe-a0b6-587fe5dfd800-lib-modules\") pod \"perf-node-gather-daemonset-6xgnm\" (UID: \"d268452e-47de-4ebe-a0b6-587fe5dfd800\") " pod="openshift-must-gather-99zpf/perf-node-gather-daemonset-6xgnm"
Jul 07 18:21:44.745683 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:21:44.745468    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d268452e-47de-4ebe-a0b6-587fe5dfd800-sys\") pod \"perf-node-gather-daemonset-6xgnm\" (UID: \"d268452e-47de-4ebe-a0b6-587fe5dfd800\") " pod="openshift-must-gather-99zpf/perf-node-gather-daemonset-6xgnm"
Jul 07 18:21:44.745683 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:21:44.745523    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/d268452e-47de-4ebe-a0b6-587fe5dfd800-proc\") pod \"perf-node-gather-daemonset-6xgnm\" (UID: \"d268452e-47de-4ebe-a0b6-587fe5dfd800\") " pod="openshift-must-gather-99zpf/perf-node-gather-daemonset-6xgnm"
Jul 07 18:21:44.745683 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:21:44.745556    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/d268452e-47de-4ebe-a0b6-587fe5dfd800-podres\") pod \"perf-node-gather-daemonset-6xgnm\" (UID: \"d268452e-47de-4ebe-a0b6-587fe5dfd800\") " pod="openshift-must-gather-99zpf/perf-node-gather-daemonset-6xgnm"
Jul 07 18:21:44.745683 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:21:44.745610    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/d268452e-47de-4ebe-a0b6-587fe5dfd800-lib-modules\") pod \"perf-node-gather-daemonset-6xgnm\" (UID: \"d268452e-47de-4ebe-a0b6-587fe5dfd800\") " pod="openshift-must-gather-99zpf/perf-node-gather-daemonset-6xgnm"
Jul 07 18:21:44.745907 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:21:44.745689    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/d268452e-47de-4ebe-a0b6-587fe5dfd800-podres\") pod \"perf-node-gather-daemonset-6xgnm\" (UID: \"d268452e-47de-4ebe-a0b6-587fe5dfd800\") " pod="openshift-must-gather-99zpf/perf-node-gather-daemonset-6xgnm"
Jul 07 18:21:44.745907 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:21:44.745688    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d268452e-47de-4ebe-a0b6-587fe5dfd800-sys\") pod \"perf-node-gather-daemonset-6xgnm\" (UID: \"d268452e-47de-4ebe-a0b6-587fe5dfd800\") " pod="openshift-must-gather-99zpf/perf-node-gather-daemonset-6xgnm"
Jul 07 18:21:44.745907 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:21:44.745714    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/d268452e-47de-4ebe-a0b6-587fe5dfd800-proc\") pod \"perf-node-gather-daemonset-6xgnm\" (UID: \"d268452e-47de-4ebe-a0b6-587fe5dfd800\") " pod="openshift-must-gather-99zpf/perf-node-gather-daemonset-6xgnm"
Jul 07 18:21:44.759326 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:21:44.759292    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fdxkl\" (UniqueName: \"kubernetes.io/projected/d268452e-47de-4ebe-a0b6-587fe5dfd800-kube-api-access-fdxkl\") pod \"perf-node-gather-daemonset-6xgnm\" (UID: \"d268452e-47de-4ebe-a0b6-587fe5dfd800\") " pod="openshift-must-gather-99zpf/perf-node-gather-daemonset-6xgnm"
Jul 07 18:21:44.795549 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:21:44.795511    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-99zpf/perf-node-gather-daemonset-6xgnm"
Jul 07 18:21:44.996984 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:21:44.995826    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-99zpf/perf-node-gather-daemonset-6xgnm"]
Jul 07 18:21:45.003170 ip-10-0-139-31 kubenswrapper[2561]: W0707 18:21:45.003049    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podd268452e_47de_4ebe_a0b6_587fe5dfd800.slice/crio-e97220b6188097f3924607c56af9e01f63f67b836813fd00d46ff41b6fa9f710 WatchSource:0}: Error finding container e97220b6188097f3924607c56af9e01f63f67b836813fd00d46ff41b6fa9f710: Status 404 returned error can't find the container with id e97220b6188097f3924607c56af9e01f63f67b836813fd00d46ff41b6fa9f710
Jul 07 18:21:45.467622 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:21:45.467586    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-99zpf/perf-node-gather-daemonset-6xgnm" event={"ID":"d268452e-47de-4ebe-a0b6-587fe5dfd800","Type":"ContainerStarted","Data":"7ab442e9664c7717a561a9a30d67046b5301ebf6a92475699bfa3d8ca9e92e74"}
Jul 07 18:21:45.467833 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:21:45.467657    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-99zpf/perf-node-gather-daemonset-6xgnm"
Jul 07 18:21:45.467833 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:21:45.467680    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-99zpf/perf-node-gather-daemonset-6xgnm" event={"ID":"d268452e-47de-4ebe-a0b6-587fe5dfd800","Type":"ContainerStarted","Data":"e97220b6188097f3924607c56af9e01f63f67b836813fd00d46ff41b6fa9f710"}
Jul 07 18:21:45.510656 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:21:45.510603    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-99zpf/perf-node-gather-daemonset-6xgnm" podStartSLOduration=1.510586745 podStartE2EDuration="1.510586745s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 18:21:44 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 18:21:45.507898905 +0000 UTC m=+2496.659023304" watchObservedRunningTime="2026-07-07 18:21:45.510586745 +0000 UTC m=+2496.661711188"
Jul 07 18:21:46.026707 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:21:46.026672    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-bjl48_805597ff-168d-4099-95b8-0037b0ceba2f/console-operator/1.log"
Jul 07 18:21:46.034138 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:21:46.034095    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-bjl48_805597ff-168d-4099-95b8-0037b0ceba2f/console-operator/2.log"
Jul 07 18:21:46.649503 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:21:46.649467    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-685bfb5f64-d4cpl_4822b40c-4869-4df7-856d-bd6958e729a4/download-server/0.log"
Jul 07 18:21:48.498165 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:21:48.498132    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-699db_66fea407-ba7e-4f9e-be19-2ed756f53841/dns/0.log"
Jul 07 18:21:48.528593 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:21:48.528558    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-699db_66fea407-ba7e-4f9e-be19-2ed756f53841/kube-rbac-proxy/0.log"
Jul 07 18:21:48.693541 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:21:48.693512    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-4wz7j_54fe2d84-2eed-4379-aeb5-6588b2ee961d/dns-node-resolver/0.log"
Jul 07 18:21:49.448593 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:21:49.448561    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-vf2rn_8e97c2c1-e9ea-41fb-9bb9-ed0cf128c144/node-ca/0.log"
Jul 07 18:21:50.627885 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:21:50.627856    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-544cc96c69-tj7pn_f4ce81ff-ae67-41c1-999e-d1768163a94e/kube-auth-proxy/0.log"
Jul 07 18:21:51.486666 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:21:51.486640    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-99zpf/perf-node-gather-daemonset-6xgnm"
Jul 07 18:21:51.600616 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:21:51.600586    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-8q22f_d4f02e4d-1da9-4fbd-ae01-7d5b954981ca/serve-healthcheck-canary/0.log"
Jul 07 18:21:52.341632 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:21:52.341599    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-5c847dcfc4-gwhjt_22855c2a-6a54-4a07-8655-db3f563f7e11/insights-operator/1.log"
Jul 07 18:21:52.342216 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:21:52.341792    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-5c847dcfc4-gwhjt_22855c2a-6a54-4a07-8655-db3f563f7e11/insights-operator/0.log"
Jul 07 18:21:52.540907 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:21:52.540875    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-tghnn_0eb58169-3997-45ba-a3c1-6d875fb3d7d2/kube-rbac-proxy/0.log"
Jul 07 18:21:52.566571 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:21:52.566542    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-tghnn_0eb58169-3997-45ba-a3c1-6d875fb3d7d2/exporter/0.log"
Jul 07 18:21:52.593977 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:21:52.593886    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-tghnn_0eb58169-3997-45ba-a3c1-6d875fb3d7d2/extractor/0.log"
Jul 07 18:21:55.343712 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:21:55.343685    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-544cc96c69-tj7pn_f4ce81ff-ae67-41c1-999e-d1768163a94e/kube-auth-proxy/0.log"
Jul 07 18:21:55.556630 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:21:55.556601    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-d698b7b5d-4pznt_f7ec3e55-c3b6-485d-acde-df0c6790ce1e/manager/0.log"
Jul 07 18:21:55.584663 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:21:55.584629    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-d698b7b5d-4pznt_f7ec3e55-c3b6-485d-acde-df0c6790ce1e/copy-manifests/0.log"
Jul 07 18:21:56.848420 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:21:56.848385    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-544cc96c69-tj7pn_f4ce81ff-ae67-41c1-999e-d1768163a94e/kube-auth-proxy/0.log"
Jul 07 18:21:57.097848 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:21:57.097772    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-85d9cbc876-lchdw_1c02957d-3c0e-4e0f-a7d8-95907c357013/manager/0.log"
Jul 07 18:22:02.919932 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:22:02.919883    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-846bf668f7-c2lj2_fb9a13b7-2352-49f4-a15a-bf67a478c82f/kube-storage-version-migrator-operator/1.log"
Jul 07 18:22:02.922771 ip-10-0-139-31 kubenswrapper[2561]: I0707 18:22:02.922738    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-846bf668f7-c2lj2_fb9a13b7-2352-49f4-a15a-bf67a478c82f/kube-storage-version-migrator-operator/0.log"