Jul 21 17:06:15.195662 ip-10-0-141-39 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory
Jul 21 17:06:15.195677 ip-10-0-141-39 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory
Jul 21 17:06:15.195686 ip-10-0-141-39 systemd[1]: kubelet.service: Failed with result 'resources'.
Jul 21 17:06:15.196223 ip-10-0-141-39 systemd[1]: Failed to start Kubernetes Kubelet.
Jul 21 17:06:25.219622 ip-10-0-141-39 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found.
Jul 21 17:06:25.219646 ip-10-0-141-39 systemd[1]: kubelet.service: Failed with result 'resources'.
-- Boot a8d06e79692742f888d0e1646463dd1e --
Jul 21 17:08:26.160901 ip-10-0-141-39 systemd[1]: Starting Kubernetes Kubelet...
Jul 21 17:08:26.555305 ip-10-0-141-39 kubenswrapper[2575]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 21 17:08:26.555305 ip-10-0-141-39 kubenswrapper[2575]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jul 21 17:08:26.555305 ip-10-0-141-39 kubenswrapper[2575]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 21 17:08:26.555305 ip-10-0-141-39 kubenswrapper[2575]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jul 21 17:08:26.555305 ip-10-0-141-39 kubenswrapper[2575]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 21 17:08:26.556879 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:26.556793    2575 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jul 21 17:08:26.561548 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:08:26.561527    2575 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 21 17:08:26.561548 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:08:26.561544    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 21 17:08:26.561548 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:08:26.561549    2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 21 17:08:26.561548 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:08:26.561570    2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 21 17:08:26.561816 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:08:26.561576    2575 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 21 17:08:26.561816 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:08:26.561580    2575 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 21 17:08:26.561816 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:08:26.561584    2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 21 17:08:26.561816 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:08:26.561589    2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 21 17:08:26.561816 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:08:26.561593    2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 21 17:08:26.561816 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:08:26.561597    2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 21 17:08:26.561816 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:08:26.561601    2575 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 21 17:08:26.561816 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:08:26.561605    2575 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 21 17:08:26.561816 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:08:26.561608    2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 21 17:08:26.561816 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:08:26.561612    2575 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 21 17:08:26.561816 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:08:26.561616    2575 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 21 17:08:26.561816 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:08:26.561619    2575 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 21 17:08:26.561816 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:08:26.561623    2575 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 21 17:08:26.561816 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:08:26.561627    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 21 17:08:26.561816 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:08:26.561636    2575 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 21 17:08:26.561816 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:08:26.561640    2575 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 21 17:08:26.561816 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:08:26.561644    2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 21 17:08:26.561816 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:08:26.561647    2575 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 21 17:08:26.561816 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:08:26.561651    2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 21 17:08:26.561816 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:08:26.561655    2575 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 21 17:08:26.562677 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:08:26.561658    2575 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 21 17:08:26.562677 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:08:26.561662    2575 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 21 17:08:26.562677 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:08:26.561665    2575 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 21 17:08:26.562677 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:08:26.561669    2575 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 21 17:08:26.562677 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:08:26.561673    2575 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 21 17:08:26.562677 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:08:26.561678    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 21 17:08:26.562677 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:08:26.561682    2575 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 21 17:08:26.562677 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:08:26.561685    2575 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 21 17:08:26.562677 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:08:26.561689    2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 21 17:08:26.562677 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:08:26.561694    2575 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 21 17:08:26.562677 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:08:26.561699    2575 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 21 17:08:26.562677 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:08:26.561704    2575 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 21 17:08:26.562677 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:08:26.561708    2575 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 21 17:08:26.562677 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:08:26.561712    2575 feature_gate.go:328] unrecognized feature gate: Example
Jul 21 17:08:26.562677 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:08:26.561718    2575 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 21 17:08:26.562677 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:08:26.561726    2575 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 21 17:08:26.562677 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:08:26.561732    2575 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 21 17:08:26.562677 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:08:26.561739    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 21 17:08:26.562677 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:08:26.561744    2575 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 21 17:08:26.563453 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:08:26.561748    2575 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 21 17:08:26.563453 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:08:26.561753    2575 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 21 17:08:26.563453 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:08:26.561757    2575 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 21 17:08:26.563453 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:08:26.561761    2575 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 21 17:08:26.563453 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:08:26.561765    2575 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 21 17:08:26.563453 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:08:26.561769    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 21 17:08:26.563453 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:08:26.561773    2575 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 21 17:08:26.563453 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:08:26.561777    2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 21 17:08:26.563453 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:08:26.561781    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 21 17:08:26.563453 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:08:26.561785    2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 21 17:08:26.563453 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:08:26.561789    2575 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 21 17:08:26.563453 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:08:26.561793    2575 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 21 17:08:26.563453 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:08:26.561798    2575 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 21 17:08:26.563453 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:08:26.561802    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 21 17:08:26.563453 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:08:26.561806    2575 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 21 17:08:26.563453 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:08:26.561810    2575 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 21 17:08:26.563453 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:08:26.561813    2575 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 21 17:08:26.563453 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:08:26.561817    2575 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 21 17:08:26.563453 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:08:26.561821    2575 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 21 17:08:26.563453 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:08:26.561826    2575 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 21 17:08:26.564357 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:08:26.561831    2575 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 21 17:08:26.564357 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:08:26.561835    2575 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 21 17:08:26.564357 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:08:26.561839    2575 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 21 17:08:26.564357 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:08:26.561843    2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 21 17:08:26.564357 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:08:26.561849    2575 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 21 17:08:26.564357 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:08:26.561852    2575 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 21 17:08:26.564357 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:08:26.561857    2575 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 21 17:08:26.564357 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:08:26.561861    2575 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 21 17:08:26.564357 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:08:26.561866    2575 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 21 17:08:26.564357 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:08:26.561870    2575 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 21 17:08:26.564357 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:08:26.561874    2575 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 21 17:08:26.564357 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:08:26.561878    2575 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 21 17:08:26.564357 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:08:26.561882    2575 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 21 17:08:26.564357 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:08:26.561886    2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 21 17:08:26.564357 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:08:26.561890    2575 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 21 17:08:26.564357 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:08:26.561895    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 21 17:08:26.564357 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:08:26.561899    2575 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 21 17:08:26.564357 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:08:26.561903    2575 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 21 17:08:26.564357 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:08:26.561906    2575 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 21 17:08:26.564357 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:08:26.561910    2575 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 21 17:08:26.565230 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:08:26.561914    2575 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 21 17:08:26.565230 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:08:26.561919    2575 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 21 17:08:26.565230 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:08:26.561923    2575 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 21 17:08:26.565230 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:08:26.561927    2575 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 21 17:08:26.565230 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:08:26.561933    2575 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 21 17:08:26.565230 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:08:26.561939    2575 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 21 17:08:26.565230 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:08:26.561944    2575 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 21 17:08:26.565230 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:08:26.561948    2575 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 21 17:08:26.565230 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:08:26.561952    2575 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 21 17:08:26.565230 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:08:26.561957    2575 feature_gate.go:328] unrecognized feature gate: Example2
Jul 21 17:08:26.565230 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:08:26.561961    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 21 17:08:26.565230 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:08:26.561965    2575 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 21 17:08:26.565230 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:08:26.561971    2575 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 21 17:08:26.565230 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:08:26.561976    2575 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 21 17:08:26.565230 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:08:26.561981    2575 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 21 17:08:26.565230 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:08:26.561986    2575 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 21 17:08:26.565230 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:08:26.563179    2575 feature_gate.go:328] unrecognized feature gate: Example2
Jul 21 17:08:26.565230 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:08:26.563191    2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 21 17:08:26.565230 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:08:26.563196    2575 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 21 17:08:26.566127 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:08:26.563201    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 21 17:08:26.566127 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:08:26.563205    2575 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 21 17:08:26.566127 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:08:26.563210    2575 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 21 17:08:26.566127 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:08:26.563214    2575 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 21 17:08:26.566127 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:08:26.563219    2575 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 21 17:08:26.566127 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:08:26.563223    2575 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 21 17:08:26.566127 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:08:26.563227    2575 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 21 17:08:26.566127 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:08:26.563231    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 21 17:08:26.566127 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:08:26.563236    2575 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 21 17:08:26.566127 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:08:26.563240    2575 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 21 17:08:26.566127 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:08:26.563244    2575 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 21 17:08:26.566127 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:08:26.563248    2575 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 21 17:08:26.566127 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:08:26.563252    2575 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 21 17:08:26.566127 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:08:26.563256    2575 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 21 17:08:26.566127 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:08:26.563261    2575 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 21 17:08:26.566127 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:08:26.563266    2575 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 21 17:08:26.566127 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:08:26.563270    2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 21 17:08:26.566127 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:08:26.563275    2575 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 21 17:08:26.566127 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:08:26.563279    2575 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 21 17:08:26.566127 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:08:26.563283    2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 21 17:08:26.566729 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:08:26.563288    2575 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 21 17:08:26.566729 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:08:26.563292    2575 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 21 17:08:26.566729 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:08:26.563299    2575 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 21 17:08:26.566729 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:08:26.563305    2575 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 21 17:08:26.566729 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:08:26.563310    2575 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 21 17:08:26.566729 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:08:26.563314    2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 21 17:08:26.566729 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:08:26.563319    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 21 17:08:26.566729 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:08:26.563324    2575 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 21 17:08:26.566729 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:08:26.563329    2575 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 21 17:08:26.566729 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:08:26.563333    2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 21 17:08:26.566729 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:08:26.563337    2575 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 21 17:08:26.566729 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:08:26.563341    2575 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 21 17:08:26.566729 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:08:26.563345    2575 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 21 17:08:26.566729 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:08:26.563350    2575 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 21 17:08:26.566729 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:08:26.563354    2575 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 21 17:08:26.566729 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:08:26.563358    2575 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 21 17:08:26.566729 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:08:26.563362    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 21 17:08:26.566729 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:08:26.563367    2575 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 21 17:08:26.566729 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:08:26.563371    2575 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 21 17:08:26.567268 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:08:26.563375    2575 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 21 17:08:26.567268 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:08:26.563380    2575 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 21 17:08:26.567268 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:08:26.563384    2575 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 21 17:08:26.567268 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:08:26.563388    2575 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 21 17:08:26.567268 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:08:26.563392    2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 21 17:08:26.567268 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:08:26.563396    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 21 17:08:26.567268 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:08:26.563400    2575 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 21 17:08:26.567268 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:08:26.563408    2575 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 21 17:08:26.567268 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:08:26.563413    2575 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 21 17:08:26.567268 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:08:26.563418    2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 21 17:08:26.567268 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:08:26.563422    2575 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 21 17:08:26.567268 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:08:26.563427    2575 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 21 17:08:26.567268 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:08:26.563431    2575 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 21 17:08:26.567268 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:08:26.563435    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 21 17:08:26.567268 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:08:26.563439    2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 21 17:08:26.567268 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:08:26.563443    2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 21 17:08:26.567268 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:08:26.563447    2575 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 21 17:08:26.567268 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:08:26.563451    2575 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 21 17:08:26.567268 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:08:26.563454    2575 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 21 17:08:26.567920 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:08:26.563458    2575 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 21 17:08:26.567920 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:08:26.563462    2575 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 21 17:08:26.567920 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:08:26.563466    2575 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 21 17:08:26.567920 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:08:26.563470    2575 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 21 17:08:26.567920 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:08:26.563474    2575 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 21 17:08:26.567920 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:08:26.563478    2575 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 21 17:08:26.567920 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:08:26.563482    2575 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 21 17:08:26.567920 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:08:26.563486    2575 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 21 17:08:26.567920 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:08:26.563491    2575 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 21 17:08:26.567920 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:08:26.563495    2575 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 21 17:08:26.567920 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:08:26.563507    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 21 17:08:26.567920 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:08:26.563512    2575 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 21 17:08:26.567920 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:08:26.563517    2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 21 17:08:26.567920 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:08:26.563521    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 21 17:08:26.567920 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:08:26.563526    2575 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 21 17:08:26.567920 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:08:26.563532    2575 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 21 17:08:26.567920 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:08:26.563538    2575 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 21 17:08:26.567920 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:08:26.563542    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 21 17:08:26.567920 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:08:26.563546    2575 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 21 17:08:26.567920 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:08:26.563551    2575 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 21 17:08:26.568477 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:08:26.563576    2575 feature_gate.go:328] unrecognized feature gate: Example
Jul 21 17:08:26.568477 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:08:26.563581    2575 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 21 17:08:26.568477 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:08:26.563585    2575 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 21 17:08:26.568477 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:08:26.563589    2575 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 21 17:08:26.568477 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:08:26.563593    2575 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 21 17:08:26.568477 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:08:26.563598    2575 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 21 17:08:26.568477 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:08:26.563602    2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 21 17:08:26.568477 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:08:26.563606    2575 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 21 17:08:26.568477 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:08:26.563610    2575 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 21 17:08:26.568477 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:08:26.563614    2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 21 17:08:26.568477 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:08:26.563618    2575 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 21 17:08:26.568477 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:08:26.563622    2575 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 21 17:08:26.568477 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:08:26.563626    2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 21 17:08:26.568477 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:08:26.563631    2575 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 21 17:08:26.568477 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:08:26.563635    2575 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 21 17:08:26.568477 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:08:26.563639    2575 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 21 17:08:26.568477 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:08:26.563643    2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 21 17:08:26.568477 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:08:26.563647    2575 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 21 17:08:26.568477 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:08:26.564221    2575 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 21 17:08:26.568477 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:08:26.564230    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 21 17:08:26.569007 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:08:26.564234    2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 21 17:08:26.569007 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:08:26.564238    2575 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 21 17:08:26.569007 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:08:26.564246    2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 21 17:08:26.569007 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:08:26.564253    2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 21 17:08:26.569007 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:08:26.564257    2575 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 21 17:08:26.569007 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:08:26.564262    2575 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 21 17:08:26.569007 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:08:26.564266    2575 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 21 17:08:26.569007 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:08:26.564270    2575 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 21 17:08:26.569007 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:08:26.564274    2575 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 21 17:08:26.569007 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:08:26.564279    2575 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 21 17:08:26.569007 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:08:26.564283    2575 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 21 17:08:26.569007 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:08:26.564288    2575 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 21 17:08:26.569007 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:08:26.564292    2575 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 21 17:08:26.569007 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:08:26.564299    2575 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 21 17:08:26.569007 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:08:26.564305    2575 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 21 17:08:26.569007 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:08:26.564316    2575 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 21 17:08:26.569007 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:08:26.564321    2575 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 21 17:08:26.569007 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:08:26.564326    2575 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 21 17:08:26.569007 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:08:26.564330    2575 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 21 17:08:26.569007 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:08:26.564335    2575 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 21 17:08:26.569592 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:08:26.564339    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 21 17:08:26.569592 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:08:26.564343    2575 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 21 17:08:26.569592 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:08:26.564347    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 21 17:08:26.569592 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:08:26.564352    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 21 17:08:26.569592 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:08:26.564355    2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 21 17:08:26.569592 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:08:26.564360    2575 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 21 17:08:26.569592 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:08:26.564363    2575 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 21 17:08:26.569592 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:08:26.564369    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 21 17:08:26.569592 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:08:26.564373    2575 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 21 17:08:26.569592 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:08:26.564377    2575 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 21 17:08:26.569592 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:08:26.564381    2575 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 21 17:08:26.569592 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:08:26.564385    2575 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 21 17:08:26.569592 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:08:26.564389    2575 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 21 17:08:26.569592 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:08:26.564393    2575 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 21 17:08:26.569592 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:08:26.564397    2575 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 21 17:08:26.569592 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:08:26.564410    2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 21 17:08:26.569592 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:08:26.564415    2575 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 21 17:08:26.569592 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:08:26.564419    2575 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 21 17:08:26.569592 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:08:26.564423    2575 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 21 17:08:26.569592 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:08:26.564428    2575 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 21 17:08:26.570080 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:08:26.564432    2575 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 21 17:08:26.570080 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:08:26.564437    2575 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 21 17:08:26.570080 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:08:26.564441    2575 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 21 17:08:26.570080 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:08:26.564445    2575 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 21 17:08:26.570080 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:08:26.564449    2575 feature_gate.go:328] unrecognized feature gate: Example
Jul 21 17:08:26.570080 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:08:26.564453    2575 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 21 17:08:26.570080 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:08:26.564457    2575 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 21 17:08:26.570080 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:08:26.564461    2575 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 21 17:08:26.570080 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:08:26.564465    2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 21 17:08:26.570080 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:08:26.564470    2575 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 21 17:08:26.570080 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:08:26.564474    2575 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 21 17:08:26.570080 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:08:26.564478    2575 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 21 17:08:26.570080 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:08:26.564483    2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 21 17:08:26.570080 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:08:26.564486    2575 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 21 17:08:26.570080 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:08:26.564491    2575 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 21 17:08:26.570080 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:08:26.564495    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 21 17:08:26.570080 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:08:26.564499    2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 21 17:08:26.570080 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:08:26.564505    2575 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 21 17:08:26.570080 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:08:26.564509    2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 21 17:08:26.570080 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:08:26.564513    2575 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 21 17:08:26.570594 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:08:26.564517    2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 21 17:08:26.570594 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:08:26.564521    2575 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 21 17:08:26.570594 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:08:26.564525    2575 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 21 17:08:26.570594 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:08:26.564529    2575 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 21 17:08:26.570594 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:08:26.564533    2575 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 21 17:08:26.570594 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:08:26.564537    2575 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 21 17:08:26.570594 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:08:26.564541    2575 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 21 17:08:26.570594 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:08:26.564547    2575 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 21 17:08:26.570594 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:08:26.564582    2575 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 21 17:08:26.570594 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:08:26.564588    2575 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 21 17:08:26.570594 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:08:26.564592    2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 21 17:08:26.570594 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:08:26.564601    2575 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 21 17:08:26.570594 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:08:26.564606    2575 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 21 17:08:26.570594 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:08:26.564611    2575 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 21 17:08:26.570594 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:08:26.564616    2575 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 21 17:08:26.570594 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:08:26.564620    2575 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 21 17:08:26.570594 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:08:26.564625    2575 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 21 17:08:26.570594 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:08:26.564629    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 21 17:08:26.570594 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:08:26.564633    2575 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 21 17:08:26.570594 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:08:26.564638    2575 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 21 17:08:26.571095 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:08:26.564642    2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 21 17:08:26.571095 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:08:26.564646    2575 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 21 17:08:26.571095 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:08:26.564650    2575 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 21 17:08:26.571095 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:08:26.564654    2575 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 21 17:08:26.571095 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:08:26.564666    2575 feature_gate.go:328] unrecognized feature gate: Example2
Jul 21 17:08:26.571095 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:08:26.564691    2575 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 21 17:08:26.571095 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:08:26.564698    2575 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 21 17:08:26.571095 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:08:26.564703    2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 21 17:08:26.571095 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:08:26.564710    2575 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 21 17:08:26.571095 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:08:26.564719    2575 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 21 17:08:26.571095 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:08:26.564724    2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 21 17:08:26.571095 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:08:26.564729    2575 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 21 17:08:26.571095 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:08:26.564733    2575 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 21 17:08:26.571095 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:08:26.564736    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 21 17:08:26.571095 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:08:26.564741    2575 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 21 17:08:26.571095 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:08:26.564745    2575 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 21 17:08:26.571095 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:08:26.564749    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 21 17:08:26.571095 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:26.564843    2575 flags.go:64] FLAG: --address="0.0.0.0"
Jul 21 17:08:26.571095 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:26.564853    2575 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jul 21 17:08:26.571095 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:26.564865    2575 flags.go:64] FLAG: --anonymous-auth="true"
Jul 21 17:08:26.571616 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:26.564872    2575 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jul 21 17:08:26.571616 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:26.564880    2575 flags.go:64] FLAG: --authentication-token-webhook="false"
Jul 21 17:08:26.571616 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:26.564884    2575 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jul 21 17:08:26.571616 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:26.564891    2575 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jul 21 17:08:26.571616 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:26.564897    2575 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jul 21 17:08:26.571616 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:26.564902    2575 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jul 21 17:08:26.571616 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:26.564907    2575 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jul 21 17:08:26.571616 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:26.564912    2575 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jul 21 17:08:26.571616 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:26.564917    2575 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jul 21 17:08:26.571616 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:26.564922    2575 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jul 21 17:08:26.571616 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:26.564927    2575 flags.go:64] FLAG: --cgroup-root=""
Jul 21 17:08:26.571616 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:26.564931    2575 flags.go:64] FLAG: --cgroups-per-qos="true"
Jul 21 17:08:26.571616 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:26.564935    2575 flags.go:64] FLAG: --client-ca-file=""
Jul 21 17:08:26.571616 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:26.564939    2575 flags.go:64] FLAG: --cloud-provider="external"
Jul 21 17:08:26.571616 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:26.564944    2575 flags.go:64] FLAG: --cluster-dns="[]"
Jul 21 17:08:26.571616 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:26.564952    2575 flags.go:64] FLAG: --cluster-domain=""
Jul 21 17:08:26.571616 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:26.564956    2575 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jul 21 17:08:26.571616 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:26.564961    2575 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jul 21 17:08:26.571616 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:26.564966    2575 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jul 21 17:08:26.571616 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:26.564971    2575 flags.go:64] FLAG: --container-log-max-files="5"
Jul 21 17:08:26.571616 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:26.564977    2575 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jul 21 17:08:26.571616 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:26.564983    2575 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jul 21 17:08:26.571616 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:26.564988    2575 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jul 21 17:08:26.572167 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:26.564992    2575 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jul 21 17:08:26.572167 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:26.564997    2575 flags.go:64] FLAG: --contention-profiling="false"
Jul 21 17:08:26.572167 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:26.565002    2575 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jul 21 17:08:26.572167 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:26.565006    2575 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jul 21 17:08:26.572167 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:26.565011    2575 flags.go:64] FLAG: --cpu-manager-policy="none"
Jul 21 17:08:26.572167 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:26.565015    2575 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jul 21 17:08:26.572167 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:26.565021    2575 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jul 21 17:08:26.572167 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:26.565026    2575 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jul 21 17:08:26.572167 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:26.565032    2575 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jul 21 17:08:26.572167 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:26.565037    2575 flags.go:64] FLAG: --enable-load-reader="false"
Jul 21 17:08:26.572167 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:26.565041    2575 flags.go:64] FLAG: --enable-server="true"
Jul 21 17:08:26.572167 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:26.565047    2575 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jul 21 17:08:26.572167 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:26.565053    2575 flags.go:64] FLAG: --event-burst="100"
Jul 21 17:08:26.572167 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:26.565058    2575 flags.go:64] FLAG: --event-qps="50"
Jul 21 17:08:26.572167 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:26.565062    2575 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jul 21 17:08:26.572167 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:26.565066    2575 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jul 21 17:08:26.572167 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:26.565071    2575 flags.go:64] FLAG: --eviction-hard=""
Jul 21 17:08:26.572167 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:26.565077    2575 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jul 21 17:08:26.572167 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:26.565081    2575 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jul 21 17:08:26.572167 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:26.565085    2575 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jul 21 17:08:26.572167 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:26.565091    2575 flags.go:64] FLAG: --eviction-soft=""
Jul 21 17:08:26.572167 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:26.565096    2575 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jul 21 17:08:26.572167 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:26.565100    2575 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jul 21 17:08:26.572167 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:26.565105    2575 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jul 21 17:08:26.572167 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:26.565109    2575 flags.go:64] FLAG: --experimental-mounter-path=""
Jul 21 17:08:26.572849 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:26.565114    2575 flags.go:64] FLAG: --fail-cgroupv1="false"
Jul 21 17:08:26.572849 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:26.565118    2575 flags.go:64] FLAG: --fail-swap-on="true"
Jul 21 17:08:26.572849 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:26.565123    2575 flags.go:64] FLAG: --feature-gates=""
Jul 21 17:08:26.572849 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:26.565128    2575 flags.go:64] FLAG: --file-check-frequency="20s"
Jul 21 17:08:26.572849 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:26.565133    2575 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jul 21 17:08:26.572849 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:26.565139    2575 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jul 21 17:08:26.572849 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:26.565144    2575 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jul 21 17:08:26.572849 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:26.565149    2575 flags.go:64] FLAG: --healthz-port="10248"
Jul 21 17:08:26.572849 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:26.565153    2575 flags.go:64] FLAG: --help="false"
Jul 21 17:08:26.572849 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:26.565158    2575 flags.go:64] FLAG: --hostname-override="ip-10-0-141-39.ec2.internal"
Jul 21 17:08:26.572849 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:26.565163    2575 flags.go:64] FLAG: --housekeeping-interval="10s"
Jul 21 17:08:26.572849 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:26.565168    2575 flags.go:64] FLAG: --http-check-frequency="20s"
Jul 21 17:08:26.572849 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:26.565172    2575 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jul 21 17:08:26.572849 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:26.565177    2575 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jul 21 17:08:26.572849 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:26.565183    2575 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jul 21 17:08:26.572849 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:26.565188    2575 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jul 21 17:08:26.572849 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:26.565193    2575 flags.go:64] FLAG: --image-service-endpoint=""
Jul 21 17:08:26.572849 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:26.565197    2575 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jul 21 17:08:26.572849 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:26.565202    2575 flags.go:64] FLAG: --kube-api-burst="100"
Jul 21 17:08:26.572849 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:26.565207    2575 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jul 21 17:08:26.572849 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:26.565212    2575 flags.go:64] FLAG: --kube-api-qps="50"
Jul 21 17:08:26.572849 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:26.565216    2575 flags.go:64] FLAG: --kube-reserved=""
Jul 21 17:08:26.572849 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:26.565221    2575 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jul 21 17:08:26.572849 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:26.565225    2575 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jul 21 17:08:26.573452 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:26.565229    2575 flags.go:64] FLAG: --kubelet-cgroups=""
Jul 21 17:08:26.573452 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:26.565234    2575 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jul 21 17:08:26.573452 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:26.565238    2575 flags.go:64] FLAG: --lock-file=""
Jul 21 17:08:26.573452 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:26.565242    2575 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jul 21 17:08:26.573452 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:26.565246    2575 flags.go:64] FLAG: --log-flush-frequency="5s"
Jul 21 17:08:26.573452 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:26.565250    2575 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jul 21 17:08:26.573452 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:26.565263    2575 flags.go:64] FLAG: --log-json-split-stream="false"
Jul 21 17:08:26.573452 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:26.565268    2575 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jul 21 17:08:26.573452 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:26.565272    2575 flags.go:64] FLAG: --log-text-split-stream="false"
Jul 21 17:08:26.573452 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:26.565277    2575 flags.go:64] FLAG: --logging-format="text"
Jul 21 17:08:26.573452 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:26.565281    2575 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jul 21 17:08:26.573452 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:26.565287    2575 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jul 21 17:08:26.573452 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:26.565291    2575 flags.go:64] FLAG: --manifest-url=""
Jul 21 17:08:26.573452 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:26.565296    2575 flags.go:64] FLAG: --manifest-url-header=""
Jul 21 17:08:26.573452 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:26.565302    2575 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jul 21 17:08:26.573452 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:26.565307    2575 flags.go:64] FLAG: --max-open-files="1000000"
Jul 21 17:08:26.573452 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:26.565314    2575 flags.go:64] FLAG: --max-pods="110"
Jul 21 17:08:26.573452 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:26.565319    2575 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jul 21 17:08:26.573452 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:26.565323    2575 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jul 21 17:08:26.573452 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:26.565328    2575 flags.go:64] FLAG: --memory-manager-policy="None"
Jul 21 17:08:26.573452 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:26.565332    2575 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jul 21 17:08:26.573452 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:26.565337    2575 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jul 21 17:08:26.573452 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:26.565341    2575 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jul 21 17:08:26.573452 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:26.565348    2575 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jul 21 17:08:26.573452 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:26.565359    2575 flags.go:64] FLAG: --node-status-max-images="50"
Jul 21 17:08:26.574091 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:26.565364    2575 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jul 21 17:08:26.574091 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:26.565368    2575 flags.go:64] FLAG: --oom-score-adj="-999"
Jul 21 17:08:26.574091 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:26.565373    2575 flags.go:64] FLAG: --pod-cidr=""
Jul 21 17:08:26.574091 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:26.565378    2575 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4017e99d76d7b91598d3a3430cd0eba6eda8b33653addd3838fdfe3cca69c5a0"
Jul 21 17:08:26.574091 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:26.565387    2575 flags.go:64] FLAG: --pod-manifest-path=""
Jul 21 17:08:26.574091 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:26.565392    2575 flags.go:64] FLAG: --pod-max-pids="-1"
Jul 21 17:08:26.574091 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:26.565396    2575 flags.go:64] FLAG: --pods-per-core="0"
Jul 21 17:08:26.574091 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:26.565401    2575 flags.go:64] FLAG: --port="10250"
Jul 21 17:08:26.574091 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:26.565405    2575 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jul 21 17:08:26.574091 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:26.565410    2575 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-03bd092769734943e"
Jul 21 17:08:26.574091 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:26.565414    2575 flags.go:64] FLAG: --qos-reserved=""
Jul 21 17:08:26.574091 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:26.565419    2575 flags.go:64] FLAG: --read-only-port="10255"
Jul 21 17:08:26.574091 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:26.565423    2575 flags.go:64] FLAG: --register-node="true"
Jul 21 17:08:26.574091 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:26.565428    2575 flags.go:64] FLAG: --register-with-taints=""
Jul 21 17:08:26.574091 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:26.565433    2575 flags.go:64] FLAG: --registry-burst="10"
Jul 21 17:08:26.574091 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:26.565437    2575 flags.go:64] FLAG: --registry-qps="5"
Jul 21 17:08:26.574091 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:26.565442    2575 flags.go:64] FLAG: --reserved-cpus=""
Jul 21 17:08:26.574091 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:26.565446    2575 flags.go:64] FLAG: --reserved-memory=""
Jul 21 17:08:26.574091 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:26.565451    2575 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jul 21 17:08:26.574091 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:26.565456    2575 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jul 21 17:08:26.574091 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:26.565460    2575 flags.go:64] FLAG: --rotate-certificates="false"
Jul 21 17:08:26.574091 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:26.565465    2575 flags.go:64] FLAG: --rotate-server-certificates="false"
Jul 21 17:08:26.574091 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:26.565470    2575 flags.go:64] FLAG: --runonce="false"
Jul 21 17:08:26.574091 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:26.565474    2575 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jul 21 17:08:26.574091 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:26.565479    2575 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jul 21 17:08:26.574741 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:26.565484    2575 flags.go:64] FLAG: --seccomp-default="false"
Jul 21 17:08:26.574741 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:26.565489    2575 flags.go:64] FLAG: --serialize-image-pulls="true"
Jul 21 17:08:26.574741 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:26.565493    2575 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jul 21 17:08:26.574741 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:26.565497    2575 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jul 21 17:08:26.574741 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:26.565502    2575 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jul 21 17:08:26.574741 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:26.565508    2575 flags.go:64] FLAG: --storage-driver-password="root"
Jul 21 17:08:26.574741 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:26.565512    2575 flags.go:64] FLAG: --storage-driver-secure="false"
Jul 21 17:08:26.574741 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:26.565517    2575 flags.go:64] FLAG: --storage-driver-table="stats"
Jul 21 17:08:26.574741 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:26.565521    2575 flags.go:64] FLAG: --storage-driver-user="root"
Jul 21 17:08:26.574741 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:26.565525    2575 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jul 21 17:08:26.574741 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:26.565530    2575 flags.go:64] FLAG: --sync-frequency="1m0s"
Jul 21 17:08:26.574741 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:26.565536    2575 flags.go:64] FLAG: --system-cgroups=""
Jul 21 17:08:26.574741 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:26.565541    2575 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jul 21 17:08:26.574741 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:26.565550    2575 flags.go:64] FLAG: --system-reserved-cgroup=""
Jul 21 17:08:26.574741 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:26.565573    2575 flags.go:64] FLAG: --tls-cert-file=""
Jul 21 17:08:26.574741 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:26.565578    2575 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jul 21 17:08:26.574741 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:26.565586    2575 flags.go:64] FLAG: --tls-min-version=""
Jul 21 17:08:26.574741 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:26.565591    2575 flags.go:64] FLAG: --tls-private-key-file=""
Jul 21 17:08:26.574741 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:26.565596    2575 flags.go:64] FLAG: --topology-manager-policy="none"
Jul 21 17:08:26.574741 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:26.565600    2575 flags.go:64] FLAG: --topology-manager-policy-options=""
Jul 21 17:08:26.574741 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:26.565605    2575 flags.go:64] FLAG: --topology-manager-scope="container"
Jul 21 17:08:26.574741 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:26.565610    2575 flags.go:64] FLAG: --v="2"
Jul 21 17:08:26.574741 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:26.565616    2575 flags.go:64] FLAG: --version="false"
Jul 21 17:08:26.574741 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:26.565622    2575 flags.go:64] FLAG: --vmodule=""
Jul 21 17:08:26.574741 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:26.565627    2575 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jul 21 17:08:26.575346 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:26.565632    2575 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jul 21 17:08:26.575346 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:08:26.565830    2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 21 17:08:26.575346 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:08:26.565837    2575 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 21 17:08:26.575346 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:08:26.565842    2575 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 21 17:08:26.575346 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:08:26.565846    2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 21 17:08:26.575346 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:08:26.565850    2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 21 17:08:26.575346 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:08:26.565855    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 21 17:08:26.575346 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:08:26.565858    2575 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 21 17:08:26.575346 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:08:26.565863    2575 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 21 17:08:26.575346 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:08:26.565866    2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 21 17:08:26.575346 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:08:26.565870    2575 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 21 17:08:26.575346 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:08:26.565874    2575 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 21 17:08:26.575346 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:08:26.565881    2575 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 21 17:08:26.575346 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:08:26.565885    2575 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 21 17:08:26.575346 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:08:26.565889    2575 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 21 17:08:26.575346 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:08:26.565893    2575 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 21 17:08:26.575346 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:08:26.565897    2575 feature_gate.go:328] unrecognized feature gate: Example
Jul 21 17:08:26.575346 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:08:26.565901    2575 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 21 17:08:26.575346 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:08:26.565905    2575 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 21 17:08:26.575346 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:08:26.565910    2575 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 21 17:08:26.575862 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:08:26.565914    2575 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 21 17:08:26.575862 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:08:26.565918    2575 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 21 17:08:26.575862 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:08:26.565925    2575 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 21 17:08:26.575862 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:08:26.565930    2575 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 21 17:08:26.575862 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:08:26.565935    2575 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 21 17:08:26.575862 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:08:26.565939    2575 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 21 17:08:26.575862 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:08:26.565943    2575 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 21 17:08:26.575862 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:08:26.565948    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 21 17:08:26.575862 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:08:26.565951    2575 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 21 17:08:26.575862 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:08:26.565955    2575 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 21 17:08:26.575862 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:08:26.565959    2575 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 21 17:08:26.575862 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:08:26.565964    2575 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 21 17:08:26.575862 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:08:26.565968    2575 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 21 17:08:26.575862 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:08:26.565972    2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 21 17:08:26.575862 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:08:26.565976    2575 feature_gate.go:328] unrecognized feature gate: Example2
Jul 21 17:08:26.575862 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:08:26.565980    2575 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 21 17:08:26.575862 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:08:26.565984    2575 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 21 17:08:26.575862 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:08:26.565988    2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 21 17:08:26.575862 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:08:26.565992    2575 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 21 17:08:26.576322 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:08:26.565996    2575 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 21 17:08:26.576322 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:08:26.566001    2575 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 21 17:08:26.576322 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:08:26.566005    2575 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 21 17:08:26.576322 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:08:26.566009    2575 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 21 17:08:26.576322 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:08:26.566013    2575 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 21 17:08:26.576322 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:08:26.566019    2575 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 21 17:08:26.576322 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:08:26.566023    2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 21 17:08:26.576322 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:08:26.566027    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 21 17:08:26.576322 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:08:26.566031    2575 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 21 17:08:26.576322 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:08:26.566035    2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 21 17:08:26.576322 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:08:26.566040    2575 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 21 17:08:26.576322 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:08:26.566044    2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 21 17:08:26.576322 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:08:26.566048    2575 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 21 17:08:26.576322 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:08:26.566053    2575 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 21 17:08:26.576322 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:08:26.566057    2575 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 21 17:08:26.576322 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:08:26.566069    2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 21 17:08:26.576322 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:08:26.566073    2575 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 21 17:08:26.576322 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:08:26.566079    2575 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 21 17:08:26.576322 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:08:26.566085    2575 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 21 17:08:26.576322 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:08:26.566090    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 21 17:08:26.576822 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:08:26.566094    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 21 17:08:26.576822 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:08:26.566098    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 21 17:08:26.576822 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:08:26.566102    2575 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 21 17:08:26.576822 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:08:26.566106    2575 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 21 17:08:26.576822 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:08:26.566112    2575 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 21 17:08:26.576822 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:08:26.566116    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 21 17:08:26.576822 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:08:26.566120    2575 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 21 17:08:26.576822 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:08:26.566124    2575 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 21 17:08:26.576822 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:08:26.566128    2575 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 21 17:08:26.576822 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:08:26.566132    2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 21 17:08:26.576822 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:08:26.566135    2575 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 21 17:08:26.576822 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:08:26.566139    2575 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 21 17:08:26.576822 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:08:26.566144    2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 21 17:08:26.576822 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:08:26.566147    2575 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 21 17:08:26.576822 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:08:26.566151    2575 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 21 17:08:26.576822 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:08:26.566155    2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 21 17:08:26.576822 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:08:26.566159    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 21 17:08:26.576822 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:08:26.566164    2575 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 21 17:08:26.576822 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:08:26.566168    2575 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 21 17:08:26.576822 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:08:26.566172    2575 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 21 17:08:26.577316 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:08:26.566176    2575 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 21 17:08:26.577316 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:08:26.566180    2575 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 21 17:08:26.577316 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:08:26.566184    2575 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 21 17:08:26.577316 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:08:26.566188    2575 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 21 17:08:26.577316 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:08:26.566192    2575 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 21 17:08:26.577316 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:08:26.566196    2575 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 21 17:08:26.577316 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:08:26.566201    2575 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 21 17:08:26.577316 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:08:26.566205    2575 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 21 17:08:26.577316 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:08:26.566210    2575 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 21 17:08:26.577316 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:08:26.566216    2575 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 21 17:08:26.577316 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:08:26.566221    2575 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 21 17:08:26.577316 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:08:26.566226    2575 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 21 17:08:26.577316 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:08:26.566230    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 21 17:08:26.577316 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:08:26.566234    2575 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 21 17:08:26.577316 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:08:26.566238    2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 21 17:08:26.577316 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:08:26.566243    2575 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 21 17:08:26.577316 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:08:26.566248    2575 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 21 17:08:26.577316 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:08:26.566252    2575 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 21 17:08:26.577316 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:08:26.566257    2575 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 21 17:08:26.577795 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:08:26.566261    2575 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 21 17:08:26.577795 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:08:26.566266    2575 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 21 17:08:26.577795 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:26.566850    2575 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 21 17:08:26.577795 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:26.574544    2575 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Jul 21 17:08:26.577795 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:26.574573    2575 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jul 21 17:08:26.577795 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:26.575105    2575 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jul 21 17:08:26.577795 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:26.575113    2575 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jul 21 17:08:26.577795 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:08:26.575177    2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 21 17:08:26.577795 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:08:26.575182    2575 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 21 17:08:26.577795 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:08:26.575185    2575 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 21 17:08:26.577795 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:08:26.575188    2575 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 21 17:08:26.577795 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:08:26.575190    2575 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 21 17:08:26.577795 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:08:26.575194    2575 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 21 17:08:26.577795 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:08:26.575197    2575 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 21 17:08:26.578143 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:08:26.575200    2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 21 17:08:26.578143 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:08:26.575202    2575 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 21 17:08:26.578143 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:08:26.575205    2575 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 21 17:08:26.578143 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:08:26.575207    2575 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 21 17:08:26.578143 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:08:26.575210    2575 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 21 17:08:26.578143 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:08:26.575218    2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 21 17:08:26.578143 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:08:26.575221    2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 21 17:08:26.578143 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:08:26.575224    2575 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 21 17:08:26.578143 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:08:26.575227    2575 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 21 17:08:26.578143 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:08:26.575229    2575 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 21 17:08:26.578143 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:08:26.575232    2575 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 21 17:08:26.578143 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:08:26.575234    2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 21 17:08:26.578143 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:08:26.575237    2575 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 21 17:08:26.578143 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:08:26.575239    2575 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 21 17:08:26.578143 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:08:26.575242    2575 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 21 17:08:26.578143 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:08:26.575244    2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 21 17:08:26.578143 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:08:26.575247    2575 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 21 17:08:26.578143 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:08:26.575249    2575 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 21 17:08:26.578143 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:08:26.575251    2575 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 21 17:08:26.578143 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:08:26.575254    2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 21 17:08:26.578691 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:08:26.575256    2575 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 21 17:08:26.578691 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:08:26.575259    2575 feature_gate.go:328] unrecognized feature gate: Example
Jul 21 17:08:26.578691 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:08:26.575262    2575 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 21 17:08:26.578691 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:08:26.575264    2575 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 21 17:08:26.578691 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:08:26.575268    2575 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 21 17:08:26.578691 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:08:26.575270    2575 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 21 17:08:26.578691 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:08:26.575272    2575 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 21 17:08:26.578691 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:08:26.575275    2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 21 17:08:26.578691 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:08:26.575277    2575 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 21 17:08:26.578691 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:08:26.575280    2575 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 21 17:08:26.578691 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:08:26.575282    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 21 17:08:26.578691 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:08:26.575285    2575 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 21 17:08:26.578691 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:08:26.575287    2575 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 21 17:08:26.578691 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:08:26.575290    2575 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 21 17:08:26.578691 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:08:26.575292    2575 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 21 17:08:26.578691 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:08:26.575295    2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 21 17:08:26.578691 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:08:26.575299    2575 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 21 17:08:26.578691 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:08:26.575302    2575 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 21 17:08:26.578691 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:08:26.575311    2575 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 21 17:08:26.579164 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:08:26.575314    2575 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 21 17:08:26.579164 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:08:26.575316    2575 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 21 17:08:26.579164 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:08:26.575319    2575 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 21 17:08:26.579164 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:08:26.575321    2575 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 21 17:08:26.579164 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:08:26.575324    2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 21 17:08:26.579164 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:08:26.575326    2575 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 21 17:08:26.579164 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:08:26.575328    2575 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 21 17:08:26.579164 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:08:26.575331    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 21 17:08:26.579164 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:08:26.575333    2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 21 17:08:26.579164 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:08:26.575335    2575 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 21 17:08:26.579164 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:08:26.575338    2575 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 21 17:08:26.579164 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:08:26.575340    2575 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 21 17:08:26.579164 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:08:26.575343    2575 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 21 17:08:26.579164 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:08:26.575345    2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 21 17:08:26.579164 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:08:26.575348    2575 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 21 17:08:26.579164 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:08:26.575351    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 21 17:08:26.579164 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:08:26.575354    2575 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 21 17:08:26.579164 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:08:26.575356    2575 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 21 17:08:26.579164 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:08:26.575359    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 21 17:08:26.579164 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:08:26.575362    2575 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 21 17:08:26.579665 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:08:26.575364    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 21 17:08:26.579665 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:08:26.575366    2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 21 17:08:26.579665 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:08:26.575369    2575 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 21 17:08:26.579665 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:08:26.575371    2575 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 21 17:08:26.579665 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:08:26.575374    2575 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 21 17:08:26.579665 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:08:26.575376    2575 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 21 17:08:26.579665 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:08:26.575381    2575 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 21 17:08:26.579665 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:08:26.575384    2575 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 21 17:08:26.579665 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:08:26.575387    2575 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 21 17:08:26.579665 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:08:26.575389    2575 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 21 17:08:26.579665 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:08:26.575391    2575 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 21 17:08:26.579665 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:08:26.575394    2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 21 17:08:26.579665 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:08:26.575403    2575 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 21 17:08:26.579665 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:08:26.575406    2575 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 21 17:08:26.579665 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:08:26.575408    2575 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 21 17:08:26.579665 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:08:26.575411    2575 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 21 17:08:26.579665 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:08:26.575413    2575 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 21 17:08:26.579665 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:08:26.575416    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 21 17:08:26.579665 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:08:26.575418    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 21 17:08:26.579665 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:08:26.575420    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 21 17:08:26.580139 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:08:26.575423    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 21 17:08:26.580139 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:08:26.575425    2575 feature_gate.go:328] unrecognized feature gate: Example2
Jul 21 17:08:26.580139 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:08:26.575429    2575 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 21 17:08:26.580139 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:08:26.575432    2575 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 21 17:08:26.580139 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:08:26.575435    2575 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 21 17:08:26.580139 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:08:26.575437    2575 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 21 17:08:26.580139 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:08:26.575440    2575 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 21 17:08:26.580139 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:08:26.575443    2575 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 21 17:08:26.580139 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:08:26.575446    2575 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 21 17:08:26.580139 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:08:26.575448    2575 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 21 17:08:26.580139 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:08:26.575452    2575 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 21 17:08:26.580139 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:08:26.575455    2575 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 21 17:08:26.580139 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:08:26.575458    2575 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 21 17:08:26.580139 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:26.575464    2575 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 21 17:08:26.580489 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:08:26.575627    2575 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 21 17:08:26.580489 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:08:26.575634    2575 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 21 17:08:26.580489 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:08:26.575637    2575 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 21 17:08:26.580489 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:08:26.575640    2575 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 21 17:08:26.580489 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:08:26.575643    2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 21 17:08:26.580489 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:08:26.575645    2575 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 21 17:08:26.580489 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:08:26.575648    2575 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 21 17:08:26.580489 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:08:26.575650    2575 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 21 17:08:26.580489 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:08:26.575653    2575 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 21 17:08:26.580489 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:08:26.575655    2575 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 21 17:08:26.580489 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:08:26.575657    2575 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 21 17:08:26.580489 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:08:26.575666    2575 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 21 17:08:26.580489 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:08:26.575670    2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 21 17:08:26.580489 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:08:26.575673    2575 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 21 17:08:26.580489 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:08:26.575676    2575 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 21 17:08:26.580489 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:08:26.575680    2575 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 21 17:08:26.580489 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:08:26.575683    2575 feature_gate.go:328] unrecognized feature gate: Example
Jul 21 17:08:26.580489 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:08:26.575685    2575 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 21 17:08:26.580489 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:08:26.575688    2575 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 21 17:08:26.580969 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:08:26.575690    2575 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 21 17:08:26.580969 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:08:26.575693    2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 21 17:08:26.580969 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:08:26.575696    2575 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 21 17:08:26.580969 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:08:26.575698    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 21 17:08:26.580969 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:08:26.575700    2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 21 17:08:26.580969 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:08:26.575703    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 21 17:08:26.580969 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:08:26.575706    2575 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 21 17:08:26.580969 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:08:26.575709    2575 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 21 17:08:26.580969 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:08:26.575711    2575 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 21 17:08:26.580969 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:08:26.575714    2575 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 21 17:08:26.580969 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:08:26.575716    2575 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 21 17:08:26.580969 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:08:26.575719    2575 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 21 17:08:26.580969 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:08:26.575721    2575 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 21 17:08:26.580969 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:08:26.575724    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 21 17:08:26.580969 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:08:26.575727    2575 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 21 17:08:26.580969 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:08:26.575729    2575 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 21 17:08:26.580969 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:08:26.575731    2575 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 21 17:08:26.580969 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:08:26.575734    2575 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 21 17:08:26.580969 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:08:26.575736    2575 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 21 17:08:26.580969 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:08:26.575739    2575 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 21 17:08:26.581444 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:08:26.575741    2575 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 21 17:08:26.581444 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:08:26.575743    2575 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 21 17:08:26.581444 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:08:26.575746    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 21 17:08:26.581444 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:08:26.575748    2575 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 21 17:08:26.581444 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:08:26.575750    2575 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 21 17:08:26.581444 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:08:26.575758    2575 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 21 17:08:26.581444 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:08:26.575761    2575 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 21 17:08:26.581444 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:08:26.575763    2575 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 21 17:08:26.581444 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:08:26.575766    2575 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 21 17:08:26.581444 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:08:26.575768    2575 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 21 17:08:26.581444 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:08:26.575771    2575 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 21 17:08:26.581444 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:08:26.575773    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 21 17:08:26.581444 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:08:26.575775    2575 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 21 17:08:26.581444 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:08:26.575778    2575 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 21 17:08:26.581444 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:08:26.575780    2575 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 21 17:08:26.581444 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:08:26.575782    2575 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 21 17:08:26.581444 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:08:26.575785    2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 21 17:08:26.581444 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:08:26.575787    2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 21 17:08:26.581444 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:08:26.575790    2575 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 21 17:08:26.581444 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:08:26.575793    2575 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 21 17:08:26.581949 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:08:26.575795    2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 21 17:08:26.581949 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:08:26.575798    2575 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 21 17:08:26.581949 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:08:26.575800    2575 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 21 17:08:26.581949 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:08:26.575802    2575 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 21 17:08:26.581949 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:08:26.575805    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 21 17:08:26.581949 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:08:26.575807    2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 21 17:08:26.581949 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:08:26.575810    2575 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 21 17:08:26.581949 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:08:26.575812    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 21 17:08:26.581949 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:08:26.575816    2575 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 21 17:08:26.581949 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:08:26.575818    2575 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 21 17:08:26.581949 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:08:26.575821    2575 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 21 17:08:26.581949 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:08:26.575824    2575 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 21 17:08:26.581949 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:08:26.575827    2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 21 17:08:26.581949 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:08:26.575830    2575 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 21 17:08:26.581949 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:08:26.575832    2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 21 17:08:26.581949 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:08:26.575835    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 21 17:08:26.581949 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:08:26.575837    2575 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 21 17:08:26.581949 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:08:26.575840    2575 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 21 17:08:26.581949 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:08:26.575847    2575 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 21 17:08:26.582400 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:08:26.575850    2575 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 21 17:08:26.582400 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:08:26.575852    2575 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 21 17:08:26.582400 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:08:26.575855    2575 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 21 17:08:26.582400 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:08:26.575857    2575 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 21 17:08:26.582400 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:08:26.575860    2575 feature_gate.go:328] unrecognized feature gate: Example2
Jul 21 17:08:26.582400 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:08:26.575862    2575 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 21 17:08:26.582400 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:08:26.575864    2575 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 21 17:08:26.582400 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:08:26.575867    2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 21 17:08:26.582400 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:08:26.575869    2575 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 21 17:08:26.582400 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:08:26.575872    2575 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 21 17:08:26.582400 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:08:26.575875    2575 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 21 17:08:26.582400 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:08:26.575877    2575 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 21 17:08:26.582400 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:08:26.575881    2575 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 21 17:08:26.582400 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:08:26.575883    2575 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 21 17:08:26.582400 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:08:26.575886    2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 21 17:08:26.582400 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:08:26.575888    2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 21 17:08:26.582400 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:08:26.575890    2575 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 21 17:08:26.582400 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:08:26.575893    2575 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 21 17:08:26.582400 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:08:26.575896    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 21 17:08:26.582400 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:08:26.575898    2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 21 17:08:26.582975 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:08:26.575900    2575 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 21 17:08:26.582975 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:26.575905    2575 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 21 17:08:26.582975 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:26.576006    2575 server.go:962] "Client rotation is on, will bootstrap in background"
Jul 21 17:08:26.582975 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:26.578787    2575 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jul 21 17:08:26.582975 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:26.580973    2575 server.go:1019] "Starting client certificate rotation"
Jul 21 17:08:26.582975 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:26.581085    2575 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 21 17:08:26.582975 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:26.581150    2575 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 21 17:08:26.583763 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:26.583748    2575 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 21 17:08:26.590412 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:26.590391    2575 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 21 17:08:26.600364 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:26.600342    2575 log.go:25] "Validated CRI v1 runtime API"
Jul 21 17:08:26.602489 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:26.602465    2575 log.go:25] "Validated CRI v1 image API"
Jul 21 17:08:26.603305 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:26.603289    2575 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jul 21 17:08:26.605903 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:26.605872    2575 fs.go:135] Filesystem UUIDs: map[2c326fb3-8fdd-4054-9eda-5a0a7b047f28:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 b21dc6fb-7d1b-448d-8254-082674f02cd3:/dev/nvme0n1p4]
Jul 21 17:08:26.605980 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:26.605893    2575 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jul 21 17:08:26.611268 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:26.611152    2575 manager.go:216] Machine: {Timestamp:2026-07-21 17:08:26.609904223 +0000 UTC m=+0.333913285 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3102739 MemoryCapacity:32812179456 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec29df439a1ee45a555d9634679ea10f SystemUUID:ec29df43-9a1e-e45a-555d-9634679ea10f BootID:a8d06e79-6927-42f8-88d0-e1646463dd1e Filesystems:[{Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406089728 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406089728 Type:vfs Inodes:4005393 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562439168 Type:vfs Inodes:819200 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:c4:c0:1a:eb:8b Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:c4:c0:1a:eb:8b Speed:0 Mtu:9001} {Name:ovs-system MacAddress:96:7f:5e:ff:21:1c Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812179456 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jul 21 17:08:26.611268 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:26.611261    2575 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jul 21 17:08:26.611435 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:26.611367    2575 manager.go:232] Version: {KernelVersion:5.14.0-570.128.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260715-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jul 21 17:08:26.613084 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:26.613065    2575 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 21 17:08:26.614237 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:26.614213    2575 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jul 21 17:08:26.614370 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:26.614241    2575 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-141-39.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jul 21 17:08:26.615125 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:26.615114    2575 topology_manager.go:138] "Creating topology manager with none policy"
Jul 21 17:08:26.615167 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:26.615127    2575 container_manager_linux.go:309] "Creating device plugin manager"
Jul 21 17:08:26.615167 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:26.615134    2575 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 21 17:08:26.615167 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:26.615147    2575 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 21 17:08:26.616459 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:26.616449    2575 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jul 21 17:08:26.619687 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:26.619676    2575 state_mem.go:36] "Initialized new in-memory state store"
Jul 21 17:08:26.619810 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:26.619800    2575 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jul 21 17:08:26.619843 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:26.619832    2575 kubelet.go:486] "Attempting to sync node with API server"
Jul 21 17:08:26.619873 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:26.619853    2575 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jul 21 17:08:26.619905 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:26.619881    2575 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jul 21 17:08:26.619905 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:26.619892    2575 kubelet.go:398] "Adding apiserver pod source"
Jul 21 17:08:26.619970 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:26.619907    2575 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jul 21 17:08:26.620314 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:26.620291    2575 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 21 17:08:26.620314 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:26.620314    2575 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 21 17:08:26.622360 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:26.622345    2575 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1"
Jul 21 17:08:26.624497 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:26.624479    2575 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jul 21 17:08:26.624598 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:26.624519    2575 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jul 21 17:08:26.625692 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:26.625679    2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jul 21 17:08:26.625758 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:26.625699    2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jul 21 17:08:26.625758 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:26.625709    2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jul 21 17:08:26.625758 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:26.625717    2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jul 21 17:08:26.625758 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:26.625729    2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jul 21 17:08:26.625758 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:26.625737    2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jul 21 17:08:26.625758 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:26.625748    2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jul 21 17:08:26.625758 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:26.625757    2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jul 21 17:08:26.625986 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:26.625767    2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jul 21 17:08:26.625986 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:26.625776    2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jul 21 17:08:26.625986 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:26.625795    2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jul 21 17:08:26.625986 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:26.625804    2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jul 21 17:08:26.626760 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:26.626749    2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jul 21 17:08:26.626823 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:26.626763    2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jul 21 17:08:26.629779 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:26.629764    2575 server.go:1268] "Started kubelet"
Jul 21 17:08:26.629895 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:26.629853    2575 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jul 21 17:08:26.632536 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:26.630101    2575 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jul 21 17:08:26.632638 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:26.632589    2575 server_v1.go:49] "podresources" method="list" useActivePods=true
Jul 21 17:08:26.632858 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:26.632839    2575 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-141-39.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 21 17:08:26.632937 ip-10-0-141-39 kubenswrapper[2575]: E0721 17:08:26.632919    2575 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 21 17:08:26.633147 ip-10-0-141-39 systemd[1]: Started Kubernetes Kubelet.
Jul 21 17:08:26.635307 ip-10-0-141-39 kubenswrapper[2575]: E0721 17:08:26.633657    2575 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-141-39.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 21 17:08:26.635307 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:26.634190    2575 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jul 21 17:08:26.635988 ip-10-0-141-39 kubenswrapper[2575]: E0721 17:08:26.635965    2575 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jul 21 17:08:26.636069 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:26.636002    2575 server.go:310] "Adding debug handlers to kubelet server"
Jul 21 17:08:26.640401 ip-10-0-141-39 kubenswrapper[2575]: E0721 17:08:26.639490    2575 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-141-39.ec2.internal.18c45d1736bfec7a  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-141-39.ec2.internal,UID:ip-10-0-141-39.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-141-39.ec2.internal,},FirstTimestamp:2026-07-21 17:08:26.629737594 +0000 UTC m=+0.353746654,LastTimestamp:2026-07-21 17:08:26.629737594 +0000 UTC m=+0.353746654,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-141-39.ec2.internal,}"
Jul 21 17:08:26.642225 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:26.642211    2575 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jul 21 17:08:26.642304 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:26.642230    2575 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jul 21 17:08:26.642383 ip-10-0-141-39 kubenswrapper[2575]: E0721 17:08:26.642350    2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-39.ec2.internal\" not found"
Jul 21 17:08:26.642940 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:26.642754    2575 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jul 21 17:08:26.642940 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:26.642878    2575 volume_manager.go:311] "The desired_state_of_world populator starts"
Jul 21 17:08:26.642940 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:26.642891    2575 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jul 21 17:08:26.643492 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:26.643009    2575 reconstruct.go:97] "Volume reconstruction finished"
Jul 21 17:08:26.643492 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:26.643017    2575 reconciler.go:29] "Reconciler: start to sync state"
Jul 21 17:08:26.643492 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:26.643448    2575 factory.go:153] Registering CRI-O factory
Jul 21 17:08:26.643492 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:26.643466    2575 factory.go:223] Registration of the crio container factory successfully
Jul 21 17:08:26.643803 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:26.643520    2575 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jul 21 17:08:26.643803 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:26.643530    2575 factory.go:55] Registering systemd factory
Jul 21 17:08:26.643803 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:26.643537    2575 factory.go:223] Registration of the systemd container factory successfully
Jul 21 17:08:26.643803 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:26.643578    2575 factory.go:103] Registering Raw factory
Jul 21 17:08:26.643803 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:26.643592    2575 manager.go:1196] Started watching for new ooms in manager
Jul 21 17:08:26.644020 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:26.643985    2575 manager.go:349] Starting recovery of all containers
Jul 21 17:08:26.645772 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:26.645749    2575 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-n6wlf"
Jul 21 17:08:26.650843 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:26.650711    2575 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jul 21 17:08:26.652725 ip-10-0-141-39 kubenswrapper[2575]: E0721 17:08:26.652697    2575 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-141-39.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Jul 21 17:08:26.652825 ip-10-0-141-39 kubenswrapper[2575]: E0721 17:08:26.652780    2575 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Jul 21 17:08:26.654995 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:26.654981    2575 manager.go:354] Recovery completed
Jul 21 17:08:26.655901 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:26.655880    2575 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-n6wlf"
Jul 21 17:08:26.658936 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:26.658924    2575 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 21 17:08:26.661494 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:26.661478    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-39.ec2.internal" event="NodeHasSufficientMemory"
Jul 21 17:08:26.661603 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:26.661509    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-39.ec2.internal" event="NodeHasNoDiskPressure"
Jul 21 17:08:26.661603 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:26.661526    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-39.ec2.internal" event="NodeHasSufficientPID"
Jul 21 17:08:26.662071 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:26.662048    2575 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jul 21 17:08:26.662071 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:26.662060    2575 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 21 17:08:26.662184 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:26.662069    2575 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jul 21 17:08:26.662184 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:26.662162    2575 state_mem.go:36] "Initialized new in-memory state store"
Jul 21 17:08:26.662690 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:26.662677    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-39.ec2.internal" event="NodeHasSufficientMemory"
Jul 21 17:08:26.662754 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:26.662702    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-39.ec2.internal" event="NodeHasNoDiskPressure"
Jul 21 17:08:26.662754 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:26.662714    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-39.ec2.internal" event="NodeHasSufficientPID"
Jul 21 17:08:26.663634 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:26.663624    2575 policy_none.go:49] "None policy: Start"
Jul 21 17:08:26.663671 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:26.663639    2575 memory_manager.go:187] "Starting memorymanager" policy="None"
Jul 21 17:08:26.663671 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:26.663649    2575 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jul 21 17:08:26.664913 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:26.664901    2575 policy_none.go:47] "Start"
Jul 21 17:08:26.701936 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:26.701919    2575 manager.go:337] "Starting Device Plugin manager"
Jul 21 17:08:26.702034 ip-10-0-141-39 kubenswrapper[2575]: E0721 17:08:26.701956    2575 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jul 21 17:08:26.702034 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:26.701971    2575 server.go:87] "Starting device plugin registration server"
Jul 21 17:08:26.702237 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:26.702223    2575 eviction_manager.go:189] "Eviction manager: starting control loop"
Jul 21 17:08:26.702290 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:26.702239    2575 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jul 21 17:08:26.702360 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:26.702337    2575 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jul 21 17:08:26.702448 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:26.702422    2575 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jul 21 17:08:26.702448 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:26.702432    2575 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jul 21 17:08:26.703034 ip-10-0-141-39 kubenswrapper[2575]: E0721 17:08:26.703014    2575 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jul 21 17:08:26.703096 ip-10-0-141-39 kubenswrapper[2575]: E0721 17:08:26.703070    2575 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-141-39.ec2.internal\" not found"
Jul 21 17:08:26.803098 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:26.803061    2575 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 21 17:08:26.804416 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:26.804011    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-39.ec2.internal" event="NodeHasSufficientMemory"
Jul 21 17:08:26.804416 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:26.804039    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-39.ec2.internal" event="NodeHasNoDiskPressure"
Jul 21 17:08:26.804416 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:26.804050    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-39.ec2.internal" event="NodeHasSufficientPID"
Jul 21 17:08:26.804416 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:26.804075    2575 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-141-39.ec2.internal"
Jul 21 17:08:26.810100 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:26.810044    2575 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-141-39.ec2.internal"
Jul 21 17:08:26.810100 ip-10-0-141-39 kubenswrapper[2575]: E0721 17:08:26.810077    2575 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-141-39.ec2.internal\": node \"ip-10-0-141-39.ec2.internal\" not found"
Jul 21 17:08:26.835675 ip-10-0-141-39 kubenswrapper[2575]: E0721 17:08:26.835650    2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-39.ec2.internal\" not found"
Jul 21 17:08:26.840403 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:26.840385    2575 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jul 21 17:08:26.840485 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:26.840423    2575 status_manager.go:244] "Starting to sync pod status with apiserver"
Jul 21 17:08:26.840485 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:26.840441    2575 kubelet.go:2448] "Starting kubelet main sync loop"
Jul 21 17:08:26.840485 ip-10-0-141-39 kubenswrapper[2575]: E0721 17:08:26.840470    2575 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jul 21 17:08:26.842626 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:26.842606    2575 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 21 17:08:26.936705 ip-10-0-141-39 kubenswrapper[2575]: E0721 17:08:26.936669    2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-39.ec2.internal\" not found"
Jul 21 17:08:26.940838 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:26.940818    2575 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-39.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-141-39.ec2.internal"]
Jul 21 17:08:26.940897 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:26.940890    2575 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 21 17:08:26.942360 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:26.942346    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-39.ec2.internal" event="NodeHasSufficientMemory"
Jul 21 17:08:26.942431 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:26.942374    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-39.ec2.internal" event="NodeHasNoDiskPressure"
Jul 21 17:08:26.942431 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:26.942384    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-39.ec2.internal" event="NodeHasSufficientPID"
Jul 21 17:08:26.943847 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:26.943835    2575 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 21 17:08:26.943955 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:26.943937    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-39.ec2.internal"
Jul 21 17:08:26.944002 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:26.943974    2575 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 21 17:08:26.944353 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:26.944335    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/a733d0df94ea33efc59cd1a4c70b79bd-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-141-39.ec2.internal\" (UID: \"a733d0df94ea33efc59cd1a4c70b79bd\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-39.ec2.internal"
Jul 21 17:08:26.944465 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:26.944364    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a733d0df94ea33efc59cd1a4c70b79bd-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-141-39.ec2.internal\" (UID: \"a733d0df94ea33efc59cd1a4c70b79bd\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-39.ec2.internal"
Jul 21 17:08:26.944547 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:26.944533    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-39.ec2.internal" event="NodeHasSufficientMemory"
Jul 21 17:08:26.944611 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:26.944536    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-39.ec2.internal" event="NodeHasSufficientMemory"
Jul 21 17:08:26.944611 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:26.944581    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-39.ec2.internal" event="NodeHasNoDiskPressure"
Jul 21 17:08:26.944611 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:26.944595    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-39.ec2.internal" event="NodeHasSufficientPID"
Jul 21 17:08:26.944699 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:26.944595    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-39.ec2.internal" event="NodeHasNoDiskPressure"
Jul 21 17:08:26.944699 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:26.944647    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-39.ec2.internal" event="NodeHasSufficientPID"
Jul 21 17:08:26.945787 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:26.945771    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-39.ec2.internal"
Jul 21 17:08:26.945836 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:26.945799    2575 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 21 17:08:26.946449 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:26.946433    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-39.ec2.internal" event="NodeHasSufficientMemory"
Jul 21 17:08:26.946509 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:26.946467    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-39.ec2.internal" event="NodeHasNoDiskPressure"
Jul 21 17:08:26.946509 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:26.946483    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-39.ec2.internal" event="NodeHasSufficientPID"
Jul 21 17:08:26.971110 ip-10-0-141-39 kubenswrapper[2575]: E0721 17:08:26.971091    2575 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-141-39.ec2.internal\" not found" node="ip-10-0-141-39.ec2.internal"
Jul 21 17:08:26.975372 ip-10-0-141-39 kubenswrapper[2575]: E0721 17:08:26.975355    2575 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-141-39.ec2.internal\" not found" node="ip-10-0-141-39.ec2.internal"
Jul 21 17:08:27.037392 ip-10-0-141-39 kubenswrapper[2575]: E0721 17:08:27.037370    2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-39.ec2.internal\" not found"
Jul 21 17:08:27.045326 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:27.045303    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/a733d0df94ea33efc59cd1a4c70b79bd-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-141-39.ec2.internal\" (UID: \"a733d0df94ea33efc59cd1a4c70b79bd\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-39.ec2.internal"
Jul 21 17:08:27.045405 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:27.045332    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a733d0df94ea33efc59cd1a4c70b79bd-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-141-39.ec2.internal\" (UID: \"a733d0df94ea33efc59cd1a4c70b79bd\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-39.ec2.internal"
Jul 21 17:08:27.045405 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:27.045362    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/35d9bf4db485a74e935a67bfd9e0bd65-config\") pod \"kube-apiserver-proxy-ip-10-0-141-39.ec2.internal\" (UID: \"35d9bf4db485a74e935a67bfd9e0bd65\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-141-39.ec2.internal"
Jul 21 17:08:27.045495 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:27.045408    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/a733d0df94ea33efc59cd1a4c70b79bd-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-141-39.ec2.internal\" (UID: \"a733d0df94ea33efc59cd1a4c70b79bd\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-39.ec2.internal"
Jul 21 17:08:27.045495 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:27.045418    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a733d0df94ea33efc59cd1a4c70b79bd-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-141-39.ec2.internal\" (UID: \"a733d0df94ea33efc59cd1a4c70b79bd\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-39.ec2.internal"
Jul 21 17:08:27.137748 ip-10-0-141-39 kubenswrapper[2575]: E0721 17:08:27.137663    2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-39.ec2.internal\" not found"
Jul 21 17:08:27.146044 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:27.146017    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/35d9bf4db485a74e935a67bfd9e0bd65-config\") pod \"kube-apiserver-proxy-ip-10-0-141-39.ec2.internal\" (UID: \"35d9bf4db485a74e935a67bfd9e0bd65\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-141-39.ec2.internal"
Jul 21 17:08:27.146044 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:27.145964    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/35d9bf4db485a74e935a67bfd9e0bd65-config\") pod \"kube-apiserver-proxy-ip-10-0-141-39.ec2.internal\" (UID: \"35d9bf4db485a74e935a67bfd9e0bd65\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-141-39.ec2.internal"
Jul 21 17:08:27.238190 ip-10-0-141-39 kubenswrapper[2575]: E0721 17:08:27.238157    2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-39.ec2.internal\" not found"
Jul 21 17:08:27.274646 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:27.274619    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-39.ec2.internal"
Jul 21 17:08:27.278875 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:27.278672    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-39.ec2.internal"
Jul 21 17:08:27.338482 ip-10-0-141-39 kubenswrapper[2575]: E0721 17:08:27.338446    2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-39.ec2.internal\" not found"
Jul 21 17:08:27.439062 ip-10-0-141-39 kubenswrapper[2575]: E0721 17:08:27.438994    2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-39.ec2.internal\" not found"
Jul 21 17:08:27.539536 ip-10-0-141-39 kubenswrapper[2575]: E0721 17:08:27.539496    2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-39.ec2.internal\" not found"
Jul 21 17:08:28.849866 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:28.849845    2575 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jul 21 17:08:28.850256 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:28.849970    2575 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 21 17:08:28.910480 ip-10-0-141-39 kubenswrapper[2575]: E0721 17:08:28.910446    2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-39.ec2.internal\" not found"
Jul 21 17:08:28.930168 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:28.930136    2575 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-20 17:03:27 +0000 UTC" deadline="2028-04-01 10:28:39.238579548 +0000 UTC"
Jul 21 17:08:28.930168 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:28.930160    2575 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14873h20m10.308422713s"
Jul 21 17:08:29.011543 ip-10-0-141-39 kubenswrapper[2575]: E0721 17:08:29.011467    2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-39.ec2.internal\" not found"
Jul 21 17:08:29.049695 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:29.049667    2575 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 21 17:08:29.111652 ip-10-0-141-39 kubenswrapper[2575]: E0721 17:08:29.111618    2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-39.ec2.internal\" not found"
Jul 21 17:08:29.129007 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:08:29.128979    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda733d0df94ea33efc59cd1a4c70b79bd.slice/crio-8931971117cb57a29612165d33c3e008bf0015c50e6ee37a7cd49188b17d4c94 WatchSource:0}: Error finding container 8931971117cb57a29612165d33c3e008bf0015c50e6ee37a7cd49188b17d4c94: Status 404 returned error can't find the container with id 8931971117cb57a29612165d33c3e008bf0015c50e6ee37a7cd49188b17d4c94
Jul 21 17:08:29.132820 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:29.132807    2575 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 21 17:08:29.211789 ip-10-0-141-39 kubenswrapper[2575]: E0721 17:08:29.211758    2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-39.ec2.internal\" not found"
Jul 21 17:08:29.283307 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:29.283226    2575 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 21 17:08:29.312318 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:29.312297    2575 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-39.ec2.internal"
Jul 21 17:08:29.324894 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:29.324874    2575 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 21 17:08:29.326611 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:29.326598    2575 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-39.ec2.internal"
Jul 21 17:08:29.342570 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:08:29.342547    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod35d9bf4db485a74e935a67bfd9e0bd65.slice/crio-28e9208be09a47f09dd2153fc9a206261b0b959d8ce1e6f8203973240a276770 WatchSource:0}: Error finding container 28e9208be09a47f09dd2153fc9a206261b0b959d8ce1e6f8203973240a276770: Status 404 returned error can't find the container with id 28e9208be09a47f09dd2153fc9a206261b0b959d8ce1e6f8203973240a276770
Jul 21 17:08:29.344141 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:29.344124    2575 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 21 17:08:29.364706 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:29.364683    2575 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 21 17:08:29.890835 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:29.890801    2575 apiserver.go:52] "Watching apiserver"
Jul 21 17:08:29.901623 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:29.901597    2575 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 21 17:08:29.903015 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:29.902975    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-node-tuning-operator/tuned-ctzzp","openshift-image-registry/node-ca-d7gn6","openshift-multus/multus-wzxwp","openshift-multus/network-metrics-daemon-n98c6","openshift-network-diagnostics/network-check-target-x4gm9","openshift-network-operator/iptables-alerter-wgb8q","kube-system/global-pull-secret-syncer-44fbg","kube-system/konnectivity-agent-hbwdq","openshift-dns/node-resolver-qmbvr","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-39.ec2.internal","openshift-multus/multus-additional-cni-plugins-jmsnn","openshift-ovn-kubernetes/ovnkube-node-b64gx","kube-system/kube-apiserver-proxy-ip-10-0-141-39.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g8b28"]
Jul 21 17:08:29.904809 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:29.904781    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-44fbg"
Jul 21 17:08:29.904923 ip-10-0-141-39 kubenswrapper[2575]: E0721 17:08:29.904880    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-44fbg" podUID="7900e00a-7d30-4941-a177-1ce9da22deb3"
Jul 21 17:08:29.906727 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:29.906696    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-jmsnn"
Jul 21 17:08:29.908870 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:29.908666    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-wzxwp"
Jul 21 17:08:29.909199 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:29.909180    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 21 17:08:29.909497 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:29.909475    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 21 17:08:29.909593 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:29.909503    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-6x82w\""
Jul 21 17:08:29.909593 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:29.909533    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 21 17:08:29.909698 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:29.909684    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 21 17:08:29.909806 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:29.909792    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 21 17:08:29.910696 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:29.910676    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 21 17:08:29.910923 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:29.910908    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-pr7l4\""
Jul 21 17:08:29.911851 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:29.911835    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-n98c6"
Jul 21 17:08:29.911958 ip-10-0-141-39 kubenswrapper[2575]: E0721 17:08:29.911923    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-n98c6" podUID="75e3f13b-b4dd-479c-b305-420ec10c39d7"
Jul 21 17:08:29.912560 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:29.912542    2575 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jul 21 17:08:29.913200 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:29.913180    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-x4gm9"
Jul 21 17:08:29.913286 ip-10-0-141-39 kubenswrapper[2575]: E0721 17:08:29.913247    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-x4gm9" podUID="1f68ab07-c91d-4a29-8b72-cc76e3dd2753"
Jul 21 17:08:29.914576 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:29.914398    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-wgb8q"
Jul 21 17:08:29.915680 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:29.915660    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-qmbvr"
Jul 21 17:08:29.916648 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:29.916628    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 21 17:08:29.916949 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:29.916924    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g8b28"
Jul 21 17:08:29.917049 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:29.916970    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 21 17:08:29.917049 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:29.916987    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-t945v\""
Jul 21 17:08:29.917400 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:29.917380    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 21 17:08:29.918090 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:29.918072    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-fdmt2\""
Jul 21 17:08:29.918254 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:29.918235    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 21 17:08:29.918346 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:29.918277    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 21 17:08:29.918505 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:29.918489    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-d7gn6"
Jul 21 17:08:29.919170 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:29.919154    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jul 21 17:08:29.919246 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:29.919184    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 21 17:08:29.919639 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:29.919620    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 21 17:08:29.919923 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:29.919900    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-qrsq8\""
Jul 21 17:08:29.920319 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:29.920299    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-hbwdq"
Jul 21 17:08:29.921776 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:29.921754    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 21 17:08:29.921898 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:29.921755    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 21 17:08:29.921898 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:29.921896    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 21 17:08:29.922042 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:29.921964    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-ctzzp"
Jul 21 17:08:29.922042 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:29.921980    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-r5v5j\""
Jul 21 17:08:29.922652 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:29.922631    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/0af1b5ce-5a4d-4cc2-a9ef-ac31ed1f07ca-cnibin\") pod \"multus-additional-cni-plugins-jmsnn\" (UID: \"0af1b5ce-5a4d-4cc2-a9ef-ac31ed1f07ca\") " pod="openshift-multus/multus-additional-cni-plugins-jmsnn"
Jul 21 17:08:29.922734 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:29.922665    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/0af1b5ce-5a4d-4cc2-a9ef-ac31ed1f07ca-os-release\") pod \"multus-additional-cni-plugins-jmsnn\" (UID: \"0af1b5ce-5a4d-4cc2-a9ef-ac31ed1f07ca\") " pod="openshift-multus/multus-additional-cni-plugins-jmsnn"
Jul 21 17:08:29.922734 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:29.922688    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 21 17:08:29.922734 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:29.922690    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/0db4134e-c6f4-4665-9268-90a3569ccb73-host-run-k8s-cni-cncf-io\") pod \"multus-wzxwp\" (UID: \"0db4134e-c6f4-4665-9268-90a3569ccb73\") " pod="openshift-multus/multus-wzxwp"
Jul 21 17:08:29.922734 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:29.922714    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0db4134e-c6f4-4665-9268-90a3569ccb73-host-var-lib-kubelet\") pod \"multus-wzxwp\" (UID: \"0db4134e-c6f4-4665-9268-90a3569ccb73\") " pod="openshift-multus/multus-wzxwp"
Jul 21 17:08:29.922979 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:29.922738    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/0db4134e-c6f4-4665-9268-90a3569ccb73-multus-conf-dir\") pod \"multus-wzxwp\" (UID: \"0db4134e-c6f4-4665-9268-90a3569ccb73\") " pod="openshift-multus/multus-wzxwp"
Jul 21 17:08:29.922979 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:29.922760    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0db4134e-c6f4-4665-9268-90a3569ccb73-system-cni-dir\") pod \"multus-wzxwp\" (UID: \"0db4134e-c6f4-4665-9268-90a3569ccb73\") " pod="openshift-multus/multus-wzxwp"
Jul 21 17:08:29.922979 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:29.922784    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/0db4134e-c6f4-4665-9268-90a3569ccb73-multus-socket-dir-parent\") pod \"multus-wzxwp\" (UID: \"0db4134e-c6f4-4665-9268-90a3569ccb73\") " pod="openshift-multus/multus-wzxwp"
Jul 21 17:08:29.922979 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:29.922807    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/0db4134e-c6f4-4665-9268-90a3569ccb73-host-run-multus-certs\") pod \"multus-wzxwp\" (UID: \"0db4134e-c6f4-4665-9268-90a3569ccb73\") " pod="openshift-multus/multus-wzxwp"
Jul 21 17:08:29.922979 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:29.922832    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/75e3f13b-b4dd-479c-b305-420ec10c39d7-metrics-certs\") pod \"network-metrics-daemon-n98c6\" (UID: \"75e3f13b-b4dd-479c-b305-420ec10c39d7\") " pod="openshift-multus/network-metrics-daemon-n98c6"
Jul 21 17:08:29.922979 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:29.922856    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/0af1b5ce-5a4d-4cc2-a9ef-ac31ed1f07ca-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-jmsnn\" (UID: \"0af1b5ce-5a4d-4cc2-a9ef-ac31ed1f07ca\") " pod="openshift-multus/multus-additional-cni-plugins-jmsnn"
Jul 21 17:08:29.922979 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:29.922880    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0db4134e-c6f4-4665-9268-90a3569ccb73-etc-kubernetes\") pod \"multus-wzxwp\" (UID: \"0db4134e-c6f4-4665-9268-90a3569ccb73\") " pod="openshift-multus/multus-wzxwp"
Jul 21 17:08:29.922979 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:29.922935    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-plkdx\" (UniqueName: \"kubernetes.io/projected/1f68ab07-c91d-4a29-8b72-cc76e3dd2753-kube-api-access-plkdx\") pod \"network-check-target-x4gm9\" (UID: \"1f68ab07-c91d-4a29-8b72-cc76e3dd2753\") " pod="openshift-network-diagnostics/network-check-target-x4gm9"
Jul 21 17:08:29.922979 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:29.922957    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/0db4134e-c6f4-4665-9268-90a3569ccb73-multus-daemon-config\") pod \"multus-wzxwp\" (UID: \"0db4134e-c6f4-4665-9268-90a3569ccb73\") " pod="openshift-multus/multus-wzxwp"
Jul 21 17:08:29.922979 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:29.922983    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/7900e00a-7d30-4941-a177-1ce9da22deb3-kubelet-config\") pod \"global-pull-secret-syncer-44fbg\" (UID: \"7900e00a-7d30-4941-a177-1ce9da22deb3\") " pod="kube-system/global-pull-secret-syncer-44fbg"
Jul 21 17:08:29.923633 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:29.923004    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/7900e00a-7d30-4941-a177-1ce9da22deb3-dbus\") pod \"global-pull-secret-syncer-44fbg\" (UID: \"7900e00a-7d30-4941-a177-1ce9da22deb3\") " pod="kube-system/global-pull-secret-syncer-44fbg"
Jul 21 17:08:29.923633 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:29.923028    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7900e00a-7d30-4941-a177-1ce9da22deb3-original-pull-secret\") pod \"global-pull-secret-syncer-44fbg\" (UID: \"7900e00a-7d30-4941-a177-1ce9da22deb3\") " pod="kube-system/global-pull-secret-syncer-44fbg"
Jul 21 17:08:29.923633 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:29.923050    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/0db4134e-c6f4-4665-9268-90a3569ccb73-host-run-netns\") pod \"multus-wzxwp\" (UID: \"0db4134e-c6f4-4665-9268-90a3569ccb73\") " pod="openshift-multus/multus-wzxwp"
Jul 21 17:08:29.923633 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:29.923073    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/0db4134e-c6f4-4665-9268-90a3569ccb73-host-var-lib-cni-bin\") pod \"multus-wzxwp\" (UID: \"0db4134e-c6f4-4665-9268-90a3569ccb73\") " pod="openshift-multus/multus-wzxwp"
Jul 21 17:08:29.923633 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:29.923095    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/0db4134e-c6f4-4665-9268-90a3569ccb73-host-var-lib-cni-multus\") pod \"multus-wzxwp\" (UID: \"0db4134e-c6f4-4665-9268-90a3569ccb73\") " pod="openshift-multus/multus-wzxwp"
Jul 21 17:08:29.923633 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:29.923121    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/0af1b5ce-5a4d-4cc2-a9ef-ac31ed1f07ca-tuning-conf-dir\") pod \"multus-additional-cni-plugins-jmsnn\" (UID: \"0af1b5ce-5a4d-4cc2-a9ef-ac31ed1f07ca\") " pod="openshift-multus/multus-additional-cni-plugins-jmsnn"
Jul 21 17:08:29.923633 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:29.923143    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mfh2p\" (UniqueName: \"kubernetes.io/projected/0af1b5ce-5a4d-4cc2-a9ef-ac31ed1f07ca-kube-api-access-mfh2p\") pod \"multus-additional-cni-plugins-jmsnn\" (UID: \"0af1b5ce-5a4d-4cc2-a9ef-ac31ed1f07ca\") " pod="openshift-multus/multus-additional-cni-plugins-jmsnn"
Jul 21 17:08:29.923633 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:29.923168    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/0db4134e-c6f4-4665-9268-90a3569ccb73-os-release\") pod \"multus-wzxwp\" (UID: \"0db4134e-c6f4-4665-9268-90a3569ccb73\") " pod="openshift-multus/multus-wzxwp"
Jul 21 17:08:29.923633 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:29.923192    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5wdcp\" (UniqueName: \"kubernetes.io/projected/0db4134e-c6f4-4665-9268-90a3569ccb73-kube-api-access-5wdcp\") pod \"multus-wzxwp\" (UID: \"0db4134e-c6f4-4665-9268-90a3569ccb73\") " pod="openshift-multus/multus-wzxwp"
Jul 21 17:08:29.923633 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:29.923480    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6qzqn\" (UniqueName: \"kubernetes.io/projected/75e3f13b-b4dd-479c-b305-420ec10c39d7-kube-api-access-6qzqn\") pod \"network-metrics-daemon-n98c6\" (UID: \"75e3f13b-b4dd-479c-b305-420ec10c39d7\") " pod="openshift-multus/network-metrics-daemon-n98c6"
Jul 21 17:08:29.923633 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:29.923541    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/0db4134e-c6f4-4665-9268-90a3569ccb73-hostroot\") pod \"multus-wzxwp\" (UID: \"0db4134e-c6f4-4665-9268-90a3569ccb73\") " pod="openshift-multus/multus-wzxwp"
Jul 21 17:08:29.923633 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:29.923578    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0af1b5ce-5a4d-4cc2-a9ef-ac31ed1f07ca-system-cni-dir\") pod \"multus-additional-cni-plugins-jmsnn\" (UID: \"0af1b5ce-5a4d-4cc2-a9ef-ac31ed1f07ca\") " pod="openshift-multus/multus-additional-cni-plugins-jmsnn"
Jul 21 17:08:29.923633 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:29.923608    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/0af1b5ce-5a4d-4cc2-a9ef-ac31ed1f07ca-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-jmsnn\" (UID: \"0af1b5ce-5a4d-4cc2-a9ef-ac31ed1f07ca\") " pod="openshift-multus/multus-additional-cni-plugins-jmsnn"
Jul 21 17:08:29.924235 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:29.923644    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0db4134e-c6f4-4665-9268-90a3569ccb73-multus-cni-dir\") pod \"multus-wzxwp\" (UID: \"0db4134e-c6f4-4665-9268-90a3569ccb73\") " pod="openshift-multus/multus-wzxwp"
Jul 21 17:08:29.924235 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:29.923673    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/0db4134e-c6f4-4665-9268-90a3569ccb73-cni-binary-copy\") pod \"multus-wzxwp\" (UID: \"0db4134e-c6f4-4665-9268-90a3569ccb73\") " pod="openshift-multus/multus-wzxwp"
Jul 21 17:08:29.924235 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:29.923705    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/0af1b5ce-5a4d-4cc2-a9ef-ac31ed1f07ca-cni-binary-copy\") pod \"multus-additional-cni-plugins-jmsnn\" (UID: \"0af1b5ce-5a4d-4cc2-a9ef-ac31ed1f07ca\") " pod="openshift-multus/multus-additional-cni-plugins-jmsnn"
Jul 21 17:08:29.924235 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:29.923736    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/0db4134e-c6f4-4665-9268-90a3569ccb73-cnibin\") pod \"multus-wzxwp\" (UID: \"0db4134e-c6f4-4665-9268-90a3569ccb73\") " pod="openshift-multus/multus-wzxwp"
Jul 21 17:08:29.924491 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:29.924471    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-b64gx"
Jul 21 17:08:29.924603 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:29.924575    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 21 17:08:29.925318 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:29.925300    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-h4xbd\""
Jul 21 17:08:29.926834 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:29.925780    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 21 17:08:29.926834 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:29.926004    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-hmphm\""
Jul 21 17:08:29.926834 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:29.926218    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 21 17:08:29.929267 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:29.929248    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 21 17:08:29.929358 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:29.929251    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 21 17:08:29.930614 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:29.930594    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 21 17:08:29.930743 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:29.930598    2575 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 21 17:08:29.930891 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:29.930613    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 21 17:08:29.930983 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:29.930613    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-ksf6w\""
Jul 21 17:08:29.931050 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:29.930653    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 21 17:08:29.931127 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:29.930672    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 21 17:08:29.966073 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:29.966052    2575 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-tp4vs"
Jul 21 17:08:29.981075 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:29.981056    2575 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 21 17:08:29.988730 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:29.988708    2575 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-tp4vs"
Jul 21 17:08:30.013872 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:30.013841    2575 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jul 21 17:08:30.023937 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:30.023902    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/72cdbb9c-0664-46c0-ab7c-4f38ebd7644f-serviceca\") pod \"node-ca-d7gn6\" (UID: \"72cdbb9c-0664-46c0-ab7c-4f38ebd7644f\") " pod="openshift-image-registry/node-ca-d7gn6"
Jul 21 17:08:30.023937 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:30.023950    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9kpz7\" (UniqueName: \"kubernetes.io/projected/7533c67e-e7ed-4836-8a8b-a670200cccba-kube-api-access-9kpz7\") pod \"node-resolver-qmbvr\" (UID: \"7533c67e-e7ed-4836-8a8b-a670200cccba\") " pod="openshift-dns/node-resolver-qmbvr"
Jul 21 17:08:30.024153 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:30.023990    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/9425e519-d00c-4af6-a68a-3efde7aae5ba-run-systemd\") pod \"ovnkube-node-b64gx\" (UID: \"9425e519-d00c-4af6-a68a-3efde7aae5ba\") " pod="openshift-ovn-kubernetes/ovnkube-node-b64gx"
Jul 21 17:08:30.024153 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:30.024014    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/9425e519-d00c-4af6-a68a-3efde7aae5ba-log-socket\") pod \"ovnkube-node-b64gx\" (UID: \"9425e519-d00c-4af6-a68a-3efde7aae5ba\") " pod="openshift-ovn-kubernetes/ovnkube-node-b64gx"
Jul 21 17:08:30.024153 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:30.024043    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/0db4134e-c6f4-4665-9268-90a3569ccb73-host-run-k8s-cni-cncf-io\") pod \"multus-wzxwp\" (UID: \"0db4134e-c6f4-4665-9268-90a3569ccb73\") " pod="openshift-multus/multus-wzxwp"
Jul 21 17:08:30.024153 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:30.024067    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/0db4134e-c6f4-4665-9268-90a3569ccb73-multus-conf-dir\") pod \"multus-wzxwp\" (UID: \"0db4134e-c6f4-4665-9268-90a3569ccb73\") " pod="openshift-multus/multus-wzxwp"
Jul 21 17:08:30.024153 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:30.024093    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zmnlt\" (UniqueName: \"kubernetes.io/projected/cb1081a1-16da-4e6f-b099-62ae771c79c1-kube-api-access-zmnlt\") pod \"iptables-alerter-wgb8q\" (UID: \"cb1081a1-16da-4e6f-b099-62ae771c79c1\") " pod="openshift-network-operator/iptables-alerter-wgb8q"
Jul 21 17:08:30.024153 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:30.024117    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0db4134e-c6f4-4665-9268-90a3569ccb73-system-cni-dir\") pod \"multus-wzxwp\" (UID: \"0db4134e-c6f4-4665-9268-90a3569ccb73\") " pod="openshift-multus/multus-wzxwp"
Jul 21 17:08:30.024153 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:30.024131    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/0db4134e-c6f4-4665-9268-90a3569ccb73-host-run-k8s-cni-cncf-io\") pod \"multus-wzxwp\" (UID: \"0db4134e-c6f4-4665-9268-90a3569ccb73\") " pod="openshift-multus/multus-wzxwp"
Jul 21 17:08:30.024476 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:30.024143    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/0db4134e-c6f4-4665-9268-90a3569ccb73-multus-socket-dir-parent\") pod \"multus-wzxwp\" (UID: \"0db4134e-c6f4-4665-9268-90a3569ccb73\") " pod="openshift-multus/multus-wzxwp"
Jul 21 17:08:30.024476 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:30.024190    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/0db4134e-c6f4-4665-9268-90a3569ccb73-host-run-multus-certs\") pod \"multus-wzxwp\" (UID: \"0db4134e-c6f4-4665-9268-90a3569ccb73\") " pod="openshift-multus/multus-wzxwp"
Jul 21 17:08:30.024476 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:30.024205    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/0db4134e-c6f4-4665-9268-90a3569ccb73-multus-socket-dir-parent\") pod \"multus-wzxwp\" (UID: \"0db4134e-c6f4-4665-9268-90a3569ccb73\") " pod="openshift-multus/multus-wzxwp"
Jul 21 17:08:30.024476 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:30.024217    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/75e3f13b-b4dd-479c-b305-420ec10c39d7-metrics-certs\") pod \"network-metrics-daemon-n98c6\" (UID: \"75e3f13b-b4dd-479c-b305-420ec10c39d7\") " pod="openshift-multus/network-metrics-daemon-n98c6"
Jul 21 17:08:30.024476 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:30.024245    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9p9mx\" (UniqueName: \"kubernetes.io/projected/72cdbb9c-0664-46c0-ab7c-4f38ebd7644f-kube-api-access-9p9mx\") pod \"node-ca-d7gn6\" (UID: \"72cdbb9c-0664-46c0-ab7c-4f38ebd7644f\") " pod="openshift-image-registry/node-ca-d7gn6"
Jul 21 17:08:30.024476 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:30.024255    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/0db4134e-c6f4-4665-9268-90a3569ccb73-multus-conf-dir\") pod \"multus-wzxwp\" (UID: \"0db4134e-c6f4-4665-9268-90a3569ccb73\") " pod="openshift-multus/multus-wzxwp"
Jul 21 17:08:30.024476 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:30.024272    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/c3efc748-d974-40f3-9d1a-031114d77366-registration-dir\") pod \"aws-ebs-csi-driver-node-g8b28\" (UID: \"c3efc748-d974-40f3-9d1a-031114d77366\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g8b28"
Jul 21 17:08:30.024476 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:30.024297    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9425e519-d00c-4af6-a68a-3efde7aae5ba-host-run-ovn-kubernetes\") pod \"ovnkube-node-b64gx\" (UID: \"9425e519-d00c-4af6-a68a-3efde7aae5ba\") " pod="openshift-ovn-kubernetes/ovnkube-node-b64gx"
Jul 21 17:08:30.024476 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:30.024323    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0db4134e-c6f4-4665-9268-90a3569ccb73-system-cni-dir\") pod \"multus-wzxwp\" (UID: \"0db4134e-c6f4-4665-9268-90a3569ccb73\") " pod="openshift-multus/multus-wzxwp"
Jul 21 17:08:30.024476 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:30.024322    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9425e519-d00c-4af6-a68a-3efde7aae5ba-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-b64gx\" (UID: \"9425e519-d00c-4af6-a68a-3efde7aae5ba\") " pod="openshift-ovn-kubernetes/ovnkube-node-b64gx"
Jul 21 17:08:30.024476 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:30.024374    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/0db4134e-c6f4-4665-9268-90a3569ccb73-host-run-multus-certs\") pod \"multus-wzxwp\" (UID: \"0db4134e-c6f4-4665-9268-90a3569ccb73\") " pod="openshift-multus/multus-wzxwp"
Jul 21 17:08:30.024476 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:30.024454    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0db4134e-c6f4-4665-9268-90a3569ccb73-etc-kubernetes\") pod \"multus-wzxwp\" (UID: \"0db4134e-c6f4-4665-9268-90a3569ccb73\") " pod="openshift-multus/multus-wzxwp"
Jul 21 17:08:30.024946 ip-10-0-141-39 kubenswrapper[2575]: E0721 17:08:30.024506    2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 21 17:08:30.024946 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:30.024509    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/72cdbb9c-0664-46c0-ab7c-4f38ebd7644f-host\") pod \"node-ca-d7gn6\" (UID: \"72cdbb9c-0664-46c0-ab7c-4f38ebd7644f\") " pod="openshift-image-registry/node-ca-d7gn6"
Jul 21 17:08:30.024946 ip-10-0-141-39 kubenswrapper[2575]: E0721 17:08:30.024586    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/75e3f13b-b4dd-479c-b305-420ec10c39d7-metrics-certs podName:75e3f13b-b4dd-479c-b305-420ec10c39d7 nodeName:}" failed. No retries permitted until 2026-07-21 17:08:30.524561289 +0000 UTC m=+2.978713924 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/75e3f13b-b4dd-479c-b305-420ec10c39d7-metrics-certs") pod "network-metrics-daemon-n98c6" (UID: "75e3f13b-b4dd-479c-b305-420ec10c39d7") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 21 17:08:30.024946 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:30.024626    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/dacfd9ac-9516-4da2-ab9c-2629e4e6174e-agent-certs\") pod \"konnectivity-agent-hbwdq\" (UID: \"dacfd9ac-9516-4da2-ab9c-2629e4e6174e\") " pod="kube-system/konnectivity-agent-hbwdq"
Jul 21 17:08:30.024946 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:30.024654    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2601f86a-f327-4d78-9407-eec87e925760-etc-kubernetes\") pod \"tuned-ctzzp\" (UID: \"2601f86a-f327-4d78-9407-eec87e925760\") " pod="openshift-cluster-node-tuning-operator/tuned-ctzzp"
Jul 21 17:08:30.024946 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:30.024677    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/c3efc748-d974-40f3-9d1a-031114d77366-device-dir\") pod \"aws-ebs-csi-driver-node-g8b28\" (UID: \"c3efc748-d974-40f3-9d1a-031114d77366\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g8b28"
Jul 21 17:08:30.024946 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:30.024722    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/9425e519-d00c-4af6-a68a-3efde7aae5ba-host-slash\") pod \"ovnkube-node-b64gx\" (UID: \"9425e519-d00c-4af6-a68a-3efde7aae5ba\") " pod="openshift-ovn-kubernetes/ovnkube-node-b64gx"
Jul 21 17:08:30.024946 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:30.024746    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0db4134e-c6f4-4665-9268-90a3569ccb73-etc-kubernetes\") pod \"multus-wzxwp\" (UID: \"0db4134e-c6f4-4665-9268-90a3569ccb73\") " pod="openshift-multus/multus-wzxwp"
Jul 21 17:08:30.024946 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:30.024745    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9425e519-d00c-4af6-a68a-3efde7aae5ba-var-lib-openvswitch\") pod \"ovnkube-node-b64gx\" (UID: \"9425e519-d00c-4af6-a68a-3efde7aae5ba\") " pod="openshift-ovn-kubernetes/ovnkube-node-b64gx"
Jul 21 17:08:30.024946 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:30.024787    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/9425e519-d00c-4af6-a68a-3efde7aae5ba-ovnkube-config\") pod \"ovnkube-node-b64gx\" (UID: \"9425e519-d00c-4af6-a68a-3efde7aae5ba\") " pod="openshift-ovn-kubernetes/ovnkube-node-b64gx"
Jul 21 17:08:30.024946 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:30.024815    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/0db4134e-c6f4-4665-9268-90a3569ccb73-multus-daemon-config\") pod \"multus-wzxwp\" (UID: \"0db4134e-c6f4-4665-9268-90a3569ccb73\") " pod="openshift-multus/multus-wzxwp"
Jul 21 17:08:30.024946 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:30.024840    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/7900e00a-7d30-4941-a177-1ce9da22deb3-dbus\") pod \"global-pull-secret-syncer-44fbg\" (UID: \"7900e00a-7d30-4941-a177-1ce9da22deb3\") " pod="kube-system/global-pull-secret-syncer-44fbg"
Jul 21 17:08:30.024946 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:30.024864    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/0db4134e-c6f4-4665-9268-90a3569ccb73-host-var-lib-cni-bin\") pod \"multus-wzxwp\" (UID: \"0db4134e-c6f4-4665-9268-90a3569ccb73\") " pod="openshift-multus/multus-wzxwp"
Jul 21 17:08:30.024946 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:30.024928    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/2601f86a-f327-4d78-9407-eec87e925760-etc-systemd\") pod \"tuned-ctzzp\" (UID: \"2601f86a-f327-4d78-9407-eec87e925760\") " pod="openshift-cluster-node-tuning-operator/tuned-ctzzp"
Jul 21 17:08:30.024946 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:30.024953    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/cb1081a1-16da-4e6f-b099-62ae771c79c1-iptables-alerter-script\") pod \"iptables-alerter-wgb8q\" (UID: \"cb1081a1-16da-4e6f-b099-62ae771c79c1\") " pod="openshift-network-operator/iptables-alerter-wgb8q"
Jul 21 17:08:30.025767 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:30.024977    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/c3efc748-d974-40f3-9d1a-031114d77366-etc-selinux\") pod \"aws-ebs-csi-driver-node-g8b28\" (UID: \"c3efc748-d974-40f3-9d1a-031114d77366\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g8b28"
Jul 21 17:08:30.025767 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:30.025000    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/9425e519-d00c-4af6-a68a-3efde7aae5ba-systemd-units\") pod \"ovnkube-node-b64gx\" (UID: \"9425e519-d00c-4af6-a68a-3efde7aae5ba\") " pod="openshift-ovn-kubernetes/ovnkube-node-b64gx"
Jul 21 17:08:30.025767 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:30.025041    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mfh2p\" (UniqueName: \"kubernetes.io/projected/0af1b5ce-5a4d-4cc2-a9ef-ac31ed1f07ca-kube-api-access-mfh2p\") pod \"multus-additional-cni-plugins-jmsnn\" (UID: \"0af1b5ce-5a4d-4cc2-a9ef-ac31ed1f07ca\") " pod="openshift-multus/multus-additional-cni-plugins-jmsnn"
Jul 21 17:08:30.025767 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:30.025074    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6qzqn\" (UniqueName: \"kubernetes.io/projected/75e3f13b-b4dd-479c-b305-420ec10c39d7-kube-api-access-6qzqn\") pod \"network-metrics-daemon-n98c6\" (UID: \"75e3f13b-b4dd-479c-b305-420ec10c39d7\") " pod="openshift-multus/network-metrics-daemon-n98c6"
Jul 21 17:08:30.025767 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:30.025100    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/0db4134e-c6f4-4665-9268-90a3569ccb73-hostroot\") pod \"multus-wzxwp\" (UID: \"0db4134e-c6f4-4665-9268-90a3569ccb73\") " pod="openshift-multus/multus-wzxwp"
Jul 21 17:08:30.025767 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:30.025181    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8gpht\" (UniqueName: \"kubernetes.io/projected/9425e519-d00c-4af6-a68a-3efde7aae5ba-kube-api-access-8gpht\") pod \"ovnkube-node-b64gx\" (UID: \"9425e519-d00c-4af6-a68a-3efde7aae5ba\") " pod="openshift-ovn-kubernetes/ovnkube-node-b64gx"
Jul 21 17:08:30.025767 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:30.025206    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/0db4134e-c6f4-4665-9268-90a3569ccb73-cni-binary-copy\") pod \"multus-wzxwp\" (UID: \"0db4134e-c6f4-4665-9268-90a3569ccb73\") " pod="openshift-multus/multus-wzxwp"
Jul 21 17:08:30.025767 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:30.025232    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/2601f86a-f327-4d78-9407-eec87e925760-etc-sysctl-d\") pod \"tuned-ctzzp\" (UID: \"2601f86a-f327-4d78-9407-eec87e925760\") " pod="openshift-cluster-node-tuning-operator/tuned-ctzzp"
Jul 21 17:08:30.025767 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:30.025254    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2601f86a-f327-4d78-9407-eec87e925760-sys\") pod \"tuned-ctzzp\" (UID: \"2601f86a-f327-4d78-9407-eec87e925760\") " pod="openshift-cluster-node-tuning-operator/tuned-ctzzp"
Jul 21 17:08:30.025767 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:30.025277    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/9425e519-d00c-4af6-a68a-3efde7aae5ba-run-ovn\") pod \"ovnkube-node-b64gx\" (UID: \"9425e519-d00c-4af6-a68a-3efde7aae5ba\") " pod="openshift-ovn-kubernetes/ovnkube-node-b64gx"
Jul 21 17:08:30.025767 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:30.025301    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/9425e519-d00c-4af6-a68a-3efde7aae5ba-host-cni-bin\") pod \"ovnkube-node-b64gx\" (UID: \"9425e519-d00c-4af6-a68a-3efde7aae5ba\") " pod="openshift-ovn-kubernetes/ovnkube-node-b64gx"
Jul 21 17:08:30.025767 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:30.025326    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/0af1b5ce-5a4d-4cc2-a9ef-ac31ed1f07ca-cni-binary-copy\") pod \"multus-additional-cni-plugins-jmsnn\" (UID: \"0af1b5ce-5a4d-4cc2-a9ef-ac31ed1f07ca\") " pod="openshift-multus/multus-additional-cni-plugins-jmsnn"
Jul 21 17:08:30.025767 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:30.025350    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/0db4134e-c6f4-4665-9268-90a3569ccb73-cnibin\") pod \"multus-wzxwp\" (UID: \"0db4134e-c6f4-4665-9268-90a3569ccb73\") " pod="openshift-multus/multus-wzxwp"
Jul 21 17:08:30.025767 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:30.025374    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/dacfd9ac-9516-4da2-ab9c-2629e4e6174e-konnectivity-ca\") pod \"konnectivity-agent-hbwdq\" (UID: \"dacfd9ac-9516-4da2-ab9c-2629e4e6174e\") " pod="kube-system/konnectivity-agent-hbwdq"
Jul 21 17:08:30.025767 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:30.025403    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/2601f86a-f327-4d78-9407-eec87e925760-etc-sysctl-conf\") pod \"tuned-ctzzp\" (UID: \"2601f86a-f327-4d78-9407-eec87e925760\") " pod="openshift-cluster-node-tuning-operator/tuned-ctzzp"
Jul 21 17:08:30.025767 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:30.025445    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/2601f86a-f327-4d78-9407-eec87e925760-lib-modules\") pod \"tuned-ctzzp\" (UID: \"2601f86a-f327-4d78-9407-eec87e925760\") " pod="openshift-cluster-node-tuning-operator/tuned-ctzzp"
Jul 21 17:08:30.025767 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:30.025467    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/2601f86a-f327-4d78-9407-eec87e925760-host\") pod \"tuned-ctzzp\" (UID: \"2601f86a-f327-4d78-9407-eec87e925760\") " pod="openshift-cluster-node-tuning-operator/tuned-ctzzp"
Jul 21 17:08:30.026562 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:30.025489    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/2601f86a-f327-4d78-9407-eec87e925760-etc-tuned\") pod \"tuned-ctzzp\" (UID: \"2601f86a-f327-4d78-9407-eec87e925760\") " pod="openshift-cluster-node-tuning-operator/tuned-ctzzp"
Jul 21 17:08:30.026562 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:30.025526    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/9425e519-d00c-4af6-a68a-3efde7aae5ba-node-log\") pod \"ovnkube-node-b64gx\" (UID: \"9425e519-d00c-4af6-a68a-3efde7aae5ba\") " pod="openshift-ovn-kubernetes/ovnkube-node-b64gx"
Jul 21 17:08:30.026562 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:30.025552    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/0af1b5ce-5a4d-4cc2-a9ef-ac31ed1f07ca-cnibin\") pod \"multus-additional-cni-plugins-jmsnn\" (UID: \"0af1b5ce-5a4d-4cc2-a9ef-ac31ed1f07ca\") " pod="openshift-multus/multus-additional-cni-plugins-jmsnn"
Jul 21 17:08:30.026562 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:30.025682    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/0af1b5ce-5a4d-4cc2-a9ef-ac31ed1f07ca-os-release\") pod \"multus-additional-cni-plugins-jmsnn\" (UID: \"0af1b5ce-5a4d-4cc2-a9ef-ac31ed1f07ca\") " pod="openshift-multus/multus-additional-cni-plugins-jmsnn"
Jul 21 17:08:30.026562 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:30.025713    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0db4134e-c6f4-4665-9268-90a3569ccb73-host-var-lib-kubelet\") pod \"multus-wzxwp\" (UID: \"0db4134e-c6f4-4665-9268-90a3569ccb73\") " pod="openshift-multus/multus-wzxwp"
Jul 21 17:08:30.026562 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:30.025742    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/2601f86a-f327-4d78-9407-eec87e925760-etc-sysconfig\") pod \"tuned-ctzzp\" (UID: \"2601f86a-f327-4d78-9407-eec87e925760\") " pod="openshift-cluster-node-tuning-operator/tuned-ctzzp"
Jul 21 17:08:30.026562 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:30.025767    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2j9r8\" (UniqueName: \"kubernetes.io/projected/2601f86a-f327-4d78-9407-eec87e925760-kube-api-access-2j9r8\") pod \"tuned-ctzzp\" (UID: \"2601f86a-f327-4d78-9407-eec87e925760\") " pod="openshift-cluster-node-tuning-operator/tuned-ctzzp"
Jul 21 17:08:30.026562 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:30.025792    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/c3efc748-d974-40f3-9d1a-031114d77366-kubelet-dir\") pod \"aws-ebs-csi-driver-node-g8b28\" (UID: \"c3efc748-d974-40f3-9d1a-031114d77366\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g8b28"
Jul 21 17:08:30.026562 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:30.025816    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/9425e519-d00c-4af6-a68a-3efde7aae5ba-host-kubelet\") pod \"ovnkube-node-b64gx\" (UID: \"9425e519-d00c-4af6-a68a-3efde7aae5ba\") " pod="openshift-ovn-kubernetes/ovnkube-node-b64gx"
Jul 21 17:08:30.026562 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:30.025839    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/9425e519-d00c-4af6-a68a-3efde7aae5ba-host-cni-netd\") pod \"ovnkube-node-b64gx\" (UID: \"9425e519-d00c-4af6-a68a-3efde7aae5ba\") " pod="openshift-ovn-kubernetes/ovnkube-node-b64gx"
Jul 21 17:08:30.026562 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:30.025863    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/2601f86a-f327-4d78-9407-eec87e925760-etc-modprobe-d\") pod \"tuned-ctzzp\" (UID: \"2601f86a-f327-4d78-9407-eec87e925760\") " pod="openshift-cluster-node-tuning-operator/tuned-ctzzp"
Jul 21 17:08:30.026562 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:30.025886    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/7533c67e-e7ed-4836-8a8b-a670200cccba-hosts-file\") pod \"node-resolver-qmbvr\" (UID: \"7533c67e-e7ed-4836-8a8b-a670200cccba\") " pod="openshift-dns/node-resolver-qmbvr"
Jul 21 17:08:30.026562 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:30.025909    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/9425e519-d00c-4af6-a68a-3efde7aae5ba-host-run-netns\") pod \"ovnkube-node-b64gx\" (UID: \"9425e519-d00c-4af6-a68a-3efde7aae5ba\") " pod="openshift-ovn-kubernetes/ovnkube-node-b64gx"
Jul 21 17:08:30.026562 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:30.025934    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9425e519-d00c-4af6-a68a-3efde7aae5ba-etc-openvswitch\") pod \"ovnkube-node-b64gx\" (UID: \"9425e519-d00c-4af6-a68a-3efde7aae5ba\") " pod="openshift-ovn-kubernetes/ovnkube-node-b64gx"
Jul 21 17:08:30.026562 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:30.025958    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/9425e519-d00c-4af6-a68a-3efde7aae5ba-ovn-node-metrics-cert\") pod \"ovnkube-node-b64gx\" (UID: \"9425e519-d00c-4af6-a68a-3efde7aae5ba\") " pod="openshift-ovn-kubernetes/ovnkube-node-b64gx"
Jul 21 17:08:30.026562 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:30.025985    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/0af1b5ce-5a4d-4cc2-a9ef-ac31ed1f07ca-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-jmsnn\" (UID: \"0af1b5ce-5a4d-4cc2-a9ef-ac31ed1f07ca\") " pod="openshift-multus/multus-additional-cni-plugins-jmsnn"
Jul 21 17:08:30.027271 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:30.026012    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-plkdx\" (UniqueName: \"kubernetes.io/projected/1f68ab07-c91d-4a29-8b72-cc76e3dd2753-kube-api-access-plkdx\") pod \"network-check-target-x4gm9\" (UID: \"1f68ab07-c91d-4a29-8b72-cc76e3dd2753\") " pod="openshift-network-diagnostics/network-check-target-x4gm9"
Jul 21 17:08:30.027271 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:30.026041    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2601f86a-f327-4d78-9407-eec87e925760-tmp\") pod \"tuned-ctzzp\" (UID: \"2601f86a-f327-4d78-9407-eec87e925760\") " pod="openshift-cluster-node-tuning-operator/tuned-ctzzp"
Jul 21 17:08:30.027271 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:30.026066    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/c3efc748-d974-40f3-9d1a-031114d77366-sys-fs\") pod \"aws-ebs-csi-driver-node-g8b28\" (UID: \"c3efc748-d974-40f3-9d1a-031114d77366\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g8b28"
Jul 21 17:08:30.027271 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:30.026090    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9425e519-d00c-4af6-a68a-3efde7aae5ba-run-openvswitch\") pod \"ovnkube-node-b64gx\" (UID: \"9425e519-d00c-4af6-a68a-3efde7aae5ba\") " pod="openshift-ovn-kubernetes/ovnkube-node-b64gx"
Jul 21 17:08:30.027271 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:30.026114    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/9425e519-d00c-4af6-a68a-3efde7aae5ba-env-overrides\") pod \"ovnkube-node-b64gx\" (UID: \"9425e519-d00c-4af6-a68a-3efde7aae5ba\") " pod="openshift-ovn-kubernetes/ovnkube-node-b64gx"
Jul 21 17:08:30.027271 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:30.026143    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/7900e00a-7d30-4941-a177-1ce9da22deb3-kubelet-config\") pod \"global-pull-secret-syncer-44fbg\" (UID: \"7900e00a-7d30-4941-a177-1ce9da22deb3\") " pod="kube-system/global-pull-secret-syncer-44fbg"
Jul 21 17:08:30.027271 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:30.026169    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7900e00a-7d30-4941-a177-1ce9da22deb3-original-pull-secret\") pod \"global-pull-secret-syncer-44fbg\" (UID: \"7900e00a-7d30-4941-a177-1ce9da22deb3\") " pod="kube-system/global-pull-secret-syncer-44fbg"
Jul 21 17:08:30.027271 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:30.026193    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/0db4134e-c6f4-4665-9268-90a3569ccb73-host-run-netns\") pod \"multus-wzxwp\" (UID: \"0db4134e-c6f4-4665-9268-90a3569ccb73\") " pod="openshift-multus/multus-wzxwp"
Jul 21 17:08:30.027271 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:30.026216    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/0db4134e-c6f4-4665-9268-90a3569ccb73-host-var-lib-cni-multus\") pod \"multus-wzxwp\" (UID: \"0db4134e-c6f4-4665-9268-90a3569ccb73\") " pod="openshift-multus/multus-wzxwp"
Jul 21 17:08:30.027271 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:30.026245    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/0af1b5ce-5a4d-4cc2-a9ef-ac31ed1f07ca-tuning-conf-dir\") pod \"multus-additional-cni-plugins-jmsnn\" (UID: \"0af1b5ce-5a4d-4cc2-a9ef-ac31ed1f07ca\") " pod="openshift-multus/multus-additional-cni-plugins-jmsnn"
Jul 21 17:08:30.027271 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:30.026270    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/0db4134e-c6f4-4665-9268-90a3569ccb73-os-release\") pod \"multus-wzxwp\" (UID: \"0db4134e-c6f4-4665-9268-90a3569ccb73\") " pod="openshift-multus/multus-wzxwp"
Jul 21 17:08:30.027271 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:30.026296    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5wdcp\" (UniqueName: \"kubernetes.io/projected/0db4134e-c6f4-4665-9268-90a3569ccb73-kube-api-access-5wdcp\") pod \"multus-wzxwp\" (UID: \"0db4134e-c6f4-4665-9268-90a3569ccb73\") " pod="openshift-multus/multus-wzxwp"
Jul 21 17:08:30.027271 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:30.026323    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/c3efc748-d974-40f3-9d1a-031114d77366-socket-dir\") pod \"aws-ebs-csi-driver-node-g8b28\" (UID: \"c3efc748-d974-40f3-9d1a-031114d77366\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g8b28"
Jul 21 17:08:30.027271 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:30.026350    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/9425e519-d00c-4af6-a68a-3efde7aae5ba-ovnkube-script-lib\") pod \"ovnkube-node-b64gx\" (UID: \"9425e519-d00c-4af6-a68a-3efde7aae5ba\") " pod="openshift-ovn-kubernetes/ovnkube-node-b64gx"
Jul 21 17:08:30.027271 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:30.026378    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2601f86a-f327-4d78-9407-eec87e925760-var-lib-kubelet\") pod \"tuned-ctzzp\" (UID: \"2601f86a-f327-4d78-9407-eec87e925760\") " pod="openshift-cluster-node-tuning-operator/tuned-ctzzp"
Jul 21 17:08:30.027271 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:30.026613    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7533c67e-e7ed-4836-8a8b-a670200cccba-tmp-dir\") pod \"node-resolver-qmbvr\" (UID: \"7533c67e-e7ed-4836-8a8b-a670200cccba\") " pod="openshift-dns/node-resolver-qmbvr"
Jul 21 17:08:30.027271 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:30.026644    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vhwvv\" (UniqueName: \"kubernetes.io/projected/c3efc748-d974-40f3-9d1a-031114d77366-kube-api-access-vhwvv\") pod \"aws-ebs-csi-driver-node-g8b28\" (UID: \"c3efc748-d974-40f3-9d1a-031114d77366\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g8b28"
Jul 21 17:08:30.027973 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:30.026674    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0af1b5ce-5a4d-4cc2-a9ef-ac31ed1f07ca-system-cni-dir\") pod \"multus-additional-cni-plugins-jmsnn\" (UID: \"0af1b5ce-5a4d-4cc2-a9ef-ac31ed1f07ca\") " pod="openshift-multus/multus-additional-cni-plugins-jmsnn"
Jul 21 17:08:30.027973 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:30.026704    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/0af1b5ce-5a4d-4cc2-a9ef-ac31ed1f07ca-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-jmsnn\" (UID: \"0af1b5ce-5a4d-4cc2-a9ef-ac31ed1f07ca\") " pod="openshift-multus/multus-additional-cni-plugins-jmsnn"
Jul 21 17:08:30.027973 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:30.026732    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0db4134e-c6f4-4665-9268-90a3569ccb73-multus-cni-dir\") pod \"multus-wzxwp\" (UID: \"0db4134e-c6f4-4665-9268-90a3569ccb73\") " pod="openshift-multus/multus-wzxwp"
Jul 21 17:08:30.027973 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:30.026755    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/2601f86a-f327-4d78-9407-eec87e925760-run\") pod \"tuned-ctzzp\" (UID: \"2601f86a-f327-4d78-9407-eec87e925760\") " pod="openshift-cluster-node-tuning-operator/tuned-ctzzp"
Jul 21 17:08:30.027973 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:30.026782    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/cb1081a1-16da-4e6f-b099-62ae771c79c1-host-slash\") pod \"iptables-alerter-wgb8q\" (UID: \"cb1081a1-16da-4e6f-b099-62ae771c79c1\") " pod="openshift-network-operator/iptables-alerter-wgb8q"
Jul 21 17:08:30.027973 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:30.026857    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/0af1b5ce-5a4d-4cc2-a9ef-ac31ed1f07ca-cnibin\") pod \"multus-additional-cni-plugins-jmsnn\" (UID: \"0af1b5ce-5a4d-4cc2-a9ef-ac31ed1f07ca\") " pod="openshift-multus/multus-additional-cni-plugins-jmsnn"
Jul 21 17:08:30.027973 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:30.026893    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/0db4134e-c6f4-4665-9268-90a3569ccb73-hostroot\") pod \"multus-wzxwp\" (UID: \"0db4134e-c6f4-4665-9268-90a3569ccb73\") " pod="openshift-multus/multus-wzxwp"
Jul 21 17:08:30.027973 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:30.026928    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/0db4134e-c6f4-4665-9268-90a3569ccb73-host-var-lib-cni-bin\") pod \"multus-wzxwp\" (UID: \"0db4134e-c6f4-4665-9268-90a3569ccb73\") " pod="openshift-multus/multus-wzxwp"
Jul 21 17:08:30.027973 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:30.027495    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/0db4134e-c6f4-4665-9268-90a3569ccb73-multus-daemon-config\") pod \"multus-wzxwp\" (UID: \"0db4134e-c6f4-4665-9268-90a3569ccb73\") " pod="openshift-multus/multus-wzxwp"
Jul 21 17:08:30.027973 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:30.027656    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/7900e00a-7d30-4941-a177-1ce9da22deb3-dbus\") pod \"global-pull-secret-syncer-44fbg\" (UID: \"7900e00a-7d30-4941-a177-1ce9da22deb3\") " pod="kube-system/global-pull-secret-syncer-44fbg"
Jul 21 17:08:30.029899 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:30.028493    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/0db4134e-c6f4-4665-9268-90a3569ccb73-cni-binary-copy\") pod \"multus-wzxwp\" (UID: \"0db4134e-c6f4-4665-9268-90a3569ccb73\") " pod="openshift-multus/multus-wzxwp"
Jul 21 17:08:30.029899 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:30.028954    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/0af1b5ce-5a4d-4cc2-a9ef-ac31ed1f07ca-cni-binary-copy\") pod \"multus-additional-cni-plugins-jmsnn\" (UID: \"0af1b5ce-5a4d-4cc2-a9ef-ac31ed1f07ca\") " pod="openshift-multus/multus-additional-cni-plugins-jmsnn"
Jul 21 17:08:30.029899 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:30.029010    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/0db4134e-c6f4-4665-9268-90a3569ccb73-cnibin\") pod \"multus-wzxwp\" (UID: \"0db4134e-c6f4-4665-9268-90a3569ccb73\") " pod="openshift-multus/multus-wzxwp"
Jul 21 17:08:30.029899 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:30.029082    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/0af1b5ce-5a4d-4cc2-a9ef-ac31ed1f07ca-os-release\") pod \"multus-additional-cni-plugins-jmsnn\" (UID: \"0af1b5ce-5a4d-4cc2-a9ef-ac31ed1f07ca\") " pod="openshift-multus/multus-additional-cni-plugins-jmsnn"
Jul 21 17:08:30.029899 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:30.029119    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0db4134e-c6f4-4665-9268-90a3569ccb73-host-var-lib-kubelet\") pod \"multus-wzxwp\" (UID: \"0db4134e-c6f4-4665-9268-90a3569ccb73\") " pod="openshift-multus/multus-wzxwp"
Jul 21 17:08:30.029899 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:30.029465    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/0af1b5ce-5a4d-4cc2-a9ef-ac31ed1f07ca-tuning-conf-dir\") pod \"multus-additional-cni-plugins-jmsnn\" (UID: \"0af1b5ce-5a4d-4cc2-a9ef-ac31ed1f07ca\") " pod="openshift-multus/multus-additional-cni-plugins-jmsnn"
Jul 21 17:08:30.029899 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:30.029572    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/0af1b5ce-5a4d-4cc2-a9ef-ac31ed1f07ca-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-jmsnn\" (UID: \"0af1b5ce-5a4d-4cc2-a9ef-ac31ed1f07ca\") " pod="openshift-multus/multus-additional-cni-plugins-jmsnn"
Jul 21 17:08:30.029899 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:30.029636    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/0db4134e-c6f4-4665-9268-90a3569ccb73-os-release\") pod \"multus-wzxwp\" (UID: \"0db4134e-c6f4-4665-9268-90a3569ccb73\") " pod="openshift-multus/multus-wzxwp"
Jul 21 17:08:30.029899 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:30.029729    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/7900e00a-7d30-4941-a177-1ce9da22deb3-kubelet-config\") pod \"global-pull-secret-syncer-44fbg\" (UID: \"7900e00a-7d30-4941-a177-1ce9da22deb3\") " pod="kube-system/global-pull-secret-syncer-44fbg"
Jul 21 17:08:30.029899 ip-10-0-141-39 kubenswrapper[2575]: E0721 17:08:30.029784    2575 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 21 17:08:30.029899 ip-10-0-141-39 kubenswrapper[2575]: E0721 17:08:30.029834    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7900e00a-7d30-4941-a177-1ce9da22deb3-original-pull-secret podName:7900e00a-7d30-4941-a177-1ce9da22deb3 nodeName:}" failed. No retries permitted until 2026-07-21 17:08:30.529817542 +0000 UTC m=+2.983970182 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/7900e00a-7d30-4941-a177-1ce9da22deb3-original-pull-secret") pod "global-pull-secret-syncer-44fbg" (UID: "7900e00a-7d30-4941-a177-1ce9da22deb3") : object "kube-system"/"original-pull-secret" not registered
Jul 21 17:08:30.029899 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:30.029875    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0af1b5ce-5a4d-4cc2-a9ef-ac31ed1f07ca-system-cni-dir\") pod \"multus-additional-cni-plugins-jmsnn\" (UID: \"0af1b5ce-5a4d-4cc2-a9ef-ac31ed1f07ca\") " pod="openshift-multus/multus-additional-cni-plugins-jmsnn"
Jul 21 17:08:30.030525 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:30.029917    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/0db4134e-c6f4-4665-9268-90a3569ccb73-host-run-netns\") pod \"multus-wzxwp\" (UID: \"0db4134e-c6f4-4665-9268-90a3569ccb73\") " pod="openshift-multus/multus-wzxwp"
Jul 21 17:08:30.030525 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:30.029956    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/0db4134e-c6f4-4665-9268-90a3569ccb73-host-var-lib-cni-multus\") pod \"multus-wzxwp\" (UID: \"0db4134e-c6f4-4665-9268-90a3569ccb73\") " pod="openshift-multus/multus-wzxwp"
Jul 21 17:08:30.030525 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:30.030018    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0db4134e-c6f4-4665-9268-90a3569ccb73-multus-cni-dir\") pod \"multus-wzxwp\" (UID: \"0db4134e-c6f4-4665-9268-90a3569ccb73\") " pod="openshift-multus/multus-wzxwp"
Jul 21 17:08:30.030525 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:30.030450    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/0af1b5ce-5a4d-4cc2-a9ef-ac31ed1f07ca-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-jmsnn\" (UID: \"0af1b5ce-5a4d-4cc2-a9ef-ac31ed1f07ca\") " pod="openshift-multus/multus-additional-cni-plugins-jmsnn"
Jul 21 17:08:30.036551 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:30.036510    2575 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jul 21 17:08:30.037063 ip-10-0-141-39 kubenswrapper[2575]: E0721 17:08:30.036800    2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 21 17:08:30.037063 ip-10-0-141-39 kubenswrapper[2575]: E0721 17:08:30.036828    2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 21 17:08:30.037063 ip-10-0-141-39 kubenswrapper[2575]: E0721 17:08:30.036841    2575 projected.go:196] Error preparing data for projected volume kube-api-access-plkdx for pod openshift-network-diagnostics/network-check-target-x4gm9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 21 17:08:30.037063 ip-10-0-141-39 kubenswrapper[2575]: E0721 17:08:30.036901    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1f68ab07-c91d-4a29-8b72-cc76e3dd2753-kube-api-access-plkdx podName:1f68ab07-c91d-4a29-8b72-cc76e3dd2753 nodeName:}" failed. No retries permitted until 2026-07-21 17:08:30.536885197 +0000 UTC m=+2.991037821 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-plkdx" (UniqueName: "kubernetes.io/projected/1f68ab07-c91d-4a29-8b72-cc76e3dd2753-kube-api-access-plkdx") pod "network-check-target-x4gm9" (UID: "1f68ab07-c91d-4a29-8b72-cc76e3dd2753") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 21 17:08:30.040881 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:30.040744    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mfh2p\" (UniqueName: \"kubernetes.io/projected/0af1b5ce-5a4d-4cc2-a9ef-ac31ed1f07ca-kube-api-access-mfh2p\") pod \"multus-additional-cni-plugins-jmsnn\" (UID: \"0af1b5ce-5a4d-4cc2-a9ef-ac31ed1f07ca\") " pod="openshift-multus/multus-additional-cni-plugins-jmsnn"
Jul 21 17:08:30.040881 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:30.040780    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6qzqn\" (UniqueName: \"kubernetes.io/projected/75e3f13b-b4dd-479c-b305-420ec10c39d7-kube-api-access-6qzqn\") pod \"network-metrics-daemon-n98c6\" (UID: \"75e3f13b-b4dd-479c-b305-420ec10c39d7\") " pod="openshift-multus/network-metrics-daemon-n98c6"
Jul 21 17:08:30.040881 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:30.040745    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5wdcp\" (UniqueName: \"kubernetes.io/projected/0db4134e-c6f4-4665-9268-90a3569ccb73-kube-api-access-5wdcp\") pod \"multus-wzxwp\" (UID: \"0db4134e-c6f4-4665-9268-90a3569ccb73\") " pod="openshift-multus/multus-wzxwp"
Jul 21 17:08:30.116863 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:30.116798    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-39.ec2.internal" event={"ID":"35d9bf4db485a74e935a67bfd9e0bd65","Type":"ContainerStarted","Data":"28e9208be09a47f09dd2153fc9a206261b0b959d8ce1e6f8203973240a276770"}
Jul 21 17:08:30.121372 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:30.121344    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-39.ec2.internal" event={"ID":"a733d0df94ea33efc59cd1a4c70b79bd","Type":"ContainerStarted","Data":"8931971117cb57a29612165d33c3e008bf0015c50e6ee37a7cd49188b17d4c94"}
Jul 21 17:08:30.127228 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:30.127198    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9p9mx\" (UniqueName: \"kubernetes.io/projected/72cdbb9c-0664-46c0-ab7c-4f38ebd7644f-kube-api-access-9p9mx\") pod \"node-ca-d7gn6\" (UID: \"72cdbb9c-0664-46c0-ab7c-4f38ebd7644f\") " pod="openshift-image-registry/node-ca-d7gn6"
Jul 21 17:08:30.127369 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:30.127238    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/c3efc748-d974-40f3-9d1a-031114d77366-registration-dir\") pod \"aws-ebs-csi-driver-node-g8b28\" (UID: \"c3efc748-d974-40f3-9d1a-031114d77366\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g8b28"
Jul 21 17:08:30.127369 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:30.127264    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9425e519-d00c-4af6-a68a-3efde7aae5ba-host-run-ovn-kubernetes\") pod \"ovnkube-node-b64gx\" (UID: \"9425e519-d00c-4af6-a68a-3efde7aae5ba\") " pod="openshift-ovn-kubernetes/ovnkube-node-b64gx"
Jul 21 17:08:30.127369 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:30.127292    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9425e519-d00c-4af6-a68a-3efde7aae5ba-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-b64gx\" (UID: \"9425e519-d00c-4af6-a68a-3efde7aae5ba\") " pod="openshift-ovn-kubernetes/ovnkube-node-b64gx"
Jul 21 17:08:30.127369 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:30.127319    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/72cdbb9c-0664-46c0-ab7c-4f38ebd7644f-host\") pod \"node-ca-d7gn6\" (UID: \"72cdbb9c-0664-46c0-ab7c-4f38ebd7644f\") " pod="openshift-image-registry/node-ca-d7gn6"
Jul 21 17:08:30.127369 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:30.127333    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/c3efc748-d974-40f3-9d1a-031114d77366-registration-dir\") pod \"aws-ebs-csi-driver-node-g8b28\" (UID: \"c3efc748-d974-40f3-9d1a-031114d77366\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g8b28"
Jul 21 17:08:30.127369 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:30.127345    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/dacfd9ac-9516-4da2-ab9c-2629e4e6174e-agent-certs\") pod \"konnectivity-agent-hbwdq\" (UID: \"dacfd9ac-9516-4da2-ab9c-2629e4e6174e\") " pod="kube-system/konnectivity-agent-hbwdq"
Jul 21 17:08:30.127369 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:30.127365    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2601f86a-f327-4d78-9407-eec87e925760-etc-kubernetes\") pod \"tuned-ctzzp\" (UID: \"2601f86a-f327-4d78-9407-eec87e925760\") " pod="openshift-cluster-node-tuning-operator/tuned-ctzzp"
Jul 21 17:08:30.127761 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:30.127388    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/c3efc748-d974-40f3-9d1a-031114d77366-device-dir\") pod \"aws-ebs-csi-driver-node-g8b28\" (UID: \"c3efc748-d974-40f3-9d1a-031114d77366\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g8b28"
Jul 21 17:08:30.127761 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:30.127390    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9425e519-d00c-4af6-a68a-3efde7aae5ba-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-b64gx\" (UID: \"9425e519-d00c-4af6-a68a-3efde7aae5ba\") " pod="openshift-ovn-kubernetes/ovnkube-node-b64gx"
Jul 21 17:08:30.127761 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:30.127431    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/9425e519-d00c-4af6-a68a-3efde7aae5ba-host-slash\") pod \"ovnkube-node-b64gx\" (UID: \"9425e519-d00c-4af6-a68a-3efde7aae5ba\") " pod="openshift-ovn-kubernetes/ovnkube-node-b64gx"
Jul 21 17:08:30.127761 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:30.127452    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9425e519-d00c-4af6-a68a-3efde7aae5ba-var-lib-openvswitch\") pod \"ovnkube-node-b64gx\" (UID: \"9425e519-d00c-4af6-a68a-3efde7aae5ba\") " pod="openshift-ovn-kubernetes/ovnkube-node-b64gx"
Jul 21 17:08:30.127761 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:30.127452    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9425e519-d00c-4af6-a68a-3efde7aae5ba-host-run-ovn-kubernetes\") pod \"ovnkube-node-b64gx\" (UID: \"9425e519-d00c-4af6-a68a-3efde7aae5ba\") " pod="openshift-ovn-kubernetes/ovnkube-node-b64gx"
Jul 21 17:08:30.127761 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:30.127466    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/9425e519-d00c-4af6-a68a-3efde7aae5ba-ovnkube-config\") pod \"ovnkube-node-b64gx\" (UID: \"9425e519-d00c-4af6-a68a-3efde7aae5ba\") " pod="openshift-ovn-kubernetes/ovnkube-node-b64gx"
Jul 21 17:08:30.127761 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:30.127485    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/2601f86a-f327-4d78-9407-eec87e925760-etc-systemd\") pod \"tuned-ctzzp\" (UID: \"2601f86a-f327-4d78-9407-eec87e925760\") " pod="openshift-cluster-node-tuning-operator/tuned-ctzzp"
Jul 21 17:08:30.127761 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:30.127499    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/cb1081a1-16da-4e6f-b099-62ae771c79c1-iptables-alerter-script\") pod \"iptables-alerter-wgb8q\" (UID: \"cb1081a1-16da-4e6f-b099-62ae771c79c1\") " pod="openshift-network-operator/iptables-alerter-wgb8q"
Jul 21 17:08:30.127761 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:30.127505    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/c3efc748-d974-40f3-9d1a-031114d77366-device-dir\") pod \"aws-ebs-csi-driver-node-g8b28\" (UID: \"c3efc748-d974-40f3-9d1a-031114d77366\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g8b28"
Jul 21 17:08:30.127761 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:30.127514    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/c3efc748-d974-40f3-9d1a-031114d77366-etc-selinux\") pod \"aws-ebs-csi-driver-node-g8b28\" (UID: \"c3efc748-d974-40f3-9d1a-031114d77366\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g8b28"
Jul 21 17:08:30.127761 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:30.127532    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/9425e519-d00c-4af6-a68a-3efde7aae5ba-systemd-units\") pod \"ovnkube-node-b64gx\" (UID: \"9425e519-d00c-4af6-a68a-3efde7aae5ba\") " pod="openshift-ovn-kubernetes/ovnkube-node-b64gx"
Jul 21 17:08:30.127761 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:30.127555    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2601f86a-f327-4d78-9407-eec87e925760-etc-kubernetes\") pod \"tuned-ctzzp\" (UID: \"2601f86a-f327-4d78-9407-eec87e925760\") " pod="openshift-cluster-node-tuning-operator/tuned-ctzzp"
Jul 21 17:08:30.127761 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:30.127562    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8gpht\" (UniqueName: \"kubernetes.io/projected/9425e519-d00c-4af6-a68a-3efde7aae5ba-kube-api-access-8gpht\") pod \"ovnkube-node-b64gx\" (UID: \"9425e519-d00c-4af6-a68a-3efde7aae5ba\") " pod="openshift-ovn-kubernetes/ovnkube-node-b64gx"
Jul 21 17:08:30.127761 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:30.127586    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/2601f86a-f327-4d78-9407-eec87e925760-etc-sysctl-d\") pod \"tuned-ctzzp\" (UID: \"2601f86a-f327-4d78-9407-eec87e925760\") " pod="openshift-cluster-node-tuning-operator/tuned-ctzzp"
Jul 21 17:08:30.127761 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:30.127592    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/72cdbb9c-0664-46c0-ab7c-4f38ebd7644f-host\") pod \"node-ca-d7gn6\" (UID: \"72cdbb9c-0664-46c0-ab7c-4f38ebd7644f\") " pod="openshift-image-registry/node-ca-d7gn6"
Jul 21 17:08:30.127761 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:30.127609    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2601f86a-f327-4d78-9407-eec87e925760-sys\") pod \"tuned-ctzzp\" (UID: \"2601f86a-f327-4d78-9407-eec87e925760\") " pod="openshift-cluster-node-tuning-operator/tuned-ctzzp"
Jul 21 17:08:30.127761 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:30.127632    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/9425e519-d00c-4af6-a68a-3efde7aae5ba-run-ovn\") pod \"ovnkube-node-b64gx\" (UID: \"9425e519-d00c-4af6-a68a-3efde7aae5ba\") " pod="openshift-ovn-kubernetes/ovnkube-node-b64gx"
Jul 21 17:08:30.128532 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:30.127637    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/2601f86a-f327-4d78-9407-eec87e925760-etc-systemd\") pod \"tuned-ctzzp\" (UID: \"2601f86a-f327-4d78-9407-eec87e925760\") " pod="openshift-cluster-node-tuning-operator/tuned-ctzzp"
Jul 21 17:08:30.128532 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:30.127655    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/9425e519-d00c-4af6-a68a-3efde7aae5ba-host-cni-bin\") pod \"ovnkube-node-b64gx\" (UID: \"9425e519-d00c-4af6-a68a-3efde7aae5ba\") " pod="openshift-ovn-kubernetes/ovnkube-node-b64gx"
Jul 21 17:08:30.128532 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:30.127674    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/9425e519-d00c-4af6-a68a-3efde7aae5ba-host-slash\") pod \"ovnkube-node-b64gx\" (UID: \"9425e519-d00c-4af6-a68a-3efde7aae5ba\") " pod="openshift-ovn-kubernetes/ovnkube-node-b64gx"
Jul 21 17:08:30.128532 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:30.127680    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/dacfd9ac-9516-4da2-ab9c-2629e4e6174e-konnectivity-ca\") pod \"konnectivity-agent-hbwdq\" (UID: \"dacfd9ac-9516-4da2-ab9c-2629e4e6174e\") " pod="kube-system/konnectivity-agent-hbwdq"
Jul 21 17:08:30.128532 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:30.127724    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9425e519-d00c-4af6-a68a-3efde7aae5ba-var-lib-openvswitch\") pod \"ovnkube-node-b64gx\" (UID: \"9425e519-d00c-4af6-a68a-3efde7aae5ba\") " pod="openshift-ovn-kubernetes/ovnkube-node-b64gx"
Jul 21 17:08:30.128532 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:30.127962    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/2601f86a-f327-4d78-9407-eec87e925760-etc-sysctl-d\") pod \"tuned-ctzzp\" (UID: \"2601f86a-f327-4d78-9407-eec87e925760\") " pod="openshift-cluster-node-tuning-operator/tuned-ctzzp"
Jul 21 17:08:30.128532 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:30.128261    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/dacfd9ac-9516-4da2-ab9c-2629e4e6174e-konnectivity-ca\") pod \"konnectivity-agent-hbwdq\" (UID: \"dacfd9ac-9516-4da2-ab9c-2629e4e6174e\") " pod="kube-system/konnectivity-agent-hbwdq"
Jul 21 17:08:30.128532 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:30.128273    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/9425e519-d00c-4af6-a68a-3efde7aae5ba-ovnkube-config\") pod \"ovnkube-node-b64gx\" (UID: \"9425e519-d00c-4af6-a68a-3efde7aae5ba\") " pod="openshift-ovn-kubernetes/ovnkube-node-b64gx"
Jul 21 17:08:30.128532 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:30.128309    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/2601f86a-f327-4d78-9407-eec87e925760-etc-sysctl-conf\") pod \"tuned-ctzzp\" (UID: \"2601f86a-f327-4d78-9407-eec87e925760\") " pod="openshift-cluster-node-tuning-operator/tuned-ctzzp"
Jul 21 17:08:30.128532 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:30.128334    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/2601f86a-f327-4d78-9407-eec87e925760-lib-modules\") pod \"tuned-ctzzp\" (UID: \"2601f86a-f327-4d78-9407-eec87e925760\") " pod="openshift-cluster-node-tuning-operator/tuned-ctzzp"
Jul 21 17:08:30.128532 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:30.128360    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/2601f86a-f327-4d78-9407-eec87e925760-host\") pod \"tuned-ctzzp\" (UID: \"2601f86a-f327-4d78-9407-eec87e925760\") " pod="openshift-cluster-node-tuning-operator/tuned-ctzzp"
Jul 21 17:08:30.128532 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:30.128368    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/9425e519-d00c-4af6-a68a-3efde7aae5ba-systemd-units\") pod \"ovnkube-node-b64gx\" (UID: \"9425e519-d00c-4af6-a68a-3efde7aae5ba\") " pod="openshift-ovn-kubernetes/ovnkube-node-b64gx"
Jul 21 17:08:30.128532 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:30.128382    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/2601f86a-f327-4d78-9407-eec87e925760-etc-tuned\") pod \"tuned-ctzzp\" (UID: \"2601f86a-f327-4d78-9407-eec87e925760\") " pod="openshift-cluster-node-tuning-operator/tuned-ctzzp"
Jul 21 17:08:30.128532 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:30.128405    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/9425e519-d00c-4af6-a68a-3efde7aae5ba-node-log\") pod \"ovnkube-node-b64gx\" (UID: \"9425e519-d00c-4af6-a68a-3efde7aae5ba\") " pod="openshift-ovn-kubernetes/ovnkube-node-b64gx"
Jul 21 17:08:30.128532 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:30.128453    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/2601f86a-f327-4d78-9407-eec87e925760-etc-sysconfig\") pod \"tuned-ctzzp\" (UID: \"2601f86a-f327-4d78-9407-eec87e925760\") " pod="openshift-cluster-node-tuning-operator/tuned-ctzzp"
Jul 21 17:08:30.128532 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:30.128479    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2j9r8\" (UniqueName: \"kubernetes.io/projected/2601f86a-f327-4d78-9407-eec87e925760-kube-api-access-2j9r8\") pod \"tuned-ctzzp\" (UID: \"2601f86a-f327-4d78-9407-eec87e925760\") " pod="openshift-cluster-node-tuning-operator/tuned-ctzzp"
Jul 21 17:08:30.128532 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:30.128504    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/c3efc748-d974-40f3-9d1a-031114d77366-kubelet-dir\") pod \"aws-ebs-csi-driver-node-g8b28\" (UID: \"c3efc748-d974-40f3-9d1a-031114d77366\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g8b28"
Jul 21 17:08:30.128532 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:30.128530    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/9425e519-d00c-4af6-a68a-3efde7aae5ba-host-kubelet\") pod \"ovnkube-node-b64gx\" (UID: \"9425e519-d00c-4af6-a68a-3efde7aae5ba\") " pod="openshift-ovn-kubernetes/ovnkube-node-b64gx"
Jul 21 17:08:30.129516 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:30.128556    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/9425e519-d00c-4af6-a68a-3efde7aae5ba-host-cni-netd\") pod \"ovnkube-node-b64gx\" (UID: \"9425e519-d00c-4af6-a68a-3efde7aae5ba\") " pod="openshift-ovn-kubernetes/ovnkube-node-b64gx"
Jul 21 17:08:30.129516 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:30.128568    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/cb1081a1-16da-4e6f-b099-62ae771c79c1-iptables-alerter-script\") pod \"iptables-alerter-wgb8q\" (UID: \"cb1081a1-16da-4e6f-b099-62ae771c79c1\") " pod="openshift-network-operator/iptables-alerter-wgb8q"
Jul 21 17:08:30.129516 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:30.128580    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/2601f86a-f327-4d78-9407-eec87e925760-etc-modprobe-d\") pod \"tuned-ctzzp\" (UID: \"2601f86a-f327-4d78-9407-eec87e925760\") " pod="openshift-cluster-node-tuning-operator/tuned-ctzzp"
Jul 21 17:08:30.129516 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:30.128585    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2601f86a-f327-4d78-9407-eec87e925760-sys\") pod \"tuned-ctzzp\" (UID: \"2601f86a-f327-4d78-9407-eec87e925760\") " pod="openshift-cluster-node-tuning-operator/tuned-ctzzp"
Jul 21 17:08:30.129516 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:30.128600    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/7533c67e-e7ed-4836-8a8b-a670200cccba-hosts-file\") pod \"node-resolver-qmbvr\" (UID: \"7533c67e-e7ed-4836-8a8b-a670200cccba\") " pod="openshift-dns/node-resolver-qmbvr"
Jul 21 17:08:30.129516 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:30.128531    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/c3efc748-d974-40f3-9d1a-031114d77366-etc-selinux\") pod \"aws-ebs-csi-driver-node-g8b28\" (UID: \"c3efc748-d974-40f3-9d1a-031114d77366\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g8b28"
Jul 21 17:08:30.129516 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:30.128633    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/c3efc748-d974-40f3-9d1a-031114d77366-kubelet-dir\") pod \"aws-ebs-csi-driver-node-g8b28\" (UID: \"c3efc748-d974-40f3-9d1a-031114d77366\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g8b28"
Jul 21 17:08:30.129516 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:30.128683    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/9425e519-d00c-4af6-a68a-3efde7aae5ba-run-ovn\") pod \"ovnkube-node-b64gx\" (UID: \"9425e519-d00c-4af6-a68a-3efde7aae5ba\") " pod="openshift-ovn-kubernetes/ovnkube-node-b64gx"
Jul 21 17:08:30.129516 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:30.128716    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/9425e519-d00c-4af6-a68a-3efde7aae5ba-host-run-netns\") pod \"ovnkube-node-b64gx\" (UID: \"9425e519-d00c-4af6-a68a-3efde7aae5ba\") " pod="openshift-ovn-kubernetes/ovnkube-node-b64gx"
Jul 21 17:08:30.129516 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:30.128742    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9425e519-d00c-4af6-a68a-3efde7aae5ba-etc-openvswitch\") pod \"ovnkube-node-b64gx\" (UID: \"9425e519-d00c-4af6-a68a-3efde7aae5ba\") " pod="openshift-ovn-kubernetes/ovnkube-node-b64gx"
Jul 21 17:08:30.129516 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:30.128753    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/9425e519-d00c-4af6-a68a-3efde7aae5ba-host-run-netns\") pod \"ovnkube-node-b64gx\" (UID: \"9425e519-d00c-4af6-a68a-3efde7aae5ba\") " pod="openshift-ovn-kubernetes/ovnkube-node-b64gx"
Jul 21 17:08:30.129516 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:30.128766    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/9425e519-d00c-4af6-a68a-3efde7aae5ba-ovn-node-metrics-cert\") pod \"ovnkube-node-b64gx\" (UID: \"9425e519-d00c-4af6-a68a-3efde7aae5ba\") " pod="openshift-ovn-kubernetes/ovnkube-node-b64gx"
Jul 21 17:08:30.129516 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:30.128809    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2601f86a-f327-4d78-9407-eec87e925760-tmp\") pod \"tuned-ctzzp\" (UID: \"2601f86a-f327-4d78-9407-eec87e925760\") " pod="openshift-cluster-node-tuning-operator/tuned-ctzzp"
Jul 21 17:08:30.129516 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:30.128812    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/9425e519-d00c-4af6-a68a-3efde7aae5ba-host-kubelet\") pod \"ovnkube-node-b64gx\" (UID: \"9425e519-d00c-4af6-a68a-3efde7aae5ba\") " pod="openshift-ovn-kubernetes/ovnkube-node-b64gx"
Jul 21 17:08:30.129516 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:30.128833    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/c3efc748-d974-40f3-9d1a-031114d77366-sys-fs\") pod \"aws-ebs-csi-driver-node-g8b28\" (UID: \"c3efc748-d974-40f3-9d1a-031114d77366\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g8b28"
Jul 21 17:08:30.129516 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:30.128859    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/2601f86a-f327-4d78-9407-eec87e925760-etc-sysconfig\") pod \"tuned-ctzzp\" (UID: \"2601f86a-f327-4d78-9407-eec87e925760\") " pod="openshift-cluster-node-tuning-operator/tuned-ctzzp"
Jul 21 17:08:30.129516 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:30.128859    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9425e519-d00c-4af6-a68a-3efde7aae5ba-run-openvswitch\") pod \"ovnkube-node-b64gx\" (UID: \"9425e519-d00c-4af6-a68a-3efde7aae5ba\") " pod="openshift-ovn-kubernetes/ovnkube-node-b64gx"
Jul 21 17:08:30.129516 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:30.128897    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/2601f86a-f327-4d78-9407-eec87e925760-lib-modules\") pod \"tuned-ctzzp\" (UID: \"2601f86a-f327-4d78-9407-eec87e925760\") " pod="openshift-cluster-node-tuning-operator/tuned-ctzzp"
Jul 21 17:08:30.130368 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:30.128935    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/9425e519-d00c-4af6-a68a-3efde7aae5ba-host-cni-bin\") pod \"ovnkube-node-b64gx\" (UID: \"9425e519-d00c-4af6-a68a-3efde7aae5ba\") " pod="openshift-ovn-kubernetes/ovnkube-node-b64gx"
Jul 21 17:08:30.130368 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:30.128935    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9425e519-d00c-4af6-a68a-3efde7aae5ba-run-openvswitch\") pod \"ovnkube-node-b64gx\" (UID: \"9425e519-d00c-4af6-a68a-3efde7aae5ba\") " pod="openshift-ovn-kubernetes/ovnkube-node-b64gx"
Jul 21 17:08:30.130368 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:30.128949    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/2601f86a-f327-4d78-9407-eec87e925760-etc-modprobe-d\") pod \"tuned-ctzzp\" (UID: \"2601f86a-f327-4d78-9407-eec87e925760\") " pod="openshift-cluster-node-tuning-operator/tuned-ctzzp"
Jul 21 17:08:30.130368 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:30.128959    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/9425e519-d00c-4af6-a68a-3efde7aae5ba-env-overrides\") pod \"ovnkube-node-b64gx\" (UID: \"9425e519-d00c-4af6-a68a-3efde7aae5ba\") " pod="openshift-ovn-kubernetes/ovnkube-node-b64gx"
Jul 21 17:08:30.130368 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:30.129026    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/2601f86a-f327-4d78-9407-eec87e925760-host\") pod \"tuned-ctzzp\" (UID: \"2601f86a-f327-4d78-9407-eec87e925760\") " pod="openshift-cluster-node-tuning-operator/tuned-ctzzp"
Jul 21 17:08:30.130368 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:30.129069    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/9425e519-d00c-4af6-a68a-3efde7aae5ba-host-cni-netd\") pod \"ovnkube-node-b64gx\" (UID: \"9425e519-d00c-4af6-a68a-3efde7aae5ba\") " pod="openshift-ovn-kubernetes/ovnkube-node-b64gx"
Jul 21 17:08:30.130368 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:30.129120    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/7533c67e-e7ed-4836-8a8b-a670200cccba-hosts-file\") pod \"node-resolver-qmbvr\" (UID: \"7533c67e-e7ed-4836-8a8b-a670200cccba\") " pod="openshift-dns/node-resolver-qmbvr"
Jul 21 17:08:30.130368 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:30.129173    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9425e519-d00c-4af6-a68a-3efde7aae5ba-etc-openvswitch\") pod \"ovnkube-node-b64gx\" (UID: \"9425e519-d00c-4af6-a68a-3efde7aae5ba\") " pod="openshift-ovn-kubernetes/ovnkube-node-b64gx"
Jul 21 17:08:30.130368 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:30.129194    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/2601f86a-f327-4d78-9407-eec87e925760-etc-sysctl-conf\") pod \"tuned-ctzzp\" (UID: \"2601f86a-f327-4d78-9407-eec87e925760\") " pod="openshift-cluster-node-tuning-operator/tuned-ctzzp"
Jul 21 17:08:30.130368 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:30.129265    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/c3efc748-d974-40f3-9d1a-031114d77366-sys-fs\") pod \"aws-ebs-csi-driver-node-g8b28\" (UID: \"c3efc748-d974-40f3-9d1a-031114d77366\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g8b28"
Jul 21 17:08:30.130368 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:30.129293    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/c3efc748-d974-40f3-9d1a-031114d77366-socket-dir\") pod \"aws-ebs-csi-driver-node-g8b28\" (UID: \"c3efc748-d974-40f3-9d1a-031114d77366\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g8b28"
Jul 21 17:08:30.130368 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:30.129328    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/9425e519-d00c-4af6-a68a-3efde7aae5ba-ovnkube-script-lib\") pod \"ovnkube-node-b64gx\" (UID: \"9425e519-d00c-4af6-a68a-3efde7aae5ba\") " pod="openshift-ovn-kubernetes/ovnkube-node-b64gx"
Jul 21 17:08:30.130368 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:30.129301    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/9425e519-d00c-4af6-a68a-3efde7aae5ba-node-log\") pod \"ovnkube-node-b64gx\" (UID: \"9425e519-d00c-4af6-a68a-3efde7aae5ba\") " pod="openshift-ovn-kubernetes/ovnkube-node-b64gx"
Jul 21 17:08:30.130368 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:30.129363    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2601f86a-f327-4d78-9407-eec87e925760-var-lib-kubelet\") pod \"tuned-ctzzp\" (UID: \"2601f86a-f327-4d78-9407-eec87e925760\") " pod="openshift-cluster-node-tuning-operator/tuned-ctzzp"
Jul 21 17:08:30.130368 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:30.129388    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7533c67e-e7ed-4836-8a8b-a670200cccba-tmp-dir\") pod \"node-resolver-qmbvr\" (UID: \"7533c67e-e7ed-4836-8a8b-a670200cccba\") " pod="openshift-dns/node-resolver-qmbvr"
Jul 21 17:08:30.130368 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:30.129445    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vhwvv\" (UniqueName: \"kubernetes.io/projected/c3efc748-d974-40f3-9d1a-031114d77366-kube-api-access-vhwvv\") pod \"aws-ebs-csi-driver-node-g8b28\" (UID: \"c3efc748-d974-40f3-9d1a-031114d77366\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g8b28"
Jul 21 17:08:30.130368 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:30.129467    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/c3efc748-d974-40f3-9d1a-031114d77366-socket-dir\") pod \"aws-ebs-csi-driver-node-g8b28\" (UID: \"c3efc748-d974-40f3-9d1a-031114d77366\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g8b28"
Jul 21 17:08:30.130368 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:30.129477    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/2601f86a-f327-4d78-9407-eec87e925760-run\") pod \"tuned-ctzzp\" (UID: \"2601f86a-f327-4d78-9407-eec87e925760\") " pod="openshift-cluster-node-tuning-operator/tuned-ctzzp"
Jul 21 17:08:30.131273 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:30.129500    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/cb1081a1-16da-4e6f-b099-62ae771c79c1-host-slash\") pod \"iptables-alerter-wgb8q\" (UID: \"cb1081a1-16da-4e6f-b099-62ae771c79c1\") " pod="openshift-network-operator/iptables-alerter-wgb8q"
Jul 21 17:08:30.131273 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:30.129526    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/72cdbb9c-0664-46c0-ab7c-4f38ebd7644f-serviceca\") pod \"node-ca-d7gn6\" (UID: \"72cdbb9c-0664-46c0-ab7c-4f38ebd7644f\") " pod="openshift-image-registry/node-ca-d7gn6"
Jul 21 17:08:30.131273 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:30.129548    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/9425e519-d00c-4af6-a68a-3efde7aae5ba-env-overrides\") pod \"ovnkube-node-b64gx\" (UID: \"9425e519-d00c-4af6-a68a-3efde7aae5ba\") " pod="openshift-ovn-kubernetes/ovnkube-node-b64gx"
Jul 21 17:08:30.131273 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:30.129567    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/cb1081a1-16da-4e6f-b099-62ae771c79c1-host-slash\") pod \"iptables-alerter-wgb8q\" (UID: \"cb1081a1-16da-4e6f-b099-62ae771c79c1\") " pod="openshift-network-operator/iptables-alerter-wgb8q"
Jul 21 17:08:30.131273 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:30.129586    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9kpz7\" (UniqueName: \"kubernetes.io/projected/7533c67e-e7ed-4836-8a8b-a670200cccba-kube-api-access-9kpz7\") pod \"node-resolver-qmbvr\" (UID: \"7533c67e-e7ed-4836-8a8b-a670200cccba\") " pod="openshift-dns/node-resolver-qmbvr"
Jul 21 17:08:30.131273 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:30.129625    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2601f86a-f327-4d78-9407-eec87e925760-var-lib-kubelet\") pod \"tuned-ctzzp\" (UID: \"2601f86a-f327-4d78-9407-eec87e925760\") " pod="openshift-cluster-node-tuning-operator/tuned-ctzzp"
Jul 21 17:08:30.131273 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:30.129849    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/9425e519-d00c-4af6-a68a-3efde7aae5ba-run-systemd\") pod \"ovnkube-node-b64gx\" (UID: \"9425e519-d00c-4af6-a68a-3efde7aae5ba\") " pod="openshift-ovn-kubernetes/ovnkube-node-b64gx"
Jul 21 17:08:30.131273 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:30.129890    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/2601f86a-f327-4d78-9407-eec87e925760-run\") pod \"tuned-ctzzp\" (UID: \"2601f86a-f327-4d78-9407-eec87e925760\") " pod="openshift-cluster-node-tuning-operator/tuned-ctzzp"
Jul 21 17:08:30.131273 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:30.129895    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/9425e519-d00c-4af6-a68a-3efde7aae5ba-ovnkube-script-lib\") pod \"ovnkube-node-b64gx\" (UID: \"9425e519-d00c-4af6-a68a-3efde7aae5ba\") " pod="openshift-ovn-kubernetes/ovnkube-node-b64gx"
Jul 21 17:08:30.131273 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:30.129908    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/9425e519-d00c-4af6-a68a-3efde7aae5ba-log-socket\") pod \"ovnkube-node-b64gx\" (UID: \"9425e519-d00c-4af6-a68a-3efde7aae5ba\") " pod="openshift-ovn-kubernetes/ovnkube-node-b64gx"
Jul 21 17:08:30.131273 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:30.129930    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zmnlt\" (UniqueName: \"kubernetes.io/projected/cb1081a1-16da-4e6f-b099-62ae771c79c1-kube-api-access-zmnlt\") pod \"iptables-alerter-wgb8q\" (UID: \"cb1081a1-16da-4e6f-b099-62ae771c79c1\") " pod="openshift-network-operator/iptables-alerter-wgb8q"
Jul 21 17:08:30.131273 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:30.129954    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/9425e519-d00c-4af6-a68a-3efde7aae5ba-run-systemd\") pod \"ovnkube-node-b64gx\" (UID: \"9425e519-d00c-4af6-a68a-3efde7aae5ba\") " pod="openshift-ovn-kubernetes/ovnkube-node-b64gx"
Jul 21 17:08:30.131273 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:30.129970    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/72cdbb9c-0664-46c0-ab7c-4f38ebd7644f-serviceca\") pod \"node-ca-d7gn6\" (UID: \"72cdbb9c-0664-46c0-ab7c-4f38ebd7644f\") " pod="openshift-image-registry/node-ca-d7gn6"
Jul 21 17:08:30.131273 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:30.129986    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/9425e519-d00c-4af6-a68a-3efde7aae5ba-log-socket\") pod \"ovnkube-node-b64gx\" (UID: \"9425e519-d00c-4af6-a68a-3efde7aae5ba\") " pod="openshift-ovn-kubernetes/ovnkube-node-b64gx"
Jul 21 17:08:30.131273 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:30.130131    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7533c67e-e7ed-4836-8a8b-a670200cccba-tmp-dir\") pod \"node-resolver-qmbvr\" (UID: \"7533c67e-e7ed-4836-8a8b-a670200cccba\") " pod="openshift-dns/node-resolver-qmbvr"
Jul 21 17:08:30.132017 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:30.131995    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/dacfd9ac-9516-4da2-ab9c-2629e4e6174e-agent-certs\") pod \"konnectivity-agent-hbwdq\" (UID: \"dacfd9ac-9516-4da2-ab9c-2629e4e6174e\") " pod="kube-system/konnectivity-agent-hbwdq"
Jul 21 17:08:30.135550 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:30.134431    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/9425e519-d00c-4af6-a68a-3efde7aae5ba-ovn-node-metrics-cert\") pod \"ovnkube-node-b64gx\" (UID: \"9425e519-d00c-4af6-a68a-3efde7aae5ba\") " pod="openshift-ovn-kubernetes/ovnkube-node-b64gx"
Jul 21 17:08:30.135550 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:30.134549    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/2601f86a-f327-4d78-9407-eec87e925760-etc-tuned\") pod \"tuned-ctzzp\" (UID: \"2601f86a-f327-4d78-9407-eec87e925760\") " pod="openshift-cluster-node-tuning-operator/tuned-ctzzp"
Jul 21 17:08:30.136845 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:30.136814    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9p9mx\" (UniqueName: \"kubernetes.io/projected/72cdbb9c-0664-46c0-ab7c-4f38ebd7644f-kube-api-access-9p9mx\") pod \"node-ca-d7gn6\" (UID: \"72cdbb9c-0664-46c0-ab7c-4f38ebd7644f\") " pod="openshift-image-registry/node-ca-d7gn6"
Jul 21 17:08:30.138816 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:30.138790    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9kpz7\" (UniqueName: \"kubernetes.io/projected/7533c67e-e7ed-4836-8a8b-a670200cccba-kube-api-access-9kpz7\") pod \"node-resolver-qmbvr\" (UID: \"7533c67e-e7ed-4836-8a8b-a670200cccba\") " pod="openshift-dns/node-resolver-qmbvr"
Jul 21 17:08:30.139093 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:30.139055    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8gpht\" (UniqueName: \"kubernetes.io/projected/9425e519-d00c-4af6-a68a-3efde7aae5ba-kube-api-access-8gpht\") pod \"ovnkube-node-b64gx\" (UID: \"9425e519-d00c-4af6-a68a-3efde7aae5ba\") " pod="openshift-ovn-kubernetes/ovnkube-node-b64gx"
Jul 21 17:08:30.139666 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:30.139644    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vhwvv\" (UniqueName: \"kubernetes.io/projected/c3efc748-d974-40f3-9d1a-031114d77366-kube-api-access-vhwvv\") pod \"aws-ebs-csi-driver-node-g8b28\" (UID: \"c3efc748-d974-40f3-9d1a-031114d77366\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g8b28"
Jul 21 17:08:30.141301 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:30.141246    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2601f86a-f327-4d78-9407-eec87e925760-tmp\") pod \"tuned-ctzzp\" (UID: \"2601f86a-f327-4d78-9407-eec87e925760\") " pod="openshift-cluster-node-tuning-operator/tuned-ctzzp"
Jul 21 17:08:30.142751 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:30.142730    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2j9r8\" (UniqueName: \"kubernetes.io/projected/2601f86a-f327-4d78-9407-eec87e925760-kube-api-access-2j9r8\") pod \"tuned-ctzzp\" (UID: \"2601f86a-f327-4d78-9407-eec87e925760\") " pod="openshift-cluster-node-tuning-operator/tuned-ctzzp"
Jul 21 17:08:30.144484 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:30.144462    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zmnlt\" (UniqueName: \"kubernetes.io/projected/cb1081a1-16da-4e6f-b099-62ae771c79c1-kube-api-access-zmnlt\") pod \"iptables-alerter-wgb8q\" (UID: \"cb1081a1-16da-4e6f-b099-62ae771c79c1\") " pod="openshift-network-operator/iptables-alerter-wgb8q"
Jul 21 17:08:30.218457 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:30.218403    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-jmsnn"
Jul 21 17:08:30.229069 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:30.229037    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-wzxwp"
Jul 21 17:08:30.239437 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:30.239254    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-wgb8q"
Jul 21 17:08:30.243656 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:30.243635    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-qmbvr"
Jul 21 17:08:30.249844 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:30.249822    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g8b28"
Jul 21 17:08:30.256856 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:30.256836    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-d7gn6"
Jul 21 17:08:30.263987 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:30.263963    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-hbwdq"
Jul 21 17:08:30.271145 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:30.271123    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-ctzzp"
Jul 21 17:08:30.276401 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:30.276379    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-b64gx"
Jul 21 17:08:30.444557 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:08:30.444407    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7533c67e_e7ed_4836_8a8b_a670200cccba.slice/crio-192fa184401e4299f737e921b8f4cf82de9e53de148009bef64edf4a794cd54f WatchSource:0}: Error finding container 192fa184401e4299f737e921b8f4cf82de9e53de148009bef64edf4a794cd54f: Status 404 returned error can't find the container with id 192fa184401e4299f737e921b8f4cf82de9e53de148009bef64edf4a794cd54f
Jul 21 17:08:30.446531 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:08:30.446484    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9425e519_d00c_4af6_a68a_3efde7aae5ba.slice/crio-6cfc21e496394c98c86268d70f3d219e4b081fad2ccb939b536ec77300af1702 WatchSource:0}: Error finding container 6cfc21e496394c98c86268d70f3d219e4b081fad2ccb939b536ec77300af1702: Status 404 returned error can't find the container with id 6cfc21e496394c98c86268d70f3d219e4b081fad2ccb939b536ec77300af1702
Jul 21 17:08:30.446869 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:08:30.446849    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddacfd9ac_9516_4da2_ab9c_2629e4e6174e.slice/crio-9cebbbcf2b4eb23d686956e0c1e6da09c43783b6439bb4e5044298907054f621 WatchSource:0}: Error finding container 9cebbbcf2b4eb23d686956e0c1e6da09c43783b6439bb4e5044298907054f621: Status 404 returned error can't find the container with id 9cebbbcf2b4eb23d686956e0c1e6da09c43783b6439bb4e5044298907054f621
Jul 21 17:08:30.447857 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:08:30.447836    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc3efc748_d974_40f3_9d1a_031114d77366.slice/crio-39281713f2dab392640a9d93246f32a62a723abf69f86d43d3437c2d9734042e WatchSource:0}: Error finding container 39281713f2dab392640a9d93246f32a62a723abf69f86d43d3437c2d9734042e: Status 404 returned error can't find the container with id 39281713f2dab392640a9d93246f32a62a723abf69f86d43d3437c2d9734042e
Jul 21 17:08:30.448795 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:08:30.448439    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod72cdbb9c_0664_46c0_ab7c_4f38ebd7644f.slice/crio-0e9027ad89cde0f15b2a29d44fce014730f8e2b59a60c3a2d0e2c0f9579a4c11 WatchSource:0}: Error finding container 0e9027ad89cde0f15b2a29d44fce014730f8e2b59a60c3a2d0e2c0f9579a4c11: Status 404 returned error can't find the container with id 0e9027ad89cde0f15b2a29d44fce014730f8e2b59a60c3a2d0e2c0f9579a4c11
Jul 21 17:08:30.449600 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:08:30.449326    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0af1b5ce_5a4d_4cc2_a9ef_ac31ed1f07ca.slice/crio-d5446b37c6c73e95cbcf60ae773d50c8aa644be0608e2bb5b052a481df29d3e4 WatchSource:0}: Error finding container d5446b37c6c73e95cbcf60ae773d50c8aa644be0608e2bb5b052a481df29d3e4: Status 404 returned error can't find the container with id d5446b37c6c73e95cbcf60ae773d50c8aa644be0608e2bb5b052a481df29d3e4
Jul 21 17:08:30.533877 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:30.533842    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/75e3f13b-b4dd-479c-b305-420ec10c39d7-metrics-certs\") pod \"network-metrics-daemon-n98c6\" (UID: \"75e3f13b-b4dd-479c-b305-420ec10c39d7\") " pod="openshift-multus/network-metrics-daemon-n98c6"
Jul 21 17:08:30.534064 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:30.533931    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7900e00a-7d30-4941-a177-1ce9da22deb3-original-pull-secret\") pod \"global-pull-secret-syncer-44fbg\" (UID: \"7900e00a-7d30-4941-a177-1ce9da22deb3\") " pod="kube-system/global-pull-secret-syncer-44fbg"
Jul 21 17:08:30.534064 ip-10-0-141-39 kubenswrapper[2575]: E0721 17:08:30.534007    2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 21 17:08:30.534064 ip-10-0-141-39 kubenswrapper[2575]: E0721 17:08:30.534034    2575 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 21 17:08:30.534185 ip-10-0-141-39 kubenswrapper[2575]: E0721 17:08:30.534083    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/75e3f13b-b4dd-479c-b305-420ec10c39d7-metrics-certs podName:75e3f13b-b4dd-479c-b305-420ec10c39d7 nodeName:}" failed. No retries permitted until 2026-07-21 17:08:31.534064888 +0000 UTC m=+3.988217522 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/75e3f13b-b4dd-479c-b305-420ec10c39d7-metrics-certs") pod "network-metrics-daemon-n98c6" (UID: "75e3f13b-b4dd-479c-b305-420ec10c39d7") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 21 17:08:30.534185 ip-10-0-141-39 kubenswrapper[2575]: E0721 17:08:30.534102    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7900e00a-7d30-4941-a177-1ce9da22deb3-original-pull-secret podName:7900e00a-7d30-4941-a177-1ce9da22deb3 nodeName:}" failed. No retries permitted until 2026-07-21 17:08:31.534093933 +0000 UTC m=+3.988246550 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/7900e00a-7d30-4941-a177-1ce9da22deb3-original-pull-secret") pod "global-pull-secret-syncer-44fbg" (UID: "7900e00a-7d30-4941-a177-1ce9da22deb3") : object "kube-system"/"original-pull-secret" not registered
Jul 21 17:08:30.634911 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:30.634874    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-plkdx\" (UniqueName: \"kubernetes.io/projected/1f68ab07-c91d-4a29-8b72-cc76e3dd2753-kube-api-access-plkdx\") pod \"network-check-target-x4gm9\" (UID: \"1f68ab07-c91d-4a29-8b72-cc76e3dd2753\") " pod="openshift-network-diagnostics/network-check-target-x4gm9"
Jul 21 17:08:30.635084 ip-10-0-141-39 kubenswrapper[2575]: E0721 17:08:30.635065    2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 21 17:08:30.635137 ip-10-0-141-39 kubenswrapper[2575]: E0721 17:08:30.635094    2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 21 17:08:30.635137 ip-10-0-141-39 kubenswrapper[2575]: E0721 17:08:30.635109    2575 projected.go:196] Error preparing data for projected volume kube-api-access-plkdx for pod openshift-network-diagnostics/network-check-target-x4gm9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 21 17:08:30.635216 ip-10-0-141-39 kubenswrapper[2575]: E0721 17:08:30.635173    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1f68ab07-c91d-4a29-8b72-cc76e3dd2753-kube-api-access-plkdx podName:1f68ab07-c91d-4a29-8b72-cc76e3dd2753 nodeName:}" failed. No retries permitted until 2026-07-21 17:08:31.635152505 +0000 UTC m=+4.089305127 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-plkdx" (UniqueName: "kubernetes.io/projected/1f68ab07-c91d-4a29-8b72-cc76e3dd2753-kube-api-access-plkdx") pod "network-check-target-x4gm9" (UID: "1f68ab07-c91d-4a29-8b72-cc76e3dd2753") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 21 17:08:30.772870 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:08:30.772791    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2601f86a_f327_4d78_9407_eec87e925760.slice/crio-58fe5beae96d941281c42837c38c9dd2dee81c605bc718ee7ff482779b3ba611 WatchSource:0}: Error finding container 58fe5beae96d941281c42837c38c9dd2dee81c605bc718ee7ff482779b3ba611: Status 404 returned error can't find the container with id 58fe5beae96d941281c42837c38c9dd2dee81c605bc718ee7ff482779b3ba611
Jul 21 17:08:30.773431 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:08:30.773389    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0db4134e_c6f4_4665_9268_90a3569ccb73.slice/crio-561db4cf6f88d0deb1d0820a11ed9448a294fd21ee4d7a6a1445906ef1b9a540 WatchSource:0}: Error finding container 561db4cf6f88d0deb1d0820a11ed9448a294fd21ee4d7a6a1445906ef1b9a540: Status 404 returned error can't find the container with id 561db4cf6f88d0deb1d0820a11ed9448a294fd21ee4d7a6a1445906ef1b9a540
Jul 21 17:08:30.990964 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:30.990911    2575 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-20 17:03:29 +0000 UTC" deadline="2028-01-19 03:40:43.193697384 +0000 UTC"
Jul 21 17:08:30.990964 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:30.990956    2575 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13114h32m12.202744362s"
Jul 21 17:08:31.111293 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:31.111267    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-44fbg"
Jul 21 17:08:31.111395 ip-10-0-141-39 kubenswrapper[2575]: E0721 17:08:31.111374    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-44fbg" podUID="7900e00a-7d30-4941-a177-1ce9da22deb3"
Jul 21 17:08:31.126159 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:31.126130    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-jmsnn" event={"ID":"0af1b5ce-5a4d-4cc2-a9ef-ac31ed1f07ca","Type":"ContainerStarted","Data":"d5446b37c6c73e95cbcf60ae773d50c8aa644be0608e2bb5b052a481df29d3e4"}
Jul 21 17:08:31.128790 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:31.128765    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-d7gn6" event={"ID":"72cdbb9c-0664-46c0-ab7c-4f38ebd7644f","Type":"ContainerStarted","Data":"0e9027ad89cde0f15b2a29d44fce014730f8e2b59a60c3a2d0e2c0f9579a4c11"}
Jul 21 17:08:31.132856 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:31.132834    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g8b28" event={"ID":"c3efc748-d974-40f3-9d1a-031114d77366","Type":"ContainerStarted","Data":"39281713f2dab392640a9d93246f32a62a723abf69f86d43d3437c2d9734042e"}
Jul 21 17:08:31.136589 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:31.136565    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-hbwdq" event={"ID":"dacfd9ac-9516-4da2-ab9c-2629e4e6174e","Type":"ContainerStarted","Data":"9cebbbcf2b4eb23d686956e0c1e6da09c43783b6439bb4e5044298907054f621"}
Jul 21 17:08:31.138240 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:31.138222    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-b64gx" event={"ID":"9425e519-d00c-4af6-a68a-3efde7aae5ba","Type":"ContainerStarted","Data":"6cfc21e496394c98c86268d70f3d219e4b081fad2ccb939b536ec77300af1702"}
Jul 21 17:08:31.139336 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:31.139314    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-wzxwp" event={"ID":"0db4134e-c6f4-4665-9268-90a3569ccb73","Type":"ContainerStarted","Data":"561db4cf6f88d0deb1d0820a11ed9448a294fd21ee4d7a6a1445906ef1b9a540"}
Jul 21 17:08:31.140408 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:31.140389    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-qmbvr" event={"ID":"7533c67e-e7ed-4836-8a8b-a670200cccba","Type":"ContainerStarted","Data":"192fa184401e4299f737e921b8f4cf82de9e53de148009bef64edf4a794cd54f"}
Jul 21 17:08:31.142774 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:31.142755    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-wgb8q" event={"ID":"cb1081a1-16da-4e6f-b099-62ae771c79c1","Type":"ContainerStarted","Data":"21698d37c0bb619ab247553d91a15ffb05831ff1f86dd74f3965000608bfd0c8"}
Jul 21 17:08:31.146717 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:31.146695    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-ctzzp" event={"ID":"2601f86a-f327-4d78-9407-eec87e925760","Type":"ContainerStarted","Data":"58fe5beae96d941281c42837c38c9dd2dee81c605bc718ee7ff482779b3ba611"}
Jul 21 17:08:31.542575 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:31.541595    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/75e3f13b-b4dd-479c-b305-420ec10c39d7-metrics-certs\") pod \"network-metrics-daemon-n98c6\" (UID: \"75e3f13b-b4dd-479c-b305-420ec10c39d7\") " pod="openshift-multus/network-metrics-daemon-n98c6"
Jul 21 17:08:31.542575 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:31.541901    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7900e00a-7d30-4941-a177-1ce9da22deb3-original-pull-secret\") pod \"global-pull-secret-syncer-44fbg\" (UID: \"7900e00a-7d30-4941-a177-1ce9da22deb3\") " pod="kube-system/global-pull-secret-syncer-44fbg"
Jul 21 17:08:31.542575 ip-10-0-141-39 kubenswrapper[2575]: E0721 17:08:31.542041    2575 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 21 17:08:31.542575 ip-10-0-141-39 kubenswrapper[2575]: E0721 17:08:31.542100    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7900e00a-7d30-4941-a177-1ce9da22deb3-original-pull-secret podName:7900e00a-7d30-4941-a177-1ce9da22deb3 nodeName:}" failed. No retries permitted until 2026-07-21 17:08:33.542083288 +0000 UTC m=+5.996235917 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/7900e00a-7d30-4941-a177-1ce9da22deb3-original-pull-secret") pod "global-pull-secret-syncer-44fbg" (UID: "7900e00a-7d30-4941-a177-1ce9da22deb3") : object "kube-system"/"original-pull-secret" not registered
Jul 21 17:08:31.542575 ip-10-0-141-39 kubenswrapper[2575]: E0721 17:08:31.542493    2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 21 17:08:31.542575 ip-10-0-141-39 kubenswrapper[2575]: E0721 17:08:31.542542    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/75e3f13b-b4dd-479c-b305-420ec10c39d7-metrics-certs podName:75e3f13b-b4dd-479c-b305-420ec10c39d7 nodeName:}" failed. No retries permitted until 2026-07-21 17:08:33.542527636 +0000 UTC m=+5.996680260 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/75e3f13b-b4dd-479c-b305-420ec10c39d7-metrics-certs") pod "network-metrics-daemon-n98c6" (UID: "75e3f13b-b4dd-479c-b305-420ec10c39d7") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 21 17:08:31.642620 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:31.642504    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-plkdx\" (UniqueName: \"kubernetes.io/projected/1f68ab07-c91d-4a29-8b72-cc76e3dd2753-kube-api-access-plkdx\") pod \"network-check-target-x4gm9\" (UID: \"1f68ab07-c91d-4a29-8b72-cc76e3dd2753\") " pod="openshift-network-diagnostics/network-check-target-x4gm9"
Jul 21 17:08:31.642707 ip-10-0-141-39 kubenswrapper[2575]: E0721 17:08:31.642663    2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 21 17:08:31.642707 ip-10-0-141-39 kubenswrapper[2575]: E0721 17:08:31.642682    2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 21 17:08:31.642707 ip-10-0-141-39 kubenswrapper[2575]: E0721 17:08:31.642694    2575 projected.go:196] Error preparing data for projected volume kube-api-access-plkdx for pod openshift-network-diagnostics/network-check-target-x4gm9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 21 17:08:31.642836 ip-10-0-141-39 kubenswrapper[2575]: E0721 17:08:31.642752    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1f68ab07-c91d-4a29-8b72-cc76e3dd2753-kube-api-access-plkdx podName:1f68ab07-c91d-4a29-8b72-cc76e3dd2753 nodeName:}" failed. No retries permitted until 2026-07-21 17:08:33.642733257 +0000 UTC m=+6.096885896 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-plkdx" (UniqueName: "kubernetes.io/projected/1f68ab07-c91d-4a29-8b72-cc76e3dd2753-kube-api-access-plkdx") pod "network-check-target-x4gm9" (UID: "1f68ab07-c91d-4a29-8b72-cc76e3dd2753") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 21 17:08:31.992043 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:31.991920    2575 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-20 17:03:29 +0000 UTC" deadline="2028-03-15 23:21:00.599862888 +0000 UTC"
Jul 21 17:08:31.992043 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:31.991994    2575 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14478h12m28.607873211s"
Jul 21 17:08:32.113691 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:32.113006    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-n98c6"
Jul 21 17:08:32.113691 ip-10-0-141-39 kubenswrapper[2575]: E0721 17:08:32.113147    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-n98c6" podUID="75e3f13b-b4dd-479c-b305-420ec10c39d7"
Jul 21 17:08:32.113691 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:32.113548    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-x4gm9"
Jul 21 17:08:32.113691 ip-10-0-141-39 kubenswrapper[2575]: E0721 17:08:32.113636    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-x4gm9" podUID="1f68ab07-c91d-4a29-8b72-cc76e3dd2753"
Jul 21 17:08:32.186074 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:32.185480    2575 generic.go:356] "Generic (PLEG): container finished" podID="a733d0df94ea33efc59cd1a4c70b79bd" containerID="870a48fa4fa406e8152bda6423bdf0d97d16efc3a24f5b64f15e7e526a16a382" exitCode=0
Jul 21 17:08:32.186074 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:32.185993    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-39.ec2.internal" event={"ID":"a733d0df94ea33efc59cd1a4c70b79bd","Type":"ContainerDied","Data":"870a48fa4fa406e8152bda6423bdf0d97d16efc3a24f5b64f15e7e526a16a382"}
Jul 21 17:08:32.196953 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:32.196924    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-39.ec2.internal" event={"ID":"35d9bf4db485a74e935a67bfd9e0bd65","Type":"ContainerStarted","Data":"23f0c6f44102573b3b1d9ab430ceffcb502ac3dd08fba50b3696f5819ccfb815"}
Jul 21 17:08:33.111512 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:33.111475    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-44fbg"
Jul 21 17:08:33.111991 ip-10-0-141-39 kubenswrapper[2575]: E0721 17:08:33.111616    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-44fbg" podUID="7900e00a-7d30-4941-a177-1ce9da22deb3"
Jul 21 17:08:33.216542 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:33.216507    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-39.ec2.internal" event={"ID":"a733d0df94ea33efc59cd1a4c70b79bd","Type":"ContainerStarted","Data":"2b782f2814e485448a9809613846855c34f824c518e082238b2e1fcc0e1154ed"}
Jul 21 17:08:33.248161 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:33.248100    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-39.ec2.internal" podStartSLOduration=4.248078124 podStartE2EDuration="4.248078124s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-21 17:08:29 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 17:08:32.298732496 +0000 UTC m=+4.752885137" watchObservedRunningTime="2026-07-21 17:08:33.248078124 +0000 UTC m=+5.702230765"
Jul 21 17:08:33.563679 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:33.563588    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7900e00a-7d30-4941-a177-1ce9da22deb3-original-pull-secret\") pod \"global-pull-secret-syncer-44fbg\" (UID: \"7900e00a-7d30-4941-a177-1ce9da22deb3\") " pod="kube-system/global-pull-secret-syncer-44fbg"
Jul 21 17:08:33.563679 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:33.563657    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/75e3f13b-b4dd-479c-b305-420ec10c39d7-metrics-certs\") pod \"network-metrics-daemon-n98c6\" (UID: \"75e3f13b-b4dd-479c-b305-420ec10c39d7\") " pod="openshift-multus/network-metrics-daemon-n98c6"
Jul 21 17:08:33.563902 ip-10-0-141-39 kubenswrapper[2575]: E0721 17:08:33.563781    2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 21 17:08:33.563902 ip-10-0-141-39 kubenswrapper[2575]: E0721 17:08:33.563841    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/75e3f13b-b4dd-479c-b305-420ec10c39d7-metrics-certs podName:75e3f13b-b4dd-479c-b305-420ec10c39d7 nodeName:}" failed. No retries permitted until 2026-07-21 17:08:37.563823657 +0000 UTC m=+10.017976280 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/75e3f13b-b4dd-479c-b305-420ec10c39d7-metrics-certs") pod "network-metrics-daemon-n98c6" (UID: "75e3f13b-b4dd-479c-b305-420ec10c39d7") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 21 17:08:33.564791 ip-10-0-141-39 kubenswrapper[2575]: E0721 17:08:33.564221    2575 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 21 17:08:33.564791 ip-10-0-141-39 kubenswrapper[2575]: E0721 17:08:33.564261    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7900e00a-7d30-4941-a177-1ce9da22deb3-original-pull-secret podName:7900e00a-7d30-4941-a177-1ce9da22deb3 nodeName:}" failed. No retries permitted until 2026-07-21 17:08:37.564251246 +0000 UTC m=+10.018403864 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/7900e00a-7d30-4941-a177-1ce9da22deb3-original-pull-secret") pod "global-pull-secret-syncer-44fbg" (UID: "7900e00a-7d30-4941-a177-1ce9da22deb3") : object "kube-system"/"original-pull-secret" not registered
Jul 21 17:08:33.664341 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:33.664301    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-plkdx\" (UniqueName: \"kubernetes.io/projected/1f68ab07-c91d-4a29-8b72-cc76e3dd2753-kube-api-access-plkdx\") pod \"network-check-target-x4gm9\" (UID: \"1f68ab07-c91d-4a29-8b72-cc76e3dd2753\") " pod="openshift-network-diagnostics/network-check-target-x4gm9"
Jul 21 17:08:33.664539 ip-10-0-141-39 kubenswrapper[2575]: E0721 17:08:33.664520    2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 21 17:08:33.664617 ip-10-0-141-39 kubenswrapper[2575]: E0721 17:08:33.664546    2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 21 17:08:33.664617 ip-10-0-141-39 kubenswrapper[2575]: E0721 17:08:33.664559    2575 projected.go:196] Error preparing data for projected volume kube-api-access-plkdx for pod openshift-network-diagnostics/network-check-target-x4gm9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 21 17:08:33.664720 ip-10-0-141-39 kubenswrapper[2575]: E0721 17:08:33.664623    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1f68ab07-c91d-4a29-8b72-cc76e3dd2753-kube-api-access-plkdx podName:1f68ab07-c91d-4a29-8b72-cc76e3dd2753 nodeName:}" failed. No retries permitted until 2026-07-21 17:08:37.664602129 +0000 UTC m=+10.118754803 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-plkdx" (UniqueName: "kubernetes.io/projected/1f68ab07-c91d-4a29-8b72-cc76e3dd2753-kube-api-access-plkdx") pod "network-check-target-x4gm9" (UID: "1f68ab07-c91d-4a29-8b72-cc76e3dd2753") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 21 17:08:34.117556 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:34.116383    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-n98c6"
Jul 21 17:08:34.117556 ip-10-0-141-39 kubenswrapper[2575]: E0721 17:08:34.116567    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-n98c6" podUID="75e3f13b-b4dd-479c-b305-420ec10c39d7"
Jul 21 17:08:34.117556 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:34.117357    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-x4gm9"
Jul 21 17:08:34.117556 ip-10-0-141-39 kubenswrapper[2575]: E0721 17:08:34.117498    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-x4gm9" podUID="1f68ab07-c91d-4a29-8b72-cc76e3dd2753"
Jul 21 17:08:35.111213 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:35.111179    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-44fbg"
Jul 21 17:08:35.111395 ip-10-0-141-39 kubenswrapper[2575]: E0721 17:08:35.111305    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-44fbg" podUID="7900e00a-7d30-4941-a177-1ce9da22deb3"
Jul 21 17:08:36.112075 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:36.111506    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-x4gm9"
Jul 21 17:08:36.112075 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:36.111533    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-n98c6"
Jul 21 17:08:36.112075 ip-10-0-141-39 kubenswrapper[2575]: E0721 17:08:36.111636    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-x4gm9" podUID="1f68ab07-c91d-4a29-8b72-cc76e3dd2753"
Jul 21 17:08:36.112075 ip-10-0-141-39 kubenswrapper[2575]: E0721 17:08:36.111732    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-n98c6" podUID="75e3f13b-b4dd-479c-b305-420ec10c39d7"
Jul 21 17:08:37.110872 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:37.110832    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-44fbg"
Jul 21 17:08:37.111041 ip-10-0-141-39 kubenswrapper[2575]: E0721 17:08:37.110949    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-44fbg" podUID="7900e00a-7d30-4941-a177-1ce9da22deb3"
Jul 21 17:08:37.600336 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:37.600257    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7900e00a-7d30-4941-a177-1ce9da22deb3-original-pull-secret\") pod \"global-pull-secret-syncer-44fbg\" (UID: \"7900e00a-7d30-4941-a177-1ce9da22deb3\") " pod="kube-system/global-pull-secret-syncer-44fbg"
Jul 21 17:08:37.600336 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:37.600308    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/75e3f13b-b4dd-479c-b305-420ec10c39d7-metrics-certs\") pod \"network-metrics-daemon-n98c6\" (UID: \"75e3f13b-b4dd-479c-b305-420ec10c39d7\") " pod="openshift-multus/network-metrics-daemon-n98c6"
Jul 21 17:08:37.600822 ip-10-0-141-39 kubenswrapper[2575]: E0721 17:08:37.600443    2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 21 17:08:37.600822 ip-10-0-141-39 kubenswrapper[2575]: E0721 17:08:37.600451    2575 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 21 17:08:37.600822 ip-10-0-141-39 kubenswrapper[2575]: E0721 17:08:37.600501    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/75e3f13b-b4dd-479c-b305-420ec10c39d7-metrics-certs podName:75e3f13b-b4dd-479c-b305-420ec10c39d7 nodeName:}" failed. No retries permitted until 2026-07-21 17:08:45.600485821 +0000 UTC m=+18.054638456 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/75e3f13b-b4dd-479c-b305-420ec10c39d7-metrics-certs") pod "network-metrics-daemon-n98c6" (UID: "75e3f13b-b4dd-479c-b305-420ec10c39d7") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 21 17:08:37.600822 ip-10-0-141-39 kubenswrapper[2575]: E0721 17:08:37.600515    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7900e00a-7d30-4941-a177-1ce9da22deb3-original-pull-secret podName:7900e00a-7d30-4941-a177-1ce9da22deb3 nodeName:}" failed. No retries permitted until 2026-07-21 17:08:45.600509535 +0000 UTC m=+18.054662153 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/7900e00a-7d30-4941-a177-1ce9da22deb3-original-pull-secret") pod "global-pull-secret-syncer-44fbg" (UID: "7900e00a-7d30-4941-a177-1ce9da22deb3") : object "kube-system"/"original-pull-secret" not registered
Jul 21 17:08:37.701016 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:37.700980    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-plkdx\" (UniqueName: \"kubernetes.io/projected/1f68ab07-c91d-4a29-8b72-cc76e3dd2753-kube-api-access-plkdx\") pod \"network-check-target-x4gm9\" (UID: \"1f68ab07-c91d-4a29-8b72-cc76e3dd2753\") " pod="openshift-network-diagnostics/network-check-target-x4gm9"
Jul 21 17:08:37.701195 ip-10-0-141-39 kubenswrapper[2575]: E0721 17:08:37.701176    2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 21 17:08:37.701238 ip-10-0-141-39 kubenswrapper[2575]: E0721 17:08:37.701204    2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 21 17:08:37.701238 ip-10-0-141-39 kubenswrapper[2575]: E0721 17:08:37.701218    2575 projected.go:196] Error preparing data for projected volume kube-api-access-plkdx for pod openshift-network-diagnostics/network-check-target-x4gm9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 21 17:08:37.701308 ip-10-0-141-39 kubenswrapper[2575]: E0721 17:08:37.701281    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1f68ab07-c91d-4a29-8b72-cc76e3dd2753-kube-api-access-plkdx podName:1f68ab07-c91d-4a29-8b72-cc76e3dd2753 nodeName:}" failed. No retries permitted until 2026-07-21 17:08:45.701262915 +0000 UTC m=+18.155415557 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-plkdx" (UniqueName: "kubernetes.io/projected/1f68ab07-c91d-4a29-8b72-cc76e3dd2753-kube-api-access-plkdx") pod "network-check-target-x4gm9" (UID: "1f68ab07-c91d-4a29-8b72-cc76e3dd2753") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 21 17:08:38.112517 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:38.112489    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-n98c6"
Jul 21 17:08:38.112686 ip-10-0-141-39 kubenswrapper[2575]: E0721 17:08:38.112616    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-n98c6" podUID="75e3f13b-b4dd-479c-b305-420ec10c39d7"
Jul 21 17:08:38.112997 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:38.112974    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-x4gm9"
Jul 21 17:08:38.113240 ip-10-0-141-39 kubenswrapper[2575]: E0721 17:08:38.113069    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-x4gm9" podUID="1f68ab07-c91d-4a29-8b72-cc76e3dd2753"
Jul 21 17:08:39.111579 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:39.111502    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-44fbg"
Jul 21 17:08:39.112026 ip-10-0-141-39 kubenswrapper[2575]: E0721 17:08:39.111628    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-44fbg" podUID="7900e00a-7d30-4941-a177-1ce9da22deb3"
Jul 21 17:08:40.111295 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:40.111254    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-n98c6"
Jul 21 17:08:40.111528 ip-10-0-141-39 kubenswrapper[2575]: E0721 17:08:40.111408    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-n98c6" podUID="75e3f13b-b4dd-479c-b305-420ec10c39d7"
Jul 21 17:08:40.112060 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:40.111903    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-x4gm9"
Jul 21 17:08:40.112060 ip-10-0-141-39 kubenswrapper[2575]: E0721 17:08:40.112008    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-x4gm9" podUID="1f68ab07-c91d-4a29-8b72-cc76e3dd2753"
Jul 21 17:08:41.110965 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:41.110931    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-44fbg"
Jul 21 17:08:41.111135 ip-10-0-141-39 kubenswrapper[2575]: E0721 17:08:41.111062    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-44fbg" podUID="7900e00a-7d30-4941-a177-1ce9da22deb3"
Jul 21 17:08:42.111178 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:42.111143    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-n98c6"
Jul 21 17:08:42.111178 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:42.111162    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-x4gm9"
Jul 21 17:08:42.111720 ip-10-0-141-39 kubenswrapper[2575]: E0721 17:08:42.111286    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-n98c6" podUID="75e3f13b-b4dd-479c-b305-420ec10c39d7"
Jul 21 17:08:42.111792 ip-10-0-141-39 kubenswrapper[2575]: E0721 17:08:42.111765    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-x4gm9" podUID="1f68ab07-c91d-4a29-8b72-cc76e3dd2753"
Jul 21 17:08:43.110897 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:43.110854    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-44fbg"
Jul 21 17:08:43.111072 ip-10-0-141-39 kubenswrapper[2575]: E0721 17:08:43.110990    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-44fbg" podUID="7900e00a-7d30-4941-a177-1ce9da22deb3"
Jul 21 17:08:44.111113 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:44.111076    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-n98c6"
Jul 21 17:08:44.111683 ip-10-0-141-39 kubenswrapper[2575]: E0721 17:08:44.111213    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-n98c6" podUID="75e3f13b-b4dd-479c-b305-420ec10c39d7"
Jul 21 17:08:44.111683 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:44.111249    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-x4gm9"
Jul 21 17:08:44.111683 ip-10-0-141-39 kubenswrapper[2575]: E0721 17:08:44.111351    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-x4gm9" podUID="1f68ab07-c91d-4a29-8b72-cc76e3dd2753"
Jul 21 17:08:45.110998 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:45.110964    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-44fbg"
Jul 21 17:08:45.111172 ip-10-0-141-39 kubenswrapper[2575]: E0721 17:08:45.111073    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-44fbg" podUID="7900e00a-7d30-4941-a177-1ce9da22deb3"
Jul 21 17:08:45.659715 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:45.659677    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7900e00a-7d30-4941-a177-1ce9da22deb3-original-pull-secret\") pod \"global-pull-secret-syncer-44fbg\" (UID: \"7900e00a-7d30-4941-a177-1ce9da22deb3\") " pod="kube-system/global-pull-secret-syncer-44fbg"
Jul 21 17:08:45.659917 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:45.659736    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/75e3f13b-b4dd-479c-b305-420ec10c39d7-metrics-certs\") pod \"network-metrics-daemon-n98c6\" (UID: \"75e3f13b-b4dd-479c-b305-420ec10c39d7\") " pod="openshift-multus/network-metrics-daemon-n98c6"
Jul 21 17:08:45.659917 ip-10-0-141-39 kubenswrapper[2575]: E0721 17:08:45.659851    2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 21 17:08:45.659917 ip-10-0-141-39 kubenswrapper[2575]: E0721 17:08:45.659852    2575 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 21 17:08:45.659917 ip-10-0-141-39 kubenswrapper[2575]: E0721 17:08:45.659915    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/75e3f13b-b4dd-479c-b305-420ec10c39d7-metrics-certs podName:75e3f13b-b4dd-479c-b305-420ec10c39d7 nodeName:}" failed. No retries permitted until 2026-07-21 17:09:01.65989686 +0000 UTC m=+34.114049477 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/75e3f13b-b4dd-479c-b305-420ec10c39d7-metrics-certs") pod "network-metrics-daemon-n98c6" (UID: "75e3f13b-b4dd-479c-b305-420ec10c39d7") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 21 17:08:45.660133 ip-10-0-141-39 kubenswrapper[2575]: E0721 17:08:45.659933    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7900e00a-7d30-4941-a177-1ce9da22deb3-original-pull-secret podName:7900e00a-7d30-4941-a177-1ce9da22deb3 nodeName:}" failed. No retries permitted until 2026-07-21 17:09:01.659924665 +0000 UTC m=+34.114077285 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/7900e00a-7d30-4941-a177-1ce9da22deb3-original-pull-secret") pod "global-pull-secret-syncer-44fbg" (UID: "7900e00a-7d30-4941-a177-1ce9da22deb3") : object "kube-system"/"original-pull-secret" not registered
Jul 21 17:08:45.760757 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:45.760719    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-plkdx\" (UniqueName: \"kubernetes.io/projected/1f68ab07-c91d-4a29-8b72-cc76e3dd2753-kube-api-access-plkdx\") pod \"network-check-target-x4gm9\" (UID: \"1f68ab07-c91d-4a29-8b72-cc76e3dd2753\") " pod="openshift-network-diagnostics/network-check-target-x4gm9"
Jul 21 17:08:45.760926 ip-10-0-141-39 kubenswrapper[2575]: E0721 17:08:45.760881    2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 21 17:08:45.760926 ip-10-0-141-39 kubenswrapper[2575]: E0721 17:08:45.760903    2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 21 17:08:45.760926 ip-10-0-141-39 kubenswrapper[2575]: E0721 17:08:45.760924    2575 projected.go:196] Error preparing data for projected volume kube-api-access-plkdx for pod openshift-network-diagnostics/network-check-target-x4gm9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 21 17:08:45.761047 ip-10-0-141-39 kubenswrapper[2575]: E0721 17:08:45.760988    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1f68ab07-c91d-4a29-8b72-cc76e3dd2753-kube-api-access-plkdx podName:1f68ab07-c91d-4a29-8b72-cc76e3dd2753 nodeName:}" failed. No retries permitted until 2026-07-21 17:09:01.760970256 +0000 UTC m=+34.215122892 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-plkdx" (UniqueName: "kubernetes.io/projected/1f68ab07-c91d-4a29-8b72-cc76e3dd2753-kube-api-access-plkdx") pod "network-check-target-x4gm9" (UID: "1f68ab07-c91d-4a29-8b72-cc76e3dd2753") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 21 17:08:46.111501 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:46.110921    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-n98c6"
Jul 21 17:08:46.111501 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:46.110971    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-x4gm9"
Jul 21 17:08:46.111501 ip-10-0-141-39 kubenswrapper[2575]: E0721 17:08:46.111073    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-n98c6" podUID="75e3f13b-b4dd-479c-b305-420ec10c39d7"
Jul 21 17:08:46.111501 ip-10-0-141-39 kubenswrapper[2575]: E0721 17:08:46.111206    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-x4gm9" podUID="1f68ab07-c91d-4a29-8b72-cc76e3dd2753"
Jul 21 17:08:47.111300 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:47.111253    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-44fbg"
Jul 21 17:08:47.111512 ip-10-0-141-39 kubenswrapper[2575]: E0721 17:08:47.111397    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-44fbg" podUID="7900e00a-7d30-4941-a177-1ce9da22deb3"
Jul 21 17:08:48.111814 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:48.111775    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-n98c6"
Jul 21 17:08:48.112251 ip-10-0-141-39 kubenswrapper[2575]: E0721 17:08:48.111900    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-n98c6" podUID="75e3f13b-b4dd-479c-b305-420ec10c39d7"
Jul 21 17:08:48.112251 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:48.111966    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-x4gm9"
Jul 21 17:08:48.112251 ip-10-0-141-39 kubenswrapper[2575]: E0721 17:08:48.112100    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-x4gm9" podUID="1f68ab07-c91d-4a29-8b72-cc76e3dd2753"
Jul 21 17:08:49.111215 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:49.111183    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-44fbg"
Jul 21 17:08:49.111398 ip-10-0-141-39 kubenswrapper[2575]: E0721 17:08:49.111326    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-44fbg" podUID="7900e00a-7d30-4941-a177-1ce9da22deb3"
Jul 21 17:08:50.111927 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:50.111600    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-n98c6"
Jul 21 17:08:50.112554 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:50.111646    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-x4gm9"
Jul 21 17:08:50.112554 ip-10-0-141-39 kubenswrapper[2575]: E0721 17:08:50.112056    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-n98c6" podUID="75e3f13b-b4dd-479c-b305-420ec10c39d7"
Jul 21 17:08:50.112554 ip-10-0-141-39 kubenswrapper[2575]: E0721 17:08:50.112094    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-x4gm9" podUID="1f68ab07-c91d-4a29-8b72-cc76e3dd2753"
Jul 21 17:08:50.247343 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:50.247318    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-hbwdq" event={"ID":"dacfd9ac-9516-4da2-ab9c-2629e4e6174e","Type":"ContainerStarted","Data":"c9c62174fd3a96f836d4be3da426cdfb0b4d913a939cc1deb1f3fc99b3021fad"}
Jul 21 17:08:50.249599 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:50.249581    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-b64gx_9425e519-d00c-4af6-a68a-3efde7aae5ba/ovn-acl-logging/0.log"
Jul 21 17:08:50.249852 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:50.249824    2575 generic.go:356] "Generic (PLEG): container finished" podID="9425e519-d00c-4af6-a68a-3efde7aae5ba" containerID="792e0aaa71cf2e76b9d3a53496e719e7b9fa02d4e4c4596422b6272edb8f6164" exitCode=1
Jul 21 17:08:50.249945 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:50.249890    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-b64gx" event={"ID":"9425e519-d00c-4af6-a68a-3efde7aae5ba","Type":"ContainerStarted","Data":"3b19c4d0f7cb61bcc33d2b7066e71b7354c7810cf2a9696ffb63368415668214"}
Jul 21 17:08:50.250016 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:50.249946    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-b64gx" event={"ID":"9425e519-d00c-4af6-a68a-3efde7aae5ba","Type":"ContainerStarted","Data":"cdb6f8f88e2d62b37a38b429b3cd4f16f8403a6e7037e625b64f429e9c9e738d"}
Jul 21 17:08:50.250016 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:50.249991    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-b64gx" event={"ID":"9425e519-d00c-4af6-a68a-3efde7aae5ba","Type":"ContainerStarted","Data":"539dd0f10566028b8af4fc29faff0a353d3e4c5c49199fa4ab53d862dbfd0808"}
Jul 21 17:08:50.250110 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:50.250024    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-b64gx" event={"ID":"9425e519-d00c-4af6-a68a-3efde7aae5ba","Type":"ContainerDied","Data":"792e0aaa71cf2e76b9d3a53496e719e7b9fa02d4e4c4596422b6272edb8f6164"}
Jul 21 17:08:50.250110 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:50.250053    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-b64gx" event={"ID":"9425e519-d00c-4af6-a68a-3efde7aae5ba","Type":"ContainerStarted","Data":"3b3b82cf2ffd332536fcfea98fb00ec4955c3f5772495ad81f65bc397e39b1d1"}
Jul 21 17:08:50.251273 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:50.251254    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-wzxwp" event={"ID":"0db4134e-c6f4-4665-9268-90a3569ccb73","Type":"ContainerStarted","Data":"55017a17b65b7878685354b7f6a0ff1d222db82e591df12bf0f1efccd5c18ff2"}
Jul 21 17:08:50.252676 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:50.252573    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-qmbvr" event={"ID":"7533c67e-e7ed-4836-8a8b-a670200cccba","Type":"ContainerStarted","Data":"c0f86169016464453f3e19f3a444b23f87317bbd5024023949caede9482dec0e"}
Jul 21 17:08:50.255065 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:50.254494    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-ctzzp" event={"ID":"2601f86a-f327-4d78-9407-eec87e925760","Type":"ContainerStarted","Data":"6993fa868f3245f0820c13c88fcf03ee88394482f6a75644ebea1ffd7b999469"}
Jul 21 17:08:50.257267 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:50.257243    2575 generic.go:356] "Generic (PLEG): container finished" podID="0af1b5ce-5a4d-4cc2-a9ef-ac31ed1f07ca" containerID="c840b4004307e0d870c9b8e9db0874a9608bb438e325b350d3c1287a948b5274" exitCode=0
Jul 21 17:08:50.257363 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:50.257305    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-jmsnn" event={"ID":"0af1b5ce-5a4d-4cc2-a9ef-ac31ed1f07ca","Type":"ContainerDied","Data":"c840b4004307e0d870c9b8e9db0874a9608bb438e325b350d3c1287a948b5274"}
Jul 21 17:08:50.259163 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:50.259133    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-d7gn6" event={"ID":"72cdbb9c-0664-46c0-ab7c-4f38ebd7644f","Type":"ContainerStarted","Data":"c8e137b75b1b7a16fe3c32e0a0f28a9af277d4474931f43644e21120e9204909"}
Jul 21 17:08:50.260782 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:50.260763    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g8b28" event={"ID":"c3efc748-d974-40f3-9d1a-031114d77366","Type":"ContainerStarted","Data":"d97e73aa01023c5bb9678b5993a712369385dc82ccf48cbac9dcdbafb33501c4"}
Jul 21 17:08:50.262342 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:50.262286    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-hbwdq" podStartSLOduration=11.507148427 podStartE2EDuration="22.262273409s" totalImagesPullingTime="10.755124982s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 17:08:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 17:08:50.262160928 +0000 UTC m=+22.716313570" watchObservedRunningTime="2026-07-21 17:08:50.262273409 +0000 UTC m=+22.716426050"
Jul 21 17:08:50.262465 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:50.262442    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-39.ec2.internal" podStartSLOduration=21.262434536 podStartE2EDuration="21.262434536s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-21 17:08:29 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 17:08:33.2488392 +0000 UTC m=+5.702991840" watchObservedRunningTime="2026-07-21 17:08:50.262434536 +0000 UTC m=+22.716587173"
Jul 21 17:08:50.279996 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:50.279953    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-ctzzp" podStartSLOduration=3.492097191 podStartE2EDuration="22.279927234s" totalImagesPullingTime="18.787830043s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-21 17:08:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 17:08:50.279305384 +0000 UTC m=+22.733458026" watchObservedRunningTime="2026-07-21 17:08:50.279927234 +0000 UTC m=+22.734079876"
Jul 21 17:08:50.326656 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:50.326599    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-wzxwp" podStartSLOduration=3.5091787229999998 podStartE2EDuration="22.326578875s" totalImagesPullingTime="18.817400152s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-21 17:08:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 17:08:50.326445183 +0000 UTC m=+22.780597822" watchObservedRunningTime="2026-07-21 17:08:50.326578875 +0000 UTC m=+22.780731515"
Jul 21 17:08:50.342855 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:50.342811    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-qmbvr" podStartSLOduration=3.2281967639999998 podStartE2EDuration="22.342796477s" totalImagesPullingTime="19.114599713s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-21 17:08:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 17:08:50.342578496 +0000 UTC m=+22.796731136" watchObservedRunningTime="2026-07-21 17:08:50.342796477 +0000 UTC m=+22.796949116"
Jul 21 17:08:50.358454 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:50.358386    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-d7gn6" podStartSLOduration=3.24793967 podStartE2EDuration="22.358367614s" totalImagesPullingTime="19.110427944s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-21 17:08:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 17:08:50.357959901 +0000 UTC m=+22.812112543" watchObservedRunningTime="2026-07-21 17:08:50.358367614 +0000 UTC m=+22.812520254"
Jul 21 17:08:51.111165 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:51.111137    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-44fbg"
Jul 21 17:08:51.111325 ip-10-0-141-39 kubenswrapper[2575]: E0721 17:08:51.111240    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-44fbg" podUID="7900e00a-7d30-4941-a177-1ce9da22deb3"
Jul 21 17:08:51.134965 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:51.134939    2575 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jul 21 17:08:51.265134 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:51.265045    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g8b28" event={"ID":"c3efc748-d974-40f3-9d1a-031114d77366","Type":"ContainerStarted","Data":"548d6dec1182205547e4ee3e56935d7df2d794049c526a1a7398a9cd92c47187"}
Jul 21 17:08:51.268053 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:51.268028    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-b64gx_9425e519-d00c-4af6-a68a-3efde7aae5ba/ovn-acl-logging/0.log"
Jul 21 17:08:51.268464 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:51.268439    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-b64gx" event={"ID":"9425e519-d00c-4af6-a68a-3efde7aae5ba","Type":"ContainerStarted","Data":"b27db218cd8aaab1fca214273091f15b0ecf6b011bc4b9134a085fbd19927893"}
Jul 21 17:08:51.269972 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:51.269930    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-wgb8q" event={"ID":"cb1081a1-16da-4e6f-b099-62ae771c79c1","Type":"ContainerStarted","Data":"e43746be4268746e57982c8e872ec3ef2619e203641da1146990532ab0f95b2d"}
Jul 21 17:08:51.286603 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:51.286563    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-wgb8q" podStartSLOduration=12.52187663 podStartE2EDuration="23.286551511s" totalImagesPullingTime="10.764674881s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-21 17:08:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 17:08:51.286476546 +0000 UTC m=+23.740629193" watchObservedRunningTime="2026-07-21 17:08:51.286551511 +0000 UTC m=+23.740704150"
Jul 21 17:08:51.982604 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:51.982479    2575 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-21T17:08:51.134957118Z","UUID":"9c9938e5-c690-4cbc-aef8-2a28ce95894c","Handler":null,"Name":"","Endpoint":""}
Jul 21 17:08:51.983822 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:51.983805    2575 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jul 21 17:08:51.983949 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:51.983838    2575 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jul 21 17:08:52.110633 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:52.110604    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-n98c6"
Jul 21 17:08:52.110766 ip-10-0-141-39 kubenswrapper[2575]: E0721 17:08:52.110744    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-n98c6" podUID="75e3f13b-b4dd-479c-b305-420ec10c39d7"
Jul 21 17:08:52.110804 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:52.110788    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-x4gm9"
Jul 21 17:08:52.110887 ip-10-0-141-39 kubenswrapper[2575]: E0721 17:08:52.110871    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-x4gm9" podUID="1f68ab07-c91d-4a29-8b72-cc76e3dd2753"
Jul 21 17:08:52.273997 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:52.273921    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g8b28" event={"ID":"c3efc748-d974-40f3-9d1a-031114d77366","Type":"ContainerStarted","Data":"761d6c5ac91ff2b13b8583600ba5a6e03ff128261635240f6d89ea8b151109b9"}
Jul 21 17:08:52.282179 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:52.282158    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-hbwdq"
Jul 21 17:08:52.282668 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:52.282650    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-hbwdq"
Jul 21 17:08:52.295670 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:52.295626    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g8b28" podStartSLOduration=3.133848167 podStartE2EDuration="24.295608036s" totalImagesPullingTime="21.161759869s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-21 17:08:28 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 17:08:52.294973259 +0000 UTC m=+24.749125899" watchObservedRunningTime="2026-07-21 17:08:52.295608036 +0000 UTC m=+24.749760678"
Jul 21 17:08:53.110997 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:53.110963    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-44fbg"
Jul 21 17:08:53.111139 ip-10-0-141-39 kubenswrapper[2575]: E0721 17:08:53.111077    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-44fbg" podUID="7900e00a-7d30-4941-a177-1ce9da22deb3"
Jul 21 17:08:53.280158 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:53.279980    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-b64gx_9425e519-d00c-4af6-a68a-3efde7aae5ba/ovn-acl-logging/0.log"
Jul 21 17:08:53.280710 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:53.280605    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-b64gx" event={"ID":"9425e519-d00c-4af6-a68a-3efde7aae5ba","Type":"ContainerStarted","Data":"e461c2d5b659df0b730d09aaa804fb6e3d8d08a4422611b762a6778b4a49d516"}
Jul 21 17:08:53.280876 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:53.280856    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-hbwdq"
Jul 21 17:08:53.281308 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:53.281290    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-hbwdq"
Jul 21 17:08:54.110867 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:54.110829    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-n98c6"
Jul 21 17:08:54.111049 ip-10-0-141-39 kubenswrapper[2575]: E0721 17:08:54.110945    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-n98c6" podUID="75e3f13b-b4dd-479c-b305-420ec10c39d7"
Jul 21 17:08:54.111049 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:54.111010    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-x4gm9"
Jul 21 17:08:54.111164 ip-10-0-141-39 kubenswrapper[2575]: E0721 17:08:54.111116    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-x4gm9" podUID="1f68ab07-c91d-4a29-8b72-cc76e3dd2753"
Jul 21 17:08:55.110764 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:55.110728    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-44fbg"
Jul 21 17:08:55.111453 ip-10-0-141-39 kubenswrapper[2575]: E0721 17:08:55.110851    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-44fbg" podUID="7900e00a-7d30-4941-a177-1ce9da22deb3"
Jul 21 17:08:55.289226 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:55.289197    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-b64gx_9425e519-d00c-4af6-a68a-3efde7aae5ba/ovn-acl-logging/0.log"
Jul 21 17:08:55.289569 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:55.289548    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-b64gx" event={"ID":"9425e519-d00c-4af6-a68a-3efde7aae5ba","Type":"ContainerStarted","Data":"9ccdf8e0c1bfa3fda07e8345ea13838b27defdb632dbee127247c088ac6132da"}
Jul 21 17:08:55.290065 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:55.290044    2575 scope.go:117] "RemoveContainer" containerID="792e0aaa71cf2e76b9d3a53496e719e7b9fa02d4e4c4596422b6272edb8f6164"
Jul 21 17:08:56.110687 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:56.110510    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-n98c6"
Jul 21 17:08:56.110880 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:56.110510    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-x4gm9"
Jul 21 17:08:56.110880 ip-10-0-141-39 kubenswrapper[2575]: E0721 17:08:56.110787    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-n98c6" podUID="75e3f13b-b4dd-479c-b305-420ec10c39d7"
Jul 21 17:08:56.110880 ip-10-0-141-39 kubenswrapper[2575]: E0721 17:08:56.110824    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-x4gm9" podUID="1f68ab07-c91d-4a29-8b72-cc76e3dd2753"
Jul 21 17:08:56.295755 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:56.295729    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-b64gx_9425e519-d00c-4af6-a68a-3efde7aae5ba/ovn-acl-logging/0.log"
Jul 21 17:08:56.296124 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:56.296093    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-b64gx" event={"ID":"9425e519-d00c-4af6-a68a-3efde7aae5ba","Type":"ContainerStarted","Data":"658756c642757b79e70f78b412aa63abc6f6da653945851626e5c7aa08c8367a"}
Jul 21 17:08:56.296266 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:56.296202    2575 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness"
Jul 21 17:08:56.296464 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:56.296444    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-b64gx"
Jul 21 17:08:56.296528 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:56.296506    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-b64gx"
Jul 21 17:08:56.314527 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:56.314499    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-b64gx"
Jul 21 17:08:56.314664 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:56.314618    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-b64gx"
Jul 21 17:08:56.330332 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:56.330283    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-b64gx" podStartSLOduration=9.157096308 podStartE2EDuration="28.330268846s" totalImagesPullingTime="19.173172538s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-21 17:08:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 17:08:56.329987089 +0000 UTC m=+28.784139743" watchObservedRunningTime="2026-07-21 17:08:56.330268846 +0000 UTC m=+28.784421485"
Jul 21 17:08:56.626209 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:56.626126    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-44fbg"]
Jul 21 17:08:56.626348 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:56.626261    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-44fbg"
Jul 21 17:08:56.626398 ip-10-0-141-39 kubenswrapper[2575]: E0721 17:08:56.626354    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-44fbg" podUID="7900e00a-7d30-4941-a177-1ce9da22deb3"
Jul 21 17:08:56.629094 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:56.629064    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-n98c6"]
Jul 21 17:08:56.629211 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:56.629189    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-n98c6"
Jul 21 17:08:56.629318 ip-10-0-141-39 kubenswrapper[2575]: E0721 17:08:56.629291    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-n98c6" podUID="75e3f13b-b4dd-479c-b305-420ec10c39d7"
Jul 21 17:08:56.642124 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:56.642095    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-x4gm9"]
Jul 21 17:08:56.642256 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:56.642212    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-x4gm9"
Jul 21 17:08:56.642335 ip-10-0-141-39 kubenswrapper[2575]: E0721 17:08:56.642315    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-x4gm9" podUID="1f68ab07-c91d-4a29-8b72-cc76e3dd2753"
Jul 21 17:08:57.298328 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:57.298300    2575 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness"
Jul 21 17:08:58.089386 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:58.089352    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-b64gx"
Jul 21 17:08:58.111606 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:58.111566    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-n98c6"
Jul 21 17:08:58.111765 ip-10-0-141-39 kubenswrapper[2575]: E0721 17:08:58.111724    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-n98c6" podUID="75e3f13b-b4dd-479c-b305-420ec10c39d7"
Jul 21 17:08:58.111765 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:58.111741    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-44fbg"
Jul 21 17:08:58.111942 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:58.111741    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-x4gm9"
Jul 21 17:08:58.111942 ip-10-0-141-39 kubenswrapper[2575]: E0721 17:08:58.111842    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-44fbg" podUID="7900e00a-7d30-4941-a177-1ce9da22deb3"
Jul 21 17:08:58.111942 ip-10-0-141-39 kubenswrapper[2575]: E0721 17:08:58.111901    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-x4gm9" podUID="1f68ab07-c91d-4a29-8b72-cc76e3dd2753"
Jul 21 17:08:59.305362 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:59.305328    2575 generic.go:356] "Generic (PLEG): container finished" podID="0af1b5ce-5a4d-4cc2-a9ef-ac31ed1f07ca" containerID="09c6c6a3f9da5300c79a07e28da0c574357f549d71f67a05704daa8bc91acb0a" exitCode=0
Jul 21 17:08:59.305718 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:59.305432    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-jmsnn" event={"ID":"0af1b5ce-5a4d-4cc2-a9ef-ac31ed1f07ca","Type":"ContainerDied","Data":"09c6c6a3f9da5300c79a07e28da0c574357f549d71f67a05704daa8bc91acb0a"}
Jul 21 17:08:59.318394 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:08:59.318173    2575 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ovn-kubernetes/ovnkube-node-b64gx" podUID="9425e519-d00c-4af6-a68a-3efde7aae5ba" containerName="ovnkube-controller" probeResult="failure" output=""
Jul 21 17:09:00.111478 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:09:00.111437    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-44fbg"
Jul 21 17:09:00.111654 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:09:00.111452    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-n98c6"
Jul 21 17:09:00.111654 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:09:00.111579    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-x4gm9"
Jul 21 17:09:00.111654 ip-10-0-141-39 kubenswrapper[2575]: E0721 17:09:00.111568    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-44fbg" podUID="7900e00a-7d30-4941-a177-1ce9da22deb3"
Jul 21 17:09:00.111792 ip-10-0-141-39 kubenswrapper[2575]: E0721 17:09:00.111716    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-n98c6" podUID="75e3f13b-b4dd-479c-b305-420ec10c39d7"
Jul 21 17:09:00.111839 ip-10-0-141-39 kubenswrapper[2575]: E0721 17:09:00.111802    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-x4gm9" podUID="1f68ab07-c91d-4a29-8b72-cc76e3dd2753"
Jul 21 17:09:00.309775 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:09:00.309739    2575 generic.go:356] "Generic (PLEG): container finished" podID="0af1b5ce-5a4d-4cc2-a9ef-ac31ed1f07ca" containerID="f59466f3c7c28bb8c73bf1fb5df837d96aaa76d46424bad37e397e87d9bb538c" exitCode=0
Jul 21 17:09:00.310133 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:09:00.309808    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-jmsnn" event={"ID":"0af1b5ce-5a4d-4cc2-a9ef-ac31ed1f07ca","Type":"ContainerDied","Data":"f59466f3c7c28bb8c73bf1fb5df837d96aaa76d46424bad37e397e87d9bb538c"}
Jul 21 17:09:01.677230 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:09:01.677204    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7900e00a-7d30-4941-a177-1ce9da22deb3-original-pull-secret\") pod \"global-pull-secret-syncer-44fbg\" (UID: \"7900e00a-7d30-4941-a177-1ce9da22deb3\") " pod="kube-system/global-pull-secret-syncer-44fbg"
Jul 21 17:09:01.677716 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:09:01.677244    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/75e3f13b-b4dd-479c-b305-420ec10c39d7-metrics-certs\") pod \"network-metrics-daemon-n98c6\" (UID: \"75e3f13b-b4dd-479c-b305-420ec10c39d7\") " pod="openshift-multus/network-metrics-daemon-n98c6"
Jul 21 17:09:01.677716 ip-10-0-141-39 kubenswrapper[2575]: E0721 17:09:01.677336    2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 21 17:09:01.677716 ip-10-0-141-39 kubenswrapper[2575]: E0721 17:09:01.677337    2575 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 21 17:09:01.677716 ip-10-0-141-39 kubenswrapper[2575]: E0721 17:09:01.677383    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/75e3f13b-b4dd-479c-b305-420ec10c39d7-metrics-certs podName:75e3f13b-b4dd-479c-b305-420ec10c39d7 nodeName:}" failed. No retries permitted until 2026-07-21 17:09:33.677369356 +0000 UTC m=+66.131521974 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/75e3f13b-b4dd-479c-b305-420ec10c39d7-metrics-certs") pod "network-metrics-daemon-n98c6" (UID: "75e3f13b-b4dd-479c-b305-420ec10c39d7") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 21 17:09:01.677716 ip-10-0-141-39 kubenswrapper[2575]: E0721 17:09:01.677394    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7900e00a-7d30-4941-a177-1ce9da22deb3-original-pull-secret podName:7900e00a-7d30-4941-a177-1ce9da22deb3 nodeName:}" failed. No retries permitted until 2026-07-21 17:09:33.677388466 +0000 UTC m=+66.131541083 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/7900e00a-7d30-4941-a177-1ce9da22deb3-original-pull-secret") pod "global-pull-secret-syncer-44fbg" (UID: "7900e00a-7d30-4941-a177-1ce9da22deb3") : object "kube-system"/"original-pull-secret" not registered
Jul 21 17:09:01.777916 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:09:01.777829    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-plkdx\" (UniqueName: \"kubernetes.io/projected/1f68ab07-c91d-4a29-8b72-cc76e3dd2753-kube-api-access-plkdx\") pod \"network-check-target-x4gm9\" (UID: \"1f68ab07-c91d-4a29-8b72-cc76e3dd2753\") " pod="openshift-network-diagnostics/network-check-target-x4gm9"
Jul 21 17:09:01.778074 ip-10-0-141-39 kubenswrapper[2575]: E0721 17:09:01.777979    2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 21 17:09:01.778074 ip-10-0-141-39 kubenswrapper[2575]: E0721 17:09:01.777998    2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 21 17:09:01.778074 ip-10-0-141-39 kubenswrapper[2575]: E0721 17:09:01.778009    2575 projected.go:196] Error preparing data for projected volume kube-api-access-plkdx for pod openshift-network-diagnostics/network-check-target-x4gm9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 21 17:09:01.778074 ip-10-0-141-39 kubenswrapper[2575]: E0721 17:09:01.778069    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1f68ab07-c91d-4a29-8b72-cc76e3dd2753-kube-api-access-plkdx podName:1f68ab07-c91d-4a29-8b72-cc76e3dd2753 nodeName:}" failed. No retries permitted until 2026-07-21 17:09:33.778051835 +0000 UTC m=+66.232204459 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-plkdx" (UniqueName: "kubernetes.io/projected/1f68ab07-c91d-4a29-8b72-cc76e3dd2753-kube-api-access-plkdx") pod "network-check-target-x4gm9" (UID: "1f68ab07-c91d-4a29-8b72-cc76e3dd2753") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 21 17:09:02.111114 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:09:02.111031    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-44fbg"
Jul 21 17:09:02.111255 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:09:02.111038    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-n98c6"
Jul 21 17:09:02.111255 ip-10-0-141-39 kubenswrapper[2575]: E0721 17:09:02.111140    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-44fbg" podUID="7900e00a-7d30-4941-a177-1ce9da22deb3"
Jul 21 17:09:02.111255 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:09:02.111159    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-x4gm9"
Jul 21 17:09:02.111355 ip-10-0-141-39 kubenswrapper[2575]: E0721 17:09:02.111273    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-n98c6" podUID="75e3f13b-b4dd-479c-b305-420ec10c39d7"
Jul 21 17:09:02.111398 ip-10-0-141-39 kubenswrapper[2575]: E0721 17:09:02.111378    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-x4gm9" podUID="1f68ab07-c91d-4a29-8b72-cc76e3dd2753"
Jul 21 17:09:02.316425 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:09:02.316386    2575 generic.go:356] "Generic (PLEG): container finished" podID="0af1b5ce-5a4d-4cc2-a9ef-ac31ed1f07ca" containerID="78c6661da9539b20bab2a7ffc69f7ac34d4838c493886b51a2c12cea53f35980" exitCode=0
Jul 21 17:09:02.316575 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:09:02.316441    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-jmsnn" event={"ID":"0af1b5ce-5a4d-4cc2-a9ef-ac31ed1f07ca","Type":"ContainerDied","Data":"78c6661da9539b20bab2a7ffc69f7ac34d4838c493886b51a2c12cea53f35980"}
Jul 21 17:09:02.369082 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:09:02.369018    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-39.ec2.internal" event="NodeReady"
Jul 21 17:09:02.369204 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:09:02.369138    2575 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jul 21 17:09:02.446770 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:09:02.446743    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-bc6dr"]
Jul 21 17:09:02.448676 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:09:02.448661    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-bc6dr"
Jul 21 17:09:02.453853 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:09:02.453828    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 21 17:09:02.454017 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:09:02.453870    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-jzcnj\""
Jul 21 17:09:02.454017 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:09:02.453871    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 21 17:09:02.454017 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:09:02.453991    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 21 17:09:02.455458 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:09:02.455441    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-bqg65"]
Jul 21 17:09:02.457117 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:09:02.457099    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-bqg65"
Jul 21 17:09:02.477446 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:09:02.477427    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 21 17:09:02.478008 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:09:02.477995    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 21 17:09:02.479726 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:09:02.479709    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-bn6n8\""
Jul 21 17:09:02.506813 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:09:02.506791    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-bqg65"]
Jul 21 17:09:02.518768 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:09:02.518747    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-bc6dr"]
Jul 21 17:09:02.582995 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:09:02.582965    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bb79e03c-062a-4642-8d8c-7803a581a97a-tmp-dir\") pod \"dns-default-bqg65\" (UID: \"bb79e03c-062a-4642-8d8c-7803a581a97a\") " pod="openshift-dns/dns-default-bqg65"
Jul 21 17:09:02.583136 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:09:02.583001    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/93f2422b-be81-4dc7-8d57-5a51f0cd2c55-cert\") pod \"ingress-canary-bc6dr\" (UID: \"93f2422b-be81-4dc7-8d57-5a51f0cd2c55\") " pod="openshift-ingress-canary/ingress-canary-bc6dr"
Jul 21 17:09:02.583136 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:09:02.583025    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/bb79e03c-062a-4642-8d8c-7803a581a97a-config-volume\") pod \"dns-default-bqg65\" (UID: \"bb79e03c-062a-4642-8d8c-7803a581a97a\") " pod="openshift-dns/dns-default-bqg65"
Jul 21 17:09:02.583207 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:09:02.583132    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/bb79e03c-062a-4642-8d8c-7803a581a97a-metrics-tls\") pod \"dns-default-bqg65\" (UID: \"bb79e03c-062a-4642-8d8c-7803a581a97a\") " pod="openshift-dns/dns-default-bqg65"
Jul 21 17:09:02.583207 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:09:02.583156    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ff5pw\" (UniqueName: \"kubernetes.io/projected/bb79e03c-062a-4642-8d8c-7803a581a97a-kube-api-access-ff5pw\") pod \"dns-default-bqg65\" (UID: \"bb79e03c-062a-4642-8d8c-7803a581a97a\") " pod="openshift-dns/dns-default-bqg65"
Jul 21 17:09:02.583207 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:09:02.583175    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sklrx\" (UniqueName: \"kubernetes.io/projected/93f2422b-be81-4dc7-8d57-5a51f0cd2c55-kube-api-access-sklrx\") pod \"ingress-canary-bc6dr\" (UID: \"93f2422b-be81-4dc7-8d57-5a51f0cd2c55\") " pod="openshift-ingress-canary/ingress-canary-bc6dr"
Jul 21 17:09:02.684146 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:09:02.684055    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bb79e03c-062a-4642-8d8c-7803a581a97a-tmp-dir\") pod \"dns-default-bqg65\" (UID: \"bb79e03c-062a-4642-8d8c-7803a581a97a\") " pod="openshift-dns/dns-default-bqg65"
Jul 21 17:09:02.684146 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:09:02.684089    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/93f2422b-be81-4dc7-8d57-5a51f0cd2c55-cert\") pod \"ingress-canary-bc6dr\" (UID: \"93f2422b-be81-4dc7-8d57-5a51f0cd2c55\") " pod="openshift-ingress-canary/ingress-canary-bc6dr"
Jul 21 17:09:02.684146 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:09:02.684107    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/bb79e03c-062a-4642-8d8c-7803a581a97a-config-volume\") pod \"dns-default-bqg65\" (UID: \"bb79e03c-062a-4642-8d8c-7803a581a97a\") " pod="openshift-dns/dns-default-bqg65"
Jul 21 17:09:02.684675 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:09:02.684172    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/bb79e03c-062a-4642-8d8c-7803a581a97a-metrics-tls\") pod \"dns-default-bqg65\" (UID: \"bb79e03c-062a-4642-8d8c-7803a581a97a\") " pod="openshift-dns/dns-default-bqg65"
Jul 21 17:09:02.684675 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:09:02.684188    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ff5pw\" (UniqueName: \"kubernetes.io/projected/bb79e03c-062a-4642-8d8c-7803a581a97a-kube-api-access-ff5pw\") pod \"dns-default-bqg65\" (UID: \"bb79e03c-062a-4642-8d8c-7803a581a97a\") " pod="openshift-dns/dns-default-bqg65"
Jul 21 17:09:02.684675 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:09:02.684213    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sklrx\" (UniqueName: \"kubernetes.io/projected/93f2422b-be81-4dc7-8d57-5a51f0cd2c55-kube-api-access-sklrx\") pod \"ingress-canary-bc6dr\" (UID: \"93f2422b-be81-4dc7-8d57-5a51f0cd2c55\") " pod="openshift-ingress-canary/ingress-canary-bc6dr"
Jul 21 17:09:02.684675 ip-10-0-141-39 kubenswrapper[2575]: E0721 17:09:02.684323    2575 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 21 17:09:02.684675 ip-10-0-141-39 kubenswrapper[2575]: E0721 17:09:02.684399    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bb79e03c-062a-4642-8d8c-7803a581a97a-metrics-tls podName:bb79e03c-062a-4642-8d8c-7803a581a97a nodeName:}" failed. No retries permitted until 2026-07-21 17:09:03.184376698 +0000 UTC m=+35.638529333 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/bb79e03c-062a-4642-8d8c-7803a581a97a-metrics-tls") pod "dns-default-bqg65" (UID: "bb79e03c-062a-4642-8d8c-7803a581a97a") : secret "dns-default-metrics-tls" not found
Jul 21 17:09:02.684675 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:09:02.684461    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bb79e03c-062a-4642-8d8c-7803a581a97a-tmp-dir\") pod \"dns-default-bqg65\" (UID: \"bb79e03c-062a-4642-8d8c-7803a581a97a\") " pod="openshift-dns/dns-default-bqg65"
Jul 21 17:09:02.684860 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:09:02.684714    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/bb79e03c-062a-4642-8d8c-7803a581a97a-config-volume\") pod \"dns-default-bqg65\" (UID: \"bb79e03c-062a-4642-8d8c-7803a581a97a\") " pod="openshift-dns/dns-default-bqg65"
Jul 21 17:09:02.688581 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:09:02.688563    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/93f2422b-be81-4dc7-8d57-5a51f0cd2c55-cert\") pod \"ingress-canary-bc6dr\" (UID: \"93f2422b-be81-4dc7-8d57-5a51f0cd2c55\") " pod="openshift-ingress-canary/ingress-canary-bc6dr"
Jul 21 17:09:02.702033 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:09:02.702004    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sklrx\" (UniqueName: \"kubernetes.io/projected/93f2422b-be81-4dc7-8d57-5a51f0cd2c55-kube-api-access-sklrx\") pod \"ingress-canary-bc6dr\" (UID: \"93f2422b-be81-4dc7-8d57-5a51f0cd2c55\") " pod="openshift-ingress-canary/ingress-canary-bc6dr"
Jul 21 17:09:02.702372 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:09:02.702357    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ff5pw\" (UniqueName: \"kubernetes.io/projected/bb79e03c-062a-4642-8d8c-7803a581a97a-kube-api-access-ff5pw\") pod \"dns-default-bqg65\" (UID: \"bb79e03c-062a-4642-8d8c-7803a581a97a\") " pod="openshift-dns/dns-default-bqg65"
Jul 21 17:09:02.757520 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:09:02.757483    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-bc6dr"
Jul 21 17:09:02.913640 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:09:02.913614    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-bc6dr"]
Jul 21 17:09:02.917190 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:09:02.917160    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod93f2422b_be81_4dc7_8d57_5a51f0cd2c55.slice/crio-c974536a111e3c088012d29944dc2c603d99eef17e3355b33d4039e6418b86fa WatchSource:0}: Error finding container c974536a111e3c088012d29944dc2c603d99eef17e3355b33d4039e6418b86fa: Status 404 returned error can't find the container with id c974536a111e3c088012d29944dc2c603d99eef17e3355b33d4039e6418b86fa
Jul 21 17:09:03.006347 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:09:03.006318    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-tg868"]
Jul 21 17:09:03.022384 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:09:03.022199    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-tg868"
Jul 21 17:09:03.026158 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:09:03.026138    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\""
Jul 21 17:09:03.026361 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:09:03.026341    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-fgll9\""
Jul 21 17:09:03.026486 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:09:03.026438    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\""
Jul 21 17:09:03.036673 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:09:03.036651    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-tg868"]
Jul 21 17:09:03.135667 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:09:03.135628    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-84m9r"]
Jul 21 17:09:03.139725 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:09:03.139703    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-84m9r"
Jul 21 17:09:03.145952 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:09:03.145930    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 21 17:09:03.146078 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:09:03.146044    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 21 17:09:03.146078 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:09:03.145932    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 21 17:09:03.146332 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:09:03.146315    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 21 17:09:03.146596 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:09:03.146579    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-t495x\""
Jul 21 17:09:03.168206 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:09:03.168137    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-84m9r"]
Jul 21 17:09:03.187893 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:09:03.187845    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t24g5\" (UniqueName: \"kubernetes.io/projected/123fc2cb-18cb-4992-a1f3-b764922b6e3d-kube-api-access-t24g5\") pod \"migrator-7cc9c7ffd7-tg868\" (UID: \"123fc2cb-18cb-4992-a1f3-b764922b6e3d\") " pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-tg868"
Jul 21 17:09:03.188072 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:09:03.187939    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/bb79e03c-062a-4642-8d8c-7803a581a97a-metrics-tls\") pod \"dns-default-bqg65\" (UID: \"bb79e03c-062a-4642-8d8c-7803a581a97a\") " pod="openshift-dns/dns-default-bqg65"
Jul 21 17:09:03.188127 ip-10-0-141-39 kubenswrapper[2575]: E0721 17:09:03.188096    2575 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 21 17:09:03.188165 ip-10-0-141-39 kubenswrapper[2575]: E0721 17:09:03.188158    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bb79e03c-062a-4642-8d8c-7803a581a97a-metrics-tls podName:bb79e03c-062a-4642-8d8c-7803a581a97a nodeName:}" failed. No retries permitted until 2026-07-21 17:09:04.188138526 +0000 UTC m=+36.642291159 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/bb79e03c-062a-4642-8d8c-7803a581a97a-metrics-tls") pod "dns-default-bqg65" (UID: "bb79e03c-062a-4642-8d8c-7803a581a97a") : secret "dns-default-metrics-tls" not found
Jul 21 17:09:03.289449 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:09:03.289310    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/3928ed50-aedd-4f2b-bc1f-cea69ea7b4b2-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-84m9r\" (UID: \"3928ed50-aedd-4f2b-bc1f-cea69ea7b4b2\") " pod="openshift-insights/insights-runtime-extractor-84m9r"
Jul 21 17:09:03.289449 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:09:03.289367    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t24g5\" (UniqueName: \"kubernetes.io/projected/123fc2cb-18cb-4992-a1f3-b764922b6e3d-kube-api-access-t24g5\") pod \"migrator-7cc9c7ffd7-tg868\" (UID: \"123fc2cb-18cb-4992-a1f3-b764922b6e3d\") " pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-tg868"
Jul 21 17:09:03.289656 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:09:03.289539    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/3928ed50-aedd-4f2b-bc1f-cea69ea7b4b2-crio-socket\") pod \"insights-runtime-extractor-84m9r\" (UID: \"3928ed50-aedd-4f2b-bc1f-cea69ea7b4b2\") " pod="openshift-insights/insights-runtime-extractor-84m9r"
Jul 21 17:09:03.289656 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:09:03.289581    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/3928ed50-aedd-4f2b-bc1f-cea69ea7b4b2-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-84m9r\" (UID: \"3928ed50-aedd-4f2b-bc1f-cea69ea7b4b2\") " pod="openshift-insights/insights-runtime-extractor-84m9r"
Jul 21 17:09:03.289656 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:09:03.289629    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/3928ed50-aedd-4f2b-bc1f-cea69ea7b4b2-data-volume\") pod \"insights-runtime-extractor-84m9r\" (UID: \"3928ed50-aedd-4f2b-bc1f-cea69ea7b4b2\") " pod="openshift-insights/insights-runtime-extractor-84m9r"
Jul 21 17:09:03.289822 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:09:03.289658    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mk9hp\" (UniqueName: \"kubernetes.io/projected/3928ed50-aedd-4f2b-bc1f-cea69ea7b4b2-kube-api-access-mk9hp\") pod \"insights-runtime-extractor-84m9r\" (UID: \"3928ed50-aedd-4f2b-bc1f-cea69ea7b4b2\") " pod="openshift-insights/insights-runtime-extractor-84m9r"
Jul 21 17:09:03.313380 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:09:03.313358    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t24g5\" (UniqueName: \"kubernetes.io/projected/123fc2cb-18cb-4992-a1f3-b764922b6e3d-kube-api-access-t24g5\") pod \"migrator-7cc9c7ffd7-tg868\" (UID: \"123fc2cb-18cb-4992-a1f3-b764922b6e3d\") " pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-tg868"
Jul 21 17:09:03.320869 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:09:03.320841    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-bc6dr" event={"ID":"93f2422b-be81-4dc7-8d57-5a51f0cd2c55","Type":"ContainerStarted","Data":"c974536a111e3c088012d29944dc2c603d99eef17e3355b33d4039e6418b86fa"}
Jul 21 17:09:03.333137 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:09:03.333109    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-tg868"
Jul 21 17:09:03.390886 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:09:03.390851    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/3928ed50-aedd-4f2b-bc1f-cea69ea7b4b2-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-84m9r\" (UID: \"3928ed50-aedd-4f2b-bc1f-cea69ea7b4b2\") " pod="openshift-insights/insights-runtime-extractor-84m9r"
Jul 21 17:09:03.391069 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:09:03.390951    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/3928ed50-aedd-4f2b-bc1f-cea69ea7b4b2-crio-socket\") pod \"insights-runtime-extractor-84m9r\" (UID: \"3928ed50-aedd-4f2b-bc1f-cea69ea7b4b2\") " pod="openshift-insights/insights-runtime-extractor-84m9r"
Jul 21 17:09:03.391069 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:09:03.390979    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/3928ed50-aedd-4f2b-bc1f-cea69ea7b4b2-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-84m9r\" (UID: \"3928ed50-aedd-4f2b-bc1f-cea69ea7b4b2\") " pod="openshift-insights/insights-runtime-extractor-84m9r"
Jul 21 17:09:03.391069 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:09:03.391024    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/3928ed50-aedd-4f2b-bc1f-cea69ea7b4b2-data-volume\") pod \"insights-runtime-extractor-84m9r\" (UID: \"3928ed50-aedd-4f2b-bc1f-cea69ea7b4b2\") " pod="openshift-insights/insights-runtime-extractor-84m9r"
Jul 21 17:09:03.391069 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:09:03.391052    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mk9hp\" (UniqueName: \"kubernetes.io/projected/3928ed50-aedd-4f2b-bc1f-cea69ea7b4b2-kube-api-access-mk9hp\") pod \"insights-runtime-extractor-84m9r\" (UID: \"3928ed50-aedd-4f2b-bc1f-cea69ea7b4b2\") " pod="openshift-insights/insights-runtime-extractor-84m9r"
Jul 21 17:09:03.391494 ip-10-0-141-39 kubenswrapper[2575]: E0721 17:09:03.391472    2575 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 21 17:09:03.391602 ip-10-0-141-39 kubenswrapper[2575]: E0721 17:09:03.391498    2575 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 21 17:09:03.391602 ip-10-0-141-39 kubenswrapper[2575]: E0721 17:09:03.391559    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/3928ed50-aedd-4f2b-bc1f-cea69ea7b4b2-kube-rbac-proxy-cm podName:3928ed50-aedd-4f2b-bc1f-cea69ea7b4b2 nodeName:}" failed. No retries permitted until 2026-07-21 17:09:03.891538488 +0000 UTC m=+36.345691127 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/3928ed50-aedd-4f2b-bc1f-cea69ea7b4b2-kube-rbac-proxy-cm") pod "insights-runtime-extractor-84m9r" (UID: "3928ed50-aedd-4f2b-bc1f-cea69ea7b4b2") : configmap "kube-rbac-proxy" not found
Jul 21 17:09:03.391602 ip-10-0-141-39 kubenswrapper[2575]: E0721 17:09:03.391578    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3928ed50-aedd-4f2b-bc1f-cea69ea7b4b2-insights-runtime-extractor-tls podName:3928ed50-aedd-4f2b-bc1f-cea69ea7b4b2 nodeName:}" failed. No retries permitted until 2026-07-21 17:09:03.891568339 +0000 UTC m=+36.345720962 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/3928ed50-aedd-4f2b-bc1f-cea69ea7b4b2-insights-runtime-extractor-tls") pod "insights-runtime-extractor-84m9r" (UID: "3928ed50-aedd-4f2b-bc1f-cea69ea7b4b2") : secret "insights-runtime-extractor-tls" not found
Jul 21 17:09:03.391882 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:09:03.391614    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/3928ed50-aedd-4f2b-bc1f-cea69ea7b4b2-crio-socket\") pod \"insights-runtime-extractor-84m9r\" (UID: \"3928ed50-aedd-4f2b-bc1f-cea69ea7b4b2\") " pod="openshift-insights/insights-runtime-extractor-84m9r"
Jul 21 17:09:03.391882 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:09:03.391687    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/3928ed50-aedd-4f2b-bc1f-cea69ea7b4b2-data-volume\") pod \"insights-runtime-extractor-84m9r\" (UID: \"3928ed50-aedd-4f2b-bc1f-cea69ea7b4b2\") " pod="openshift-insights/insights-runtime-extractor-84m9r"
Jul 21 17:09:03.412136 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:09:03.412102    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mk9hp\" (UniqueName: \"kubernetes.io/projected/3928ed50-aedd-4f2b-bc1f-cea69ea7b4b2-kube-api-access-mk9hp\") pod \"insights-runtime-extractor-84m9r\" (UID: \"3928ed50-aedd-4f2b-bc1f-cea69ea7b4b2\") " pod="openshift-insights/insights-runtime-extractor-84m9r"
Jul 21 17:09:03.507709 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:09:03.507640    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-tg868"]
Jul 21 17:09:03.511856 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:09:03.511737    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod123fc2cb_18cb_4992_a1f3_b764922b6e3d.slice/crio-7c2f747794a26754d58ada2d4fd47b5f28685b378a5ccd12ec1dea74354c30dc WatchSource:0}: Error finding container 7c2f747794a26754d58ada2d4fd47b5f28685b378a5ccd12ec1dea74354c30dc: Status 404 returned error can't find the container with id 7c2f747794a26754d58ada2d4fd47b5f28685b378a5ccd12ec1dea74354c30dc
Jul 21 17:09:03.895631 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:09:03.895594    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/3928ed50-aedd-4f2b-bc1f-cea69ea7b4b2-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-84m9r\" (UID: \"3928ed50-aedd-4f2b-bc1f-cea69ea7b4b2\") " pod="openshift-insights/insights-runtime-extractor-84m9r"
Jul 21 17:09:03.896338 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:09:03.895676    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/3928ed50-aedd-4f2b-bc1f-cea69ea7b4b2-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-84m9r\" (UID: \"3928ed50-aedd-4f2b-bc1f-cea69ea7b4b2\") " pod="openshift-insights/insights-runtime-extractor-84m9r"
Jul 21 17:09:03.896338 ip-10-0-141-39 kubenswrapper[2575]: E0721 17:09:03.895820    2575 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 21 17:09:03.896338 ip-10-0-141-39 kubenswrapper[2575]: E0721 17:09:03.895888    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3928ed50-aedd-4f2b-bc1f-cea69ea7b4b2-insights-runtime-extractor-tls podName:3928ed50-aedd-4f2b-bc1f-cea69ea7b4b2 nodeName:}" failed. No retries permitted until 2026-07-21 17:09:04.895869645 +0000 UTC m=+37.350022266 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/3928ed50-aedd-4f2b-bc1f-cea69ea7b4b2-insights-runtime-extractor-tls") pod "insights-runtime-extractor-84m9r" (UID: "3928ed50-aedd-4f2b-bc1f-cea69ea7b4b2") : secret "insights-runtime-extractor-tls" not found
Jul 21 17:09:03.896338 ip-10-0-141-39 kubenswrapper[2575]: E0721 17:09:03.896233    2575 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 21 17:09:03.896338 ip-10-0-141-39 kubenswrapper[2575]: E0721 17:09:03.896273    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/3928ed50-aedd-4f2b-bc1f-cea69ea7b4b2-kube-rbac-proxy-cm podName:3928ed50-aedd-4f2b-bc1f-cea69ea7b4b2 nodeName:}" failed. No retries permitted until 2026-07-21 17:09:04.896260655 +0000 UTC m=+37.350413273 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/3928ed50-aedd-4f2b-bc1f-cea69ea7b4b2-kube-rbac-proxy-cm") pod "insights-runtime-extractor-84m9r" (UID: "3928ed50-aedd-4f2b-bc1f-cea69ea7b4b2") : configmap "kube-rbac-proxy" not found
Jul 21 17:09:04.111142 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:09:04.111098    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-x4gm9"
Jul 21 17:09:04.111656 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:09:04.111544    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-44fbg"
Jul 21 17:09:04.111964 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:09:04.111944    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-n98c6"
Jul 21 17:09:04.114377 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:09:04.114355    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 21 17:09:04.117529 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:09:04.117355    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 21 17:09:04.118071 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:09:04.117920    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 21 17:09:04.118071 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:09:04.117953    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 21 17:09:04.118737 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:09:04.118535    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-9bczc\""
Jul 21 17:09:04.118737 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:09:04.118602    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-wk959\""
Jul 21 17:09:04.197746 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:09:04.197669    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/bb79e03c-062a-4642-8d8c-7803a581a97a-metrics-tls\") pod \"dns-default-bqg65\" (UID: \"bb79e03c-062a-4642-8d8c-7803a581a97a\") " pod="openshift-dns/dns-default-bqg65"
Jul 21 17:09:04.197881 ip-10-0-141-39 kubenswrapper[2575]: E0721 17:09:04.197810    2575 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 21 17:09:04.197881 ip-10-0-141-39 kubenswrapper[2575]: E0721 17:09:04.197862    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bb79e03c-062a-4642-8d8c-7803a581a97a-metrics-tls podName:bb79e03c-062a-4642-8d8c-7803a581a97a nodeName:}" failed. No retries permitted until 2026-07-21 17:09:06.197844935 +0000 UTC m=+38.651997553 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/bb79e03c-062a-4642-8d8c-7803a581a97a-metrics-tls") pod "dns-default-bqg65" (UID: "bb79e03c-062a-4642-8d8c-7803a581a97a") : secret "dns-default-metrics-tls" not found
Jul 21 17:09:04.327022 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:09:04.326951    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-tg868" event={"ID":"123fc2cb-18cb-4992-a1f3-b764922b6e3d","Type":"ContainerStarted","Data":"7c2f747794a26754d58ada2d4fd47b5f28685b378a5ccd12ec1dea74354c30dc"}
Jul 21 17:09:04.904746 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:09:04.904707    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/3928ed50-aedd-4f2b-bc1f-cea69ea7b4b2-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-84m9r\" (UID: \"3928ed50-aedd-4f2b-bc1f-cea69ea7b4b2\") " pod="openshift-insights/insights-runtime-extractor-84m9r"
Jul 21 17:09:04.905252 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:09:04.904807    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/3928ed50-aedd-4f2b-bc1f-cea69ea7b4b2-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-84m9r\" (UID: \"3928ed50-aedd-4f2b-bc1f-cea69ea7b4b2\") " pod="openshift-insights/insights-runtime-extractor-84m9r"
Jul 21 17:09:04.905252 ip-10-0-141-39 kubenswrapper[2575]: E0721 17:09:04.904867    2575 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 21 17:09:04.905252 ip-10-0-141-39 kubenswrapper[2575]: E0721 17:09:04.904948    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/3928ed50-aedd-4f2b-bc1f-cea69ea7b4b2-kube-rbac-proxy-cm podName:3928ed50-aedd-4f2b-bc1f-cea69ea7b4b2 nodeName:}" failed. No retries permitted until 2026-07-21 17:09:06.904925751 +0000 UTC m=+39.359078393 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/3928ed50-aedd-4f2b-bc1f-cea69ea7b4b2-kube-rbac-proxy-cm") pod "insights-runtime-extractor-84m9r" (UID: "3928ed50-aedd-4f2b-bc1f-cea69ea7b4b2") : configmap "kube-rbac-proxy" not found
Jul 21 17:09:04.905252 ip-10-0-141-39 kubenswrapper[2575]: E0721 17:09:04.904956    2575 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 21 17:09:04.905252 ip-10-0-141-39 kubenswrapper[2575]: E0721 17:09:04.905008    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3928ed50-aedd-4f2b-bc1f-cea69ea7b4b2-insights-runtime-extractor-tls podName:3928ed50-aedd-4f2b-bc1f-cea69ea7b4b2 nodeName:}" failed. No retries permitted until 2026-07-21 17:09:06.904992352 +0000 UTC m=+39.359144974 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/3928ed50-aedd-4f2b-bc1f-cea69ea7b4b2-insights-runtime-extractor-tls") pod "insights-runtime-extractor-84m9r" (UID: "3928ed50-aedd-4f2b-bc1f-cea69ea7b4b2") : secret "insights-runtime-extractor-tls" not found
Jul 21 17:09:05.027532 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:09:05.027494    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-58598695f7-ww8mw"]
Jul 21 17:09:05.045711 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:09:05.045683    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-58598695f7-ww8mw"
Jul 21 17:09:05.047143 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:09:05.047110    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-58598695f7-ww8mw"]
Jul 21 17:09:05.049799 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:09:05.049775    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-msl9h\""
Jul 21 17:09:05.049975 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:09:05.049847    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\""
Jul 21 17:09:05.050906 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:09:05.050885    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\""
Jul 21 17:09:05.051152 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:09:05.051134    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\""
Jul 21 17:09:05.051353 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:09:05.051335    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\""
Jul 21 17:09:05.207277 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:09:05.207190    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/476abfd9-8cee-4584-b7b2-7e618a2c5be4-signing-cabundle\") pod \"service-ca-58598695f7-ww8mw\" (UID: \"476abfd9-8cee-4584-b7b2-7e618a2c5be4\") " pod="openshift-service-ca/service-ca-58598695f7-ww8mw"
Jul 21 17:09:05.207277 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:09:05.207248    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/476abfd9-8cee-4584-b7b2-7e618a2c5be4-signing-key\") pod \"service-ca-58598695f7-ww8mw\" (UID: \"476abfd9-8cee-4584-b7b2-7e618a2c5be4\") " pod="openshift-service-ca/service-ca-58598695f7-ww8mw"
Jul 21 17:09:05.207515 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:09:05.207401    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-njjnx\" (UniqueName: \"kubernetes.io/projected/476abfd9-8cee-4584-b7b2-7e618a2c5be4-kube-api-access-njjnx\") pod \"service-ca-58598695f7-ww8mw\" (UID: \"476abfd9-8cee-4584-b7b2-7e618a2c5be4\") " pod="openshift-service-ca/service-ca-58598695f7-ww8mw"
Jul 21 17:09:05.308666 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:09:05.308633    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-njjnx\" (UniqueName: \"kubernetes.io/projected/476abfd9-8cee-4584-b7b2-7e618a2c5be4-kube-api-access-njjnx\") pod \"service-ca-58598695f7-ww8mw\" (UID: \"476abfd9-8cee-4584-b7b2-7e618a2c5be4\") " pod="openshift-service-ca/service-ca-58598695f7-ww8mw"
Jul 21 17:09:05.308841 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:09:05.308724    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/476abfd9-8cee-4584-b7b2-7e618a2c5be4-signing-cabundle\") pod \"service-ca-58598695f7-ww8mw\" (UID: \"476abfd9-8cee-4584-b7b2-7e618a2c5be4\") " pod="openshift-service-ca/service-ca-58598695f7-ww8mw"
Jul 21 17:09:05.308841 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:09:05.308764    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/476abfd9-8cee-4584-b7b2-7e618a2c5be4-signing-key\") pod \"service-ca-58598695f7-ww8mw\" (UID: \"476abfd9-8cee-4584-b7b2-7e618a2c5be4\") " pod="openshift-service-ca/service-ca-58598695f7-ww8mw"
Jul 21 17:09:05.309560 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:09:05.309533    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/476abfd9-8cee-4584-b7b2-7e618a2c5be4-signing-cabundle\") pod \"service-ca-58598695f7-ww8mw\" (UID: \"476abfd9-8cee-4584-b7b2-7e618a2c5be4\") " pod="openshift-service-ca/service-ca-58598695f7-ww8mw"
Jul 21 17:09:05.311900 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:09:05.311875    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/476abfd9-8cee-4584-b7b2-7e618a2c5be4-signing-key\") pod \"service-ca-58598695f7-ww8mw\" (UID: \"476abfd9-8cee-4584-b7b2-7e618a2c5be4\") " pod="openshift-service-ca/service-ca-58598695f7-ww8mw"
Jul 21 17:09:05.324914 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:09:05.324889    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-njjnx\" (UniqueName: \"kubernetes.io/projected/476abfd9-8cee-4584-b7b2-7e618a2c5be4-kube-api-access-njjnx\") pod \"service-ca-58598695f7-ww8mw\" (UID: \"476abfd9-8cee-4584-b7b2-7e618a2c5be4\") " pod="openshift-service-ca/service-ca-58598695f7-ww8mw"
Jul 21 17:09:05.358850 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:09:05.358792    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-58598695f7-ww8mw"
Jul 21 17:09:06.053430 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:09:06.053383    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-qmbvr_7533c67e-e7ed-4836-8a8b-a670200cccba/dns-node-resolver/0.log"
Jul 21 17:09:06.215724 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:09:06.215687    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/bb79e03c-062a-4642-8d8c-7803a581a97a-metrics-tls\") pod \"dns-default-bqg65\" (UID: \"bb79e03c-062a-4642-8d8c-7803a581a97a\") " pod="openshift-dns/dns-default-bqg65"
Jul 21 17:09:06.215880 ip-10-0-141-39 kubenswrapper[2575]: E0721 17:09:06.215854    2575 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 21 17:09:06.215959 ip-10-0-141-39 kubenswrapper[2575]: E0721 17:09:06.215938    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bb79e03c-062a-4642-8d8c-7803a581a97a-metrics-tls podName:bb79e03c-062a-4642-8d8c-7803a581a97a nodeName:}" failed. No retries permitted until 2026-07-21 17:09:10.215916534 +0000 UTC m=+42.670069153 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/bb79e03c-062a-4642-8d8c-7803a581a97a-metrics-tls") pod "dns-default-bqg65" (UID: "bb79e03c-062a-4642-8d8c-7803a581a97a") : secret "dns-default-metrics-tls" not found
Jul 21 17:09:06.653178 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:09:06.653140    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-d7gn6_72cdbb9c-0664-46c0-ab7c-4f38ebd7644f/node-ca/0.log"
Jul 21 17:09:06.921878 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:09:06.921797    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/3928ed50-aedd-4f2b-bc1f-cea69ea7b4b2-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-84m9r\" (UID: \"3928ed50-aedd-4f2b-bc1f-cea69ea7b4b2\") " pod="openshift-insights/insights-runtime-extractor-84m9r"
Jul 21 17:09:06.922018 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:09:06.921877    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/3928ed50-aedd-4f2b-bc1f-cea69ea7b4b2-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-84m9r\" (UID: \"3928ed50-aedd-4f2b-bc1f-cea69ea7b4b2\") " pod="openshift-insights/insights-runtime-extractor-84m9r"
Jul 21 17:09:06.922018 ip-10-0-141-39 kubenswrapper[2575]: E0721 17:09:06.921923    2575 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 21 17:09:06.922018 ip-10-0-141-39 kubenswrapper[2575]: E0721 17:09:06.921980    2575 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 21 17:09:06.922018 ip-10-0-141-39 kubenswrapper[2575]: E0721 17:09:06.921995    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/3928ed50-aedd-4f2b-bc1f-cea69ea7b4b2-kube-rbac-proxy-cm podName:3928ed50-aedd-4f2b-bc1f-cea69ea7b4b2 nodeName:}" failed. No retries permitted until 2026-07-21 17:09:10.92197561 +0000 UTC m=+43.376128242 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/3928ed50-aedd-4f2b-bc1f-cea69ea7b4b2-kube-rbac-proxy-cm") pod "insights-runtime-extractor-84m9r" (UID: "3928ed50-aedd-4f2b-bc1f-cea69ea7b4b2") : configmap "kube-rbac-proxy" not found
Jul 21 17:09:06.922233 ip-10-0-141-39 kubenswrapper[2575]: E0721 17:09:06.922022    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3928ed50-aedd-4f2b-bc1f-cea69ea7b4b2-insights-runtime-extractor-tls podName:3928ed50-aedd-4f2b-bc1f-cea69ea7b4b2 nodeName:}" failed. No retries permitted until 2026-07-21 17:09:10.922012735 +0000 UTC m=+43.376165359 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/3928ed50-aedd-4f2b-bc1f-cea69ea7b4b2-insights-runtime-extractor-tls") pod "insights-runtime-extractor-84m9r" (UID: "3928ed50-aedd-4f2b-bc1f-cea69ea7b4b2") : secret "insights-runtime-extractor-tls" not found
Jul 21 17:09:07.933187 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:09:07.933021    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-58598695f7-ww8mw"]
Jul 21 17:09:07.937251 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:09:07.937222    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod476abfd9_8cee_4584_b7b2_7e618a2c5be4.slice/crio-4816e8fc5a845bb927b66146d35cb5e892d12be3651a01ace6db04e0ddaf1795 WatchSource:0}: Error finding container 4816e8fc5a845bb927b66146d35cb5e892d12be3651a01ace6db04e0ddaf1795: Status 404 returned error can't find the container with id 4816e8fc5a845bb927b66146d35cb5e892d12be3651a01ace6db04e0ddaf1795
Jul 21 17:09:08.337782 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:09:08.337749    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-58598695f7-ww8mw" event={"ID":"476abfd9-8cee-4584-b7b2-7e618a2c5be4","Type":"ContainerStarted","Data":"4816e8fc5a845bb927b66146d35cb5e892d12be3651a01ace6db04e0ddaf1795"}
Jul 21 17:09:08.340716 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:09:08.340691    2575 generic.go:356] "Generic (PLEG): container finished" podID="0af1b5ce-5a4d-4cc2-a9ef-ac31ed1f07ca" containerID="0c59f4d35f28041aa6293d523ac208d9c498312cf937f0becb54ba3ab90f52dd" exitCode=0
Jul 21 17:09:08.340847 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:09:08.340772    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-jmsnn" event={"ID":"0af1b5ce-5a4d-4cc2-a9ef-ac31ed1f07ca","Type":"ContainerDied","Data":"0c59f4d35f28041aa6293d523ac208d9c498312cf937f0becb54ba3ab90f52dd"}
Jul 21 17:09:08.342408 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:09:08.342156    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-bc6dr" event={"ID":"93f2422b-be81-4dc7-8d57-5a51f0cd2c55","Type":"ContainerStarted","Data":"f822f2587c911f3864eeda224896b211ce19d3d5910c46b040eaa09f6b794e06"}
Jul 21 17:09:08.343603 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:09:08.343584    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-tg868" event={"ID":"123fc2cb-18cb-4992-a1f3-b764922b6e3d","Type":"ContainerStarted","Data":"54b3a980f24baaf2c43f252a37758c56849c207cef84a6fe7c36c8f85b7ce1a1"}
Jul 21 17:09:08.343678 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:09:08.343620    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-tg868" event={"ID":"123fc2cb-18cb-4992-a1f3-b764922b6e3d","Type":"ContainerStarted","Data":"e3c6cc54558f8eef6d4dc3cb602b9cfa0d5fae6de42ae8eec2993f4d5e004d9a"}
Jul 21 17:09:08.388857 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:09:08.388806    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-tg868" podStartSLOduration=2.101738566 podStartE2EDuration="6.388790559s" totalImagesPullingTime="4.287051993s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 17:09:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 17:09:08.387932964 +0000 UTC m=+40.842085605" watchObservedRunningTime="2026-07-21 17:09:08.388790559 +0000 UTC m=+40.842943198"
Jul 21 17:09:08.405440 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:09:08.405233    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-bc6dr" podStartSLOduration=1.5241541650000001 podStartE2EDuration="6.40521447s" totalImagesPullingTime="4.881060305s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 17:09:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 17:09:08.404959238 +0000 UTC m=+40.859111880" watchObservedRunningTime="2026-07-21 17:09:08.40521447 +0000 UTC m=+40.859367110"
Jul 21 17:09:09.349762 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:09:09.349629    2575 generic.go:356] "Generic (PLEG): container finished" podID="0af1b5ce-5a4d-4cc2-a9ef-ac31ed1f07ca" containerID="58203fd95ae5a9eb3fc25647c5a4d1eca7483d6f965e8e3bf0f8e6ae26647dbc" exitCode=0
Jul 21 17:09:09.349762 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:09:09.349716    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-jmsnn" event={"ID":"0af1b5ce-5a4d-4cc2-a9ef-ac31ed1f07ca","Type":"ContainerDied","Data":"58203fd95ae5a9eb3fc25647c5a4d1eca7483d6f965e8e3bf0f8e6ae26647dbc"}
Jul 21 17:09:10.248358 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:09:10.248323    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/bb79e03c-062a-4642-8d8c-7803a581a97a-metrics-tls\") pod \"dns-default-bqg65\" (UID: \"bb79e03c-062a-4642-8d8c-7803a581a97a\") " pod="openshift-dns/dns-default-bqg65"
Jul 21 17:09:10.248529 ip-10-0-141-39 kubenswrapper[2575]: E0721 17:09:10.248492    2575 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 21 17:09:10.248578 ip-10-0-141-39 kubenswrapper[2575]: E0721 17:09:10.248555    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bb79e03c-062a-4642-8d8c-7803a581a97a-metrics-tls podName:bb79e03c-062a-4642-8d8c-7803a581a97a nodeName:}" failed. No retries permitted until 2026-07-21 17:09:18.248539441 +0000 UTC m=+50.702692058 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/bb79e03c-062a-4642-8d8c-7803a581a97a-metrics-tls") pod "dns-default-bqg65" (UID: "bb79e03c-062a-4642-8d8c-7803a581a97a") : secret "dns-default-metrics-tls" not found
Jul 21 17:09:10.354979 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:09:10.354945    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-jmsnn" event={"ID":"0af1b5ce-5a4d-4cc2-a9ef-ac31ed1f07ca","Type":"ContainerStarted","Data":"d8a5489163300c5a233f9efc35460f1dd459f8c75edc4eb93ade6bfabdc2f112"}
Jul 21 17:09:10.384299 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:09:10.384252    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-jmsnn" podStartSLOduration=7.764275458 podStartE2EDuration="42.384238336s" totalImagesPullingTime="34.619962878s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-21 17:08:28 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 17:09:10.38415316 +0000 UTC m=+42.838305800" watchObservedRunningTime="2026-07-21 17:09:10.384238336 +0000 UTC m=+42.838390976"
Jul 21 17:09:10.954669 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:09:10.954632    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/3928ed50-aedd-4f2b-bc1f-cea69ea7b4b2-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-84m9r\" (UID: \"3928ed50-aedd-4f2b-bc1f-cea69ea7b4b2\") " pod="openshift-insights/insights-runtime-extractor-84m9r"
Jul 21 17:09:10.954863 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:09:10.954738    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/3928ed50-aedd-4f2b-bc1f-cea69ea7b4b2-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-84m9r\" (UID: \"3928ed50-aedd-4f2b-bc1f-cea69ea7b4b2\") " pod="openshift-insights/insights-runtime-extractor-84m9r"
Jul 21 17:09:10.954863 ip-10-0-141-39 kubenswrapper[2575]: E0721 17:09:10.954808    2575 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 21 17:09:10.954863 ip-10-0-141-39 kubenswrapper[2575]: E0721 17:09:10.954839    2575 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 21 17:09:10.955019 ip-10-0-141-39 kubenswrapper[2575]: E0721 17:09:10.954887    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3928ed50-aedd-4f2b-bc1f-cea69ea7b4b2-insights-runtime-extractor-tls podName:3928ed50-aedd-4f2b-bc1f-cea69ea7b4b2 nodeName:}" failed. No retries permitted until 2026-07-21 17:09:18.954866178 +0000 UTC m=+51.409018804 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/3928ed50-aedd-4f2b-bc1f-cea69ea7b4b2-insights-runtime-extractor-tls") pod "insights-runtime-extractor-84m9r" (UID: "3928ed50-aedd-4f2b-bc1f-cea69ea7b4b2") : secret "insights-runtime-extractor-tls" not found
Jul 21 17:09:10.955019 ip-10-0-141-39 kubenswrapper[2575]: E0721 17:09:10.954909    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/3928ed50-aedd-4f2b-bc1f-cea69ea7b4b2-kube-rbac-proxy-cm podName:3928ed50-aedd-4f2b-bc1f-cea69ea7b4b2 nodeName:}" failed. No retries permitted until 2026-07-21 17:09:18.95489895 +0000 UTC m=+51.409051574 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/3928ed50-aedd-4f2b-bc1f-cea69ea7b4b2-kube-rbac-proxy-cm") pod "insights-runtime-extractor-84m9r" (UID: "3928ed50-aedd-4f2b-bc1f-cea69ea7b4b2") : configmap "kube-rbac-proxy" not found
Jul 21 17:09:12.361820 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:09:12.361775    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-58598695f7-ww8mw" event={"ID":"476abfd9-8cee-4584-b7b2-7e618a2c5be4","Type":"ContainerStarted","Data":"36b52e716baf40412dc1e67e72dedaa3c5c2bb1a00417b5201df07010fdbd9b5"}
Jul 21 17:09:12.379429 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:09:12.379358    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-58598695f7-ww8mw" podStartSLOduration=3.866013199 podStartE2EDuration="7.379341089s" totalImagesPullingTime="3.51332789s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 17:09:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 17:09:12.37931745 +0000 UTC m=+44.833470089" watchObservedRunningTime="2026-07-21 17:09:12.379341089 +0000 UTC m=+44.833493729"
Jul 21 17:09:18.329445 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:09:18.329393    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/bb79e03c-062a-4642-8d8c-7803a581a97a-metrics-tls\") pod \"dns-default-bqg65\" (UID: \"bb79e03c-062a-4642-8d8c-7803a581a97a\") " pod="openshift-dns/dns-default-bqg65"
Jul 21 17:09:18.333707 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:09:18.333681    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/bb79e03c-062a-4642-8d8c-7803a581a97a-metrics-tls\") pod \"dns-default-bqg65\" (UID: \"bb79e03c-062a-4642-8d8c-7803a581a97a\") " pod="openshift-dns/dns-default-bqg65"
Jul 21 17:09:18.364742 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:09:18.364716    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-bqg65"
Jul 21 17:09:18.510532 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:09:18.510502    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-bqg65"]
Jul 21 17:09:18.513399 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:09:18.513378    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbb79e03c_062a_4642_8d8c_7803a581a97a.slice/crio-a8b437ba73f3e989c169e88d5c5644e10c15bb1440fa5f632c7698b1b689dfff WatchSource:0}: Error finding container a8b437ba73f3e989c169e88d5c5644e10c15bb1440fa5f632c7698b1b689dfff: Status 404 returned error can't find the container with id a8b437ba73f3e989c169e88d5c5644e10c15bb1440fa5f632c7698b1b689dfff
Jul 21 17:09:19.034831 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:09:19.034789    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/3928ed50-aedd-4f2b-bc1f-cea69ea7b4b2-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-84m9r\" (UID: \"3928ed50-aedd-4f2b-bc1f-cea69ea7b4b2\") " pod="openshift-insights/insights-runtime-extractor-84m9r"
Jul 21 17:09:19.035020 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:09:19.034877    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/3928ed50-aedd-4f2b-bc1f-cea69ea7b4b2-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-84m9r\" (UID: \"3928ed50-aedd-4f2b-bc1f-cea69ea7b4b2\") " pod="openshift-insights/insights-runtime-extractor-84m9r"
Jul 21 17:09:19.035020 ip-10-0-141-39 kubenswrapper[2575]: E0721 17:09:19.035012    2575 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 21 17:09:19.035130 ip-10-0-141-39 kubenswrapper[2575]: E0721 17:09:19.035092    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3928ed50-aedd-4f2b-bc1f-cea69ea7b4b2-insights-runtime-extractor-tls podName:3928ed50-aedd-4f2b-bc1f-cea69ea7b4b2 nodeName:}" failed. No retries permitted until 2026-07-21 17:09:35.035073121 +0000 UTC m=+67.489225754 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/3928ed50-aedd-4f2b-bc1f-cea69ea7b4b2-insights-runtime-extractor-tls") pod "insights-runtime-extractor-84m9r" (UID: "3928ed50-aedd-4f2b-bc1f-cea69ea7b4b2") : secret "insights-runtime-extractor-tls" not found
Jul 21 17:09:19.035395 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:09:19.035371    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/3928ed50-aedd-4f2b-bc1f-cea69ea7b4b2-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-84m9r\" (UID: \"3928ed50-aedd-4f2b-bc1f-cea69ea7b4b2\") " pod="openshift-insights/insights-runtime-extractor-84m9r"
Jul 21 17:09:19.381474 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:09:19.381377    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-bqg65" event={"ID":"bb79e03c-062a-4642-8d8c-7803a581a97a","Type":"ContainerStarted","Data":"a8b437ba73f3e989c169e88d5c5644e10c15bb1440fa5f632c7698b1b689dfff"}
Jul 21 17:09:21.390511 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:09:21.390475    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-bqg65" event={"ID":"bb79e03c-062a-4642-8d8c-7803a581a97a","Type":"ContainerStarted","Data":"04fecba7bd7e5169282662f82fa348617f973c294840fc0ce9d2afd9c7afed56"}
Jul 21 17:09:21.390983 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:09:21.390535    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-bqg65" event={"ID":"bb79e03c-062a-4642-8d8c-7803a581a97a","Type":"ContainerStarted","Data":"b44fb6121ea4b5d645881d9594eff532e7415537013d5a33710bf9210989a8fb"}
Jul 21 17:09:21.390983 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:09:21.390620    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-bqg65"
Jul 21 17:09:21.414584 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:09:21.414530    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-bqg65" podStartSLOduration=16.89384122 podStartE2EDuration="19.414511257s" totalImagesPullingTime="2.520670037s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 17:09:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 17:09:21.414476367 +0000 UTC m=+53.868629009" watchObservedRunningTime="2026-07-21 17:09:21.414511257 +0000 UTC m=+53.868663900"
Jul 21 17:09:25.593708 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:09:25.593676    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-7d4b558d7c-v5zxt"]
Jul 21 17:09:25.595627 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:09:25.595612    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7d4b558d7c-v5zxt"
Jul 21 17:09:25.600680 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:09:25.600646    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
Jul 21 17:09:25.601870 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:09:25.601849    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\""
Jul 21 17:09:25.603194 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:09:25.603176    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
Jul 21 17:09:25.603321 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:09:25.603208    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
Jul 21 17:09:25.634854 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:09:25.634827    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-7d4b558d7c-v5zxt"]
Jul 21 17:09:25.683967 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:09:25.683939    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b274d3b0-5b14-4c90-b006-d5615eda3c09-tmp\") pod \"klusterlet-addon-workmgr-7d4b558d7c-v5zxt\" (UID: \"b274d3b0-5b14-4c90-b006-d5615eda3c09\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7d4b558d7c-v5zxt"
Jul 21 17:09:25.684142 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:09:25.683985    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/b274d3b0-5b14-4c90-b006-d5615eda3c09-klusterlet-config\") pod \"klusterlet-addon-workmgr-7d4b558d7c-v5zxt\" (UID: \"b274d3b0-5b14-4c90-b006-d5615eda3c09\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7d4b558d7c-v5zxt"
Jul 21 17:09:25.684142 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:09:25.684036    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-47q97\" (UniqueName: \"kubernetes.io/projected/b274d3b0-5b14-4c90-b006-d5615eda3c09-kube-api-access-47q97\") pod \"klusterlet-addon-workmgr-7d4b558d7c-v5zxt\" (UID: \"b274d3b0-5b14-4c90-b006-d5615eda3c09\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7d4b558d7c-v5zxt"
Jul 21 17:09:25.784716 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:09:25.784682    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b274d3b0-5b14-4c90-b006-d5615eda3c09-tmp\") pod \"klusterlet-addon-workmgr-7d4b558d7c-v5zxt\" (UID: \"b274d3b0-5b14-4c90-b006-d5615eda3c09\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7d4b558d7c-v5zxt"
Jul 21 17:09:25.784883 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:09:25.784736    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/b274d3b0-5b14-4c90-b006-d5615eda3c09-klusterlet-config\") pod \"klusterlet-addon-workmgr-7d4b558d7c-v5zxt\" (UID: \"b274d3b0-5b14-4c90-b006-d5615eda3c09\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7d4b558d7c-v5zxt"
Jul 21 17:09:25.784955 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:09:25.784880    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-47q97\" (UniqueName: \"kubernetes.io/projected/b274d3b0-5b14-4c90-b006-d5615eda3c09-kube-api-access-47q97\") pod \"klusterlet-addon-workmgr-7d4b558d7c-v5zxt\" (UID: \"b274d3b0-5b14-4c90-b006-d5615eda3c09\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7d4b558d7c-v5zxt"
Jul 21 17:09:25.785118 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:09:25.785098    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b274d3b0-5b14-4c90-b006-d5615eda3c09-tmp\") pod \"klusterlet-addon-workmgr-7d4b558d7c-v5zxt\" (UID: \"b274d3b0-5b14-4c90-b006-d5615eda3c09\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7d4b558d7c-v5zxt"
Jul 21 17:09:25.787478 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:09:25.787451    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/b274d3b0-5b14-4c90-b006-d5615eda3c09-klusterlet-config\") pod \"klusterlet-addon-workmgr-7d4b558d7c-v5zxt\" (UID: \"b274d3b0-5b14-4c90-b006-d5615eda3c09\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7d4b558d7c-v5zxt"
Jul 21 17:09:25.793511 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:09:25.793489    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-47q97\" (UniqueName: \"kubernetes.io/projected/b274d3b0-5b14-4c90-b006-d5615eda3c09-kube-api-access-47q97\") pod \"klusterlet-addon-workmgr-7d4b558d7c-v5zxt\" (UID: \"b274d3b0-5b14-4c90-b006-d5615eda3c09\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7d4b558d7c-v5zxt"
Jul 21 17:09:25.806987 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:09:25.806963    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-57dbbfd699-mb69j"]
Jul 21 17:09:25.809059 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:09:25.809045    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-57dbbfd699-mb69j"
Jul 21 17:09:25.811666 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:09:25.811643    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Jul 21 17:09:25.811828 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:09:25.811680    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Jul 21 17:09:25.811828 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:09:25.811709    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Jul 21 17:09:25.811828 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:09:25.811791    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-h5krw\""
Jul 21 17:09:25.816954 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:09:25.816937    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Jul 21 17:09:25.829025 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:09:25.829006    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-57dbbfd699-mb69j"]
Jul 21 17:09:25.885727 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:09:25.885649    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ccc7bf0b-87e4-4eae-8e6a-4b61193af05d-registry-tls\") pod \"image-registry-57dbbfd699-mb69j\" (UID: \"ccc7bf0b-87e4-4eae-8e6a-4b61193af05d\") " pod="openshift-image-registry/image-registry-57dbbfd699-mb69j"
Jul 21 17:09:25.885727 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:09:25.885698    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/ccc7bf0b-87e4-4eae-8e6a-4b61193af05d-installation-pull-secrets\") pod \"image-registry-57dbbfd699-mb69j\" (UID: \"ccc7bf0b-87e4-4eae-8e6a-4b61193af05d\") " pod="openshift-image-registry/image-registry-57dbbfd699-mb69j"
Jul 21 17:09:25.885902 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:09:25.885748    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/ccc7bf0b-87e4-4eae-8e6a-4b61193af05d-image-registry-private-configuration\") pod \"image-registry-57dbbfd699-mb69j\" (UID: \"ccc7bf0b-87e4-4eae-8e6a-4b61193af05d\") " pod="openshift-image-registry/image-registry-57dbbfd699-mb69j"
Jul 21 17:09:25.885902 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:09:25.885765    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/ccc7bf0b-87e4-4eae-8e6a-4b61193af05d-registry-certificates\") pod \"image-registry-57dbbfd699-mb69j\" (UID: \"ccc7bf0b-87e4-4eae-8e6a-4b61193af05d\") " pod="openshift-image-registry/image-registry-57dbbfd699-mb69j"
Jul 21 17:09:25.885902 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:09:25.885780    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ccc7bf0b-87e4-4eae-8e6a-4b61193af05d-bound-sa-token\") pod \"image-registry-57dbbfd699-mb69j\" (UID: \"ccc7bf0b-87e4-4eae-8e6a-4b61193af05d\") " pod="openshift-image-registry/image-registry-57dbbfd699-mb69j"
Jul 21 17:09:25.885902 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:09:25.885804    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/ccc7bf0b-87e4-4eae-8e6a-4b61193af05d-ca-trust-extracted\") pod \"image-registry-57dbbfd699-mb69j\" (UID: \"ccc7bf0b-87e4-4eae-8e6a-4b61193af05d\") " pod="openshift-image-registry/image-registry-57dbbfd699-mb69j"
Jul 21 17:09:25.885902 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:09:25.885851    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/ccc7bf0b-87e4-4eae-8e6a-4b61193af05d-trusted-ca\") pod \"image-registry-57dbbfd699-mb69j\" (UID: \"ccc7bf0b-87e4-4eae-8e6a-4b61193af05d\") " pod="openshift-image-registry/image-registry-57dbbfd699-mb69j"
Jul 21 17:09:25.885902 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:09:25.885896    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cd8sq\" (UniqueName: \"kubernetes.io/projected/ccc7bf0b-87e4-4eae-8e6a-4b61193af05d-kube-api-access-cd8sq\") pod \"image-registry-57dbbfd699-mb69j\" (UID: \"ccc7bf0b-87e4-4eae-8e6a-4b61193af05d\") " pod="openshift-image-registry/image-registry-57dbbfd699-mb69j"
Jul 21 17:09:25.905812 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:09:25.905786    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7d4b558d7c-v5zxt"
Jul 21 17:09:25.986681 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:09:25.986646    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/ccc7bf0b-87e4-4eae-8e6a-4b61193af05d-installation-pull-secrets\") pod \"image-registry-57dbbfd699-mb69j\" (UID: \"ccc7bf0b-87e4-4eae-8e6a-4b61193af05d\") " pod="openshift-image-registry/image-registry-57dbbfd699-mb69j"
Jul 21 17:09:25.986799 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:09:25.986704    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/ccc7bf0b-87e4-4eae-8e6a-4b61193af05d-image-registry-private-configuration\") pod \"image-registry-57dbbfd699-mb69j\" (UID: \"ccc7bf0b-87e4-4eae-8e6a-4b61193af05d\") " pod="openshift-image-registry/image-registry-57dbbfd699-mb69j"
Jul 21 17:09:25.986799 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:09:25.986723    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/ccc7bf0b-87e4-4eae-8e6a-4b61193af05d-registry-certificates\") pod \"image-registry-57dbbfd699-mb69j\" (UID: \"ccc7bf0b-87e4-4eae-8e6a-4b61193af05d\") " pod="openshift-image-registry/image-registry-57dbbfd699-mb69j"
Jul 21 17:09:25.986924 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:09:25.986838    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ccc7bf0b-87e4-4eae-8e6a-4b61193af05d-bound-sa-token\") pod \"image-registry-57dbbfd699-mb69j\" (UID: \"ccc7bf0b-87e4-4eae-8e6a-4b61193af05d\") " pod="openshift-image-registry/image-registry-57dbbfd699-mb69j"
Jul 21 17:09:25.986924 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:09:25.986869    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/ccc7bf0b-87e4-4eae-8e6a-4b61193af05d-ca-trust-extracted\") pod \"image-registry-57dbbfd699-mb69j\" (UID: \"ccc7bf0b-87e4-4eae-8e6a-4b61193af05d\") " pod="openshift-image-registry/image-registry-57dbbfd699-mb69j"
Jul 21 17:09:25.986924 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:09:25.986887    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/ccc7bf0b-87e4-4eae-8e6a-4b61193af05d-trusted-ca\") pod \"image-registry-57dbbfd699-mb69j\" (UID: \"ccc7bf0b-87e4-4eae-8e6a-4b61193af05d\") " pod="openshift-image-registry/image-registry-57dbbfd699-mb69j"
Jul 21 17:09:25.986924 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:09:25.986912    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cd8sq\" (UniqueName: \"kubernetes.io/projected/ccc7bf0b-87e4-4eae-8e6a-4b61193af05d-kube-api-access-cd8sq\") pod \"image-registry-57dbbfd699-mb69j\" (UID: \"ccc7bf0b-87e4-4eae-8e6a-4b61193af05d\") " pod="openshift-image-registry/image-registry-57dbbfd699-mb69j"
Jul 21 17:09:25.987120 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:09:25.986968    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ccc7bf0b-87e4-4eae-8e6a-4b61193af05d-registry-tls\") pod \"image-registry-57dbbfd699-mb69j\" (UID: \"ccc7bf0b-87e4-4eae-8e6a-4b61193af05d\") " pod="openshift-image-registry/image-registry-57dbbfd699-mb69j"
Jul 21 17:09:25.987561 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:09:25.987285    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/ccc7bf0b-87e4-4eae-8e6a-4b61193af05d-ca-trust-extracted\") pod \"image-registry-57dbbfd699-mb69j\" (UID: \"ccc7bf0b-87e4-4eae-8e6a-4b61193af05d\") " pod="openshift-image-registry/image-registry-57dbbfd699-mb69j"
Jul 21 17:09:25.987754 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:09:25.987706    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/ccc7bf0b-87e4-4eae-8e6a-4b61193af05d-registry-certificates\") pod \"image-registry-57dbbfd699-mb69j\" (UID: \"ccc7bf0b-87e4-4eae-8e6a-4b61193af05d\") " pod="openshift-image-registry/image-registry-57dbbfd699-mb69j"
Jul 21 17:09:25.988120 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:09:25.988094    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/ccc7bf0b-87e4-4eae-8e6a-4b61193af05d-trusted-ca\") pod \"image-registry-57dbbfd699-mb69j\" (UID: \"ccc7bf0b-87e4-4eae-8e6a-4b61193af05d\") " pod="openshift-image-registry/image-registry-57dbbfd699-mb69j"
Jul 21 17:09:25.989734 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:09:25.989698    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/ccc7bf0b-87e4-4eae-8e6a-4b61193af05d-image-registry-private-configuration\") pod \"image-registry-57dbbfd699-mb69j\" (UID: \"ccc7bf0b-87e4-4eae-8e6a-4b61193af05d\") " pod="openshift-image-registry/image-registry-57dbbfd699-mb69j"
Jul 21 17:09:25.990218 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:09:25.990190    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/ccc7bf0b-87e4-4eae-8e6a-4b61193af05d-installation-pull-secrets\") pod \"image-registry-57dbbfd699-mb69j\" (UID: \"ccc7bf0b-87e4-4eae-8e6a-4b61193af05d\") " pod="openshift-image-registry/image-registry-57dbbfd699-mb69j"
Jul 21 17:09:25.990373 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:09:25.990266    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ccc7bf0b-87e4-4eae-8e6a-4b61193af05d-registry-tls\") pod \"image-registry-57dbbfd699-mb69j\" (UID: \"ccc7bf0b-87e4-4eae-8e6a-4b61193af05d\") " pod="openshift-image-registry/image-registry-57dbbfd699-mb69j"
Jul 21 17:09:25.999637 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:09:25.999614    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cd8sq\" (UniqueName: \"kubernetes.io/projected/ccc7bf0b-87e4-4eae-8e6a-4b61193af05d-kube-api-access-cd8sq\") pod \"image-registry-57dbbfd699-mb69j\" (UID: \"ccc7bf0b-87e4-4eae-8e6a-4b61193af05d\") " pod="openshift-image-registry/image-registry-57dbbfd699-mb69j"
Jul 21 17:09:25.999723 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:09:25.999651    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ccc7bf0b-87e4-4eae-8e6a-4b61193af05d-bound-sa-token\") pod \"image-registry-57dbbfd699-mb69j\" (UID: \"ccc7bf0b-87e4-4eae-8e6a-4b61193af05d\") " pod="openshift-image-registry/image-registry-57dbbfd699-mb69j"
Jul 21 17:09:26.032076 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:09:26.032049    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-7d4b558d7c-v5zxt"]
Jul 21 17:09:26.034915 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:09:26.034860    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb274d3b0_5b14_4c90_b006_d5615eda3c09.slice/crio-0481916a900f1ca9811f51b778e0cef37a2b68c20e87f1e91e638011e3cd7c3f WatchSource:0}: Error finding container 0481916a900f1ca9811f51b778e0cef37a2b68c20e87f1e91e638011e3cd7c3f: Status 404 returned error can't find the container with id 0481916a900f1ca9811f51b778e0cef37a2b68c20e87f1e91e638011e3cd7c3f
Jul 21 17:09:26.119177 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:09:26.119155    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-57dbbfd699-mb69j"
Jul 21 17:09:26.250710 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:09:26.250678    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-57dbbfd699-mb69j"]
Jul 21 17:09:26.253866 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:09:26.253843    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podccc7bf0b_87e4_4eae_8e6a_4b61193af05d.slice/crio-e2418e85fd30a96e166d0ea814d76ec2a0d3b8cadfa81b10666dfb5a0fcc8281 WatchSource:0}: Error finding container e2418e85fd30a96e166d0ea814d76ec2a0d3b8cadfa81b10666dfb5a0fcc8281: Status 404 returned error can't find the container with id e2418e85fd30a96e166d0ea814d76ec2a0d3b8cadfa81b10666dfb5a0fcc8281
Jul 21 17:09:26.408295 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:09:26.408249    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-57dbbfd699-mb69j" event={"ID":"ccc7bf0b-87e4-4eae-8e6a-4b61193af05d","Type":"ContainerStarted","Data":"300e9cc2c0f6e6f6bfed9627001d486a3a3ebaa06b29a81c3a8d10b430235cc9"}
Jul 21 17:09:26.408483 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:09:26.408309    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-57dbbfd699-mb69j" event={"ID":"ccc7bf0b-87e4-4eae-8e6a-4b61193af05d","Type":"ContainerStarted","Data":"e2418e85fd30a96e166d0ea814d76ec2a0d3b8cadfa81b10666dfb5a0fcc8281"}
Jul 21 17:09:26.408483 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:09:26.408330    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-57dbbfd699-mb69j"
Jul 21 17:09:26.409472 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:09:26.409451    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7d4b558d7c-v5zxt" event={"ID":"b274d3b0-5b14-4c90-b006-d5615eda3c09","Type":"ContainerStarted","Data":"0481916a900f1ca9811f51b778e0cef37a2b68c20e87f1e91e638011e3cd7c3f"}
Jul 21 17:09:26.436899 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:09:26.436804    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-57dbbfd699-mb69j" podStartSLOduration=1.4367861880000001 podStartE2EDuration="1.436786188s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 17:09:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 17:09:26.436036755 +0000 UTC m=+58.890189394" watchObservedRunningTime="2026-07-21 17:09:26.436786188 +0000 UTC m=+58.890938831"
Jul 21 17:09:29.317231 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:09:29.317202    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-b64gx"
Jul 21 17:09:30.426998 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:09:30.426962    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7d4b558d7c-v5zxt" event={"ID":"b274d3b0-5b14-4c90-b006-d5615eda3c09","Type":"ContainerStarted","Data":"d2052a0b4ea8eadb5b6b31e30ffacbfaadecadb7d967d93271e166c69cdcd505"}
Jul 21 17:09:30.427404 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:09:30.427242    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7d4b558d7c-v5zxt"
Jul 21 17:09:30.428940 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:09:30.428922    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7d4b558d7c-v5zxt"
Jul 21 17:09:30.443619 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:09:30.443577    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7d4b558d7c-v5zxt" podStartSLOduration=1.492622831 podStartE2EDuration="5.443563503s" totalImagesPullingTime="3.950940672s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 17:09:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 17:09:30.443495912 +0000 UTC m=+62.897648552" watchObservedRunningTime="2026-07-21 17:09:30.443563503 +0000 UTC m=+62.897716137"
Jul 21 17:09:31.397203 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:09:31.397171    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-bqg65"
Jul 21 17:09:32.150764 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:09:32.150726    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-zch68"]
Jul 21 17:09:32.157224 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:09:32.157197    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-zch68"
Jul 21 17:09:32.160097 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:09:32.160073    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-5mhrr\""
Jul 21 17:09:32.160097 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:09:32.160090    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\""
Jul 21 17:09:32.161931 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:09:32.161901    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-zch68"]
Jul 21 17:09:32.241512 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:09:32.241479    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/229dd683-aaf1-4bde-8091-45e5d43360bc-tls-certificates\") pod \"prometheus-operator-admission-webhook-85574b5f49-zch68\" (UID: \"229dd683-aaf1-4bde-8091-45e5d43360bc\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-zch68"
Jul 21 17:09:32.342400 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:09:32.342369    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/229dd683-aaf1-4bde-8091-45e5d43360bc-tls-certificates\") pod \"prometheus-operator-admission-webhook-85574b5f49-zch68\" (UID: \"229dd683-aaf1-4bde-8091-45e5d43360bc\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-zch68"
Jul 21 17:09:32.342557 ip-10-0-141-39 kubenswrapper[2575]: E0721 17:09:32.342541    2575 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-admission-webhook-tls: secret "prometheus-operator-admission-webhook-tls" not found
Jul 21 17:09:32.342619 ip-10-0-141-39 kubenswrapper[2575]: E0721 17:09:32.342608    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/229dd683-aaf1-4bde-8091-45e5d43360bc-tls-certificates podName:229dd683-aaf1-4bde-8091-45e5d43360bc nodeName:}" failed. No retries permitted until 2026-07-21 17:09:32.842591802 +0000 UTC m=+65.296744422 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certificates" (UniqueName: "kubernetes.io/secret/229dd683-aaf1-4bde-8091-45e5d43360bc-tls-certificates") pod "prometheus-operator-admission-webhook-85574b5f49-zch68" (UID: "229dd683-aaf1-4bde-8091-45e5d43360bc") : secret "prometheus-operator-admission-webhook-tls" not found
Jul 21 17:09:32.847119 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:09:32.847082    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/229dd683-aaf1-4bde-8091-45e5d43360bc-tls-certificates\") pod \"prometheus-operator-admission-webhook-85574b5f49-zch68\" (UID: \"229dd683-aaf1-4bde-8091-45e5d43360bc\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-zch68"
Jul 21 17:09:32.849685 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:09:32.849667    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/229dd683-aaf1-4bde-8091-45e5d43360bc-tls-certificates\") pod \"prometheus-operator-admission-webhook-85574b5f49-zch68\" (UID: \"229dd683-aaf1-4bde-8091-45e5d43360bc\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-zch68"
Jul 21 17:09:33.066717 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:09:33.066690    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-zch68"
Jul 21 17:09:33.223603 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:09:33.223571    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-zch68"]
Jul 21 17:09:33.226367 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:09:33.226338    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod229dd683_aaf1_4bde_8091_45e5d43360bc.slice/crio-cb7b426670ee8acd803a8b0e8105ec5c61bc8ff78256702fa92f63c3a3313d4d WatchSource:0}: Error finding container cb7b426670ee8acd803a8b0e8105ec5c61bc8ff78256702fa92f63c3a3313d4d: Status 404 returned error can't find the container with id cb7b426670ee8acd803a8b0e8105ec5c61bc8ff78256702fa92f63c3a3313d4d
Jul 21 17:09:33.437332 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:09:33.437249    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-zch68" event={"ID":"229dd683-aaf1-4bde-8091-45e5d43360bc","Type":"ContainerStarted","Data":"cb7b426670ee8acd803a8b0e8105ec5c61bc8ff78256702fa92f63c3a3313d4d"}
Jul 21 17:09:33.754794 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:09:33.754765    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7900e00a-7d30-4941-a177-1ce9da22deb3-original-pull-secret\") pod \"global-pull-secret-syncer-44fbg\" (UID: \"7900e00a-7d30-4941-a177-1ce9da22deb3\") " pod="kube-system/global-pull-secret-syncer-44fbg"
Jul 21 17:09:33.755033 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:09:33.754810    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/75e3f13b-b4dd-479c-b305-420ec10c39d7-metrics-certs\") pod \"network-metrics-daemon-n98c6\" (UID: \"75e3f13b-b4dd-479c-b305-420ec10c39d7\") " pod="openshift-multus/network-metrics-daemon-n98c6"
Jul 21 17:09:33.757577 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:09:33.757560    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 21 17:09:33.758525 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:09:33.758508    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 21 17:09:33.767917 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:09:33.767895    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7900e00a-7d30-4941-a177-1ce9da22deb3-original-pull-secret\") pod \"global-pull-secret-syncer-44fbg\" (UID: \"7900e00a-7d30-4941-a177-1ce9da22deb3\") " pod="kube-system/global-pull-secret-syncer-44fbg"
Jul 21 17:09:33.768026 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:09:33.767930    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/75e3f13b-b4dd-479c-b305-420ec10c39d7-metrics-certs\") pod \"network-metrics-daemon-n98c6\" (UID: \"75e3f13b-b4dd-479c-b305-420ec10c39d7\") " pod="openshift-multus/network-metrics-daemon-n98c6"
Jul 21 17:09:33.834712 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:09:33.834686    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-44fbg"
Jul 21 17:09:33.843661 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:09:33.843641    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-wk959\""
Jul 21 17:09:33.851040 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:09:33.851019    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-n98c6"
Jul 21 17:09:33.855323 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:09:33.855302    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-plkdx\" (UniqueName: \"kubernetes.io/projected/1f68ab07-c91d-4a29-8b72-cc76e3dd2753-kube-api-access-plkdx\") pod \"network-check-target-x4gm9\" (UID: \"1f68ab07-c91d-4a29-8b72-cc76e3dd2753\") " pod="openshift-network-diagnostics/network-check-target-x4gm9"
Jul 21 17:09:33.858283 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:09:33.858265    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 21 17:09:33.868517 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:09:33.868495    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 21 17:09:33.879486 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:09:33.878468    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-plkdx\" (UniqueName: \"kubernetes.io/projected/1f68ab07-c91d-4a29-8b72-cc76e3dd2753-kube-api-access-plkdx\") pod \"network-check-target-x4gm9\" (UID: \"1f68ab07-c91d-4a29-8b72-cc76e3dd2753\") " pod="openshift-network-diagnostics/network-check-target-x4gm9"
Jul 21 17:09:33.976985 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:09:33.976944    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-44fbg"]
Jul 21 17:09:33.982141 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:09:33.982116    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7900e00a_7d30_4941_a177_1ce9da22deb3.slice/crio-7ffcc03bcc2a2e39ae703210a6992b9c1d7668c05a39712a454a2374b7a988f2 WatchSource:0}: Error finding container 7ffcc03bcc2a2e39ae703210a6992b9c1d7668c05a39712a454a2374b7a988f2: Status 404 returned error can't find the container with id 7ffcc03bcc2a2e39ae703210a6992b9c1d7668c05a39712a454a2374b7a988f2
Jul 21 17:09:33.992176 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:09:33.992151    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-n98c6"]
Jul 21 17:09:33.996551 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:09:33.996527    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod75e3f13b_b4dd_479c_b305_420ec10c39d7.slice/crio-f209024f78639eb8d11187a91f3d20384c10f72255a0c7f42143801d110a5b6d WatchSource:0}: Error finding container f209024f78639eb8d11187a91f3d20384c10f72255a0c7f42143801d110a5b6d: Status 404 returned error can't find the container with id f209024f78639eb8d11187a91f3d20384c10f72255a0c7f42143801d110a5b6d
Jul 21 17:09:34.128794 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:09:34.128719    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-9bczc\""
Jul 21 17:09:34.136181 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:09:34.136163    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-x4gm9"
Jul 21 17:09:34.258408 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:09:34.258376    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-x4gm9"]
Jul 21 17:09:34.261882 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:09:34.261857    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1f68ab07_c91d_4a29_8b72_cc76e3dd2753.slice/crio-2a9e8c8828eeb280519cfaefa505e9b6dec2328a2ff5ac5841fc35781613b5b3 WatchSource:0}: Error finding container 2a9e8c8828eeb280519cfaefa505e9b6dec2328a2ff5ac5841fc35781613b5b3: Status 404 returned error can't find the container with id 2a9e8c8828eeb280519cfaefa505e9b6dec2328a2ff5ac5841fc35781613b5b3
Jul 21 17:09:34.442052 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:09:34.441956    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-n98c6" event={"ID":"75e3f13b-b4dd-479c-b305-420ec10c39d7","Type":"ContainerStarted","Data":"f209024f78639eb8d11187a91f3d20384c10f72255a0c7f42143801d110a5b6d"}
Jul 21 17:09:34.443395 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:09:34.443361    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-x4gm9" event={"ID":"1f68ab07-c91d-4a29-8b72-cc76e3dd2753","Type":"ContainerStarted","Data":"2a9e8c8828eeb280519cfaefa505e9b6dec2328a2ff5ac5841fc35781613b5b3"}
Jul 21 17:09:34.444657 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:09:34.444627    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-44fbg" event={"ID":"7900e00a-7d30-4941-a177-1ce9da22deb3","Type":"ContainerStarted","Data":"7ffcc03bcc2a2e39ae703210a6992b9c1d7668c05a39712a454a2374b7a988f2"}
Jul 21 17:09:35.065480 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:09:35.064957    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/3928ed50-aedd-4f2b-bc1f-cea69ea7b4b2-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-84m9r\" (UID: \"3928ed50-aedd-4f2b-bc1f-cea69ea7b4b2\") " pod="openshift-insights/insights-runtime-extractor-84m9r"
Jul 21 17:09:35.069376 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:09:35.069292    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/3928ed50-aedd-4f2b-bc1f-cea69ea7b4b2-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-84m9r\" (UID: \"3928ed50-aedd-4f2b-bc1f-cea69ea7b4b2\") " pod="openshift-insights/insights-runtime-extractor-84m9r"
Jul 21 17:09:35.254040 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:09:35.253883    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-t495x\""
Jul 21 17:09:35.262264 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:09:35.262243    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-84m9r"
Jul 21 17:09:35.424811 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:09:35.424783    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-84m9r"]
Jul 21 17:09:35.428705 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:09:35.428667    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3928ed50_aedd_4f2b_bc1f_cea69ea7b4b2.slice/crio-8cdd16ff82df8d8efeeb652f4842ca863b375fd97299c412d7c4a6dfd192adb8 WatchSource:0}: Error finding container 8cdd16ff82df8d8efeeb652f4842ca863b375fd97299c412d7c4a6dfd192adb8: Status 404 returned error can't find the container with id 8cdd16ff82df8d8efeeb652f4842ca863b375fd97299c412d7c4a6dfd192adb8
Jul 21 17:09:35.451760 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:09:35.451723    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-n98c6" event={"ID":"75e3f13b-b4dd-479c-b305-420ec10c39d7","Type":"ContainerStarted","Data":"f6554ded78ad2676a7d3123d7a9b9b6ae30030aca16e556b6b42ad8e061be031"}
Jul 21 17:09:35.451894 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:09:35.451792    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-n98c6" event={"ID":"75e3f13b-b4dd-479c-b305-420ec10c39d7","Type":"ContainerStarted","Data":"c4b904de3bebd8929b0bab913ea305534975570ab2e2be5771246df0a20afd67"}
Jul 21 17:09:35.454614 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:09:35.454544    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-zch68" event={"ID":"229dd683-aaf1-4bde-8091-45e5d43360bc","Type":"ContainerStarted","Data":"e7bbb903da2260782257ab189e5174f2c33d2924490483ffcb0176e3a078c360"}
Jul 21 17:09:35.454802 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:09:35.454753    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-zch68"
Jul 21 17:09:35.456439 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:09:35.456399    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-84m9r" event={"ID":"3928ed50-aedd-4f2b-bc1f-cea69ea7b4b2","Type":"ContainerStarted","Data":"8cdd16ff82df8d8efeeb652f4842ca863b375fd97299c412d7c4a6dfd192adb8"}
Jul 21 17:09:35.461009 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:09:35.460991    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-zch68"
Jul 21 17:09:35.469492 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:09:35.469445    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-n98c6" podStartSLOduration=66.366461378 podStartE2EDuration="1m7.469433466s" totalImagesPullingTime="1.102972088s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 17:08:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 17:09:35.468195403 +0000 UTC m=+67.922348044" watchObservedRunningTime="2026-07-21 17:09:35.469433466 +0000 UTC m=+67.923586106"
Jul 21 17:09:35.486797 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:09:35.486756    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-zch68" podStartSLOduration=1.617520915 podStartE2EDuration="3.486743325s" totalImagesPullingTime="1.86922241s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 17:09:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 17:09:35.486621455 +0000 UTC m=+67.940774096" watchObservedRunningTime="2026-07-21 17:09:35.486743325 +0000 UTC m=+67.940895967"
Jul 21 17:09:43.496171 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:09:43.496129    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-x4gm9" event={"ID":"1f68ab07-c91d-4a29-8b72-cc76e3dd2753","Type":"ContainerStarted","Data":"672fb44e7443f549bdda28248fe2a019ae18003fcf68953df059e4e6a324e086"}
Jul 21 17:09:43.496618 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:09:43.496257    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-x4gm9"
Jul 21 17:09:43.497546 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:09:43.497519    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-44fbg" event={"ID":"7900e00a-7d30-4941-a177-1ce9da22deb3","Type":"ContainerStarted","Data":"2088aee8d9f789be7bd07f8b188d4fba73e483ea0824fa6119547d6d6dfbd6ef"}
Jul 21 17:09:43.498890 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:09:43.498857    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-84m9r" event={"ID":"3928ed50-aedd-4f2b-bc1f-cea69ea7b4b2","Type":"ContainerStarted","Data":"e993e2c9f5d74b1a7e28d9e31db5e96956c1f1622678f7c93a0438d63828a4a0"}
Jul 21 17:09:43.518613 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:09:43.518563    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-x4gm9" podStartSLOduration=66.454264212 podStartE2EDuration="1m15.518546537s" totalImagesPullingTime="9.064282325s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 17:08:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 17:09:43.517152844 +0000 UTC m=+75.971305482" watchObservedRunningTime="2026-07-21 17:09:43.518546537 +0000 UTC m=+75.972699179"
Jul 21 17:09:43.539803 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:09:43.539754    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-44fbg" podStartSLOduration=66.195125013 podStartE2EDuration="1m15.539739497s" totalImagesPullingTime="9.344614484s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-21 17:08:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 17:09:43.538379089 +0000 UTC m=+75.992531730" watchObservedRunningTime="2026-07-21 17:09:43.539739497 +0000 UTC m=+75.993892137"
Jul 21 17:09:44.679018 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:09:44.678404    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-9k2gn"]
Jul 21 17:09:44.681049 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:09:44.680999    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-9k2gn"
Jul 21 17:09:44.685339 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:09:44.685310    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 21 17:09:44.685667 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:09:44.685649    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 21 17:09:44.685961 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:09:44.685944    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 21 17:09:44.686603 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:09:44.686579    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 21 17:09:44.687019 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:09:44.686822    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 21 17:09:44.687019 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:09:44.686874    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 21 17:09:44.687019 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:09:44.686826    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-rx78m\""
Jul 21 17:09:44.765910 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:09:44.765879    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-56c5594674-m7w8f"]
Jul 21 17:09:44.768401 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:09:44.768371    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-56c5594674-m7w8f"
Jul 21 17:09:44.771527 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:09:44.771506    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\""
Jul 21 17:09:44.771981 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:09:44.771957    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-dhgd8\""
Jul 21 17:09:44.772160 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:09:44.772147    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\""
Jul 21 17:09:44.772509 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:09:44.772337    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\""
Jul 21 17:09:44.783236 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:09:44.782485    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-56c5594674-m7w8f"]
Jul 21 17:09:44.846886 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:09:44.846855    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/175fcf39-c159-4e24-885e-60190609aa71-node-exporter-textfile\") pod \"node-exporter-9k2gn\" (UID: \"175fcf39-c159-4e24-885e-60190609aa71\") " pod="openshift-monitoring/node-exporter-9k2gn"
Jul 21 17:09:44.846886 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:09:44.846890    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/175fcf39-c159-4e24-885e-60190609aa71-node-exporter-wtmp\") pod \"node-exporter-9k2gn\" (UID: \"175fcf39-c159-4e24-885e-60190609aa71\") " pod="openshift-monitoring/node-exporter-9k2gn"
Jul 21 17:09:44.847115 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:09:44.846920    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/175fcf39-c159-4e24-885e-60190609aa71-node-exporter-tls\") pod \"node-exporter-9k2gn\" (UID: \"175fcf39-c159-4e24-885e-60190609aa71\") " pod="openshift-monitoring/node-exporter-9k2gn"
Jul 21 17:09:44.847115 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:09:44.847093    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/175fcf39-c159-4e24-885e-60190609aa71-sys\") pod \"node-exporter-9k2gn\" (UID: \"175fcf39-c159-4e24-885e-60190609aa71\") " pod="openshift-monitoring/node-exporter-9k2gn"
Jul 21 17:09:44.847225 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:09:44.847125    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/175fcf39-c159-4e24-885e-60190609aa71-node-exporter-accelerators-collector-config\") pod \"node-exporter-9k2gn\" (UID: \"175fcf39-c159-4e24-885e-60190609aa71\") " pod="openshift-monitoring/node-exporter-9k2gn"
Jul 21 17:09:44.847225 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:09:44.847156    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/175fcf39-c159-4e24-885e-60190609aa71-metrics-client-ca\") pod \"node-exporter-9k2gn\" (UID: \"175fcf39-c159-4e24-885e-60190609aa71\") " pod="openshift-monitoring/node-exporter-9k2gn"
Jul 21 17:09:44.847225 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:09:44.847173    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/eac8bdfe-0e8f-44d6-9a65-c65c9ad9a767-volume-directive-shadow\") pod \"kube-state-metrics-56c5594674-m7w8f\" (UID: \"eac8bdfe-0e8f-44d6-9a65-c65c9ad9a767\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-m7w8f"
Jul 21 17:09:44.847225 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:09:44.847195    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/eac8bdfe-0e8f-44d6-9a65-c65c9ad9a767-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-56c5594674-m7w8f\" (UID: \"eac8bdfe-0e8f-44d6-9a65-c65c9ad9a767\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-m7w8f"
Jul 21 17:09:44.847443 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:09:44.847241    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wv6hr\" (UniqueName: \"kubernetes.io/projected/eac8bdfe-0e8f-44d6-9a65-c65c9ad9a767-kube-api-access-wv6hr\") pod \"kube-state-metrics-56c5594674-m7w8f\" (UID: \"eac8bdfe-0e8f-44d6-9a65-c65c9ad9a767\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-m7w8f"
Jul 21 17:09:44.847443 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:09:44.847260    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/175fcf39-c159-4e24-885e-60190609aa71-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-9k2gn\" (UID: \"175fcf39-c159-4e24-885e-60190609aa71\") " pod="openshift-monitoring/node-exporter-9k2gn"
Jul 21 17:09:44.847443 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:09:44.847279    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/eac8bdfe-0e8f-44d6-9a65-c65c9ad9a767-metrics-client-ca\") pod \"kube-state-metrics-56c5594674-m7w8f\" (UID: \"eac8bdfe-0e8f-44d6-9a65-c65c9ad9a767\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-m7w8f"
Jul 21 17:09:44.847443 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:09:44.847437    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h5xkq\" (UniqueName: \"kubernetes.io/projected/175fcf39-c159-4e24-885e-60190609aa71-kube-api-access-h5xkq\") pod \"node-exporter-9k2gn\" (UID: \"175fcf39-c159-4e24-885e-60190609aa71\") " pod="openshift-monitoring/node-exporter-9k2gn"
Jul 21 17:09:44.847652 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:09:44.847470    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/eac8bdfe-0e8f-44d6-9a65-c65c9ad9a767-kube-state-metrics-tls\") pod \"kube-state-metrics-56c5594674-m7w8f\" (UID: \"eac8bdfe-0e8f-44d6-9a65-c65c9ad9a767\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-m7w8f"
Jul 21 17:09:44.847652 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:09:44.847489    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/eac8bdfe-0e8f-44d6-9a65-c65c9ad9a767-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-56c5594674-m7w8f\" (UID: \"eac8bdfe-0e8f-44d6-9a65-c65c9ad9a767\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-m7w8f"
Jul 21 17:09:44.847652 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:09:44.847505    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/175fcf39-c159-4e24-885e-60190609aa71-root\") pod \"node-exporter-9k2gn\" (UID: \"175fcf39-c159-4e24-885e-60190609aa71\") " pod="openshift-monitoring/node-exporter-9k2gn"
Jul 21 17:09:44.948045 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:09:44.947924    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h5xkq\" (UniqueName: \"kubernetes.io/projected/175fcf39-c159-4e24-885e-60190609aa71-kube-api-access-h5xkq\") pod \"node-exporter-9k2gn\" (UID: \"175fcf39-c159-4e24-885e-60190609aa71\") " pod="openshift-monitoring/node-exporter-9k2gn"
Jul 21 17:09:44.948045 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:09:44.948008    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/eac8bdfe-0e8f-44d6-9a65-c65c9ad9a767-kube-state-metrics-tls\") pod \"kube-state-metrics-56c5594674-m7w8f\" (UID: \"eac8bdfe-0e8f-44d6-9a65-c65c9ad9a767\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-m7w8f"
Jul 21 17:09:44.948045 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:09:44.948041    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/eac8bdfe-0e8f-44d6-9a65-c65c9ad9a767-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-56c5594674-m7w8f\" (UID: \"eac8bdfe-0e8f-44d6-9a65-c65c9ad9a767\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-m7w8f"
Jul 21 17:09:44.948319 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:09:44.948099    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/175fcf39-c159-4e24-885e-60190609aa71-root\") pod \"node-exporter-9k2gn\" (UID: \"175fcf39-c159-4e24-885e-60190609aa71\") " pod="openshift-monitoring/node-exporter-9k2gn"
Jul 21 17:09:44.948319 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:09:44.948139    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/175fcf39-c159-4e24-885e-60190609aa71-node-exporter-textfile\") pod \"node-exporter-9k2gn\" (UID: \"175fcf39-c159-4e24-885e-60190609aa71\") " pod="openshift-monitoring/node-exporter-9k2gn"
Jul 21 17:09:44.948319 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:09:44.948165    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/175fcf39-c159-4e24-885e-60190609aa71-node-exporter-wtmp\") pod \"node-exporter-9k2gn\" (UID: \"175fcf39-c159-4e24-885e-60190609aa71\") " pod="openshift-monitoring/node-exporter-9k2gn"
Jul 21 17:09:44.948319 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:09:44.948227    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/175fcf39-c159-4e24-885e-60190609aa71-node-exporter-tls\") pod \"node-exporter-9k2gn\" (UID: \"175fcf39-c159-4e24-885e-60190609aa71\") " pod="openshift-monitoring/node-exporter-9k2gn"
Jul 21 17:09:44.948319 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:09:44.948271    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/175fcf39-c159-4e24-885e-60190609aa71-sys\") pod \"node-exporter-9k2gn\" (UID: \"175fcf39-c159-4e24-885e-60190609aa71\") " pod="openshift-monitoring/node-exporter-9k2gn"
Jul 21 17:09:44.948319 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:09:44.948296    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/175fcf39-c159-4e24-885e-60190609aa71-node-exporter-accelerators-collector-config\") pod \"node-exporter-9k2gn\" (UID: \"175fcf39-c159-4e24-885e-60190609aa71\") " pod="openshift-monitoring/node-exporter-9k2gn"
Jul 21 17:09:44.948606 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:09:44.948333    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/175fcf39-c159-4e24-885e-60190609aa71-metrics-client-ca\") pod \"node-exporter-9k2gn\" (UID: \"175fcf39-c159-4e24-885e-60190609aa71\") " pod="openshift-monitoring/node-exporter-9k2gn"
Jul 21 17:09:44.948606 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:09:44.948359    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/eac8bdfe-0e8f-44d6-9a65-c65c9ad9a767-volume-directive-shadow\") pod \"kube-state-metrics-56c5594674-m7w8f\" (UID: \"eac8bdfe-0e8f-44d6-9a65-c65c9ad9a767\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-m7w8f"
Jul 21 17:09:44.948606 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:09:44.948384    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/eac8bdfe-0e8f-44d6-9a65-c65c9ad9a767-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-56c5594674-m7w8f\" (UID: \"eac8bdfe-0e8f-44d6-9a65-c65c9ad9a767\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-m7w8f"
Jul 21 17:09:44.948606 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:09:44.948441    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wv6hr\" (UniqueName: \"kubernetes.io/projected/eac8bdfe-0e8f-44d6-9a65-c65c9ad9a767-kube-api-access-wv6hr\") pod \"kube-state-metrics-56c5594674-m7w8f\" (UID: \"eac8bdfe-0e8f-44d6-9a65-c65c9ad9a767\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-m7w8f"
Jul 21 17:09:44.948606 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:09:44.948472    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/175fcf39-c159-4e24-885e-60190609aa71-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-9k2gn\" (UID: \"175fcf39-c159-4e24-885e-60190609aa71\") " pod="openshift-monitoring/node-exporter-9k2gn"
Jul 21 17:09:44.948606 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:09:44.948500    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/eac8bdfe-0e8f-44d6-9a65-c65c9ad9a767-metrics-client-ca\") pod \"kube-state-metrics-56c5594674-m7w8f\" (UID: \"eac8bdfe-0e8f-44d6-9a65-c65c9ad9a767\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-m7w8f"
Jul 21 17:09:44.948923 ip-10-0-141-39 kubenswrapper[2575]: E0721 17:09:44.948800    2575 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found
Jul 21 17:09:44.948923 ip-10-0-141-39 kubenswrapper[2575]: E0721 17:09:44.948873    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/175fcf39-c159-4e24-885e-60190609aa71-node-exporter-tls podName:175fcf39-c159-4e24-885e-60190609aa71 nodeName:}" failed. No retries permitted until 2026-07-21 17:09:45.448853982 +0000 UTC m=+77.903006604 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/175fcf39-c159-4e24-885e-60190609aa71-node-exporter-tls") pod "node-exporter-9k2gn" (UID: "175fcf39-c159-4e24-885e-60190609aa71") : secret "node-exporter-tls" not found
Jul 21 17:09:44.949316 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:09:44.949284    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/175fcf39-c159-4e24-885e-60190609aa71-sys\") pod \"node-exporter-9k2gn\" (UID: \"175fcf39-c159-4e24-885e-60190609aa71\") " pod="openshift-monitoring/node-exporter-9k2gn"
Jul 21 17:09:44.949480 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:09:44.949364    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/175fcf39-c159-4e24-885e-60190609aa71-root\") pod \"node-exporter-9k2gn\" (UID: \"175fcf39-c159-4e24-885e-60190609aa71\") " pod="openshift-monitoring/node-exporter-9k2gn"
Jul 21 17:09:44.950495 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:09:44.949576    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/175fcf39-c159-4e24-885e-60190609aa71-node-exporter-wtmp\") pod \"node-exporter-9k2gn\" (UID: \"175fcf39-c159-4e24-885e-60190609aa71\") " pod="openshift-monitoring/node-exporter-9k2gn"
Jul 21 17:09:44.950495 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:09:44.949808    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/175fcf39-c159-4e24-885e-60190609aa71-node-exporter-textfile\") pod \"node-exporter-9k2gn\" (UID: \"175fcf39-c159-4e24-885e-60190609aa71\") " pod="openshift-monitoring/node-exporter-9k2gn"
Jul 21 17:09:44.950495 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:09:44.949894    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/175fcf39-c159-4e24-885e-60190609aa71-node-exporter-accelerators-collector-config\") pod \"node-exporter-9k2gn\" (UID: \"175fcf39-c159-4e24-885e-60190609aa71\") " pod="openshift-monitoring/node-exporter-9k2gn"
Jul 21 17:09:44.950495 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:09:44.950455    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/175fcf39-c159-4e24-885e-60190609aa71-metrics-client-ca\") pod \"node-exporter-9k2gn\" (UID: \"175fcf39-c159-4e24-885e-60190609aa71\") " pod="openshift-monitoring/node-exporter-9k2gn"
Jul 21 17:09:44.950955 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:09:44.950937    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/eac8bdfe-0e8f-44d6-9a65-c65c9ad9a767-metrics-client-ca\") pod \"kube-state-metrics-56c5594674-m7w8f\" (UID: \"eac8bdfe-0e8f-44d6-9a65-c65c9ad9a767\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-m7w8f"
Jul 21 17:09:44.951394 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:09:44.951235    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/eac8bdfe-0e8f-44d6-9a65-c65c9ad9a767-volume-directive-shadow\") pod \"kube-state-metrics-56c5594674-m7w8f\" (UID: \"eac8bdfe-0e8f-44d6-9a65-c65c9ad9a767\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-m7w8f"
Jul 21 17:09:44.951671 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:09:44.951618    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/eac8bdfe-0e8f-44d6-9a65-c65c9ad9a767-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-56c5594674-m7w8f\" (UID: \"eac8bdfe-0e8f-44d6-9a65-c65c9ad9a767\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-m7w8f"
Jul 21 17:09:44.953155 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:09:44.953114    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/175fcf39-c159-4e24-885e-60190609aa71-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-9k2gn\" (UID: \"175fcf39-c159-4e24-885e-60190609aa71\") " pod="openshift-monitoring/node-exporter-9k2gn"
Jul 21 17:09:44.953657 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:09:44.953640    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/eac8bdfe-0e8f-44d6-9a65-c65c9ad9a767-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-56c5594674-m7w8f\" (UID: \"eac8bdfe-0e8f-44d6-9a65-c65c9ad9a767\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-m7w8f"
Jul 21 17:09:44.954941 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:09:44.954905    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/eac8bdfe-0e8f-44d6-9a65-c65c9ad9a767-kube-state-metrics-tls\") pod \"kube-state-metrics-56c5594674-m7w8f\" (UID: \"eac8bdfe-0e8f-44d6-9a65-c65c9ad9a767\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-m7w8f"
Jul 21 17:09:44.958495 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:09:44.958473    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h5xkq\" (UniqueName: \"kubernetes.io/projected/175fcf39-c159-4e24-885e-60190609aa71-kube-api-access-h5xkq\") pod \"node-exporter-9k2gn\" (UID: \"175fcf39-c159-4e24-885e-60190609aa71\") " pod="openshift-monitoring/node-exporter-9k2gn"
Jul 21 17:09:44.961047 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:09:44.961025    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wv6hr\" (UniqueName: \"kubernetes.io/projected/eac8bdfe-0e8f-44d6-9a65-c65c9ad9a767-kube-api-access-wv6hr\") pod \"kube-state-metrics-56c5594674-m7w8f\" (UID: \"eac8bdfe-0e8f-44d6-9a65-c65c9ad9a767\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-m7w8f"
Jul 21 17:09:45.086248 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:09:45.086217    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-56c5594674-m7w8f"
Jul 21 17:09:45.452146 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:09:45.452106    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/175fcf39-c159-4e24-885e-60190609aa71-node-exporter-tls\") pod \"node-exporter-9k2gn\" (UID: \"175fcf39-c159-4e24-885e-60190609aa71\") " pod="openshift-monitoring/node-exporter-9k2gn"
Jul 21 17:09:45.452342 ip-10-0-141-39 kubenswrapper[2575]: E0721 17:09:45.452289    2575 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found
Jul 21 17:09:45.452410 ip-10-0-141-39 kubenswrapper[2575]: E0721 17:09:45.452363    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/175fcf39-c159-4e24-885e-60190609aa71-node-exporter-tls podName:175fcf39-c159-4e24-885e-60190609aa71 nodeName:}" failed. No retries permitted until 2026-07-21 17:09:46.452342151 +0000 UTC m=+78.906494779 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/175fcf39-c159-4e24-885e-60190609aa71-node-exporter-tls") pod "node-exporter-9k2gn" (UID: "175fcf39-c159-4e24-885e-60190609aa71") : secret "node-exporter-tls" not found
Jul 21 17:09:45.763557 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:09:45.763520    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 21 17:09:45.773863 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:09:45.773833    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 21 17:09:45.776780 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:09:45.776759    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
Jul 21 17:09:45.776999 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:09:45.776983    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
Jul 21 17:09:45.777134 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:09:45.777115    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
Jul 21 17:09:45.777239 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:09:45.777172    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
Jul 21 17:09:45.777388 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:09:45.777373    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
Jul 21 17:09:45.777388 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:09:45.777383    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
Jul 21 17:09:45.777567 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:09:45.777552    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
Jul 21 17:09:45.777651 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:09:45.777636    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-6dgjm\""
Jul 21 17:09:45.777745 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:09:45.777731    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
Jul 21 17:09:45.777909 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:09:45.777894    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
Jul 21 17:09:45.783095 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:09:45.783072    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 21 17:09:45.856818 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:09:45.856779    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/1f616833-66fa-486f-8596-fcabb0de9cc5-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"1f616833-66fa-486f-8596-fcabb0de9cc5\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 17:09:45.857001 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:09:45.856839    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c9kbq\" (UniqueName: \"kubernetes.io/projected/1f616833-66fa-486f-8596-fcabb0de9cc5-kube-api-access-c9kbq\") pod \"alertmanager-main-0\" (UID: \"1f616833-66fa-486f-8596-fcabb0de9cc5\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 17:09:45.857001 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:09:45.856897    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/1f616833-66fa-486f-8596-fcabb0de9cc5-config-out\") pod \"alertmanager-main-0\" (UID: \"1f616833-66fa-486f-8596-fcabb0de9cc5\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 17:09:45.857001 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:09:45.856926    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1f616833-66fa-486f-8596-fcabb0de9cc5-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"1f616833-66fa-486f-8596-fcabb0de9cc5\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 17:09:45.857001 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:09:45.856960    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/1f616833-66fa-486f-8596-fcabb0de9cc5-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"1f616833-66fa-486f-8596-fcabb0de9cc5\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 17:09:45.857161 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:09:45.857024    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/1f616833-66fa-486f-8596-fcabb0de9cc5-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"1f616833-66fa-486f-8596-fcabb0de9cc5\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 17:09:45.857161 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:09:45.857063    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/1f616833-66fa-486f-8596-fcabb0de9cc5-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"1f616833-66fa-486f-8596-fcabb0de9cc5\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 17:09:45.857161 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:09:45.857096    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/1f616833-66fa-486f-8596-fcabb0de9cc5-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"1f616833-66fa-486f-8596-fcabb0de9cc5\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 17:09:45.857161 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:09:45.857142    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/1f616833-66fa-486f-8596-fcabb0de9cc5-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"1f616833-66fa-486f-8596-fcabb0de9cc5\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 17:09:45.857301 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:09:45.857205    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1f616833-66fa-486f-8596-fcabb0de9cc5-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"1f616833-66fa-486f-8596-fcabb0de9cc5\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 17:09:45.857301 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:09:45.857245    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/1f616833-66fa-486f-8596-fcabb0de9cc5-tls-assets\") pod \"alertmanager-main-0\" (UID: \"1f616833-66fa-486f-8596-fcabb0de9cc5\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 17:09:45.857301 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:09:45.857286    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/1f616833-66fa-486f-8596-fcabb0de9cc5-config-volume\") pod \"alertmanager-main-0\" (UID: \"1f616833-66fa-486f-8596-fcabb0de9cc5\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 17:09:45.857395 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:09:45.857311    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/1f616833-66fa-486f-8596-fcabb0de9cc5-web-config\") pod \"alertmanager-main-0\" (UID: \"1f616833-66fa-486f-8596-fcabb0de9cc5\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 17:09:45.957943 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:09:45.957901    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1f616833-66fa-486f-8596-fcabb0de9cc5-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"1f616833-66fa-486f-8596-fcabb0de9cc5\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 17:09:45.958130 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:09:45.957957    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/1f616833-66fa-486f-8596-fcabb0de9cc5-tls-assets\") pod \"alertmanager-main-0\" (UID: \"1f616833-66fa-486f-8596-fcabb0de9cc5\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 17:09:45.958130 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:09:45.957997    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/1f616833-66fa-486f-8596-fcabb0de9cc5-config-volume\") pod \"alertmanager-main-0\" (UID: \"1f616833-66fa-486f-8596-fcabb0de9cc5\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 17:09:45.958130 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:09:45.958023    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/1f616833-66fa-486f-8596-fcabb0de9cc5-web-config\") pod \"alertmanager-main-0\" (UID: \"1f616833-66fa-486f-8596-fcabb0de9cc5\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 17:09:45.958130 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:09:45.958057    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/1f616833-66fa-486f-8596-fcabb0de9cc5-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"1f616833-66fa-486f-8596-fcabb0de9cc5\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 17:09:45.958130 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:09:45.958086    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c9kbq\" (UniqueName: \"kubernetes.io/projected/1f616833-66fa-486f-8596-fcabb0de9cc5-kube-api-access-c9kbq\") pod \"alertmanager-main-0\" (UID: \"1f616833-66fa-486f-8596-fcabb0de9cc5\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 17:09:45.958130 ip-10-0-141-39 kubenswrapper[2575]: E0721 17:09:45.958106    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/1f616833-66fa-486f-8596-fcabb0de9cc5-alertmanager-trusted-ca-bundle podName:1f616833-66fa-486f-8596-fcabb0de9cc5 nodeName:}" failed. No retries permitted until 2026-07-21 17:09:46.458082792 +0000 UTC m=+78.912235424 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "alertmanager-trusted-ca-bundle" (UniqueName: "kubernetes.io/configmap/1f616833-66fa-486f-8596-fcabb0de9cc5-alertmanager-trusted-ca-bundle") pod "alertmanager-main-0" (UID: "1f616833-66fa-486f-8596-fcabb0de9cc5") : configmap references non-existent config key: ca-bundle.crt
Jul 21 17:09:45.958474 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:09:45.958173    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/1f616833-66fa-486f-8596-fcabb0de9cc5-config-out\") pod \"alertmanager-main-0\" (UID: \"1f616833-66fa-486f-8596-fcabb0de9cc5\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 17:09:45.958474 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:09:45.958207    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1f616833-66fa-486f-8596-fcabb0de9cc5-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"1f616833-66fa-486f-8596-fcabb0de9cc5\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 17:09:45.958474 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:09:45.958240    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/1f616833-66fa-486f-8596-fcabb0de9cc5-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"1f616833-66fa-486f-8596-fcabb0de9cc5\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 17:09:45.958474 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:09:45.958274    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/1f616833-66fa-486f-8596-fcabb0de9cc5-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"1f616833-66fa-486f-8596-fcabb0de9cc5\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 17:09:45.958474 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:09:45.958309    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/1f616833-66fa-486f-8596-fcabb0de9cc5-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"1f616833-66fa-486f-8596-fcabb0de9cc5\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 17:09:45.958474 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:09:45.958338    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/1f616833-66fa-486f-8596-fcabb0de9cc5-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"1f616833-66fa-486f-8596-fcabb0de9cc5\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 17:09:45.958474 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:09:45.958381    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/1f616833-66fa-486f-8596-fcabb0de9cc5-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"1f616833-66fa-486f-8596-fcabb0de9cc5\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 17:09:45.964346 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:09:45.964324    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/1f616833-66fa-486f-8596-fcabb0de9cc5-tls-assets\") pod \"alertmanager-main-0\" (UID: \"1f616833-66fa-486f-8596-fcabb0de9cc5\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 17:09:45.967186 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:09:45.966881    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/1f616833-66fa-486f-8596-fcabb0de9cc5-config-volume\") pod \"alertmanager-main-0\" (UID: \"1f616833-66fa-486f-8596-fcabb0de9cc5\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 17:09:45.968279 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:09:45.967875    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1f616833-66fa-486f-8596-fcabb0de9cc5-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"1f616833-66fa-486f-8596-fcabb0de9cc5\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 17:09:45.968279 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:09:45.967921    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/1f616833-66fa-486f-8596-fcabb0de9cc5-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"1f616833-66fa-486f-8596-fcabb0de9cc5\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 17:09:45.969039 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:09:45.968844    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/1f616833-66fa-486f-8596-fcabb0de9cc5-web-config\") pod \"alertmanager-main-0\" (UID: \"1f616833-66fa-486f-8596-fcabb0de9cc5\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 17:09:45.969258 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:09:45.969236    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/1f616833-66fa-486f-8596-fcabb0de9cc5-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"1f616833-66fa-486f-8596-fcabb0de9cc5\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 17:09:45.970087 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:09:45.969909    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/1f616833-66fa-486f-8596-fcabb0de9cc5-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"1f616833-66fa-486f-8596-fcabb0de9cc5\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 17:09:45.970087 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:09:45.970048    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/1f616833-66fa-486f-8596-fcabb0de9cc5-config-out\") pod \"alertmanager-main-0\" (UID: \"1f616833-66fa-486f-8596-fcabb0de9cc5\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 17:09:45.970326 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:09:45.970304    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/1f616833-66fa-486f-8596-fcabb0de9cc5-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"1f616833-66fa-486f-8596-fcabb0de9cc5\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 17:09:45.971354 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:09:45.971328    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/1f616833-66fa-486f-8596-fcabb0de9cc5-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"1f616833-66fa-486f-8596-fcabb0de9cc5\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 17:09:45.971693 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:09:45.971670    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/1f616833-66fa-486f-8596-fcabb0de9cc5-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"1f616833-66fa-486f-8596-fcabb0de9cc5\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 17:09:45.972685 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:09:45.972645    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c9kbq\" (UniqueName: \"kubernetes.io/projected/1f616833-66fa-486f-8596-fcabb0de9cc5-kube-api-access-c9kbq\") pod \"alertmanager-main-0\" (UID: \"1f616833-66fa-486f-8596-fcabb0de9cc5\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 17:09:46.462619 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:09:46.462577    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/175fcf39-c159-4e24-885e-60190609aa71-node-exporter-tls\") pod \"node-exporter-9k2gn\" (UID: \"175fcf39-c159-4e24-885e-60190609aa71\") " pod="openshift-monitoring/node-exporter-9k2gn"
Jul 21 17:09:46.462790 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:09:46.462625    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1f616833-66fa-486f-8596-fcabb0de9cc5-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"1f616833-66fa-486f-8596-fcabb0de9cc5\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 17:09:46.463498 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:09:46.463472    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1f616833-66fa-486f-8596-fcabb0de9cc5-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"1f616833-66fa-486f-8596-fcabb0de9cc5\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 17:09:46.465023 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:09:46.464995    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/175fcf39-c159-4e24-885e-60190609aa71-node-exporter-tls\") pod \"node-exporter-9k2gn\" (UID: \"175fcf39-c159-4e24-885e-60190609aa71\") " pod="openshift-monitoring/node-exporter-9k2gn"
Jul 21 17:09:46.494153 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:09:46.494123    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-9k2gn"
Jul 21 17:09:46.686923 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:09:46.686888    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 21 17:09:47.090453 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:09:47.090407    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod175fcf39_c159_4e24_885e_60190609aa71.slice/crio-daed7da725eb7d804915f6c5a7fe049bd64b8cd2aaca7786aa5afa3d6f694865 WatchSource:0}: Error finding container daed7da725eb7d804915f6c5a7fe049bd64b8cd2aaca7786aa5afa3d6f694865: Status 404 returned error can't find the container with id daed7da725eb7d804915f6c5a7fe049bd64b8cd2aaca7786aa5afa3d6f694865
Jul 21 17:09:47.238170 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:09:47.238146    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-56c5594674-m7w8f"]
Jul 21 17:09:47.239881 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:09:47.239855    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeac8bdfe_0e8f_44d6_9a65_c65c9ad9a767.slice/crio-4621652a3db1e73757cbdd90610268ce12664f17399dfe25ce15b62cdea4c947 WatchSource:0}: Error finding container 4621652a3db1e73757cbdd90610268ce12664f17399dfe25ce15b62cdea4c947: Status 404 returned error can't find the container with id 4621652a3db1e73757cbdd90610268ce12664f17399dfe25ce15b62cdea4c947
Jul 21 17:09:47.259149 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:09:47.259129    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 21 17:09:47.260622 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:09:47.260600    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1f616833_66fa_486f_8596_fcabb0de9cc5.slice/crio-9ff184dbd3f9384413598665636649a76d8a2e56406f6d41efc160ab25427eaf WatchSource:0}: Error finding container 9ff184dbd3f9384413598665636649a76d8a2e56406f6d41efc160ab25427eaf: Status 404 returned error can't find the container with id 9ff184dbd3f9384413598665636649a76d8a2e56406f6d41efc160ab25427eaf
Jul 21 17:09:47.418327 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:09:47.418238    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-57dbbfd699-mb69j"
Jul 21 17:09:47.516033 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:09:47.515997    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-84m9r" event={"ID":"3928ed50-aedd-4f2b-bc1f-cea69ea7b4b2","Type":"ContainerStarted","Data":"c7505d697b38675802f1151ee7c3a5c19178c04ec041971285009b3710b027a5"}
Jul 21 17:09:47.517154 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:09:47.517131    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-9k2gn" event={"ID":"175fcf39-c159-4e24-885e-60190609aa71","Type":"ContainerStarted","Data":"daed7da725eb7d804915f6c5a7fe049bd64b8cd2aaca7786aa5afa3d6f694865"}
Jul 21 17:09:47.518127 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:09:47.518107    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56c5594674-m7w8f" event={"ID":"eac8bdfe-0e8f-44d6-9a65-c65c9ad9a767","Type":"ContainerStarted","Data":"4621652a3db1e73757cbdd90610268ce12664f17399dfe25ce15b62cdea4c947"}
Jul 21 17:09:47.519153 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:09:47.519133    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"1f616833-66fa-486f-8596-fcabb0de9cc5","Type":"ContainerStarted","Data":"9ff184dbd3f9384413598665636649a76d8a2e56406f6d41efc160ab25427eaf"}
Jul 21 17:09:48.525266 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:09:48.525220    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-9k2gn" event={"ID":"175fcf39-c159-4e24-885e-60190609aa71","Type":"ContainerStarted","Data":"3454c2c99073e30cc5ef895710eccc31e8b253ea7f943cf54162213f795655c6"}
Jul 21 17:09:49.068170 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:09:49.068132    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-7c7644cb77-wflck"]
Jul 21 17:09:49.071173 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:09:49.070728    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-7c7644cb77-wflck"
Jul 21 17:09:49.075047 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:09:49.075021    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\""
Jul 21 17:09:49.075267 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:09:49.075250    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-ul02bm4eauvf\""
Jul 21 17:09:49.075594 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:09:49.075577    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Jul 21 17:09:49.075848 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:09:49.075831    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\""
Jul 21 17:09:49.076058 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:09:49.076042    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\""
Jul 21 17:09:49.076249 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:09:49.076234    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-4g9rj\""
Jul 21 17:09:49.083871 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:09:49.083785    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-7c7644cb77-wflck"]
Jul 21 17:09:49.195143 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:09:49.195071    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/e93b6b24-7471-4420-a3ca-33e74b7797b7-secret-metrics-server-client-certs\") pod \"metrics-server-7c7644cb77-wflck\" (UID: \"e93b6b24-7471-4420-a3ca-33e74b7797b7\") " pod="openshift-monitoring/metrics-server-7c7644cb77-wflck"
Jul 21 17:09:49.195143 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:09:49.195127    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/e93b6b24-7471-4420-a3ca-33e74b7797b7-metrics-server-audit-profiles\") pod \"metrics-server-7c7644cb77-wflck\" (UID: \"e93b6b24-7471-4420-a3ca-33e74b7797b7\") " pod="openshift-monitoring/metrics-server-7c7644cb77-wflck"
Jul 21 17:09:49.195143 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:09:49.195148    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-86zd4\" (UniqueName: \"kubernetes.io/projected/e93b6b24-7471-4420-a3ca-33e74b7797b7-kube-api-access-86zd4\") pod \"metrics-server-7c7644cb77-wflck\" (UID: \"e93b6b24-7471-4420-a3ca-33e74b7797b7\") " pod="openshift-monitoring/metrics-server-7c7644cb77-wflck"
Jul 21 17:09:49.195380 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:09:49.195192    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/e93b6b24-7471-4420-a3ca-33e74b7797b7-secret-metrics-server-tls\") pod \"metrics-server-7c7644cb77-wflck\" (UID: \"e93b6b24-7471-4420-a3ca-33e74b7797b7\") " pod="openshift-monitoring/metrics-server-7c7644cb77-wflck"
Jul 21 17:09:49.195380 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:09:49.195210    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/e93b6b24-7471-4420-a3ca-33e74b7797b7-audit-log\") pod \"metrics-server-7c7644cb77-wflck\" (UID: \"e93b6b24-7471-4420-a3ca-33e74b7797b7\") " pod="openshift-monitoring/metrics-server-7c7644cb77-wflck"
Jul 21 17:09:49.195380 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:09:49.195235    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e93b6b24-7471-4420-a3ca-33e74b7797b7-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-7c7644cb77-wflck\" (UID: \"e93b6b24-7471-4420-a3ca-33e74b7797b7\") " pod="openshift-monitoring/metrics-server-7c7644cb77-wflck"
Jul 21 17:09:49.195380 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:09:49.195254    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e93b6b24-7471-4420-a3ca-33e74b7797b7-client-ca-bundle\") pod \"metrics-server-7c7644cb77-wflck\" (UID: \"e93b6b24-7471-4420-a3ca-33e74b7797b7\") " pod="openshift-monitoring/metrics-server-7c7644cb77-wflck"
Jul 21 17:09:49.296536 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:09:49.296501    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e93b6b24-7471-4420-a3ca-33e74b7797b7-client-ca-bundle\") pod \"metrics-server-7c7644cb77-wflck\" (UID: \"e93b6b24-7471-4420-a3ca-33e74b7797b7\") " pod="openshift-monitoring/metrics-server-7c7644cb77-wflck"
Jul 21 17:09:49.296715 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:09:49.296575    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/e93b6b24-7471-4420-a3ca-33e74b7797b7-secret-metrics-server-client-certs\") pod \"metrics-server-7c7644cb77-wflck\" (UID: \"e93b6b24-7471-4420-a3ca-33e74b7797b7\") " pod="openshift-monitoring/metrics-server-7c7644cb77-wflck"
Jul 21 17:09:49.296715 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:09:49.296616    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/e93b6b24-7471-4420-a3ca-33e74b7797b7-metrics-server-audit-profiles\") pod \"metrics-server-7c7644cb77-wflck\" (UID: \"e93b6b24-7471-4420-a3ca-33e74b7797b7\") " pod="openshift-monitoring/metrics-server-7c7644cb77-wflck"
Jul 21 17:09:49.296715 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:09:49.296638    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-86zd4\" (UniqueName: \"kubernetes.io/projected/e93b6b24-7471-4420-a3ca-33e74b7797b7-kube-api-access-86zd4\") pod \"metrics-server-7c7644cb77-wflck\" (UID: \"e93b6b24-7471-4420-a3ca-33e74b7797b7\") " pod="openshift-monitoring/metrics-server-7c7644cb77-wflck"
Jul 21 17:09:49.296715 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:09:49.296673    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/e93b6b24-7471-4420-a3ca-33e74b7797b7-secret-metrics-server-tls\") pod \"metrics-server-7c7644cb77-wflck\" (UID: \"e93b6b24-7471-4420-a3ca-33e74b7797b7\") " pod="openshift-monitoring/metrics-server-7c7644cb77-wflck"
Jul 21 17:09:49.296715 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:09:49.296699    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/e93b6b24-7471-4420-a3ca-33e74b7797b7-audit-log\") pod \"metrics-server-7c7644cb77-wflck\" (UID: \"e93b6b24-7471-4420-a3ca-33e74b7797b7\") " pod="openshift-monitoring/metrics-server-7c7644cb77-wflck"
Jul 21 17:09:49.296960 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:09:49.296736    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e93b6b24-7471-4420-a3ca-33e74b7797b7-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-7c7644cb77-wflck\" (UID: \"e93b6b24-7471-4420-a3ca-33e74b7797b7\") " pod="openshift-monitoring/metrics-server-7c7644cb77-wflck"
Jul 21 17:09:49.297472 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:09:49.297388    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/e93b6b24-7471-4420-a3ca-33e74b7797b7-audit-log\") pod \"metrics-server-7c7644cb77-wflck\" (UID: \"e93b6b24-7471-4420-a3ca-33e74b7797b7\") " pod="openshift-monitoring/metrics-server-7c7644cb77-wflck"
Jul 21 17:09:49.297607 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:09:49.297522    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e93b6b24-7471-4420-a3ca-33e74b7797b7-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-7c7644cb77-wflck\" (UID: \"e93b6b24-7471-4420-a3ca-33e74b7797b7\") " pod="openshift-monitoring/metrics-server-7c7644cb77-wflck"
Jul 21 17:09:49.298003 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:09:49.297951    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/e93b6b24-7471-4420-a3ca-33e74b7797b7-metrics-server-audit-profiles\") pod \"metrics-server-7c7644cb77-wflck\" (UID: \"e93b6b24-7471-4420-a3ca-33e74b7797b7\") " pod="openshift-monitoring/metrics-server-7c7644cb77-wflck"
Jul 21 17:09:49.299566 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:09:49.299541    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e93b6b24-7471-4420-a3ca-33e74b7797b7-client-ca-bundle\") pod \"metrics-server-7c7644cb77-wflck\" (UID: \"e93b6b24-7471-4420-a3ca-33e74b7797b7\") " pod="openshift-monitoring/metrics-server-7c7644cb77-wflck"
Jul 21 17:09:49.299657 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:09:49.299587    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/e93b6b24-7471-4420-a3ca-33e74b7797b7-secret-metrics-server-tls\") pod \"metrics-server-7c7644cb77-wflck\" (UID: \"e93b6b24-7471-4420-a3ca-33e74b7797b7\") " pod="openshift-monitoring/metrics-server-7c7644cb77-wflck"
Jul 21 17:09:49.299657 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:09:49.299609    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/e93b6b24-7471-4420-a3ca-33e74b7797b7-secret-metrics-server-client-certs\") pod \"metrics-server-7c7644cb77-wflck\" (UID: \"e93b6b24-7471-4420-a3ca-33e74b7797b7\") " pod="openshift-monitoring/metrics-server-7c7644cb77-wflck"
Jul 21 17:09:49.307072 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:09:49.307053    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-86zd4\" (UniqueName: \"kubernetes.io/projected/e93b6b24-7471-4420-a3ca-33e74b7797b7-kube-api-access-86zd4\") pod \"metrics-server-7c7644cb77-wflck\" (UID: \"e93b6b24-7471-4420-a3ca-33e74b7797b7\") " pod="openshift-monitoring/metrics-server-7c7644cb77-wflck"
Jul 21 17:09:49.385584 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:09:49.385542    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-7c7644cb77-wflck"
Jul 21 17:09:49.530742 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:09:49.530710    2575 generic.go:356] "Generic (PLEG): container finished" podID="175fcf39-c159-4e24-885e-60190609aa71" containerID="3454c2c99073e30cc5ef895710eccc31e8b253ea7f943cf54162213f795655c6" exitCode=0
Jul 21 17:09:49.531180 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:09:49.530797    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-9k2gn" event={"ID":"175fcf39-c159-4e24-885e-60190609aa71","Type":"ContainerDied","Data":"3454c2c99073e30cc5ef895710eccc31e8b253ea7f943cf54162213f795655c6"}
Jul 21 17:09:49.533115 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:09:49.533094    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56c5594674-m7w8f" event={"ID":"eac8bdfe-0e8f-44d6-9a65-c65c9ad9a767","Type":"ContainerStarted","Data":"c52337b66f7a69196f8743bfaeca597f9d2d0b0fc23b9dac9baaf630b046695c"}
Jul 21 17:09:49.533285 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:09:49.533145    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56c5594674-m7w8f" event={"ID":"eac8bdfe-0e8f-44d6-9a65-c65c9ad9a767","Type":"ContainerStarted","Data":"54ebddbb628b00104f6c85dac4b850d56bd276f87832a890a21ad694ea27b693"}
Jul 21 17:09:49.533285 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:09:49.533180    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56c5594674-m7w8f" event={"ID":"eac8bdfe-0e8f-44d6-9a65-c65c9ad9a767","Type":"ContainerStarted","Data":"925e704ed8c6b7ef9410d470de5228af62b1277e36f62f47d7d8ae084159e567"}
Jul 21 17:09:49.534750 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:09:49.534716    2575 generic.go:356] "Generic (PLEG): container finished" podID="1f616833-66fa-486f-8596-fcabb0de9cc5" containerID="a347aba1d610d72947f020278fbd008b49c4aa9bfdb4665738205ccdd0d9c237" exitCode=0
Jul 21 17:09:49.534862 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:09:49.534763    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"1f616833-66fa-486f-8596-fcabb0de9cc5","Type":"ContainerDied","Data":"a347aba1d610d72947f020278fbd008b49c4aa9bfdb4665738205ccdd0d9c237"}
Jul 21 17:09:50.988469 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:09:50.988390    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-56c5594674-m7w8f" podStartSLOduration=5.303118935 podStartE2EDuration="6.988370826s" totalImagesPullingTime="1.685251891s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 17:09:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 17:09:49.624432916 +0000 UTC m=+82.078585572" watchObservedRunningTime="2026-07-21 17:09:50.988370826 +0000 UTC m=+83.442523471"
Jul 21 17:09:50.988879 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:09:50.988770    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 21 17:09:51.006613 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:09:51.006589    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 17:09:51.011470 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:09:51.011442    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
Jul 21 17:09:51.011623 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:09:51.011453    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
Jul 21 17:09:51.011760 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:09:51.011744    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\""
Jul 21 17:09:51.011848 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:09:51.011760    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
Jul 21 17:09:51.012669 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:09:51.012408    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
Jul 21 17:09:51.012669 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:09:51.012461    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-795avj7tlpdb5\""
Jul 21 17:09:51.012669 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:09:51.012468    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
Jul 21 17:09:51.012669 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:09:51.012488    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-xznkj\""
Jul 21 17:09:51.012669 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:09:51.012514    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\""
Jul 21 17:09:51.012669 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:09:51.012468    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
Jul 21 17:09:51.012669 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:09:51.012625    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
Jul 21 17:09:51.013061 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:09:51.012711    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
Jul 21 17:09:51.013061 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:09:51.012824    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
Jul 21 17:09:51.013538 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:09:51.013522    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
Jul 21 17:09:51.015312 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:09:51.014959    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
Jul 21 17:09:51.020444 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:09:51.020427    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
Jul 21 17:09:51.030281 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:09:51.030255    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 21 17:09:51.113146 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:09:51.113125    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/8364b4ed-8031-45f1-891f-4fbb77e6df78-config\") pod \"prometheus-k8s-0\" (UID: \"8364b4ed-8031-45f1-891f-4fbb77e6df78\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 17:09:51.113253 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:09:51.113161    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/8364b4ed-8031-45f1-891f-4fbb77e6df78-web-config\") pod \"prometheus-k8s-0\" (UID: \"8364b4ed-8031-45f1-891f-4fbb77e6df78\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 17:09:51.113253 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:09:51.113182    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/8364b4ed-8031-45f1-891f-4fbb77e6df78-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"8364b4ed-8031-45f1-891f-4fbb77e6df78\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 17:09:51.113253 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:09:51.113200    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/8364b4ed-8031-45f1-891f-4fbb77e6df78-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"8364b4ed-8031-45f1-891f-4fbb77e6df78\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 17:09:51.113358 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:09:51.113269    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8364b4ed-8031-45f1-891f-4fbb77e6df78-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"8364b4ed-8031-45f1-891f-4fbb77e6df78\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 17:09:51.113358 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:09:51.113288    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-msrqf\" (UniqueName: \"kubernetes.io/projected/8364b4ed-8031-45f1-891f-4fbb77e6df78-kube-api-access-msrqf\") pod \"prometheus-k8s-0\" (UID: \"8364b4ed-8031-45f1-891f-4fbb77e6df78\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 17:09:51.113358 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:09:51.113346    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/8364b4ed-8031-45f1-891f-4fbb77e6df78-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"8364b4ed-8031-45f1-891f-4fbb77e6df78\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 17:09:51.113476 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:09:51.113384    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8364b4ed-8031-45f1-891f-4fbb77e6df78-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"8364b4ed-8031-45f1-891f-4fbb77e6df78\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 17:09:51.113540 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:09:51.113519    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/8364b4ed-8031-45f1-891f-4fbb77e6df78-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"8364b4ed-8031-45f1-891f-4fbb77e6df78\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 17:09:51.113573 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:09:51.113558    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/8364b4ed-8031-45f1-891f-4fbb77e6df78-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"8364b4ed-8031-45f1-891f-4fbb77e6df78\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 17:09:51.113609 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:09:51.113584    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8364b4ed-8031-45f1-891f-4fbb77e6df78-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"8364b4ed-8031-45f1-891f-4fbb77e6df78\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 17:09:51.113656 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:09:51.113635    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8364b4ed-8031-45f1-891f-4fbb77e6df78-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"8364b4ed-8031-45f1-891f-4fbb77e6df78\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 17:09:51.113711 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:09:51.113698    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/8364b4ed-8031-45f1-891f-4fbb77e6df78-config-out\") pod \"prometheus-k8s-0\" (UID: \"8364b4ed-8031-45f1-891f-4fbb77e6df78\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 17:09:51.113751 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:09:51.113728    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/8364b4ed-8031-45f1-891f-4fbb77e6df78-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"8364b4ed-8031-45f1-891f-4fbb77e6df78\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 17:09:51.113791 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:09:51.113760    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/8364b4ed-8031-45f1-891f-4fbb77e6df78-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"8364b4ed-8031-45f1-891f-4fbb77e6df78\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 17:09:51.113848 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:09:51.113788    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/8364b4ed-8031-45f1-891f-4fbb77e6df78-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"8364b4ed-8031-45f1-891f-4fbb77e6df78\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 17:09:51.113848 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:09:51.113813    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/8364b4ed-8031-45f1-891f-4fbb77e6df78-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"8364b4ed-8031-45f1-891f-4fbb77e6df78\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 17:09:51.113848 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:09:51.113838    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/8364b4ed-8031-45f1-891f-4fbb77e6df78-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"8364b4ed-8031-45f1-891f-4fbb77e6df78\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 17:09:51.113962 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:09:51.113905    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/8364b4ed-8031-45f1-891f-4fbb77e6df78-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"8364b4ed-8031-45f1-891f-4fbb77e6df78\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 17:09:51.113962 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:09:51.113934    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/8364b4ed-8031-45f1-891f-4fbb77e6df78-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"8364b4ed-8031-45f1-891f-4fbb77e6df78\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 17:09:51.215053 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:09:51.215023    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/8364b4ed-8031-45f1-891f-4fbb77e6df78-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"8364b4ed-8031-45f1-891f-4fbb77e6df78\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 17:09:51.215181 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:09:51.215059    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/8364b4ed-8031-45f1-891f-4fbb77e6df78-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"8364b4ed-8031-45f1-891f-4fbb77e6df78\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 17:09:51.215181 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:09:51.215077    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/8364b4ed-8031-45f1-891f-4fbb77e6df78-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"8364b4ed-8031-45f1-891f-4fbb77e6df78\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 17:09:51.215181 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:09:51.215092    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/8364b4ed-8031-45f1-891f-4fbb77e6df78-config\") pod \"prometheus-k8s-0\" (UID: \"8364b4ed-8031-45f1-891f-4fbb77e6df78\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 17:09:51.215181 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:09:51.215125    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/8364b4ed-8031-45f1-891f-4fbb77e6df78-web-config\") pod \"prometheus-k8s-0\" (UID: \"8364b4ed-8031-45f1-891f-4fbb77e6df78\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 17:09:51.215181 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:09:51.215148    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/8364b4ed-8031-45f1-891f-4fbb77e6df78-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"8364b4ed-8031-45f1-891f-4fbb77e6df78\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 17:09:51.215181 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:09:51.215165    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/8364b4ed-8031-45f1-891f-4fbb77e6df78-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"8364b4ed-8031-45f1-891f-4fbb77e6df78\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 17:09:51.215508 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:09:51.215190    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8364b4ed-8031-45f1-891f-4fbb77e6df78-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"8364b4ed-8031-45f1-891f-4fbb77e6df78\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 17:09:51.215508 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:09:51.215213    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-msrqf\" (UniqueName: \"kubernetes.io/projected/8364b4ed-8031-45f1-891f-4fbb77e6df78-kube-api-access-msrqf\") pod \"prometheus-k8s-0\" (UID: \"8364b4ed-8031-45f1-891f-4fbb77e6df78\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 17:09:51.215508 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:09:51.215231    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/8364b4ed-8031-45f1-891f-4fbb77e6df78-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"8364b4ed-8031-45f1-891f-4fbb77e6df78\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 17:09:51.215508 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:09:51.215245    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8364b4ed-8031-45f1-891f-4fbb77e6df78-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"8364b4ed-8031-45f1-891f-4fbb77e6df78\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 17:09:51.215508 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:09:51.215281    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/8364b4ed-8031-45f1-891f-4fbb77e6df78-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"8364b4ed-8031-45f1-891f-4fbb77e6df78\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 17:09:51.215508 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:09:51.215308    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/8364b4ed-8031-45f1-891f-4fbb77e6df78-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"8364b4ed-8031-45f1-891f-4fbb77e6df78\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 17:09:51.216402 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:09:51.215871    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/8364b4ed-8031-45f1-891f-4fbb77e6df78-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"8364b4ed-8031-45f1-891f-4fbb77e6df78\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 17:09:51.216402 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:09:51.216240    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8364b4ed-8031-45f1-891f-4fbb77e6df78-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"8364b4ed-8031-45f1-891f-4fbb77e6df78\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 17:09:51.216587 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:09:51.216485    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8364b4ed-8031-45f1-891f-4fbb77e6df78-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"8364b4ed-8031-45f1-891f-4fbb77e6df78\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 17:09:51.216587 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:09:51.216560    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/8364b4ed-8031-45f1-891f-4fbb77e6df78-config-out\") pod \"prometheus-k8s-0\" (UID: \"8364b4ed-8031-45f1-891f-4fbb77e6df78\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 17:09:51.216698 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:09:51.216581    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/8364b4ed-8031-45f1-891f-4fbb77e6df78-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"8364b4ed-8031-45f1-891f-4fbb77e6df78\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 17:09:51.216698 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:09:51.216593    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/8364b4ed-8031-45f1-891f-4fbb77e6df78-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"8364b4ed-8031-45f1-891f-4fbb77e6df78\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 17:09:51.217100 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:09:51.216849    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/8364b4ed-8031-45f1-891f-4fbb77e6df78-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"8364b4ed-8031-45f1-891f-4fbb77e6df78\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 17:09:51.217938 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:09:51.217764    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8364b4ed-8031-45f1-891f-4fbb77e6df78-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"8364b4ed-8031-45f1-891f-4fbb77e6df78\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 17:09:51.217938 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:09:51.217779    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/8364b4ed-8031-45f1-891f-4fbb77e6df78-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"8364b4ed-8031-45f1-891f-4fbb77e6df78\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 17:09:51.218202 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:09:51.217982    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/8364b4ed-8031-45f1-891f-4fbb77e6df78-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"8364b4ed-8031-45f1-891f-4fbb77e6df78\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 17:09:51.218332 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:09:51.218179    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/8364b4ed-8031-45f1-891f-4fbb77e6df78-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"8364b4ed-8031-45f1-891f-4fbb77e6df78\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 17:09:51.219877 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:09:51.218526    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8364b4ed-8031-45f1-891f-4fbb77e6df78-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"8364b4ed-8031-45f1-891f-4fbb77e6df78\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 17:09:51.219877 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:09:51.219467    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/8364b4ed-8031-45f1-891f-4fbb77e6df78-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"8364b4ed-8031-45f1-891f-4fbb77e6df78\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 17:09:51.219877 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:09:51.216253    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-7c7644cb77-wflck"]
Jul 21 17:09:51.224618 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:09:51.221403    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/8364b4ed-8031-45f1-891f-4fbb77e6df78-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"8364b4ed-8031-45f1-891f-4fbb77e6df78\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 17:09:51.224618 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:09:51.222448    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/8364b4ed-8031-45f1-891f-4fbb77e6df78-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"8364b4ed-8031-45f1-891f-4fbb77e6df78\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 17:09:51.224618 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:09:51.223139    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/8364b4ed-8031-45f1-891f-4fbb77e6df78-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"8364b4ed-8031-45f1-891f-4fbb77e6df78\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 17:09:51.224618 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:09:51.224557    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8364b4ed-8031-45f1-891f-4fbb77e6df78-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"8364b4ed-8031-45f1-891f-4fbb77e6df78\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 17:09:51.225079 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:09:51.225044    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/8364b4ed-8031-45f1-891f-4fbb77e6df78-config-out\") pod \"prometheus-k8s-0\" (UID: \"8364b4ed-8031-45f1-891f-4fbb77e6df78\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 17:09:51.225523 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:09:51.225497    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/8364b4ed-8031-45f1-891f-4fbb77e6df78-config\") pod \"prometheus-k8s-0\" (UID: \"8364b4ed-8031-45f1-891f-4fbb77e6df78\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 17:09:51.225607 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:09:51.225576    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/8364b4ed-8031-45f1-891f-4fbb77e6df78-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"8364b4ed-8031-45f1-891f-4fbb77e6df78\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 17:09:51.225607 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:09:51.225586    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8364b4ed-8031-45f1-891f-4fbb77e6df78-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"8364b4ed-8031-45f1-891f-4fbb77e6df78\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 17:09:51.225747 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:09:51.225723    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/8364b4ed-8031-45f1-891f-4fbb77e6df78-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"8364b4ed-8031-45f1-891f-4fbb77e6df78\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 17:09:51.229057 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:09:51.229015    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/8364b4ed-8031-45f1-891f-4fbb77e6df78-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"8364b4ed-8031-45f1-891f-4fbb77e6df78\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 17:09:51.232536 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:09:51.232218    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/8364b4ed-8031-45f1-891f-4fbb77e6df78-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"8364b4ed-8031-45f1-891f-4fbb77e6df78\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 17:09:51.233104 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:09:51.233057    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/8364b4ed-8031-45f1-891f-4fbb77e6df78-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"8364b4ed-8031-45f1-891f-4fbb77e6df78\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 17:09:51.233906 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:09:51.233882    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/8364b4ed-8031-45f1-891f-4fbb77e6df78-web-config\") pod \"prometheus-k8s-0\" (UID: \"8364b4ed-8031-45f1-891f-4fbb77e6df78\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 17:09:51.242847 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:09:51.242820    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-msrqf\" (UniqueName: \"kubernetes.io/projected/8364b4ed-8031-45f1-891f-4fbb77e6df78-kube-api-access-msrqf\") pod \"prometheus-k8s-0\" (UID: \"8364b4ed-8031-45f1-891f-4fbb77e6df78\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 17:09:51.317980 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:09:51.317921    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 17:09:51.466715 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:09:51.466683    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 21 17:09:51.470202 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:09:51.470173    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8364b4ed_8031_45f1_891f_4fbb77e6df78.slice/crio-887d8eebb92f23d363853bbcbaf2de90c0fa79af5c8f196d886c4c0cfd296f70 WatchSource:0}: Error finding container 887d8eebb92f23d363853bbcbaf2de90c0fa79af5c8f196d886c4c0cfd296f70: Status 404 returned error can't find the container with id 887d8eebb92f23d363853bbcbaf2de90c0fa79af5c8f196d886c4c0cfd296f70
Jul 21 17:09:51.545527 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:09:51.545494    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-84m9r" event={"ID":"3928ed50-aedd-4f2b-bc1f-cea69ea7b4b2","Type":"ContainerStarted","Data":"727051a70398121c9065b779bb786970224c63ad499e2432eec690e7f13dbdac"}
Jul 21 17:09:51.548806 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:09:51.548772    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-9k2gn" event={"ID":"175fcf39-c159-4e24-885e-60190609aa71","Type":"ContainerStarted","Data":"299ce4fe1bf45c4212fb95e2c22f8c2d6194f4ff1690c78b2c6128970c7247c7"}
Jul 21 17:09:51.549008 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:09:51.548828    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-9k2gn" event={"ID":"175fcf39-c159-4e24-885e-60190609aa71","Type":"ContainerStarted","Data":"33aaafde208cc78c85f63f82dfafe9d471db85059e3a9a53e3a217f479ab0e63"}
Jul 21 17:09:51.550408 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:09:51.550381    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-7c7644cb77-wflck" event={"ID":"e93b6b24-7471-4420-a3ca-33e74b7797b7","Type":"ContainerStarted","Data":"762d6587aca689ddd34e87dd6836206ee4c8d5471c8114d83916b45dd933d505"}
Jul 21 17:09:51.551910 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:09:51.551885    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8364b4ed-8031-45f1-891f-4fbb77e6df78","Type":"ContainerStarted","Data":"3ab5ac0d1f959a6f14406453a794e3e87a4a398c6dea9a1cd3f4859eabe05d0d"}
Jul 21 17:09:51.552010 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:09:51.551958    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8364b4ed-8031-45f1-891f-4fbb77e6df78","Type":"ContainerStarted","Data":"887d8eebb92f23d363853bbcbaf2de90c0fa79af5c8f196d886c4c0cfd296f70"}
Jul 21 17:09:51.568198 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:09:51.568141    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-84m9r" podStartSLOduration=33.055758207 podStartE2EDuration="48.568120971s" totalImagesPullingTime="15.512362764s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-21 17:09:03 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 17:09:51.56633685 +0000 UTC m=+84.020489490" watchObservedRunningTime="2026-07-21 17:09:51.568120971 +0000 UTC m=+84.022273612"
Jul 21 17:09:51.589914 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:09:51.589852    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-9k2gn" podStartSLOduration=6.4364014990000005 podStartE2EDuration="7.589836172s" totalImagesPullingTime="1.069359646s" totalInitContainerRuntime="84.075027ms" isStatefulPod=true podCreationTimestamp="2026-07-21 17:09:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 17:09:51.589013312 +0000 UTC m=+84.043165953" watchObservedRunningTime="2026-07-21 17:09:51.589836172 +0000 UTC m=+84.043988812"
Jul 21 17:09:52.559382 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:09:52.559349    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"1f616833-66fa-486f-8596-fcabb0de9cc5","Type":"ContainerStarted","Data":"df007037e8c8a15a5ede5ca32f4615fbb53cbbf5e96fefb50d5557192878a1aa"}
Jul 21 17:09:52.559866 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:09:52.559455    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"1f616833-66fa-486f-8596-fcabb0de9cc5","Type":"ContainerStarted","Data":"3d9a33fef75e11e4fd33072b1800687be6762eb0a3b12b49967d406caf0c3f73"}
Jul 21 17:09:52.559866 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:09:52.559531    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"1f616833-66fa-486f-8596-fcabb0de9cc5","Type":"ContainerStarted","Data":"1357fe04c396a02d7c135264a5e76f274ca45f1e3884067b21a5ffa8dc8c4b6c"}
Jul 21 17:09:52.559866 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:09:52.559558    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"1f616833-66fa-486f-8596-fcabb0de9cc5","Type":"ContainerStarted","Data":"9f0c0a1dca7e61bada05de1ccb1d7ab054d5b4b9c9ce12abcfff586ddb6577b2"}
Jul 21 17:09:52.561106 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:09:52.561080    2575 generic.go:356] "Generic (PLEG): container finished" podID="8364b4ed-8031-45f1-891f-4fbb77e6df78" containerID="3ab5ac0d1f959a6f14406453a794e3e87a4a398c6dea9a1cd3f4859eabe05d0d" exitCode=0
Jul 21 17:09:52.561227 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:09:52.561127    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8364b4ed-8031-45f1-891f-4fbb77e6df78","Type":"ContainerDied","Data":"3ab5ac0d1f959a6f14406453a794e3e87a4a398c6dea9a1cd3f4859eabe05d0d"}
Jul 21 17:09:53.568647 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:09:53.568612    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-7c7644cb77-wflck" event={"ID":"e93b6b24-7471-4420-a3ca-33e74b7797b7","Type":"ContainerStarted","Data":"dbfe7020b43716f3708c9121ac49480b9c226a657e7784d479a4038ab22d3f45"}
Jul 21 17:09:53.572218 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:09:53.572191    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"1f616833-66fa-486f-8596-fcabb0de9cc5","Type":"ContainerStarted","Data":"517fd9df2ffe89e02875c882b9516cd0cd7c5b9fba022efe64fc07916454126a"}
Jul 21 17:09:53.589197 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:09:53.589142    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-7c7644cb77-wflck" podStartSLOduration=2.951787807 podStartE2EDuration="4.589123371s" totalImagesPullingTime="1.637335564s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 17:09:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 17:09:53.588824738 +0000 UTC m=+86.042977378" watchObservedRunningTime="2026-07-21 17:09:53.589123371 +0000 UTC m=+86.043276046"
Jul 21 17:09:54.580480 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:09:54.580437    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"1f616833-66fa-486f-8596-fcabb0de9cc5","Type":"ContainerStarted","Data":"e907d858783d12aa832deed5e518fbf29dc778a7d84a81731e5ed40a70f6938e"}
Jul 21 17:09:54.609984 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:09:54.609926    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=4.237748615 podStartE2EDuration="9.609908781s" totalImagesPullingTime="5.347285204s" totalInitContainerRuntime="24.874962ms" isStatefulPod=false podCreationTimestamp="2026-07-21 17:09:45 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 17:09:54.607353344 +0000 UTC m=+87.061505985" watchObservedRunningTime="2026-07-21 17:09:54.609908781 +0000 UTC m=+87.064061423"
Jul 21 17:09:56.591514 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:09:56.591405    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8364b4ed-8031-45f1-891f-4fbb77e6df78","Type":"ContainerStarted","Data":"0410a0b42eb68cafccfe8a03e454a7033577972fa33ad56e75264a135cfebd5d"}
Jul 21 17:09:56.591859 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:09:56.591517    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8364b4ed-8031-45f1-891f-4fbb77e6df78","Type":"ContainerStarted","Data":"27ed7c1517c0617b78a3e7ecf03707e57b872caf3acf5a22576f2f7e654f16a9"}
Jul 21 17:09:58.603316 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:09:58.603275    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8364b4ed-8031-45f1-891f-4fbb77e6df78","Type":"ContainerStarted","Data":"1664a22bc720515bb6bff88dc59c2b58494bdb2ee559621a5ec99c798dea55f3"}
Jul 21 17:09:58.603855 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:09:58.603362    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8364b4ed-8031-45f1-891f-4fbb77e6df78","Type":"ContainerStarted","Data":"41edd2cb99d560eebfa3a8e570abeda8ec59d71c5ca73fed3cc827eedcafda3b"}
Jul 21 17:09:58.603855 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:09:58.603389    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8364b4ed-8031-45f1-891f-4fbb77e6df78","Type":"ContainerStarted","Data":"ac9d562f82a8e08cb751f37855f702f4794b02c1a561de0c79726383bf1feea2"}
Jul 21 17:09:58.603855 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:09:58.603438    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8364b4ed-8031-45f1-891f-4fbb77e6df78","Type":"ContainerStarted","Data":"925a7475c18eafc2034e3339f4045ca31d1190096a4babcd5cdec770474474b0"}
Jul 21 17:09:58.634178 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:09:58.634120    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=3.187118497 podStartE2EDuration="8.634103201s" totalImagesPullingTime="5.418066239s" totalInitContainerRuntime="28.918465ms" isStatefulPod=false podCreationTimestamp="2026-07-21 17:09:50 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 17:09:58.632316103 +0000 UTC m=+91.086468742" watchObservedRunningTime="2026-07-21 17:09:58.634103201 +0000 UTC m=+91.088255842"
Jul 21 17:10:01.318498 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:10:01.318466    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 17:10:09.386293 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:10:09.386243    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-7c7644cb77-wflck"
Jul 21 17:10:09.386704 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:10:09.386320    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-7c7644cb77-wflck"
Jul 21 17:10:14.506328 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:10:14.506300    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-x4gm9"
Jul 21 17:10:29.391760 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:10:29.391733    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-7c7644cb77-wflck"
Jul 21 17:10:29.395502 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:10:29.395475    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-7c7644cb77-wflck"
Jul 21 17:10:51.318473 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:10:51.318437    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 17:10:51.339494 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:10:51.339473    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 17:10:51.818716 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:10:51.818692    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 17:11:04.990357 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:11:04.990323    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 21 17:11:04.990809 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:11:04.990633    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="1f616833-66fa-486f-8596-fcabb0de9cc5" containerName="alertmanager" containerID="cri-o://9f0c0a1dca7e61bada05de1ccb1d7ab054d5b4b9c9ce12abcfff586ddb6577b2" gracePeriod=120
Jul 21 17:11:04.990809 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:11:04.990706    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="1f616833-66fa-486f-8596-fcabb0de9cc5" containerName="kube-rbac-proxy-metric" containerID="cri-o://517fd9df2ffe89e02875c882b9516cd0cd7c5b9fba022efe64fc07916454126a" gracePeriod=120
Jul 21 17:11:04.990809 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:11:04.990749    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="1f616833-66fa-486f-8596-fcabb0de9cc5" containerName="prom-label-proxy" containerID="cri-o://e907d858783d12aa832deed5e518fbf29dc778a7d84a81731e5ed40a70f6938e" gracePeriod=120
Jul 21 17:11:04.990809 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:11:04.990767    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="1f616833-66fa-486f-8596-fcabb0de9cc5" containerName="config-reloader" containerID="cri-o://1357fe04c396a02d7c135264a5e76f274ca45f1e3884067b21a5ffa8dc8c4b6c" gracePeriod=120
Jul 21 17:11:04.991012 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:11:04.990706    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="1f616833-66fa-486f-8596-fcabb0de9cc5" containerName="kube-rbac-proxy" containerID="cri-o://df007037e8c8a15a5ede5ca32f4615fbb53cbbf5e96fefb50d5557192878a1aa" gracePeriod=120
Jul 21 17:11:04.991012 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:11:04.990825    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="1f616833-66fa-486f-8596-fcabb0de9cc5" containerName="kube-rbac-proxy-web" containerID="cri-o://3d9a33fef75e11e4fd33072b1800687be6762eb0a3b12b49967d406caf0c3f73" gracePeriod=120
Jul 21 17:11:05.858087 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:11:05.858057    2575 generic.go:356] "Generic (PLEG): container finished" podID="1f616833-66fa-486f-8596-fcabb0de9cc5" containerID="e907d858783d12aa832deed5e518fbf29dc778a7d84a81731e5ed40a70f6938e" exitCode=0
Jul 21 17:11:05.858087 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:11:05.858081    2575 generic.go:356] "Generic (PLEG): container finished" podID="1f616833-66fa-486f-8596-fcabb0de9cc5" containerID="df007037e8c8a15a5ede5ca32f4615fbb53cbbf5e96fefb50d5557192878a1aa" exitCode=0
Jul 21 17:11:05.858087 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:11:05.858087    2575 generic.go:356] "Generic (PLEG): container finished" podID="1f616833-66fa-486f-8596-fcabb0de9cc5" containerID="1357fe04c396a02d7c135264a5e76f274ca45f1e3884067b21a5ffa8dc8c4b6c" exitCode=0
Jul 21 17:11:05.858087 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:11:05.858092    2575 generic.go:356] "Generic (PLEG): container finished" podID="1f616833-66fa-486f-8596-fcabb0de9cc5" containerID="9f0c0a1dca7e61bada05de1ccb1d7ab054d5b4b9c9ce12abcfff586ddb6577b2" exitCode=0
Jul 21 17:11:05.858403 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:11:05.858125    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"1f616833-66fa-486f-8596-fcabb0de9cc5","Type":"ContainerDied","Data":"e907d858783d12aa832deed5e518fbf29dc778a7d84a81731e5ed40a70f6938e"}
Jul 21 17:11:05.858403 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:11:05.858205    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"1f616833-66fa-486f-8596-fcabb0de9cc5","Type":"ContainerDied","Data":"df007037e8c8a15a5ede5ca32f4615fbb53cbbf5e96fefb50d5557192878a1aa"}
Jul 21 17:11:05.858403 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:11:05.858246    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"1f616833-66fa-486f-8596-fcabb0de9cc5","Type":"ContainerDied","Data":"1357fe04c396a02d7c135264a5e76f274ca45f1e3884067b21a5ffa8dc8c4b6c"}
Jul 21 17:11:05.858403 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:11:05.858283    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"1f616833-66fa-486f-8596-fcabb0de9cc5","Type":"ContainerDied","Data":"9f0c0a1dca7e61bada05de1ccb1d7ab054d5b4b9c9ce12abcfff586ddb6577b2"}
Jul 21 17:11:06.234285 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:11:06.234256    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 21 17:11:06.367027 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:11:06.366988    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/1f616833-66fa-486f-8596-fcabb0de9cc5-alertmanager-main-db\") pod \"1f616833-66fa-486f-8596-fcabb0de9cc5\" (UID: \"1f616833-66fa-486f-8596-fcabb0de9cc5\") "
Jul 21 17:11:06.367027 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:11:06.367038    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1f616833-66fa-486f-8596-fcabb0de9cc5-metrics-client-ca\") pod \"1f616833-66fa-486f-8596-fcabb0de9cc5\" (UID: \"1f616833-66fa-486f-8596-fcabb0de9cc5\") "
Jul 21 17:11:06.367261 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:11:06.367096    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/1f616833-66fa-486f-8596-fcabb0de9cc5-cluster-tls-config\") pod \"1f616833-66fa-486f-8596-fcabb0de9cc5\" (UID: \"1f616833-66fa-486f-8596-fcabb0de9cc5\") "
Jul 21 17:11:06.367261 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:11:06.367118    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1f616833-66fa-486f-8596-fcabb0de9cc5-alertmanager-trusted-ca-bundle\") pod \"1f616833-66fa-486f-8596-fcabb0de9cc5\" (UID: \"1f616833-66fa-486f-8596-fcabb0de9cc5\") "
Jul 21 17:11:06.367261 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:11:06.367140    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/1f616833-66fa-486f-8596-fcabb0de9cc5-secret-alertmanager-kube-rbac-proxy\") pod \"1f616833-66fa-486f-8596-fcabb0de9cc5\" (UID: \"1f616833-66fa-486f-8596-fcabb0de9cc5\") "
Jul 21 17:11:06.367261 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:11:06.367164    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/1f616833-66fa-486f-8596-fcabb0de9cc5-tls-assets\") pod \"1f616833-66fa-486f-8596-fcabb0de9cc5\" (UID: \"1f616833-66fa-486f-8596-fcabb0de9cc5\") "
Jul 21 17:11:06.367261 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:11:06.367189    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/1f616833-66fa-486f-8596-fcabb0de9cc5-config-out\") pod \"1f616833-66fa-486f-8596-fcabb0de9cc5\" (UID: \"1f616833-66fa-486f-8596-fcabb0de9cc5\") "
Jul 21 17:11:06.367261 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:11:06.367222    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/1f616833-66fa-486f-8596-fcabb0de9cc5-secret-alertmanager-kube-rbac-proxy-web\") pod \"1f616833-66fa-486f-8596-fcabb0de9cc5\" (UID: \"1f616833-66fa-486f-8596-fcabb0de9cc5\") "
Jul 21 17:11:06.367261 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:11:06.367247    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/1f616833-66fa-486f-8596-fcabb0de9cc5-web-config\") pod \"1f616833-66fa-486f-8596-fcabb0de9cc5\" (UID: \"1f616833-66fa-486f-8596-fcabb0de9cc5\") "
Jul 21 17:11:06.367626 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:11:06.367285    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/1f616833-66fa-486f-8596-fcabb0de9cc5-secret-alertmanager-kube-rbac-proxy-metric\") pod \"1f616833-66fa-486f-8596-fcabb0de9cc5\" (UID: \"1f616833-66fa-486f-8596-fcabb0de9cc5\") "
Jul 21 17:11:06.367626 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:11:06.367311    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/1f616833-66fa-486f-8596-fcabb0de9cc5-config-volume\") pod \"1f616833-66fa-486f-8596-fcabb0de9cc5\" (UID: \"1f616833-66fa-486f-8596-fcabb0de9cc5\") "
Jul 21 17:11:06.367626 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:11:06.367348    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/1f616833-66fa-486f-8596-fcabb0de9cc5-secret-alertmanager-main-tls\") pod \"1f616833-66fa-486f-8596-fcabb0de9cc5\" (UID: \"1f616833-66fa-486f-8596-fcabb0de9cc5\") "
Jul 21 17:11:06.367626 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:11:06.367379    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-c9kbq\" (UniqueName: \"kubernetes.io/projected/1f616833-66fa-486f-8596-fcabb0de9cc5-kube-api-access-c9kbq\") pod \"1f616833-66fa-486f-8596-fcabb0de9cc5\" (UID: \"1f616833-66fa-486f-8596-fcabb0de9cc5\") "
Jul 21 17:11:06.367626 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:11:06.367449    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1f616833-66fa-486f-8596-fcabb0de9cc5-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "1f616833-66fa-486f-8596-fcabb0de9cc5" (UID: "1f616833-66fa-486f-8596-fcabb0de9cc5"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 17:11:06.367626 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:11:06.367471    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1f616833-66fa-486f-8596-fcabb0de9cc5-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "1f616833-66fa-486f-8596-fcabb0de9cc5" (UID: "1f616833-66fa-486f-8596-fcabb0de9cc5"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 17:11:06.367626 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:11:06.367574    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1f616833-66fa-486f-8596-fcabb0de9cc5-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "1f616833-66fa-486f-8596-fcabb0de9cc5" (UID: "1f616833-66fa-486f-8596-fcabb0de9cc5"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 17:11:06.367962 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:11:06.367698    2575 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/1f616833-66fa-486f-8596-fcabb0de9cc5-alertmanager-main-db\") on node \"ip-10-0-141-39.ec2.internal\" DevicePath \"\""
Jul 21 17:11:06.367962 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:11:06.367718    2575 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1f616833-66fa-486f-8596-fcabb0de9cc5-metrics-client-ca\") on node \"ip-10-0-141-39.ec2.internal\" DevicePath \"\""
Jul 21 17:11:06.367962 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:11:06.367734    2575 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1f616833-66fa-486f-8596-fcabb0de9cc5-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-141-39.ec2.internal\" DevicePath \"\""
Jul 21 17:11:06.370747 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:11:06.370703    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1f616833-66fa-486f-8596-fcabb0de9cc5-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "1f616833-66fa-486f-8596-fcabb0de9cc5" (UID: "1f616833-66fa-486f-8596-fcabb0de9cc5"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 21 17:11:06.371083 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:11:06.371001    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1f616833-66fa-486f-8596-fcabb0de9cc5-kube-api-access-c9kbq" (OuterVolumeSpecName: "kube-api-access-c9kbq") pod "1f616833-66fa-486f-8596-fcabb0de9cc5" (UID: "1f616833-66fa-486f-8596-fcabb0de9cc5"). InnerVolumeSpecName "kube-api-access-c9kbq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 17:11:06.371279 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:11:06.371225    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1f616833-66fa-486f-8596-fcabb0de9cc5-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "1f616833-66fa-486f-8596-fcabb0de9cc5" (UID: "1f616833-66fa-486f-8596-fcabb0de9cc5"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 21 17:11:06.371279 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:11:06.371245    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1f616833-66fa-486f-8596-fcabb0de9cc5-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "1f616833-66fa-486f-8596-fcabb0de9cc5" (UID: "1f616833-66fa-486f-8596-fcabb0de9cc5"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 21 17:11:06.371400 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:11:06.371314    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1f616833-66fa-486f-8596-fcabb0de9cc5-config-out" (OuterVolumeSpecName: "config-out") pod "1f616833-66fa-486f-8596-fcabb0de9cc5" (UID: "1f616833-66fa-486f-8596-fcabb0de9cc5"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 17:11:06.371400 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:11:06.371338    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1f616833-66fa-486f-8596-fcabb0de9cc5-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "1f616833-66fa-486f-8596-fcabb0de9cc5" (UID: "1f616833-66fa-486f-8596-fcabb0de9cc5"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 17:11:06.371782 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:11:06.371763    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1f616833-66fa-486f-8596-fcabb0de9cc5-config-volume" (OuterVolumeSpecName: "config-volume") pod "1f616833-66fa-486f-8596-fcabb0de9cc5" (UID: "1f616833-66fa-486f-8596-fcabb0de9cc5"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 21 17:11:06.372099 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:11:06.372084    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1f616833-66fa-486f-8596-fcabb0de9cc5-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "1f616833-66fa-486f-8596-fcabb0de9cc5" (UID: "1f616833-66fa-486f-8596-fcabb0de9cc5"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 21 17:11:06.374666 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:11:06.374633    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1f616833-66fa-486f-8596-fcabb0de9cc5-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "1f616833-66fa-486f-8596-fcabb0de9cc5" (UID: "1f616833-66fa-486f-8596-fcabb0de9cc5"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 21 17:11:06.381865 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:11:06.381845    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1f616833-66fa-486f-8596-fcabb0de9cc5-web-config" (OuterVolumeSpecName: "web-config") pod "1f616833-66fa-486f-8596-fcabb0de9cc5" (UID: "1f616833-66fa-486f-8596-fcabb0de9cc5"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 21 17:11:06.468656 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:11:06.468577    2575 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/1f616833-66fa-486f-8596-fcabb0de9cc5-cluster-tls-config\") on node \"ip-10-0-141-39.ec2.internal\" DevicePath \"\""
Jul 21 17:11:06.468656 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:11:06.468607    2575 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/1f616833-66fa-486f-8596-fcabb0de9cc5-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-141-39.ec2.internal\" DevicePath \"\""
Jul 21 17:11:06.468656 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:11:06.468618    2575 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/1f616833-66fa-486f-8596-fcabb0de9cc5-tls-assets\") on node \"ip-10-0-141-39.ec2.internal\" DevicePath \"\""
Jul 21 17:11:06.468656 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:11:06.468626    2575 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/1f616833-66fa-486f-8596-fcabb0de9cc5-config-out\") on node \"ip-10-0-141-39.ec2.internal\" DevicePath \"\""
Jul 21 17:11:06.468656 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:11:06.468635    2575 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/1f616833-66fa-486f-8596-fcabb0de9cc5-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-141-39.ec2.internal\" DevicePath \"\""
Jul 21 17:11:06.468656 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:11:06.468663    2575 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/1f616833-66fa-486f-8596-fcabb0de9cc5-web-config\") on node \"ip-10-0-141-39.ec2.internal\" DevicePath \"\""
Jul 21 17:11:06.468937 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:11:06.468672    2575 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/1f616833-66fa-486f-8596-fcabb0de9cc5-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-141-39.ec2.internal\" DevicePath \"\""
Jul 21 17:11:06.468937 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:11:06.468682    2575 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/1f616833-66fa-486f-8596-fcabb0de9cc5-config-volume\") on node \"ip-10-0-141-39.ec2.internal\" DevicePath \"\""
Jul 21 17:11:06.468937 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:11:06.468691    2575 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/1f616833-66fa-486f-8596-fcabb0de9cc5-secret-alertmanager-main-tls\") on node \"ip-10-0-141-39.ec2.internal\" DevicePath \"\""
Jul 21 17:11:06.468937 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:11:06.468699    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-c9kbq\" (UniqueName: \"kubernetes.io/projected/1f616833-66fa-486f-8596-fcabb0de9cc5-kube-api-access-c9kbq\") on node \"ip-10-0-141-39.ec2.internal\" DevicePath \"\""
Jul 21 17:11:06.864573 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:11:06.864538    2575 generic.go:356] "Generic (PLEG): container finished" podID="1f616833-66fa-486f-8596-fcabb0de9cc5" containerID="517fd9df2ffe89e02875c882b9516cd0cd7c5b9fba022efe64fc07916454126a" exitCode=0
Jul 21 17:11:06.864573 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:11:06.864569    2575 generic.go:356] "Generic (PLEG): container finished" podID="1f616833-66fa-486f-8596-fcabb0de9cc5" containerID="3d9a33fef75e11e4fd33072b1800687be6762eb0a3b12b49967d406caf0c3f73" exitCode=0
Jul 21 17:11:06.864754 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:11:06.864630    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 21 17:11:06.864754 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:11:06.864630    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"1f616833-66fa-486f-8596-fcabb0de9cc5","Type":"ContainerDied","Data":"517fd9df2ffe89e02875c882b9516cd0cd7c5b9fba022efe64fc07916454126a"}
Jul 21 17:11:06.864754 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:11:06.864699    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"1f616833-66fa-486f-8596-fcabb0de9cc5","Type":"ContainerDied","Data":"3d9a33fef75e11e4fd33072b1800687be6762eb0a3b12b49967d406caf0c3f73"}
Jul 21 17:11:06.864754 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:11:06.864726    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"1f616833-66fa-486f-8596-fcabb0de9cc5","Type":"ContainerDied","Data":"9ff184dbd3f9384413598665636649a76d8a2e56406f6d41efc160ab25427eaf"}
Jul 21 17:11:06.864887 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:11:06.864769    2575 scope.go:117] "RemoveContainer" containerID="e907d858783d12aa832deed5e518fbf29dc778a7d84a81731e5ed40a70f6938e"
Jul 21 17:11:06.873121 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:11:06.873103    2575 scope.go:117] "RemoveContainer" containerID="517fd9df2ffe89e02875c882b9516cd0cd7c5b9fba022efe64fc07916454126a"
Jul 21 17:11:06.880080 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:11:06.880064    2575 scope.go:117] "RemoveContainer" containerID="df007037e8c8a15a5ede5ca32f4615fbb53cbbf5e96fefb50d5557192878a1aa"
Jul 21 17:11:06.887061 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:11:06.887044    2575 scope.go:117] "RemoveContainer" containerID="3d9a33fef75e11e4fd33072b1800687be6762eb0a3b12b49967d406caf0c3f73"
Jul 21 17:11:06.889483 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:11:06.889462    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 21 17:11:06.893830 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:11:06.893806    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 21 17:11:06.895803 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:11:06.895786    2575 scope.go:117] "RemoveContainer" containerID="1357fe04c396a02d7c135264a5e76f274ca45f1e3884067b21a5ffa8dc8c4b6c"
Jul 21 17:11:06.902681 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:11:06.902656    2575 scope.go:117] "RemoveContainer" containerID="9f0c0a1dca7e61bada05de1ccb1d7ab054d5b4b9c9ce12abcfff586ddb6577b2"
Jul 21 17:11:06.909487 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:11:06.909473    2575 scope.go:117] "RemoveContainer" containerID="a347aba1d610d72947f020278fbd008b49c4aa9bfdb4665738205ccdd0d9c237"
Jul 21 17:11:06.916684 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:11:06.916665    2575 scope.go:117] "RemoveContainer" containerID="e907d858783d12aa832deed5e518fbf29dc778a7d84a81731e5ed40a70f6938e"
Jul 21 17:11:06.916985 ip-10-0-141-39 kubenswrapper[2575]: E0721 17:11:06.916946    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e907d858783d12aa832deed5e518fbf29dc778a7d84a81731e5ed40a70f6938e\": container with ID starting with e907d858783d12aa832deed5e518fbf29dc778a7d84a81731e5ed40a70f6938e not found: ID does not exist" containerID="e907d858783d12aa832deed5e518fbf29dc778a7d84a81731e5ed40a70f6938e"
Jul 21 17:11:06.917053 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:11:06.916993    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e907d858783d12aa832deed5e518fbf29dc778a7d84a81731e5ed40a70f6938e"} err="failed to get container status \"e907d858783d12aa832deed5e518fbf29dc778a7d84a81731e5ed40a70f6938e\": rpc error: code = NotFound desc = could not find container \"e907d858783d12aa832deed5e518fbf29dc778a7d84a81731e5ed40a70f6938e\": container with ID starting with e907d858783d12aa832deed5e518fbf29dc778a7d84a81731e5ed40a70f6938e not found: ID does not exist"
Jul 21 17:11:06.917053 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:11:06.917027    2575 scope.go:117] "RemoveContainer" containerID="517fd9df2ffe89e02875c882b9516cd0cd7c5b9fba022efe64fc07916454126a"
Jul 21 17:11:06.917290 ip-10-0-141-39 kubenswrapper[2575]: E0721 17:11:06.917277    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"517fd9df2ffe89e02875c882b9516cd0cd7c5b9fba022efe64fc07916454126a\": container with ID starting with 517fd9df2ffe89e02875c882b9516cd0cd7c5b9fba022efe64fc07916454126a not found: ID does not exist" containerID="517fd9df2ffe89e02875c882b9516cd0cd7c5b9fba022efe64fc07916454126a"
Jul 21 17:11:06.917329 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:11:06.917293    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"517fd9df2ffe89e02875c882b9516cd0cd7c5b9fba022efe64fc07916454126a"} err="failed to get container status \"517fd9df2ffe89e02875c882b9516cd0cd7c5b9fba022efe64fc07916454126a\": rpc error: code = NotFound desc = could not find container \"517fd9df2ffe89e02875c882b9516cd0cd7c5b9fba022efe64fc07916454126a\": container with ID starting with 517fd9df2ffe89e02875c882b9516cd0cd7c5b9fba022efe64fc07916454126a not found: ID does not exist"
Jul 21 17:11:06.917329 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:11:06.917315    2575 scope.go:117] "RemoveContainer" containerID="df007037e8c8a15a5ede5ca32f4615fbb53cbbf5e96fefb50d5557192878a1aa"
Jul 21 17:11:06.917556 ip-10-0-141-39 kubenswrapper[2575]: E0721 17:11:06.917541    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"df007037e8c8a15a5ede5ca32f4615fbb53cbbf5e96fefb50d5557192878a1aa\": container with ID starting with df007037e8c8a15a5ede5ca32f4615fbb53cbbf5e96fefb50d5557192878a1aa not found: ID does not exist" containerID="df007037e8c8a15a5ede5ca32f4615fbb53cbbf5e96fefb50d5557192878a1aa"
Jul 21 17:11:06.917606 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:11:06.917559    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"df007037e8c8a15a5ede5ca32f4615fbb53cbbf5e96fefb50d5557192878a1aa"} err="failed to get container status \"df007037e8c8a15a5ede5ca32f4615fbb53cbbf5e96fefb50d5557192878a1aa\": rpc error: code = NotFound desc = could not find container \"df007037e8c8a15a5ede5ca32f4615fbb53cbbf5e96fefb50d5557192878a1aa\": container with ID starting with df007037e8c8a15a5ede5ca32f4615fbb53cbbf5e96fefb50d5557192878a1aa not found: ID does not exist"
Jul 21 17:11:06.917606 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:11:06.917571    2575 scope.go:117] "RemoveContainer" containerID="3d9a33fef75e11e4fd33072b1800687be6762eb0a3b12b49967d406caf0c3f73"
Jul 21 17:11:06.917772 ip-10-0-141-39 kubenswrapper[2575]: E0721 17:11:06.917758    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3d9a33fef75e11e4fd33072b1800687be6762eb0a3b12b49967d406caf0c3f73\": container with ID starting with 3d9a33fef75e11e4fd33072b1800687be6762eb0a3b12b49967d406caf0c3f73 not found: ID does not exist" containerID="3d9a33fef75e11e4fd33072b1800687be6762eb0a3b12b49967d406caf0c3f73"
Jul 21 17:11:06.917809 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:11:06.917775    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3d9a33fef75e11e4fd33072b1800687be6762eb0a3b12b49967d406caf0c3f73"} err="failed to get container status \"3d9a33fef75e11e4fd33072b1800687be6762eb0a3b12b49967d406caf0c3f73\": rpc error: code = NotFound desc = could not find container \"3d9a33fef75e11e4fd33072b1800687be6762eb0a3b12b49967d406caf0c3f73\": container with ID starting with 3d9a33fef75e11e4fd33072b1800687be6762eb0a3b12b49967d406caf0c3f73 not found: ID does not exist"
Jul 21 17:11:06.917809 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:11:06.917798    2575 scope.go:117] "RemoveContainer" containerID="1357fe04c396a02d7c135264a5e76f274ca45f1e3884067b21a5ffa8dc8c4b6c"
Jul 21 17:11:06.918010 ip-10-0-141-39 kubenswrapper[2575]: E0721 17:11:06.917990    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1357fe04c396a02d7c135264a5e76f274ca45f1e3884067b21a5ffa8dc8c4b6c\": container with ID starting with 1357fe04c396a02d7c135264a5e76f274ca45f1e3884067b21a5ffa8dc8c4b6c not found: ID does not exist" containerID="1357fe04c396a02d7c135264a5e76f274ca45f1e3884067b21a5ffa8dc8c4b6c"
Jul 21 17:11:06.918082 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:11:06.918018    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1357fe04c396a02d7c135264a5e76f274ca45f1e3884067b21a5ffa8dc8c4b6c"} err="failed to get container status \"1357fe04c396a02d7c135264a5e76f274ca45f1e3884067b21a5ffa8dc8c4b6c\": rpc error: code = NotFound desc = could not find container \"1357fe04c396a02d7c135264a5e76f274ca45f1e3884067b21a5ffa8dc8c4b6c\": container with ID starting with 1357fe04c396a02d7c135264a5e76f274ca45f1e3884067b21a5ffa8dc8c4b6c not found: ID does not exist"
Jul 21 17:11:06.918082 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:11:06.918040    2575 scope.go:117] "RemoveContainer" containerID="9f0c0a1dca7e61bada05de1ccb1d7ab054d5b4b9c9ce12abcfff586ddb6577b2"
Jul 21 17:11:06.918262 ip-10-0-141-39 kubenswrapper[2575]: E0721 17:11:06.918245    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9f0c0a1dca7e61bada05de1ccb1d7ab054d5b4b9c9ce12abcfff586ddb6577b2\": container with ID starting with 9f0c0a1dca7e61bada05de1ccb1d7ab054d5b4b9c9ce12abcfff586ddb6577b2 not found: ID does not exist" containerID="9f0c0a1dca7e61bada05de1ccb1d7ab054d5b4b9c9ce12abcfff586ddb6577b2"
Jul 21 17:11:06.918299 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:11:06.918268    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9f0c0a1dca7e61bada05de1ccb1d7ab054d5b4b9c9ce12abcfff586ddb6577b2"} err="failed to get container status \"9f0c0a1dca7e61bada05de1ccb1d7ab054d5b4b9c9ce12abcfff586ddb6577b2\": rpc error: code = NotFound desc = could not find container \"9f0c0a1dca7e61bada05de1ccb1d7ab054d5b4b9c9ce12abcfff586ddb6577b2\": container with ID starting with 9f0c0a1dca7e61bada05de1ccb1d7ab054d5b4b9c9ce12abcfff586ddb6577b2 not found: ID does not exist"
Jul 21 17:11:06.918299 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:11:06.918283    2575 scope.go:117] "RemoveContainer" containerID="a347aba1d610d72947f020278fbd008b49c4aa9bfdb4665738205ccdd0d9c237"
Jul 21 17:11:06.918577 ip-10-0-141-39 kubenswrapper[2575]: E0721 17:11:06.918558    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a347aba1d610d72947f020278fbd008b49c4aa9bfdb4665738205ccdd0d9c237\": container with ID starting with a347aba1d610d72947f020278fbd008b49c4aa9bfdb4665738205ccdd0d9c237 not found: ID does not exist" containerID="a347aba1d610d72947f020278fbd008b49c4aa9bfdb4665738205ccdd0d9c237"
Jul 21 17:11:06.918652 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:11:06.918584    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a347aba1d610d72947f020278fbd008b49c4aa9bfdb4665738205ccdd0d9c237"} err="failed to get container status \"a347aba1d610d72947f020278fbd008b49c4aa9bfdb4665738205ccdd0d9c237\": rpc error: code = NotFound desc = could not find container \"a347aba1d610d72947f020278fbd008b49c4aa9bfdb4665738205ccdd0d9c237\": container with ID starting with a347aba1d610d72947f020278fbd008b49c4aa9bfdb4665738205ccdd0d9c237 not found: ID does not exist"
Jul 21 17:11:06.918652 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:11:06.918602    2575 scope.go:117] "RemoveContainer" containerID="e907d858783d12aa832deed5e518fbf29dc778a7d84a81731e5ed40a70f6938e"
Jul 21 17:11:06.918841 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:11:06.918821    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e907d858783d12aa832deed5e518fbf29dc778a7d84a81731e5ed40a70f6938e"} err="failed to get container status \"e907d858783d12aa832deed5e518fbf29dc778a7d84a81731e5ed40a70f6938e\": rpc error: code = NotFound desc = could not find container \"e907d858783d12aa832deed5e518fbf29dc778a7d84a81731e5ed40a70f6938e\": container with ID starting with e907d858783d12aa832deed5e518fbf29dc778a7d84a81731e5ed40a70f6938e not found: ID does not exist"
Jul 21 17:11:06.918883 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:11:06.918842    2575 scope.go:117] "RemoveContainer" containerID="517fd9df2ffe89e02875c882b9516cd0cd7c5b9fba022efe64fc07916454126a"
Jul 21 17:11:06.919057 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:11:06.919040    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"517fd9df2ffe89e02875c882b9516cd0cd7c5b9fba022efe64fc07916454126a"} err="failed to get container status \"517fd9df2ffe89e02875c882b9516cd0cd7c5b9fba022efe64fc07916454126a\": rpc error: code = NotFound desc = could not find container \"517fd9df2ffe89e02875c882b9516cd0cd7c5b9fba022efe64fc07916454126a\": container with ID starting with 517fd9df2ffe89e02875c882b9516cd0cd7c5b9fba022efe64fc07916454126a not found: ID does not exist"
Jul 21 17:11:06.919126 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:11:06.919059    2575 scope.go:117] "RemoveContainer" containerID="df007037e8c8a15a5ede5ca32f4615fbb53cbbf5e96fefb50d5557192878a1aa"
Jul 21 17:11:06.919276 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:11:06.919259    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"df007037e8c8a15a5ede5ca32f4615fbb53cbbf5e96fefb50d5557192878a1aa"} err="failed to get container status \"df007037e8c8a15a5ede5ca32f4615fbb53cbbf5e96fefb50d5557192878a1aa\": rpc error: code = NotFound desc = could not find container \"df007037e8c8a15a5ede5ca32f4615fbb53cbbf5e96fefb50d5557192878a1aa\": container with ID starting with df007037e8c8a15a5ede5ca32f4615fbb53cbbf5e96fefb50d5557192878a1aa not found: ID does not exist"
Jul 21 17:11:06.919322 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:11:06.919278    2575 scope.go:117] "RemoveContainer" containerID="3d9a33fef75e11e4fd33072b1800687be6762eb0a3b12b49967d406caf0c3f73"
Jul 21 17:11:06.919508 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:11:06.919491    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3d9a33fef75e11e4fd33072b1800687be6762eb0a3b12b49967d406caf0c3f73"} err="failed to get container status \"3d9a33fef75e11e4fd33072b1800687be6762eb0a3b12b49967d406caf0c3f73\": rpc error: code = NotFound desc = could not find container \"3d9a33fef75e11e4fd33072b1800687be6762eb0a3b12b49967d406caf0c3f73\": container with ID starting with 3d9a33fef75e11e4fd33072b1800687be6762eb0a3b12b49967d406caf0c3f73 not found: ID does not exist"
Jul 21 17:11:06.919580 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:11:06.919509    2575 scope.go:117] "RemoveContainer" containerID="1357fe04c396a02d7c135264a5e76f274ca45f1e3884067b21a5ffa8dc8c4b6c"
Jul 21 17:11:06.919718 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:11:06.919703    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1357fe04c396a02d7c135264a5e76f274ca45f1e3884067b21a5ffa8dc8c4b6c"} err="failed to get container status \"1357fe04c396a02d7c135264a5e76f274ca45f1e3884067b21a5ffa8dc8c4b6c\": rpc error: code = NotFound desc = could not find container \"1357fe04c396a02d7c135264a5e76f274ca45f1e3884067b21a5ffa8dc8c4b6c\": container with ID starting with 1357fe04c396a02d7c135264a5e76f274ca45f1e3884067b21a5ffa8dc8c4b6c not found: ID does not exist"
Jul 21 17:11:06.919780 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:11:06.919719    2575 scope.go:117] "RemoveContainer" containerID="9f0c0a1dca7e61bada05de1ccb1d7ab054d5b4b9c9ce12abcfff586ddb6577b2"
Jul 21 17:11:06.919935 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:11:06.919919    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9f0c0a1dca7e61bada05de1ccb1d7ab054d5b4b9c9ce12abcfff586ddb6577b2"} err="failed to get container status \"9f0c0a1dca7e61bada05de1ccb1d7ab054d5b4b9c9ce12abcfff586ddb6577b2\": rpc error: code = NotFound desc = could not find container \"9f0c0a1dca7e61bada05de1ccb1d7ab054d5b4b9c9ce12abcfff586ddb6577b2\": container with ID starting with 9f0c0a1dca7e61bada05de1ccb1d7ab054d5b4b9c9ce12abcfff586ddb6577b2 not found: ID does not exist"
Jul 21 17:11:06.919980 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:11:06.919936    2575 scope.go:117] "RemoveContainer" containerID="a347aba1d610d72947f020278fbd008b49c4aa9bfdb4665738205ccdd0d9c237"
Jul 21 17:11:06.920183 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:11:06.920166    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a347aba1d610d72947f020278fbd008b49c4aa9bfdb4665738205ccdd0d9c237"} err="failed to get container status \"a347aba1d610d72947f020278fbd008b49c4aa9bfdb4665738205ccdd0d9c237\": rpc error: code = NotFound desc = could not find container \"a347aba1d610d72947f020278fbd008b49c4aa9bfdb4665738205ccdd0d9c237\": container with ID starting with a347aba1d610d72947f020278fbd008b49c4aa9bfdb4665738205ccdd0d9c237 not found: ID does not exist"
Jul 21 17:11:08.115168 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:11:08.115137    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1f616833-66fa-486f-8596-fcabb0de9cc5" path="/var/lib/kubelet/pods/1f616833-66fa-486f-8596-fcabb0de9cc5/volumes"
Jul 21 17:11:09.328378 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:11:09.328345    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 21 17:11:09.328819 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:11:09.328625    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="8364b4ed-8031-45f1-891f-4fbb77e6df78" containerName="prometheus" containerID="cri-o://27ed7c1517c0617b78a3e7ecf03707e57b872caf3acf5a22576f2f7e654f16a9" gracePeriod=600
Jul 21 17:11:09.328819 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:11:09.328636    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="8364b4ed-8031-45f1-891f-4fbb77e6df78" containerName="kube-rbac-proxy" containerID="cri-o://41edd2cb99d560eebfa3a8e570abeda8ec59d71c5ca73fed3cc827eedcafda3b" gracePeriod=600
Jul 21 17:11:09.328819 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:11:09.328677    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="8364b4ed-8031-45f1-891f-4fbb77e6df78" containerName="thanos-sidecar" containerID="cri-o://925a7475c18eafc2034e3339f4045ca31d1190096a4babcd5cdec770474474b0" gracePeriod=600
Jul 21 17:11:09.328819 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:11:09.328693    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="8364b4ed-8031-45f1-891f-4fbb77e6df78" containerName="kube-rbac-proxy-thanos" containerID="cri-o://1664a22bc720515bb6bff88dc59c2b58494bdb2ee559621a5ec99c798dea55f3" gracePeriod=600
Jul 21 17:11:09.328819 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:11:09.328715    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="8364b4ed-8031-45f1-891f-4fbb77e6df78" containerName="kube-rbac-proxy-web" containerID="cri-o://ac9d562f82a8e08cb751f37855f702f4794b02c1a561de0c79726383bf1feea2" gracePeriod=600
Jul 21 17:11:09.329069 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:11:09.328866    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="8364b4ed-8031-45f1-891f-4fbb77e6df78" containerName="config-reloader" containerID="cri-o://0410a0b42eb68cafccfe8a03e454a7033577972fa33ad56e75264a135cfebd5d" gracePeriod=600
Jul 21 17:11:09.565494 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:11:09.565471    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 17:11:09.696175 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:11:09.696099    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/8364b4ed-8031-45f1-891f-4fbb77e6df78-prometheus-k8s-rulefiles-0\") pod \"8364b4ed-8031-45f1-891f-4fbb77e6df78\" (UID: \"8364b4ed-8031-45f1-891f-4fbb77e6df78\") "
Jul 21 17:11:09.696175 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:11:09.696155    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/8364b4ed-8031-45f1-891f-4fbb77e6df78-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"8364b4ed-8031-45f1-891f-4fbb77e6df78\" (UID: \"8364b4ed-8031-45f1-891f-4fbb77e6df78\") "
Jul 21 17:11:09.696341 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:11:09.696192    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-msrqf\" (UniqueName: \"kubernetes.io/projected/8364b4ed-8031-45f1-891f-4fbb77e6df78-kube-api-access-msrqf\") pod \"8364b4ed-8031-45f1-891f-4fbb77e6df78\" (UID: \"8364b4ed-8031-45f1-891f-4fbb77e6df78\") "
Jul 21 17:11:09.696376 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:11:09.696352    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8364b4ed-8031-45f1-891f-4fbb77e6df78-prometheus-trusted-ca-bundle\") pod \"8364b4ed-8031-45f1-891f-4fbb77e6df78\" (UID: \"8364b4ed-8031-45f1-891f-4fbb77e6df78\") "
Jul 21 17:11:09.696438 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:11:09.696389    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/8364b4ed-8031-45f1-891f-4fbb77e6df78-secret-grpc-tls\") pod \"8364b4ed-8031-45f1-891f-4fbb77e6df78\" (UID: \"8364b4ed-8031-45f1-891f-4fbb77e6df78\") "
Jul 21 17:11:09.696486 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:11:09.696435    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8364b4ed-8031-45f1-891f-4fbb77e6df78-configmap-serving-certs-ca-bundle\") pod \"8364b4ed-8031-45f1-891f-4fbb77e6df78\" (UID: \"8364b4ed-8031-45f1-891f-4fbb77e6df78\") "
Jul 21 17:11:09.696486 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:11:09.696463    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/8364b4ed-8031-45f1-891f-4fbb77e6df78-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"8364b4ed-8031-45f1-891f-4fbb77e6df78\" (UID: \"8364b4ed-8031-45f1-891f-4fbb77e6df78\") "
Jul 21 17:11:09.697084 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:11:09.696790    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/8364b4ed-8031-45f1-891f-4fbb77e6df78-tls-assets\") pod \"8364b4ed-8031-45f1-891f-4fbb77e6df78\" (UID: \"8364b4ed-8031-45f1-891f-4fbb77e6df78\") "
Jul 21 17:11:09.697084 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:11:09.696802    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8364b4ed-8031-45f1-891f-4fbb77e6df78-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "8364b4ed-8031-45f1-891f-4fbb77e6df78" (UID: "8364b4ed-8031-45f1-891f-4fbb77e6df78"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 17:11:09.697084 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:11:09.696839    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8364b4ed-8031-45f1-891f-4fbb77e6df78-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "8364b4ed-8031-45f1-891f-4fbb77e6df78" (UID: "8364b4ed-8031-45f1-891f-4fbb77e6df78"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 17:11:09.697084 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:11:09.696832    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/8364b4ed-8031-45f1-891f-4fbb77e6df78-secret-metrics-client-certs\") pod \"8364b4ed-8031-45f1-891f-4fbb77e6df78\" (UID: \"8364b4ed-8031-45f1-891f-4fbb77e6df78\") "
Jul 21 17:11:09.697084 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:11:09.697044    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/8364b4ed-8031-45f1-891f-4fbb77e6df78-config\") pod \"8364b4ed-8031-45f1-891f-4fbb77e6df78\" (UID: \"8364b4ed-8031-45f1-891f-4fbb77e6df78\") "
Jul 21 17:11:09.697084 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:11:09.697073    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/8364b4ed-8031-45f1-891f-4fbb77e6df78-secret-prometheus-k8s-tls\") pod \"8364b4ed-8031-45f1-891f-4fbb77e6df78\" (UID: \"8364b4ed-8031-45f1-891f-4fbb77e6df78\") "
Jul 21 17:11:09.697084 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:11:09.697116    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8364b4ed-8031-45f1-891f-4fbb77e6df78-configmap-kubelet-serving-ca-bundle\") pod \"8364b4ed-8031-45f1-891f-4fbb77e6df78\" (UID: \"8364b4ed-8031-45f1-891f-4fbb77e6df78\") "
Jul 21 17:11:09.697084 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:11:09.697145    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/8364b4ed-8031-45f1-891f-4fbb77e6df78-prometheus-k8s-db\") pod \"8364b4ed-8031-45f1-891f-4fbb77e6df78\" (UID: \"8364b4ed-8031-45f1-891f-4fbb77e6df78\") "
Jul 21 17:11:09.697775 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:11:09.697171    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/8364b4ed-8031-45f1-891f-4fbb77e6df78-prometheus-k8s-rulefiles-2\") pod \"8364b4ed-8031-45f1-891f-4fbb77e6df78\" (UID: \"8364b4ed-8031-45f1-891f-4fbb77e6df78\") "
Jul 21 17:11:09.697775 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:11:09.697204    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8364b4ed-8031-45f1-891f-4fbb77e6df78-configmap-metrics-client-ca\") pod \"8364b4ed-8031-45f1-891f-4fbb77e6df78\" (UID: \"8364b4ed-8031-45f1-891f-4fbb77e6df78\") "
Jul 21 17:11:09.697775 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:11:09.697230    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/8364b4ed-8031-45f1-891f-4fbb77e6df78-thanos-prometheus-http-client-file\") pod \"8364b4ed-8031-45f1-891f-4fbb77e6df78\" (UID: \"8364b4ed-8031-45f1-891f-4fbb77e6df78\") "
Jul 21 17:11:09.697775 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:11:09.697269    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/8364b4ed-8031-45f1-891f-4fbb77e6df78-secret-kube-rbac-proxy\") pod \"8364b4ed-8031-45f1-891f-4fbb77e6df78\" (UID: \"8364b4ed-8031-45f1-891f-4fbb77e6df78\") "
Jul 21 17:11:09.697775 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:11:09.697293    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/8364b4ed-8031-45f1-891f-4fbb77e6df78-config-out\") pod \"8364b4ed-8031-45f1-891f-4fbb77e6df78\" (UID: \"8364b4ed-8031-45f1-891f-4fbb77e6df78\") "
Jul 21 17:11:09.697775 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:11:09.697340    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/8364b4ed-8031-45f1-891f-4fbb77e6df78-prometheus-k8s-rulefiles-1\") pod \"8364b4ed-8031-45f1-891f-4fbb77e6df78\" (UID: \"8364b4ed-8031-45f1-891f-4fbb77e6df78\") "
Jul 21 17:11:09.697775 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:11:09.697372    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/8364b4ed-8031-45f1-891f-4fbb77e6df78-web-config\") pod \"8364b4ed-8031-45f1-891f-4fbb77e6df78\" (UID: \"8364b4ed-8031-45f1-891f-4fbb77e6df78\") "
Jul 21 17:11:09.697775 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:11:09.697643    2575 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8364b4ed-8031-45f1-891f-4fbb77e6df78-prometheus-trusted-ca-bundle\") on node \"ip-10-0-141-39.ec2.internal\" DevicePath \"\""
Jul 21 17:11:09.697775 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:11:09.697663    2575 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8364b4ed-8031-45f1-891f-4fbb77e6df78-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-141-39.ec2.internal\" DevicePath \"\""
Jul 21 17:11:09.698262 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:11:09.698016    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8364b4ed-8031-45f1-891f-4fbb77e6df78-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "8364b4ed-8031-45f1-891f-4fbb77e6df78" (UID: "8364b4ed-8031-45f1-891f-4fbb77e6df78"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 17:11:09.698600 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:11:09.698545    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8364b4ed-8031-45f1-891f-4fbb77e6df78-prometheus-k8s-rulefiles-2" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-2") pod "8364b4ed-8031-45f1-891f-4fbb77e6df78" (UID: "8364b4ed-8031-45f1-891f-4fbb77e6df78"). InnerVolumeSpecName "prometheus-k8s-rulefiles-2". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 17:11:09.698861 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:11:09.698810    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8364b4ed-8031-45f1-891f-4fbb77e6df78-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "8364b4ed-8031-45f1-891f-4fbb77e6df78" (UID: "8364b4ed-8031-45f1-891f-4fbb77e6df78"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 21 17:11:09.699009 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:11:09.698986    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8364b4ed-8031-45f1-891f-4fbb77e6df78-kube-api-access-msrqf" (OuterVolumeSpecName: "kube-api-access-msrqf") pod "8364b4ed-8031-45f1-891f-4fbb77e6df78" (UID: "8364b4ed-8031-45f1-891f-4fbb77e6df78"). InnerVolumeSpecName "kube-api-access-msrqf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 17:11:09.699674 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:11:09.699393    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8364b4ed-8031-45f1-891f-4fbb77e6df78-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "8364b4ed-8031-45f1-891f-4fbb77e6df78" (UID: "8364b4ed-8031-45f1-891f-4fbb77e6df78"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 21 17:11:09.699674 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:11:09.699515    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8364b4ed-8031-45f1-891f-4fbb77e6df78-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "8364b4ed-8031-45f1-891f-4fbb77e6df78" (UID: "8364b4ed-8031-45f1-891f-4fbb77e6df78"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 21 17:11:09.699674 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:11:09.699549    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8364b4ed-8031-45f1-891f-4fbb77e6df78-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "8364b4ed-8031-45f1-891f-4fbb77e6df78" (UID: "8364b4ed-8031-45f1-891f-4fbb77e6df78"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 17:11:09.699940 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:11:09.699725    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8364b4ed-8031-45f1-891f-4fbb77e6df78-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "8364b4ed-8031-45f1-891f-4fbb77e6df78" (UID: "8364b4ed-8031-45f1-891f-4fbb77e6df78"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 17:11:09.699996 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:11:09.699942    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8364b4ed-8031-45f1-891f-4fbb77e6df78-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "8364b4ed-8031-45f1-891f-4fbb77e6df78" (UID: "8364b4ed-8031-45f1-891f-4fbb77e6df78"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 17:11:09.700065 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:11:09.700016    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8364b4ed-8031-45f1-891f-4fbb77e6df78-prometheus-k8s-rulefiles-1" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-1") pod "8364b4ed-8031-45f1-891f-4fbb77e6df78" (UID: "8364b4ed-8031-45f1-891f-4fbb77e6df78"). InnerVolumeSpecName "prometheus-k8s-rulefiles-1". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 17:11:09.700691 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:11:09.700647    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8364b4ed-8031-45f1-891f-4fbb77e6df78-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "8364b4ed-8031-45f1-891f-4fbb77e6df78" (UID: "8364b4ed-8031-45f1-891f-4fbb77e6df78"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 21 17:11:09.701082 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:11:09.701054    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8364b4ed-8031-45f1-891f-4fbb77e6df78-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "8364b4ed-8031-45f1-891f-4fbb77e6df78" (UID: "8364b4ed-8031-45f1-891f-4fbb77e6df78"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 21 17:11:09.701184 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:11:09.701108    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8364b4ed-8031-45f1-891f-4fbb77e6df78-config" (OuterVolumeSpecName: "config") pod "8364b4ed-8031-45f1-891f-4fbb77e6df78" (UID: "8364b4ed-8031-45f1-891f-4fbb77e6df78"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 21 17:11:09.701184 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:11:09.701166    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8364b4ed-8031-45f1-891f-4fbb77e6df78-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "8364b4ed-8031-45f1-891f-4fbb77e6df78" (UID: "8364b4ed-8031-45f1-891f-4fbb77e6df78"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 17:11:09.701617 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:11:09.701599    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8364b4ed-8031-45f1-891f-4fbb77e6df78-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "8364b4ed-8031-45f1-891f-4fbb77e6df78" (UID: "8364b4ed-8031-45f1-891f-4fbb77e6df78"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 21 17:11:09.702052 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:11:09.702031    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8364b4ed-8031-45f1-891f-4fbb77e6df78-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "8364b4ed-8031-45f1-891f-4fbb77e6df78" (UID: "8364b4ed-8031-45f1-891f-4fbb77e6df78"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 21 17:11:09.702128 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:11:09.702098    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8364b4ed-8031-45f1-891f-4fbb77e6df78-config-out" (OuterVolumeSpecName: "config-out") pod "8364b4ed-8031-45f1-891f-4fbb77e6df78" (UID: "8364b4ed-8031-45f1-891f-4fbb77e6df78"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 17:11:09.710315 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:11:09.710296    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8364b4ed-8031-45f1-891f-4fbb77e6df78-web-config" (OuterVolumeSpecName: "web-config") pod "8364b4ed-8031-45f1-891f-4fbb77e6df78" (UID: "8364b4ed-8031-45f1-891f-4fbb77e6df78"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 21 17:11:09.798845 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:11:09.798807    2575 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/8364b4ed-8031-45f1-891f-4fbb77e6df78-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-141-39.ec2.internal\" DevicePath \"\""
Jul 21 17:11:09.798845 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:11:09.798843    2575 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/8364b4ed-8031-45f1-891f-4fbb77e6df78-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-141-39.ec2.internal\" DevicePath \"\""
Jul 21 17:11:09.798845 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:11:09.798853    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-msrqf\" (UniqueName: \"kubernetes.io/projected/8364b4ed-8031-45f1-891f-4fbb77e6df78-kube-api-access-msrqf\") on node \"ip-10-0-141-39.ec2.internal\" DevicePath \"\""
Jul 21 17:11:09.798845 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:11:09.798861    2575 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/8364b4ed-8031-45f1-891f-4fbb77e6df78-secret-grpc-tls\") on node \"ip-10-0-141-39.ec2.internal\" DevicePath \"\""
Jul 21 17:11:09.799067 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:11:09.798872    2575 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/8364b4ed-8031-45f1-891f-4fbb77e6df78-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-141-39.ec2.internal\" DevicePath \"\""
Jul 21 17:11:09.799067 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:11:09.798880    2575 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/8364b4ed-8031-45f1-891f-4fbb77e6df78-tls-assets\") on node \"ip-10-0-141-39.ec2.internal\" DevicePath \"\""
Jul 21 17:11:09.799067 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:11:09.798888    2575 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/8364b4ed-8031-45f1-891f-4fbb77e6df78-secret-metrics-client-certs\") on node \"ip-10-0-141-39.ec2.internal\" DevicePath \"\""
Jul 21 17:11:09.799067 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:11:09.798896    2575 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/8364b4ed-8031-45f1-891f-4fbb77e6df78-config\") on node \"ip-10-0-141-39.ec2.internal\" DevicePath \"\""
Jul 21 17:11:09.799067 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:11:09.798904    2575 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/8364b4ed-8031-45f1-891f-4fbb77e6df78-secret-prometheus-k8s-tls\") on node \"ip-10-0-141-39.ec2.internal\" DevicePath \"\""
Jul 21 17:11:09.799067 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:11:09.798913    2575 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8364b4ed-8031-45f1-891f-4fbb77e6df78-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-141-39.ec2.internal\" DevicePath \"\""
Jul 21 17:11:09.799067 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:11:09.798921    2575 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/8364b4ed-8031-45f1-891f-4fbb77e6df78-prometheus-k8s-db\") on node \"ip-10-0-141-39.ec2.internal\" DevicePath \"\""
Jul 21 17:11:09.799067 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:11:09.798929    2575 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/8364b4ed-8031-45f1-891f-4fbb77e6df78-prometheus-k8s-rulefiles-2\") on node \"ip-10-0-141-39.ec2.internal\" DevicePath \"\""
Jul 21 17:11:09.799067 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:11:09.798937    2575 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8364b4ed-8031-45f1-891f-4fbb77e6df78-configmap-metrics-client-ca\") on node \"ip-10-0-141-39.ec2.internal\" DevicePath \"\""
Jul 21 17:11:09.799067 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:11:09.798945    2575 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/8364b4ed-8031-45f1-891f-4fbb77e6df78-thanos-prometheus-http-client-file\") on node \"ip-10-0-141-39.ec2.internal\" DevicePath \"\""
Jul 21 17:11:09.799067 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:11:09.798953    2575 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/8364b4ed-8031-45f1-891f-4fbb77e6df78-secret-kube-rbac-proxy\") on node \"ip-10-0-141-39.ec2.internal\" DevicePath \"\""
Jul 21 17:11:09.799067 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:11:09.798962    2575 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/8364b4ed-8031-45f1-891f-4fbb77e6df78-config-out\") on node \"ip-10-0-141-39.ec2.internal\" DevicePath \"\""
Jul 21 17:11:09.799067 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:11:09.798969    2575 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/8364b4ed-8031-45f1-891f-4fbb77e6df78-prometheus-k8s-rulefiles-1\") on node \"ip-10-0-141-39.ec2.internal\" DevicePath \"\""
Jul 21 17:11:09.799067 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:11:09.798978    2575 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/8364b4ed-8031-45f1-891f-4fbb77e6df78-web-config\") on node \"ip-10-0-141-39.ec2.internal\" DevicePath \"\""
Jul 21 17:11:09.879744 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:11:09.879716    2575 generic.go:356] "Generic (PLEG): container finished" podID="8364b4ed-8031-45f1-891f-4fbb77e6df78" containerID="1664a22bc720515bb6bff88dc59c2b58494bdb2ee559621a5ec99c798dea55f3" exitCode=0
Jul 21 17:11:09.879744 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:11:09.879738    2575 generic.go:356] "Generic (PLEG): container finished" podID="8364b4ed-8031-45f1-891f-4fbb77e6df78" containerID="41edd2cb99d560eebfa3a8e570abeda8ec59d71c5ca73fed3cc827eedcafda3b" exitCode=0
Jul 21 17:11:09.879744 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:11:09.879745    2575 generic.go:356] "Generic (PLEG): container finished" podID="8364b4ed-8031-45f1-891f-4fbb77e6df78" containerID="ac9d562f82a8e08cb751f37855f702f4794b02c1a561de0c79726383bf1feea2" exitCode=0
Jul 21 17:11:09.879744 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:11:09.879750    2575 generic.go:356] "Generic (PLEG): container finished" podID="8364b4ed-8031-45f1-891f-4fbb77e6df78" containerID="925a7475c18eafc2034e3339f4045ca31d1190096a4babcd5cdec770474474b0" exitCode=0
Jul 21 17:11:09.880084 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:11:09.879755    2575 generic.go:356] "Generic (PLEG): container finished" podID="8364b4ed-8031-45f1-891f-4fbb77e6df78" containerID="0410a0b42eb68cafccfe8a03e454a7033577972fa33ad56e75264a135cfebd5d" exitCode=0
Jul 21 17:11:09.880084 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:11:09.879761    2575 generic.go:356] "Generic (PLEG): container finished" podID="8364b4ed-8031-45f1-891f-4fbb77e6df78" containerID="27ed7c1517c0617b78a3e7ecf03707e57b872caf3acf5a22576f2f7e654f16a9" exitCode=0
Jul 21 17:11:09.880084 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:11:09.879797    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 17:11:09.880084 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:11:09.879806    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8364b4ed-8031-45f1-891f-4fbb77e6df78","Type":"ContainerDied","Data":"1664a22bc720515bb6bff88dc59c2b58494bdb2ee559621a5ec99c798dea55f3"}
Jul 21 17:11:09.880084 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:11:09.879894    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8364b4ed-8031-45f1-891f-4fbb77e6df78","Type":"ContainerDied","Data":"41edd2cb99d560eebfa3a8e570abeda8ec59d71c5ca73fed3cc827eedcafda3b"}
Jul 21 17:11:09.880084 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:11:09.879937    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8364b4ed-8031-45f1-891f-4fbb77e6df78","Type":"ContainerDied","Data":"ac9d562f82a8e08cb751f37855f702f4794b02c1a561de0c79726383bf1feea2"}
Jul 21 17:11:09.880084 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:11:09.879960    2575 scope.go:117] "RemoveContainer" containerID="1664a22bc720515bb6bff88dc59c2b58494bdb2ee559621a5ec99c798dea55f3"
Jul 21 17:11:09.880084 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:11:09.879978    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8364b4ed-8031-45f1-891f-4fbb77e6df78","Type":"ContainerDied","Data":"925a7475c18eafc2034e3339f4045ca31d1190096a4babcd5cdec770474474b0"}
Jul 21 17:11:09.880084 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:11:09.880022    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8364b4ed-8031-45f1-891f-4fbb77e6df78","Type":"ContainerDied","Data":"0410a0b42eb68cafccfe8a03e454a7033577972fa33ad56e75264a135cfebd5d"}
Jul 21 17:11:09.880084 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:11:09.880074    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8364b4ed-8031-45f1-891f-4fbb77e6df78","Type":"ContainerDied","Data":"27ed7c1517c0617b78a3e7ecf03707e57b872caf3acf5a22576f2f7e654f16a9"}
Jul 21 17:11:09.880514 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:11:09.880116    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8364b4ed-8031-45f1-891f-4fbb77e6df78","Type":"ContainerDied","Data":"887d8eebb92f23d363853bbcbaf2de90c0fa79af5c8f196d886c4c0cfd296f70"}
Jul 21 17:11:09.887945 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:11:09.887931    2575 scope.go:117] "RemoveContainer" containerID="41edd2cb99d560eebfa3a8e570abeda8ec59d71c5ca73fed3cc827eedcafda3b"
Jul 21 17:11:09.895097 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:11:09.895083    2575 scope.go:117] "RemoveContainer" containerID="ac9d562f82a8e08cb751f37855f702f4794b02c1a561de0c79726383bf1feea2"
Jul 21 17:11:09.901692 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:11:09.901674    2575 scope.go:117] "RemoveContainer" containerID="925a7475c18eafc2034e3339f4045ca31d1190096a4babcd5cdec770474474b0"
Jul 21 17:11:09.905816 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:11:09.905794    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 21 17:11:09.910615 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:11:09.910597    2575 scope.go:117] "RemoveContainer" containerID="0410a0b42eb68cafccfe8a03e454a7033577972fa33ad56e75264a135cfebd5d"
Jul 21 17:11:09.913445 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:11:09.913362    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 21 17:11:09.917451 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:11:09.917436    2575 scope.go:117] "RemoveContainer" containerID="27ed7c1517c0617b78a3e7ecf03707e57b872caf3acf5a22576f2f7e654f16a9"
Jul 21 17:11:09.924177 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:11:09.924156    2575 scope.go:117] "RemoveContainer" containerID="3ab5ac0d1f959a6f14406453a794e3e87a4a398c6dea9a1cd3f4859eabe05d0d"
Jul 21 17:11:09.930425 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:11:09.930395    2575 scope.go:117] "RemoveContainer" containerID="1664a22bc720515bb6bff88dc59c2b58494bdb2ee559621a5ec99c798dea55f3"
Jul 21 17:11:09.930670 ip-10-0-141-39 kubenswrapper[2575]: E0721 17:11:09.930648    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1664a22bc720515bb6bff88dc59c2b58494bdb2ee559621a5ec99c798dea55f3\": container with ID starting with 1664a22bc720515bb6bff88dc59c2b58494bdb2ee559621a5ec99c798dea55f3 not found: ID does not exist" containerID="1664a22bc720515bb6bff88dc59c2b58494bdb2ee559621a5ec99c798dea55f3"
Jul 21 17:11:09.930724 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:11:09.930683    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1664a22bc720515bb6bff88dc59c2b58494bdb2ee559621a5ec99c798dea55f3"} err="failed to get container status \"1664a22bc720515bb6bff88dc59c2b58494bdb2ee559621a5ec99c798dea55f3\": rpc error: code = NotFound desc = could not find container \"1664a22bc720515bb6bff88dc59c2b58494bdb2ee559621a5ec99c798dea55f3\": container with ID starting with 1664a22bc720515bb6bff88dc59c2b58494bdb2ee559621a5ec99c798dea55f3 not found: ID does not exist"
Jul 21 17:11:09.930724 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:11:09.930700    2575 scope.go:117] "RemoveContainer" containerID="41edd2cb99d560eebfa3a8e570abeda8ec59d71c5ca73fed3cc827eedcafda3b"
Jul 21 17:11:09.930924 ip-10-0-141-39 kubenswrapper[2575]: E0721 17:11:09.930908    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"41edd2cb99d560eebfa3a8e570abeda8ec59d71c5ca73fed3cc827eedcafda3b\": container with ID starting with 41edd2cb99d560eebfa3a8e570abeda8ec59d71c5ca73fed3cc827eedcafda3b not found: ID does not exist" containerID="41edd2cb99d560eebfa3a8e570abeda8ec59d71c5ca73fed3cc827eedcafda3b"
Jul 21 17:11:09.930962 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:11:09.930931    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"41edd2cb99d560eebfa3a8e570abeda8ec59d71c5ca73fed3cc827eedcafda3b"} err="failed to get container status \"41edd2cb99d560eebfa3a8e570abeda8ec59d71c5ca73fed3cc827eedcafda3b\": rpc error: code = NotFound desc = could not find container \"41edd2cb99d560eebfa3a8e570abeda8ec59d71c5ca73fed3cc827eedcafda3b\": container with ID starting with 41edd2cb99d560eebfa3a8e570abeda8ec59d71c5ca73fed3cc827eedcafda3b not found: ID does not exist"
Jul 21 17:11:09.930962 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:11:09.930946    2575 scope.go:117] "RemoveContainer" containerID="ac9d562f82a8e08cb751f37855f702f4794b02c1a561de0c79726383bf1feea2"
Jul 21 17:11:09.931146 ip-10-0-141-39 kubenswrapper[2575]: E0721 17:11:09.931132    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ac9d562f82a8e08cb751f37855f702f4794b02c1a561de0c79726383bf1feea2\": container with ID starting with ac9d562f82a8e08cb751f37855f702f4794b02c1a561de0c79726383bf1feea2 not found: ID does not exist" containerID="ac9d562f82a8e08cb751f37855f702f4794b02c1a561de0c79726383bf1feea2"
Jul 21 17:11:09.931192 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:11:09.931150    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ac9d562f82a8e08cb751f37855f702f4794b02c1a561de0c79726383bf1feea2"} err="failed to get container status \"ac9d562f82a8e08cb751f37855f702f4794b02c1a561de0c79726383bf1feea2\": rpc error: code = NotFound desc = could not find container \"ac9d562f82a8e08cb751f37855f702f4794b02c1a561de0c79726383bf1feea2\": container with ID starting with ac9d562f82a8e08cb751f37855f702f4794b02c1a561de0c79726383bf1feea2 not found: ID does not exist"
Jul 21 17:11:09.931192 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:11:09.931162    2575 scope.go:117] "RemoveContainer" containerID="925a7475c18eafc2034e3339f4045ca31d1190096a4babcd5cdec770474474b0"
Jul 21 17:11:09.931409 ip-10-0-141-39 kubenswrapper[2575]: E0721 17:11:09.931394    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"925a7475c18eafc2034e3339f4045ca31d1190096a4babcd5cdec770474474b0\": container with ID starting with 925a7475c18eafc2034e3339f4045ca31d1190096a4babcd5cdec770474474b0 not found: ID does not exist" containerID="925a7475c18eafc2034e3339f4045ca31d1190096a4babcd5cdec770474474b0"
Jul 21 17:11:09.931469 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:11:09.931428    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"925a7475c18eafc2034e3339f4045ca31d1190096a4babcd5cdec770474474b0"} err="failed to get container status \"925a7475c18eafc2034e3339f4045ca31d1190096a4babcd5cdec770474474b0\": rpc error: code = NotFound desc = could not find container \"925a7475c18eafc2034e3339f4045ca31d1190096a4babcd5cdec770474474b0\": container with ID starting with 925a7475c18eafc2034e3339f4045ca31d1190096a4babcd5cdec770474474b0 not found: ID does not exist"
Jul 21 17:11:09.931469 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:11:09.931444    2575 scope.go:117] "RemoveContainer" containerID="0410a0b42eb68cafccfe8a03e454a7033577972fa33ad56e75264a135cfebd5d"
Jul 21 17:11:09.931636 ip-10-0-141-39 kubenswrapper[2575]: E0721 17:11:09.931620    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0410a0b42eb68cafccfe8a03e454a7033577972fa33ad56e75264a135cfebd5d\": container with ID starting with 0410a0b42eb68cafccfe8a03e454a7033577972fa33ad56e75264a135cfebd5d not found: ID does not exist" containerID="0410a0b42eb68cafccfe8a03e454a7033577972fa33ad56e75264a135cfebd5d"
Jul 21 17:11:09.931685 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:11:09.931639    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0410a0b42eb68cafccfe8a03e454a7033577972fa33ad56e75264a135cfebd5d"} err="failed to get container status \"0410a0b42eb68cafccfe8a03e454a7033577972fa33ad56e75264a135cfebd5d\": rpc error: code = NotFound desc = could not find container \"0410a0b42eb68cafccfe8a03e454a7033577972fa33ad56e75264a135cfebd5d\": container with ID starting with 0410a0b42eb68cafccfe8a03e454a7033577972fa33ad56e75264a135cfebd5d not found: ID does not exist"
Jul 21 17:11:09.931685 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:11:09.931652    2575 scope.go:117] "RemoveContainer" containerID="27ed7c1517c0617b78a3e7ecf03707e57b872caf3acf5a22576f2f7e654f16a9"
Jul 21 17:11:09.931837 ip-10-0-141-39 kubenswrapper[2575]: E0721 17:11:09.931821    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"27ed7c1517c0617b78a3e7ecf03707e57b872caf3acf5a22576f2f7e654f16a9\": container with ID starting with 27ed7c1517c0617b78a3e7ecf03707e57b872caf3acf5a22576f2f7e654f16a9 not found: ID does not exist" containerID="27ed7c1517c0617b78a3e7ecf03707e57b872caf3acf5a22576f2f7e654f16a9"
Jul 21 17:11:09.931874 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:11:09.931841    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"27ed7c1517c0617b78a3e7ecf03707e57b872caf3acf5a22576f2f7e654f16a9"} err="failed to get container status \"27ed7c1517c0617b78a3e7ecf03707e57b872caf3acf5a22576f2f7e654f16a9\": rpc error: code = NotFound desc = could not find container \"27ed7c1517c0617b78a3e7ecf03707e57b872caf3acf5a22576f2f7e654f16a9\": container with ID starting with 27ed7c1517c0617b78a3e7ecf03707e57b872caf3acf5a22576f2f7e654f16a9 not found: ID does not exist"
Jul 21 17:11:09.931874 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:11:09.931853    2575 scope.go:117] "RemoveContainer" containerID="3ab5ac0d1f959a6f14406453a794e3e87a4a398c6dea9a1cd3f4859eabe05d0d"
Jul 21 17:11:09.932070 ip-10-0-141-39 kubenswrapper[2575]: E0721 17:11:09.932051    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3ab5ac0d1f959a6f14406453a794e3e87a4a398c6dea9a1cd3f4859eabe05d0d\": container with ID starting with 3ab5ac0d1f959a6f14406453a794e3e87a4a398c6dea9a1cd3f4859eabe05d0d not found: ID does not exist" containerID="3ab5ac0d1f959a6f14406453a794e3e87a4a398c6dea9a1cd3f4859eabe05d0d"
Jul 21 17:11:09.932118 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:11:09.932074    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3ab5ac0d1f959a6f14406453a794e3e87a4a398c6dea9a1cd3f4859eabe05d0d"} err="failed to get container status \"3ab5ac0d1f959a6f14406453a794e3e87a4a398c6dea9a1cd3f4859eabe05d0d\": rpc error: code = NotFound desc = could not find container \"3ab5ac0d1f959a6f14406453a794e3e87a4a398c6dea9a1cd3f4859eabe05d0d\": container with ID starting with 3ab5ac0d1f959a6f14406453a794e3e87a4a398c6dea9a1cd3f4859eabe05d0d not found: ID does not exist"
Jul 21 17:11:09.932118 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:11:09.932087    2575 scope.go:117] "RemoveContainer" containerID="1664a22bc720515bb6bff88dc59c2b58494bdb2ee559621a5ec99c798dea55f3"
Jul 21 17:11:09.932287 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:11:09.932271    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1664a22bc720515bb6bff88dc59c2b58494bdb2ee559621a5ec99c798dea55f3"} err="failed to get container status \"1664a22bc720515bb6bff88dc59c2b58494bdb2ee559621a5ec99c798dea55f3\": rpc error: code = NotFound desc = could not find container \"1664a22bc720515bb6bff88dc59c2b58494bdb2ee559621a5ec99c798dea55f3\": container with ID starting with 1664a22bc720515bb6bff88dc59c2b58494bdb2ee559621a5ec99c798dea55f3 not found: ID does not exist"
Jul 21 17:11:09.932326 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:11:09.932288    2575 scope.go:117] "RemoveContainer" containerID="41edd2cb99d560eebfa3a8e570abeda8ec59d71c5ca73fed3cc827eedcafda3b"
Jul 21 17:11:09.932489 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:11:09.932473    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"41edd2cb99d560eebfa3a8e570abeda8ec59d71c5ca73fed3cc827eedcafda3b"} err="failed to get container status \"41edd2cb99d560eebfa3a8e570abeda8ec59d71c5ca73fed3cc827eedcafda3b\": rpc error: code = NotFound desc = could not find container \"41edd2cb99d560eebfa3a8e570abeda8ec59d71c5ca73fed3cc827eedcafda3b\": container with ID starting with 41edd2cb99d560eebfa3a8e570abeda8ec59d71c5ca73fed3cc827eedcafda3b not found: ID does not exist"
Jul 21 17:11:09.932543 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:11:09.932489    2575 scope.go:117] "RemoveContainer" containerID="ac9d562f82a8e08cb751f37855f702f4794b02c1a561de0c79726383bf1feea2"
Jul 21 17:11:09.932689 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:11:09.932673    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ac9d562f82a8e08cb751f37855f702f4794b02c1a561de0c79726383bf1feea2"} err="failed to get container status \"ac9d562f82a8e08cb751f37855f702f4794b02c1a561de0c79726383bf1feea2\": rpc error: code = NotFound desc = could not find container \"ac9d562f82a8e08cb751f37855f702f4794b02c1a561de0c79726383bf1feea2\": container with ID starting with ac9d562f82a8e08cb751f37855f702f4794b02c1a561de0c79726383bf1feea2 not found: ID does not exist"
Jul 21 17:11:09.932741 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:11:09.932690    2575 scope.go:117] "RemoveContainer" containerID="925a7475c18eafc2034e3339f4045ca31d1190096a4babcd5cdec770474474b0"
Jul 21 17:11:09.932883 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:11:09.932869    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"925a7475c18eafc2034e3339f4045ca31d1190096a4babcd5cdec770474474b0"} err="failed to get container status \"925a7475c18eafc2034e3339f4045ca31d1190096a4babcd5cdec770474474b0\": rpc error: code = NotFound desc = could not find container \"925a7475c18eafc2034e3339f4045ca31d1190096a4babcd5cdec770474474b0\": container with ID starting with 925a7475c18eafc2034e3339f4045ca31d1190096a4babcd5cdec770474474b0 not found: ID does not exist"
Jul 21 17:11:09.932922 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:11:09.932883    2575 scope.go:117] "RemoveContainer" containerID="0410a0b42eb68cafccfe8a03e454a7033577972fa33ad56e75264a135cfebd5d"
Jul 21 17:11:09.933086 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:11:09.933068    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0410a0b42eb68cafccfe8a03e454a7033577972fa33ad56e75264a135cfebd5d"} err="failed to get container status \"0410a0b42eb68cafccfe8a03e454a7033577972fa33ad56e75264a135cfebd5d\": rpc error: code = NotFound desc = could not find container \"0410a0b42eb68cafccfe8a03e454a7033577972fa33ad56e75264a135cfebd5d\": container with ID starting with 0410a0b42eb68cafccfe8a03e454a7033577972fa33ad56e75264a135cfebd5d not found: ID does not exist"
Jul 21 17:11:09.933135 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:11:09.933085    2575 scope.go:117] "RemoveContainer" containerID="27ed7c1517c0617b78a3e7ecf03707e57b872caf3acf5a22576f2f7e654f16a9"
Jul 21 17:11:09.933278 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:11:09.933259    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"27ed7c1517c0617b78a3e7ecf03707e57b872caf3acf5a22576f2f7e654f16a9"} err="failed to get container status \"27ed7c1517c0617b78a3e7ecf03707e57b872caf3acf5a22576f2f7e654f16a9\": rpc error: code = NotFound desc = could not find container \"27ed7c1517c0617b78a3e7ecf03707e57b872caf3acf5a22576f2f7e654f16a9\": container with ID starting with 27ed7c1517c0617b78a3e7ecf03707e57b872caf3acf5a22576f2f7e654f16a9 not found: ID does not exist"
Jul 21 17:11:09.933323 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:11:09.933281    2575 scope.go:117] "RemoveContainer" containerID="3ab5ac0d1f959a6f14406453a794e3e87a4a398c6dea9a1cd3f4859eabe05d0d"
Jul 21 17:11:09.933577 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:11:09.933560    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3ab5ac0d1f959a6f14406453a794e3e87a4a398c6dea9a1cd3f4859eabe05d0d"} err="failed to get container status \"3ab5ac0d1f959a6f14406453a794e3e87a4a398c6dea9a1cd3f4859eabe05d0d\": rpc error: code = NotFound desc = could not find container \"3ab5ac0d1f959a6f14406453a794e3e87a4a398c6dea9a1cd3f4859eabe05d0d\": container with ID starting with 3ab5ac0d1f959a6f14406453a794e3e87a4a398c6dea9a1cd3f4859eabe05d0d not found: ID does not exist"
Jul 21 17:11:09.933635 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:11:09.933578    2575 scope.go:117] "RemoveContainer" containerID="1664a22bc720515bb6bff88dc59c2b58494bdb2ee559621a5ec99c798dea55f3"
Jul 21 17:11:09.933802 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:11:09.933779    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1664a22bc720515bb6bff88dc59c2b58494bdb2ee559621a5ec99c798dea55f3"} err="failed to get container status \"1664a22bc720515bb6bff88dc59c2b58494bdb2ee559621a5ec99c798dea55f3\": rpc error: code = NotFound desc = could not find container \"1664a22bc720515bb6bff88dc59c2b58494bdb2ee559621a5ec99c798dea55f3\": container with ID starting with 1664a22bc720515bb6bff88dc59c2b58494bdb2ee559621a5ec99c798dea55f3 not found: ID does not exist"
Jul 21 17:11:09.933839 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:11:09.933803    2575 scope.go:117] "RemoveContainer" containerID="41edd2cb99d560eebfa3a8e570abeda8ec59d71c5ca73fed3cc827eedcafda3b"
Jul 21 17:11:09.934007 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:11:09.933987    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"41edd2cb99d560eebfa3a8e570abeda8ec59d71c5ca73fed3cc827eedcafda3b"} err="failed to get container status \"41edd2cb99d560eebfa3a8e570abeda8ec59d71c5ca73fed3cc827eedcafda3b\": rpc error: code = NotFound desc = could not find container \"41edd2cb99d560eebfa3a8e570abeda8ec59d71c5ca73fed3cc827eedcafda3b\": container with ID starting with 41edd2cb99d560eebfa3a8e570abeda8ec59d71c5ca73fed3cc827eedcafda3b not found: ID does not exist"
Jul 21 17:11:09.934053 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:11:09.934008    2575 scope.go:117] "RemoveContainer" containerID="ac9d562f82a8e08cb751f37855f702f4794b02c1a561de0c79726383bf1feea2"
Jul 21 17:11:09.934196 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:11:09.934180    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ac9d562f82a8e08cb751f37855f702f4794b02c1a561de0c79726383bf1feea2"} err="failed to get container status \"ac9d562f82a8e08cb751f37855f702f4794b02c1a561de0c79726383bf1feea2\": rpc error: code = NotFound desc = could not find container \"ac9d562f82a8e08cb751f37855f702f4794b02c1a561de0c79726383bf1feea2\": container with ID starting with ac9d562f82a8e08cb751f37855f702f4794b02c1a561de0c79726383bf1feea2 not found: ID does not exist"
Jul 21 17:11:09.934244 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:11:09.934197    2575 scope.go:117] "RemoveContainer" containerID="925a7475c18eafc2034e3339f4045ca31d1190096a4babcd5cdec770474474b0"
Jul 21 17:11:09.934391 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:11:09.934375    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"925a7475c18eafc2034e3339f4045ca31d1190096a4babcd5cdec770474474b0"} err="failed to get container status \"925a7475c18eafc2034e3339f4045ca31d1190096a4babcd5cdec770474474b0\": rpc error: code = NotFound desc = could not find container \"925a7475c18eafc2034e3339f4045ca31d1190096a4babcd5cdec770474474b0\": container with ID starting with 925a7475c18eafc2034e3339f4045ca31d1190096a4babcd5cdec770474474b0 not found: ID does not exist"
Jul 21 17:11:09.934463 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:11:09.934391    2575 scope.go:117] "RemoveContainer" containerID="0410a0b42eb68cafccfe8a03e454a7033577972fa33ad56e75264a135cfebd5d"
Jul 21 17:11:09.934625 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:11:09.934609    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0410a0b42eb68cafccfe8a03e454a7033577972fa33ad56e75264a135cfebd5d"} err="failed to get container status \"0410a0b42eb68cafccfe8a03e454a7033577972fa33ad56e75264a135cfebd5d\": rpc error: code = NotFound desc = could not find container \"0410a0b42eb68cafccfe8a03e454a7033577972fa33ad56e75264a135cfebd5d\": container with ID starting with 0410a0b42eb68cafccfe8a03e454a7033577972fa33ad56e75264a135cfebd5d not found: ID does not exist"
Jul 21 17:11:09.934625 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:11:09.934625    2575 scope.go:117] "RemoveContainer" containerID="27ed7c1517c0617b78a3e7ecf03707e57b872caf3acf5a22576f2f7e654f16a9"
Jul 21 17:11:09.934828 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:11:09.934810    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"27ed7c1517c0617b78a3e7ecf03707e57b872caf3acf5a22576f2f7e654f16a9"} err="failed to get container status \"27ed7c1517c0617b78a3e7ecf03707e57b872caf3acf5a22576f2f7e654f16a9\": rpc error: code = NotFound desc = could not find container \"27ed7c1517c0617b78a3e7ecf03707e57b872caf3acf5a22576f2f7e654f16a9\": container with ID starting with 27ed7c1517c0617b78a3e7ecf03707e57b872caf3acf5a22576f2f7e654f16a9 not found: ID does not exist"
Jul 21 17:11:09.934828 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:11:09.934828    2575 scope.go:117] "RemoveContainer" containerID="3ab5ac0d1f959a6f14406453a794e3e87a4a398c6dea9a1cd3f4859eabe05d0d"
Jul 21 17:11:09.935025 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:11:09.935010    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3ab5ac0d1f959a6f14406453a794e3e87a4a398c6dea9a1cd3f4859eabe05d0d"} err="failed to get container status \"3ab5ac0d1f959a6f14406453a794e3e87a4a398c6dea9a1cd3f4859eabe05d0d\": rpc error: code = NotFound desc = could not find container \"3ab5ac0d1f959a6f14406453a794e3e87a4a398c6dea9a1cd3f4859eabe05d0d\": container with ID starting with 3ab5ac0d1f959a6f14406453a794e3e87a4a398c6dea9a1cd3f4859eabe05d0d not found: ID does not exist"
Jul 21 17:11:09.935078 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:11:09.935027    2575 scope.go:117] "RemoveContainer" containerID="1664a22bc720515bb6bff88dc59c2b58494bdb2ee559621a5ec99c798dea55f3"
Jul 21 17:11:09.935216 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:11:09.935198    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1664a22bc720515bb6bff88dc59c2b58494bdb2ee559621a5ec99c798dea55f3"} err="failed to get container status \"1664a22bc720515bb6bff88dc59c2b58494bdb2ee559621a5ec99c798dea55f3\": rpc error: code = NotFound desc = could not find container \"1664a22bc720515bb6bff88dc59c2b58494bdb2ee559621a5ec99c798dea55f3\": container with ID starting with 1664a22bc720515bb6bff88dc59c2b58494bdb2ee559621a5ec99c798dea55f3 not found: ID does not exist"
Jul 21 17:11:09.935256 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:11:09.935218    2575 scope.go:117] "RemoveContainer" containerID="41edd2cb99d560eebfa3a8e570abeda8ec59d71c5ca73fed3cc827eedcafda3b"
Jul 21 17:11:09.935456 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:11:09.935435    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"41edd2cb99d560eebfa3a8e570abeda8ec59d71c5ca73fed3cc827eedcafda3b"} err="failed to get container status \"41edd2cb99d560eebfa3a8e570abeda8ec59d71c5ca73fed3cc827eedcafda3b\": rpc error: code = NotFound desc = could not find container \"41edd2cb99d560eebfa3a8e570abeda8ec59d71c5ca73fed3cc827eedcafda3b\": container with ID starting with 41edd2cb99d560eebfa3a8e570abeda8ec59d71c5ca73fed3cc827eedcafda3b not found: ID does not exist"
Jul 21 17:11:09.935456 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:11:09.935456    2575 scope.go:117] "RemoveContainer" containerID="ac9d562f82a8e08cb751f37855f702f4794b02c1a561de0c79726383bf1feea2"
Jul 21 17:11:09.935641 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:11:09.935626    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ac9d562f82a8e08cb751f37855f702f4794b02c1a561de0c79726383bf1feea2"} err="failed to get container status \"ac9d562f82a8e08cb751f37855f702f4794b02c1a561de0c79726383bf1feea2\": rpc error: code = NotFound desc = could not find container \"ac9d562f82a8e08cb751f37855f702f4794b02c1a561de0c79726383bf1feea2\": container with ID starting with ac9d562f82a8e08cb751f37855f702f4794b02c1a561de0c79726383bf1feea2 not found: ID does not exist"
Jul 21 17:11:09.935693 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:11:09.935643    2575 scope.go:117] "RemoveContainer" containerID="925a7475c18eafc2034e3339f4045ca31d1190096a4babcd5cdec770474474b0"
Jul 21 17:11:09.935847 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:11:09.935828    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"925a7475c18eafc2034e3339f4045ca31d1190096a4babcd5cdec770474474b0"} err="failed to get container status \"925a7475c18eafc2034e3339f4045ca31d1190096a4babcd5cdec770474474b0\": rpc error: code = NotFound desc = could not find container \"925a7475c18eafc2034e3339f4045ca31d1190096a4babcd5cdec770474474b0\": container with ID starting with 925a7475c18eafc2034e3339f4045ca31d1190096a4babcd5cdec770474474b0 not found: ID does not exist"
Jul 21 17:11:09.935894 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:11:09.935849    2575 scope.go:117] "RemoveContainer" containerID="0410a0b42eb68cafccfe8a03e454a7033577972fa33ad56e75264a135cfebd5d"
Jul 21 17:11:09.936025 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:11:09.936008    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0410a0b42eb68cafccfe8a03e454a7033577972fa33ad56e75264a135cfebd5d"} err="failed to get container status \"0410a0b42eb68cafccfe8a03e454a7033577972fa33ad56e75264a135cfebd5d\": rpc error: code = NotFound desc = could not find container \"0410a0b42eb68cafccfe8a03e454a7033577972fa33ad56e75264a135cfebd5d\": container with ID starting with 0410a0b42eb68cafccfe8a03e454a7033577972fa33ad56e75264a135cfebd5d not found: ID does not exist"
Jul 21 17:11:09.936092 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:11:09.936025    2575 scope.go:117] "RemoveContainer" containerID="27ed7c1517c0617b78a3e7ecf03707e57b872caf3acf5a22576f2f7e654f16a9"
Jul 21 17:11:09.936282 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:11:09.936262    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"27ed7c1517c0617b78a3e7ecf03707e57b872caf3acf5a22576f2f7e654f16a9"} err="failed to get container status \"27ed7c1517c0617b78a3e7ecf03707e57b872caf3acf5a22576f2f7e654f16a9\": rpc error: code = NotFound desc = could not find container \"27ed7c1517c0617b78a3e7ecf03707e57b872caf3acf5a22576f2f7e654f16a9\": container with ID starting with 27ed7c1517c0617b78a3e7ecf03707e57b872caf3acf5a22576f2f7e654f16a9 not found: ID does not exist"
Jul 21 17:11:09.936354 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:11:09.936283    2575 scope.go:117] "RemoveContainer" containerID="3ab5ac0d1f959a6f14406453a794e3e87a4a398c6dea9a1cd3f4859eabe05d0d"
Jul 21 17:11:09.936571 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:11:09.936552    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3ab5ac0d1f959a6f14406453a794e3e87a4a398c6dea9a1cd3f4859eabe05d0d"} err="failed to get container status \"3ab5ac0d1f959a6f14406453a794e3e87a4a398c6dea9a1cd3f4859eabe05d0d\": rpc error: code = NotFound desc = could not find container \"3ab5ac0d1f959a6f14406453a794e3e87a4a398c6dea9a1cd3f4859eabe05d0d\": container with ID starting with 3ab5ac0d1f959a6f14406453a794e3e87a4a398c6dea9a1cd3f4859eabe05d0d not found: ID does not exist"
Jul 21 17:11:09.936571 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:11:09.936570    2575 scope.go:117] "RemoveContainer" containerID="1664a22bc720515bb6bff88dc59c2b58494bdb2ee559621a5ec99c798dea55f3"
Jul 21 17:11:09.936781 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:11:09.936755    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1664a22bc720515bb6bff88dc59c2b58494bdb2ee559621a5ec99c798dea55f3"} err="failed to get container status \"1664a22bc720515bb6bff88dc59c2b58494bdb2ee559621a5ec99c798dea55f3\": rpc error: code = NotFound desc = could not find container \"1664a22bc720515bb6bff88dc59c2b58494bdb2ee559621a5ec99c798dea55f3\": container with ID starting with 1664a22bc720515bb6bff88dc59c2b58494bdb2ee559621a5ec99c798dea55f3 not found: ID does not exist"
Jul 21 17:11:09.936781 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:11:09.936773    2575 scope.go:117] "RemoveContainer" containerID="41edd2cb99d560eebfa3a8e570abeda8ec59d71c5ca73fed3cc827eedcafda3b"
Jul 21 17:11:09.937014 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:11:09.936984    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"41edd2cb99d560eebfa3a8e570abeda8ec59d71c5ca73fed3cc827eedcafda3b"} err="failed to get container status \"41edd2cb99d560eebfa3a8e570abeda8ec59d71c5ca73fed3cc827eedcafda3b\": rpc error: code = NotFound desc = could not find container \"41edd2cb99d560eebfa3a8e570abeda8ec59d71c5ca73fed3cc827eedcafda3b\": container with ID starting with 41edd2cb99d560eebfa3a8e570abeda8ec59d71c5ca73fed3cc827eedcafda3b not found: ID does not exist"
Jul 21 17:11:09.937014 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:11:09.937014    2575 scope.go:117] "RemoveContainer" containerID="ac9d562f82a8e08cb751f37855f702f4794b02c1a561de0c79726383bf1feea2"
Jul 21 17:11:09.937308 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:11:09.937277    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ac9d562f82a8e08cb751f37855f702f4794b02c1a561de0c79726383bf1feea2"} err="failed to get container status \"ac9d562f82a8e08cb751f37855f702f4794b02c1a561de0c79726383bf1feea2\": rpc error: code = NotFound desc = could not find container \"ac9d562f82a8e08cb751f37855f702f4794b02c1a561de0c79726383bf1feea2\": container with ID starting with ac9d562f82a8e08cb751f37855f702f4794b02c1a561de0c79726383bf1feea2 not found: ID does not exist"
Jul 21 17:11:09.937308 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:11:09.937301    2575 scope.go:117] "RemoveContainer" containerID="925a7475c18eafc2034e3339f4045ca31d1190096a4babcd5cdec770474474b0"
Jul 21 17:11:09.937574 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:11:09.937556    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"925a7475c18eafc2034e3339f4045ca31d1190096a4babcd5cdec770474474b0"} err="failed to get container status \"925a7475c18eafc2034e3339f4045ca31d1190096a4babcd5cdec770474474b0\": rpc error: code = NotFound desc = could not find container \"925a7475c18eafc2034e3339f4045ca31d1190096a4babcd5cdec770474474b0\": container with ID starting with 925a7475c18eafc2034e3339f4045ca31d1190096a4babcd5cdec770474474b0 not found: ID does not exist"
Jul 21 17:11:09.937635 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:11:09.937576    2575 scope.go:117] "RemoveContainer" containerID="0410a0b42eb68cafccfe8a03e454a7033577972fa33ad56e75264a135cfebd5d"
Jul 21 17:11:09.937838 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:11:09.937821    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0410a0b42eb68cafccfe8a03e454a7033577972fa33ad56e75264a135cfebd5d"} err="failed to get container status \"0410a0b42eb68cafccfe8a03e454a7033577972fa33ad56e75264a135cfebd5d\": rpc error: code = NotFound desc = could not find container \"0410a0b42eb68cafccfe8a03e454a7033577972fa33ad56e75264a135cfebd5d\": container with ID starting with 0410a0b42eb68cafccfe8a03e454a7033577972fa33ad56e75264a135cfebd5d not found: ID does not exist"
Jul 21 17:11:09.937912 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:11:09.937841    2575 scope.go:117] "RemoveContainer" containerID="27ed7c1517c0617b78a3e7ecf03707e57b872caf3acf5a22576f2f7e654f16a9"
Jul 21 17:11:09.938065 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:11:09.938048    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"27ed7c1517c0617b78a3e7ecf03707e57b872caf3acf5a22576f2f7e654f16a9"} err="failed to get container status \"27ed7c1517c0617b78a3e7ecf03707e57b872caf3acf5a22576f2f7e654f16a9\": rpc error: code = NotFound desc = could not find container \"27ed7c1517c0617b78a3e7ecf03707e57b872caf3acf5a22576f2f7e654f16a9\": container with ID starting with 27ed7c1517c0617b78a3e7ecf03707e57b872caf3acf5a22576f2f7e654f16a9 not found: ID does not exist"
Jul 21 17:11:09.938065 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:11:09.938065    2575 scope.go:117] "RemoveContainer" containerID="3ab5ac0d1f959a6f14406453a794e3e87a4a398c6dea9a1cd3f4859eabe05d0d"
Jul 21 17:11:09.938267 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:11:09.938252    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3ab5ac0d1f959a6f14406453a794e3e87a4a398c6dea9a1cd3f4859eabe05d0d"} err="failed to get container status \"3ab5ac0d1f959a6f14406453a794e3e87a4a398c6dea9a1cd3f4859eabe05d0d\": rpc error: code = NotFound desc = could not find container \"3ab5ac0d1f959a6f14406453a794e3e87a4a398c6dea9a1cd3f4859eabe05d0d\": container with ID starting with 3ab5ac0d1f959a6f14406453a794e3e87a4a398c6dea9a1cd3f4859eabe05d0d not found: ID does not exist"
Jul 21 17:11:09.938316 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:11:09.938270    2575 scope.go:117] "RemoveContainer" containerID="1664a22bc720515bb6bff88dc59c2b58494bdb2ee559621a5ec99c798dea55f3"
Jul 21 17:11:09.938487 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:11:09.938465    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1664a22bc720515bb6bff88dc59c2b58494bdb2ee559621a5ec99c798dea55f3"} err="failed to get container status \"1664a22bc720515bb6bff88dc59c2b58494bdb2ee559621a5ec99c798dea55f3\": rpc error: code = NotFound desc = could not find container \"1664a22bc720515bb6bff88dc59c2b58494bdb2ee559621a5ec99c798dea55f3\": container with ID starting with 1664a22bc720515bb6bff88dc59c2b58494bdb2ee559621a5ec99c798dea55f3 not found: ID does not exist"
Jul 21 17:11:09.938487 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:11:09.938485    2575 scope.go:117] "RemoveContainer" containerID="41edd2cb99d560eebfa3a8e570abeda8ec59d71c5ca73fed3cc827eedcafda3b"
Jul 21 17:11:09.938715 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:11:09.938698    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"41edd2cb99d560eebfa3a8e570abeda8ec59d71c5ca73fed3cc827eedcafda3b"} err="failed to get container status \"41edd2cb99d560eebfa3a8e570abeda8ec59d71c5ca73fed3cc827eedcafda3b\": rpc error: code = NotFound desc = could not find container \"41edd2cb99d560eebfa3a8e570abeda8ec59d71c5ca73fed3cc827eedcafda3b\": container with ID starting with 41edd2cb99d560eebfa3a8e570abeda8ec59d71c5ca73fed3cc827eedcafda3b not found: ID does not exist"
Jul 21 17:11:09.938768 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:11:09.938715    2575 scope.go:117] "RemoveContainer" containerID="ac9d562f82a8e08cb751f37855f702f4794b02c1a561de0c79726383bf1feea2"
Jul 21 17:11:09.938913 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:11:09.938898    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ac9d562f82a8e08cb751f37855f702f4794b02c1a561de0c79726383bf1feea2"} err="failed to get container status \"ac9d562f82a8e08cb751f37855f702f4794b02c1a561de0c79726383bf1feea2\": rpc error: code = NotFound desc = could not find container \"ac9d562f82a8e08cb751f37855f702f4794b02c1a561de0c79726383bf1feea2\": container with ID starting with ac9d562f82a8e08cb751f37855f702f4794b02c1a561de0c79726383bf1feea2 not found: ID does not exist"
Jul 21 17:11:09.938953 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:11:09.938914    2575 scope.go:117] "RemoveContainer" containerID="925a7475c18eafc2034e3339f4045ca31d1190096a4babcd5cdec770474474b0"
Jul 21 17:11:09.939090 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:11:09.939075    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"925a7475c18eafc2034e3339f4045ca31d1190096a4babcd5cdec770474474b0"} err="failed to get container status \"925a7475c18eafc2034e3339f4045ca31d1190096a4babcd5cdec770474474b0\": rpc error: code = NotFound desc = could not find container \"925a7475c18eafc2034e3339f4045ca31d1190096a4babcd5cdec770474474b0\": container with ID starting with 925a7475c18eafc2034e3339f4045ca31d1190096a4babcd5cdec770474474b0 not found: ID does not exist"
Jul 21 17:11:09.939090 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:11:09.939089    2575 scope.go:117] "RemoveContainer" containerID="0410a0b42eb68cafccfe8a03e454a7033577972fa33ad56e75264a135cfebd5d"
Jul 21 17:11:09.939272 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:11:09.939256    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0410a0b42eb68cafccfe8a03e454a7033577972fa33ad56e75264a135cfebd5d"} err="failed to get container status \"0410a0b42eb68cafccfe8a03e454a7033577972fa33ad56e75264a135cfebd5d\": rpc error: code = NotFound desc = could not find container \"0410a0b42eb68cafccfe8a03e454a7033577972fa33ad56e75264a135cfebd5d\": container with ID starting with 0410a0b42eb68cafccfe8a03e454a7033577972fa33ad56e75264a135cfebd5d not found: ID does not exist"
Jul 21 17:11:09.939313 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:11:09.939274    2575 scope.go:117] "RemoveContainer" containerID="27ed7c1517c0617b78a3e7ecf03707e57b872caf3acf5a22576f2f7e654f16a9"
Jul 21 17:11:09.939469 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:11:09.939453    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"27ed7c1517c0617b78a3e7ecf03707e57b872caf3acf5a22576f2f7e654f16a9"} err="failed to get container status \"27ed7c1517c0617b78a3e7ecf03707e57b872caf3acf5a22576f2f7e654f16a9\": rpc error: code = NotFound desc = could not find container \"27ed7c1517c0617b78a3e7ecf03707e57b872caf3acf5a22576f2f7e654f16a9\": container with ID starting with 27ed7c1517c0617b78a3e7ecf03707e57b872caf3acf5a22576f2f7e654f16a9 not found: ID does not exist"
Jul 21 17:11:09.939521 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:11:09.939470    2575 scope.go:117] "RemoveContainer" containerID="3ab5ac0d1f959a6f14406453a794e3e87a4a398c6dea9a1cd3f4859eabe05d0d"
Jul 21 17:11:09.939657 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:11:09.939643    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3ab5ac0d1f959a6f14406453a794e3e87a4a398c6dea9a1cd3f4859eabe05d0d"} err="failed to get container status \"3ab5ac0d1f959a6f14406453a794e3e87a4a398c6dea9a1cd3f4859eabe05d0d\": rpc error: code = NotFound desc = could not find container \"3ab5ac0d1f959a6f14406453a794e3e87a4a398c6dea9a1cd3f4859eabe05d0d\": container with ID starting with 3ab5ac0d1f959a6f14406453a794e3e87a4a398c6dea9a1cd3f4859eabe05d0d not found: ID does not exist"
Jul 21 17:11:09.956950 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:11:09.956894    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 21 17:11:09.957151 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:11:09.957138    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8364b4ed-8031-45f1-891f-4fbb77e6df78" containerName="kube-rbac-proxy-web"
Jul 21 17:11:09.957186 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:11:09.957155    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="8364b4ed-8031-45f1-891f-4fbb77e6df78" containerName="kube-rbac-proxy-web"
Jul 21 17:11:09.957186 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:11:09.957166    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1f616833-66fa-486f-8596-fcabb0de9cc5" containerName="kube-rbac-proxy-web"
Jul 21 17:11:09.957186 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:11:09.957171    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="1f616833-66fa-486f-8596-fcabb0de9cc5" containerName="kube-rbac-proxy-web"
Jul 21 17:11:09.957186 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:11:09.957179    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1f616833-66fa-486f-8596-fcabb0de9cc5" containerName="kube-rbac-proxy"
Jul 21 17:11:09.957186 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:11:09.957184    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="1f616833-66fa-486f-8596-fcabb0de9cc5" containerName="kube-rbac-proxy"
Jul 21 17:11:09.957320 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:11:09.957189    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8364b4ed-8031-45f1-891f-4fbb77e6df78" containerName="kube-rbac-proxy-thanos"
Jul 21 17:11:09.957320 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:11:09.957195    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="8364b4ed-8031-45f1-891f-4fbb77e6df78" containerName="kube-rbac-proxy-thanos"
Jul 21 17:11:09.957320 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:11:09.957202    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1f616833-66fa-486f-8596-fcabb0de9cc5" containerName="kube-rbac-proxy-metric"
Jul 21 17:11:09.957320 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:11:09.957207    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="1f616833-66fa-486f-8596-fcabb0de9cc5" containerName="kube-rbac-proxy-metric"
Jul 21 17:11:09.957320 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:11:09.957212    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8364b4ed-8031-45f1-891f-4fbb77e6df78" containerName="prometheus"
Jul 21 17:11:09.957320 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:11:09.957217    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="8364b4ed-8031-45f1-891f-4fbb77e6df78" containerName="prometheus"
Jul 21 17:11:09.957320 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:11:09.957224    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1f616833-66fa-486f-8596-fcabb0de9cc5" containerName="alertmanager"
Jul 21 17:11:09.957320 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:11:09.957228    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="1f616833-66fa-486f-8596-fcabb0de9cc5" containerName="alertmanager"
Jul 21 17:11:09.957320 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:11:09.957233    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8364b4ed-8031-45f1-891f-4fbb77e6df78" containerName="kube-rbac-proxy"
Jul 21 17:11:09.957320 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:11:09.957237    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="8364b4ed-8031-45f1-891f-4fbb77e6df78" containerName="kube-rbac-proxy"
Jul 21 17:11:09.957320 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:11:09.957244    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8364b4ed-8031-45f1-891f-4fbb77e6df78" containerName="thanos-sidecar"
Jul 21 17:11:09.957320 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:11:09.957249    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="8364b4ed-8031-45f1-891f-4fbb77e6df78" containerName="thanos-sidecar"
Jul 21 17:11:09.957320 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:11:09.957259    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1f616833-66fa-486f-8596-fcabb0de9cc5" containerName="prom-label-proxy"
Jul 21 17:11:09.957320 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:11:09.957264    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="1f616833-66fa-486f-8596-fcabb0de9cc5" containerName="prom-label-proxy"
Jul 21 17:11:09.957320 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:11:09.957271    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8364b4ed-8031-45f1-891f-4fbb77e6df78" containerName="config-reloader"
Jul 21 17:11:09.957320 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:11:09.957275    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="8364b4ed-8031-45f1-891f-4fbb77e6df78" containerName="config-reloader"
Jul 21 17:11:09.957320 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:11:09.957281    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8364b4ed-8031-45f1-891f-4fbb77e6df78" containerName="init-config-reloader"
Jul 21 17:11:09.957320 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:11:09.957286    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="8364b4ed-8031-45f1-891f-4fbb77e6df78" containerName="init-config-reloader"
Jul 21 17:11:09.957320 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:11:09.957291    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1f616833-66fa-486f-8596-fcabb0de9cc5" containerName="config-reloader"
Jul 21 17:11:09.957320 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:11:09.957295    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="1f616833-66fa-486f-8596-fcabb0de9cc5" containerName="config-reloader"
Jul 21 17:11:09.957320 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:11:09.957302    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1f616833-66fa-486f-8596-fcabb0de9cc5" containerName="init-config-reloader"
Jul 21 17:11:09.957320 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:11:09.957306    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="1f616833-66fa-486f-8596-fcabb0de9cc5" containerName="init-config-reloader"
Jul 21 17:11:09.957914 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:11:09.957343    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="1f616833-66fa-486f-8596-fcabb0de9cc5" containerName="kube-rbac-proxy-metric"
Jul 21 17:11:09.957914 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:11:09.957349    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="8364b4ed-8031-45f1-891f-4fbb77e6df78" containerName="prometheus"
Jul 21 17:11:09.957914 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:11:09.957355    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="1f616833-66fa-486f-8596-fcabb0de9cc5" containerName="prom-label-proxy"
Jul 21 17:11:09.957914 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:11:09.957359    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="8364b4ed-8031-45f1-891f-4fbb77e6df78" containerName="kube-rbac-proxy-thanos"
Jul 21 17:11:09.957914 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:11:09.957366    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="1f616833-66fa-486f-8596-fcabb0de9cc5" containerName="config-reloader"
Jul 21 17:11:09.957914 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:11:09.957371    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="1f616833-66fa-486f-8596-fcabb0de9cc5" containerName="kube-rbac-proxy-web"
Jul 21 17:11:09.957914 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:11:09.957379    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="1f616833-66fa-486f-8596-fcabb0de9cc5" containerName="alertmanager"
Jul 21 17:11:09.957914 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:11:09.957384    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="8364b4ed-8031-45f1-891f-4fbb77e6df78" containerName="thanos-sidecar"
Jul 21 17:11:09.957914 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:11:09.957388    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="8364b4ed-8031-45f1-891f-4fbb77e6df78" containerName="kube-rbac-proxy-web"
Jul 21 17:11:09.957914 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:11:09.957393    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="1f616833-66fa-486f-8596-fcabb0de9cc5" containerName="kube-rbac-proxy"
Jul 21 17:11:09.957914 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:11:09.957398    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="8364b4ed-8031-45f1-891f-4fbb77e6df78" containerName="config-reloader"
Jul 21 17:11:09.957914 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:11:09.957402    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="8364b4ed-8031-45f1-891f-4fbb77e6df78" containerName="kube-rbac-proxy"
Jul 21 17:11:09.961334 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:11:09.961318    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 17:11:09.964109 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:11:09.964074    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
Jul 21 17:11:09.964109 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:11:09.964078    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
Jul 21 17:11:09.964332 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:11:09.964180    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
Jul 21 17:11:09.964407 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:11:09.964350    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-795avj7tlpdb5\""
Jul 21 17:11:09.964407 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:11:09.964362    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
Jul 21 17:11:09.964560 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:11:09.964447    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
Jul 21 17:11:09.964560 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:11:09.964472    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-xznkj\""
Jul 21 17:11:09.964752 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:11:09.964736    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
Jul 21 17:11:09.964854 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:11:09.964764    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\""
Jul 21 17:11:09.964854 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:11:09.964770    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
Jul 21 17:11:09.964854 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:11:09.964810    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
Jul 21 17:11:09.964999 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:11:09.964857    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
Jul 21 17:11:09.965157 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:11:09.965117    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
Jul 21 17:11:09.965573 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:11:09.965553    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\""
Jul 21 17:11:09.973256 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:11:09.973239    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
Jul 21 17:11:09.974208 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:11:09.974193    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
Jul 21 17:11:10.003212 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:11:10.003189    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 21 17:11:10.101787 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:11:10.101753    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/9c1b74e2-0ca1-4a71-b530-6bc1536771b4-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"9c1b74e2-0ca1-4a71-b530-6bc1536771b4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 17:11:10.101787 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:11:10.101789    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9c1b74e2-0ca1-4a71-b530-6bc1536771b4-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"9c1b74e2-0ca1-4a71-b530-6bc1536771b4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 17:11:10.102015 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:11:10.101808    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9c1b74e2-0ca1-4a71-b530-6bc1536771b4-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"9c1b74e2-0ca1-4a71-b530-6bc1536771b4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 17:11:10.102015 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:11:10.101830    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/9c1b74e2-0ca1-4a71-b530-6bc1536771b4-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"9c1b74e2-0ca1-4a71-b530-6bc1536771b4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 17:11:10.102015 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:11:10.101895    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/9c1b74e2-0ca1-4a71-b530-6bc1536771b4-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"9c1b74e2-0ca1-4a71-b530-6bc1536771b4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 17:11:10.102015 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:11:10.101959    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/9c1b74e2-0ca1-4a71-b530-6bc1536771b4-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"9c1b74e2-0ca1-4a71-b530-6bc1536771b4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 17:11:10.102015 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:11:10.101988    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/9c1b74e2-0ca1-4a71-b530-6bc1536771b4-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"9c1b74e2-0ca1-4a71-b530-6bc1536771b4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 17:11:10.102193 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:11:10.102027    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/9c1b74e2-0ca1-4a71-b530-6bc1536771b4-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"9c1b74e2-0ca1-4a71-b530-6bc1536771b4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 17:11:10.102193 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:11:10.102043    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9c1b74e2-0ca1-4a71-b530-6bc1536771b4-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"9c1b74e2-0ca1-4a71-b530-6bc1536771b4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 17:11:10.102193 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:11:10.102062    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/9c1b74e2-0ca1-4a71-b530-6bc1536771b4-web-config\") pod \"prometheus-k8s-0\" (UID: \"9c1b74e2-0ca1-4a71-b530-6bc1536771b4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 17:11:10.102193 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:11:10.102107    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/9c1b74e2-0ca1-4a71-b530-6bc1536771b4-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"9c1b74e2-0ca1-4a71-b530-6bc1536771b4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 17:11:10.102193 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:11:10.102132    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/9c1b74e2-0ca1-4a71-b530-6bc1536771b4-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"9c1b74e2-0ca1-4a71-b530-6bc1536771b4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 17:11:10.102462 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:11:10.102192    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/9c1b74e2-0ca1-4a71-b530-6bc1536771b4-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"9c1b74e2-0ca1-4a71-b530-6bc1536771b4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 17:11:10.102462 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:11:10.102232    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/9c1b74e2-0ca1-4a71-b530-6bc1536771b4-config-out\") pod \"prometheus-k8s-0\" (UID: \"9c1b74e2-0ca1-4a71-b530-6bc1536771b4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 17:11:10.102462 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:11:10.102260    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/9c1b74e2-0ca1-4a71-b530-6bc1536771b4-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"9c1b74e2-0ca1-4a71-b530-6bc1536771b4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 17:11:10.102462 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:11:10.102290    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/9c1b74e2-0ca1-4a71-b530-6bc1536771b4-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"9c1b74e2-0ca1-4a71-b530-6bc1536771b4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 17:11:10.102462 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:11:10.102319    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/9c1b74e2-0ca1-4a71-b530-6bc1536771b4-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"9c1b74e2-0ca1-4a71-b530-6bc1536771b4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 17:11:10.102462 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:11:10.102343    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-44dmm\" (UniqueName: \"kubernetes.io/projected/9c1b74e2-0ca1-4a71-b530-6bc1536771b4-kube-api-access-44dmm\") pod \"prometheus-k8s-0\" (UID: \"9c1b74e2-0ca1-4a71-b530-6bc1536771b4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 17:11:10.102462 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:11:10.102370    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/9c1b74e2-0ca1-4a71-b530-6bc1536771b4-config\") pod \"prometheus-k8s-0\" (UID: \"9c1b74e2-0ca1-4a71-b530-6bc1536771b4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 17:11:10.102462 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:11:10.102392    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9c1b74e2-0ca1-4a71-b530-6bc1536771b4-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"9c1b74e2-0ca1-4a71-b530-6bc1536771b4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 17:11:10.115146 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:11:10.115118    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8364b4ed-8031-45f1-891f-4fbb77e6df78" path="/var/lib/kubelet/pods/8364b4ed-8031-45f1-891f-4fbb77e6df78/volumes"
Jul 21 17:11:10.203409 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:11:10.203373    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/9c1b74e2-0ca1-4a71-b530-6bc1536771b4-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"9c1b74e2-0ca1-4a71-b530-6bc1536771b4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 17:11:10.203605 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:11:10.203438    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9c1b74e2-0ca1-4a71-b530-6bc1536771b4-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"9c1b74e2-0ca1-4a71-b530-6bc1536771b4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 17:11:10.203605 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:11:10.203467    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/9c1b74e2-0ca1-4a71-b530-6bc1536771b4-web-config\") pod \"prometheus-k8s-0\" (UID: \"9c1b74e2-0ca1-4a71-b530-6bc1536771b4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 17:11:10.203605 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:11:10.203498    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/9c1b74e2-0ca1-4a71-b530-6bc1536771b4-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"9c1b74e2-0ca1-4a71-b530-6bc1536771b4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 17:11:10.203605 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:11:10.203532    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/9c1b74e2-0ca1-4a71-b530-6bc1536771b4-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"9c1b74e2-0ca1-4a71-b530-6bc1536771b4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 17:11:10.203605 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:11:10.203565    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/9c1b74e2-0ca1-4a71-b530-6bc1536771b4-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"9c1b74e2-0ca1-4a71-b530-6bc1536771b4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 17:11:10.203605 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:11:10.203594    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/9c1b74e2-0ca1-4a71-b530-6bc1536771b4-config-out\") pod \"prometheus-k8s-0\" (UID: \"9c1b74e2-0ca1-4a71-b530-6bc1536771b4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 17:11:10.203886 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:11:10.203617    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/9c1b74e2-0ca1-4a71-b530-6bc1536771b4-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"9c1b74e2-0ca1-4a71-b530-6bc1536771b4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 17:11:10.203886 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:11:10.203749    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/9c1b74e2-0ca1-4a71-b530-6bc1536771b4-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"9c1b74e2-0ca1-4a71-b530-6bc1536771b4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 17:11:10.203886 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:11:10.203825    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/9c1b74e2-0ca1-4a71-b530-6bc1536771b4-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"9c1b74e2-0ca1-4a71-b530-6bc1536771b4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 17:11:10.203886 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:11:10.203853    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-44dmm\" (UniqueName: \"kubernetes.io/projected/9c1b74e2-0ca1-4a71-b530-6bc1536771b4-kube-api-access-44dmm\") pod \"prometheus-k8s-0\" (UID: \"9c1b74e2-0ca1-4a71-b530-6bc1536771b4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 17:11:10.204090 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:11:10.203896    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/9c1b74e2-0ca1-4a71-b530-6bc1536771b4-config\") pod \"prometheus-k8s-0\" (UID: \"9c1b74e2-0ca1-4a71-b530-6bc1536771b4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 17:11:10.204090 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:11:10.203925    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9c1b74e2-0ca1-4a71-b530-6bc1536771b4-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"9c1b74e2-0ca1-4a71-b530-6bc1536771b4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 17:11:10.204090 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:11:10.203976    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/9c1b74e2-0ca1-4a71-b530-6bc1536771b4-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"9c1b74e2-0ca1-4a71-b530-6bc1536771b4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 17:11:10.204090 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:11:10.204002    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9c1b74e2-0ca1-4a71-b530-6bc1536771b4-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"9c1b74e2-0ca1-4a71-b530-6bc1536771b4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 17:11:10.204090 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:11:10.204030    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9c1b74e2-0ca1-4a71-b530-6bc1536771b4-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"9c1b74e2-0ca1-4a71-b530-6bc1536771b4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 17:11:10.204090 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:11:10.204085    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/9c1b74e2-0ca1-4a71-b530-6bc1536771b4-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"9c1b74e2-0ca1-4a71-b530-6bc1536771b4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 17:11:10.204381 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:11:10.204134    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/9c1b74e2-0ca1-4a71-b530-6bc1536771b4-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"9c1b74e2-0ca1-4a71-b530-6bc1536771b4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 17:11:10.204381 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:11:10.204163    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/9c1b74e2-0ca1-4a71-b530-6bc1536771b4-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"9c1b74e2-0ca1-4a71-b530-6bc1536771b4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 17:11:10.204381 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:11:10.204187    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/9c1b74e2-0ca1-4a71-b530-6bc1536771b4-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"9c1b74e2-0ca1-4a71-b530-6bc1536771b4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 17:11:10.204381 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:11:10.204349    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9c1b74e2-0ca1-4a71-b530-6bc1536771b4-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"9c1b74e2-0ca1-4a71-b530-6bc1536771b4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 17:11:10.204906 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:11:10.204851    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/9c1b74e2-0ca1-4a71-b530-6bc1536771b4-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"9c1b74e2-0ca1-4a71-b530-6bc1536771b4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 17:11:10.205113 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:11:10.205087    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/9c1b74e2-0ca1-4a71-b530-6bc1536771b4-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"9c1b74e2-0ca1-4a71-b530-6bc1536771b4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 17:11:10.207209 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:11:10.206034    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9c1b74e2-0ca1-4a71-b530-6bc1536771b4-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"9c1b74e2-0ca1-4a71-b530-6bc1536771b4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 17:11:10.207209 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:11:10.206480    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9c1b74e2-0ca1-4a71-b530-6bc1536771b4-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"9c1b74e2-0ca1-4a71-b530-6bc1536771b4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 17:11:10.207209 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:11:10.206541    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/9c1b74e2-0ca1-4a71-b530-6bc1536771b4-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"9c1b74e2-0ca1-4a71-b530-6bc1536771b4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 17:11:10.207209 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:11:10.206700    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/9c1b74e2-0ca1-4a71-b530-6bc1536771b4-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"9c1b74e2-0ca1-4a71-b530-6bc1536771b4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 17:11:10.207209 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:11:10.206763    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/9c1b74e2-0ca1-4a71-b530-6bc1536771b4-config-out\") pod \"prometheus-k8s-0\" (UID: \"9c1b74e2-0ca1-4a71-b530-6bc1536771b4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 17:11:10.207209 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:11:10.207139    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/9c1b74e2-0ca1-4a71-b530-6bc1536771b4-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"9c1b74e2-0ca1-4a71-b530-6bc1536771b4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 17:11:10.208269 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:11:10.207322    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9c1b74e2-0ca1-4a71-b530-6bc1536771b4-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"9c1b74e2-0ca1-4a71-b530-6bc1536771b4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 17:11:10.208269 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:11:10.207783    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/9c1b74e2-0ca1-4a71-b530-6bc1536771b4-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"9c1b74e2-0ca1-4a71-b530-6bc1536771b4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 17:11:10.208269 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:11:10.207809    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/9c1b74e2-0ca1-4a71-b530-6bc1536771b4-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"9c1b74e2-0ca1-4a71-b530-6bc1536771b4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 17:11:10.208269 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:11:10.207825    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/9c1b74e2-0ca1-4a71-b530-6bc1536771b4-web-config\") pod \"prometheus-k8s-0\" (UID: \"9c1b74e2-0ca1-4a71-b530-6bc1536771b4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 17:11:10.209060 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:11:10.209033    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/9c1b74e2-0ca1-4a71-b530-6bc1536771b4-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"9c1b74e2-0ca1-4a71-b530-6bc1536771b4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 17:11:10.209220 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:11:10.209204    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/9c1b74e2-0ca1-4a71-b530-6bc1536771b4-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"9c1b74e2-0ca1-4a71-b530-6bc1536771b4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 17:11:10.209270 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:11:10.209243    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/9c1b74e2-0ca1-4a71-b530-6bc1536771b4-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"9c1b74e2-0ca1-4a71-b530-6bc1536771b4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 17:11:10.209586 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:11:10.209570    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/9c1b74e2-0ca1-4a71-b530-6bc1536771b4-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"9c1b74e2-0ca1-4a71-b530-6bc1536771b4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 17:11:10.210218 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:11:10.210197    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/9c1b74e2-0ca1-4a71-b530-6bc1536771b4-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"9c1b74e2-0ca1-4a71-b530-6bc1536771b4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 17:11:10.210744 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:11:10.210724    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/9c1b74e2-0ca1-4a71-b530-6bc1536771b4-config\") pod \"prometheus-k8s-0\" (UID: \"9c1b74e2-0ca1-4a71-b530-6bc1536771b4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 17:11:10.213774 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:11:10.213756    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-44dmm\" (UniqueName: \"kubernetes.io/projected/9c1b74e2-0ca1-4a71-b530-6bc1536771b4-kube-api-access-44dmm\") pod \"prometheus-k8s-0\" (UID: \"9c1b74e2-0ca1-4a71-b530-6bc1536771b4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 17:11:10.272846 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:11:10.272816    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 17:11:10.408254 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:11:10.408234    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 21 17:11:10.410380 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:11:10.410345    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9c1b74e2_0ca1_4a71_b530_6bc1536771b4.slice/crio-55b7581d859d485a616720e997a90b4b6d61d8028e38262002906838572f3693 WatchSource:0}: Error finding container 55b7581d859d485a616720e997a90b4b6d61d8028e38262002906838572f3693: Status 404 returned error can't find the container with id 55b7581d859d485a616720e997a90b4b6d61d8028e38262002906838572f3693
Jul 21 17:11:10.886048 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:11:10.886006    2575 generic.go:356] "Generic (PLEG): container finished" podID="9c1b74e2-0ca1-4a71-b530-6bc1536771b4" containerID="2f101d594f5ce4768731a34f9faa1feca2d17a10cfc20736ebaee613054148e8" exitCode=0
Jul 21 17:11:10.886188 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:11:10.886100    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"9c1b74e2-0ca1-4a71-b530-6bc1536771b4","Type":"ContainerDied","Data":"2f101d594f5ce4768731a34f9faa1feca2d17a10cfc20736ebaee613054148e8"}
Jul 21 17:11:10.886188 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:11:10.886159    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"9c1b74e2-0ca1-4a71-b530-6bc1536771b4","Type":"ContainerStarted","Data":"55b7581d859d485a616720e997a90b4b6d61d8028e38262002906838572f3693"}
Jul 21 17:11:11.893049 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:11:11.893021    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"9c1b74e2-0ca1-4a71-b530-6bc1536771b4","Type":"ContainerStarted","Data":"753430c8792058bc4877c96f32ceb5859dd906cbebf7e2f9d48a9a566a57b51e"}
Jul 21 17:11:11.893440 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:11:11.893079    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"9c1b74e2-0ca1-4a71-b530-6bc1536771b4","Type":"ContainerStarted","Data":"d7f32871f2f6f5845fee4d0a014ae923a5ad232b3440d3f2cb4dee4b89a528d8"}
Jul 21 17:11:11.893440 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:11:11.893108    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"9c1b74e2-0ca1-4a71-b530-6bc1536771b4","Type":"ContainerStarted","Data":"753d94e584c42ce354662c2a5beac81fc80209b3af2123aa541b4ed22018d532"}
Jul 21 17:11:11.893440 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:11:11.893132    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"9c1b74e2-0ca1-4a71-b530-6bc1536771b4","Type":"ContainerStarted","Data":"c6f293bfaf598d1eedd1b69364d27ef1121d0d422e603915411b8c28e8484967"}
Jul 21 17:11:11.893440 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:11:11.893153    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"9c1b74e2-0ca1-4a71-b530-6bc1536771b4","Type":"ContainerStarted","Data":"dc61281396c6e7e9ff82891a3ac963c445bf1549e1361d6d80dc883b5e140a52"}
Jul 21 17:11:11.893440 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:11:11.893175    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"9c1b74e2-0ca1-4a71-b530-6bc1536771b4","Type":"ContainerStarted","Data":"f012684bf1438df9d8de72d330994e32057572eb08c6757ebf34d6fb67e66a43"}
Jul 21 17:11:11.936168 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:11:11.936091    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.9175122780000002 podStartE2EDuration="2.9360723s" totalImagesPullingTime="0s" totalInitContainerRuntime="18.560022ms" isStatefulPod=false podCreationTimestamp="2026-07-21 17:11:09 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 17:11:11.933801621 +0000 UTC m=+164.387954297" watchObservedRunningTime="2026-07-21 17:11:11.9360723 +0000 UTC m=+164.390224943"
Jul 21 17:11:15.273573 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:11:15.273535    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 17:12:10.273502 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:12:10.273459    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 17:12:10.289216 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:12:10.289193    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 17:12:11.127899 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:12:11.127875    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 17:13:27.925930 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:13:27.925901    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-b64gx_9425e519-d00c-4af6-a68a-3efde7aae5ba/ovn-acl-logging/0.log"
Jul 21 17:13:27.929445 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:13:27.929406    2575 kubelet.go:1648] "Image garbage collection succeeded"
Jul 21 17:13:27.933258 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:13:27.933240    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-b64gx_9425e519-d00c-4af6-a68a-3efde7aae5ba/ovn-acl-logging/0.log"
Jul 21 17:16:15.563154 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:16:15.563121    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-646df98c5d-wzk9k"]
Jul 21 17:16:15.565564 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:16:15.565546    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-646df98c5d-wzk9k"
Jul 21 17:16:15.570011 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:16:15.569990    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\""
Jul 21 17:16:15.570011 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:16:15.570005    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\""
Jul 21 17:16:15.570215 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:16:15.570197    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\""
Jul 21 17:16:15.570280 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:16:15.570248    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-d7tnw\""
Jul 21 17:16:15.570366 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:16:15.570320    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Jul 21 17:16:15.570548 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:16:15.570533    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Jul 21 17:16:15.609587 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:16:15.609547    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-646df98c5d-wzk9k"]
Jul 21 17:16:15.656126 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:16:15.656088    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/bea11817-7413-42c3-b7b5-530fce83f672-metrics-cert\") pod \"lws-controller-manager-646df98c5d-wzk9k\" (UID: \"bea11817-7413-42c3-b7b5-530fce83f672\") " pod="openshift-lws-operator/lws-controller-manager-646df98c5d-wzk9k"
Jul 21 17:16:15.656283 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:16:15.656141    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gh7qr\" (UniqueName: \"kubernetes.io/projected/bea11817-7413-42c3-b7b5-530fce83f672-kube-api-access-gh7qr\") pod \"lws-controller-manager-646df98c5d-wzk9k\" (UID: \"bea11817-7413-42c3-b7b5-530fce83f672\") " pod="openshift-lws-operator/lws-controller-manager-646df98c5d-wzk9k"
Jul 21 17:16:15.656283 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:16:15.656221    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/bea11817-7413-42c3-b7b5-530fce83f672-manager-config\") pod \"lws-controller-manager-646df98c5d-wzk9k\" (UID: \"bea11817-7413-42c3-b7b5-530fce83f672\") " pod="openshift-lws-operator/lws-controller-manager-646df98c5d-wzk9k"
Jul 21 17:16:15.656283 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:16:15.656248    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/bea11817-7413-42c3-b7b5-530fce83f672-cert\") pod \"lws-controller-manager-646df98c5d-wzk9k\" (UID: \"bea11817-7413-42c3-b7b5-530fce83f672\") " pod="openshift-lws-operator/lws-controller-manager-646df98c5d-wzk9k"
Jul 21 17:16:15.756861 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:16:15.756807    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/bea11817-7413-42c3-b7b5-530fce83f672-metrics-cert\") pod \"lws-controller-manager-646df98c5d-wzk9k\" (UID: \"bea11817-7413-42c3-b7b5-530fce83f672\") " pod="openshift-lws-operator/lws-controller-manager-646df98c5d-wzk9k"
Jul 21 17:16:15.756861 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:16:15.756856    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gh7qr\" (UniqueName: \"kubernetes.io/projected/bea11817-7413-42c3-b7b5-530fce83f672-kube-api-access-gh7qr\") pod \"lws-controller-manager-646df98c5d-wzk9k\" (UID: \"bea11817-7413-42c3-b7b5-530fce83f672\") " pod="openshift-lws-operator/lws-controller-manager-646df98c5d-wzk9k"
Jul 21 17:16:15.757116 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:16:15.756917    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/bea11817-7413-42c3-b7b5-530fce83f672-manager-config\") pod \"lws-controller-manager-646df98c5d-wzk9k\" (UID: \"bea11817-7413-42c3-b7b5-530fce83f672\") " pod="openshift-lws-operator/lws-controller-manager-646df98c5d-wzk9k"
Jul 21 17:16:15.757116 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:16:15.756944    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/bea11817-7413-42c3-b7b5-530fce83f672-cert\") pod \"lws-controller-manager-646df98c5d-wzk9k\" (UID: \"bea11817-7413-42c3-b7b5-530fce83f672\") " pod="openshift-lws-operator/lws-controller-manager-646df98c5d-wzk9k"
Jul 21 17:16:15.757646 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:16:15.757576    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/bea11817-7413-42c3-b7b5-530fce83f672-manager-config\") pod \"lws-controller-manager-646df98c5d-wzk9k\" (UID: \"bea11817-7413-42c3-b7b5-530fce83f672\") " pod="openshift-lws-operator/lws-controller-manager-646df98c5d-wzk9k"
Jul 21 17:16:15.759328 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:16:15.759307    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/bea11817-7413-42c3-b7b5-530fce83f672-metrics-cert\") pod \"lws-controller-manager-646df98c5d-wzk9k\" (UID: \"bea11817-7413-42c3-b7b5-530fce83f672\") " pod="openshift-lws-operator/lws-controller-manager-646df98c5d-wzk9k"
Jul 21 17:16:15.759404 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:16:15.759328    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/bea11817-7413-42c3-b7b5-530fce83f672-cert\") pod \"lws-controller-manager-646df98c5d-wzk9k\" (UID: \"bea11817-7413-42c3-b7b5-530fce83f672\") " pod="openshift-lws-operator/lws-controller-manager-646df98c5d-wzk9k"
Jul 21 17:16:15.782508 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:16:15.782483    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gh7qr\" (UniqueName: \"kubernetes.io/projected/bea11817-7413-42c3-b7b5-530fce83f672-kube-api-access-gh7qr\") pod \"lws-controller-manager-646df98c5d-wzk9k\" (UID: \"bea11817-7413-42c3-b7b5-530fce83f672\") " pod="openshift-lws-operator/lws-controller-manager-646df98c5d-wzk9k"
Jul 21 17:16:15.874913 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:16:15.874829    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-646df98c5d-wzk9k"
Jul 21 17:16:16.003340 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:16:16.003305    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-646df98c5d-wzk9k"]
Jul 21 17:16:16.006205 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:16:16.006177    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbea11817_7413_42c3_b7b5_530fce83f672.slice/crio-0dd8c6cd6d5129c98a1a6ab72dd91553d2f5fb4cafdf613c932aec01f951b418 WatchSource:0}: Error finding container 0dd8c6cd6d5129c98a1a6ab72dd91553d2f5fb4cafdf613c932aec01f951b418: Status 404 returned error can't find the container with id 0dd8c6cd6d5129c98a1a6ab72dd91553d2f5fb4cafdf613c932aec01f951b418
Jul 21 17:16:16.007950 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:16:16.007935    2575 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 21 17:16:16.960117 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:16:16.959736    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-65b498688-hkdhk"]
Jul 21 17:16:16.962533 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:16:16.962509    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-65b498688-hkdhk"
Jul 21 17:16:16.968316 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:16:16.968288    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Jul 21 17:16:16.968878 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:16:16.968352    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Jul 21 17:16:16.969001 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:16:16.968983    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Jul 21 17:16:16.969070 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:16:16.969050    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Jul 21 17:16:16.969175 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:16:16.969157    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-m8pfx\""
Jul 21 17:16:16.977966 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:16:16.977921    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-646df98c5d-wzk9k" event={"ID":"bea11817-7413-42c3-b7b5-530fce83f672","Type":"ContainerStarted","Data":"0dd8c6cd6d5129c98a1a6ab72dd91553d2f5fb4cafdf613c932aec01f951b418"}
Jul 21 17:16:16.989324 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:16:16.989297    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-65b498688-hkdhk"]
Jul 21 17:16:17.064998 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:16:17.064968    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/06e8fe36-9cbc-467f-9e2f-38a20111351c-manifests\") pod \"opendatahub-operator-controller-manager-65b498688-hkdhk\" (UID: \"06e8fe36-9cbc-467f-9e2f-38a20111351c\") " pod="opendatahub/opendatahub-operator-controller-manager-65b498688-hkdhk"
Jul 21 17:16:17.065161 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:16:17.065021    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/06e8fe36-9cbc-467f-9e2f-38a20111351c-webhook-cert\") pod \"opendatahub-operator-controller-manager-65b498688-hkdhk\" (UID: \"06e8fe36-9cbc-467f-9e2f-38a20111351c\") " pod="opendatahub/opendatahub-operator-controller-manager-65b498688-hkdhk"
Jul 21 17:16:17.065161 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:16:17.065073    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/06e8fe36-9cbc-467f-9e2f-38a20111351c-tmp\") pod \"opendatahub-operator-controller-manager-65b498688-hkdhk\" (UID: \"06e8fe36-9cbc-467f-9e2f-38a20111351c\") " pod="opendatahub/opendatahub-operator-controller-manager-65b498688-hkdhk"
Jul 21 17:16:17.065161 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:16:17.065115    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/06e8fe36-9cbc-467f-9e2f-38a20111351c-apiservice-cert\") pod \"opendatahub-operator-controller-manager-65b498688-hkdhk\" (UID: \"06e8fe36-9cbc-467f-9e2f-38a20111351c\") " pod="opendatahub/opendatahub-operator-controller-manager-65b498688-hkdhk"
Jul 21 17:16:17.065161 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:16:17.065151    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qtk9h\" (UniqueName: \"kubernetes.io/projected/06e8fe36-9cbc-467f-9e2f-38a20111351c-kube-api-access-qtk9h\") pod \"opendatahub-operator-controller-manager-65b498688-hkdhk\" (UID: \"06e8fe36-9cbc-467f-9e2f-38a20111351c\") " pod="opendatahub/opendatahub-operator-controller-manager-65b498688-hkdhk"
Jul 21 17:16:17.166019 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:16:17.165984    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/06e8fe36-9cbc-467f-9e2f-38a20111351c-apiservice-cert\") pod \"opendatahub-operator-controller-manager-65b498688-hkdhk\" (UID: \"06e8fe36-9cbc-467f-9e2f-38a20111351c\") " pod="opendatahub/opendatahub-operator-controller-manager-65b498688-hkdhk"
Jul 21 17:16:17.166230 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:16:17.166026    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qtk9h\" (UniqueName: \"kubernetes.io/projected/06e8fe36-9cbc-467f-9e2f-38a20111351c-kube-api-access-qtk9h\") pod \"opendatahub-operator-controller-manager-65b498688-hkdhk\" (UID: \"06e8fe36-9cbc-467f-9e2f-38a20111351c\") " pod="opendatahub/opendatahub-operator-controller-manager-65b498688-hkdhk"
Jul 21 17:16:17.166230 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:16:17.166072    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/06e8fe36-9cbc-467f-9e2f-38a20111351c-manifests\") pod \"opendatahub-operator-controller-manager-65b498688-hkdhk\" (UID: \"06e8fe36-9cbc-467f-9e2f-38a20111351c\") " pod="opendatahub/opendatahub-operator-controller-manager-65b498688-hkdhk"
Jul 21 17:16:17.166230 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:16:17.166181    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/06e8fe36-9cbc-467f-9e2f-38a20111351c-webhook-cert\") pod \"opendatahub-operator-controller-manager-65b498688-hkdhk\" (UID: \"06e8fe36-9cbc-467f-9e2f-38a20111351c\") " pod="opendatahub/opendatahub-operator-controller-manager-65b498688-hkdhk"
Jul 21 17:16:17.166230 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:16:17.166219    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/06e8fe36-9cbc-467f-9e2f-38a20111351c-tmp\") pod \"opendatahub-operator-controller-manager-65b498688-hkdhk\" (UID: \"06e8fe36-9cbc-467f-9e2f-38a20111351c\") " pod="opendatahub/opendatahub-operator-controller-manager-65b498688-hkdhk"
Jul 21 17:16:17.166679 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:16:17.166636    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/06e8fe36-9cbc-467f-9e2f-38a20111351c-manifests\") pod \"opendatahub-operator-controller-manager-65b498688-hkdhk\" (UID: \"06e8fe36-9cbc-467f-9e2f-38a20111351c\") " pod="opendatahub/opendatahub-operator-controller-manager-65b498688-hkdhk"
Jul 21 17:16:17.169041 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:16:17.168997    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/06e8fe36-9cbc-467f-9e2f-38a20111351c-tmp\") pod \"opendatahub-operator-controller-manager-65b498688-hkdhk\" (UID: \"06e8fe36-9cbc-467f-9e2f-38a20111351c\") " pod="opendatahub/opendatahub-operator-controller-manager-65b498688-hkdhk"
Jul 21 17:16:17.169212 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:16:17.169191    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/06e8fe36-9cbc-467f-9e2f-38a20111351c-apiservice-cert\") pod \"opendatahub-operator-controller-manager-65b498688-hkdhk\" (UID: \"06e8fe36-9cbc-467f-9e2f-38a20111351c\") " pod="opendatahub/opendatahub-operator-controller-manager-65b498688-hkdhk"
Jul 21 17:16:17.170169 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:16:17.170148    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/06e8fe36-9cbc-467f-9e2f-38a20111351c-webhook-cert\") pod \"opendatahub-operator-controller-manager-65b498688-hkdhk\" (UID: \"06e8fe36-9cbc-467f-9e2f-38a20111351c\") " pod="opendatahub/opendatahub-operator-controller-manager-65b498688-hkdhk"
Jul 21 17:16:17.177198 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:16:17.177156    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qtk9h\" (UniqueName: \"kubernetes.io/projected/06e8fe36-9cbc-467f-9e2f-38a20111351c-kube-api-access-qtk9h\") pod \"opendatahub-operator-controller-manager-65b498688-hkdhk\" (UID: \"06e8fe36-9cbc-467f-9e2f-38a20111351c\") " pod="opendatahub/opendatahub-operator-controller-manager-65b498688-hkdhk"
Jul 21 17:16:17.277132 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:16:17.277089    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-65b498688-hkdhk"
Jul 21 17:16:17.458967 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:16:17.458890    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-65b498688-hkdhk"]
Jul 21 17:16:17.462239 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:16:17.462204    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod06e8fe36_9cbc_467f_9e2f_38a20111351c.slice/crio-ca05e17a65c11e61fa081807013693bc67a57a30ad8196e46f49cf830c31c0a5 WatchSource:0}: Error finding container ca05e17a65c11e61fa081807013693bc67a57a30ad8196e46f49cf830c31c0a5: Status 404 returned error can't find the container with id ca05e17a65c11e61fa081807013693bc67a57a30ad8196e46f49cf830c31c0a5
Jul 21 17:16:17.983042 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:16:17.983005    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-65b498688-hkdhk" event={"ID":"06e8fe36-9cbc-467f-9e2f-38a20111351c","Type":"ContainerStarted","Data":"ca05e17a65c11e61fa081807013693bc67a57a30ad8196e46f49cf830c31c0a5"}
Jul 21 17:16:18.989199 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:16:18.989135    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-646df98c5d-wzk9k" event={"ID":"bea11817-7413-42c3-b7b5-530fce83f672","Type":"ContainerStarted","Data":"7c3bef1063ff117a47ba8ee1381547aa2ff51823ec5c763f9e81e2a4fe27bb9e"}
Jul 21 17:16:18.989851 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:16:18.989822    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-646df98c5d-wzk9k"
Jul 21 17:16:19.012466 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:16:19.012383    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-646df98c5d-wzk9k" podStartSLOduration=1.351729284 podStartE2EDuration="4.012361717s" totalImagesPullingTime="2.660632433s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 17:16:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 17:16:19.011761972 +0000 UTC m=+471.465914609" watchObservedRunningTime="2026-07-21 17:16:19.012361717 +0000 UTC m=+471.466514354"
Jul 21 17:16:22.002795 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:16:22.002757    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-65b498688-hkdhk" event={"ID":"06e8fe36-9cbc-467f-9e2f-38a20111351c","Type":"ContainerStarted","Data":"90689ed395c0b854d9c75ca9a0caf1bdbf6e7f13d49ee7ea883a99b7146777fe"}
Jul 21 17:16:23.008608 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:16:23.008575    2575 generic.go:356] "Generic (PLEG): container finished" podID="06e8fe36-9cbc-467f-9e2f-38a20111351c" containerID="90689ed395c0b854d9c75ca9a0caf1bdbf6e7f13d49ee7ea883a99b7146777fe" exitCode=0
Jul 21 17:16:23.008973 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:16:23.008625    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-65b498688-hkdhk" event={"ID":"06e8fe36-9cbc-467f-9e2f-38a20111351c","Type":"ContainerDied","Data":"90689ed395c0b854d9c75ca9a0caf1bdbf6e7f13d49ee7ea883a99b7146777fe"}
Jul 21 17:16:26.021913 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:16:26.021875    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-65b498688-hkdhk" event={"ID":"06e8fe36-9cbc-467f-9e2f-38a20111351c","Type":"ContainerStarted","Data":"786653a63da82b3aef4426e395f42fbdb4bbe1ec0b2843910e8158274cc8f880"}
Jul 21 17:16:26.022270 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:16:26.022015    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-65b498688-hkdhk"
Jul 21 17:16:26.045882 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:16:26.045842    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-65b498688-hkdhk" podStartSLOduration=3.070871733 podStartE2EDuration="10.045827994s" totalImagesPullingTime="5.903010123s" totalInitContainerRuntime="1.071946138s" isStatefulPod=false podCreationTimestamp="2026-07-21 17:16:16 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 17:16:26.04365786 +0000 UTC m=+478.497810499" watchObservedRunningTime="2026-07-21 17:16:26.045827994 +0000 UTC m=+478.499980634"
Jul 21 17:16:29.996135 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:16:29.996102    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-646df98c5d-wzk9k"
Jul 21 17:16:37.028599 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:16:37.028568    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-65b498688-hkdhk"
Jul 21 17:16:38.814086 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:16:38.814050    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-589694fdcc-62dzq"]
Jul 21 17:16:38.963425 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:16:38.963373    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-589694fdcc-62dzq"]
Jul 21 17:16:38.963594 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:16:38.963521    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-589694fdcc-62dzq"
Jul 21 17:16:38.974712 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:16:38.974686    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Jul 21 17:16:38.974874 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:16:38.974686    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jul 21 17:16:38.974874 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:16:38.974686    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jul 21 17:16:38.974874 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:16:38.974861    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-mrsvr\""
Jul 21 17:16:38.975033 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:16:38.974874    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
Jul 21 17:16:39.064149 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:16:39.064052    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j75ch\" (UniqueName: \"kubernetes.io/projected/94fa3ceb-0fc6-47f7-8847-af61b41903e4-kube-api-access-j75ch\") pod \"kube-auth-proxy-589694fdcc-62dzq\" (UID: \"94fa3ceb-0fc6-47f7-8847-af61b41903e4\") " pod="openshift-ingress/kube-auth-proxy-589694fdcc-62dzq"
Jul 21 17:16:39.064149 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:16:39.064110    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/94fa3ceb-0fc6-47f7-8847-af61b41903e4-tmp\") pod \"kube-auth-proxy-589694fdcc-62dzq\" (UID: \"94fa3ceb-0fc6-47f7-8847-af61b41903e4\") " pod="openshift-ingress/kube-auth-proxy-589694fdcc-62dzq"
Jul 21 17:16:39.064325 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:16:39.064202    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/94fa3ceb-0fc6-47f7-8847-af61b41903e4-tls-certs\") pod \"kube-auth-proxy-589694fdcc-62dzq\" (UID: \"94fa3ceb-0fc6-47f7-8847-af61b41903e4\") " pod="openshift-ingress/kube-auth-proxy-589694fdcc-62dzq"
Jul 21 17:16:39.165158 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:16:39.165128    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/94fa3ceb-0fc6-47f7-8847-af61b41903e4-tmp\") pod \"kube-auth-proxy-589694fdcc-62dzq\" (UID: \"94fa3ceb-0fc6-47f7-8847-af61b41903e4\") " pod="openshift-ingress/kube-auth-proxy-589694fdcc-62dzq"
Jul 21 17:16:39.165158 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:16:39.165176    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/94fa3ceb-0fc6-47f7-8847-af61b41903e4-tls-certs\") pod \"kube-auth-proxy-589694fdcc-62dzq\" (UID: \"94fa3ceb-0fc6-47f7-8847-af61b41903e4\") " pod="openshift-ingress/kube-auth-proxy-589694fdcc-62dzq"
Jul 21 17:16:39.165444 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:16:39.165221    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j75ch\" (UniqueName: \"kubernetes.io/projected/94fa3ceb-0fc6-47f7-8847-af61b41903e4-kube-api-access-j75ch\") pod \"kube-auth-proxy-589694fdcc-62dzq\" (UID: \"94fa3ceb-0fc6-47f7-8847-af61b41903e4\") " pod="openshift-ingress/kube-auth-proxy-589694fdcc-62dzq"
Jul 21 17:16:39.167595 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:16:39.167572    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/94fa3ceb-0fc6-47f7-8847-af61b41903e4-tmp\") pod \"kube-auth-proxy-589694fdcc-62dzq\" (UID: \"94fa3ceb-0fc6-47f7-8847-af61b41903e4\") " pod="openshift-ingress/kube-auth-proxy-589694fdcc-62dzq"
Jul 21 17:16:39.167780 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:16:39.167766    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/94fa3ceb-0fc6-47f7-8847-af61b41903e4-tls-certs\") pod \"kube-auth-proxy-589694fdcc-62dzq\" (UID: \"94fa3ceb-0fc6-47f7-8847-af61b41903e4\") " pod="openshift-ingress/kube-auth-proxy-589694fdcc-62dzq"
Jul 21 17:16:39.192643 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:16:39.192617    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j75ch\" (UniqueName: \"kubernetes.io/projected/94fa3ceb-0fc6-47f7-8847-af61b41903e4-kube-api-access-j75ch\") pod \"kube-auth-proxy-589694fdcc-62dzq\" (UID: \"94fa3ceb-0fc6-47f7-8847-af61b41903e4\") " pod="openshift-ingress/kube-auth-proxy-589694fdcc-62dzq"
Jul 21 17:16:39.273374 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:16:39.273344    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-589694fdcc-62dzq"
Jul 21 17:16:39.416038 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:16:39.415973    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-589694fdcc-62dzq"]
Jul 21 17:16:39.419957 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:16:39.419924    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod94fa3ceb_0fc6_47f7_8847_af61b41903e4.slice/crio-c279f6324c640dc31a03667bb6e8de70ebf767dd5b9a3601a57fead08484f60a WatchSource:0}: Error finding container c279f6324c640dc31a03667bb6e8de70ebf767dd5b9a3601a57fead08484f60a: Status 404 returned error can't find the container with id c279f6324c640dc31a03667bb6e8de70ebf767dd5b9a3601a57fead08484f60a
Jul 21 17:16:40.080886 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:16:40.080849    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-589694fdcc-62dzq" event={"ID":"94fa3ceb-0fc6-47f7-8847-af61b41903e4","Type":"ContainerStarted","Data":"c279f6324c640dc31a03667bb6e8de70ebf767dd5b9a3601a57fead08484f60a"}
Jul 21 17:16:43.094761 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:16:43.094724    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-589694fdcc-62dzq" event={"ID":"94fa3ceb-0fc6-47f7-8847-af61b41903e4","Type":"ContainerStarted","Data":"746f7dd5d3c1a6572100b051b657cda4d4f8fbaf196ef92d4e5bfbefba471b6c"}
Jul 21 17:16:43.113685 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:16:43.113626    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-589694fdcc-62dzq" podStartSLOduration=1.9585295870000001 podStartE2EDuration="5.11360822s" totalImagesPullingTime="3.155078633s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 17:16:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 17:16:43.112549417 +0000 UTC m=+495.566702058" watchObservedRunningTime="2026-07-21 17:16:43.11360822 +0000 UTC m=+495.567760861"
Jul 21 17:18:22.390297 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:18:22.390262    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-w4f7k"]
Jul 21 17:18:22.392448 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:18:22.392431    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-w4f7k"
Jul 21 17:18:22.395126 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:18:22.395100    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"plugin-serving-cert\""
Jul 21 17:18:22.395974 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:18:22.395954    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 21 17:18:22.396253 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:18:22.396232    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kuadrant-console-nginx-conf\""
Jul 21 17:18:22.396368 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:18:22.396235    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 21 17:18:22.396368 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:18:22.396322    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-w9h6f\""
Jul 21 17:18:22.403882 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:18:22.403857    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-w4f7k"]
Jul 21 17:18:22.546673 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:18:22.546634    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/b150820a-6d2d-4426-82f1-6d8def164e1b-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-w4f7k\" (UID: \"b150820a-6d2d-4426-82f1-6d8def164e1b\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-w4f7k"
Jul 21 17:18:22.546881 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:18:22.546683    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s94mf\" (UniqueName: \"kubernetes.io/projected/b150820a-6d2d-4426-82f1-6d8def164e1b-kube-api-access-s94mf\") pod \"kuadrant-console-plugin-66b5774985-w4f7k\" (UID: \"b150820a-6d2d-4426-82f1-6d8def164e1b\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-w4f7k"
Jul 21 17:18:22.546881 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:18:22.546719    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/b150820a-6d2d-4426-82f1-6d8def164e1b-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-w4f7k\" (UID: \"b150820a-6d2d-4426-82f1-6d8def164e1b\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-w4f7k"
Jul 21 17:18:22.648235 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:18:22.648125    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/b150820a-6d2d-4426-82f1-6d8def164e1b-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-w4f7k\" (UID: \"b150820a-6d2d-4426-82f1-6d8def164e1b\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-w4f7k"
Jul 21 17:18:22.648235 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:18:22.648197    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s94mf\" (UniqueName: \"kubernetes.io/projected/b150820a-6d2d-4426-82f1-6d8def164e1b-kube-api-access-s94mf\") pod \"kuadrant-console-plugin-66b5774985-w4f7k\" (UID: \"b150820a-6d2d-4426-82f1-6d8def164e1b\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-w4f7k"
Jul 21 17:18:22.648235 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:18:22.648227    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/b150820a-6d2d-4426-82f1-6d8def164e1b-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-w4f7k\" (UID: \"b150820a-6d2d-4426-82f1-6d8def164e1b\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-w4f7k"
Jul 21 17:18:22.648818 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:18:22.648796    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/b150820a-6d2d-4426-82f1-6d8def164e1b-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-w4f7k\" (UID: \"b150820a-6d2d-4426-82f1-6d8def164e1b\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-w4f7k"
Jul 21 17:18:22.650762 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:18:22.650736    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/b150820a-6d2d-4426-82f1-6d8def164e1b-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-w4f7k\" (UID: \"b150820a-6d2d-4426-82f1-6d8def164e1b\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-w4f7k"
Jul 21 17:18:22.657378 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:18:22.657356    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s94mf\" (UniqueName: \"kubernetes.io/projected/b150820a-6d2d-4426-82f1-6d8def164e1b-kube-api-access-s94mf\") pod \"kuadrant-console-plugin-66b5774985-w4f7k\" (UID: \"b150820a-6d2d-4426-82f1-6d8def164e1b\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-w4f7k"
Jul 21 17:18:22.711382 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:18:22.711341    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-w4f7k"
Jul 21 17:18:22.843791 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:18:22.843765    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-w4f7k"]
Jul 21 17:18:22.846340 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:18:22.846313    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb150820a_6d2d_4426_82f1_6d8def164e1b.slice/crio-ea5c62c1ad1640debdf99eaf04ada5eb8e81353379ee219c96f8d4fec8b889c6 WatchSource:0}: Error finding container ea5c62c1ad1640debdf99eaf04ada5eb8e81353379ee219c96f8d4fec8b889c6: Status 404 returned error can't find the container with id ea5c62c1ad1640debdf99eaf04ada5eb8e81353379ee219c96f8d4fec8b889c6
Jul 21 17:18:23.497145 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:18:23.497107    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-w4f7k" event={"ID":"b150820a-6d2d-4426-82f1-6d8def164e1b","Type":"ContainerStarted","Data":"ea5c62c1ad1640debdf99eaf04ada5eb8e81353379ee219c96f8d4fec8b889c6"}
Jul 21 17:18:28.391347 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:18:28.391315    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-b64gx_9425e519-d00c-4af6-a68a-3efde7aae5ba/ovn-acl-logging/0.log"
Jul 21 17:18:28.391846 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:18:28.391322    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-b64gx_9425e519-d00c-4af6-a68a-3efde7aae5ba/ovn-acl-logging/0.log"
Jul 21 17:18:33.034688 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:18:33.034640    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-ttqr2"]
Jul 21 17:18:33.049720 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:18:33.049692    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-ttqr2"
Jul 21 17:18:33.056047 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:18:33.056018    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-czqmv\""
Jul 21 17:18:33.058940 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:18:33.058914    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-ttqr2"]
Jul 21 17:18:33.143053 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:18:33.143015    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ph522\" (UniqueName: \"kubernetes.io/projected/33726560-1107-41fb-a974-9c568d1229f0-kube-api-access-ph522\") pod \"kuadrant-operator-controller-manager-86878c769f-ttqr2\" (UID: \"33726560-1107-41fb-a974-9c568d1229f0\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-ttqr2"
Jul 21 17:18:33.143247 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:18:33.143116    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/33726560-1107-41fb-a974-9c568d1229f0-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-ttqr2\" (UID: \"33726560-1107-41fb-a974-9c568d1229f0\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-ttqr2"
Jul 21 17:18:33.244566 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:18:33.244526    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/33726560-1107-41fb-a974-9c568d1229f0-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-ttqr2\" (UID: \"33726560-1107-41fb-a974-9c568d1229f0\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-ttqr2"
Jul 21 17:18:33.244770 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:18:33.244630    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ph522\" (UniqueName: \"kubernetes.io/projected/33726560-1107-41fb-a974-9c568d1229f0-kube-api-access-ph522\") pod \"kuadrant-operator-controller-manager-86878c769f-ttqr2\" (UID: \"33726560-1107-41fb-a974-9c568d1229f0\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-ttqr2"
Jul 21 17:18:33.244959 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:18:33.244930    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/33726560-1107-41fb-a974-9c568d1229f0-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-ttqr2\" (UID: \"33726560-1107-41fb-a974-9c568d1229f0\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-ttqr2"
Jul 21 17:18:33.259908 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:18:33.259876    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ph522\" (UniqueName: \"kubernetes.io/projected/33726560-1107-41fb-a974-9c568d1229f0-kube-api-access-ph522\") pod \"kuadrant-operator-controller-manager-86878c769f-ttqr2\" (UID: \"33726560-1107-41fb-a974-9c568d1229f0\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-ttqr2"
Jul 21 17:18:33.363944 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:18:33.363864    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-ttqr2"
Jul 21 17:18:46.046198 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:18:46.046174    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-ttqr2"]
Jul 21 17:18:46.049599 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:18:46.048039    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod33726560_1107_41fb_a974_9c568d1229f0.slice/crio-8618779d7f5b289b32655c928abd80ae14df44d298b5773f195fc36e81bba2bb WatchSource:0}: Error finding container 8618779d7f5b289b32655c928abd80ae14df44d298b5773f195fc36e81bba2bb: Status 404 returned error can't find the container with id 8618779d7f5b289b32655c928abd80ae14df44d298b5773f195fc36e81bba2bb
Jul 21 17:18:46.605330 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:18:46.605249    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-ttqr2" event={"ID":"33726560-1107-41fb-a974-9c568d1229f0","Type":"ContainerStarted","Data":"8618779d7f5b289b32655c928abd80ae14df44d298b5773f195fc36e81bba2bb"}
Jul 21 17:18:46.606543 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:18:46.606514    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-w4f7k" event={"ID":"b150820a-6d2d-4426-82f1-6d8def164e1b","Type":"ContainerStarted","Data":"6977c201af07af436761895c020fe2221274bc4c46503c3c7f8c039e2b0ba4d8"}
Jul 21 17:18:46.628753 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:18:46.628700    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-w4f7k" podStartSLOduration=1.150740944 podStartE2EDuration="24.628682663s" totalImagesPullingTime="23.477941719s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 17:18:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 17:18:46.626551779 +0000 UTC m=+619.080704416" watchObservedRunningTime="2026-07-21 17:18:46.628682663 +0000 UTC m=+619.082835302"
Jul 21 17:18:53.641777 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:18:53.641739    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-ttqr2" event={"ID":"33726560-1107-41fb-a974-9c568d1229f0","Type":"ContainerStarted","Data":"fb19d9f8194fe4c9337ff677a89231ae7b916d84093fcfc78c1cf10ceb3df531"}
Jul 21 17:18:53.642223 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:18:53.641861    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-ttqr2"
Jul 21 17:18:53.665237 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:18:53.665183    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-ttqr2" podStartSLOduration=13.634899041 podStartE2EDuration="20.66516699s" totalImagesPullingTime="7.030267949s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 17:18:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 17:18:53.663619205 +0000 UTC m=+626.117771856" watchObservedRunningTime="2026-07-21 17:18:53.66516699 +0000 UTC m=+626.119319630"
Jul 21 17:19:04.648227 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:19:04.648194    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-ttqr2"
Jul 21 17:19:27.619218 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:19:27.619187    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-75d556bd77-2wdr2"]
Jul 21 17:19:27.623910 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:19:27.623886    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-2wdr2"
Jul 21 17:19:27.626201 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:19:27.626177    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-hlwrs\""
Jul 21 17:19:27.629194 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:19:27.629167    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-2wdr2"]
Jul 21 17:19:27.744393 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:19:27.744353    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-727pw\" (UniqueName: \"kubernetes.io/projected/767de1cc-2e79-4272-83a7-ba9771442ab6-kube-api-access-727pw\") pod \"authorino-75d556bd77-2wdr2\" (UID: \"767de1cc-2e79-4272-83a7-ba9771442ab6\") " pod="kuadrant-system/authorino-75d556bd77-2wdr2"
Jul 21 17:19:27.845748 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:19:27.845706    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-727pw\" (UniqueName: \"kubernetes.io/projected/767de1cc-2e79-4272-83a7-ba9771442ab6-kube-api-access-727pw\") pod \"authorino-75d556bd77-2wdr2\" (UID: \"767de1cc-2e79-4272-83a7-ba9771442ab6\") " pod="kuadrant-system/authorino-75d556bd77-2wdr2"
Jul 21 17:19:27.855316 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:19:27.855292    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-727pw\" (UniqueName: \"kubernetes.io/projected/767de1cc-2e79-4272-83a7-ba9771442ab6-kube-api-access-727pw\") pod \"authorino-75d556bd77-2wdr2\" (UID: \"767de1cc-2e79-4272-83a7-ba9771442ab6\") " pod="kuadrant-system/authorino-75d556bd77-2wdr2"
Jul 21 17:19:27.937197 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:19:27.937126    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-hlwrs\""
Jul 21 17:19:27.945479 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:19:27.945457    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-2wdr2"
Jul 21 17:19:28.076480 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:19:28.076451    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-2wdr2"]
Jul 21 17:19:28.079542 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:19:28.079516    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod767de1cc_2e79_4272_83a7_ba9771442ab6.slice/crio-bb3deeba480ed988671cd5603761c2a7470b1ab5553bd44a4f910ac37e38a38c WatchSource:0}: Error finding container bb3deeba480ed988671cd5603761c2a7470b1ab5553bd44a4f910ac37e38a38c: Status 404 returned error can't find the container with id bb3deeba480ed988671cd5603761c2a7470b1ab5553bd44a4f910ac37e38a38c
Jul 21 17:19:28.797890 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:19:28.797852    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-2wdr2" event={"ID":"767de1cc-2e79-4272-83a7-ba9771442ab6","Type":"ContainerStarted","Data":"bb3deeba480ed988671cd5603761c2a7470b1ab5553bd44a4f910ac37e38a38c"}
Jul 21 17:19:31.813521 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:19:31.813485    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-2wdr2" event={"ID":"767de1cc-2e79-4272-83a7-ba9771442ab6","Type":"ContainerStarted","Data":"523a4b6e21078c3db6438d7f4b657304e80f6c2b099b4827ff9ae47b4e1ac217"}
Jul 21 17:19:31.831063 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:19:31.831012    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-75d556bd77-2wdr2" podStartSLOduration=1.9695811220000001 podStartE2EDuration="4.830995063s" totalImagesPullingTime="2.861413941s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 17:19:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 17:19:31.829480301 +0000 UTC m=+664.283632960" watchObservedRunningTime="2026-07-21 17:19:31.830995063 +0000 UTC m=+664.285147702"
Jul 21 17:20:02.806663 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:20:02.806615    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-2wdr2"]
Jul 21 17:20:02.807162 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:20:02.806799    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-75d556bd77-2wdr2" podUID="767de1cc-2e79-4272-83a7-ba9771442ab6" containerName="authorino" containerID="cri-o://523a4b6e21078c3db6438d7f4b657304e80f6c2b099b4827ff9ae47b4e1ac217" gracePeriod=30
Jul 21 17:20:02.955854 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:20:02.955816    2575 generic.go:356] "Generic (PLEG): container finished" podID="767de1cc-2e79-4272-83a7-ba9771442ab6" containerID="523a4b6e21078c3db6438d7f4b657304e80f6c2b099b4827ff9ae47b4e1ac217" exitCode=0
Jul 21 17:20:02.956014 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:20:02.955863    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-2wdr2" event={"ID":"767de1cc-2e79-4272-83a7-ba9771442ab6","Type":"ContainerDied","Data":"523a4b6e21078c3db6438d7f4b657304e80f6c2b099b4827ff9ae47b4e1ac217"}
Jul 21 17:20:03.055583 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:20:03.055554    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-2wdr2"
Jul 21 17:20:03.146784 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:20:03.146700    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-727pw\" (UniqueName: \"kubernetes.io/projected/767de1cc-2e79-4272-83a7-ba9771442ab6-kube-api-access-727pw\") pod \"767de1cc-2e79-4272-83a7-ba9771442ab6\" (UID: \"767de1cc-2e79-4272-83a7-ba9771442ab6\") "
Jul 21 17:20:03.149009 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:20:03.148984    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/767de1cc-2e79-4272-83a7-ba9771442ab6-kube-api-access-727pw" (OuterVolumeSpecName: "kube-api-access-727pw") pod "767de1cc-2e79-4272-83a7-ba9771442ab6" (UID: "767de1cc-2e79-4272-83a7-ba9771442ab6"). InnerVolumeSpecName "kube-api-access-727pw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 17:20:03.247502 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:20:03.247468    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-727pw\" (UniqueName: \"kubernetes.io/projected/767de1cc-2e79-4272-83a7-ba9771442ab6-kube-api-access-727pw\") on node \"ip-10-0-141-39.ec2.internal\" DevicePath \"\""
Jul 21 17:20:03.961173 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:20:03.961142    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-2wdr2"
Jul 21 17:20:03.961594 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:20:03.961135    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-2wdr2" event={"ID":"767de1cc-2e79-4272-83a7-ba9771442ab6","Type":"ContainerDied","Data":"bb3deeba480ed988671cd5603761c2a7470b1ab5553bd44a4f910ac37e38a38c"}
Jul 21 17:20:03.961594 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:20:03.961275    2575 scope.go:117] "RemoveContainer" containerID="523a4b6e21078c3db6438d7f4b657304e80f6c2b099b4827ff9ae47b4e1ac217"
Jul 21 17:20:03.986117 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:20:03.986089    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-2wdr2"]
Jul 21 17:20:03.989959 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:20:03.989934    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-75d556bd77-2wdr2"]
Jul 21 17:20:04.118093 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:20:04.118057    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="767de1cc-2e79-4272-83a7-ba9771442ab6" path="/var/lib/kubelet/pods/767de1cc-2e79-4272-83a7-ba9771442ab6/volumes"
Jul 21 17:20:07.426746 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:20:07.426707    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-5fd6c78779-dfhqs"]
Jul 21 17:20:07.427225 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:20:07.427156    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="767de1cc-2e79-4272-83a7-ba9771442ab6" containerName="authorino"
Jul 21 17:20:07.427225 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:20:07.427175    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="767de1cc-2e79-4272-83a7-ba9771442ab6" containerName="authorino"
Jul 21 17:20:07.427337 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:20:07.427256    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="767de1cc-2e79-4272-83a7-ba9771442ab6" containerName="authorino"
Jul 21 17:20:07.431168 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:20:07.431147    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5fd6c78779-dfhqs"
Jul 21 17:20:07.433800 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:20:07.433773    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Jul 21 17:20:07.433938 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:20:07.433776    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Jul 21 17:20:07.434904 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:20:07.434888    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-q72kd\""
Jul 21 17:20:07.441195 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:20:07.441166    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-5fd6c78779-dfhqs"]
Jul 21 17:20:07.483921 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:20:07.483889    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5gqqf\" (UniqueName: \"kubernetes.io/projected/4379a227-f5e6-44d6-b963-6e19ad6b81cf-kube-api-access-5gqqf\") pod \"maas-controller-5fd6c78779-dfhqs\" (UID: \"4379a227-f5e6-44d6-b963-6e19ad6b81cf\") " pod="opendatahub/maas-controller-5fd6c78779-dfhqs"
Jul 21 17:20:07.484105 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:20:07.483925    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/4379a227-f5e6-44d6-b963-6e19ad6b81cf-webhook-cert\") pod \"maas-controller-5fd6c78779-dfhqs\" (UID: \"4379a227-f5e6-44d6-b963-6e19ad6b81cf\") " pod="opendatahub/maas-controller-5fd6c78779-dfhqs"
Jul 21 17:20:07.584581 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:20:07.584547    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5gqqf\" (UniqueName: \"kubernetes.io/projected/4379a227-f5e6-44d6-b963-6e19ad6b81cf-kube-api-access-5gqqf\") pod \"maas-controller-5fd6c78779-dfhqs\" (UID: \"4379a227-f5e6-44d6-b963-6e19ad6b81cf\") " pod="opendatahub/maas-controller-5fd6c78779-dfhqs"
Jul 21 17:20:07.584581 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:20:07.584581    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/4379a227-f5e6-44d6-b963-6e19ad6b81cf-webhook-cert\") pod \"maas-controller-5fd6c78779-dfhqs\" (UID: \"4379a227-f5e6-44d6-b963-6e19ad6b81cf\") " pod="opendatahub/maas-controller-5fd6c78779-dfhqs"
Jul 21 17:20:07.587240 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:20:07.587209    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/4379a227-f5e6-44d6-b963-6e19ad6b81cf-webhook-cert\") pod \"maas-controller-5fd6c78779-dfhqs\" (UID: \"4379a227-f5e6-44d6-b963-6e19ad6b81cf\") " pod="opendatahub/maas-controller-5fd6c78779-dfhqs"
Jul 21 17:20:07.592950 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:20:07.592903    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5gqqf\" (UniqueName: \"kubernetes.io/projected/4379a227-f5e6-44d6-b963-6e19ad6b81cf-kube-api-access-5gqqf\") pod \"maas-controller-5fd6c78779-dfhqs\" (UID: \"4379a227-f5e6-44d6-b963-6e19ad6b81cf\") " pod="opendatahub/maas-controller-5fd6c78779-dfhqs"
Jul 21 17:20:07.599502 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:20:07.599480    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-64ff86b949-cvdnt"]
Jul 21 17:20:07.601947 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:20:07.601930    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-64ff86b949-cvdnt"
Jul 21 17:20:07.615898 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:20:07.615873    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-64ff86b949-cvdnt"]
Jul 21 17:20:07.685713 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:20:07.685629    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/927a948f-dcb4-4121-97ad-bc7a8791f4e7-webhook-cert\") pod \"maas-controller-64ff86b949-cvdnt\" (UID: \"927a948f-dcb4-4121-97ad-bc7a8791f4e7\") " pod="opendatahub/maas-controller-64ff86b949-cvdnt"
Jul 21 17:20:07.685856 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:20:07.685731    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8dsfg\" (UniqueName: \"kubernetes.io/projected/927a948f-dcb4-4121-97ad-bc7a8791f4e7-kube-api-access-8dsfg\") pod \"maas-controller-64ff86b949-cvdnt\" (UID: \"927a948f-dcb4-4121-97ad-bc7a8791f4e7\") " pod="opendatahub/maas-controller-64ff86b949-cvdnt"
Jul 21 17:20:07.742572 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:20:07.742536    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5fd6c78779-dfhqs"
Jul 21 17:20:07.786131 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:20:07.786100    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/927a948f-dcb4-4121-97ad-bc7a8791f4e7-webhook-cert\") pod \"maas-controller-64ff86b949-cvdnt\" (UID: \"927a948f-dcb4-4121-97ad-bc7a8791f4e7\") " pod="opendatahub/maas-controller-64ff86b949-cvdnt"
Jul 21 17:20:07.786333 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:20:07.786169    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8dsfg\" (UniqueName: \"kubernetes.io/projected/927a948f-dcb4-4121-97ad-bc7a8791f4e7-kube-api-access-8dsfg\") pod \"maas-controller-64ff86b949-cvdnt\" (UID: \"927a948f-dcb4-4121-97ad-bc7a8791f4e7\") " pod="opendatahub/maas-controller-64ff86b949-cvdnt"
Jul 21 17:20:07.789176 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:20:07.789143    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/927a948f-dcb4-4121-97ad-bc7a8791f4e7-webhook-cert\") pod \"maas-controller-64ff86b949-cvdnt\" (UID: \"927a948f-dcb4-4121-97ad-bc7a8791f4e7\") " pod="opendatahub/maas-controller-64ff86b949-cvdnt"
Jul 21 17:20:07.795573 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:20:07.795541    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8dsfg\" (UniqueName: \"kubernetes.io/projected/927a948f-dcb4-4121-97ad-bc7a8791f4e7-kube-api-access-8dsfg\") pod \"maas-controller-64ff86b949-cvdnt\" (UID: \"927a948f-dcb4-4121-97ad-bc7a8791f4e7\") " pod="opendatahub/maas-controller-64ff86b949-cvdnt"
Jul 21 17:20:07.873670 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:20:07.873647    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-5fd6c78779-dfhqs"]
Jul 21 17:20:07.875478 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:20:07.875453    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4379a227_f5e6_44d6_b963_6e19ad6b81cf.slice/crio-454d28a5eb5e68aa33d4779e9ec387d0af4f72eff50d97ea33997c307d10f01d WatchSource:0}: Error finding container 454d28a5eb5e68aa33d4779e9ec387d0af4f72eff50d97ea33997c307d10f01d: Status 404 returned error can't find the container with id 454d28a5eb5e68aa33d4779e9ec387d0af4f72eff50d97ea33997c307d10f01d
Jul 21 17:20:07.915840 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:20:07.915806    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-64ff86b949-cvdnt"
Jul 21 17:20:07.980730 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:20:07.980701    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5fd6c78779-dfhqs" event={"ID":"4379a227-f5e6-44d6-b963-6e19ad6b81cf","Type":"ContainerStarted","Data":"454d28a5eb5e68aa33d4779e9ec387d0af4f72eff50d97ea33997c307d10f01d"}
Jul 21 17:20:08.049517 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:20:08.049494    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-64ff86b949-cvdnt"]
Jul 21 17:20:08.051455 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:20:08.051426    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod927a948f_dcb4_4121_97ad_bc7a8791f4e7.slice/crio-73a36cd273e7f6c362d42f0b41db118ebfc7a68f837407225c08c6b9db70d66e WatchSource:0}: Error finding container 73a36cd273e7f6c362d42f0b41db118ebfc7a68f837407225c08c6b9db70d66e: Status 404 returned error can't find the container with id 73a36cd273e7f6c362d42f0b41db118ebfc7a68f837407225c08c6b9db70d66e
Jul 21 17:20:08.990466 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:20:08.990406    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-64ff86b949-cvdnt" event={"ID":"927a948f-dcb4-4121-97ad-bc7a8791f4e7","Type":"ContainerStarted","Data":"73a36cd273e7f6c362d42f0b41db118ebfc7a68f837407225c08c6b9db70d66e"}
Jul 21 17:20:11.001439 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:20:11.001368    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5fd6c78779-dfhqs" event={"ID":"4379a227-f5e6-44d6-b963-6e19ad6b81cf","Type":"ContainerStarted","Data":"7cc981883041a407580dbfa1c0e9c60c636cf506f07fa68b712ec6b257794611"}
Jul 21 17:20:11.001885 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:20:11.001544    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-5fd6c78779-dfhqs"
Jul 21 17:20:11.003060 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:20:11.003033    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-64ff86b949-cvdnt" event={"ID":"927a948f-dcb4-4121-97ad-bc7a8791f4e7","Type":"ContainerStarted","Data":"8852ba78c3dc6e09519ff29e4169c0d5fd74ad40ca5575aa600bcf7acc8d6cc2"}
Jul 21 17:20:11.003191 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:20:11.003173    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-64ff86b949-cvdnt"
Jul 21 17:20:11.049196 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:20:11.049122    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-5fd6c78779-dfhqs" podStartSLOduration=1.192460235 podStartE2EDuration="4.049103813s" totalImagesPullingTime="2.856643578s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 17:20:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 17:20:11.047906238 +0000 UTC m=+703.502058873" watchObservedRunningTime="2026-07-21 17:20:11.049103813 +0000 UTC m=+703.503256453"
Jul 21 17:20:11.094766 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:20:11.094717    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-64ff86b949-cvdnt" podStartSLOduration=1.404637447 podStartE2EDuration="4.094698465s" totalImagesPullingTime="2.690061018s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 17:20:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 17:20:11.094065392 +0000 UTC m=+703.548218033" watchObservedRunningTime="2026-07-21 17:20:11.094698465 +0000 UTC m=+703.548851104"
Jul 21 17:20:22.010523 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:20:22.010442    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-64ff86b949-cvdnt"
Jul 21 17:20:22.010523 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:20:22.010520    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-5fd6c78779-dfhqs"
Jul 21 17:20:22.076195 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:20:22.076166    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-5fd6c78779-dfhqs"]
Jul 21 17:20:22.076380 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:20:22.076354    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-5fd6c78779-dfhqs" podUID="4379a227-f5e6-44d6-b963-6e19ad6b81cf" containerName="manager" containerID="cri-o://7cc981883041a407580dbfa1c0e9c60c636cf506f07fa68b712ec6b257794611" gracePeriod=30
Jul 21 17:20:22.320407 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:20:22.320381    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5fd6c78779-dfhqs"
Jul 21 17:20:22.424663 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:20:22.424628    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5gqqf\" (UniqueName: \"kubernetes.io/projected/4379a227-f5e6-44d6-b963-6e19ad6b81cf-kube-api-access-5gqqf\") pod \"4379a227-f5e6-44d6-b963-6e19ad6b81cf\" (UID: \"4379a227-f5e6-44d6-b963-6e19ad6b81cf\") "
Jul 21 17:20:22.424824 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:20:22.424698    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/4379a227-f5e6-44d6-b963-6e19ad6b81cf-webhook-cert\") pod \"4379a227-f5e6-44d6-b963-6e19ad6b81cf\" (UID: \"4379a227-f5e6-44d6-b963-6e19ad6b81cf\") "
Jul 21 17:20:22.426950 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:20:22.426918    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4379a227-f5e6-44d6-b963-6e19ad6b81cf-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "4379a227-f5e6-44d6-b963-6e19ad6b81cf" (UID: "4379a227-f5e6-44d6-b963-6e19ad6b81cf"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 21 17:20:22.426950 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:20:22.426935    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4379a227-f5e6-44d6-b963-6e19ad6b81cf-kube-api-access-5gqqf" (OuterVolumeSpecName: "kube-api-access-5gqqf") pod "4379a227-f5e6-44d6-b963-6e19ad6b81cf" (UID: "4379a227-f5e6-44d6-b963-6e19ad6b81cf"). InnerVolumeSpecName "kube-api-access-5gqqf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 17:20:22.526015 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:20:22.525976    2575 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/4379a227-f5e6-44d6-b963-6e19ad6b81cf-webhook-cert\") on node \"ip-10-0-141-39.ec2.internal\" DevicePath \"\""
Jul 21 17:20:22.526015 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:20:22.526006    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5gqqf\" (UniqueName: \"kubernetes.io/projected/4379a227-f5e6-44d6-b963-6e19ad6b81cf-kube-api-access-5gqqf\") on node \"ip-10-0-141-39.ec2.internal\" DevicePath \"\""
Jul 21 17:20:23.059829 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:20:23.059795    2575 generic.go:356] "Generic (PLEG): container finished" podID="4379a227-f5e6-44d6-b963-6e19ad6b81cf" containerID="7cc981883041a407580dbfa1c0e9c60c636cf506f07fa68b712ec6b257794611" exitCode=0
Jul 21 17:20:23.060244 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:20:23.059839    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5fd6c78779-dfhqs"
Jul 21 17:20:23.060244 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:20:23.059880    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5fd6c78779-dfhqs" event={"ID":"4379a227-f5e6-44d6-b963-6e19ad6b81cf","Type":"ContainerDied","Data":"7cc981883041a407580dbfa1c0e9c60c636cf506f07fa68b712ec6b257794611"}
Jul 21 17:20:23.060244 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:20:23.059931    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5fd6c78779-dfhqs" event={"ID":"4379a227-f5e6-44d6-b963-6e19ad6b81cf","Type":"ContainerDied","Data":"454d28a5eb5e68aa33d4779e9ec387d0af4f72eff50d97ea33997c307d10f01d"}
Jul 21 17:20:23.060244 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:20:23.059952    2575 scope.go:117] "RemoveContainer" containerID="7cc981883041a407580dbfa1c0e9c60c636cf506f07fa68b712ec6b257794611"
Jul 21 17:20:23.068710 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:20:23.068688    2575 scope.go:117] "RemoveContainer" containerID="7cc981883041a407580dbfa1c0e9c60c636cf506f07fa68b712ec6b257794611"
Jul 21 17:20:23.069022 ip-10-0-141-39 kubenswrapper[2575]: E0721 17:20:23.069004    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7cc981883041a407580dbfa1c0e9c60c636cf506f07fa68b712ec6b257794611\": container with ID starting with 7cc981883041a407580dbfa1c0e9c60c636cf506f07fa68b712ec6b257794611 not found: ID does not exist" containerID="7cc981883041a407580dbfa1c0e9c60c636cf506f07fa68b712ec6b257794611"
Jul 21 17:20:23.069085 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:20:23.069032    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7cc981883041a407580dbfa1c0e9c60c636cf506f07fa68b712ec6b257794611"} err="failed to get container status \"7cc981883041a407580dbfa1c0e9c60c636cf506f07fa68b712ec6b257794611\": rpc error: code = NotFound desc = could not find container \"7cc981883041a407580dbfa1c0e9c60c636cf506f07fa68b712ec6b257794611\": container with ID starting with 7cc981883041a407580dbfa1c0e9c60c636cf506f07fa68b712ec6b257794611 not found: ID does not exist"
Jul 21 17:20:23.081405 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:20:23.081382    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-5fd6c78779-dfhqs"]
Jul 21 17:20:23.085209 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:20:23.085189    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-5fd6c78779-dfhqs"]
Jul 21 17:20:24.115979 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:20:24.115945    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4379a227-f5e6-44d6-b963-6e19ad6b81cf" path="/var/lib/kubelet/pods/4379a227-f5e6-44d6-b963-6e19ad6b81cf/volumes"
Jul 21 17:20:45.985555 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:20:45.985517    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-86767987f9-52rc8"]
Jul 21 17:20:45.986032 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:20:45.985864    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4379a227-f5e6-44d6-b963-6e19ad6b81cf" containerName="manager"
Jul 21 17:20:45.986032 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:20:45.985876    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="4379a227-f5e6-44d6-b963-6e19ad6b81cf" containerName="manager"
Jul 21 17:20:45.986032 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:20:45.985933    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="4379a227-f5e6-44d6-b963-6e19ad6b81cf" containerName="manager"
Jul 21 17:20:45.990673 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:20:45.990651    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-86767987f9-52rc8"
Jul 21 17:20:45.993575 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:20:45.993548    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-hmc6q\""
Jul 21 17:20:45.993575 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:20:45.993566    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-serving-cert\""
Jul 21 17:20:45.993767 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:20:45.993561    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 21 17:20:45.994526 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:20:45.994506    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 21 17:20:45.998580 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:20:45.998224    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-86767987f9-52rc8"]
Jul 21 17:20:46.030698 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:20:46.030665    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9c75a363-e217-4a69-bd09-aaa6e68d9080-maas-api-tls\") pod \"maas-api-86767987f9-52rc8\" (UID: \"9c75a363-e217-4a69-bd09-aaa6e68d9080\") " pod="odh-ai-gateway-infra/maas-api-86767987f9-52rc8"
Jul 21 17:20:46.030875 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:20:46.030718    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rx5t5\" (UniqueName: \"kubernetes.io/projected/9c75a363-e217-4a69-bd09-aaa6e68d9080-kube-api-access-rx5t5\") pod \"maas-api-86767987f9-52rc8\" (UID: \"9c75a363-e217-4a69-bd09-aaa6e68d9080\") " pod="odh-ai-gateway-infra/maas-api-86767987f9-52rc8"
Jul 21 17:20:46.030875 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:20:46.030771    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9c75a363-e217-4a69-bd09-aaa6e68d9080-openshift-service-ca\") pod \"maas-api-86767987f9-52rc8\" (UID: \"9c75a363-e217-4a69-bd09-aaa6e68d9080\") " pod="odh-ai-gateway-infra/maas-api-86767987f9-52rc8"
Jul 21 17:20:46.132024 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:20:46.131997    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9c75a363-e217-4a69-bd09-aaa6e68d9080-openshift-service-ca\") pod \"maas-api-86767987f9-52rc8\" (UID: \"9c75a363-e217-4a69-bd09-aaa6e68d9080\") " pod="odh-ai-gateway-infra/maas-api-86767987f9-52rc8"
Jul 21 17:20:46.132191 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:20:46.132031    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9c75a363-e217-4a69-bd09-aaa6e68d9080-maas-api-tls\") pod \"maas-api-86767987f9-52rc8\" (UID: \"9c75a363-e217-4a69-bd09-aaa6e68d9080\") " pod="odh-ai-gateway-infra/maas-api-86767987f9-52rc8"
Jul 21 17:20:46.132191 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:20:46.132081    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rx5t5\" (UniqueName: \"kubernetes.io/projected/9c75a363-e217-4a69-bd09-aaa6e68d9080-kube-api-access-rx5t5\") pod \"maas-api-86767987f9-52rc8\" (UID: \"9c75a363-e217-4a69-bd09-aaa6e68d9080\") " pod="odh-ai-gateway-infra/maas-api-86767987f9-52rc8"
Jul 21 17:20:46.132733 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:20:46.132712    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9c75a363-e217-4a69-bd09-aaa6e68d9080-openshift-service-ca\") pod \"maas-api-86767987f9-52rc8\" (UID: \"9c75a363-e217-4a69-bd09-aaa6e68d9080\") " pod="odh-ai-gateway-infra/maas-api-86767987f9-52rc8"
Jul 21 17:20:46.134470 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:20:46.134456    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9c75a363-e217-4a69-bd09-aaa6e68d9080-maas-api-tls\") pod \"maas-api-86767987f9-52rc8\" (UID: \"9c75a363-e217-4a69-bd09-aaa6e68d9080\") " pod="odh-ai-gateway-infra/maas-api-86767987f9-52rc8"
Jul 21 17:20:46.140322 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:20:46.140300    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rx5t5\" (UniqueName: \"kubernetes.io/projected/9c75a363-e217-4a69-bd09-aaa6e68d9080-kube-api-access-rx5t5\") pod \"maas-api-86767987f9-52rc8\" (UID: \"9c75a363-e217-4a69-bd09-aaa6e68d9080\") " pod="odh-ai-gateway-infra/maas-api-86767987f9-52rc8"
Jul 21 17:20:46.302921 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:20:46.302888    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-86767987f9-52rc8"
Jul 21 17:20:46.449793 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:20:46.449767    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-86767987f9-52rc8"]
Jul 21 17:20:46.452431 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:20:46.452385    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9c75a363_e217_4a69_bd09_aaa6e68d9080.slice/crio-0ff66fabeda9036cfc58a32264afd74c3f3cc1c7ffcef098b632ac1e0a27ce4d WatchSource:0}: Error finding container 0ff66fabeda9036cfc58a32264afd74c3f3cc1c7ffcef098b632ac1e0a27ce4d: Status 404 returned error can't find the container with id 0ff66fabeda9036cfc58a32264afd74c3f3cc1c7ffcef098b632ac1e0a27ce4d
Jul 21 17:20:46.627399 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:20:46.627322    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-7677b774bb-shdmw"]
Jul 21 17:20:46.630428 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:20:46.630397    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-7677b774bb-shdmw"
Jul 21 17:20:46.632883 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:20:46.632866    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\""
Jul 21 17:20:46.632985 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:20:46.632920    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-8lcfh\""
Jul 21 17:20:46.634998 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:20:46.634976    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4ba7de0b-5e3f-4462-babf-3b40fce63243-plugins-config-volume\") pod \"payload-pre-processing-7677b774bb-shdmw\" (UID: \"4ba7de0b-5e3f-4462-babf-3b40fce63243\") " pod="openshift-ingress/payload-pre-processing-7677b774bb-shdmw"
Jul 21 17:20:46.635085 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:20:46.635066    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cgvqx\" (UniqueName: \"kubernetes.io/projected/4ba7de0b-5e3f-4462-babf-3b40fce63243-kube-api-access-cgvqx\") pod \"payload-pre-processing-7677b774bb-shdmw\" (UID: \"4ba7de0b-5e3f-4462-babf-3b40fce63243\") " pod="openshift-ingress/payload-pre-processing-7677b774bb-shdmw"
Jul 21 17:20:46.639060 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:20:46.639008    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-7677b774bb-shdmw"]
Jul 21 17:20:46.735728 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:20:46.735697    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cgvqx\" (UniqueName: \"kubernetes.io/projected/4ba7de0b-5e3f-4462-babf-3b40fce63243-kube-api-access-cgvqx\") pod \"payload-pre-processing-7677b774bb-shdmw\" (UID: \"4ba7de0b-5e3f-4462-babf-3b40fce63243\") " pod="openshift-ingress/payload-pre-processing-7677b774bb-shdmw"
Jul 21 17:20:46.735888 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:20:46.735744    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4ba7de0b-5e3f-4462-babf-3b40fce63243-plugins-config-volume\") pod \"payload-pre-processing-7677b774bb-shdmw\" (UID: \"4ba7de0b-5e3f-4462-babf-3b40fce63243\") " pod="openshift-ingress/payload-pre-processing-7677b774bb-shdmw"
Jul 21 17:20:46.736433 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:20:46.736397    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4ba7de0b-5e3f-4462-babf-3b40fce63243-plugins-config-volume\") pod \"payload-pre-processing-7677b774bb-shdmw\" (UID: \"4ba7de0b-5e3f-4462-babf-3b40fce63243\") " pod="openshift-ingress/payload-pre-processing-7677b774bb-shdmw"
Jul 21 17:20:46.744831 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:20:46.744809    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cgvqx\" (UniqueName: \"kubernetes.io/projected/4ba7de0b-5e3f-4462-babf-3b40fce63243-kube-api-access-cgvqx\") pod \"payload-pre-processing-7677b774bb-shdmw\" (UID: \"4ba7de0b-5e3f-4462-babf-3b40fce63243\") " pod="openshift-ingress/payload-pre-processing-7677b774bb-shdmw"
Jul 21 17:20:46.941406 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:20:46.941329    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-7677b774bb-shdmw"
Jul 21 17:20:47.122544 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:20:47.122514    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-7677b774bb-shdmw"]
Jul 21 17:20:47.126404 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:20:47.126372    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4ba7de0b_5e3f_4462_babf_3b40fce63243.slice/crio-a7c0f75e6d81a36b9ec7223c10b08b48260c2be0a852637e39622e9ea27dfdf4 WatchSource:0}: Error finding container a7c0f75e6d81a36b9ec7223c10b08b48260c2be0a852637e39622e9ea27dfdf4: Status 404 returned error can't find the container with id a7c0f75e6d81a36b9ec7223c10b08b48260c2be0a852637e39622e9ea27dfdf4
Jul 21 17:20:47.158685 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:20:47.158652    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-7677b774bb-shdmw" event={"ID":"4ba7de0b-5e3f-4462-babf-3b40fce63243","Type":"ContainerStarted","Data":"a7c0f75e6d81a36b9ec7223c10b08b48260c2be0a852637e39622e9ea27dfdf4"}
Jul 21 17:20:47.159827 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:20:47.159804    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-86767987f9-52rc8" event={"ID":"9c75a363-e217-4a69-bd09-aaa6e68d9080","Type":"ContainerStarted","Data":"0ff66fabeda9036cfc58a32264afd74c3f3cc1c7ffcef098b632ac1e0a27ce4d"}
Jul 21 17:20:50.176506 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:20:50.176468    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-7677b774bb-shdmw" event={"ID":"4ba7de0b-5e3f-4462-babf-3b40fce63243","Type":"ContainerStarted","Data":"796565d60b56c1db423d2a1c9b3eda81e2c14ae80ec1748fd76fd782f5c8f0e9"}
Jul 21 17:20:50.176937 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:20:50.176585    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-7677b774bb-shdmw"
Jul 21 17:20:50.178003 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:20:50.177979    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-86767987f9-52rc8" event={"ID":"9c75a363-e217-4a69-bd09-aaa6e68d9080","Type":"ContainerStarted","Data":"47beb12774c494b1c4e194adbba774fbf46551d5cd8808f5d90cf2936c89e279"}
Jul 21 17:20:50.178128 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:20:50.178045    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-86767987f9-52rc8"
Jul 21 17:20:50.193616 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:20:50.193566    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-7677b774bb-shdmw" podStartSLOduration=2.029001361 podStartE2EDuration="4.193549437s" totalImagesPullingTime="2.164548076s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 17:20:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 17:20:50.192609697 +0000 UTC m=+742.646762337" watchObservedRunningTime="2026-07-21 17:20:50.193549437 +0000 UTC m=+742.647702080"
Jul 21 17:20:50.211739 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:20:50.211691    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-86767987f9-52rc8" podStartSLOduration=2.414035297 podStartE2EDuration="5.211675845s" totalImagesPullingTime="2.797640548s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 17:20:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 17:20:50.209816644 +0000 UTC m=+742.663969287" watchObservedRunningTime="2026-07-21 17:20:50.211675845 +0000 UTC m=+742.665828484"
Jul 21 17:20:56.188193 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:20:56.188166    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-86767987f9-52rc8"
Jul 21 17:21:01.184752 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:21:01.184724    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-7677b774bb-shdmw"
Jul 21 17:21:02.926065 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:21:02.926026    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-44zt9"]
Jul 21 17:21:02.928636 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:21:02.928613    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-44zt9"
Jul 21 17:21:02.932464 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:21:02.932442    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Jul 21 17:21:02.933121 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:21:02.933098    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\""
Jul 21 17:21:02.933238 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:21:02.933144    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Jul 21 17:21:02.933238 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:21:02.933167    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-78xwk\""
Jul 21 17:21:02.950011 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:21:02.949988    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-44zt9"]
Jul 21 17:21:02.986206 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:21:02.986173    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bc5082c4-f9c6-4f27-9d40-1992ae9aeb00-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-44zt9\" (UID: \"bc5082c4-f9c6-4f27-9d40-1992ae9aeb00\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-44zt9"
Jul 21 17:21:02.986206 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:21:02.986206    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bc5082c4-f9c6-4f27-9d40-1992ae9aeb00-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-44zt9\" (UID: \"bc5082c4-f9c6-4f27-9d40-1992ae9aeb00\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-44zt9"
Jul 21 17:21:02.986396 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:21:02.986235    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bc5082c4-f9c6-4f27-9d40-1992ae9aeb00-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-44zt9\" (UID: \"bc5082c4-f9c6-4f27-9d40-1992ae9aeb00\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-44zt9"
Jul 21 17:21:02.986396 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:21:02.986255    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bc5082c4-f9c6-4f27-9d40-1992ae9aeb00-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-44zt9\" (UID: \"bc5082c4-f9c6-4f27-9d40-1992ae9aeb00\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-44zt9"
Jul 21 17:21:02.986396 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:21:02.986306    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bc5082c4-f9c6-4f27-9d40-1992ae9aeb00-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-44zt9\" (UID: \"bc5082c4-f9c6-4f27-9d40-1992ae9aeb00\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-44zt9"
Jul 21 17:21:02.986396 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:21:02.986344    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sc98s\" (UniqueName: \"kubernetes.io/projected/bc5082c4-f9c6-4f27-9d40-1992ae9aeb00-kube-api-access-sc98s\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-44zt9\" (UID: \"bc5082c4-f9c6-4f27-9d40-1992ae9aeb00\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-44zt9"
Jul 21 17:21:03.087525 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:21:03.087494    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bc5082c4-f9c6-4f27-9d40-1992ae9aeb00-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-44zt9\" (UID: \"bc5082c4-f9c6-4f27-9d40-1992ae9aeb00\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-44zt9"
Jul 21 17:21:03.087525 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:21:03.087530    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bc5082c4-f9c6-4f27-9d40-1992ae9aeb00-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-44zt9\" (UID: \"bc5082c4-f9c6-4f27-9d40-1992ae9aeb00\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-44zt9"
Jul 21 17:21:03.087729 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:21:03.087554    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bc5082c4-f9c6-4f27-9d40-1992ae9aeb00-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-44zt9\" (UID: \"bc5082c4-f9c6-4f27-9d40-1992ae9aeb00\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-44zt9"
Jul 21 17:21:03.087729 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:21:03.087591    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sc98s\" (UniqueName: \"kubernetes.io/projected/bc5082c4-f9c6-4f27-9d40-1992ae9aeb00-kube-api-access-sc98s\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-44zt9\" (UID: \"bc5082c4-f9c6-4f27-9d40-1992ae9aeb00\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-44zt9"
Jul 21 17:21:03.087729 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:21:03.087678    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bc5082c4-f9c6-4f27-9d40-1992ae9aeb00-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-44zt9\" (UID: \"bc5082c4-f9c6-4f27-9d40-1992ae9aeb00\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-44zt9"
Jul 21 17:21:03.087729 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:21:03.087706    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bc5082c4-f9c6-4f27-9d40-1992ae9aeb00-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-44zt9\" (UID: \"bc5082c4-f9c6-4f27-9d40-1992ae9aeb00\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-44zt9"
Jul 21 17:21:03.087957 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:21:03.087936    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bc5082c4-f9c6-4f27-9d40-1992ae9aeb00-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-44zt9\" (UID: \"bc5082c4-f9c6-4f27-9d40-1992ae9aeb00\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-44zt9"
Jul 21 17:21:03.088030 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:21:03.087969    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bc5082c4-f9c6-4f27-9d40-1992ae9aeb00-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-44zt9\" (UID: \"bc5082c4-f9c6-4f27-9d40-1992ae9aeb00\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-44zt9"
Jul 21 17:21:03.088030 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:21:03.088017    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bc5082c4-f9c6-4f27-9d40-1992ae9aeb00-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-44zt9\" (UID: \"bc5082c4-f9c6-4f27-9d40-1992ae9aeb00\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-44zt9"
Jul 21 17:21:03.090227 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:21:03.090205    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bc5082c4-f9c6-4f27-9d40-1992ae9aeb00-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-44zt9\" (UID: \"bc5082c4-f9c6-4f27-9d40-1992ae9aeb00\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-44zt9"
Jul 21 17:21:03.090400 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:21:03.090384    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bc5082c4-f9c6-4f27-9d40-1992ae9aeb00-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-44zt9\" (UID: \"bc5082c4-f9c6-4f27-9d40-1992ae9aeb00\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-44zt9"
Jul 21 17:21:03.097037 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:21:03.097016    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sc98s\" (UniqueName: \"kubernetes.io/projected/bc5082c4-f9c6-4f27-9d40-1992ae9aeb00-kube-api-access-sc98s\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-44zt9\" (UID: \"bc5082c4-f9c6-4f27-9d40-1992ae9aeb00\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-44zt9"
Jul 21 17:21:03.239483 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:21:03.239460    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-44zt9"
Jul 21 17:21:03.377073 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:21:03.377038    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-44zt9"]
Jul 21 17:21:03.380127 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:21:03.380093    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbc5082c4_f9c6_4f27_9d40_1992ae9aeb00.slice/crio-3b7fc0f8a28e19241b0d3719f8ea77e5db60be679557905e7f19893b4f6e370a WatchSource:0}: Error finding container 3b7fc0f8a28e19241b0d3719f8ea77e5db60be679557905e7f19893b4f6e370a: Status 404 returned error can't find the container with id 3b7fc0f8a28e19241b0d3719f8ea77e5db60be679557905e7f19893b4f6e370a
Jul 21 17:21:04.240720 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:21:04.240682    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-44zt9" event={"ID":"bc5082c4-f9c6-4f27-9d40-1992ae9aeb00","Type":"ContainerStarted","Data":"3b7fc0f8a28e19241b0d3719f8ea77e5db60be679557905e7f19893b4f6e370a"}
Jul 21 17:21:05.247801 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:21:05.247765    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-44zt9" event={"ID":"bc5082c4-f9c6-4f27-9d40-1992ae9aeb00","Type":"ContainerStarted","Data":"d306ac7a196836d53d558acbc8aab1dfb1fb5835ecdb52bcb721c67b1fcf7078"}
Jul 21 17:21:05.268730 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:21:05.268654    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-44zt9" podStartSLOduration=2.032237334 podStartE2EDuration="3.268633205s" totalImagesPullingTime="1.236395871s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 17:21:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 17:21:05.266356109 +0000 UTC m=+757.720508750" watchObservedRunningTime="2026-07-21 17:21:05.268633205 +0000 UTC m=+757.722785862"
Jul 21 17:21:13.239644 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:21:13.239593    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-44zt9"
Jul 21 17:21:13.240067 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:21:13.239688    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-44zt9"
Jul 21 17:21:13.252114 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:21:13.252092    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-44zt9"
Jul 21 17:21:13.294293 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:21:13.294262    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-44zt9"
Jul 21 17:21:17.712232 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:21:17.712202    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-6vj7t"]
Jul 21 17:21:17.715992 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:21:17.715977    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-6vj7t"
Jul 21 17:21:17.718606 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:21:17.718586    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\""
Jul 21 17:21:17.727405 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:21:17.727377    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-6vj7t"]
Jul 21 17:21:17.824222 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:21:17.824187    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fb1096e4-f860-44e6-be7e-d90cbd760e04-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-6vj7t\" (UID: \"fb1096e4-f860-44e6-be7e-d90cbd760e04\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-6vj7t"
Jul 21 17:21:17.824409 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:21:17.824244    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fb1096e4-f860-44e6-be7e-d90cbd760e04-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-6vj7t\" (UID: \"fb1096e4-f860-44e6-be7e-d90cbd760e04\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-6vj7t"
Jul 21 17:21:17.824409 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:21:17.824303    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fb1096e4-f860-44e6-be7e-d90cbd760e04-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-6vj7t\" (UID: \"fb1096e4-f860-44e6-be7e-d90cbd760e04\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-6vj7t"
Jul 21 17:21:17.824409 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:21:17.824342    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kj7vk\" (UniqueName: \"kubernetes.io/projected/fb1096e4-f860-44e6-be7e-d90cbd760e04-kube-api-access-kj7vk\") pod \"e2e-trlp-test-simulated-kserve-598466548d-6vj7t\" (UID: \"fb1096e4-f860-44e6-be7e-d90cbd760e04\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-6vj7t"
Jul 21 17:21:17.824409 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:21:17.824374    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fb1096e4-f860-44e6-be7e-d90cbd760e04-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-6vj7t\" (UID: \"fb1096e4-f860-44e6-be7e-d90cbd760e04\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-6vj7t"
Jul 21 17:21:17.824409 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:21:17.824392    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fb1096e4-f860-44e6-be7e-d90cbd760e04-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-6vj7t\" (UID: \"fb1096e4-f860-44e6-be7e-d90cbd760e04\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-6vj7t"
Jul 21 17:21:17.925768 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:21:17.925734    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fb1096e4-f860-44e6-be7e-d90cbd760e04-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-6vj7t\" (UID: \"fb1096e4-f860-44e6-be7e-d90cbd760e04\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-6vj7t"
Jul 21 17:21:17.925768 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:21:17.925769    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fb1096e4-f860-44e6-be7e-d90cbd760e04-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-6vj7t\" (UID: \"fb1096e4-f860-44e6-be7e-d90cbd760e04\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-6vj7t"
Jul 21 17:21:17.926010 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:21:17.925792    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kj7vk\" (UniqueName: \"kubernetes.io/projected/fb1096e4-f860-44e6-be7e-d90cbd760e04-kube-api-access-kj7vk\") pod \"e2e-trlp-test-simulated-kserve-598466548d-6vj7t\" (UID: \"fb1096e4-f860-44e6-be7e-d90cbd760e04\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-6vj7t"
Jul 21 17:21:17.926010 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:21:17.925930    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fb1096e4-f860-44e6-be7e-d90cbd760e04-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-6vj7t\" (UID: \"fb1096e4-f860-44e6-be7e-d90cbd760e04\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-6vj7t"
Jul 21 17:21:17.926010 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:21:17.925975    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fb1096e4-f860-44e6-be7e-d90cbd760e04-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-6vj7t\" (UID: \"fb1096e4-f860-44e6-be7e-d90cbd760e04\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-6vj7t"
Jul 21 17:21:17.926162 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:21:17.926067    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fb1096e4-f860-44e6-be7e-d90cbd760e04-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-6vj7t\" (UID: \"fb1096e4-f860-44e6-be7e-d90cbd760e04\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-6vj7t"
Jul 21 17:21:17.926162 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:21:17.926149    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fb1096e4-f860-44e6-be7e-d90cbd760e04-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-6vj7t\" (UID: \"fb1096e4-f860-44e6-be7e-d90cbd760e04\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-6vj7t"
Jul 21 17:21:17.926261 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:21:17.926197    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fb1096e4-f860-44e6-be7e-d90cbd760e04-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-6vj7t\" (UID: \"fb1096e4-f860-44e6-be7e-d90cbd760e04\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-6vj7t"
Jul 21 17:21:17.926327 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:21:17.926309    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fb1096e4-f860-44e6-be7e-d90cbd760e04-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-6vj7t\" (UID: \"fb1096e4-f860-44e6-be7e-d90cbd760e04\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-6vj7t"
Jul 21 17:21:17.928387 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:21:17.928365    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fb1096e4-f860-44e6-be7e-d90cbd760e04-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-6vj7t\" (UID: \"fb1096e4-f860-44e6-be7e-d90cbd760e04\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-6vj7t"
Jul 21 17:21:17.928614 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:21:17.928596    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fb1096e4-f860-44e6-be7e-d90cbd760e04-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-6vj7t\" (UID: \"fb1096e4-f860-44e6-be7e-d90cbd760e04\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-6vj7t"
Jul 21 17:21:17.934107 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:21:17.934083    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kj7vk\" (UniqueName: \"kubernetes.io/projected/fb1096e4-f860-44e6-be7e-d90cbd760e04-kube-api-access-kj7vk\") pod \"e2e-trlp-test-simulated-kserve-598466548d-6vj7t\" (UID: \"fb1096e4-f860-44e6-be7e-d90cbd760e04\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-6vj7t"
Jul 21 17:21:18.026866 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:21:18.026825    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-6vj7t"
Jul 21 17:21:18.165704 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:21:18.165548    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-6vj7t"]
Jul 21 17:21:18.168111 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:21:18.168084    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfb1096e4_f860_44e6_be7e_d90cbd760e04.slice/crio-ae62fbf554e8b8e30cf9d0ea9f74e4208ce7266e8645eb8941f87eb3b6b205a9 WatchSource:0}: Error finding container ae62fbf554e8b8e30cf9d0ea9f74e4208ce7266e8645eb8941f87eb3b6b205a9: Status 404 returned error can't find the container with id ae62fbf554e8b8e30cf9d0ea9f74e4208ce7266e8645eb8941f87eb3b6b205a9
Jul 21 17:21:18.169948 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:21:18.169932    2575 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 21 17:21:18.307777 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:21:18.307683    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-6vj7t" event={"ID":"fb1096e4-f860-44e6-be7e-d90cbd760e04","Type":"ContainerStarted","Data":"ae62fbf554e8b8e30cf9d0ea9f74e4208ce7266e8645eb8941f87eb3b6b205a9"}
Jul 21 17:21:19.313603 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:21:19.313566    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-6vj7t" event={"ID":"fb1096e4-f860-44e6-be7e-d90cbd760e04","Type":"ContainerStarted","Data":"f4c267dbd66b2c935c49fcd050c441f35b9b2a3a59b81fcaa7e848a164ca6c48"}
Jul 21 17:21:19.334582 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:21:19.334327    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-6vj7t" podStartSLOduration=2.151938838 podStartE2EDuration="2.334307219s" totalImagesPullingTime="182.368381ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 17:21:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 17:21:19.333700036 +0000 UTC m=+771.787852697" watchObservedRunningTime="2026-07-21 17:21:19.334307219 +0000 UTC m=+771.788459859"
Jul 21 17:21:28.027561 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:21:28.027518    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-6vj7t"
Jul 21 17:21:28.028042 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:21:28.027623    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-6vj7t"
Jul 21 17:21:28.044190 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:21:28.044157    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-6vj7t"
Jul 21 17:21:28.362912 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:21:28.362831    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-6vj7t"
Jul 21 17:21:54.015371 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:21:54.015335    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-57fc66f697-86fxw"]
Jul 21 17:21:54.017698 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:21:54.017678    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-86fxw"
Jul 21 17:21:54.020155 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:21:54.020135    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"premium-simulated-simulated-premium-kserve-self-signed-certs\""
Jul 21 17:21:54.028957 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:21:54.028935    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-57fc66f697-86fxw"]
Jul 21 17:21:54.143795 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:21:54.143765    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/12e90958-152f-4416-bba2-e8f752fa09e9-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-86fxw\" (UID: \"12e90958-152f-4416-bba2-e8f752fa09e9\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-86fxw"
Jul 21 17:21:54.143957 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:21:54.143813    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/12e90958-152f-4416-bba2-e8f752fa09e9-home\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-86fxw\" (UID: \"12e90958-152f-4416-bba2-e8f752fa09e9\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-86fxw"
Jul 21 17:21:54.143957 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:21:54.143854    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/12e90958-152f-4416-bba2-e8f752fa09e9-model-cache\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-86fxw\" (UID: \"12e90958-152f-4416-bba2-e8f752fa09e9\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-86fxw"
Jul 21 17:21:54.143957 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:21:54.143872    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m2hps\" (UniqueName: \"kubernetes.io/projected/12e90958-152f-4416-bba2-e8f752fa09e9-kube-api-access-m2hps\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-86fxw\" (UID: \"12e90958-152f-4416-bba2-e8f752fa09e9\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-86fxw"
Jul 21 17:21:54.143957 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:21:54.143890    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/12e90958-152f-4416-bba2-e8f752fa09e9-dshm\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-86fxw\" (UID: \"12e90958-152f-4416-bba2-e8f752fa09e9\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-86fxw"
Jul 21 17:21:54.143957 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:21:54.143905    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/12e90958-152f-4416-bba2-e8f752fa09e9-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-86fxw\" (UID: \"12e90958-152f-4416-bba2-e8f752fa09e9\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-86fxw"
Jul 21 17:21:54.244791 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:21:54.244754    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/12e90958-152f-4416-bba2-e8f752fa09e9-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-86fxw\" (UID: \"12e90958-152f-4416-bba2-e8f752fa09e9\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-86fxw"
Jul 21 17:21:54.244957 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:21:54.244805    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/12e90958-152f-4416-bba2-e8f752fa09e9-home\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-86fxw\" (UID: \"12e90958-152f-4416-bba2-e8f752fa09e9\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-86fxw"
Jul 21 17:21:54.244957 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:21:54.244825    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/12e90958-152f-4416-bba2-e8f752fa09e9-model-cache\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-86fxw\" (UID: \"12e90958-152f-4416-bba2-e8f752fa09e9\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-86fxw"
Jul 21 17:21:54.244957 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:21:54.244906    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m2hps\" (UniqueName: \"kubernetes.io/projected/12e90958-152f-4416-bba2-e8f752fa09e9-kube-api-access-m2hps\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-86fxw\" (UID: \"12e90958-152f-4416-bba2-e8f752fa09e9\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-86fxw"
Jul 21 17:21:54.245063 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:21:54.244954    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/12e90958-152f-4416-bba2-e8f752fa09e9-dshm\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-86fxw\" (UID: \"12e90958-152f-4416-bba2-e8f752fa09e9\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-86fxw"
Jul 21 17:21:54.245063 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:21:54.244979    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/12e90958-152f-4416-bba2-e8f752fa09e9-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-86fxw\" (UID: \"12e90958-152f-4416-bba2-e8f752fa09e9\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-86fxw"
Jul 21 17:21:54.245165 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:21:54.245146    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/12e90958-152f-4416-bba2-e8f752fa09e9-model-cache\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-86fxw\" (UID: \"12e90958-152f-4416-bba2-e8f752fa09e9\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-86fxw"
Jul 21 17:21:54.245218 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:21:54.245194    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/12e90958-152f-4416-bba2-e8f752fa09e9-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-86fxw\" (UID: \"12e90958-152f-4416-bba2-e8f752fa09e9\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-86fxw"
Jul 21 17:21:54.245543 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:21:54.245516    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/12e90958-152f-4416-bba2-e8f752fa09e9-home\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-86fxw\" (UID: \"12e90958-152f-4416-bba2-e8f752fa09e9\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-86fxw"
Jul 21 17:21:54.247231 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:21:54.247212    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/12e90958-152f-4416-bba2-e8f752fa09e9-dshm\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-86fxw\" (UID: \"12e90958-152f-4416-bba2-e8f752fa09e9\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-86fxw"
Jul 21 17:21:54.247594 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:21:54.247576    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/12e90958-152f-4416-bba2-e8f752fa09e9-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-86fxw\" (UID: \"12e90958-152f-4416-bba2-e8f752fa09e9\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-86fxw"
Jul 21 17:21:54.253558 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:21:54.253534    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m2hps\" (UniqueName: \"kubernetes.io/projected/12e90958-152f-4416-bba2-e8f752fa09e9-kube-api-access-m2hps\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-86fxw\" (UID: \"12e90958-152f-4416-bba2-e8f752fa09e9\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-86fxw"
Jul 21 17:21:54.326208 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:21:54.326121    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-86fxw"
Jul 21 17:21:54.457048 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:21:54.457021    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-57fc66f697-86fxw"]
Jul 21 17:21:54.459817 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:21:54.459771    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod12e90958_152f_4416_bba2_e8f752fa09e9.slice/crio-659a4fa63e7399890ecfe8ac410d662dcda503681adc4650de834bd428d28909 WatchSource:0}: Error finding container 659a4fa63e7399890ecfe8ac410d662dcda503681adc4650de834bd428d28909: Status 404 returned error can't find the container with id 659a4fa63e7399890ecfe8ac410d662dcda503681adc4650de834bd428d28909
Jul 21 17:21:55.468835 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:21:55.468790    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-86fxw" event={"ID":"12e90958-152f-4416-bba2-e8f752fa09e9","Type":"ContainerStarted","Data":"9edc58a2116a2756d99c5c84e04f94c049abfcb4ef266a46a200b5f056a01160"}
Jul 21 17:21:55.468835 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:21:55.468838    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-86fxw" event={"ID":"12e90958-152f-4416-bba2-e8f752fa09e9","Type":"ContainerStarted","Data":"659a4fa63e7399890ecfe8ac410d662dcda503681adc4650de834bd428d28909"}
Jul 21 17:21:55.487840 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:21:55.487784    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-86fxw" podStartSLOduration=2.29179389 podStartE2EDuration="2.487764648s" totalImagesPullingTime="195.970758ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 17:21:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 17:21:55.486618326 +0000 UTC m=+807.940770980" watchObservedRunningTime="2026-07-21 17:21:55.487764648 +0000 UTC m=+807.941917288"
Jul 21 17:22:04.326836 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:22:04.326794    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-86fxw"
Jul 21 17:22:04.327221 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:22:04.326848    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-86fxw"
Jul 21 17:22:04.339915 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:22:04.339885    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-86fxw"
Jul 21 17:22:04.523637 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:22:04.523611    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-86fxw"
Jul 21 17:23:28.417757 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:23:28.417670    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-b64gx_9425e519-d00c-4af6-a68a-3efde7aae5ba/ovn-acl-logging/0.log"
Jul 21 17:23:28.419747 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:23:28.419730    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-b64gx_9425e519-d00c-4af6-a68a-3efde7aae5ba/ovn-acl-logging/0.log"
Jul 21 17:23:36.404811 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:23:36.404770    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-64ff86b949-cvdnt"]
Jul 21 17:23:36.405266 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:23:36.405050    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-64ff86b949-cvdnt" podUID="927a948f-dcb4-4121-97ad-bc7a8791f4e7" containerName="manager" containerID="cri-o://8852ba78c3dc6e09519ff29e4169c0d5fd74ad40ca5575aa600bcf7acc8d6cc2" gracePeriod=30
Jul 21 17:23:36.659151 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:23:36.659094    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-64ff86b949-cvdnt"
Jul 21 17:23:36.785482 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:23:36.785451    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8dsfg\" (UniqueName: \"kubernetes.io/projected/927a948f-dcb4-4121-97ad-bc7a8791f4e7-kube-api-access-8dsfg\") pod \"927a948f-dcb4-4121-97ad-bc7a8791f4e7\" (UID: \"927a948f-dcb4-4121-97ad-bc7a8791f4e7\") "
Jul 21 17:23:36.785694 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:23:36.785510    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/927a948f-dcb4-4121-97ad-bc7a8791f4e7-webhook-cert\") pod \"927a948f-dcb4-4121-97ad-bc7a8791f4e7\" (UID: \"927a948f-dcb4-4121-97ad-bc7a8791f4e7\") "
Jul 21 17:23:36.787713 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:23:36.787679    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/927a948f-dcb4-4121-97ad-bc7a8791f4e7-kube-api-access-8dsfg" (OuterVolumeSpecName: "kube-api-access-8dsfg") pod "927a948f-dcb4-4121-97ad-bc7a8791f4e7" (UID: "927a948f-dcb4-4121-97ad-bc7a8791f4e7"). InnerVolumeSpecName "kube-api-access-8dsfg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 17:23:36.787713 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:23:36.787705    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/927a948f-dcb4-4121-97ad-bc7a8791f4e7-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "927a948f-dcb4-4121-97ad-bc7a8791f4e7" (UID: "927a948f-dcb4-4121-97ad-bc7a8791f4e7"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 21 17:23:36.886402 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:23:36.886370    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8dsfg\" (UniqueName: \"kubernetes.io/projected/927a948f-dcb4-4121-97ad-bc7a8791f4e7-kube-api-access-8dsfg\") on node \"ip-10-0-141-39.ec2.internal\" DevicePath \"\""
Jul 21 17:23:36.886569 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:23:36.886404    2575 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/927a948f-dcb4-4121-97ad-bc7a8791f4e7-webhook-cert\") on node \"ip-10-0-141-39.ec2.internal\" DevicePath \"\""
Jul 21 17:23:36.920832 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:23:36.920758    2575 generic.go:356] "Generic (PLEG): container finished" podID="927a948f-dcb4-4121-97ad-bc7a8791f4e7" containerID="8852ba78c3dc6e09519ff29e4169c0d5fd74ad40ca5575aa600bcf7acc8d6cc2" exitCode=0
Jul 21 17:23:36.920832 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:23:36.920806    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-64ff86b949-cvdnt"
Jul 21 17:23:36.920979 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:23:36.920843    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-64ff86b949-cvdnt" event={"ID":"927a948f-dcb4-4121-97ad-bc7a8791f4e7","Type":"ContainerDied","Data":"8852ba78c3dc6e09519ff29e4169c0d5fd74ad40ca5575aa600bcf7acc8d6cc2"}
Jul 21 17:23:36.920979 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:23:36.920896    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-64ff86b949-cvdnt" event={"ID":"927a948f-dcb4-4121-97ad-bc7a8791f4e7","Type":"ContainerDied","Data":"73a36cd273e7f6c362d42f0b41db118ebfc7a68f837407225c08c6b9db70d66e"}
Jul 21 17:23:36.920979 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:23:36.920922    2575 scope.go:117] "RemoveContainer" containerID="8852ba78c3dc6e09519ff29e4169c0d5fd74ad40ca5575aa600bcf7acc8d6cc2"
Jul 21 17:23:36.929883 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:23:36.929861    2575 scope.go:117] "RemoveContainer" containerID="8852ba78c3dc6e09519ff29e4169c0d5fd74ad40ca5575aa600bcf7acc8d6cc2"
Jul 21 17:23:36.930132 ip-10-0-141-39 kubenswrapper[2575]: E0721 17:23:36.930116    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8852ba78c3dc6e09519ff29e4169c0d5fd74ad40ca5575aa600bcf7acc8d6cc2\": container with ID starting with 8852ba78c3dc6e09519ff29e4169c0d5fd74ad40ca5575aa600bcf7acc8d6cc2 not found: ID does not exist" containerID="8852ba78c3dc6e09519ff29e4169c0d5fd74ad40ca5575aa600bcf7acc8d6cc2"
Jul 21 17:23:36.930182 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:23:36.930142    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8852ba78c3dc6e09519ff29e4169c0d5fd74ad40ca5575aa600bcf7acc8d6cc2"} err="failed to get container status \"8852ba78c3dc6e09519ff29e4169c0d5fd74ad40ca5575aa600bcf7acc8d6cc2\": rpc error: code = NotFound desc = could not find container \"8852ba78c3dc6e09519ff29e4169c0d5fd74ad40ca5575aa600bcf7acc8d6cc2\": container with ID starting with 8852ba78c3dc6e09519ff29e4169c0d5fd74ad40ca5575aa600bcf7acc8d6cc2 not found: ID does not exist"
Jul 21 17:23:36.942450 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:23:36.942367    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-64ff86b949-cvdnt"]
Jul 21 17:23:36.944139 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:23:36.944120    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-64ff86b949-cvdnt"]
Jul 21 17:23:38.116096 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:23:38.116069    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="927a948f-dcb4-4121-97ad-bc7a8791f4e7" path="/var/lib/kubelet/pods/927a948f-dcb4-4121-97ad-bc7a8791f4e7/volumes"
Jul 21 17:24:37.742298 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:24:37.742266    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-64ff86b949-pw9wb"]
Jul 21 17:24:37.742760 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:24:37.742615    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="927a948f-dcb4-4121-97ad-bc7a8791f4e7" containerName="manager"
Jul 21 17:24:37.742760 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:24:37.742626    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="927a948f-dcb4-4121-97ad-bc7a8791f4e7" containerName="manager"
Jul 21 17:24:37.742760 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:24:37.742690    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="927a948f-dcb4-4121-97ad-bc7a8791f4e7" containerName="manager"
Jul 21 17:24:37.745986 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:24:37.745966    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-64ff86b949-pw9wb"
Jul 21 17:24:37.749649 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:24:37.749629    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-q72kd\""
Jul 21 17:24:37.749782 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:24:37.749701    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Jul 21 17:24:37.750565 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:24:37.750548    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Jul 21 17:24:37.760265 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:24:37.760239    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-64ff86b949-pw9wb"]
Jul 21 17:24:37.811475 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:24:37.811441    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/d5f3baa3-42ad-40c7-9330-65d3c53ad43c-webhook-cert\") pod \"maas-controller-64ff86b949-pw9wb\" (UID: \"d5f3baa3-42ad-40c7-9330-65d3c53ad43c\") " pod="opendatahub/maas-controller-64ff86b949-pw9wb"
Jul 21 17:24:37.811628 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:24:37.811543    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hkrst\" (UniqueName: \"kubernetes.io/projected/d5f3baa3-42ad-40c7-9330-65d3c53ad43c-kube-api-access-hkrst\") pod \"maas-controller-64ff86b949-pw9wb\" (UID: \"d5f3baa3-42ad-40c7-9330-65d3c53ad43c\") " pod="opendatahub/maas-controller-64ff86b949-pw9wb"
Jul 21 17:24:37.912938 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:24:37.912904    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hkrst\" (UniqueName: \"kubernetes.io/projected/d5f3baa3-42ad-40c7-9330-65d3c53ad43c-kube-api-access-hkrst\") pod \"maas-controller-64ff86b949-pw9wb\" (UID: \"d5f3baa3-42ad-40c7-9330-65d3c53ad43c\") " pod="opendatahub/maas-controller-64ff86b949-pw9wb"
Jul 21 17:24:37.913103 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:24:37.912959    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/d5f3baa3-42ad-40c7-9330-65d3c53ad43c-webhook-cert\") pod \"maas-controller-64ff86b949-pw9wb\" (UID: \"d5f3baa3-42ad-40c7-9330-65d3c53ad43c\") " pod="opendatahub/maas-controller-64ff86b949-pw9wb"
Jul 21 17:24:37.915630 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:24:37.915600    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/d5f3baa3-42ad-40c7-9330-65d3c53ad43c-webhook-cert\") pod \"maas-controller-64ff86b949-pw9wb\" (UID: \"d5f3baa3-42ad-40c7-9330-65d3c53ad43c\") " pod="opendatahub/maas-controller-64ff86b949-pw9wb"
Jul 21 17:24:37.922342 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:24:37.922318    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hkrst\" (UniqueName: \"kubernetes.io/projected/d5f3baa3-42ad-40c7-9330-65d3c53ad43c-kube-api-access-hkrst\") pod \"maas-controller-64ff86b949-pw9wb\" (UID: \"d5f3baa3-42ad-40c7-9330-65d3c53ad43c\") " pod="opendatahub/maas-controller-64ff86b949-pw9wb"
Jul 21 17:24:38.056524 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:24:38.056435    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-64ff86b949-pw9wb"
Jul 21 17:24:38.190373 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:24:38.190353    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-64ff86b949-pw9wb"]
Jul 21 17:24:38.192863 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:24:38.192834    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd5f3baa3_42ad_40c7_9330_65d3c53ad43c.slice/crio-e78163cc291b49368d26f0dd1f9c807ca3f6bbf1aadb11538dab50ac999926bf WatchSource:0}: Error finding container e78163cc291b49368d26f0dd1f9c807ca3f6bbf1aadb11538dab50ac999926bf: Status 404 returned error can't find the container with id e78163cc291b49368d26f0dd1f9c807ca3f6bbf1aadb11538dab50ac999926bf
Jul 21 17:24:38.207042 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:24:38.207018    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-64ff86b949-pw9wb" event={"ID":"d5f3baa3-42ad-40c7-9330-65d3c53ad43c","Type":"ContainerStarted","Data":"e78163cc291b49368d26f0dd1f9c807ca3f6bbf1aadb11538dab50ac999926bf"}
Jul 21 17:24:39.218476 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:24:39.218436    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-64ff86b949-pw9wb" event={"ID":"d5f3baa3-42ad-40c7-9330-65d3c53ad43c","Type":"ContainerStarted","Data":"26c524ce789c61bfd8696e260449c21e0f5299c3112cfc5392c5ad2124287591"}
Jul 21 17:24:39.218856 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:24:39.218538    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-64ff86b949-pw9wb"
Jul 21 17:24:39.239079 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:24:39.239032    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-64ff86b949-pw9wb" podStartSLOduration=1.762771151 podStartE2EDuration="2.239018113s" totalImagesPullingTime="476.246962ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 17:24:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 17:24:39.237317214 +0000 UTC m=+971.691469854" watchObservedRunningTime="2026-07-21 17:24:39.239018113 +0000 UTC m=+971.693170753"
Jul 21 17:24:50.224275 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:24:50.224202    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-64ff86b949-pw9wb"
Jul 21 17:24:54.839528 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:24:54.839495    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-64ff86b949-pw9wb"]
Jul 21 17:24:54.839936 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:24:54.839688    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-64ff86b949-pw9wb" podUID="d5f3baa3-42ad-40c7-9330-65d3c53ad43c" containerName="manager" containerID="cri-o://26c524ce789c61bfd8696e260449c21e0f5299c3112cfc5392c5ad2124287591" gracePeriod=30
Jul 21 17:24:55.081976 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:24:55.081951    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-64ff86b949-pw9wb"
Jul 21 17:24:55.167795 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:24:55.167711    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hkrst\" (UniqueName: \"kubernetes.io/projected/d5f3baa3-42ad-40c7-9330-65d3c53ad43c-kube-api-access-hkrst\") pod \"d5f3baa3-42ad-40c7-9330-65d3c53ad43c\" (UID: \"d5f3baa3-42ad-40c7-9330-65d3c53ad43c\") "
Jul 21 17:24:55.167934 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:24:55.167812    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/d5f3baa3-42ad-40c7-9330-65d3c53ad43c-webhook-cert\") pod \"d5f3baa3-42ad-40c7-9330-65d3c53ad43c\" (UID: \"d5f3baa3-42ad-40c7-9330-65d3c53ad43c\") "
Jul 21 17:24:55.169788 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:24:55.169759    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d5f3baa3-42ad-40c7-9330-65d3c53ad43c-kube-api-access-hkrst" (OuterVolumeSpecName: "kube-api-access-hkrst") pod "d5f3baa3-42ad-40c7-9330-65d3c53ad43c" (UID: "d5f3baa3-42ad-40c7-9330-65d3c53ad43c"). InnerVolumeSpecName "kube-api-access-hkrst". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 17:24:55.169915 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:24:55.169823    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d5f3baa3-42ad-40c7-9330-65d3c53ad43c-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "d5f3baa3-42ad-40c7-9330-65d3c53ad43c" (UID: "d5f3baa3-42ad-40c7-9330-65d3c53ad43c"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 21 17:24:55.268765 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:24:55.268739    2575 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/d5f3baa3-42ad-40c7-9330-65d3c53ad43c-webhook-cert\") on node \"ip-10-0-141-39.ec2.internal\" DevicePath \"\""
Jul 21 17:24:55.268765 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:24:55.268764    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hkrst\" (UniqueName: \"kubernetes.io/projected/d5f3baa3-42ad-40c7-9330-65d3c53ad43c-kube-api-access-hkrst\") on node \"ip-10-0-141-39.ec2.internal\" DevicePath \"\""
Jul 21 17:24:55.289298 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:24:55.289262    2575 generic.go:356] "Generic (PLEG): container finished" podID="d5f3baa3-42ad-40c7-9330-65d3c53ad43c" containerID="26c524ce789c61bfd8696e260449c21e0f5299c3112cfc5392c5ad2124287591" exitCode=0
Jul 21 17:24:55.289496 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:24:55.289306    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-64ff86b949-pw9wb"
Jul 21 17:24:55.289496 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:24:55.289391    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-64ff86b949-pw9wb" event={"ID":"d5f3baa3-42ad-40c7-9330-65d3c53ad43c","Type":"ContainerDied","Data":"26c524ce789c61bfd8696e260449c21e0f5299c3112cfc5392c5ad2124287591"}
Jul 21 17:24:55.289496 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:24:55.289457    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-64ff86b949-pw9wb" event={"ID":"d5f3baa3-42ad-40c7-9330-65d3c53ad43c","Type":"ContainerDied","Data":"e78163cc291b49368d26f0dd1f9c807ca3f6bbf1aadb11538dab50ac999926bf"}
Jul 21 17:24:55.289496 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:24:55.289489    2575 scope.go:117] "RemoveContainer" containerID="26c524ce789c61bfd8696e260449c21e0f5299c3112cfc5392c5ad2124287591"
Jul 21 17:24:55.298708 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:24:55.298691    2575 scope.go:117] "RemoveContainer" containerID="26c524ce789c61bfd8696e260449c21e0f5299c3112cfc5392c5ad2124287591"
Jul 21 17:24:55.298935 ip-10-0-141-39 kubenswrapper[2575]: E0721 17:24:55.298918    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"26c524ce789c61bfd8696e260449c21e0f5299c3112cfc5392c5ad2124287591\": container with ID starting with 26c524ce789c61bfd8696e260449c21e0f5299c3112cfc5392c5ad2124287591 not found: ID does not exist" containerID="26c524ce789c61bfd8696e260449c21e0f5299c3112cfc5392c5ad2124287591"
Jul 21 17:24:55.299000 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:24:55.298942    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"26c524ce789c61bfd8696e260449c21e0f5299c3112cfc5392c5ad2124287591"} err="failed to get container status \"26c524ce789c61bfd8696e260449c21e0f5299c3112cfc5392c5ad2124287591\": rpc error: code = NotFound desc = could not find container \"26c524ce789c61bfd8696e260449c21e0f5299c3112cfc5392c5ad2124287591\": container with ID starting with 26c524ce789c61bfd8696e260449c21e0f5299c3112cfc5392c5ad2124287591 not found: ID does not exist"
Jul 21 17:24:55.310850 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:24:55.310829    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-64ff86b949-pw9wb"]
Jul 21 17:24:55.314753 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:24:55.314734    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-64ff86b949-pw9wb"]
Jul 21 17:24:56.083306 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:24:56.083271    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-64ff86b949-jdvqb"]
Jul 21 17:24:56.083708 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:24:56.083599    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d5f3baa3-42ad-40c7-9330-65d3c53ad43c" containerName="manager"
Jul 21 17:24:56.083708 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:24:56.083609    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="d5f3baa3-42ad-40c7-9330-65d3c53ad43c" containerName="manager"
Jul 21 17:24:56.083708 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:24:56.083678    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="d5f3baa3-42ad-40c7-9330-65d3c53ad43c" containerName="manager"
Jul 21 17:24:56.088050 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:24:56.088031    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-64ff86b949-jdvqb"
Jul 21 17:24:56.091811 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:24:56.091791    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Jul 21 17:24:56.091950 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:24:56.091792    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Jul 21 17:24:56.091950 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:24:56.091821    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-q72kd\""
Jul 21 17:24:56.097557 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:24:56.097535    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-64ff86b949-jdvqb"]
Jul 21 17:24:56.117998 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:24:56.117972    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d5f3baa3-42ad-40c7-9330-65d3c53ad43c" path="/var/lib/kubelet/pods/d5f3baa3-42ad-40c7-9330-65d3c53ad43c/volumes"
Jul 21 17:24:56.176666 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:24:56.176639    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/deb4e91d-dbfd-4c48-986d-16526d41a946-webhook-cert\") pod \"maas-controller-64ff86b949-jdvqb\" (UID: \"deb4e91d-dbfd-4c48-986d-16526d41a946\") " pod="opendatahub/maas-controller-64ff86b949-jdvqb"
Jul 21 17:24:56.176831 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:24:56.176725    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r4vhp\" (UniqueName: \"kubernetes.io/projected/deb4e91d-dbfd-4c48-986d-16526d41a946-kube-api-access-r4vhp\") pod \"maas-controller-64ff86b949-jdvqb\" (UID: \"deb4e91d-dbfd-4c48-986d-16526d41a946\") " pod="opendatahub/maas-controller-64ff86b949-jdvqb"
Jul 21 17:24:56.277619 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:24:56.277581    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/deb4e91d-dbfd-4c48-986d-16526d41a946-webhook-cert\") pod \"maas-controller-64ff86b949-jdvqb\" (UID: \"deb4e91d-dbfd-4c48-986d-16526d41a946\") " pod="opendatahub/maas-controller-64ff86b949-jdvqb"
Jul 21 17:24:56.277788 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:24:56.277672    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r4vhp\" (UniqueName: \"kubernetes.io/projected/deb4e91d-dbfd-4c48-986d-16526d41a946-kube-api-access-r4vhp\") pod \"maas-controller-64ff86b949-jdvqb\" (UID: \"deb4e91d-dbfd-4c48-986d-16526d41a946\") " pod="opendatahub/maas-controller-64ff86b949-jdvqb"
Jul 21 17:24:56.280319 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:24:56.280297    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/deb4e91d-dbfd-4c48-986d-16526d41a946-webhook-cert\") pod \"maas-controller-64ff86b949-jdvqb\" (UID: \"deb4e91d-dbfd-4c48-986d-16526d41a946\") " pod="opendatahub/maas-controller-64ff86b949-jdvqb"
Jul 21 17:24:56.286880 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:24:56.286857    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r4vhp\" (UniqueName: \"kubernetes.io/projected/deb4e91d-dbfd-4c48-986d-16526d41a946-kube-api-access-r4vhp\") pod \"maas-controller-64ff86b949-jdvqb\" (UID: \"deb4e91d-dbfd-4c48-986d-16526d41a946\") " pod="opendatahub/maas-controller-64ff86b949-jdvqb"
Jul 21 17:24:56.399129 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:24:56.399042    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-64ff86b949-jdvqb"
Jul 21 17:24:56.535609 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:24:56.535561    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-64ff86b949-jdvqb"]
Jul 21 17:24:56.538296 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:24:56.538266    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddeb4e91d_dbfd_4c48_986d_16526d41a946.slice/crio-e1d8059b889e9ef99f5c3d137b2027e4be76225bfbd1095b8f4e75e497dbc975 WatchSource:0}: Error finding container e1d8059b889e9ef99f5c3d137b2027e4be76225bfbd1095b8f4e75e497dbc975: Status 404 returned error can't find the container with id e1d8059b889e9ef99f5c3d137b2027e4be76225bfbd1095b8f4e75e497dbc975
Jul 21 17:24:57.301823 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:24:57.301789    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-64ff86b949-jdvqb" event={"ID":"deb4e91d-dbfd-4c48-986d-16526d41a946","Type":"ContainerStarted","Data":"af5afaf9e1afe976f6693c42739d4868269224ddda60f2d9263c8227974e6f70"}
Jul 21 17:24:57.302198 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:24:57.301840    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-64ff86b949-jdvqb" event={"ID":"deb4e91d-dbfd-4c48-986d-16526d41a946","Type":"ContainerStarted","Data":"e1d8059b889e9ef99f5c3d137b2027e4be76225bfbd1095b8f4e75e497dbc975"}
Jul 21 17:24:57.302198 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:24:57.301886    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-64ff86b949-jdvqb"
Jul 21 17:24:57.320068 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:24:57.320015    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-64ff86b949-jdvqb" podStartSLOduration=1.03283721 podStartE2EDuration="1.319999507s" totalImagesPullingTime="287.162297ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 17:24:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 17:24:57.318502321 +0000 UTC m=+989.772654964" watchObservedRunningTime="2026-07-21 17:24:57.319999507 +0000 UTC m=+989.774152127"
Jul 21 17:25:08.308619 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:25:08.308590    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-64ff86b949-jdvqb"
Jul 21 17:28:28.446915 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:28:28.446884    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-b64gx_9425e519-d00c-4af6-a68a-3efde7aae5ba/ovn-acl-logging/0.log"
Jul 21 17:28:28.449341 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:28:28.449322    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-b64gx_9425e519-d00c-4af6-a68a-3efde7aae5ba/ovn-acl-logging/0.log"
Jul 21 17:29:41.154510 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:29:41.154476    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-ttqr2"]
Jul 21 17:29:41.157148 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:29:41.154732    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-ttqr2" podUID="33726560-1107-41fb-a974-9c568d1229f0" containerName="manager" containerID="cri-o://fb19d9f8194fe4c9337ff677a89231ae7b916d84093fcfc78c1cf10ceb3df531" gracePeriod=10
Jul 21 17:29:43.004579 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:29:43.004551    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-ttqr2"
Jul 21 17:29:43.159004 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:29:43.158921    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/33726560-1107-41fb-a974-9c568d1229f0-extensions-socket-volume\") pod \"33726560-1107-41fb-a974-9c568d1229f0\" (UID: \"33726560-1107-41fb-a974-9c568d1229f0\") "
Jul 21 17:29:43.159004 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:29:43.158959    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ph522\" (UniqueName: \"kubernetes.io/projected/33726560-1107-41fb-a974-9c568d1229f0-kube-api-access-ph522\") pod \"33726560-1107-41fb-a974-9c568d1229f0\" (UID: \"33726560-1107-41fb-a974-9c568d1229f0\") "
Jul 21 17:29:43.159281 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:29:43.159259    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/33726560-1107-41fb-a974-9c568d1229f0-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "33726560-1107-41fb-a974-9c568d1229f0" (UID: "33726560-1107-41fb-a974-9c568d1229f0"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 17:29:43.161234 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:29:43.161212    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/33726560-1107-41fb-a974-9c568d1229f0-kube-api-access-ph522" (OuterVolumeSpecName: "kube-api-access-ph522") pod "33726560-1107-41fb-a974-9c568d1229f0" (UID: "33726560-1107-41fb-a974-9c568d1229f0"). InnerVolumeSpecName "kube-api-access-ph522". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 17:29:43.259857 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:29:43.259823    2575 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/33726560-1107-41fb-a974-9c568d1229f0-extensions-socket-volume\") on node \"ip-10-0-141-39.ec2.internal\" DevicePath \"\""
Jul 21 17:29:43.259857 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:29:43.259849    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ph522\" (UniqueName: \"kubernetes.io/projected/33726560-1107-41fb-a974-9c568d1229f0-kube-api-access-ph522\") on node \"ip-10-0-141-39.ec2.internal\" DevicePath \"\""
Jul 21 17:29:43.608959 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:29:43.608926    2575 generic.go:356] "Generic (PLEG): container finished" podID="33726560-1107-41fb-a974-9c568d1229f0" containerID="fb19d9f8194fe4c9337ff677a89231ae7b916d84093fcfc78c1cf10ceb3df531" exitCode=0
Jul 21 17:29:43.609131 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:29:43.608967    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-ttqr2"
Jul 21 17:29:43.609131 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:29:43.608975    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-ttqr2" event={"ID":"33726560-1107-41fb-a974-9c568d1229f0","Type":"ContainerDied","Data":"fb19d9f8194fe4c9337ff677a89231ae7b916d84093fcfc78c1cf10ceb3df531"}
Jul 21 17:29:43.609131 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:29:43.609016    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-ttqr2" event={"ID":"33726560-1107-41fb-a974-9c568d1229f0","Type":"ContainerDied","Data":"8618779d7f5b289b32655c928abd80ae14df44d298b5773f195fc36e81bba2bb"}
Jul 21 17:29:43.609131 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:29:43.609037    2575 scope.go:117] "RemoveContainer" containerID="fb19d9f8194fe4c9337ff677a89231ae7b916d84093fcfc78c1cf10ceb3df531"
Jul 21 17:29:43.618610 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:29:43.618594    2575 scope.go:117] "RemoveContainer" containerID="fb19d9f8194fe4c9337ff677a89231ae7b916d84093fcfc78c1cf10ceb3df531"
Jul 21 17:29:43.618872 ip-10-0-141-39 kubenswrapper[2575]: E0721 17:29:43.618851    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fb19d9f8194fe4c9337ff677a89231ae7b916d84093fcfc78c1cf10ceb3df531\": container with ID starting with fb19d9f8194fe4c9337ff677a89231ae7b916d84093fcfc78c1cf10ceb3df531 not found: ID does not exist" containerID="fb19d9f8194fe4c9337ff677a89231ae7b916d84093fcfc78c1cf10ceb3df531"
Jul 21 17:29:43.618967 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:29:43.618885    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fb19d9f8194fe4c9337ff677a89231ae7b916d84093fcfc78c1cf10ceb3df531"} err="failed to get container status \"fb19d9f8194fe4c9337ff677a89231ae7b916d84093fcfc78c1cf10ceb3df531\": rpc error: code = NotFound desc = could not find container \"fb19d9f8194fe4c9337ff677a89231ae7b916d84093fcfc78c1cf10ceb3df531\": container with ID starting with fb19d9f8194fe4c9337ff677a89231ae7b916d84093fcfc78c1cf10ceb3df531 not found: ID does not exist"
Jul 21 17:29:43.634760 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:29:43.634735    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-ttqr2"]
Jul 21 17:29:43.639260 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:29:43.639241    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-ttqr2"]
Jul 21 17:29:44.116521 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:29:44.116488    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="33726560-1107-41fb-a974-9c568d1229f0" path="/var/lib/kubelet/pods/33726560-1107-41fb-a974-9c568d1229f0/volumes"
Jul 21 17:30:00.156784 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:30:00.156753    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29744250-kpgfg"]
Jul 21 17:30:00.157249 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:30:00.157179    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="33726560-1107-41fb-a974-9c568d1229f0" containerName="manager"
Jul 21 17:30:00.157249 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:30:00.157195    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="33726560-1107-41fb-a974-9c568d1229f0" containerName="manager"
Jul 21 17:30:00.157325 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:30:00.157265    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="33726560-1107-41fb-a974-9c568d1229f0" containerName="manager"
Jul 21 17:30:00.160130 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:30:00.160114    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29744250-kpgfg"
Jul 21 17:30:00.162883 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:30:00.162860    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-kgm68\""
Jul 21 17:30:00.168447 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:30:00.168403    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29744250-kpgfg"]
Jul 21 17:30:00.170473 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:30:00.170456    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29744250-kpgfg"
Jul 21 17:30:00.307475 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:30:00.307451    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29744250-kpgfg"]
Jul 21 17:30:00.309348 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:30:00.309311    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod38bf5016_b955_4c0f_8cbe_edcb50833f65.slice/crio-fb2b82679a9117b802bf0da1f107496439bc5a1c8769bfc434dafc1754f2377f WatchSource:0}: Error finding container fb2b82679a9117b802bf0da1f107496439bc5a1c8769bfc434dafc1754f2377f: Status 404 returned error can't find the container with id fb2b82679a9117b802bf0da1f107496439bc5a1c8769bfc434dafc1754f2377f
Jul 21 17:30:00.311151 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:30:00.311131    2575 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 21 17:30:00.683962 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:30:00.683930    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29744250-kpgfg" event={"ID":"38bf5016-b955-4c0f-8cbe-edcb50833f65","Type":"ContainerStarted","Data":"fb2b82679a9117b802bf0da1f107496439bc5a1c8769bfc434dafc1754f2377f"}
Jul 21 17:30:03.699400 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:30:03.699363    2575 generic.go:356] "Generic (PLEG): container finished" podID="38bf5016-b955-4c0f-8cbe-edcb50833f65" containerID="52ba135dd990943fc03740fafe4f03f477d3d069aab7bd0cf8c760ffc828b14b" exitCode=0
Jul 21 17:30:03.699831 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:30:03.699438    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29744250-kpgfg" event={"ID":"38bf5016-b955-4c0f-8cbe-edcb50833f65","Type":"ContainerDied","Data":"52ba135dd990943fc03740fafe4f03f477d3d069aab7bd0cf8c760ffc828b14b"}
Jul 21 17:30:04.832391 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:30:04.832370    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29744250-kpgfg"
Jul 21 17:30:05.709783 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:30:05.709748    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29744250-kpgfg"
Jul 21 17:30:05.709783 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:30:05.709777    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29744250-kpgfg" event={"ID":"38bf5016-b955-4c0f-8cbe-edcb50833f65","Type":"ContainerDied","Data":"fb2b82679a9117b802bf0da1f107496439bc5a1c8769bfc434dafc1754f2377f"}
Jul 21 17:30:05.709991 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:30:05.709820    2575 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="fb2b82679a9117b802bf0da1f107496439bc5a1c8769bfc434dafc1754f2377f"
Jul 21 17:30:42.340089 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:30:42.340055    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-hctdj"]
Jul 21 17:30:42.340569 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:30:42.340428    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="38bf5016-b955-4c0f-8cbe-edcb50833f65" containerName="cleanup"
Jul 21 17:30:42.340569 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:30:42.340443    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="38bf5016-b955-4c0f-8cbe-edcb50833f65" containerName="cleanup"
Jul 21 17:30:42.340569 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:30:42.340523    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="38bf5016-b955-4c0f-8cbe-edcb50833f65" containerName="cleanup"
Jul 21 17:30:42.343220 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:30:42.343201    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-hctdj"
Jul 21 17:30:42.347726 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:30:42.347709    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-czqmv\""
Jul 21 17:30:42.360758 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:30:42.360732    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-hctdj"]
Jul 21 17:30:42.396638 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:30:42.396602    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fprgm\" (UniqueName: \"kubernetes.io/projected/37daaf9f-e396-4287-a4e7-457b221672fb-kube-api-access-fprgm\") pod \"kuadrant-operator-controller-manager-86878c769f-hctdj\" (UID: \"37daaf9f-e396-4287-a4e7-457b221672fb\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-hctdj"
Jul 21 17:30:42.396781 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:30:42.396646    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/37daaf9f-e396-4287-a4e7-457b221672fb-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-hctdj\" (UID: \"37daaf9f-e396-4287-a4e7-457b221672fb\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-hctdj"
Jul 21 17:30:42.497062 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:30:42.497030    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fprgm\" (UniqueName: \"kubernetes.io/projected/37daaf9f-e396-4287-a4e7-457b221672fb-kube-api-access-fprgm\") pod \"kuadrant-operator-controller-manager-86878c769f-hctdj\" (UID: \"37daaf9f-e396-4287-a4e7-457b221672fb\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-hctdj"
Jul 21 17:30:42.497209 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:30:42.497068    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/37daaf9f-e396-4287-a4e7-457b221672fb-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-hctdj\" (UID: \"37daaf9f-e396-4287-a4e7-457b221672fb\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-hctdj"
Jul 21 17:30:42.497409 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:30:42.497393    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/37daaf9f-e396-4287-a4e7-457b221672fb-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-hctdj\" (UID: \"37daaf9f-e396-4287-a4e7-457b221672fb\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-hctdj"
Jul 21 17:30:42.508177 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:30:42.508152    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fprgm\" (UniqueName: \"kubernetes.io/projected/37daaf9f-e396-4287-a4e7-457b221672fb-kube-api-access-fprgm\") pod \"kuadrant-operator-controller-manager-86878c769f-hctdj\" (UID: \"37daaf9f-e396-4287-a4e7-457b221672fb\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-hctdj"
Jul 21 17:30:42.653026 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:30:42.652943    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-hctdj"
Jul 21 17:30:42.792146 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:30:42.792123    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-hctdj"]
Jul 21 17:30:42.794535 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:30:42.794505    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod37daaf9f_e396_4287_a4e7_457b221672fb.slice/crio-5c702062a74ba1243341c7d27ba411f79ba6275b37b4f769f01af22d3efaae51 WatchSource:0}: Error finding container 5c702062a74ba1243341c7d27ba411f79ba6275b37b4f769f01af22d3efaae51: Status 404 returned error can't find the container with id 5c702062a74ba1243341c7d27ba411f79ba6275b37b4f769f01af22d3efaae51
Jul 21 17:30:42.875485 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:30:42.875453    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-hctdj" event={"ID":"37daaf9f-e396-4287-a4e7-457b221672fb","Type":"ContainerStarted","Data":"6fa0fb694350279ac1159c7c2aa5535743a6789015781e07446a3319c2c6a105"}
Jul 21 17:30:42.875604 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:30:42.875505    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-hctdj" event={"ID":"37daaf9f-e396-4287-a4e7-457b221672fb","Type":"ContainerStarted","Data":"5c702062a74ba1243341c7d27ba411f79ba6275b37b4f769f01af22d3efaae51"}
Jul 21 17:30:42.875604 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:30:42.875539    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-hctdj"
Jul 21 17:30:42.902630 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:30:42.902592    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-hctdj" podStartSLOduration=0.902577043 podStartE2EDuration="902.577043ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 17:30:42 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 17:30:42.900011281 +0000 UTC m=+1335.354163902" watchObservedRunningTime="2026-07-21 17:30:42.902577043 +0000 UTC m=+1335.356729682"
Jul 21 17:30:53.882429 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:30:53.882379    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-hctdj"
Jul 21 17:33:28.473856 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:33:28.473831    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-b64gx_9425e519-d00c-4af6-a68a-3efde7aae5ba/ovn-acl-logging/0.log"
Jul 21 17:33:28.477382 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:33:28.477363    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-b64gx_9425e519-d00c-4af6-a68a-3efde7aae5ba/ovn-acl-logging/0.log"
Jul 21 17:38:14.265737 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:38:14.265705    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-01e22ac5-74698d58f7-rdf9d"]
Jul 21 17:38:14.269579 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:38:14.269558    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-01e22ac5-74698d58f7-rdf9d"
Jul 21 17:38:14.272780 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:38:14.272746    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ait-01e22ac5-serving-cert\""
Jul 21 17:38:14.282043 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:38:14.282017    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-01e22ac5-74698d58f7-rdf9d"]
Jul 21 17:38:14.434568 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:38:14.434536    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r99mh\" (UniqueName: \"kubernetes.io/projected/f4e9c00a-2683-437b-bda4-e2ac69f1a263-kube-api-access-r99mh\") pod \"maas-api-e2e-ait-01e22ac5-74698d58f7-rdf9d\" (UID: \"f4e9c00a-2683-437b-bda4-e2ac69f1a263\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-01e22ac5-74698d58f7-rdf9d"
Jul 21 17:38:14.434781 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:38:14.434589    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f4e9c00a-2683-437b-bda4-e2ac69f1a263-maas-api-tls\") pod \"maas-api-e2e-ait-01e22ac5-74698d58f7-rdf9d\" (UID: \"f4e9c00a-2683-437b-bda4-e2ac69f1a263\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-01e22ac5-74698d58f7-rdf9d"
Jul 21 17:38:14.434781 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:38:14.434653    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f4e9c00a-2683-437b-bda4-e2ac69f1a263-openshift-service-ca\") pod \"maas-api-e2e-ait-01e22ac5-74698d58f7-rdf9d\" (UID: \"f4e9c00a-2683-437b-bda4-e2ac69f1a263\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-01e22ac5-74698d58f7-rdf9d"
Jul 21 17:38:14.536134 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:38:14.536042    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r99mh\" (UniqueName: \"kubernetes.io/projected/f4e9c00a-2683-437b-bda4-e2ac69f1a263-kube-api-access-r99mh\") pod \"maas-api-e2e-ait-01e22ac5-74698d58f7-rdf9d\" (UID: \"f4e9c00a-2683-437b-bda4-e2ac69f1a263\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-01e22ac5-74698d58f7-rdf9d"
Jul 21 17:38:14.536134 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:38:14.536101    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f4e9c00a-2683-437b-bda4-e2ac69f1a263-maas-api-tls\") pod \"maas-api-e2e-ait-01e22ac5-74698d58f7-rdf9d\" (UID: \"f4e9c00a-2683-437b-bda4-e2ac69f1a263\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-01e22ac5-74698d58f7-rdf9d"
Jul 21 17:38:14.536368 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:38:14.536158    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f4e9c00a-2683-437b-bda4-e2ac69f1a263-openshift-service-ca\") pod \"maas-api-e2e-ait-01e22ac5-74698d58f7-rdf9d\" (UID: \"f4e9c00a-2683-437b-bda4-e2ac69f1a263\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-01e22ac5-74698d58f7-rdf9d"
Jul 21 17:38:14.536368 ip-10-0-141-39 kubenswrapper[2575]: E0721 17:38:14.536282    2575 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-ait-01e22ac5-serving-cert: secret "maas-api-e2e-ait-01e22ac5-serving-cert" not found
Jul 21 17:38:14.536507 ip-10-0-141-39 kubenswrapper[2575]: E0721 17:38:14.536370    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f4e9c00a-2683-437b-bda4-e2ac69f1a263-maas-api-tls podName:f4e9c00a-2683-437b-bda4-e2ac69f1a263 nodeName:}" failed. No retries permitted until 2026-07-21 17:38:15.036349476 +0000 UTC m=+1787.490502106 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/f4e9c00a-2683-437b-bda4-e2ac69f1a263-maas-api-tls") pod "maas-api-e2e-ait-01e22ac5-74698d58f7-rdf9d" (UID: "f4e9c00a-2683-437b-bda4-e2ac69f1a263") : secret "maas-api-e2e-ait-01e22ac5-serving-cert" not found
Jul 21 17:38:14.536854 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:38:14.536833    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f4e9c00a-2683-437b-bda4-e2ac69f1a263-openshift-service-ca\") pod \"maas-api-e2e-ait-01e22ac5-74698d58f7-rdf9d\" (UID: \"f4e9c00a-2683-437b-bda4-e2ac69f1a263\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-01e22ac5-74698d58f7-rdf9d"
Jul 21 17:38:14.545138 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:38:14.545108    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r99mh\" (UniqueName: \"kubernetes.io/projected/f4e9c00a-2683-437b-bda4-e2ac69f1a263-kube-api-access-r99mh\") pod \"maas-api-e2e-ait-01e22ac5-74698d58f7-rdf9d\" (UID: \"f4e9c00a-2683-437b-bda4-e2ac69f1a263\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-01e22ac5-74698d58f7-rdf9d"
Jul 21 17:38:15.040795 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:38:15.040757    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f4e9c00a-2683-437b-bda4-e2ac69f1a263-maas-api-tls\") pod \"maas-api-e2e-ait-01e22ac5-74698d58f7-rdf9d\" (UID: \"f4e9c00a-2683-437b-bda4-e2ac69f1a263\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-01e22ac5-74698d58f7-rdf9d"
Jul 21 17:38:15.043357 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:38:15.043335    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f4e9c00a-2683-437b-bda4-e2ac69f1a263-maas-api-tls\") pod \"maas-api-e2e-ait-01e22ac5-74698d58f7-rdf9d\" (UID: \"f4e9c00a-2683-437b-bda4-e2ac69f1a263\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-01e22ac5-74698d58f7-rdf9d"
Jul 21 17:38:15.179165 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:38:15.179129    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-01e22ac5-74698d58f7-rdf9d"
Jul 21 17:38:15.333755 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:38:15.333732    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-01e22ac5-74698d58f7-rdf9d"]
Jul 21 17:38:15.334580 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:38:15.334558    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf4e9c00a_2683_437b_bda4_e2ac69f1a263.slice/crio-50e8373785032b6df89f14c08b7f417d5bcc3bfa37d2e7f7909988c3d37819ef WatchSource:0}: Error finding container 50e8373785032b6df89f14c08b7f417d5bcc3bfa37d2e7f7909988c3d37819ef: Status 404 returned error can't find the container with id 50e8373785032b6df89f14c08b7f417d5bcc3bfa37d2e7f7909988c3d37819ef
Jul 21 17:38:15.336263 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:38:15.336245    2575 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 21 17:38:15.918461 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:38:15.918391    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-01e22ac5-74698d58f7-rdf9d" event={"ID":"f4e9c00a-2683-437b-bda4-e2ac69f1a263","Type":"ContainerStarted","Data":"be72f8609a66306d588a3a9e240a8f4aa08567e79cbd38a98f70297ec3426e5a"}
Jul 21 17:38:15.918644 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:38:15.918615    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-01e22ac5-74698d58f7-rdf9d"
Jul 21 17:38:15.918703 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:38:15.918644    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-01e22ac5-74698d58f7-rdf9d" event={"ID":"f4e9c00a-2683-437b-bda4-e2ac69f1a263","Type":"ContainerStarted","Data":"50e8373785032b6df89f14c08b7f417d5bcc3bfa37d2e7f7909988c3d37819ef"}
Jul 21 17:38:15.938135 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:38:15.938079    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ait-01e22ac5-74698d58f7-rdf9d" podStartSLOduration=1.4974978939999999 podStartE2EDuration="1.938064073s" totalImagesPullingTime="440.566179ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 17:38:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 17:38:15.936098947 +0000 UTC m=+1788.390251595" watchObservedRunningTime="2026-07-21 17:38:15.938064073 +0000 UTC m=+1788.392216714"
Jul 21 17:38:21.929177 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:38:21.929098    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-01e22ac5-74698d58f7-rdf9d"
Jul 21 17:38:28.499997 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:38:28.499972    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-b64gx_9425e519-d00c-4af6-a68a-3efde7aae5ba/ovn-acl-logging/0.log"
Jul 21 17:38:28.504915 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:38:28.504896    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-b64gx_9425e519-d00c-4af6-a68a-3efde7aae5ba/ovn-acl-logging/0.log"
Jul 21 17:38:50.119146 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:38:50.119110    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-01e22ac5-74698d58f7-rdf9d"]
Jul 21 17:38:50.119706 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:38:50.119358    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ait-01e22ac5-74698d58f7-rdf9d" podUID="f4e9c00a-2683-437b-bda4-e2ac69f1a263" containerName="maas-api" containerID="cri-o://be72f8609a66306d588a3a9e240a8f4aa08567e79cbd38a98f70297ec3426e5a" gracePeriod=30
Jul 21 17:38:50.365773 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:38:50.365749    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-01e22ac5-74698d58f7-rdf9d"
Jul 21 17:38:50.454484 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:38:50.454388    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-r99mh\" (UniqueName: \"kubernetes.io/projected/f4e9c00a-2683-437b-bda4-e2ac69f1a263-kube-api-access-r99mh\") pod \"f4e9c00a-2683-437b-bda4-e2ac69f1a263\" (UID: \"f4e9c00a-2683-437b-bda4-e2ac69f1a263\") "
Jul 21 17:38:50.454484 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:38:50.454455    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f4e9c00a-2683-437b-bda4-e2ac69f1a263-openshift-service-ca\") pod \"f4e9c00a-2683-437b-bda4-e2ac69f1a263\" (UID: \"f4e9c00a-2683-437b-bda4-e2ac69f1a263\") "
Jul 21 17:38:50.454484 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:38:50.454485    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f4e9c00a-2683-437b-bda4-e2ac69f1a263-maas-api-tls\") pod \"f4e9c00a-2683-437b-bda4-e2ac69f1a263\" (UID: \"f4e9c00a-2683-437b-bda4-e2ac69f1a263\") "
Jul 21 17:38:50.454840 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:38:50.454810    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f4e9c00a-2683-437b-bda4-e2ac69f1a263-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "f4e9c00a-2683-437b-bda4-e2ac69f1a263" (UID: "f4e9c00a-2683-437b-bda4-e2ac69f1a263"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 17:38:50.456850 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:38:50.456828    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f4e9c00a-2683-437b-bda4-e2ac69f1a263-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "f4e9c00a-2683-437b-bda4-e2ac69f1a263" (UID: "f4e9c00a-2683-437b-bda4-e2ac69f1a263"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 21 17:38:50.456950 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:38:50.456922    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f4e9c00a-2683-437b-bda4-e2ac69f1a263-kube-api-access-r99mh" (OuterVolumeSpecName: "kube-api-access-r99mh") pod "f4e9c00a-2683-437b-bda4-e2ac69f1a263" (UID: "f4e9c00a-2683-437b-bda4-e2ac69f1a263"). InnerVolumeSpecName "kube-api-access-r99mh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 17:38:50.555570 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:38:50.555530    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-r99mh\" (UniqueName: \"kubernetes.io/projected/f4e9c00a-2683-437b-bda4-e2ac69f1a263-kube-api-access-r99mh\") on node \"ip-10-0-141-39.ec2.internal\" DevicePath \"\""
Jul 21 17:38:50.555570 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:38:50.555562    2575 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f4e9c00a-2683-437b-bda4-e2ac69f1a263-openshift-service-ca\") on node \"ip-10-0-141-39.ec2.internal\" DevicePath \"\""
Jul 21 17:38:50.555570 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:38:50.555576    2575 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f4e9c00a-2683-437b-bda4-e2ac69f1a263-maas-api-tls\") on node \"ip-10-0-141-39.ec2.internal\" DevicePath \"\""
Jul 21 17:38:51.081099 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:38:51.081068    2575 generic.go:356] "Generic (PLEG): container finished" podID="f4e9c00a-2683-437b-bda4-e2ac69f1a263" containerID="be72f8609a66306d588a3a9e240a8f4aa08567e79cbd38a98f70297ec3426e5a" exitCode=0
Jul 21 17:38:51.081250 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:38:51.081114    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-01e22ac5-74698d58f7-rdf9d" event={"ID":"f4e9c00a-2683-437b-bda4-e2ac69f1a263","Type":"ContainerDied","Data":"be72f8609a66306d588a3a9e240a8f4aa08567e79cbd38a98f70297ec3426e5a"}
Jul 21 17:38:51.081250 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:38:51.081152    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-01e22ac5-74698d58f7-rdf9d" event={"ID":"f4e9c00a-2683-437b-bda4-e2ac69f1a263","Type":"ContainerDied","Data":"50e8373785032b6df89f14c08b7f417d5bcc3bfa37d2e7f7909988c3d37819ef"}
Jul 21 17:38:51.081250 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:38:51.081172    2575 scope.go:117] "RemoveContainer" containerID="be72f8609a66306d588a3a9e240a8f4aa08567e79cbd38a98f70297ec3426e5a"
Jul 21 17:38:51.081250 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:38:51.081116    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-01e22ac5-74698d58f7-rdf9d"
Jul 21 17:38:51.091624 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:38:51.091580    2575 scope.go:117] "RemoveContainer" containerID="be72f8609a66306d588a3a9e240a8f4aa08567e79cbd38a98f70297ec3426e5a"
Jul 21 17:38:51.091935 ip-10-0-141-39 kubenswrapper[2575]: E0721 17:38:51.091913    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"be72f8609a66306d588a3a9e240a8f4aa08567e79cbd38a98f70297ec3426e5a\": container with ID starting with be72f8609a66306d588a3a9e240a8f4aa08567e79cbd38a98f70297ec3426e5a not found: ID does not exist" containerID="be72f8609a66306d588a3a9e240a8f4aa08567e79cbd38a98f70297ec3426e5a"
Jul 21 17:38:51.092001 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:38:51.091947    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"be72f8609a66306d588a3a9e240a8f4aa08567e79cbd38a98f70297ec3426e5a"} err="failed to get container status \"be72f8609a66306d588a3a9e240a8f4aa08567e79cbd38a98f70297ec3426e5a\": rpc error: code = NotFound desc = could not find container \"be72f8609a66306d588a3a9e240a8f4aa08567e79cbd38a98f70297ec3426e5a\": container with ID starting with be72f8609a66306d588a3a9e240a8f4aa08567e79cbd38a98f70297ec3426e5a not found: ID does not exist"
Jul 21 17:38:51.108940 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:38:51.108908    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-01e22ac5-74698d58f7-rdf9d"]
Jul 21 17:38:51.120896 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:38:51.120868    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-01e22ac5-74698d58f7-rdf9d"]
Jul 21 17:38:52.116339 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:38:52.116307    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f4e9c00a-2683-437b-bda4-e2ac69f1a263" path="/var/lib/kubelet/pods/f4e9c00a-2683-437b-bda4-e2ac69f1a263/volumes"
Jul 21 17:38:58.525639 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:38:58.525601    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-07f072da-58b94798db-599c9"]
Jul 21 17:38:58.526017 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:38:58.525961    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f4e9c00a-2683-437b-bda4-e2ac69f1a263" containerName="maas-api"
Jul 21 17:38:58.526017 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:38:58.525971    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="f4e9c00a-2683-437b-bda4-e2ac69f1a263" containerName="maas-api"
Jul 21 17:38:58.526089 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:38:58.526025    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="f4e9c00a-2683-437b-bda4-e2ac69f1a263" containerName="maas-api"
Jul 21 17:38:58.528780 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:38:58.528755    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-07f072da-58b94798db-599c9"
Jul 21 17:38:58.531328 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:38:58.531309    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-migrate-07f072da-serving-cert\""
Jul 21 17:38:58.538857 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:38:58.538832    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-07f072da-58b94798db-599c9"]
Jul 21 17:38:58.629661 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:38:58.629631    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qdb7p\" (UniqueName: \"kubernetes.io/projected/8d0dc6d1-9d36-4f0c-bab8-85dab205346a-kube-api-access-qdb7p\") pod \"maas-api-e2e-migrate-07f072da-58b94798db-599c9\" (UID: \"8d0dc6d1-9d36-4f0c-bab8-85dab205346a\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-07f072da-58b94798db-599c9"
Jul 21 17:38:58.629871 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:38:58.629701    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8d0dc6d1-9d36-4f0c-bab8-85dab205346a-maas-api-tls\") pod \"maas-api-e2e-migrate-07f072da-58b94798db-599c9\" (UID: \"8d0dc6d1-9d36-4f0c-bab8-85dab205346a\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-07f072da-58b94798db-599c9"
Jul 21 17:38:58.629871 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:38:58.629730    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8d0dc6d1-9d36-4f0c-bab8-85dab205346a-openshift-service-ca\") pod \"maas-api-e2e-migrate-07f072da-58b94798db-599c9\" (UID: \"8d0dc6d1-9d36-4f0c-bab8-85dab205346a\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-07f072da-58b94798db-599c9"
Jul 21 17:38:58.730260 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:38:58.730225    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8d0dc6d1-9d36-4f0c-bab8-85dab205346a-maas-api-tls\") pod \"maas-api-e2e-migrate-07f072da-58b94798db-599c9\" (UID: \"8d0dc6d1-9d36-4f0c-bab8-85dab205346a\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-07f072da-58b94798db-599c9"
Jul 21 17:38:58.730260 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:38:58.730264    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8d0dc6d1-9d36-4f0c-bab8-85dab205346a-openshift-service-ca\") pod \"maas-api-e2e-migrate-07f072da-58b94798db-599c9\" (UID: \"8d0dc6d1-9d36-4f0c-bab8-85dab205346a\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-07f072da-58b94798db-599c9"
Jul 21 17:38:58.730513 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:38:58.730339    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qdb7p\" (UniqueName: \"kubernetes.io/projected/8d0dc6d1-9d36-4f0c-bab8-85dab205346a-kube-api-access-qdb7p\") pod \"maas-api-e2e-migrate-07f072da-58b94798db-599c9\" (UID: \"8d0dc6d1-9d36-4f0c-bab8-85dab205346a\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-07f072da-58b94798db-599c9"
Jul 21 17:38:58.731058 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:38:58.731004    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8d0dc6d1-9d36-4f0c-bab8-85dab205346a-openshift-service-ca\") pod \"maas-api-e2e-migrate-07f072da-58b94798db-599c9\" (UID: \"8d0dc6d1-9d36-4f0c-bab8-85dab205346a\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-07f072da-58b94798db-599c9"
Jul 21 17:38:58.733023 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:38:58.732997    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8d0dc6d1-9d36-4f0c-bab8-85dab205346a-maas-api-tls\") pod \"maas-api-e2e-migrate-07f072da-58b94798db-599c9\" (UID: \"8d0dc6d1-9d36-4f0c-bab8-85dab205346a\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-07f072da-58b94798db-599c9"
Jul 21 17:38:58.748284 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:38:58.748258    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qdb7p\" (UniqueName: \"kubernetes.io/projected/8d0dc6d1-9d36-4f0c-bab8-85dab205346a-kube-api-access-qdb7p\") pod \"maas-api-e2e-migrate-07f072da-58b94798db-599c9\" (UID: \"8d0dc6d1-9d36-4f0c-bab8-85dab205346a\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-07f072da-58b94798db-599c9"
Jul 21 17:38:58.842289 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:38:58.842193    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-07f072da-58b94798db-599c9"
Jul 21 17:38:58.981905 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:38:58.981791    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-07f072da-58b94798db-599c9"]
Jul 21 17:38:58.984195 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:38:58.984172    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8d0dc6d1_9d36_4f0c_bab8_85dab205346a.slice/crio-3cb1d09b0f3720fba7a81a0d1a828781886f1763f4e701de8783629c9eaf6020 WatchSource:0}: Error finding container 3cb1d09b0f3720fba7a81a0d1a828781886f1763f4e701de8783629c9eaf6020: Status 404 returned error can't find the container with id 3cb1d09b0f3720fba7a81a0d1a828781886f1763f4e701de8783629c9eaf6020
Jul 21 17:38:59.120810 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:38:59.120720    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-07f072da-58b94798db-599c9" event={"ID":"8d0dc6d1-9d36-4f0c-bab8-85dab205346a","Type":"ContainerStarted","Data":"3cb1d09b0f3720fba7a81a0d1a828781886f1763f4e701de8783629c9eaf6020"}
Jul 21 17:39:00.126255 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:39:00.126215    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-07f072da-58b94798db-599c9" event={"ID":"8d0dc6d1-9d36-4f0c-bab8-85dab205346a","Type":"ContainerStarted","Data":"9e9018360d10b67a14d7cc82f6b4b69acb8ebcc0b740ac25fa0b37bf4b4b14ee"}
Jul 21 17:39:00.126632 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:39:00.126350    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-07f072da-58b94798db-599c9"
Jul 21 17:39:00.143943 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:39:00.143897    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-07f072da-58b94798db-599c9" podStartSLOduration=1.703095663 podStartE2EDuration="2.143883077s" totalImagesPullingTime="440.787414ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 17:38:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 17:39:00.142827375 +0000 UTC m=+1832.596980017" watchObservedRunningTime="2026-07-21 17:39:00.143883077 +0000 UTC m=+1832.598035716"
Jul 21 17:39:06.136846 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:39:06.136821    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-07f072da-58b94798db-599c9"
Jul 21 17:39:33.877393 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:39:33.877354    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-07f072da-58b94798db-599c9"]
Jul 21 17:39:33.877916 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:39:33.877594    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-07f072da-58b94798db-599c9" podUID="8d0dc6d1-9d36-4f0c-bab8-85dab205346a" containerName="maas-api" containerID="cri-o://9e9018360d10b67a14d7cc82f6b4b69acb8ebcc0b740ac25fa0b37bf4b4b14ee" gracePeriod=30
Jul 21 17:39:34.127692 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:39:34.127628    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-07f072da-58b94798db-599c9"
Jul 21 17:39:34.259915 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:39:34.259883    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8d0dc6d1-9d36-4f0c-bab8-85dab205346a-maas-api-tls\") pod \"8d0dc6d1-9d36-4f0c-bab8-85dab205346a\" (UID: \"8d0dc6d1-9d36-4f0c-bab8-85dab205346a\") "
Jul 21 17:39:34.259915 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:39:34.259919    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8d0dc6d1-9d36-4f0c-bab8-85dab205346a-openshift-service-ca\") pod \"8d0dc6d1-9d36-4f0c-bab8-85dab205346a\" (UID: \"8d0dc6d1-9d36-4f0c-bab8-85dab205346a\") "
Jul 21 17:39:34.260113 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:39:34.260014    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qdb7p\" (UniqueName: \"kubernetes.io/projected/8d0dc6d1-9d36-4f0c-bab8-85dab205346a-kube-api-access-qdb7p\") pod \"8d0dc6d1-9d36-4f0c-bab8-85dab205346a\" (UID: \"8d0dc6d1-9d36-4f0c-bab8-85dab205346a\") "
Jul 21 17:39:34.260397 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:39:34.260373    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8d0dc6d1-9d36-4f0c-bab8-85dab205346a-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "8d0dc6d1-9d36-4f0c-bab8-85dab205346a" (UID: "8d0dc6d1-9d36-4f0c-bab8-85dab205346a"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 17:39:34.262201 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:39:34.262169    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8d0dc6d1-9d36-4f0c-bab8-85dab205346a-kube-api-access-qdb7p" (OuterVolumeSpecName: "kube-api-access-qdb7p") pod "8d0dc6d1-9d36-4f0c-bab8-85dab205346a" (UID: "8d0dc6d1-9d36-4f0c-bab8-85dab205346a"). InnerVolumeSpecName "kube-api-access-qdb7p". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 17:39:34.262326 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:39:34.262230    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8d0dc6d1-9d36-4f0c-bab8-85dab205346a-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "8d0dc6d1-9d36-4f0c-bab8-85dab205346a" (UID: "8d0dc6d1-9d36-4f0c-bab8-85dab205346a"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 21 17:39:34.279181 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:39:34.279153    2575 generic.go:356] "Generic (PLEG): container finished" podID="8d0dc6d1-9d36-4f0c-bab8-85dab205346a" containerID="9e9018360d10b67a14d7cc82f6b4b69acb8ebcc0b740ac25fa0b37bf4b4b14ee" exitCode=0
Jul 21 17:39:34.279314 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:39:34.279195    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-07f072da-58b94798db-599c9"
Jul 21 17:39:34.279314 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:39:34.279235    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-07f072da-58b94798db-599c9" event={"ID":"8d0dc6d1-9d36-4f0c-bab8-85dab205346a","Type":"ContainerDied","Data":"9e9018360d10b67a14d7cc82f6b4b69acb8ebcc0b740ac25fa0b37bf4b4b14ee"}
Jul 21 17:39:34.279314 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:39:34.279287    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-07f072da-58b94798db-599c9" event={"ID":"8d0dc6d1-9d36-4f0c-bab8-85dab205346a","Type":"ContainerDied","Data":"3cb1d09b0f3720fba7a81a0d1a828781886f1763f4e701de8783629c9eaf6020"}
Jul 21 17:39:34.279314 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:39:34.279309    2575 scope.go:117] "RemoveContainer" containerID="9e9018360d10b67a14d7cc82f6b4b69acb8ebcc0b740ac25fa0b37bf4b4b14ee"
Jul 21 17:39:34.288164 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:39:34.288146    2575 scope.go:117] "RemoveContainer" containerID="9e9018360d10b67a14d7cc82f6b4b69acb8ebcc0b740ac25fa0b37bf4b4b14ee"
Jul 21 17:39:34.288435 ip-10-0-141-39 kubenswrapper[2575]: E0721 17:39:34.288401    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9e9018360d10b67a14d7cc82f6b4b69acb8ebcc0b740ac25fa0b37bf4b4b14ee\": container with ID starting with 9e9018360d10b67a14d7cc82f6b4b69acb8ebcc0b740ac25fa0b37bf4b4b14ee not found: ID does not exist" containerID="9e9018360d10b67a14d7cc82f6b4b69acb8ebcc0b740ac25fa0b37bf4b4b14ee"
Jul 21 17:39:34.288512 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:39:34.288443    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9e9018360d10b67a14d7cc82f6b4b69acb8ebcc0b740ac25fa0b37bf4b4b14ee"} err="failed to get container status \"9e9018360d10b67a14d7cc82f6b4b69acb8ebcc0b740ac25fa0b37bf4b4b14ee\": rpc error: code = NotFound desc = could not find container \"9e9018360d10b67a14d7cc82f6b4b69acb8ebcc0b740ac25fa0b37bf4b4b14ee\": container with ID starting with 9e9018360d10b67a14d7cc82f6b4b69acb8ebcc0b740ac25fa0b37bf4b4b14ee not found: ID does not exist"
Jul 21 17:39:34.306210 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:39:34.306168    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-07f072da-58b94798db-599c9"]
Jul 21 17:39:34.306369 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:39:34.306229    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-07f072da-58b94798db-599c9"]
Jul 21 17:39:34.361659 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:39:34.361625    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qdb7p\" (UniqueName: \"kubernetes.io/projected/8d0dc6d1-9d36-4f0c-bab8-85dab205346a-kube-api-access-qdb7p\") on node \"ip-10-0-141-39.ec2.internal\" DevicePath \"\""
Jul 21 17:39:34.361659 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:39:34.361654    2575 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8d0dc6d1-9d36-4f0c-bab8-85dab205346a-maas-api-tls\") on node \"ip-10-0-141-39.ec2.internal\" DevicePath \"\""
Jul 21 17:39:34.361659 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:39:34.361664    2575 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8d0dc6d1-9d36-4f0c-bab8-85dab205346a-openshift-service-ca\") on node \"ip-10-0-141-39.ec2.internal\" DevicePath \"\""
Jul 21 17:39:36.117655 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:39:36.117620    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8d0dc6d1-9d36-4f0c-bab8-85dab205346a" path="/var/lib/kubelet/pods/8d0dc6d1-9d36-4f0c-bab8-85dab205346a/volumes"
Jul 21 17:39:41.809543 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:39:41.809512    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-6b1d8ddb-5bf78b6955-g7lnj"]
Jul 21 17:39:41.810039 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:39:41.810021    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8d0dc6d1-9d36-4f0c-bab8-85dab205346a" containerName="maas-api"
Jul 21 17:39:41.810125 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:39:41.810041    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="8d0dc6d1-9d36-4f0c-bab8-85dab205346a" containerName="maas-api"
Jul 21 17:39:41.810199 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:39:41.810186    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="8d0dc6d1-9d36-4f0c-bab8-85dab205346a" containerName="maas-api"
Jul 21 17:39:41.814540 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:39:41.814519    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-6b1d8ddb-5bf78b6955-g7lnj"
Jul 21 17:39:41.816924 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:39:41.816904    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ait-6b1d8ddb-serving-cert\""
Jul 21 17:39:41.823370 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:39:41.823318    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-6b1d8ddb-5bf78b6955-g7lnj"]
Jul 21 17:39:41.932462 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:39:41.932405    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/dd8c08ae-f2d1-4a31-a559-2b8243a8fbc9-openshift-service-ca\") pod \"maas-api-e2e-ait-6b1d8ddb-5bf78b6955-g7lnj\" (UID: \"dd8c08ae-f2d1-4a31-a559-2b8243a8fbc9\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-6b1d8ddb-5bf78b6955-g7lnj"
Jul 21 17:39:41.932614 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:39:41.932490    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/dd8c08ae-f2d1-4a31-a559-2b8243a8fbc9-maas-api-tls\") pod \"maas-api-e2e-ait-6b1d8ddb-5bf78b6955-g7lnj\" (UID: \"dd8c08ae-f2d1-4a31-a559-2b8243a8fbc9\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-6b1d8ddb-5bf78b6955-g7lnj"
Jul 21 17:39:41.932614 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:39:41.932535    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nx2sh\" (UniqueName: \"kubernetes.io/projected/dd8c08ae-f2d1-4a31-a559-2b8243a8fbc9-kube-api-access-nx2sh\") pod \"maas-api-e2e-ait-6b1d8ddb-5bf78b6955-g7lnj\" (UID: \"dd8c08ae-f2d1-4a31-a559-2b8243a8fbc9\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-6b1d8ddb-5bf78b6955-g7lnj"
Jul 21 17:39:42.033271 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:39:42.033231    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/dd8c08ae-f2d1-4a31-a559-2b8243a8fbc9-maas-api-tls\") pod \"maas-api-e2e-ait-6b1d8ddb-5bf78b6955-g7lnj\" (UID: \"dd8c08ae-f2d1-4a31-a559-2b8243a8fbc9\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-6b1d8ddb-5bf78b6955-g7lnj"
Jul 21 17:39:42.033473 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:39:42.033308    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nx2sh\" (UniqueName: \"kubernetes.io/projected/dd8c08ae-f2d1-4a31-a559-2b8243a8fbc9-kube-api-access-nx2sh\") pod \"maas-api-e2e-ait-6b1d8ddb-5bf78b6955-g7lnj\" (UID: \"dd8c08ae-f2d1-4a31-a559-2b8243a8fbc9\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-6b1d8ddb-5bf78b6955-g7lnj"
Jul 21 17:39:42.033473 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:39:42.033377    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/dd8c08ae-f2d1-4a31-a559-2b8243a8fbc9-openshift-service-ca\") pod \"maas-api-e2e-ait-6b1d8ddb-5bf78b6955-g7lnj\" (UID: \"dd8c08ae-f2d1-4a31-a559-2b8243a8fbc9\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-6b1d8ddb-5bf78b6955-g7lnj"
Jul 21 17:39:42.033473 ip-10-0-141-39 kubenswrapper[2575]: E0721 17:39:42.033383    2575 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-ait-6b1d8ddb-serving-cert: secret "maas-api-e2e-ait-6b1d8ddb-serving-cert" not found
Jul 21 17:39:42.033608 ip-10-0-141-39 kubenswrapper[2575]: E0721 17:39:42.033486    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dd8c08ae-f2d1-4a31-a559-2b8243a8fbc9-maas-api-tls podName:dd8c08ae-f2d1-4a31-a559-2b8243a8fbc9 nodeName:}" failed. No retries permitted until 2026-07-21 17:39:42.533470317 +0000 UTC m=+1874.987622935 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/dd8c08ae-f2d1-4a31-a559-2b8243a8fbc9-maas-api-tls") pod "maas-api-e2e-ait-6b1d8ddb-5bf78b6955-g7lnj" (UID: "dd8c08ae-f2d1-4a31-a559-2b8243a8fbc9") : secret "maas-api-e2e-ait-6b1d8ddb-serving-cert" not found
Jul 21 17:39:42.034197 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:39:42.034176    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/dd8c08ae-f2d1-4a31-a559-2b8243a8fbc9-openshift-service-ca\") pod \"maas-api-e2e-ait-6b1d8ddb-5bf78b6955-g7lnj\" (UID: \"dd8c08ae-f2d1-4a31-a559-2b8243a8fbc9\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-6b1d8ddb-5bf78b6955-g7lnj"
Jul 21 17:39:42.044564 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:39:42.044535    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nx2sh\" (UniqueName: \"kubernetes.io/projected/dd8c08ae-f2d1-4a31-a559-2b8243a8fbc9-kube-api-access-nx2sh\") pod \"maas-api-e2e-ait-6b1d8ddb-5bf78b6955-g7lnj\" (UID: \"dd8c08ae-f2d1-4a31-a559-2b8243a8fbc9\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-6b1d8ddb-5bf78b6955-g7lnj"
Jul 21 17:39:42.537944 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:39:42.537912    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/dd8c08ae-f2d1-4a31-a559-2b8243a8fbc9-maas-api-tls\") pod \"maas-api-e2e-ait-6b1d8ddb-5bf78b6955-g7lnj\" (UID: \"dd8c08ae-f2d1-4a31-a559-2b8243a8fbc9\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-6b1d8ddb-5bf78b6955-g7lnj"
Jul 21 17:39:42.540482 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:39:42.540463    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/dd8c08ae-f2d1-4a31-a559-2b8243a8fbc9-maas-api-tls\") pod \"maas-api-e2e-ait-6b1d8ddb-5bf78b6955-g7lnj\" (UID: \"dd8c08ae-f2d1-4a31-a559-2b8243a8fbc9\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-6b1d8ddb-5bf78b6955-g7lnj"
Jul 21 17:39:42.726694 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:39:42.726657    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-6b1d8ddb-5bf78b6955-g7lnj"
Jul 21 17:39:42.873685 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:39:42.873654    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-6b1d8ddb-5bf78b6955-g7lnj"]
Jul 21 17:39:42.878289 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:39:42.878262    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddd8c08ae_f2d1_4a31_a559_2b8243a8fbc9.slice/crio-ddba57c4154a4f41a7318ae2adb71db33cb1e5c8f286d8c2ce3c216ef4b7e44c WatchSource:0}: Error finding container ddba57c4154a4f41a7318ae2adb71db33cb1e5c8f286d8c2ce3c216ef4b7e44c: Status 404 returned error can't find the container with id ddba57c4154a4f41a7318ae2adb71db33cb1e5c8f286d8c2ce3c216ef4b7e44c
Jul 21 17:39:43.325489 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:39:43.325457    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-6b1d8ddb-5bf78b6955-g7lnj" event={"ID":"dd8c08ae-f2d1-4a31-a559-2b8243a8fbc9","Type":"ContainerStarted","Data":"0c2ff752034dc85e4c80e9cf5b51c039296938c14a0f95a2adc4510952e75410"}
Jul 21 17:39:43.325619 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:39:43.325508    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-6b1d8ddb-5bf78b6955-g7lnj" event={"ID":"dd8c08ae-f2d1-4a31-a559-2b8243a8fbc9","Type":"ContainerStarted","Data":"ddba57c4154a4f41a7318ae2adb71db33cb1e5c8f286d8c2ce3c216ef4b7e44c"}
Jul 21 17:39:43.325619 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:39:43.325540    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-6b1d8ddb-5bf78b6955-g7lnj"
Jul 21 17:39:43.352189 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:39:43.352122    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ait-6b1d8ddb-5bf78b6955-g7lnj" podStartSLOduration=1.9845336439999999 podStartE2EDuration="2.352106196s" totalImagesPullingTime="367.572552ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 17:39:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 17:39:43.34975959 +0000 UTC m=+1875.803912230" watchObservedRunningTime="2026-07-21 17:39:43.352106196 +0000 UTC m=+1875.806258835"
Jul 21 17:39:49.336665 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:39:49.336587    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-6b1d8ddb-5bf78b6955-g7lnj"
Jul 21 17:40:17.764333 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:40:17.764295    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-6b1d8ddb-5bf78b6955-g7lnj"]
Jul 21 17:40:17.767065 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:40:17.764695    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ait-6b1d8ddb-5bf78b6955-g7lnj" podUID="dd8c08ae-f2d1-4a31-a559-2b8243a8fbc9" containerName="maas-api" containerID="cri-o://0c2ff752034dc85e4c80e9cf5b51c039296938c14a0f95a2adc4510952e75410" gracePeriod=30
Jul 21 17:40:18.011067 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:40:18.011042    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-6b1d8ddb-5bf78b6955-g7lnj"
Jul 21 17:40:18.129688 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:40:18.129616    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/dd8c08ae-f2d1-4a31-a559-2b8243a8fbc9-openshift-service-ca\") pod \"dd8c08ae-f2d1-4a31-a559-2b8243a8fbc9\" (UID: \"dd8c08ae-f2d1-4a31-a559-2b8243a8fbc9\") "
Jul 21 17:40:18.129688 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:40:18.129679    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/dd8c08ae-f2d1-4a31-a559-2b8243a8fbc9-maas-api-tls\") pod \"dd8c08ae-f2d1-4a31-a559-2b8243a8fbc9\" (UID: \"dd8c08ae-f2d1-4a31-a559-2b8243a8fbc9\") "
Jul 21 17:40:18.129867 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:40:18.129700    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nx2sh\" (UniqueName: \"kubernetes.io/projected/dd8c08ae-f2d1-4a31-a559-2b8243a8fbc9-kube-api-access-nx2sh\") pod \"dd8c08ae-f2d1-4a31-a559-2b8243a8fbc9\" (UID: \"dd8c08ae-f2d1-4a31-a559-2b8243a8fbc9\") "
Jul 21 17:40:18.130031 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:40:18.130006    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/dd8c08ae-f2d1-4a31-a559-2b8243a8fbc9-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "dd8c08ae-f2d1-4a31-a559-2b8243a8fbc9" (UID: "dd8c08ae-f2d1-4a31-a559-2b8243a8fbc9"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 17:40:18.131861 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:40:18.131828    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dd8c08ae-f2d1-4a31-a559-2b8243a8fbc9-kube-api-access-nx2sh" (OuterVolumeSpecName: "kube-api-access-nx2sh") pod "dd8c08ae-f2d1-4a31-a559-2b8243a8fbc9" (UID: "dd8c08ae-f2d1-4a31-a559-2b8243a8fbc9"). InnerVolumeSpecName "kube-api-access-nx2sh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 17:40:18.131976 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:40:18.131936    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dd8c08ae-f2d1-4a31-a559-2b8243a8fbc9-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "dd8c08ae-f2d1-4a31-a559-2b8243a8fbc9" (UID: "dd8c08ae-f2d1-4a31-a559-2b8243a8fbc9"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 21 17:40:18.230845 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:40:18.230809    2575 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/dd8c08ae-f2d1-4a31-a559-2b8243a8fbc9-maas-api-tls\") on node \"ip-10-0-141-39.ec2.internal\" DevicePath \"\""
Jul 21 17:40:18.230845 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:40:18.230837    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nx2sh\" (UniqueName: \"kubernetes.io/projected/dd8c08ae-f2d1-4a31-a559-2b8243a8fbc9-kube-api-access-nx2sh\") on node \"ip-10-0-141-39.ec2.internal\" DevicePath \"\""
Jul 21 17:40:18.230845 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:40:18.230848    2575 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/dd8c08ae-f2d1-4a31-a559-2b8243a8fbc9-openshift-service-ca\") on node \"ip-10-0-141-39.ec2.internal\" DevicePath \"\""
Jul 21 17:40:18.487113 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:40:18.487009    2575 generic.go:356] "Generic (PLEG): container finished" podID="dd8c08ae-f2d1-4a31-a559-2b8243a8fbc9" containerID="0c2ff752034dc85e4c80e9cf5b51c039296938c14a0f95a2adc4510952e75410" exitCode=0
Jul 21 17:40:18.487113 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:40:18.487054    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-6b1d8ddb-5bf78b6955-g7lnj"
Jul 21 17:40:18.487113 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:40:18.487094    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-6b1d8ddb-5bf78b6955-g7lnj" event={"ID":"dd8c08ae-f2d1-4a31-a559-2b8243a8fbc9","Type":"ContainerDied","Data":"0c2ff752034dc85e4c80e9cf5b51c039296938c14a0f95a2adc4510952e75410"}
Jul 21 17:40:18.487407 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:40:18.487161    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-6b1d8ddb-5bf78b6955-g7lnj" event={"ID":"dd8c08ae-f2d1-4a31-a559-2b8243a8fbc9","Type":"ContainerDied","Data":"ddba57c4154a4f41a7318ae2adb71db33cb1e5c8f286d8c2ce3c216ef4b7e44c"}
Jul 21 17:40:18.487407 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:40:18.487190    2575 scope.go:117] "RemoveContainer" containerID="0c2ff752034dc85e4c80e9cf5b51c039296938c14a0f95a2adc4510952e75410"
Jul 21 17:40:18.498795 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:40:18.498779    2575 scope.go:117] "RemoveContainer" containerID="0c2ff752034dc85e4c80e9cf5b51c039296938c14a0f95a2adc4510952e75410"
Jul 21 17:40:18.499031 ip-10-0-141-39 kubenswrapper[2575]: E0721 17:40:18.499012    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0c2ff752034dc85e4c80e9cf5b51c039296938c14a0f95a2adc4510952e75410\": container with ID starting with 0c2ff752034dc85e4c80e9cf5b51c039296938c14a0f95a2adc4510952e75410 not found: ID does not exist" containerID="0c2ff752034dc85e4c80e9cf5b51c039296938c14a0f95a2adc4510952e75410"
Jul 21 17:40:18.499075 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:40:18.499040    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0c2ff752034dc85e4c80e9cf5b51c039296938c14a0f95a2adc4510952e75410"} err="failed to get container status \"0c2ff752034dc85e4c80e9cf5b51c039296938c14a0f95a2adc4510952e75410\": rpc error: code = NotFound desc = could not find container \"0c2ff752034dc85e4c80e9cf5b51c039296938c14a0f95a2adc4510952e75410\": container with ID starting with 0c2ff752034dc85e4c80e9cf5b51c039296938c14a0f95a2adc4510952e75410 not found: ID does not exist"
Jul 21 17:40:18.510617 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:40:18.510590    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-6b1d8ddb-5bf78b6955-g7lnj"]
Jul 21 17:40:18.516358 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:40:18.516317    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-6b1d8ddb-5bf78b6955-g7lnj"]
Jul 21 17:40:20.117552 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:40:20.117514    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="dd8c08ae-f2d1-4a31-a559-2b8243a8fbc9" path="/var/lib/kubelet/pods/dd8c08ae-f2d1-4a31-a559-2b8243a8fbc9/volumes"
Jul 21 17:40:26.782079 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:40:26.782041    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-336913ae-8477447cdd-59vnh"]
Jul 21 17:40:26.782606 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:40:26.782587    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dd8c08ae-f2d1-4a31-a559-2b8243a8fbc9" containerName="maas-api"
Jul 21 17:40:26.782684 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:40:26.782609    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="dd8c08ae-f2d1-4a31-a559-2b8243a8fbc9" containerName="maas-api"
Jul 21 17:40:26.782736 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:40:26.782700    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="dd8c08ae-f2d1-4a31-a559-2b8243a8fbc9" containerName="maas-api"
Jul 21 17:40:26.787138 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:40:26.787117    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-336913ae-8477447cdd-59vnh"
Jul 21 17:40:26.789763 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:40:26.789739    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-derive-336913ae-serving-cert\""
Jul 21 17:40:26.797077 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:40:26.797002    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-336913ae-8477447cdd-59vnh"]
Jul 21 17:40:26.918077 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:40:26.918038    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/bd018c3d-3e38-4523-949f-e1c4c8625420-openshift-service-ca\") pod \"maas-api-e2e-derive-336913ae-8477447cdd-59vnh\" (UID: \"bd018c3d-3e38-4523-949f-e1c4c8625420\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-336913ae-8477447cdd-59vnh"
Jul 21 17:40:26.918270 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:40:26.918098    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/bd018c3d-3e38-4523-949f-e1c4c8625420-maas-api-tls\") pod \"maas-api-e2e-derive-336913ae-8477447cdd-59vnh\" (UID: \"bd018c3d-3e38-4523-949f-e1c4c8625420\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-336913ae-8477447cdd-59vnh"
Jul 21 17:40:26.918270 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:40:26.918188    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rnr4k\" (UniqueName: \"kubernetes.io/projected/bd018c3d-3e38-4523-949f-e1c4c8625420-kube-api-access-rnr4k\") pod \"maas-api-e2e-derive-336913ae-8477447cdd-59vnh\" (UID: \"bd018c3d-3e38-4523-949f-e1c4c8625420\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-336913ae-8477447cdd-59vnh"
Jul 21 17:40:27.019600 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:40:27.019563    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/bd018c3d-3e38-4523-949f-e1c4c8625420-openshift-service-ca\") pod \"maas-api-e2e-derive-336913ae-8477447cdd-59vnh\" (UID: \"bd018c3d-3e38-4523-949f-e1c4c8625420\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-336913ae-8477447cdd-59vnh"
Jul 21 17:40:27.019820 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:40:27.019622    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/bd018c3d-3e38-4523-949f-e1c4c8625420-maas-api-tls\") pod \"maas-api-e2e-derive-336913ae-8477447cdd-59vnh\" (UID: \"bd018c3d-3e38-4523-949f-e1c4c8625420\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-336913ae-8477447cdd-59vnh"
Jul 21 17:40:27.019820 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:40:27.019663    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rnr4k\" (UniqueName: \"kubernetes.io/projected/bd018c3d-3e38-4523-949f-e1c4c8625420-kube-api-access-rnr4k\") pod \"maas-api-e2e-derive-336913ae-8477447cdd-59vnh\" (UID: \"bd018c3d-3e38-4523-949f-e1c4c8625420\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-336913ae-8477447cdd-59vnh"
Jul 21 17:40:27.019820 ip-10-0-141-39 kubenswrapper[2575]: E0721 17:40:27.019788    2575 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-derive-336913ae-serving-cert: secret "maas-api-e2e-derive-336913ae-serving-cert" not found
Jul 21 17:40:27.019926 ip-10-0-141-39 kubenswrapper[2575]: E0721 17:40:27.019875    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bd018c3d-3e38-4523-949f-e1c4c8625420-maas-api-tls podName:bd018c3d-3e38-4523-949f-e1c4c8625420 nodeName:}" failed. No retries permitted until 2026-07-21 17:40:27.519853851 +0000 UTC m=+1919.974006476 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/bd018c3d-3e38-4523-949f-e1c4c8625420-maas-api-tls") pod "maas-api-e2e-derive-336913ae-8477447cdd-59vnh" (UID: "bd018c3d-3e38-4523-949f-e1c4c8625420") : secret "maas-api-e2e-derive-336913ae-serving-cert" not found
Jul 21 17:40:27.020359 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:40:27.020341    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/bd018c3d-3e38-4523-949f-e1c4c8625420-openshift-service-ca\") pod \"maas-api-e2e-derive-336913ae-8477447cdd-59vnh\" (UID: \"bd018c3d-3e38-4523-949f-e1c4c8625420\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-336913ae-8477447cdd-59vnh"
Jul 21 17:40:27.030316 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:40:27.030287    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rnr4k\" (UniqueName: \"kubernetes.io/projected/bd018c3d-3e38-4523-949f-e1c4c8625420-kube-api-access-rnr4k\") pod \"maas-api-e2e-derive-336913ae-8477447cdd-59vnh\" (UID: \"bd018c3d-3e38-4523-949f-e1c4c8625420\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-336913ae-8477447cdd-59vnh"
Jul 21 17:40:27.525515 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:40:27.525480    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/bd018c3d-3e38-4523-949f-e1c4c8625420-maas-api-tls\") pod \"maas-api-e2e-derive-336913ae-8477447cdd-59vnh\" (UID: \"bd018c3d-3e38-4523-949f-e1c4c8625420\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-336913ae-8477447cdd-59vnh"
Jul 21 17:40:27.525708 ip-10-0-141-39 kubenswrapper[2575]: E0721 17:40:27.525635    2575 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-derive-336913ae-serving-cert: secret "maas-api-e2e-derive-336913ae-serving-cert" not found
Jul 21 17:40:27.525708 ip-10-0-141-39 kubenswrapper[2575]: E0721 17:40:27.525707    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bd018c3d-3e38-4523-949f-e1c4c8625420-maas-api-tls podName:bd018c3d-3e38-4523-949f-e1c4c8625420 nodeName:}" failed. No retries permitted until 2026-07-21 17:40:28.525691058 +0000 UTC m=+1920.979843679 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/bd018c3d-3e38-4523-949f-e1c4c8625420-maas-api-tls") pod "maas-api-e2e-derive-336913ae-8477447cdd-59vnh" (UID: "bd018c3d-3e38-4523-949f-e1c4c8625420") : secret "maas-api-e2e-derive-336913ae-serving-cert" not found
Jul 21 17:40:28.534755 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:40:28.534726    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/bd018c3d-3e38-4523-949f-e1c4c8625420-maas-api-tls\") pod \"maas-api-e2e-derive-336913ae-8477447cdd-59vnh\" (UID: \"bd018c3d-3e38-4523-949f-e1c4c8625420\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-336913ae-8477447cdd-59vnh"
Jul 21 17:40:28.537473 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:40:28.537442    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/bd018c3d-3e38-4523-949f-e1c4c8625420-maas-api-tls\") pod \"maas-api-e2e-derive-336913ae-8477447cdd-59vnh\" (UID: \"bd018c3d-3e38-4523-949f-e1c4c8625420\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-336913ae-8477447cdd-59vnh"
Jul 21 17:40:28.599521 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:40:28.599488    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-336913ae-8477447cdd-59vnh"
Jul 21 17:40:28.760965 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:40:28.760939    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-336913ae-8477447cdd-59vnh"]
Jul 21 17:40:28.763526 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:40:28.763499    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbd018c3d_3e38_4523_949f_e1c4c8625420.slice/crio-b2059a90bd7eca5ec888bd345351fb814b090d62d8ff8d47c1b920ae52829106 WatchSource:0}: Error finding container b2059a90bd7eca5ec888bd345351fb814b090d62d8ff8d47c1b920ae52829106: Status 404 returned error can't find the container with id b2059a90bd7eca5ec888bd345351fb814b090d62d8ff8d47c1b920ae52829106
Jul 21 17:40:29.540929 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:40:29.540900    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-336913ae-8477447cdd-59vnh" event={"ID":"bd018c3d-3e38-4523-949f-e1c4c8625420","Type":"ContainerStarted","Data":"e93eb88ac6aba91fa46430d6410dfadcea420506ebca9755f197c59ab9856d31"}
Jul 21 17:40:29.541408 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:40:29.540953    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-336913ae-8477447cdd-59vnh" event={"ID":"bd018c3d-3e38-4523-949f-e1c4c8625420","Type":"ContainerStarted","Data":"b2059a90bd7eca5ec888bd345351fb814b090d62d8ff8d47c1b920ae52829106"}
Jul 21 17:40:29.541408 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:40:29.540987    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-derive-336913ae-8477447cdd-59vnh"
Jul 21 17:40:29.560040 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:40:29.559989    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-derive-336913ae-8477447cdd-59vnh" podStartSLOduration=3.129529824 podStartE2EDuration="3.559973476s" totalImagesPullingTime="430.443652ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 17:40:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 17:40:29.558937115 +0000 UTC m=+1922.013089747" watchObservedRunningTime="2026-07-21 17:40:29.559973476 +0000 UTC m=+1922.014126157"
Jul 21 17:40:35.552323 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:40:35.552294    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-derive-336913ae-8477447cdd-59vnh"
Jul 21 17:41:02.144179 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:41:02.144145    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-336913ae-8477447cdd-59vnh"]
Jul 21 17:41:02.144722 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:41:02.144401    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-derive-336913ae-8477447cdd-59vnh" podUID="bd018c3d-3e38-4523-949f-e1c4c8625420" containerName="maas-api" containerID="cri-o://e93eb88ac6aba91fa46430d6410dfadcea420506ebca9755f197c59ab9856d31" gracePeriod=30
Jul 21 17:41:02.393387 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:41:02.393354    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-336913ae-8477447cdd-59vnh"
Jul 21 17:41:02.456731 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:41:02.456645    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/bd018c3d-3e38-4523-949f-e1c4c8625420-openshift-service-ca\") pod \"bd018c3d-3e38-4523-949f-e1c4c8625420\" (UID: \"bd018c3d-3e38-4523-949f-e1c4c8625420\") "
Jul 21 17:41:02.456731 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:41:02.456711    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rnr4k\" (UniqueName: \"kubernetes.io/projected/bd018c3d-3e38-4523-949f-e1c4c8625420-kube-api-access-rnr4k\") pod \"bd018c3d-3e38-4523-949f-e1c4c8625420\" (UID: \"bd018c3d-3e38-4523-949f-e1c4c8625420\") "
Jul 21 17:41:02.456948 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:41:02.456743    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/bd018c3d-3e38-4523-949f-e1c4c8625420-maas-api-tls\") pod \"bd018c3d-3e38-4523-949f-e1c4c8625420\" (UID: \"bd018c3d-3e38-4523-949f-e1c4c8625420\") "
Jul 21 17:41:02.457052 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:41:02.457019    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bd018c3d-3e38-4523-949f-e1c4c8625420-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "bd018c3d-3e38-4523-949f-e1c4c8625420" (UID: "bd018c3d-3e38-4523-949f-e1c4c8625420"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 17:41:02.458898 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:41:02.458866    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bd018c3d-3e38-4523-949f-e1c4c8625420-kube-api-access-rnr4k" (OuterVolumeSpecName: "kube-api-access-rnr4k") pod "bd018c3d-3e38-4523-949f-e1c4c8625420" (UID: "bd018c3d-3e38-4523-949f-e1c4c8625420"). InnerVolumeSpecName "kube-api-access-rnr4k". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 17:41:02.459010 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:41:02.458949    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bd018c3d-3e38-4523-949f-e1c4c8625420-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "bd018c3d-3e38-4523-949f-e1c4c8625420" (UID: "bd018c3d-3e38-4523-949f-e1c4c8625420"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 21 17:41:02.557589 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:41:02.557553    2575 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/bd018c3d-3e38-4523-949f-e1c4c8625420-openshift-service-ca\") on node \"ip-10-0-141-39.ec2.internal\" DevicePath \"\""
Jul 21 17:41:02.557589 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:41:02.557584    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rnr4k\" (UniqueName: \"kubernetes.io/projected/bd018c3d-3e38-4523-949f-e1c4c8625420-kube-api-access-rnr4k\") on node \"ip-10-0-141-39.ec2.internal\" DevicePath \"\""
Jul 21 17:41:02.557589 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:41:02.557595    2575 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/bd018c3d-3e38-4523-949f-e1c4c8625420-maas-api-tls\") on node \"ip-10-0-141-39.ec2.internal\" DevicePath \"\""
Jul 21 17:41:02.691343 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:41:02.691307    2575 generic.go:356] "Generic (PLEG): container finished" podID="bd018c3d-3e38-4523-949f-e1c4c8625420" containerID="e93eb88ac6aba91fa46430d6410dfadcea420506ebca9755f197c59ab9856d31" exitCode=0
Jul 21 17:41:02.691529 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:41:02.691350    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-336913ae-8477447cdd-59vnh"
Jul 21 17:41:02.691529 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:41:02.691388    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-336913ae-8477447cdd-59vnh" event={"ID":"bd018c3d-3e38-4523-949f-e1c4c8625420","Type":"ContainerDied","Data":"e93eb88ac6aba91fa46430d6410dfadcea420506ebca9755f197c59ab9856d31"}
Jul 21 17:41:02.691529 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:41:02.691490    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-336913ae-8477447cdd-59vnh" event={"ID":"bd018c3d-3e38-4523-949f-e1c4c8625420","Type":"ContainerDied","Data":"b2059a90bd7eca5ec888bd345351fb814b090d62d8ff8d47c1b920ae52829106"}
Jul 21 17:41:02.691529 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:41:02.691515    2575 scope.go:117] "RemoveContainer" containerID="e93eb88ac6aba91fa46430d6410dfadcea420506ebca9755f197c59ab9856d31"
Jul 21 17:41:02.700372 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:41:02.700357    2575 scope.go:117] "RemoveContainer" containerID="e93eb88ac6aba91fa46430d6410dfadcea420506ebca9755f197c59ab9856d31"
Jul 21 17:41:02.700671 ip-10-0-141-39 kubenswrapper[2575]: E0721 17:41:02.700654    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e93eb88ac6aba91fa46430d6410dfadcea420506ebca9755f197c59ab9856d31\": container with ID starting with e93eb88ac6aba91fa46430d6410dfadcea420506ebca9755f197c59ab9856d31 not found: ID does not exist" containerID="e93eb88ac6aba91fa46430d6410dfadcea420506ebca9755f197c59ab9856d31"
Jul 21 17:41:02.700737 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:41:02.700682    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e93eb88ac6aba91fa46430d6410dfadcea420506ebca9755f197c59ab9856d31"} err="failed to get container status \"e93eb88ac6aba91fa46430d6410dfadcea420506ebca9755f197c59ab9856d31\": rpc error: code = NotFound desc = could not find container \"e93eb88ac6aba91fa46430d6410dfadcea420506ebca9755f197c59ab9856d31\": container with ID starting with e93eb88ac6aba91fa46430d6410dfadcea420506ebca9755f197c59ab9856d31 not found: ID does not exist"
Jul 21 17:41:02.712929 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:41:02.712858    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-336913ae-8477447cdd-59vnh"]
Jul 21 17:41:02.717151 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:41:02.717124    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-336913ae-8477447cdd-59vnh"]
Jul 21 17:41:04.117066 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:41:04.117035    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bd018c3d-3e38-4523-949f-e1c4c8625420" path="/var/lib/kubelet/pods/bd018c3d-3e38-4523-949f-e1c4c8625420/volumes"
Jul 21 17:42:52.964742 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:42:52.964702    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-5151e12a-746896c7b4-xqsdn"]
Jul 21 17:42:52.965334 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:42:52.965070    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bd018c3d-3e38-4523-949f-e1c4c8625420" containerName="maas-api"
Jul 21 17:42:52.965334 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:42:52.965083    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="bd018c3d-3e38-4523-949f-e1c4c8625420" containerName="maas-api"
Jul 21 17:42:52.965334 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:42:52.965145    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="bd018c3d-3e38-4523-949f-e1c4c8625420" containerName="maas-api"
Jul 21 17:42:52.968340 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:42:52.968321    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-5151e12a-746896c7b4-xqsdn"
Jul 21 17:42:52.971012 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:42:52.970985    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-mt-5151e12a-serving-cert\""
Jul 21 17:42:52.978285 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:42:52.978250    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-5151e12a-746896c7b4-xqsdn"]
Jul 21 17:42:53.065783 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:42:53.065738    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/df9d3707-4278-47d0-9fe4-b907c9f42866-openshift-service-ca\") pod \"maas-api-e2e-mt-5151e12a-746896c7b4-xqsdn\" (UID: \"df9d3707-4278-47d0-9fe4-b907c9f42866\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-5151e12a-746896c7b4-xqsdn"
Jul 21 17:42:53.065961 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:42:53.065833    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/df9d3707-4278-47d0-9fe4-b907c9f42866-maas-api-tls\") pod \"maas-api-e2e-mt-5151e12a-746896c7b4-xqsdn\" (UID: \"df9d3707-4278-47d0-9fe4-b907c9f42866\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-5151e12a-746896c7b4-xqsdn"
Jul 21 17:42:53.065961 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:42:53.065888    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tvv56\" (UniqueName: \"kubernetes.io/projected/df9d3707-4278-47d0-9fe4-b907c9f42866-kube-api-access-tvv56\") pod \"maas-api-e2e-mt-5151e12a-746896c7b4-xqsdn\" (UID: \"df9d3707-4278-47d0-9fe4-b907c9f42866\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-5151e12a-746896c7b4-xqsdn"
Jul 21 17:42:53.166652 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:42:53.166616    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/df9d3707-4278-47d0-9fe4-b907c9f42866-maas-api-tls\") pod \"maas-api-e2e-mt-5151e12a-746896c7b4-xqsdn\" (UID: \"df9d3707-4278-47d0-9fe4-b907c9f42866\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-5151e12a-746896c7b4-xqsdn"
Jul 21 17:42:53.166833 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:42:53.166709    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tvv56\" (UniqueName: \"kubernetes.io/projected/df9d3707-4278-47d0-9fe4-b907c9f42866-kube-api-access-tvv56\") pod \"maas-api-e2e-mt-5151e12a-746896c7b4-xqsdn\" (UID: \"df9d3707-4278-47d0-9fe4-b907c9f42866\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-5151e12a-746896c7b4-xqsdn"
Jul 21 17:42:53.166833 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:42:53.166754    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/df9d3707-4278-47d0-9fe4-b907c9f42866-openshift-service-ca\") pod \"maas-api-e2e-mt-5151e12a-746896c7b4-xqsdn\" (UID: \"df9d3707-4278-47d0-9fe4-b907c9f42866\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-5151e12a-746896c7b4-xqsdn"
Jul 21 17:42:53.166833 ip-10-0-141-39 kubenswrapper[2575]: E0721 17:42:53.166800    2575 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-mt-5151e12a-serving-cert: secret "maas-api-e2e-mt-5151e12a-serving-cert" not found
Jul 21 17:42:53.167006 ip-10-0-141-39 kubenswrapper[2575]: E0721 17:42:53.166883    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/df9d3707-4278-47d0-9fe4-b907c9f42866-maas-api-tls podName:df9d3707-4278-47d0-9fe4-b907c9f42866 nodeName:}" failed. No retries permitted until 2026-07-21 17:42:53.66686491 +0000 UTC m=+2066.121017530 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/df9d3707-4278-47d0-9fe4-b907c9f42866-maas-api-tls") pod "maas-api-e2e-mt-5151e12a-746896c7b4-xqsdn" (UID: "df9d3707-4278-47d0-9fe4-b907c9f42866") : secret "maas-api-e2e-mt-5151e12a-serving-cert" not found
Jul 21 17:42:53.167367 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:42:53.167348    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/df9d3707-4278-47d0-9fe4-b907c9f42866-openshift-service-ca\") pod \"maas-api-e2e-mt-5151e12a-746896c7b4-xqsdn\" (UID: \"df9d3707-4278-47d0-9fe4-b907c9f42866\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-5151e12a-746896c7b4-xqsdn"
Jul 21 17:42:53.176246 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:42:53.176224    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tvv56\" (UniqueName: \"kubernetes.io/projected/df9d3707-4278-47d0-9fe4-b907c9f42866-kube-api-access-tvv56\") pod \"maas-api-e2e-mt-5151e12a-746896c7b4-xqsdn\" (UID: \"df9d3707-4278-47d0-9fe4-b907c9f42866\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-5151e12a-746896c7b4-xqsdn"
Jul 21 17:42:53.671699 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:42:53.671648    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/df9d3707-4278-47d0-9fe4-b907c9f42866-maas-api-tls\") pod \"maas-api-e2e-mt-5151e12a-746896c7b4-xqsdn\" (UID: \"df9d3707-4278-47d0-9fe4-b907c9f42866\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-5151e12a-746896c7b4-xqsdn"
Jul 21 17:42:53.671904 ip-10-0-141-39 kubenswrapper[2575]: E0721 17:42:53.671827    2575 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-mt-5151e12a-serving-cert: secret "maas-api-e2e-mt-5151e12a-serving-cert" not found
Jul 21 17:42:53.671977 ip-10-0-141-39 kubenswrapper[2575]: E0721 17:42:53.671907    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/df9d3707-4278-47d0-9fe4-b907c9f42866-maas-api-tls podName:df9d3707-4278-47d0-9fe4-b907c9f42866 nodeName:}" failed. No retries permitted until 2026-07-21 17:42:54.671886923 +0000 UTC m=+2067.126039542 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/df9d3707-4278-47d0-9fe4-b907c9f42866-maas-api-tls") pod "maas-api-e2e-mt-5151e12a-746896c7b4-xqsdn" (UID: "df9d3707-4278-47d0-9fe4-b907c9f42866") : secret "maas-api-e2e-mt-5151e12a-serving-cert" not found
Jul 21 17:42:54.680927 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:42:54.680891    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/df9d3707-4278-47d0-9fe4-b907c9f42866-maas-api-tls\") pod \"maas-api-e2e-mt-5151e12a-746896c7b4-xqsdn\" (UID: \"df9d3707-4278-47d0-9fe4-b907c9f42866\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-5151e12a-746896c7b4-xqsdn"
Jul 21 17:42:54.683397 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:42:54.683375    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/df9d3707-4278-47d0-9fe4-b907c9f42866-maas-api-tls\") pod \"maas-api-e2e-mt-5151e12a-746896c7b4-xqsdn\" (UID: \"df9d3707-4278-47d0-9fe4-b907c9f42866\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-5151e12a-746896c7b4-xqsdn"
Jul 21 17:42:54.781766 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:42:54.781728    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-5151e12a-746896c7b4-xqsdn"
Jul 21 17:42:54.916075 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:42:54.916043    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-5151e12a-746896c7b4-xqsdn"]
Jul 21 17:42:54.919191 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:42:54.919165    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddf9d3707_4278_47d0_9fe4_b907c9f42866.slice/crio-44504b21a3a30074d62538a770b639fee40e1b96d971287068005f6e699c5c96 WatchSource:0}: Error finding container 44504b21a3a30074d62538a770b639fee40e1b96d971287068005f6e699c5c96: Status 404 returned error can't find the container with id 44504b21a3a30074d62538a770b639fee40e1b96d971287068005f6e699c5c96
Jul 21 17:42:55.197476 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:42:55.197442    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-5151e12a-746896c7b4-xqsdn" event={"ID":"df9d3707-4278-47d0-9fe4-b907c9f42866","Type":"ContainerStarted","Data":"44504b21a3a30074d62538a770b639fee40e1b96d971287068005f6e699c5c96"}
Jul 21 17:42:56.203475 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:42:56.203443    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-5151e12a-746896c7b4-xqsdn" event={"ID":"df9d3707-4278-47d0-9fe4-b907c9f42866","Type":"ContainerStarted","Data":"1b6c6bb389c4acaaeec82e605f44ce68b4c93245ea010a6b75fa30180ccb416c"}
Jul 21 17:42:56.203868 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:42:56.203524    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-5151e12a-746896c7b4-xqsdn"
Jul 21 17:42:56.224255 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:42:56.224201    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-mt-5151e12a-746896c7b4-xqsdn" podStartSLOduration=3.8114937209999997 podStartE2EDuration="4.224187551s" totalImagesPullingTime="412.69383ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 17:42:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 17:42:56.222781551 +0000 UTC m=+2068.676934228" watchObservedRunningTime="2026-07-21 17:42:56.224187551 +0000 UTC m=+2068.678340241"
Jul 21 17:43:02.212762 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:43:02.212725    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-5151e12a-746896c7b4-xqsdn"
Jul 21 17:43:15.111810 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:43:15.111779    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-5151e12a-746896c7b4-xqsdn"]
Jul 21 17:43:15.112202 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:43:15.112005    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-mt-5151e12a-746896c7b4-xqsdn" podUID="df9d3707-4278-47d0-9fe4-b907c9f42866" containerName="maas-api" containerID="cri-o://1b6c6bb389c4acaaeec82e605f44ce68b4c93245ea010a6b75fa30180ccb416c" gracePeriod=30
Jul 21 17:43:15.290661 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:43:15.290482    2575 generic.go:356] "Generic (PLEG): container finished" podID="df9d3707-4278-47d0-9fe4-b907c9f42866" containerID="1b6c6bb389c4acaaeec82e605f44ce68b4c93245ea010a6b75fa30180ccb416c" exitCode=0
Jul 21 17:43:15.290661 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:43:15.290591    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-5151e12a-746896c7b4-xqsdn" event={"ID":"df9d3707-4278-47d0-9fe4-b907c9f42866","Type":"ContainerDied","Data":"1b6c6bb389c4acaaeec82e605f44ce68b4c93245ea010a6b75fa30180ccb416c"}
Jul 21 17:43:15.357650 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:43:15.357626    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-5151e12a-746896c7b4-xqsdn"
Jul 21 17:43:15.468972 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:43:15.468886    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/df9d3707-4278-47d0-9fe4-b907c9f42866-openshift-service-ca\") pod \"df9d3707-4278-47d0-9fe4-b907c9f42866\" (UID: \"df9d3707-4278-47d0-9fe4-b907c9f42866\") "
Jul 21 17:43:15.468972 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:43:15.468938    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/df9d3707-4278-47d0-9fe4-b907c9f42866-maas-api-tls\") pod \"df9d3707-4278-47d0-9fe4-b907c9f42866\" (UID: \"df9d3707-4278-47d0-9fe4-b907c9f42866\") "
Jul 21 17:43:15.469207 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:43:15.468995    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tvv56\" (UniqueName: \"kubernetes.io/projected/df9d3707-4278-47d0-9fe4-b907c9f42866-kube-api-access-tvv56\") pod \"df9d3707-4278-47d0-9fe4-b907c9f42866\" (UID: \"df9d3707-4278-47d0-9fe4-b907c9f42866\") "
Jul 21 17:43:15.469301 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:43:15.469282    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/df9d3707-4278-47d0-9fe4-b907c9f42866-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "df9d3707-4278-47d0-9fe4-b907c9f42866" (UID: "df9d3707-4278-47d0-9fe4-b907c9f42866"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 17:43:15.471162 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:43:15.471139    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/df9d3707-4278-47d0-9fe4-b907c9f42866-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "df9d3707-4278-47d0-9fe4-b907c9f42866" (UID: "df9d3707-4278-47d0-9fe4-b907c9f42866"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 21 17:43:15.471284 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:43:15.471260    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/df9d3707-4278-47d0-9fe4-b907c9f42866-kube-api-access-tvv56" (OuterVolumeSpecName: "kube-api-access-tvv56") pod "df9d3707-4278-47d0-9fe4-b907c9f42866" (UID: "df9d3707-4278-47d0-9fe4-b907c9f42866"). InnerVolumeSpecName "kube-api-access-tvv56". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 17:43:15.569700 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:43:15.569658    2575 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/df9d3707-4278-47d0-9fe4-b907c9f42866-maas-api-tls\") on node \"ip-10-0-141-39.ec2.internal\" DevicePath \"\""
Jul 21 17:43:15.569700 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:43:15.569686    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tvv56\" (UniqueName: \"kubernetes.io/projected/df9d3707-4278-47d0-9fe4-b907c9f42866-kube-api-access-tvv56\") on node \"ip-10-0-141-39.ec2.internal\" DevicePath \"\""
Jul 21 17:43:15.569700 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:43:15.569696    2575 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/df9d3707-4278-47d0-9fe4-b907c9f42866-openshift-service-ca\") on node \"ip-10-0-141-39.ec2.internal\" DevicePath \"\""
Jul 21 17:43:16.296249 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:43:16.296221    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-5151e12a-746896c7b4-xqsdn"
Jul 21 17:43:16.296249 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:43:16.296223    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-5151e12a-746896c7b4-xqsdn" event={"ID":"df9d3707-4278-47d0-9fe4-b907c9f42866","Type":"ContainerDied","Data":"44504b21a3a30074d62538a770b639fee40e1b96d971287068005f6e699c5c96"}
Jul 21 17:43:16.296794 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:43:16.296290    2575 scope.go:117] "RemoveContainer" containerID="1b6c6bb389c4acaaeec82e605f44ce68b4c93245ea010a6b75fa30180ccb416c"
Jul 21 17:43:16.313832 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:43:16.313806    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-5151e12a-746896c7b4-xqsdn"]
Jul 21 17:43:16.318132 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:43:16.318107    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-5151e12a-746896c7b4-xqsdn"]
Jul 21 17:43:18.116573 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:43:18.116538    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="df9d3707-4278-47d0-9fe4-b907c9f42866" path="/var/lib/kubelet/pods/df9d3707-4278-47d0-9fe4-b907c9f42866/volumes"
Jul 21 17:43:28.526594 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:43:28.526569    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-b64gx_9425e519-d00c-4af6-a68a-3efde7aae5ba/ovn-acl-logging/0.log"
Jul 21 17:43:28.538931 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:43:28.538901    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-b64gx_9425e519-d00c-4af6-a68a-3efde7aae5ba/ovn-acl-logging/0.log"
Jul 21 17:43:50.307935 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:43:50.307899    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-f446106b-6bb6f9666b-8k5qg"]
Jul 21 17:43:50.308509 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:43:50.308488    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="df9d3707-4278-47d0-9fe4-b907c9f42866" containerName="maas-api"
Jul 21 17:43:50.308625 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:43:50.308513    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="df9d3707-4278-47d0-9fe4-b907c9f42866" containerName="maas-api"
Jul 21 17:43:50.308690 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:43:50.308628    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="df9d3707-4278-47d0-9fe4-b907c9f42866" containerName="maas-api"
Jul 21 17:43:50.312098 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:43:50.312080    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-f446106b-6bb6f9666b-8k5qg"
Jul 21 17:43:50.314704 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:43:50.314681    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-mt-f446106b-serving-cert\""
Jul 21 17:43:50.325174 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:43:50.325149    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-f446106b-6bb6f9666b-8k5qg"]
Jul 21 17:43:50.387933 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:43:50.387900    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x6j5g\" (UniqueName: \"kubernetes.io/projected/2adc6e08-a23b-41ae-b5f5-3f9b19a695ff-kube-api-access-x6j5g\") pod \"maas-api-e2e-mt-f446106b-6bb6f9666b-8k5qg\" (UID: \"2adc6e08-a23b-41ae-b5f5-3f9b19a695ff\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-f446106b-6bb6f9666b-8k5qg"
Jul 21 17:43:50.388135 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:43:50.387949    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2adc6e08-a23b-41ae-b5f5-3f9b19a695ff-maas-api-tls\") pod \"maas-api-e2e-mt-f446106b-6bb6f9666b-8k5qg\" (UID: \"2adc6e08-a23b-41ae-b5f5-3f9b19a695ff\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-f446106b-6bb6f9666b-8k5qg"
Jul 21 17:43:50.388135 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:43:50.388034    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2adc6e08-a23b-41ae-b5f5-3f9b19a695ff-openshift-service-ca\") pod \"maas-api-e2e-mt-f446106b-6bb6f9666b-8k5qg\" (UID: \"2adc6e08-a23b-41ae-b5f5-3f9b19a695ff\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-f446106b-6bb6f9666b-8k5qg"
Jul 21 17:43:50.489345 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:43:50.489312    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x6j5g\" (UniqueName: \"kubernetes.io/projected/2adc6e08-a23b-41ae-b5f5-3f9b19a695ff-kube-api-access-x6j5g\") pod \"maas-api-e2e-mt-f446106b-6bb6f9666b-8k5qg\" (UID: \"2adc6e08-a23b-41ae-b5f5-3f9b19a695ff\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-f446106b-6bb6f9666b-8k5qg"
Jul 21 17:43:50.489548 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:43:50.489363    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2adc6e08-a23b-41ae-b5f5-3f9b19a695ff-maas-api-tls\") pod \"maas-api-e2e-mt-f446106b-6bb6f9666b-8k5qg\" (UID: \"2adc6e08-a23b-41ae-b5f5-3f9b19a695ff\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-f446106b-6bb6f9666b-8k5qg"
Jul 21 17:43:50.489548 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:43:50.489409    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2adc6e08-a23b-41ae-b5f5-3f9b19a695ff-openshift-service-ca\") pod \"maas-api-e2e-mt-f446106b-6bb6f9666b-8k5qg\" (UID: \"2adc6e08-a23b-41ae-b5f5-3f9b19a695ff\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-f446106b-6bb6f9666b-8k5qg"
Jul 21 17:43:50.490056 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:43:50.490021    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2adc6e08-a23b-41ae-b5f5-3f9b19a695ff-openshift-service-ca\") pod \"maas-api-e2e-mt-f446106b-6bb6f9666b-8k5qg\" (UID: \"2adc6e08-a23b-41ae-b5f5-3f9b19a695ff\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-f446106b-6bb6f9666b-8k5qg"
Jul 21 17:43:50.491963 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:43:50.491942    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2adc6e08-a23b-41ae-b5f5-3f9b19a695ff-maas-api-tls\") pod \"maas-api-e2e-mt-f446106b-6bb6f9666b-8k5qg\" (UID: \"2adc6e08-a23b-41ae-b5f5-3f9b19a695ff\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-f446106b-6bb6f9666b-8k5qg"
Jul 21 17:43:50.497301 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:43:50.497278    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x6j5g\" (UniqueName: \"kubernetes.io/projected/2adc6e08-a23b-41ae-b5f5-3f9b19a695ff-kube-api-access-x6j5g\") pod \"maas-api-e2e-mt-f446106b-6bb6f9666b-8k5qg\" (UID: \"2adc6e08-a23b-41ae-b5f5-3f9b19a695ff\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-f446106b-6bb6f9666b-8k5qg"
Jul 21 17:43:50.623339 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:43:50.623253    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-f446106b-6bb6f9666b-8k5qg"
Jul 21 17:43:50.765381 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:43:50.765302    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-f446106b-6bb6f9666b-8k5qg"]
Jul 21 17:43:50.768466 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:43:50.768434    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2adc6e08_a23b_41ae_b5f5_3f9b19a695ff.slice/crio-6c8ea118e10e143359e77498c37e41a18cd3a3345ebdba01d5a96538502ffd0c WatchSource:0}: Error finding container 6c8ea118e10e143359e77498c37e41a18cd3a3345ebdba01d5a96538502ffd0c: Status 404 returned error can't find the container with id 6c8ea118e10e143359e77498c37e41a18cd3a3345ebdba01d5a96538502ffd0c
Jul 21 17:43:50.769863 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:43:50.769845    2575 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 21 17:43:51.457554 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:43:51.457455    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-f446106b-6bb6f9666b-8k5qg" event={"ID":"2adc6e08-a23b-41ae-b5f5-3f9b19a695ff","Type":"ContainerStarted","Data":"fa4488c56e9c4fb3e63bb39eb143656ad658c267394ca0fc2245033b9c3d0f67"}
Jul 21 17:43:51.457914 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:43:51.457637    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-f446106b-6bb6f9666b-8k5qg"
Jul 21 17:43:51.457914 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:43:51.457657    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-f446106b-6bb6f9666b-8k5qg" event={"ID":"2adc6e08-a23b-41ae-b5f5-3f9b19a695ff","Type":"ContainerStarted","Data":"6c8ea118e10e143359e77498c37e41a18cd3a3345ebdba01d5a96538502ffd0c"}
Jul 21 17:43:51.474854 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:43:51.474804    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-mt-f446106b-6bb6f9666b-8k5qg" podStartSLOduration=1.107567843 podStartE2EDuration="1.474790506s" totalImagesPullingTime="367.222663ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 17:43:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 17:43:51.47357644 +0000 UTC m=+2123.927729080" watchObservedRunningTime="2026-07-21 17:43:51.474790506 +0000 UTC m=+2123.928943147"
Jul 21 17:43:57.467190 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:43:57.467157    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-f446106b-6bb6f9666b-8k5qg"
Jul 21 17:44:02.217886 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:44:02.217849    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-mt-f446106b/e2e-lifecycle-model-f446106b-kserve-67bdc9c7f9-zz5vz"]
Jul 21 17:44:02.221501 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:44:02.221480    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-f446106b/e2e-lifecycle-model-f446106b-kserve-67bdc9c7f9-zz5vz"
Jul 21 17:44:02.225039 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:44:02.225011    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-mt-f446106b\"/\"openshift-service-ca.crt\""
Jul 21 17:44:02.225175 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:44:02.225061    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-mt-f446106b\"/\"default-dockercfg-q7tvb\""
Jul 21 17:44:02.225175 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:44:02.225065    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-mt-f446106b\"/\"kube-root-ca.crt\""
Jul 21 17:44:02.225175 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:44:02.225090    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-mt-f446106b\"/\"e2e-lifecycle-model-f446106b-kserve-self-signed-certs\""
Jul 21 17:44:02.230380 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:44:02.230353    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-mt-f446106b/e2e-lifecycle-model-f446106b-kserve-67bdc9c7f9-zz5vz"]
Jul 21 17:44:02.300564 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:44:02.300527    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/19fc4a81-19af-46f0-adcc-b36fc70a64ff-home\") pod \"e2e-lifecycle-model-f446106b-kserve-67bdc9c7f9-zz5vz\" (UID: \"19fc4a81-19af-46f0-adcc-b36fc70a64ff\") " pod="ai-tenant-e2e-mt-f446106b/e2e-lifecycle-model-f446106b-kserve-67bdc9c7f9-zz5vz"
Jul 21 17:44:02.300564 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:44:02.300566    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ctkxz\" (UniqueName: \"kubernetes.io/projected/19fc4a81-19af-46f0-adcc-b36fc70a64ff-kube-api-access-ctkxz\") pod \"e2e-lifecycle-model-f446106b-kserve-67bdc9c7f9-zz5vz\" (UID: \"19fc4a81-19af-46f0-adcc-b36fc70a64ff\") " pod="ai-tenant-e2e-mt-f446106b/e2e-lifecycle-model-f446106b-kserve-67bdc9c7f9-zz5vz"
Jul 21 17:44:02.300797 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:44:02.300628    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/19fc4a81-19af-46f0-adcc-b36fc70a64ff-dshm\") pod \"e2e-lifecycle-model-f446106b-kserve-67bdc9c7f9-zz5vz\" (UID: \"19fc4a81-19af-46f0-adcc-b36fc70a64ff\") " pod="ai-tenant-e2e-mt-f446106b/e2e-lifecycle-model-f446106b-kserve-67bdc9c7f9-zz5vz"
Jul 21 17:44:02.300797 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:44:02.300645    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/19fc4a81-19af-46f0-adcc-b36fc70a64ff-model-cache\") pod \"e2e-lifecycle-model-f446106b-kserve-67bdc9c7f9-zz5vz\" (UID: \"19fc4a81-19af-46f0-adcc-b36fc70a64ff\") " pod="ai-tenant-e2e-mt-f446106b/e2e-lifecycle-model-f446106b-kserve-67bdc9c7f9-zz5vz"
Jul 21 17:44:02.300797 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:44:02.300667    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/19fc4a81-19af-46f0-adcc-b36fc70a64ff-tmp-dir\") pod \"e2e-lifecycle-model-f446106b-kserve-67bdc9c7f9-zz5vz\" (UID: \"19fc4a81-19af-46f0-adcc-b36fc70a64ff\") " pod="ai-tenant-e2e-mt-f446106b/e2e-lifecycle-model-f446106b-kserve-67bdc9c7f9-zz5vz"
Jul 21 17:44:02.300797 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:44:02.300697    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/19fc4a81-19af-46f0-adcc-b36fc70a64ff-tls-certs\") pod \"e2e-lifecycle-model-f446106b-kserve-67bdc9c7f9-zz5vz\" (UID: \"19fc4a81-19af-46f0-adcc-b36fc70a64ff\") " pod="ai-tenant-e2e-mt-f446106b/e2e-lifecycle-model-f446106b-kserve-67bdc9c7f9-zz5vz"
Jul 21 17:44:02.401323 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:44:02.401283    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/19fc4a81-19af-46f0-adcc-b36fc70a64ff-home\") pod \"e2e-lifecycle-model-f446106b-kserve-67bdc9c7f9-zz5vz\" (UID: \"19fc4a81-19af-46f0-adcc-b36fc70a64ff\") " pod="ai-tenant-e2e-mt-f446106b/e2e-lifecycle-model-f446106b-kserve-67bdc9c7f9-zz5vz"
Jul 21 17:44:02.401323 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:44:02.401325    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ctkxz\" (UniqueName: \"kubernetes.io/projected/19fc4a81-19af-46f0-adcc-b36fc70a64ff-kube-api-access-ctkxz\") pod \"e2e-lifecycle-model-f446106b-kserve-67bdc9c7f9-zz5vz\" (UID: \"19fc4a81-19af-46f0-adcc-b36fc70a64ff\") " pod="ai-tenant-e2e-mt-f446106b/e2e-lifecycle-model-f446106b-kserve-67bdc9c7f9-zz5vz"
Jul 21 17:44:02.401626 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:44:02.401370    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/19fc4a81-19af-46f0-adcc-b36fc70a64ff-dshm\") pod \"e2e-lifecycle-model-f446106b-kserve-67bdc9c7f9-zz5vz\" (UID: \"19fc4a81-19af-46f0-adcc-b36fc70a64ff\") " pod="ai-tenant-e2e-mt-f446106b/e2e-lifecycle-model-f446106b-kserve-67bdc9c7f9-zz5vz"
Jul 21 17:44:02.401626 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:44:02.401389    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/19fc4a81-19af-46f0-adcc-b36fc70a64ff-model-cache\") pod \"e2e-lifecycle-model-f446106b-kserve-67bdc9c7f9-zz5vz\" (UID: \"19fc4a81-19af-46f0-adcc-b36fc70a64ff\") " pod="ai-tenant-e2e-mt-f446106b/e2e-lifecycle-model-f446106b-kserve-67bdc9c7f9-zz5vz"
Jul 21 17:44:02.401626 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:44:02.401405    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/19fc4a81-19af-46f0-adcc-b36fc70a64ff-tmp-dir\") pod \"e2e-lifecycle-model-f446106b-kserve-67bdc9c7f9-zz5vz\" (UID: \"19fc4a81-19af-46f0-adcc-b36fc70a64ff\") " pod="ai-tenant-e2e-mt-f446106b/e2e-lifecycle-model-f446106b-kserve-67bdc9c7f9-zz5vz"
Jul 21 17:44:02.401626 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:44:02.401476    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/19fc4a81-19af-46f0-adcc-b36fc70a64ff-tls-certs\") pod \"e2e-lifecycle-model-f446106b-kserve-67bdc9c7f9-zz5vz\" (UID: \"19fc4a81-19af-46f0-adcc-b36fc70a64ff\") " pod="ai-tenant-e2e-mt-f446106b/e2e-lifecycle-model-f446106b-kserve-67bdc9c7f9-zz5vz"
Jul 21 17:44:02.401842 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:44:02.401811    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/19fc4a81-19af-46f0-adcc-b36fc70a64ff-home\") pod \"e2e-lifecycle-model-f446106b-kserve-67bdc9c7f9-zz5vz\" (UID: \"19fc4a81-19af-46f0-adcc-b36fc70a64ff\") " pod="ai-tenant-e2e-mt-f446106b/e2e-lifecycle-model-f446106b-kserve-67bdc9c7f9-zz5vz"
Jul 21 17:44:02.401894 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:44:02.401863    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/19fc4a81-19af-46f0-adcc-b36fc70a64ff-model-cache\") pod \"e2e-lifecycle-model-f446106b-kserve-67bdc9c7f9-zz5vz\" (UID: \"19fc4a81-19af-46f0-adcc-b36fc70a64ff\") " pod="ai-tenant-e2e-mt-f446106b/e2e-lifecycle-model-f446106b-kserve-67bdc9c7f9-zz5vz"
Jul 21 17:44:02.401933 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:44:02.401907    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/19fc4a81-19af-46f0-adcc-b36fc70a64ff-tmp-dir\") pod \"e2e-lifecycle-model-f446106b-kserve-67bdc9c7f9-zz5vz\" (UID: \"19fc4a81-19af-46f0-adcc-b36fc70a64ff\") " pod="ai-tenant-e2e-mt-f446106b/e2e-lifecycle-model-f446106b-kserve-67bdc9c7f9-zz5vz"
Jul 21 17:44:02.403848 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:44:02.403828    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/19fc4a81-19af-46f0-adcc-b36fc70a64ff-dshm\") pod \"e2e-lifecycle-model-f446106b-kserve-67bdc9c7f9-zz5vz\" (UID: \"19fc4a81-19af-46f0-adcc-b36fc70a64ff\") " pod="ai-tenant-e2e-mt-f446106b/e2e-lifecycle-model-f446106b-kserve-67bdc9c7f9-zz5vz"
Jul 21 17:44:02.403982 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:44:02.403963    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/19fc4a81-19af-46f0-adcc-b36fc70a64ff-tls-certs\") pod \"e2e-lifecycle-model-f446106b-kserve-67bdc9c7f9-zz5vz\" (UID: \"19fc4a81-19af-46f0-adcc-b36fc70a64ff\") " pod="ai-tenant-e2e-mt-f446106b/e2e-lifecycle-model-f446106b-kserve-67bdc9c7f9-zz5vz"
Jul 21 17:44:02.410305 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:44:02.410279    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ctkxz\" (UniqueName: \"kubernetes.io/projected/19fc4a81-19af-46f0-adcc-b36fc70a64ff-kube-api-access-ctkxz\") pod \"e2e-lifecycle-model-f446106b-kserve-67bdc9c7f9-zz5vz\" (UID: \"19fc4a81-19af-46f0-adcc-b36fc70a64ff\") " pod="ai-tenant-e2e-mt-f446106b/e2e-lifecycle-model-f446106b-kserve-67bdc9c7f9-zz5vz"
Jul 21 17:44:02.532540 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:44:02.532508    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-f446106b/e2e-lifecycle-model-f446106b-kserve-67bdc9c7f9-zz5vz"
Jul 21 17:44:02.673722 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:44:02.673687    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-mt-f446106b/e2e-lifecycle-model-f446106b-kserve-67bdc9c7f9-zz5vz"]
Jul 21 17:44:02.675519 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:44:02.675490    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod19fc4a81_19af_46f0_adcc_b36fc70a64ff.slice/crio-68b51c1355bac2fd43d50632b90145b2083b6cc41399922d3f566044061f29de WatchSource:0}: Error finding container 68b51c1355bac2fd43d50632b90145b2083b6cc41399922d3f566044061f29de: Status 404 returned error can't find the container with id 68b51c1355bac2fd43d50632b90145b2083b6cc41399922d3f566044061f29de
Jul 21 17:44:03.513480 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:44:03.513448    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-f446106b/e2e-lifecycle-model-f446106b-kserve-67bdc9c7f9-zz5vz" event={"ID":"19fc4a81-19af-46f0-adcc-b36fc70a64ff","Type":"ContainerStarted","Data":"5c1b8021e580cb5c497f105356e368c17bfdfb916fd3dec1d3faecbf82ee872f"}
Jul 21 17:44:03.513853 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:44:03.513492    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-f446106b/e2e-lifecycle-model-f446106b-kserve-67bdc9c7f9-zz5vz" event={"ID":"19fc4a81-19af-46f0-adcc-b36fc70a64ff","Type":"ContainerStarted","Data":"68b51c1355bac2fd43d50632b90145b2083b6cc41399922d3f566044061f29de"}
Jul 21 17:44:12.533232 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:44:12.533195    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-mt-f446106b/e2e-lifecycle-model-f446106b-kserve-67bdc9c7f9-zz5vz"
Jul 21 17:44:12.533704 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:44:12.533271    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-mt-f446106b/e2e-lifecycle-model-f446106b-kserve-67bdc9c7f9-zz5vz"
Jul 21 17:44:12.545928 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:44:12.545902    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-mt-f446106b/e2e-lifecycle-model-f446106b-kserve-67bdc9c7f9-zz5vz"
Jul 21 17:44:12.564711 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:44:12.564650    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-mt-f446106b/e2e-lifecycle-model-f446106b-kserve-67bdc9c7f9-zz5vz" podStartSLOduration=10.564629602 podStartE2EDuration="10.564629602s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 17:44:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 17:44:03.530567683 +0000 UTC m=+2135.984720326" watchObservedRunningTime="2026-07-21 17:44:12.564629602 +0000 UTC m=+2145.018782243"
Jul 21 17:44:12.568345 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:44:12.568324    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-mt-f446106b/e2e-lifecycle-model-f446106b-kserve-67bdc9c7f9-zz5vz"
Jul 21 17:44:43.506081 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:44:43.505994    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-f446106b-6bb6f9666b-8k5qg"]
Jul 21 17:44:43.506617 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:44:43.506285    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-mt-f446106b-6bb6f9666b-8k5qg" podUID="2adc6e08-a23b-41ae-b5f5-3f9b19a695ff" containerName="maas-api" containerID="cri-o://fa4488c56e9c4fb3e63bb39eb143656ad658c267394ca0fc2245033b9c3d0f67" gracePeriod=30
Jul 21 17:44:43.702930 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:44:43.702891    2575 generic.go:356] "Generic (PLEG): container finished" podID="2adc6e08-a23b-41ae-b5f5-3f9b19a695ff" containerID="fa4488c56e9c4fb3e63bb39eb143656ad658c267394ca0fc2245033b9c3d0f67" exitCode=0
Jul 21 17:44:43.702930 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:44:43.702917    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-f446106b-6bb6f9666b-8k5qg" event={"ID":"2adc6e08-a23b-41ae-b5f5-3f9b19a695ff","Type":"ContainerDied","Data":"fa4488c56e9c4fb3e63bb39eb143656ad658c267394ca0fc2245033b9c3d0f67"}
Jul 21 17:44:43.755855 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:44:43.755826    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-f446106b-6bb6f9666b-8k5qg"
Jul 21 17:44:43.882851 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:44:43.882764    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2adc6e08-a23b-41ae-b5f5-3f9b19a695ff-maas-api-tls\") pod \"2adc6e08-a23b-41ae-b5f5-3f9b19a695ff\" (UID: \"2adc6e08-a23b-41ae-b5f5-3f9b19a695ff\") "
Jul 21 17:44:43.883025 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:44:43.882895    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-x6j5g\" (UniqueName: \"kubernetes.io/projected/2adc6e08-a23b-41ae-b5f5-3f9b19a695ff-kube-api-access-x6j5g\") pod \"2adc6e08-a23b-41ae-b5f5-3f9b19a695ff\" (UID: \"2adc6e08-a23b-41ae-b5f5-3f9b19a695ff\") "
Jul 21 17:44:43.883025 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:44:43.882926    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2adc6e08-a23b-41ae-b5f5-3f9b19a695ff-openshift-service-ca\") pod \"2adc6e08-a23b-41ae-b5f5-3f9b19a695ff\" (UID: \"2adc6e08-a23b-41ae-b5f5-3f9b19a695ff\") "
Jul 21 17:44:43.883299 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:44:43.883269    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2adc6e08-a23b-41ae-b5f5-3f9b19a695ff-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "2adc6e08-a23b-41ae-b5f5-3f9b19a695ff" (UID: "2adc6e08-a23b-41ae-b5f5-3f9b19a695ff"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 17:44:43.884999 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:44:43.884978    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2adc6e08-a23b-41ae-b5f5-3f9b19a695ff-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "2adc6e08-a23b-41ae-b5f5-3f9b19a695ff" (UID: "2adc6e08-a23b-41ae-b5f5-3f9b19a695ff"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 21 17:44:43.885067 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:44:43.885046    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2adc6e08-a23b-41ae-b5f5-3f9b19a695ff-kube-api-access-x6j5g" (OuterVolumeSpecName: "kube-api-access-x6j5g") pod "2adc6e08-a23b-41ae-b5f5-3f9b19a695ff" (UID: "2adc6e08-a23b-41ae-b5f5-3f9b19a695ff"). InnerVolumeSpecName "kube-api-access-x6j5g". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 17:44:43.983955 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:44:43.983908    2575 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2adc6e08-a23b-41ae-b5f5-3f9b19a695ff-maas-api-tls\") on node \"ip-10-0-141-39.ec2.internal\" DevicePath \"\""
Jul 21 17:44:43.983955 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:44:43.983947    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-x6j5g\" (UniqueName: \"kubernetes.io/projected/2adc6e08-a23b-41ae-b5f5-3f9b19a695ff-kube-api-access-x6j5g\") on node \"ip-10-0-141-39.ec2.internal\" DevicePath \"\""
Jul 21 17:44:43.983955 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:44:43.983957    2575 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2adc6e08-a23b-41ae-b5f5-3f9b19a695ff-openshift-service-ca\") on node \"ip-10-0-141-39.ec2.internal\" DevicePath \"\""
Jul 21 17:44:44.709487 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:44:44.709462    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-f446106b-6bb6f9666b-8k5qg"
Jul 21 17:44:44.709921 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:44:44.709460    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-f446106b-6bb6f9666b-8k5qg" event={"ID":"2adc6e08-a23b-41ae-b5f5-3f9b19a695ff","Type":"ContainerDied","Data":"6c8ea118e10e143359e77498c37e41a18cd3a3345ebdba01d5a96538502ffd0c"}
Jul 21 17:44:44.709921 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:44:44.709589    2575 scope.go:117] "RemoveContainer" containerID="fa4488c56e9c4fb3e63bb39eb143656ad658c267394ca0fc2245033b9c3d0f67"
Jul 21 17:44:44.731944 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:44:44.731921    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-f446106b-6bb6f9666b-8k5qg"]
Jul 21 17:44:44.736158 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:44:44.736134    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-f446106b-6bb6f9666b-8k5qg"]
Jul 21 17:44:46.116409 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:44:46.116370    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2adc6e08-a23b-41ae-b5f5-3f9b19a695ff" path="/var/lib/kubelet/pods/2adc6e08-a23b-41ae-b5f5-3f9b19a695ff/volumes"
Jul 21 17:44:55.420950 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:44:55.420917    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-mt-f446106b/e2e-lifecycle-model-f446106b-kserve-67bdc9c7f9-zz5vz"]
Jul 21 17:45:10.441726 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:45:10.441665    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-mt-f446106b/e2e-lifecycle-model-f446106b-kserve-67bdc9c7f9-zz5vz" podUID="19fc4a81-19af-46f0-adcc-b36fc70a64ff" containerName="main" containerID="cri-o://5c1b8021e580cb5c497f105356e368c17bfdfb916fd3dec1d3faecbf82ee872f" gracePeriod=45
Jul 21 17:45:10.692204 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:45:10.692146    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-f446106b/e2e-lifecycle-model-f446106b-kserve-67bdc9c7f9-zz5vz"
Jul 21 17:45:10.729993 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:45:10.729954    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/19fc4a81-19af-46f0-adcc-b36fc70a64ff-home\") pod \"19fc4a81-19af-46f0-adcc-b36fc70a64ff\" (UID: \"19fc4a81-19af-46f0-adcc-b36fc70a64ff\") "
Jul 21 17:45:10.730166 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:45:10.730028    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/19fc4a81-19af-46f0-adcc-b36fc70a64ff-tls-certs\") pod \"19fc4a81-19af-46f0-adcc-b36fc70a64ff\" (UID: \"19fc4a81-19af-46f0-adcc-b36fc70a64ff\") "
Jul 21 17:45:10.730166 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:45:10.730076    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/19fc4a81-19af-46f0-adcc-b36fc70a64ff-dshm\") pod \"19fc4a81-19af-46f0-adcc-b36fc70a64ff\" (UID: \"19fc4a81-19af-46f0-adcc-b36fc70a64ff\") "
Jul 21 17:45:10.730291 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:45:10.730174    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/19fc4a81-19af-46f0-adcc-b36fc70a64ff-model-cache\") pod \"19fc4a81-19af-46f0-adcc-b36fc70a64ff\" (UID: \"19fc4a81-19af-46f0-adcc-b36fc70a64ff\") "
Jul 21 17:45:10.730291 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:45:10.730214    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ctkxz\" (UniqueName: \"kubernetes.io/projected/19fc4a81-19af-46f0-adcc-b36fc70a64ff-kube-api-access-ctkxz\") pod \"19fc4a81-19af-46f0-adcc-b36fc70a64ff\" (UID: \"19fc4a81-19af-46f0-adcc-b36fc70a64ff\") "
Jul 21 17:45:10.730291 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:45:10.730258    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/19fc4a81-19af-46f0-adcc-b36fc70a64ff-tmp-dir\") pod \"19fc4a81-19af-46f0-adcc-b36fc70a64ff\" (UID: \"19fc4a81-19af-46f0-adcc-b36fc70a64ff\") "
Jul 21 17:45:10.730478 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:45:10.730345    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/19fc4a81-19af-46f0-adcc-b36fc70a64ff-home" (OuterVolumeSpecName: "home") pod "19fc4a81-19af-46f0-adcc-b36fc70a64ff" (UID: "19fc4a81-19af-46f0-adcc-b36fc70a64ff"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 17:45:10.730478 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:45:10.730433    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/19fc4a81-19af-46f0-adcc-b36fc70a64ff-model-cache" (OuterVolumeSpecName: "model-cache") pod "19fc4a81-19af-46f0-adcc-b36fc70a64ff" (UID: "19fc4a81-19af-46f0-adcc-b36fc70a64ff"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 17:45:10.730610 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:45:10.730583    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/19fc4a81-19af-46f0-adcc-b36fc70a64ff-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "19fc4a81-19af-46f0-adcc-b36fc70a64ff" (UID: "19fc4a81-19af-46f0-adcc-b36fc70a64ff"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 17:45:10.730668 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:45:10.730658    2575 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/19fc4a81-19af-46f0-adcc-b36fc70a64ff-home\") on node \"ip-10-0-141-39.ec2.internal\" DevicePath \"\""
Jul 21 17:45:10.730734 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:45:10.730676    2575 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/19fc4a81-19af-46f0-adcc-b36fc70a64ff-model-cache\") on node \"ip-10-0-141-39.ec2.internal\" DevicePath \"\""
Jul 21 17:45:10.730734 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:45:10.730690    2575 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/19fc4a81-19af-46f0-adcc-b36fc70a64ff-tmp-dir\") on node \"ip-10-0-141-39.ec2.internal\" DevicePath \"\""
Jul 21 17:45:10.732548 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:45:10.732519    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/19fc4a81-19af-46f0-adcc-b36fc70a64ff-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "19fc4a81-19af-46f0-adcc-b36fc70a64ff" (UID: "19fc4a81-19af-46f0-adcc-b36fc70a64ff"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 21 17:45:10.732548 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:45:10.732519    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/19fc4a81-19af-46f0-adcc-b36fc70a64ff-dshm" (OuterVolumeSpecName: "dshm") pod "19fc4a81-19af-46f0-adcc-b36fc70a64ff" (UID: "19fc4a81-19af-46f0-adcc-b36fc70a64ff"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 17:45:10.732916 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:45:10.732889    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/19fc4a81-19af-46f0-adcc-b36fc70a64ff-kube-api-access-ctkxz" (OuterVolumeSpecName: "kube-api-access-ctkxz") pod "19fc4a81-19af-46f0-adcc-b36fc70a64ff" (UID: "19fc4a81-19af-46f0-adcc-b36fc70a64ff"). InnerVolumeSpecName "kube-api-access-ctkxz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 17:45:10.831072 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:45:10.831041    2575 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/19fc4a81-19af-46f0-adcc-b36fc70a64ff-tls-certs\") on node \"ip-10-0-141-39.ec2.internal\" DevicePath \"\""
Jul 21 17:45:10.831072 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:45:10.831068    2575 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/19fc4a81-19af-46f0-adcc-b36fc70a64ff-dshm\") on node \"ip-10-0-141-39.ec2.internal\" DevicePath \"\""
Jul 21 17:45:10.831072 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:45:10.831078    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ctkxz\" (UniqueName: \"kubernetes.io/projected/19fc4a81-19af-46f0-adcc-b36fc70a64ff-kube-api-access-ctkxz\") on node \"ip-10-0-141-39.ec2.internal\" DevicePath \"\""
Jul 21 17:45:10.832045 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:45:10.832020    2575 generic.go:356] "Generic (PLEG): container finished" podID="19fc4a81-19af-46f0-adcc-b36fc70a64ff" containerID="5c1b8021e580cb5c497f105356e368c17bfdfb916fd3dec1d3faecbf82ee872f" exitCode=0
Jul 21 17:45:10.832154 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:45:10.832056    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-f446106b/e2e-lifecycle-model-f446106b-kserve-67bdc9c7f9-zz5vz"
Jul 21 17:45:10.832154 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:45:10.832112    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-f446106b/e2e-lifecycle-model-f446106b-kserve-67bdc9c7f9-zz5vz" event={"ID":"19fc4a81-19af-46f0-adcc-b36fc70a64ff","Type":"ContainerDied","Data":"5c1b8021e580cb5c497f105356e368c17bfdfb916fd3dec1d3faecbf82ee872f"}
Jul 21 17:45:10.832154 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:45:10.832151    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-f446106b/e2e-lifecycle-model-f446106b-kserve-67bdc9c7f9-zz5vz" event={"ID":"19fc4a81-19af-46f0-adcc-b36fc70a64ff","Type":"ContainerDied","Data":"68b51c1355bac2fd43d50632b90145b2083b6cc41399922d3f566044061f29de"}
Jul 21 17:45:10.832254 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:45:10.832169    2575 scope.go:117] "RemoveContainer" containerID="5c1b8021e580cb5c497f105356e368c17bfdfb916fd3dec1d3faecbf82ee872f"
Jul 21 17:45:10.840886 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:45:10.840869    2575 scope.go:117] "RemoveContainer" containerID="5c1b8021e580cb5c497f105356e368c17bfdfb916fd3dec1d3faecbf82ee872f"
Jul 21 17:45:10.841125 ip-10-0-141-39 kubenswrapper[2575]: E0721 17:45:10.841107    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5c1b8021e580cb5c497f105356e368c17bfdfb916fd3dec1d3faecbf82ee872f\": container with ID starting with 5c1b8021e580cb5c497f105356e368c17bfdfb916fd3dec1d3faecbf82ee872f not found: ID does not exist" containerID="5c1b8021e580cb5c497f105356e368c17bfdfb916fd3dec1d3faecbf82ee872f"
Jul 21 17:45:10.841175 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:45:10.841132    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5c1b8021e580cb5c497f105356e368c17bfdfb916fd3dec1d3faecbf82ee872f"} err="failed to get container status \"5c1b8021e580cb5c497f105356e368c17bfdfb916fd3dec1d3faecbf82ee872f\": rpc error: code = NotFound desc = could not find container \"5c1b8021e580cb5c497f105356e368c17bfdfb916fd3dec1d3faecbf82ee872f\": container with ID starting with 5c1b8021e580cb5c497f105356e368c17bfdfb916fd3dec1d3faecbf82ee872f not found: ID does not exist"
Jul 21 17:45:10.872303 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:45:10.872272    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-mt-f446106b/e2e-lifecycle-model-f446106b-kserve-67bdc9c7f9-zz5vz"]
Jul 21 17:45:10.878723 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:45:10.878701    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-mt-f446106b/e2e-lifecycle-model-f446106b-kserve-67bdc9c7f9-zz5vz"]
Jul 21 17:45:12.116467 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:45:12.116409    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="19fc4a81-19af-46f0-adcc-b36fc70a64ff" path="/var/lib/kubelet/pods/19fc4a81-19af-46f0-adcc-b36fc70a64ff/volumes"
Jul 21 17:46:37.985118 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:46:37.985081    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-d1fcb9-554d954c6-fk6gb"]
Jul 21 17:46:37.985753 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:46:37.985531    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="19fc4a81-19af-46f0-adcc-b36fc70a64ff" containerName="main"
Jul 21 17:46:37.985753 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:46:37.985545    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="19fc4a81-19af-46f0-adcc-b36fc70a64ff" containerName="main"
Jul 21 17:46:37.985753 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:46:37.985556    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2adc6e08-a23b-41ae-b5f5-3f9b19a695ff" containerName="maas-api"
Jul 21 17:46:37.985753 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:46:37.985562    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="2adc6e08-a23b-41ae-b5f5-3f9b19a695ff" containerName="maas-api"
Jul 21 17:46:37.985753 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:46:37.985622    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="2adc6e08-a23b-41ae-b5f5-3f9b19a695ff" containerName="maas-api"
Jul 21 17:46:37.985753 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:46:37.985632    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="19fc4a81-19af-46f0-adcc-b36fc70a64ff" containerName="main"
Jul 21 17:46:37.988493 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:46:37.988474    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-d1fcb9-554d954c6-fk6gb"
Jul 21 17:46:37.992538 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:46:37.992511    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-inf-a-d1fcb9-serving-cert\""
Jul 21 17:46:38.002141 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:46:38.002117    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-d1fcb9-554d954c6-fk6gb"]
Jul 21 17:46:38.120834 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:46:38.120800    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2c2e6e9c-e85a-4ced-9dbb-4cf1cbdf9c2e-openshift-service-ca\") pod \"maas-api-e2e-inf-a-d1fcb9-554d954c6-fk6gb\" (UID: \"2c2e6e9c-e85a-4ced-9dbb-4cf1cbdf9c2e\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-d1fcb9-554d954c6-fk6gb"
Jul 21 17:46:38.121019 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:46:38.120865    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2c2e6e9c-e85a-4ced-9dbb-4cf1cbdf9c2e-maas-api-tls\") pod \"maas-api-e2e-inf-a-d1fcb9-554d954c6-fk6gb\" (UID: \"2c2e6e9c-e85a-4ced-9dbb-4cf1cbdf9c2e\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-d1fcb9-554d954c6-fk6gb"
Jul 21 17:46:38.121019 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:46:38.120914    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dm7xf\" (UniqueName: \"kubernetes.io/projected/2c2e6e9c-e85a-4ced-9dbb-4cf1cbdf9c2e-kube-api-access-dm7xf\") pod \"maas-api-e2e-inf-a-d1fcb9-554d954c6-fk6gb\" (UID: \"2c2e6e9c-e85a-4ced-9dbb-4cf1cbdf9c2e\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-d1fcb9-554d954c6-fk6gb"
Jul 21 17:46:38.221922 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:46:38.221887    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dm7xf\" (UniqueName: \"kubernetes.io/projected/2c2e6e9c-e85a-4ced-9dbb-4cf1cbdf9c2e-kube-api-access-dm7xf\") pod \"maas-api-e2e-inf-a-d1fcb9-554d954c6-fk6gb\" (UID: \"2c2e6e9c-e85a-4ced-9dbb-4cf1cbdf9c2e\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-d1fcb9-554d954c6-fk6gb"
Jul 21 17:46:38.222066 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:46:38.222006    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2c2e6e9c-e85a-4ced-9dbb-4cf1cbdf9c2e-openshift-service-ca\") pod \"maas-api-e2e-inf-a-d1fcb9-554d954c6-fk6gb\" (UID: \"2c2e6e9c-e85a-4ced-9dbb-4cf1cbdf9c2e\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-d1fcb9-554d954c6-fk6gb"
Jul 21 17:46:38.222066 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:46:38.222057    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2c2e6e9c-e85a-4ced-9dbb-4cf1cbdf9c2e-maas-api-tls\") pod \"maas-api-e2e-inf-a-d1fcb9-554d954c6-fk6gb\" (UID: \"2c2e6e9c-e85a-4ced-9dbb-4cf1cbdf9c2e\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-d1fcb9-554d954c6-fk6gb"
Jul 21 17:46:38.222248 ip-10-0-141-39 kubenswrapper[2575]: E0721 17:46:38.222229    2575 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-inf-a-d1fcb9-serving-cert: secret "maas-api-e2e-inf-a-d1fcb9-serving-cert" not found
Jul 21 17:46:38.222316 ip-10-0-141-39 kubenswrapper[2575]: E0721 17:46:38.222306    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2c2e6e9c-e85a-4ced-9dbb-4cf1cbdf9c2e-maas-api-tls podName:2c2e6e9c-e85a-4ced-9dbb-4cf1cbdf9c2e nodeName:}" failed. No retries permitted until 2026-07-21 17:46:38.722282999 +0000 UTC m=+2291.176435630 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/2c2e6e9c-e85a-4ced-9dbb-4cf1cbdf9c2e-maas-api-tls") pod "maas-api-e2e-inf-a-d1fcb9-554d954c6-fk6gb" (UID: "2c2e6e9c-e85a-4ced-9dbb-4cf1cbdf9c2e") : secret "maas-api-e2e-inf-a-d1fcb9-serving-cert" not found
Jul 21 17:46:38.222713 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:46:38.222693    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2c2e6e9c-e85a-4ced-9dbb-4cf1cbdf9c2e-openshift-service-ca\") pod \"maas-api-e2e-inf-a-d1fcb9-554d954c6-fk6gb\" (UID: \"2c2e6e9c-e85a-4ced-9dbb-4cf1cbdf9c2e\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-d1fcb9-554d954c6-fk6gb"
Jul 21 17:46:38.230274 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:46:38.230241    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dm7xf\" (UniqueName: \"kubernetes.io/projected/2c2e6e9c-e85a-4ced-9dbb-4cf1cbdf9c2e-kube-api-access-dm7xf\") pod \"maas-api-e2e-inf-a-d1fcb9-554d954c6-fk6gb\" (UID: \"2c2e6e9c-e85a-4ced-9dbb-4cf1cbdf9c2e\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-d1fcb9-554d954c6-fk6gb"
Jul 21 17:46:38.726812 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:46:38.726778    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2c2e6e9c-e85a-4ced-9dbb-4cf1cbdf9c2e-maas-api-tls\") pod \"maas-api-e2e-inf-a-d1fcb9-554d954c6-fk6gb\" (UID: \"2c2e6e9c-e85a-4ced-9dbb-4cf1cbdf9c2e\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-d1fcb9-554d954c6-fk6gb"
Jul 21 17:46:38.729366 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:46:38.729342    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2c2e6e9c-e85a-4ced-9dbb-4cf1cbdf9c2e-maas-api-tls\") pod \"maas-api-e2e-inf-a-d1fcb9-554d954c6-fk6gb\" (UID: \"2c2e6e9c-e85a-4ced-9dbb-4cf1cbdf9c2e\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-d1fcb9-554d954c6-fk6gb"
Jul 21 17:46:38.899576 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:46:38.899545    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-d1fcb9-554d954c6-fk6gb"
Jul 21 17:46:39.033130 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:46:39.033102    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-d1fcb9-554d954c6-fk6gb"]
Jul 21 17:46:39.035789 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:46:39.035753    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2c2e6e9c_e85a_4ced_9dbb_4cf1cbdf9c2e.slice/crio-d03cb833440b1480b0be6a9592c4f448fb885be390799a3f7d8d7df16d1f32f2 WatchSource:0}: Error finding container d03cb833440b1480b0be6a9592c4f448fb885be390799a3f7d8d7df16d1f32f2: Status 404 returned error can't find the container with id d03cb833440b1480b0be6a9592c4f448fb885be390799a3f7d8d7df16d1f32f2
Jul 21 17:46:39.232273 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:46:39.232236    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-d1fcb9-554d954c6-fk6gb" event={"ID":"2c2e6e9c-e85a-4ced-9dbb-4cf1cbdf9c2e","Type":"ContainerStarted","Data":"d03cb833440b1480b0be6a9592c4f448fb885be390799a3f7d8d7df16d1f32f2"}
Jul 21 17:46:40.238115 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:46:40.238079    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-d1fcb9-554d954c6-fk6gb" event={"ID":"2c2e6e9c-e85a-4ced-9dbb-4cf1cbdf9c2e","Type":"ContainerStarted","Data":"101b5455d380716b509d316a3002629932155eb8adc6660d866db7094aa5b395"}
Jul 21 17:46:40.238531 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:46:40.238161    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-d1fcb9-554d954c6-fk6gb"
Jul 21 17:46:40.256681 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:46:40.256632    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-d1fcb9-554d954c6-fk6gb" podStartSLOduration=2.683452797 podStartE2EDuration="3.25661869s" totalImagesPullingTime="573.165893ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 17:46:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 17:46:40.255439752 +0000 UTC m=+2292.709592392" watchObservedRunningTime="2026-07-21 17:46:40.25661869 +0000 UTC m=+2292.710771330"
Jul 21 17:46:45.917649 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:46:45.917619    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-95fd83-674d978d95-kv6gv"]
Jul 21 17:46:45.921240 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:46:45.921218    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-95fd83-674d978d95-kv6gv"
Jul 21 17:46:45.925140 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:46:45.924780    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-inf-b-95fd83-serving-cert\""
Jul 21 17:46:45.942681 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:46:45.942661    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-95fd83-674d978d95-kv6gv"]
Jul 21 17:46:45.993831 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:46:45.993800    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8ckqd\" (UniqueName: \"kubernetes.io/projected/8845e417-b7bf-41dc-b00a-7305d9677e6a-kube-api-access-8ckqd\") pod \"maas-api-e2e-inf-b-95fd83-674d978d95-kv6gv\" (UID: \"8845e417-b7bf-41dc-b00a-7305d9677e6a\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-95fd83-674d978d95-kv6gv"
Jul 21 17:46:45.993976 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:46:45.993873    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8845e417-b7bf-41dc-b00a-7305d9677e6a-openshift-service-ca\") pod \"maas-api-e2e-inf-b-95fd83-674d978d95-kv6gv\" (UID: \"8845e417-b7bf-41dc-b00a-7305d9677e6a\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-95fd83-674d978d95-kv6gv"
Jul 21 17:46:45.993976 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:46:45.993921    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8845e417-b7bf-41dc-b00a-7305d9677e6a-maas-api-tls\") pod \"maas-api-e2e-inf-b-95fd83-674d978d95-kv6gv\" (UID: \"8845e417-b7bf-41dc-b00a-7305d9677e6a\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-95fd83-674d978d95-kv6gv"
Jul 21 17:46:46.094334 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:46:46.094302    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8845e417-b7bf-41dc-b00a-7305d9677e6a-openshift-service-ca\") pod \"maas-api-e2e-inf-b-95fd83-674d978d95-kv6gv\" (UID: \"8845e417-b7bf-41dc-b00a-7305d9677e6a\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-95fd83-674d978d95-kv6gv"
Jul 21 17:46:46.094556 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:46:46.094353    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8845e417-b7bf-41dc-b00a-7305d9677e6a-maas-api-tls\") pod \"maas-api-e2e-inf-b-95fd83-674d978d95-kv6gv\" (UID: \"8845e417-b7bf-41dc-b00a-7305d9677e6a\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-95fd83-674d978d95-kv6gv"
Jul 21 17:46:46.094556 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:46:46.094405    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8ckqd\" (UniqueName: \"kubernetes.io/projected/8845e417-b7bf-41dc-b00a-7305d9677e6a-kube-api-access-8ckqd\") pod \"maas-api-e2e-inf-b-95fd83-674d978d95-kv6gv\" (UID: \"8845e417-b7bf-41dc-b00a-7305d9677e6a\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-95fd83-674d978d95-kv6gv"
Jul 21 17:46:46.094691 ip-10-0-141-39 kubenswrapper[2575]: E0721 17:46:46.094552    2575 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-inf-b-95fd83-serving-cert: secret "maas-api-e2e-inf-b-95fd83-serving-cert" not found
Jul 21 17:46:46.094691 ip-10-0-141-39 kubenswrapper[2575]: E0721 17:46:46.094628    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8845e417-b7bf-41dc-b00a-7305d9677e6a-maas-api-tls podName:8845e417-b7bf-41dc-b00a-7305d9677e6a nodeName:}" failed. No retries permitted until 2026-07-21 17:46:46.594606413 +0000 UTC m=+2299.048759033 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/8845e417-b7bf-41dc-b00a-7305d9677e6a-maas-api-tls") pod "maas-api-e2e-inf-b-95fd83-674d978d95-kv6gv" (UID: "8845e417-b7bf-41dc-b00a-7305d9677e6a") : secret "maas-api-e2e-inf-b-95fd83-serving-cert" not found
Jul 21 17:46:46.095136 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:46:46.095118    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8845e417-b7bf-41dc-b00a-7305d9677e6a-openshift-service-ca\") pod \"maas-api-e2e-inf-b-95fd83-674d978d95-kv6gv\" (UID: \"8845e417-b7bf-41dc-b00a-7305d9677e6a\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-95fd83-674d978d95-kv6gv"
Jul 21 17:46:46.104182 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:46:46.104156    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8ckqd\" (UniqueName: \"kubernetes.io/projected/8845e417-b7bf-41dc-b00a-7305d9677e6a-kube-api-access-8ckqd\") pod \"maas-api-e2e-inf-b-95fd83-674d978d95-kv6gv\" (UID: \"8845e417-b7bf-41dc-b00a-7305d9677e6a\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-95fd83-674d978d95-kv6gv"
Jul 21 17:46:46.247980 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:46:46.247944    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-d1fcb9-554d954c6-fk6gb"
Jul 21 17:46:46.599482 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:46:46.599392    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8845e417-b7bf-41dc-b00a-7305d9677e6a-maas-api-tls\") pod \"maas-api-e2e-inf-b-95fd83-674d978d95-kv6gv\" (UID: \"8845e417-b7bf-41dc-b00a-7305d9677e6a\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-95fd83-674d978d95-kv6gv"
Jul 21 17:46:46.601946 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:46:46.601921    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8845e417-b7bf-41dc-b00a-7305d9677e6a-maas-api-tls\") pod \"maas-api-e2e-inf-b-95fd83-674d978d95-kv6gv\" (UID: \"8845e417-b7bf-41dc-b00a-7305d9677e6a\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-95fd83-674d978d95-kv6gv"
Jul 21 17:46:46.834925 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:46:46.834884    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-95fd83-674d978d95-kv6gv"
Jul 21 17:46:46.975255 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:46:46.975232    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-95fd83-674d978d95-kv6gv"]
Jul 21 17:46:46.978664 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:46:46.978627    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8845e417_b7bf_41dc_b00a_7305d9677e6a.slice/crio-5583d16971684073a7372bbefb2e84c0bb4f0da2ac5a36b8c9df32bc6f5b5b17 WatchSource:0}: Error finding container 5583d16971684073a7372bbefb2e84c0bb4f0da2ac5a36b8c9df32bc6f5b5b17: Status 404 returned error can't find the container with id 5583d16971684073a7372bbefb2e84c0bb4f0da2ac5a36b8c9df32bc6f5b5b17
Jul 21 17:46:47.273904 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:46:47.273871    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-95fd83-674d978d95-kv6gv" event={"ID":"8845e417-b7bf-41dc-b00a-7305d9677e6a","Type":"ContainerStarted","Data":"5583d16971684073a7372bbefb2e84c0bb4f0da2ac5a36b8c9df32bc6f5b5b17"}
Jul 21 17:46:48.279175 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:46:48.279144    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-95fd83-674d978d95-kv6gv" event={"ID":"8845e417-b7bf-41dc-b00a-7305d9677e6a","Type":"ContainerStarted","Data":"fc5e91d20e92410848b83b00bd9dc7c68f06bfce37d321a0ba247efd0eff33ba"}
Jul 21 17:46:48.279581 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:46:48.279213    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-95fd83-674d978d95-kv6gv"
Jul 21 17:46:48.296845 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:46:48.296786    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-95fd83-674d978d95-kv6gv" podStartSLOduration=2.908264005 podStartE2EDuration="3.296771889s" totalImagesPullingTime="388.507884ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 17:46:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 17:46:48.294810838 +0000 UTC m=+2300.748963470" watchObservedRunningTime="2026-07-21 17:46:48.296771889 +0000 UTC m=+2300.750924526"
Jul 21 17:46:54.289373 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:46:54.289345    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-95fd83-674d978d95-kv6gv"
Jul 21 17:46:54.910091 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:46:54.910050    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-a-d1fcb9/test-model-d1fcb9-kserve-f9f58fd99-bhj6n"]
Jul 21 17:46:54.913637 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:46:54.913616    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-d1fcb9/test-model-d1fcb9-kserve-f9f58fd99-bhj6n"
Jul 21 17:46:54.915968 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:46:54.915948    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-d1fcb9\"/\"test-model-d1fcb9-kserve-self-signed-certs\""
Jul 21 17:46:54.917092 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:46:54.917068    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-d1fcb9\"/\"default-dockercfg-m28s9\""
Jul 21 17:46:54.917279 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:46:54.917106    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-d1fcb9\"/\"kube-root-ca.crt\""
Jul 21 17:46:54.917279 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:46:54.917195    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-d1fcb9\"/\"openshift-service-ca.crt\""
Jul 21 17:46:54.923275 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:46:54.923254    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-d1fcb9/test-model-d1fcb9-kserve-f9f58fd99-bhj6n"]
Jul 21 17:46:54.974770 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:46:54.974732    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cd63347a-206a-477e-ad07-d9287991e551-tls-certs\") pod \"test-model-d1fcb9-kserve-f9f58fd99-bhj6n\" (UID: \"cd63347a-206a-477e-ad07-d9287991e551\") " pod="ai-tenant-e2e-inf-a-d1fcb9/test-model-d1fcb9-kserve-f9f58fd99-bhj6n"
Jul 21 17:46:54.974952 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:46:54.974806    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/cd63347a-206a-477e-ad07-d9287991e551-model-cache\") pod \"test-model-d1fcb9-kserve-f9f58fd99-bhj6n\" (UID: \"cd63347a-206a-477e-ad07-d9287991e551\") " pod="ai-tenant-e2e-inf-a-d1fcb9/test-model-d1fcb9-kserve-f9f58fd99-bhj6n"
Jul 21 17:46:54.974952 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:46:54.974853    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4hs5t\" (UniqueName: \"kubernetes.io/projected/cd63347a-206a-477e-ad07-d9287991e551-kube-api-access-4hs5t\") pod \"test-model-d1fcb9-kserve-f9f58fd99-bhj6n\" (UID: \"cd63347a-206a-477e-ad07-d9287991e551\") " pod="ai-tenant-e2e-inf-a-d1fcb9/test-model-d1fcb9-kserve-f9f58fd99-bhj6n"
Jul 21 17:46:54.974952 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:46:54.974912    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/cd63347a-206a-477e-ad07-d9287991e551-dshm\") pod \"test-model-d1fcb9-kserve-f9f58fd99-bhj6n\" (UID: \"cd63347a-206a-477e-ad07-d9287991e551\") " pod="ai-tenant-e2e-inf-a-d1fcb9/test-model-d1fcb9-kserve-f9f58fd99-bhj6n"
Jul 21 17:46:54.974952 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:46:54.974930    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cd63347a-206a-477e-ad07-d9287991e551-tmp-dir\") pod \"test-model-d1fcb9-kserve-f9f58fd99-bhj6n\" (UID: \"cd63347a-206a-477e-ad07-d9287991e551\") " pod="ai-tenant-e2e-inf-a-d1fcb9/test-model-d1fcb9-kserve-f9f58fd99-bhj6n"
Jul 21 17:46:54.975116 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:46:54.974969    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/cd63347a-206a-477e-ad07-d9287991e551-home\") pod \"test-model-d1fcb9-kserve-f9f58fd99-bhj6n\" (UID: \"cd63347a-206a-477e-ad07-d9287991e551\") " pod="ai-tenant-e2e-inf-a-d1fcb9/test-model-d1fcb9-kserve-f9f58fd99-bhj6n"
Jul 21 17:46:55.076330 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:46:55.076294    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/cd63347a-206a-477e-ad07-d9287991e551-model-cache\") pod \"test-model-d1fcb9-kserve-f9f58fd99-bhj6n\" (UID: \"cd63347a-206a-477e-ad07-d9287991e551\") " pod="ai-tenant-e2e-inf-a-d1fcb9/test-model-d1fcb9-kserve-f9f58fd99-bhj6n"
Jul 21 17:46:55.076330 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:46:55.076327    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4hs5t\" (UniqueName: \"kubernetes.io/projected/cd63347a-206a-477e-ad07-d9287991e551-kube-api-access-4hs5t\") pod \"test-model-d1fcb9-kserve-f9f58fd99-bhj6n\" (UID: \"cd63347a-206a-477e-ad07-d9287991e551\") " pod="ai-tenant-e2e-inf-a-d1fcb9/test-model-d1fcb9-kserve-f9f58fd99-bhj6n"
Jul 21 17:46:55.076616 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:46:55.076364    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/cd63347a-206a-477e-ad07-d9287991e551-dshm\") pod \"test-model-d1fcb9-kserve-f9f58fd99-bhj6n\" (UID: \"cd63347a-206a-477e-ad07-d9287991e551\") " pod="ai-tenant-e2e-inf-a-d1fcb9/test-model-d1fcb9-kserve-f9f58fd99-bhj6n"
Jul 21 17:46:55.076616 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:46:55.076382    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cd63347a-206a-477e-ad07-d9287991e551-tmp-dir\") pod \"test-model-d1fcb9-kserve-f9f58fd99-bhj6n\" (UID: \"cd63347a-206a-477e-ad07-d9287991e551\") " pod="ai-tenant-e2e-inf-a-d1fcb9/test-model-d1fcb9-kserve-f9f58fd99-bhj6n"
Jul 21 17:46:55.076616 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:46:55.076504    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/cd63347a-206a-477e-ad07-d9287991e551-home\") pod \"test-model-d1fcb9-kserve-f9f58fd99-bhj6n\" (UID: \"cd63347a-206a-477e-ad07-d9287991e551\") " pod="ai-tenant-e2e-inf-a-d1fcb9/test-model-d1fcb9-kserve-f9f58fd99-bhj6n"
Jul 21 17:46:55.076616 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:46:55.076595    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cd63347a-206a-477e-ad07-d9287991e551-tls-certs\") pod \"test-model-d1fcb9-kserve-f9f58fd99-bhj6n\" (UID: \"cd63347a-206a-477e-ad07-d9287991e551\") " pod="ai-tenant-e2e-inf-a-d1fcb9/test-model-d1fcb9-kserve-f9f58fd99-bhj6n"
Jul 21 17:46:55.076826 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:46:55.076751    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cd63347a-206a-477e-ad07-d9287991e551-tmp-dir\") pod \"test-model-d1fcb9-kserve-f9f58fd99-bhj6n\" (UID: \"cd63347a-206a-477e-ad07-d9287991e551\") " pod="ai-tenant-e2e-inf-a-d1fcb9/test-model-d1fcb9-kserve-f9f58fd99-bhj6n"
Jul 21 17:46:55.076884 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:46:55.076842    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/cd63347a-206a-477e-ad07-d9287991e551-model-cache\") pod \"test-model-d1fcb9-kserve-f9f58fd99-bhj6n\" (UID: \"cd63347a-206a-477e-ad07-d9287991e551\") " pod="ai-tenant-e2e-inf-a-d1fcb9/test-model-d1fcb9-kserve-f9f58fd99-bhj6n"
Jul 21 17:46:55.076884 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:46:55.076851    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/cd63347a-206a-477e-ad07-d9287991e551-home\") pod \"test-model-d1fcb9-kserve-f9f58fd99-bhj6n\" (UID: \"cd63347a-206a-477e-ad07-d9287991e551\") " pod="ai-tenant-e2e-inf-a-d1fcb9/test-model-d1fcb9-kserve-f9f58fd99-bhj6n"
Jul 21 17:46:55.078770 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:46:55.078739    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/cd63347a-206a-477e-ad07-d9287991e551-dshm\") pod \"test-model-d1fcb9-kserve-f9f58fd99-bhj6n\" (UID: \"cd63347a-206a-477e-ad07-d9287991e551\") " pod="ai-tenant-e2e-inf-a-d1fcb9/test-model-d1fcb9-kserve-f9f58fd99-bhj6n"
Jul 21 17:46:55.078979 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:46:55.078962    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cd63347a-206a-477e-ad07-d9287991e551-tls-certs\") pod \"test-model-d1fcb9-kserve-f9f58fd99-bhj6n\" (UID: \"cd63347a-206a-477e-ad07-d9287991e551\") " pod="ai-tenant-e2e-inf-a-d1fcb9/test-model-d1fcb9-kserve-f9f58fd99-bhj6n"
Jul 21 17:46:55.084795 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:46:55.084773    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4hs5t\" (UniqueName: \"kubernetes.io/projected/cd63347a-206a-477e-ad07-d9287991e551-kube-api-access-4hs5t\") pod \"test-model-d1fcb9-kserve-f9f58fd99-bhj6n\" (UID: \"cd63347a-206a-477e-ad07-d9287991e551\") " pod="ai-tenant-e2e-inf-a-d1fcb9/test-model-d1fcb9-kserve-f9f58fd99-bhj6n"
Jul 21 17:46:55.224598 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:46:55.224508    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-d1fcb9/test-model-d1fcb9-kserve-f9f58fd99-bhj6n"
Jul 21 17:46:55.366744 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:46:55.366676    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-d1fcb9/test-model-d1fcb9-kserve-f9f58fd99-bhj6n"]
Jul 21 17:46:55.369341 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:46:55.369301    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podcd63347a_206a_477e_ad07_d9287991e551.slice/crio-b02e27674418cf8ed8a5b81f29e5e29be752ec17b96904ee317c052948c72960 WatchSource:0}: Error finding container b02e27674418cf8ed8a5b81f29e5e29be752ec17b96904ee317c052948c72960: Status 404 returned error can't find the container with id b02e27674418cf8ed8a5b81f29e5e29be752ec17b96904ee317c052948c72960
Jul 21 17:46:56.318263 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:46:56.318232    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-d1fcb9/test-model-d1fcb9-kserve-f9f58fd99-bhj6n" event={"ID":"cd63347a-206a-477e-ad07-d9287991e551","Type":"ContainerStarted","Data":"03fc89f3b095862e2944b872eacfeb74732968e9c7f822e71ed25988c8ef01c3"}
Jul 21 17:46:56.318490 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:46:56.318270    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-d1fcb9/test-model-d1fcb9-kserve-f9f58fd99-bhj6n" event={"ID":"cd63347a-206a-477e-ad07-d9287991e551","Type":"ContainerStarted","Data":"b02e27674418cf8ed8a5b81f29e5e29be752ec17b96904ee317c052948c72960"}
Jul 21 17:46:56.338757 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:46:56.338707    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-a-d1fcb9/test-model-d1fcb9-kserve-f9f58fd99-bhj6n" podStartSLOduration=2.33869092 podStartE2EDuration="2.33869092s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 17:46:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 17:46:56.338100554 +0000 UTC m=+2308.792253191" watchObservedRunningTime="2026-07-21 17:46:56.33869092 +0000 UTC m=+2308.792843559"
Jul 21 17:47:05.225068 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:47:05.225020    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-a-d1fcb9/test-model-d1fcb9-kserve-f9f58fd99-bhj6n"
Jul 21 17:47:05.225478 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:47:05.225094    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-a-d1fcb9/test-model-d1fcb9-kserve-f9f58fd99-bhj6n"
Jul 21 17:47:05.237704 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:47:05.237681    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-a-d1fcb9/test-model-d1fcb9-kserve-f9f58fd99-bhj6n"
Jul 21 17:47:05.369746 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:47:05.369713    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-a-d1fcb9/test-model-d1fcb9-kserve-f9f58fd99-bhj6n"
Jul 21 17:48:28.554609 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:48:28.554581    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-b64gx_9425e519-d00c-4af6-a68a-3efde7aae5ba/ovn-acl-logging/0.log"
Jul 21 17:48:28.566071 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:48:28.566051    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-b64gx_9425e519-d00c-4af6-a68a-3efde7aae5ba/ovn-acl-logging/0.log"
Jul 21 17:48:41.099573 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:48:41.099540    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-d1fcb9/test-model-d1fcb9-kserve-f9f58fd99-bhj6n"]
Jul 21 17:48:52.519732 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:48:52.519643    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-d1fcb9-554d954c6-fk6gb"]
Jul 21 17:48:52.520164 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:48:52.519870    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-d1fcb9-554d954c6-fk6gb" podUID="2c2e6e9c-e85a-4ced-9dbb-4cf1cbdf9c2e" containerName="maas-api" containerID="cri-o://101b5455d380716b509d316a3002629932155eb8adc6660d866db7094aa5b395" gracePeriod=30
Jul 21 17:48:52.766999 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:48:52.766976    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-d1fcb9-554d954c6-fk6gb"
Jul 21 17:48:52.850959 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:48:52.850855    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dm7xf\" (UniqueName: \"kubernetes.io/projected/2c2e6e9c-e85a-4ced-9dbb-4cf1cbdf9c2e-kube-api-access-dm7xf\") pod \"2c2e6e9c-e85a-4ced-9dbb-4cf1cbdf9c2e\" (UID: \"2c2e6e9c-e85a-4ced-9dbb-4cf1cbdf9c2e\") "
Jul 21 17:48:52.851139 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:48:52.850995    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2c2e6e9c-e85a-4ced-9dbb-4cf1cbdf9c2e-maas-api-tls\") pod \"2c2e6e9c-e85a-4ced-9dbb-4cf1cbdf9c2e\" (UID: \"2c2e6e9c-e85a-4ced-9dbb-4cf1cbdf9c2e\") "
Jul 21 17:48:52.851139 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:48:52.851027    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2c2e6e9c-e85a-4ced-9dbb-4cf1cbdf9c2e-openshift-service-ca\") pod \"2c2e6e9c-e85a-4ced-9dbb-4cf1cbdf9c2e\" (UID: \"2c2e6e9c-e85a-4ced-9dbb-4cf1cbdf9c2e\") "
Jul 21 17:48:52.851430 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:48:52.851377    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2c2e6e9c-e85a-4ced-9dbb-4cf1cbdf9c2e-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "2c2e6e9c-e85a-4ced-9dbb-4cf1cbdf9c2e" (UID: "2c2e6e9c-e85a-4ced-9dbb-4cf1cbdf9c2e"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 17:48:52.853273 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:48:52.853240    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2c2e6e9c-e85a-4ced-9dbb-4cf1cbdf9c2e-kube-api-access-dm7xf" (OuterVolumeSpecName: "kube-api-access-dm7xf") pod "2c2e6e9c-e85a-4ced-9dbb-4cf1cbdf9c2e" (UID: "2c2e6e9c-e85a-4ced-9dbb-4cf1cbdf9c2e"). InnerVolumeSpecName "kube-api-access-dm7xf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 17:48:52.853715 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:48:52.853692    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2c2e6e9c-e85a-4ced-9dbb-4cf1cbdf9c2e-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "2c2e6e9c-e85a-4ced-9dbb-4cf1cbdf9c2e" (UID: "2c2e6e9c-e85a-4ced-9dbb-4cf1cbdf9c2e"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 21 17:48:52.855781 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:48:52.855759    2575 generic.go:356] "Generic (PLEG): container finished" podID="2c2e6e9c-e85a-4ced-9dbb-4cf1cbdf9c2e" containerID="101b5455d380716b509d316a3002629932155eb8adc6660d866db7094aa5b395" exitCode=0
Jul 21 17:48:52.855897 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:48:52.855804    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-d1fcb9-554d954c6-fk6gb"
Jul 21 17:48:52.855897 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:48:52.855846    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-d1fcb9-554d954c6-fk6gb" event={"ID":"2c2e6e9c-e85a-4ced-9dbb-4cf1cbdf9c2e","Type":"ContainerDied","Data":"101b5455d380716b509d316a3002629932155eb8adc6660d866db7094aa5b395"}
Jul 21 17:48:52.856048 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:48:52.855907    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-d1fcb9-554d954c6-fk6gb" event={"ID":"2c2e6e9c-e85a-4ced-9dbb-4cf1cbdf9c2e","Type":"ContainerDied","Data":"d03cb833440b1480b0be6a9592c4f448fb885be390799a3f7d8d7df16d1f32f2"}
Jul 21 17:48:52.856048 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:48:52.855940    2575 scope.go:117] "RemoveContainer" containerID="101b5455d380716b509d316a3002629932155eb8adc6660d866db7094aa5b395"
Jul 21 17:48:52.870669 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:48:52.870652    2575 scope.go:117] "RemoveContainer" containerID="101b5455d380716b509d316a3002629932155eb8adc6660d866db7094aa5b395"
Jul 21 17:48:52.870925 ip-10-0-141-39 kubenswrapper[2575]: E0721 17:48:52.870905    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"101b5455d380716b509d316a3002629932155eb8adc6660d866db7094aa5b395\": container with ID starting with 101b5455d380716b509d316a3002629932155eb8adc6660d866db7094aa5b395 not found: ID does not exist" containerID="101b5455d380716b509d316a3002629932155eb8adc6660d866db7094aa5b395"
Jul 21 17:48:52.870987 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:48:52.870934    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"101b5455d380716b509d316a3002629932155eb8adc6660d866db7094aa5b395"} err="failed to get container status \"101b5455d380716b509d316a3002629932155eb8adc6660d866db7094aa5b395\": rpc error: code = NotFound desc = could not find container \"101b5455d380716b509d316a3002629932155eb8adc6660d866db7094aa5b395\": container with ID starting with 101b5455d380716b509d316a3002629932155eb8adc6660d866db7094aa5b395 not found: ID does not exist"
Jul 21 17:48:52.881879 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:48:52.881851    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-d1fcb9-554d954c6-fk6gb"]
Jul 21 17:48:52.885451 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:48:52.885430    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-d1fcb9-554d954c6-fk6gb"]
Jul 21 17:48:52.951824 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:48:52.951795    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dm7xf\" (UniqueName: \"kubernetes.io/projected/2c2e6e9c-e85a-4ced-9dbb-4cf1cbdf9c2e-kube-api-access-dm7xf\") on node \"ip-10-0-141-39.ec2.internal\" DevicePath \"\""
Jul 21 17:48:52.951824 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:48:52.951822    2575 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2c2e6e9c-e85a-4ced-9dbb-4cf1cbdf9c2e-maas-api-tls\") on node \"ip-10-0-141-39.ec2.internal\" DevicePath \"\""
Jul 21 17:48:52.951995 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:48:52.951835    2575 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2c2e6e9c-e85a-4ced-9dbb-4cf1cbdf9c2e-openshift-service-ca\") on node \"ip-10-0-141-39.ec2.internal\" DevicePath \"\""
Jul 21 17:48:54.116312 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:48:54.116283    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2c2e6e9c-e85a-4ced-9dbb-4cf1cbdf9c2e" path="/var/lib/kubelet/pods/2c2e6e9c-e85a-4ced-9dbb-4cf1cbdf9c2e/volumes"
Jul 21 17:48:56.121693 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:48:56.121627    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-inf-a-d1fcb9/test-model-d1fcb9-kserve-f9f58fd99-bhj6n" podUID="cd63347a-206a-477e-ad07-d9287991e551" containerName="main" containerID="cri-o://03fc89f3b095862e2944b872eacfeb74732968e9c7f822e71ed25988c8ef01c3" gracePeriod=45
Jul 21 17:48:56.376330 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:48:56.376273    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-d1fcb9/test-model-d1fcb9-kserve-f9f58fd99-bhj6n"
Jul 21 17:48:56.484746 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:48:56.484713    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/cd63347a-206a-477e-ad07-d9287991e551-dshm\") pod \"cd63347a-206a-477e-ad07-d9287991e551\" (UID: \"cd63347a-206a-477e-ad07-d9287991e551\") "
Jul 21 17:48:56.484746 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:48:56.484751    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cd63347a-206a-477e-ad07-d9287991e551-tmp-dir\") pod \"cd63347a-206a-477e-ad07-d9287991e551\" (UID: \"cd63347a-206a-477e-ad07-d9287991e551\") "
Jul 21 17:48:56.485020 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:48:56.484772    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cd63347a-206a-477e-ad07-d9287991e551-tls-certs\") pod \"cd63347a-206a-477e-ad07-d9287991e551\" (UID: \"cd63347a-206a-477e-ad07-d9287991e551\") "
Jul 21 17:48:56.485020 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:48:56.484811    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/cd63347a-206a-477e-ad07-d9287991e551-home\") pod \"cd63347a-206a-477e-ad07-d9287991e551\" (UID: \"cd63347a-206a-477e-ad07-d9287991e551\") "
Jul 21 17:48:56.485020 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:48:56.484870    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4hs5t\" (UniqueName: \"kubernetes.io/projected/cd63347a-206a-477e-ad07-d9287991e551-kube-api-access-4hs5t\") pod \"cd63347a-206a-477e-ad07-d9287991e551\" (UID: \"cd63347a-206a-477e-ad07-d9287991e551\") "
Jul 21 17:48:56.485020 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:48:56.484918    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/cd63347a-206a-477e-ad07-d9287991e551-model-cache\") pod \"cd63347a-206a-477e-ad07-d9287991e551\" (UID: \"cd63347a-206a-477e-ad07-d9287991e551\") "
Jul 21 17:48:56.485224 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:48:56.485089    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cd63347a-206a-477e-ad07-d9287991e551-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "cd63347a-206a-477e-ad07-d9287991e551" (UID: "cd63347a-206a-477e-ad07-d9287991e551"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 17:48:56.485224 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:48:56.485118    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cd63347a-206a-477e-ad07-d9287991e551-home" (OuterVolumeSpecName: "home") pod "cd63347a-206a-477e-ad07-d9287991e551" (UID: "cd63347a-206a-477e-ad07-d9287991e551"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 17:48:56.485311 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:48:56.485286    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cd63347a-206a-477e-ad07-d9287991e551-model-cache" (OuterVolumeSpecName: "model-cache") pod "cd63347a-206a-477e-ad07-d9287991e551" (UID: "cd63347a-206a-477e-ad07-d9287991e551"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 17:48:56.487190 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:48:56.487161    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cd63347a-206a-477e-ad07-d9287991e551-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "cd63347a-206a-477e-ad07-d9287991e551" (UID: "cd63347a-206a-477e-ad07-d9287991e551"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 21 17:48:56.487190 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:48:56.487176    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cd63347a-206a-477e-ad07-d9287991e551-dshm" (OuterVolumeSpecName: "dshm") pod "cd63347a-206a-477e-ad07-d9287991e551" (UID: "cd63347a-206a-477e-ad07-d9287991e551"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 17:48:56.487340 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:48:56.487196    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cd63347a-206a-477e-ad07-d9287991e551-kube-api-access-4hs5t" (OuterVolumeSpecName: "kube-api-access-4hs5t") pod "cd63347a-206a-477e-ad07-d9287991e551" (UID: "cd63347a-206a-477e-ad07-d9287991e551"). InnerVolumeSpecName "kube-api-access-4hs5t". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 17:48:56.585557 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:48:56.585522    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4hs5t\" (UniqueName: \"kubernetes.io/projected/cd63347a-206a-477e-ad07-d9287991e551-kube-api-access-4hs5t\") on node \"ip-10-0-141-39.ec2.internal\" DevicePath \"\""
Jul 21 17:48:56.585557 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:48:56.585555    2575 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/cd63347a-206a-477e-ad07-d9287991e551-model-cache\") on node \"ip-10-0-141-39.ec2.internal\" DevicePath \"\""
Jul 21 17:48:56.585557 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:48:56.585568    2575 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/cd63347a-206a-477e-ad07-d9287991e551-dshm\") on node \"ip-10-0-141-39.ec2.internal\" DevicePath \"\""
Jul 21 17:48:56.585806 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:48:56.585579    2575 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cd63347a-206a-477e-ad07-d9287991e551-tmp-dir\") on node \"ip-10-0-141-39.ec2.internal\" DevicePath \"\""
Jul 21 17:48:56.585806 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:48:56.585589    2575 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cd63347a-206a-477e-ad07-d9287991e551-tls-certs\") on node \"ip-10-0-141-39.ec2.internal\" DevicePath \"\""
Jul 21 17:48:56.585806 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:48:56.585599    2575 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/cd63347a-206a-477e-ad07-d9287991e551-home\") on node \"ip-10-0-141-39.ec2.internal\" DevicePath \"\""
Jul 21 17:48:56.877671 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:48:56.877633    2575 generic.go:356] "Generic (PLEG): container finished" podID="cd63347a-206a-477e-ad07-d9287991e551" containerID="03fc89f3b095862e2944b872eacfeb74732968e9c7f822e71ed25988c8ef01c3" exitCode=0
Jul 21 17:48:56.877671 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:48:56.877674    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-d1fcb9/test-model-d1fcb9-kserve-f9f58fd99-bhj6n"
Jul 21 17:48:56.877904 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:48:56.877719    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-d1fcb9/test-model-d1fcb9-kserve-f9f58fd99-bhj6n" event={"ID":"cd63347a-206a-477e-ad07-d9287991e551","Type":"ContainerDied","Data":"03fc89f3b095862e2944b872eacfeb74732968e9c7f822e71ed25988c8ef01c3"}
Jul 21 17:48:56.877904 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:48:56.877762    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-d1fcb9/test-model-d1fcb9-kserve-f9f58fd99-bhj6n" event={"ID":"cd63347a-206a-477e-ad07-d9287991e551","Type":"ContainerDied","Data":"b02e27674418cf8ed8a5b81f29e5e29be752ec17b96904ee317c052948c72960"}
Jul 21 17:48:56.877904 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:48:56.877780    2575 scope.go:117] "RemoveContainer" containerID="03fc89f3b095862e2944b872eacfeb74732968e9c7f822e71ed25988c8ef01c3"
Jul 21 17:48:56.886626 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:48:56.886613    2575 scope.go:117] "RemoveContainer" containerID="03fc89f3b095862e2944b872eacfeb74732968e9c7f822e71ed25988c8ef01c3"
Jul 21 17:48:56.886871 ip-10-0-141-39 kubenswrapper[2575]: E0721 17:48:56.886852    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"03fc89f3b095862e2944b872eacfeb74732968e9c7f822e71ed25988c8ef01c3\": container with ID starting with 03fc89f3b095862e2944b872eacfeb74732968e9c7f822e71ed25988c8ef01c3 not found: ID does not exist" containerID="03fc89f3b095862e2944b872eacfeb74732968e9c7f822e71ed25988c8ef01c3"
Jul 21 17:48:56.886928 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:48:56.886884    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"03fc89f3b095862e2944b872eacfeb74732968e9c7f822e71ed25988c8ef01c3"} err="failed to get container status \"03fc89f3b095862e2944b872eacfeb74732968e9c7f822e71ed25988c8ef01c3\": rpc error: code = NotFound desc = could not find container \"03fc89f3b095862e2944b872eacfeb74732968e9c7f822e71ed25988c8ef01c3\": container with ID starting with 03fc89f3b095862e2944b872eacfeb74732968e9c7f822e71ed25988c8ef01c3 not found: ID does not exist"
Jul 21 17:48:56.899514 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:48:56.899487    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-d1fcb9/test-model-d1fcb9-kserve-f9f58fd99-bhj6n"]
Jul 21 17:48:56.901674 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:48:56.901650    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-a-d1fcb9/test-model-d1fcb9-kserve-f9f58fd99-bhj6n"]
Jul 21 17:48:58.116916 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:48:58.116884    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cd63347a-206a-477e-ad07-d9287991e551" path="/var/lib/kubelet/pods/cd63347a-206a-477e-ad07-d9287991e551/volumes"
Jul 21 17:49:14.828897 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:49:14.828866    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-95fd83-674d978d95-kv6gv"]
Jul 21 17:49:14.829395 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:49:14.829062    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-95fd83-674d978d95-kv6gv" podUID="8845e417-b7bf-41dc-b00a-7305d9677e6a" containerName="maas-api" containerID="cri-o://fc5e91d20e92410848b83b00bd9dc7c68f06bfce37d321a0ba247efd0eff33ba" gracePeriod=30
Jul 21 17:49:15.281017 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:49:15.280987    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-95fd83-674d978d95-kv6gv"
Jul 21 17:49:15.359826 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:49:15.359747    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8845e417-b7bf-41dc-b00a-7305d9677e6a-openshift-service-ca\") pod \"8845e417-b7bf-41dc-b00a-7305d9677e6a\" (UID: \"8845e417-b7bf-41dc-b00a-7305d9677e6a\") "
Jul 21 17:49:15.359826 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:49:15.359790    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8845e417-b7bf-41dc-b00a-7305d9677e6a-maas-api-tls\") pod \"8845e417-b7bf-41dc-b00a-7305d9677e6a\" (UID: \"8845e417-b7bf-41dc-b00a-7305d9677e6a\") "
Jul 21 17:49:15.360021 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:49:15.359896    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8ckqd\" (UniqueName: \"kubernetes.io/projected/8845e417-b7bf-41dc-b00a-7305d9677e6a-kube-api-access-8ckqd\") pod \"8845e417-b7bf-41dc-b00a-7305d9677e6a\" (UID: \"8845e417-b7bf-41dc-b00a-7305d9677e6a\") "
Jul 21 17:49:15.360167 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:49:15.360145    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8845e417-b7bf-41dc-b00a-7305d9677e6a-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "8845e417-b7bf-41dc-b00a-7305d9677e6a" (UID: "8845e417-b7bf-41dc-b00a-7305d9677e6a"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 17:49:15.362064 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:49:15.362034    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8845e417-b7bf-41dc-b00a-7305d9677e6a-kube-api-access-8ckqd" (OuterVolumeSpecName: "kube-api-access-8ckqd") pod "8845e417-b7bf-41dc-b00a-7305d9677e6a" (UID: "8845e417-b7bf-41dc-b00a-7305d9677e6a"). InnerVolumeSpecName "kube-api-access-8ckqd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 17:49:15.362064 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:49:15.362055    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8845e417-b7bf-41dc-b00a-7305d9677e6a-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "8845e417-b7bf-41dc-b00a-7305d9677e6a" (UID: "8845e417-b7bf-41dc-b00a-7305d9677e6a"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 21 17:49:15.461469 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:49:15.461437    2575 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8845e417-b7bf-41dc-b00a-7305d9677e6a-maas-api-tls\") on node \"ip-10-0-141-39.ec2.internal\" DevicePath \"\""
Jul 21 17:49:15.461469 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:49:15.461467    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8ckqd\" (UniqueName: \"kubernetes.io/projected/8845e417-b7bf-41dc-b00a-7305d9677e6a-kube-api-access-8ckqd\") on node \"ip-10-0-141-39.ec2.internal\" DevicePath \"\""
Jul 21 17:49:15.461469 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:49:15.461477    2575 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8845e417-b7bf-41dc-b00a-7305d9677e6a-openshift-service-ca\") on node \"ip-10-0-141-39.ec2.internal\" DevicePath \"\""
Jul 21 17:49:15.967923 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:49:15.967882    2575 generic.go:356] "Generic (PLEG): container finished" podID="8845e417-b7bf-41dc-b00a-7305d9677e6a" containerID="fc5e91d20e92410848b83b00bd9dc7c68f06bfce37d321a0ba247efd0eff33ba" exitCode=0
Jul 21 17:49:15.968351 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:49:15.967945    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-95fd83-674d978d95-kv6gv"
Jul 21 17:49:15.968351 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:49:15.967966    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-95fd83-674d978d95-kv6gv" event={"ID":"8845e417-b7bf-41dc-b00a-7305d9677e6a","Type":"ContainerDied","Data":"fc5e91d20e92410848b83b00bd9dc7c68f06bfce37d321a0ba247efd0eff33ba"}
Jul 21 17:49:15.968351 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:49:15.968063    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-95fd83-674d978d95-kv6gv" event={"ID":"8845e417-b7bf-41dc-b00a-7305d9677e6a","Type":"ContainerDied","Data":"5583d16971684073a7372bbefb2e84c0bb4f0da2ac5a36b8c9df32bc6f5b5b17"}
Jul 21 17:49:15.968351 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:49:15.968102    2575 scope.go:117] "RemoveContainer" containerID="fc5e91d20e92410848b83b00bd9dc7c68f06bfce37d321a0ba247efd0eff33ba"
Jul 21 17:49:15.977072 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:49:15.977055    2575 scope.go:117] "RemoveContainer" containerID="fc5e91d20e92410848b83b00bd9dc7c68f06bfce37d321a0ba247efd0eff33ba"
Jul 21 17:49:15.977328 ip-10-0-141-39 kubenswrapper[2575]: E0721 17:49:15.977309    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fc5e91d20e92410848b83b00bd9dc7c68f06bfce37d321a0ba247efd0eff33ba\": container with ID starting with fc5e91d20e92410848b83b00bd9dc7c68f06bfce37d321a0ba247efd0eff33ba not found: ID does not exist" containerID="fc5e91d20e92410848b83b00bd9dc7c68f06bfce37d321a0ba247efd0eff33ba"
Jul 21 17:49:15.977379 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:49:15.977336    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fc5e91d20e92410848b83b00bd9dc7c68f06bfce37d321a0ba247efd0eff33ba"} err="failed to get container status \"fc5e91d20e92410848b83b00bd9dc7c68f06bfce37d321a0ba247efd0eff33ba\": rpc error: code = NotFound desc = could not find container \"fc5e91d20e92410848b83b00bd9dc7c68f06bfce37d321a0ba247efd0eff33ba\": container with ID starting with fc5e91d20e92410848b83b00bd9dc7c68f06bfce37d321a0ba247efd0eff33ba not found: ID does not exist"
Jul 21 17:49:15.989079 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:49:15.989056    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-95fd83-674d978d95-kv6gv"]
Jul 21 17:49:15.992466 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:49:15.992446    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-95fd83-674d978d95-kv6gv"]
Jul 21 17:49:16.116353 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:49:16.116315    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8845e417-b7bf-41dc-b00a-7305d9677e6a" path="/var/lib/kubelet/pods/8845e417-b7bf-41dc-b00a-7305d9677e6a/volumes"
Jul 21 17:49:30.814492 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:49:30.814447    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-54b201-795564bfc4-5j4s4"]
Jul 21 17:49:30.814890 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:49:30.814818    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2c2e6e9c-e85a-4ced-9dbb-4cf1cbdf9c2e" containerName="maas-api"
Jul 21 17:49:30.814890 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:49:30.814833    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="2c2e6e9c-e85a-4ced-9dbb-4cf1cbdf9c2e" containerName="maas-api"
Jul 21 17:49:30.814890 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:49:30.814858    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cd63347a-206a-477e-ad07-d9287991e551" containerName="main"
Jul 21 17:49:30.814890 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:49:30.814864    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="cd63347a-206a-477e-ad07-d9287991e551" containerName="main"
Jul 21 17:49:30.814890 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:49:30.814877    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8845e417-b7bf-41dc-b00a-7305d9677e6a" containerName="maas-api"
Jul 21 17:49:30.814890 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:49:30.814883    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="8845e417-b7bf-41dc-b00a-7305d9677e6a" containerName="maas-api"
Jul 21 17:49:30.815115 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:49:30.814948    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="2c2e6e9c-e85a-4ced-9dbb-4cf1cbdf9c2e" containerName="maas-api"
Jul 21 17:49:30.815115 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:49:30.814957    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="cd63347a-206a-477e-ad07-d9287991e551" containerName="main"
Jul 21 17:49:30.815115 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:49:30.814964    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="8845e417-b7bf-41dc-b00a-7305d9677e6a" containerName="maas-api"
Jul 21 17:49:30.819453 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:49:30.819434    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-54b201-795564bfc4-5j4s4"
Jul 21 17:49:30.822692 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:49:30.822667    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-api-a-54b201-serving-cert\""
Jul 21 17:49:30.829924 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:49:30.829895    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-54b201-795564bfc4-5j4s4"]
Jul 21 17:49:30.894255 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:49:30.894228    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t9mrm\" (UniqueName: \"kubernetes.io/projected/01fad2db-7c66-4451-b85d-088c63966608-kube-api-access-t9mrm\") pod \"maas-api-e2e-api-a-54b201-795564bfc4-5j4s4\" (UID: \"01fad2db-7c66-4451-b85d-088c63966608\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-54b201-795564bfc4-5j4s4"
Jul 21 17:49:30.894444 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:49:30.894260    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/01fad2db-7c66-4451-b85d-088c63966608-openshift-service-ca\") pod \"maas-api-e2e-api-a-54b201-795564bfc4-5j4s4\" (UID: \"01fad2db-7c66-4451-b85d-088c63966608\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-54b201-795564bfc4-5j4s4"
Jul 21 17:49:30.894444 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:49:30.894300    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/01fad2db-7c66-4451-b85d-088c63966608-maas-api-tls\") pod \"maas-api-e2e-api-a-54b201-795564bfc4-5j4s4\" (UID: \"01fad2db-7c66-4451-b85d-088c63966608\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-54b201-795564bfc4-5j4s4"
Jul 21 17:49:30.995157 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:49:30.995124    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/01fad2db-7c66-4451-b85d-088c63966608-maas-api-tls\") pod \"maas-api-e2e-api-a-54b201-795564bfc4-5j4s4\" (UID: \"01fad2db-7c66-4451-b85d-088c63966608\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-54b201-795564bfc4-5j4s4"
Jul 21 17:49:30.995337 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:49:30.995203    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t9mrm\" (UniqueName: \"kubernetes.io/projected/01fad2db-7c66-4451-b85d-088c63966608-kube-api-access-t9mrm\") pod \"maas-api-e2e-api-a-54b201-795564bfc4-5j4s4\" (UID: \"01fad2db-7c66-4451-b85d-088c63966608\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-54b201-795564bfc4-5j4s4"
Jul 21 17:49:30.995337 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:49:30.995231    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/01fad2db-7c66-4451-b85d-088c63966608-openshift-service-ca\") pod \"maas-api-e2e-api-a-54b201-795564bfc4-5j4s4\" (UID: \"01fad2db-7c66-4451-b85d-088c63966608\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-54b201-795564bfc4-5j4s4"
Jul 21 17:49:30.995337 ip-10-0-141-39 kubenswrapper[2575]: E0721 17:49:30.995303    2575 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-api-a-54b201-serving-cert: secret "maas-api-e2e-api-a-54b201-serving-cert" not found
Jul 21 17:49:30.995543 ip-10-0-141-39 kubenswrapper[2575]: E0721 17:49:30.995380    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/01fad2db-7c66-4451-b85d-088c63966608-maas-api-tls podName:01fad2db-7c66-4451-b85d-088c63966608 nodeName:}" failed. No retries permitted until 2026-07-21 17:49:31.495359522 +0000 UTC m=+2463.949512143 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/01fad2db-7c66-4451-b85d-088c63966608-maas-api-tls") pod "maas-api-e2e-api-a-54b201-795564bfc4-5j4s4" (UID: "01fad2db-7c66-4451-b85d-088c63966608") : secret "maas-api-e2e-api-a-54b201-serving-cert" not found
Jul 21 17:49:30.995826 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:49:30.995809    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/01fad2db-7c66-4451-b85d-088c63966608-openshift-service-ca\") pod \"maas-api-e2e-api-a-54b201-795564bfc4-5j4s4\" (UID: \"01fad2db-7c66-4451-b85d-088c63966608\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-54b201-795564bfc4-5j4s4"
Jul 21 17:49:31.004867 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:49:31.004840    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t9mrm\" (UniqueName: \"kubernetes.io/projected/01fad2db-7c66-4451-b85d-088c63966608-kube-api-access-t9mrm\") pod \"maas-api-e2e-api-a-54b201-795564bfc4-5j4s4\" (UID: \"01fad2db-7c66-4451-b85d-088c63966608\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-54b201-795564bfc4-5j4s4"
Jul 21 17:49:31.499530 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:49:31.499497    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/01fad2db-7c66-4451-b85d-088c63966608-maas-api-tls\") pod \"maas-api-e2e-api-a-54b201-795564bfc4-5j4s4\" (UID: \"01fad2db-7c66-4451-b85d-088c63966608\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-54b201-795564bfc4-5j4s4"
Jul 21 17:49:31.502266 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:49:31.502238    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/01fad2db-7c66-4451-b85d-088c63966608-maas-api-tls\") pod \"maas-api-e2e-api-a-54b201-795564bfc4-5j4s4\" (UID: \"01fad2db-7c66-4451-b85d-088c63966608\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-54b201-795564bfc4-5j4s4"
Jul 21 17:49:31.732955 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:49:31.732924    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-54b201-795564bfc4-5j4s4"
Jul 21 17:49:31.875509 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:49:31.875484    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-54b201-795564bfc4-5j4s4"]
Jul 21 17:49:31.878122 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:49:31.878093    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod01fad2db_7c66_4451_b85d_088c63966608.slice/crio-537538095ff06a53855b13da384072e5f593234043805c40294642351fe0f230 WatchSource:0}: Error finding container 537538095ff06a53855b13da384072e5f593234043805c40294642351fe0f230: Status 404 returned error can't find the container with id 537538095ff06a53855b13da384072e5f593234043805c40294642351fe0f230
Jul 21 17:49:31.879738 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:49:31.879715    2575 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 21 17:49:32.042073 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:49:32.041983    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-54b201-795564bfc4-5j4s4" event={"ID":"01fad2db-7c66-4451-b85d-088c63966608","Type":"ContainerStarted","Data":"537538095ff06a53855b13da384072e5f593234043805c40294642351fe0f230"}
Jul 21 17:49:33.049455 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:49:33.049399    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-54b201-795564bfc4-5j4s4" event={"ID":"01fad2db-7c66-4451-b85d-088c63966608","Type":"ContainerStarted","Data":"159a7154a63a7199df9041fa011719b6763abd791c73ddef27fc8804a9864b8a"}
Jul 21 17:49:33.049854 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:49:33.049528    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-54b201-795564bfc4-5j4s4"
Jul 21 17:49:33.069745 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:49:33.069691    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-54b201-795564bfc4-5j4s4" podStartSLOduration=2.6059484619999997 podStartE2EDuration="3.069675743s" totalImagesPullingTime="463.727281ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 17:49:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 17:49:33.067619378 +0000 UTC m=+2465.521772012" watchObservedRunningTime="2026-07-21 17:49:33.069675743 +0000 UTC m=+2465.523828377"
Jul 21 17:49:39.060512 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:49:39.060474    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-54b201-795564bfc4-5j4s4"
Jul 21 17:49:39.825583 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:49:39.825546    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-eb37d3-5d57f9d4cf-g5j58"]
Jul 21 17:49:39.828990 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:49:39.828967    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-eb37d3-5d57f9d4cf-g5j58"
Jul 21 17:49:39.831678 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:49:39.831657    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-api-b-eb37d3-serving-cert\""
Jul 21 17:49:39.840495 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:49:39.840471    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-eb37d3-5d57f9d4cf-g5j58"]
Jul 21 17:49:39.877468 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:49:39.877439    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5cc500bf-cf2e-467a-9a50-f0c4a108f406-maas-api-tls\") pod \"maas-api-e2e-api-b-eb37d3-5d57f9d4cf-g5j58\" (UID: \"5cc500bf-cf2e-467a-9a50-f0c4a108f406\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-eb37d3-5d57f9d4cf-g5j58"
Jul 21 17:49:39.877605 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:49:39.877482    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c9smv\" (UniqueName: \"kubernetes.io/projected/5cc500bf-cf2e-467a-9a50-f0c4a108f406-kube-api-access-c9smv\") pod \"maas-api-e2e-api-b-eb37d3-5d57f9d4cf-g5j58\" (UID: \"5cc500bf-cf2e-467a-9a50-f0c4a108f406\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-eb37d3-5d57f9d4cf-g5j58"
Jul 21 17:49:39.877605 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:49:39.877589    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5cc500bf-cf2e-467a-9a50-f0c4a108f406-openshift-service-ca\") pod \"maas-api-e2e-api-b-eb37d3-5d57f9d4cf-g5j58\" (UID: \"5cc500bf-cf2e-467a-9a50-f0c4a108f406\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-eb37d3-5d57f9d4cf-g5j58"
Jul 21 17:49:39.978622 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:49:39.978584    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5cc500bf-cf2e-467a-9a50-f0c4a108f406-maas-api-tls\") pod \"maas-api-e2e-api-b-eb37d3-5d57f9d4cf-g5j58\" (UID: \"5cc500bf-cf2e-467a-9a50-f0c4a108f406\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-eb37d3-5d57f9d4cf-g5j58"
Jul 21 17:49:39.978814 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:49:39.978628    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c9smv\" (UniqueName: \"kubernetes.io/projected/5cc500bf-cf2e-467a-9a50-f0c4a108f406-kube-api-access-c9smv\") pod \"maas-api-e2e-api-b-eb37d3-5d57f9d4cf-g5j58\" (UID: \"5cc500bf-cf2e-467a-9a50-f0c4a108f406\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-eb37d3-5d57f9d4cf-g5j58"
Jul 21 17:49:39.978814 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:49:39.978683    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5cc500bf-cf2e-467a-9a50-f0c4a108f406-openshift-service-ca\") pod \"maas-api-e2e-api-b-eb37d3-5d57f9d4cf-g5j58\" (UID: \"5cc500bf-cf2e-467a-9a50-f0c4a108f406\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-eb37d3-5d57f9d4cf-g5j58"
Jul 21 17:49:39.978814 ip-10-0-141-39 kubenswrapper[2575]: E0721 17:49:39.978727    2575 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-api-b-eb37d3-serving-cert: secret "maas-api-e2e-api-b-eb37d3-serving-cert" not found
Jul 21 17:49:39.978814 ip-10-0-141-39 kubenswrapper[2575]: E0721 17:49:39.978794    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5cc500bf-cf2e-467a-9a50-f0c4a108f406-maas-api-tls podName:5cc500bf-cf2e-467a-9a50-f0c4a108f406 nodeName:}" failed. No retries permitted until 2026-07-21 17:49:40.478776879 +0000 UTC m=+2472.932929498 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/5cc500bf-cf2e-467a-9a50-f0c4a108f406-maas-api-tls") pod "maas-api-e2e-api-b-eb37d3-5d57f9d4cf-g5j58" (UID: "5cc500bf-cf2e-467a-9a50-f0c4a108f406") : secret "maas-api-e2e-api-b-eb37d3-serving-cert" not found
Jul 21 17:49:39.979348 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:49:39.979327    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5cc500bf-cf2e-467a-9a50-f0c4a108f406-openshift-service-ca\") pod \"maas-api-e2e-api-b-eb37d3-5d57f9d4cf-g5j58\" (UID: \"5cc500bf-cf2e-467a-9a50-f0c4a108f406\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-eb37d3-5d57f9d4cf-g5j58"
Jul 21 17:49:39.990408 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:49:39.990375    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c9smv\" (UniqueName: \"kubernetes.io/projected/5cc500bf-cf2e-467a-9a50-f0c4a108f406-kube-api-access-c9smv\") pod \"maas-api-e2e-api-b-eb37d3-5d57f9d4cf-g5j58\" (UID: \"5cc500bf-cf2e-467a-9a50-f0c4a108f406\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-eb37d3-5d57f9d4cf-g5j58"
Jul 21 17:49:40.484348 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:49:40.484315    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5cc500bf-cf2e-467a-9a50-f0c4a108f406-maas-api-tls\") pod \"maas-api-e2e-api-b-eb37d3-5d57f9d4cf-g5j58\" (UID: \"5cc500bf-cf2e-467a-9a50-f0c4a108f406\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-eb37d3-5d57f9d4cf-g5j58"
Jul 21 17:49:40.487382 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:49:40.487352    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5cc500bf-cf2e-467a-9a50-f0c4a108f406-maas-api-tls\") pod \"maas-api-e2e-api-b-eb37d3-5d57f9d4cf-g5j58\" (UID: \"5cc500bf-cf2e-467a-9a50-f0c4a108f406\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-eb37d3-5d57f9d4cf-g5j58"
Jul 21 17:49:40.741758 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:49:40.741725    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-eb37d3-5d57f9d4cf-g5j58"
Jul 21 17:49:40.875492 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:49:40.875467    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-eb37d3-5d57f9d4cf-g5j58"]
Jul 21 17:49:40.877068 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:49:40.877043    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5cc500bf_cf2e_467a_9a50_f0c4a108f406.slice/crio-e7a10ecade1f8f09c3fcfe5ea763327b4583e3b006a0e085efc0bad06fab7bdd WatchSource:0}: Error finding container e7a10ecade1f8f09c3fcfe5ea763327b4583e3b006a0e085efc0bad06fab7bdd: Status 404 returned error can't find the container with id e7a10ecade1f8f09c3fcfe5ea763327b4583e3b006a0e085efc0bad06fab7bdd
Jul 21 17:49:41.088829 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:49:41.088735    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-eb37d3-5d57f9d4cf-g5j58" event={"ID":"5cc500bf-cf2e-467a-9a50-f0c4a108f406","Type":"ContainerStarted","Data":"e7a10ecade1f8f09c3fcfe5ea763327b4583e3b006a0e085efc0bad06fab7bdd"}
Jul 21 17:49:42.094435 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:49:42.094382    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-eb37d3-5d57f9d4cf-g5j58" event={"ID":"5cc500bf-cf2e-467a-9a50-f0c4a108f406","Type":"ContainerStarted","Data":"869e0c903ba4d575c69ec42b3d6ca233c447f21feb6af0a2bdbee7dfe039667f"}
Jul 21 17:49:42.094812 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:49:42.094577    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-eb37d3-5d57f9d4cf-g5j58"
Jul 21 17:49:42.113998 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:49:42.113949    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-eb37d3-5d57f9d4cf-g5j58" podStartSLOduration=2.727737481 podStartE2EDuration="3.113932283s" totalImagesPullingTime="386.194802ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 17:49:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 17:49:42.112914649 +0000 UTC m=+2474.567067304" watchObservedRunningTime="2026-07-21 17:49:42.113932283 +0000 UTC m=+2474.568084925"
Jul 21 17:49:48.104445 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:49:48.104406    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-eb37d3-5d57f9d4cf-g5j58"
Jul 21 17:50:07.994538 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:50:07.994498    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-54b201-795564bfc4-5j4s4"]
Jul 21 17:50:07.995011 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:50:07.994751    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-54b201-795564bfc4-5j4s4" podUID="01fad2db-7c66-4451-b85d-088c63966608" containerName="maas-api" containerID="cri-o://159a7154a63a7199df9041fa011719b6763abd791c73ddef27fc8804a9864b8a" gracePeriod=30
Jul 21 17:50:08.216849 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:50:08.216817    2575 generic.go:356] "Generic (PLEG): container finished" podID="01fad2db-7c66-4451-b85d-088c63966608" containerID="159a7154a63a7199df9041fa011719b6763abd791c73ddef27fc8804a9864b8a" exitCode=0
Jul 21 17:50:08.217008 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:50:08.216861    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-54b201-795564bfc4-5j4s4" event={"ID":"01fad2db-7c66-4451-b85d-088c63966608","Type":"ContainerDied","Data":"159a7154a63a7199df9041fa011719b6763abd791c73ddef27fc8804a9864b8a"}
Jul 21 17:50:08.245261 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:50:08.245194    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-54b201-795564bfc4-5j4s4"
Jul 21 17:50:08.336557 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:50:08.336521    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/01fad2db-7c66-4451-b85d-088c63966608-maas-api-tls\") pod \"01fad2db-7c66-4451-b85d-088c63966608\" (UID: \"01fad2db-7c66-4451-b85d-088c63966608\") "
Jul 21 17:50:08.336754 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:50:08.336582    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-t9mrm\" (UniqueName: \"kubernetes.io/projected/01fad2db-7c66-4451-b85d-088c63966608-kube-api-access-t9mrm\") pod \"01fad2db-7c66-4451-b85d-088c63966608\" (UID: \"01fad2db-7c66-4451-b85d-088c63966608\") "
Jul 21 17:50:08.336754 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:50:08.336616    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/01fad2db-7c66-4451-b85d-088c63966608-openshift-service-ca\") pod \"01fad2db-7c66-4451-b85d-088c63966608\" (UID: \"01fad2db-7c66-4451-b85d-088c63966608\") "
Jul 21 17:50:08.337027 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:50:08.337002    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/01fad2db-7c66-4451-b85d-088c63966608-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "01fad2db-7c66-4451-b85d-088c63966608" (UID: "01fad2db-7c66-4451-b85d-088c63966608"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 17:50:08.338837 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:50:08.338814    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/01fad2db-7c66-4451-b85d-088c63966608-kube-api-access-t9mrm" (OuterVolumeSpecName: "kube-api-access-t9mrm") pod "01fad2db-7c66-4451-b85d-088c63966608" (UID: "01fad2db-7c66-4451-b85d-088c63966608"). InnerVolumeSpecName "kube-api-access-t9mrm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 17:50:08.338946 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:50:08.338863    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/01fad2db-7c66-4451-b85d-088c63966608-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "01fad2db-7c66-4451-b85d-088c63966608" (UID: "01fad2db-7c66-4451-b85d-088c63966608"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 21 17:50:08.437587 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:50:08.437550    2575 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/01fad2db-7c66-4451-b85d-088c63966608-maas-api-tls\") on node \"ip-10-0-141-39.ec2.internal\" DevicePath \"\""
Jul 21 17:50:08.437587 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:50:08.437584    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-t9mrm\" (UniqueName: \"kubernetes.io/projected/01fad2db-7c66-4451-b85d-088c63966608-kube-api-access-t9mrm\") on node \"ip-10-0-141-39.ec2.internal\" DevicePath \"\""
Jul 21 17:50:08.437795 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:50:08.437599    2575 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/01fad2db-7c66-4451-b85d-088c63966608-openshift-service-ca\") on node \"ip-10-0-141-39.ec2.internal\" DevicePath \"\""
Jul 21 17:50:09.222062 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:50:09.222035    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-54b201-795564bfc4-5j4s4"
Jul 21 17:50:09.222556 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:50:09.222034    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-54b201-795564bfc4-5j4s4" event={"ID":"01fad2db-7c66-4451-b85d-088c63966608","Type":"ContainerDied","Data":"537538095ff06a53855b13da384072e5f593234043805c40294642351fe0f230"}
Jul 21 17:50:09.222556 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:50:09.222164    2575 scope.go:117] "RemoveContainer" containerID="159a7154a63a7199df9041fa011719b6763abd791c73ddef27fc8804a9864b8a"
Jul 21 17:50:09.246525 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:50:09.246498    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-54b201-795564bfc4-5j4s4"]
Jul 21 17:50:09.256818 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:50:09.256793    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-54b201-795564bfc4-5j4s4"]
Jul 21 17:50:10.116561 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:50:10.116520    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="01fad2db-7c66-4451-b85d-088c63966608" path="/var/lib/kubelet/pods/01fad2db-7c66-4451-b85d-088c63966608/volumes"
Jul 21 17:50:35.325470 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:50:35.325435    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-eb37d3-5d57f9d4cf-g5j58"]
Jul 21 17:50:35.325883 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:50:35.325677    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-eb37d3-5d57f9d4cf-g5j58" podUID="5cc500bf-cf2e-467a-9a50-f0c4a108f406" containerName="maas-api" containerID="cri-o://869e0c903ba4d575c69ec42b3d6ca233c447f21feb6af0a2bdbee7dfe039667f" gracePeriod=30
Jul 21 17:50:35.570386 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:50:35.570361    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-eb37d3-5d57f9d4cf-g5j58"
Jul 21 17:50:35.680601 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:50:35.680512    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5cc500bf-cf2e-467a-9a50-f0c4a108f406-openshift-service-ca\") pod \"5cc500bf-cf2e-467a-9a50-f0c4a108f406\" (UID: \"5cc500bf-cf2e-467a-9a50-f0c4a108f406\") "
Jul 21 17:50:35.680601 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:50:35.680557    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-c9smv\" (UniqueName: \"kubernetes.io/projected/5cc500bf-cf2e-467a-9a50-f0c4a108f406-kube-api-access-c9smv\") pod \"5cc500bf-cf2e-467a-9a50-f0c4a108f406\" (UID: \"5cc500bf-cf2e-467a-9a50-f0c4a108f406\") "
Jul 21 17:50:35.680601 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:50:35.680582    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5cc500bf-cf2e-467a-9a50-f0c4a108f406-maas-api-tls\") pod \"5cc500bf-cf2e-467a-9a50-f0c4a108f406\" (UID: \"5cc500bf-cf2e-467a-9a50-f0c4a108f406\") "
Jul 21 17:50:35.680896 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:50:35.680877    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5cc500bf-cf2e-467a-9a50-f0c4a108f406-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "5cc500bf-cf2e-467a-9a50-f0c4a108f406" (UID: "5cc500bf-cf2e-467a-9a50-f0c4a108f406"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 17:50:35.682838 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:50:35.682817    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5cc500bf-cf2e-467a-9a50-f0c4a108f406-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "5cc500bf-cf2e-467a-9a50-f0c4a108f406" (UID: "5cc500bf-cf2e-467a-9a50-f0c4a108f406"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 21 17:50:35.682838 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:50:35.682820    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5cc500bf-cf2e-467a-9a50-f0c4a108f406-kube-api-access-c9smv" (OuterVolumeSpecName: "kube-api-access-c9smv") pod "5cc500bf-cf2e-467a-9a50-f0c4a108f406" (UID: "5cc500bf-cf2e-467a-9a50-f0c4a108f406"). InnerVolumeSpecName "kube-api-access-c9smv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 17:50:35.781823 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:50:35.781786    2575 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5cc500bf-cf2e-467a-9a50-f0c4a108f406-openshift-service-ca\") on node \"ip-10-0-141-39.ec2.internal\" DevicePath \"\""
Jul 21 17:50:35.781823 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:50:35.781816    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-c9smv\" (UniqueName: \"kubernetes.io/projected/5cc500bf-cf2e-467a-9a50-f0c4a108f406-kube-api-access-c9smv\") on node \"ip-10-0-141-39.ec2.internal\" DevicePath \"\""
Jul 21 17:50:35.781823 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:50:35.781829    2575 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5cc500bf-cf2e-467a-9a50-f0c4a108f406-maas-api-tls\") on node \"ip-10-0-141-39.ec2.internal\" DevicePath \"\""
Jul 21 17:50:36.350703 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:50:36.350664    2575 generic.go:356] "Generic (PLEG): container finished" podID="5cc500bf-cf2e-467a-9a50-f0c4a108f406" containerID="869e0c903ba4d575c69ec42b3d6ca233c447f21feb6af0a2bdbee7dfe039667f" exitCode=0
Jul 21 17:50:36.351183 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:50:36.350732    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-eb37d3-5d57f9d4cf-g5j58"
Jul 21 17:50:36.351183 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:50:36.350736    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-eb37d3-5d57f9d4cf-g5j58" event={"ID":"5cc500bf-cf2e-467a-9a50-f0c4a108f406","Type":"ContainerDied","Data":"869e0c903ba4d575c69ec42b3d6ca233c447f21feb6af0a2bdbee7dfe039667f"}
Jul 21 17:50:36.351183 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:50:36.350785    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-eb37d3-5d57f9d4cf-g5j58" event={"ID":"5cc500bf-cf2e-467a-9a50-f0c4a108f406","Type":"ContainerDied","Data":"e7a10ecade1f8f09c3fcfe5ea763327b4583e3b006a0e085efc0bad06fab7bdd"}
Jul 21 17:50:36.351183 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:50:36.350805    2575 scope.go:117] "RemoveContainer" containerID="869e0c903ba4d575c69ec42b3d6ca233c447f21feb6af0a2bdbee7dfe039667f"
Jul 21 17:50:36.359165 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:50:36.359147    2575 scope.go:117] "RemoveContainer" containerID="869e0c903ba4d575c69ec42b3d6ca233c447f21feb6af0a2bdbee7dfe039667f"
Jul 21 17:50:36.359515 ip-10-0-141-39 kubenswrapper[2575]: E0721 17:50:36.359495    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"869e0c903ba4d575c69ec42b3d6ca233c447f21feb6af0a2bdbee7dfe039667f\": container with ID starting with 869e0c903ba4d575c69ec42b3d6ca233c447f21feb6af0a2bdbee7dfe039667f not found: ID does not exist" containerID="869e0c903ba4d575c69ec42b3d6ca233c447f21feb6af0a2bdbee7dfe039667f"
Jul 21 17:50:36.359595 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:50:36.359524    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"869e0c903ba4d575c69ec42b3d6ca233c447f21feb6af0a2bdbee7dfe039667f"} err="failed to get container status \"869e0c903ba4d575c69ec42b3d6ca233c447f21feb6af0a2bdbee7dfe039667f\": rpc error: code = NotFound desc = could not find container \"869e0c903ba4d575c69ec42b3d6ca233c447f21feb6af0a2bdbee7dfe039667f\": container with ID starting with 869e0c903ba4d575c69ec42b3d6ca233c447f21feb6af0a2bdbee7dfe039667f not found: ID does not exist"
Jul 21 17:50:36.381763 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:50:36.381699    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-eb37d3-5d57f9d4cf-g5j58"]
Jul 21 17:50:36.386779 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:50:36.386759    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-eb37d3-5d57f9d4cf-g5j58"]
Jul 21 17:50:38.116760 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:50:38.116730    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5cc500bf-cf2e-467a-9a50-f0c4a108f406" path="/var/lib/kubelet/pods/5cc500bf-cf2e-467a-9a50-f0c4a108f406/volumes"
Jul 21 17:50:51.201906 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:50:51.201875    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-43413b-68dbcd55db-5pjn8"]
Jul 21 17:50:51.202285 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:50:51.202218    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="01fad2db-7c66-4451-b85d-088c63966608" containerName="maas-api"
Jul 21 17:50:51.202285 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:50:51.202228    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="01fad2db-7c66-4451-b85d-088c63966608" containerName="maas-api"
Jul 21 17:50:51.202285 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:50:51.202239    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5cc500bf-cf2e-467a-9a50-f0c4a108f406" containerName="maas-api"
Jul 21 17:50:51.202285 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:50:51.202245    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="5cc500bf-cf2e-467a-9a50-f0c4a108f406" containerName="maas-api"
Jul 21 17:50:51.202438 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:50:51.202317    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="5cc500bf-cf2e-467a-9a50-f0c4a108f406" containerName="maas-api"
Jul 21 17:50:51.202438 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:50:51.202326    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="01fad2db-7c66-4451-b85d-088c63966608" containerName="maas-api"
Jul 21 17:50:51.206802 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:50:51.206781    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-43413b-68dbcd55db-5pjn8"
Jul 21 17:50:51.216373 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:50:51.216353    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-a-43413b-serving-cert\""
Jul 21 17:50:51.233218 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:50:51.233192    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-43413b-68dbcd55db-5pjn8"]
Jul 21 17:50:51.320286 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:50:51.320252    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9s2s5\" (UniqueName: \"kubernetes.io/projected/8e998c14-cd72-412e-820e-ae75977208bd-kube-api-access-9s2s5\") pod \"maas-api-e2e-shared-a-43413b-68dbcd55db-5pjn8\" (UID: \"8e998c14-cd72-412e-820e-ae75977208bd\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-43413b-68dbcd55db-5pjn8"
Jul 21 17:50:51.320533 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:50:51.320304    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8e998c14-cd72-412e-820e-ae75977208bd-openshift-service-ca\") pod \"maas-api-e2e-shared-a-43413b-68dbcd55db-5pjn8\" (UID: \"8e998c14-cd72-412e-820e-ae75977208bd\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-43413b-68dbcd55db-5pjn8"
Jul 21 17:50:51.320533 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:50:51.320367    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8e998c14-cd72-412e-820e-ae75977208bd-maas-api-tls\") pod \"maas-api-e2e-shared-a-43413b-68dbcd55db-5pjn8\" (UID: \"8e998c14-cd72-412e-820e-ae75977208bd\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-43413b-68dbcd55db-5pjn8"
Jul 21 17:50:51.420958 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:50:51.420922    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9s2s5\" (UniqueName: \"kubernetes.io/projected/8e998c14-cd72-412e-820e-ae75977208bd-kube-api-access-9s2s5\") pod \"maas-api-e2e-shared-a-43413b-68dbcd55db-5pjn8\" (UID: \"8e998c14-cd72-412e-820e-ae75977208bd\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-43413b-68dbcd55db-5pjn8"
Jul 21 17:50:51.421104 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:50:51.420966    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8e998c14-cd72-412e-820e-ae75977208bd-openshift-service-ca\") pod \"maas-api-e2e-shared-a-43413b-68dbcd55db-5pjn8\" (UID: \"8e998c14-cd72-412e-820e-ae75977208bd\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-43413b-68dbcd55db-5pjn8"
Jul 21 17:50:51.421104 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:50:51.421004    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8e998c14-cd72-412e-820e-ae75977208bd-maas-api-tls\") pod \"maas-api-e2e-shared-a-43413b-68dbcd55db-5pjn8\" (UID: \"8e998c14-cd72-412e-820e-ae75977208bd\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-43413b-68dbcd55db-5pjn8"
Jul 21 17:50:51.421784 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:50:51.421759    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8e998c14-cd72-412e-820e-ae75977208bd-openshift-service-ca\") pod \"maas-api-e2e-shared-a-43413b-68dbcd55db-5pjn8\" (UID: \"8e998c14-cd72-412e-820e-ae75977208bd\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-43413b-68dbcd55db-5pjn8"
Jul 21 17:50:51.423612 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:50:51.423580    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8e998c14-cd72-412e-820e-ae75977208bd-maas-api-tls\") pod \"maas-api-e2e-shared-a-43413b-68dbcd55db-5pjn8\" (UID: \"8e998c14-cd72-412e-820e-ae75977208bd\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-43413b-68dbcd55db-5pjn8"
Jul 21 17:50:51.429941 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:50:51.429905    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9s2s5\" (UniqueName: \"kubernetes.io/projected/8e998c14-cd72-412e-820e-ae75977208bd-kube-api-access-9s2s5\") pod \"maas-api-e2e-shared-a-43413b-68dbcd55db-5pjn8\" (UID: \"8e998c14-cd72-412e-820e-ae75977208bd\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-43413b-68dbcd55db-5pjn8"
Jul 21 17:50:51.516251 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:50:51.516215    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-43413b-68dbcd55db-5pjn8"
Jul 21 17:50:51.654648 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:50:51.654617    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-43413b-68dbcd55db-5pjn8"]
Jul 21 17:50:51.656483 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:50:51.656456    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8e998c14_cd72_412e_820e_ae75977208bd.slice/crio-88c4c129da1b016d9b0de812b73c32b06c3e28ff6dba8e27459bbb568d8a8910 WatchSource:0}: Error finding container 88c4c129da1b016d9b0de812b73c32b06c3e28ff6dba8e27459bbb568d8a8910: Status 404 returned error can't find the container with id 88c4c129da1b016d9b0de812b73c32b06c3e28ff6dba8e27459bbb568d8a8910
Jul 21 17:50:52.429789 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:50:52.429754    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-43413b-68dbcd55db-5pjn8" event={"ID":"8e998c14-cd72-412e-820e-ae75977208bd","Type":"ContainerStarted","Data":"7581e778cf3b834a905d4e5ed8ad2cd695a598abf4ce8e05c76bc2fa862c25ea"}
Jul 21 17:50:52.430235 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:50:52.429806    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-43413b-68dbcd55db-5pjn8" event={"ID":"8e998c14-cd72-412e-820e-ae75977208bd","Type":"ContainerStarted","Data":"88c4c129da1b016d9b0de812b73c32b06c3e28ff6dba8e27459bbb568d8a8910"}
Jul 21 17:50:52.430235 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:50:52.429853    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-43413b-68dbcd55db-5pjn8"
Jul 21 17:50:52.449982 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:50:52.449920    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-43413b-68dbcd55db-5pjn8" podStartSLOduration=0.83151519 podStartE2EDuration="1.449896864s" totalImagesPullingTime="618.381674ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 17:50:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 17:50:52.447845095 +0000 UTC m=+2544.901997738" watchObservedRunningTime="2026-07-21 17:50:52.449896864 +0000 UTC m=+2544.904049506"
Jul 21 17:50:58.440099 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:50:58.440065    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-43413b-68dbcd55db-5pjn8"
Jul 21 17:50:59.166390 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:50:59.166350    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-046b27-55bd467469-hsk4w"]
Jul 21 17:50:59.170656 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:50:59.170636    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-046b27-55bd467469-hsk4w"
Jul 21 17:50:59.173213 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:50:59.173192    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-b-046b27-serving-cert\""
Jul 21 17:50:59.182912 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:50:59.182887    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-046b27-55bd467469-hsk4w"]
Jul 21 17:50:59.298720 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:50:59.298676    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7288009f-192e-4009-b097-dc0f8d4df8ea-openshift-service-ca\") pod \"maas-api-e2e-shared-b-046b27-55bd467469-hsk4w\" (UID: \"7288009f-192e-4009-b097-dc0f8d4df8ea\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-046b27-55bd467469-hsk4w"
Jul 21 17:50:59.298906 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:50:59.298753    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7288009f-192e-4009-b097-dc0f8d4df8ea-maas-api-tls\") pod \"maas-api-e2e-shared-b-046b27-55bd467469-hsk4w\" (UID: \"7288009f-192e-4009-b097-dc0f8d4df8ea\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-046b27-55bd467469-hsk4w"
Jul 21 17:50:59.298906 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:50:59.298784    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-znbpq\" (UniqueName: \"kubernetes.io/projected/7288009f-192e-4009-b097-dc0f8d4df8ea-kube-api-access-znbpq\") pod \"maas-api-e2e-shared-b-046b27-55bd467469-hsk4w\" (UID: \"7288009f-192e-4009-b097-dc0f8d4df8ea\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-046b27-55bd467469-hsk4w"
Jul 21 17:50:59.399515 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:50:59.399484    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-znbpq\" (UniqueName: \"kubernetes.io/projected/7288009f-192e-4009-b097-dc0f8d4df8ea-kube-api-access-znbpq\") pod \"maas-api-e2e-shared-b-046b27-55bd467469-hsk4w\" (UID: \"7288009f-192e-4009-b097-dc0f8d4df8ea\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-046b27-55bd467469-hsk4w"
Jul 21 17:50:59.399732 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:50:59.399563    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7288009f-192e-4009-b097-dc0f8d4df8ea-openshift-service-ca\") pod \"maas-api-e2e-shared-b-046b27-55bd467469-hsk4w\" (UID: \"7288009f-192e-4009-b097-dc0f8d4df8ea\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-046b27-55bd467469-hsk4w"
Jul 21 17:50:59.399732 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:50:59.399614    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7288009f-192e-4009-b097-dc0f8d4df8ea-maas-api-tls\") pod \"maas-api-e2e-shared-b-046b27-55bd467469-hsk4w\" (UID: \"7288009f-192e-4009-b097-dc0f8d4df8ea\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-046b27-55bd467469-hsk4w"
Jul 21 17:50:59.399732 ip-10-0-141-39 kubenswrapper[2575]: E0721 17:50:59.399727    2575 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-shared-b-046b27-serving-cert: secret "maas-api-e2e-shared-b-046b27-serving-cert" not found
Jul 21 17:50:59.399895 ip-10-0-141-39 kubenswrapper[2575]: E0721 17:50:59.399786    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7288009f-192e-4009-b097-dc0f8d4df8ea-maas-api-tls podName:7288009f-192e-4009-b097-dc0f8d4df8ea nodeName:}" failed. No retries permitted until 2026-07-21 17:50:59.899769642 +0000 UTC m=+2552.353922275 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/7288009f-192e-4009-b097-dc0f8d4df8ea-maas-api-tls") pod "maas-api-e2e-shared-b-046b27-55bd467469-hsk4w" (UID: "7288009f-192e-4009-b097-dc0f8d4df8ea") : secret "maas-api-e2e-shared-b-046b27-serving-cert" not found
Jul 21 17:50:59.400299 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:50:59.400281    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7288009f-192e-4009-b097-dc0f8d4df8ea-openshift-service-ca\") pod \"maas-api-e2e-shared-b-046b27-55bd467469-hsk4w\" (UID: \"7288009f-192e-4009-b097-dc0f8d4df8ea\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-046b27-55bd467469-hsk4w"
Jul 21 17:50:59.408912 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:50:59.408886    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-znbpq\" (UniqueName: \"kubernetes.io/projected/7288009f-192e-4009-b097-dc0f8d4df8ea-kube-api-access-znbpq\") pod \"maas-api-e2e-shared-b-046b27-55bd467469-hsk4w\" (UID: \"7288009f-192e-4009-b097-dc0f8d4df8ea\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-046b27-55bd467469-hsk4w"
Jul 21 17:50:59.904313 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:50:59.904265    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7288009f-192e-4009-b097-dc0f8d4df8ea-maas-api-tls\") pod \"maas-api-e2e-shared-b-046b27-55bd467469-hsk4w\" (UID: \"7288009f-192e-4009-b097-dc0f8d4df8ea\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-046b27-55bd467469-hsk4w"
Jul 21 17:50:59.907102 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:50:59.907073    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7288009f-192e-4009-b097-dc0f8d4df8ea-maas-api-tls\") pod \"maas-api-e2e-shared-b-046b27-55bd467469-hsk4w\" (UID: \"7288009f-192e-4009-b097-dc0f8d4df8ea\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-046b27-55bd467469-hsk4w"
Jul 21 17:51:00.083442 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:51:00.083387    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-046b27-55bd467469-hsk4w"
Jul 21 17:51:00.230469 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:51:00.230437    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-046b27-55bd467469-hsk4w"]
Jul 21 17:51:00.234836 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:51:00.234810    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7288009f_192e_4009_b097_dc0f8d4df8ea.slice/crio-1f947ad60bbd32931efad6a8ec2cf4492cca808ef7a119bf6391dbd6b1889764 WatchSource:0}: Error finding container 1f947ad60bbd32931efad6a8ec2cf4492cca808ef7a119bf6391dbd6b1889764: Status 404 returned error can't find the container with id 1f947ad60bbd32931efad6a8ec2cf4492cca808ef7a119bf6391dbd6b1889764
Jul 21 17:51:00.467637 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:51:00.467556    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-046b27-55bd467469-hsk4w" event={"ID":"7288009f-192e-4009-b097-dc0f8d4df8ea","Type":"ContainerStarted","Data":"1f947ad60bbd32931efad6a8ec2cf4492cca808ef7a119bf6391dbd6b1889764"}
Jul 21 17:51:01.473311 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:51:01.473278    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-046b27-55bd467469-hsk4w" event={"ID":"7288009f-192e-4009-b097-dc0f8d4df8ea","Type":"ContainerStarted","Data":"f7f55d7693c29bafb4b9d86f90cbfae938f585e7e6a442cd129be7d9c38bdd45"}
Jul 21 17:51:01.473713 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:51:01.473439    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-046b27-55bd467469-hsk4w"
Jul 21 17:51:01.493337 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:51:01.493293    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-046b27-55bd467469-hsk4w" podStartSLOduration=2.024486134 podStartE2EDuration="2.493277618s" totalImagesPullingTime="468.791484ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 17:50:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 17:51:01.492084105 +0000 UTC m=+2553.946236745" watchObservedRunningTime="2026-07-21 17:51:01.493277618 +0000 UTC m=+2553.947430257"
Jul 21 17:51:07.482915 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:51:07.482884    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-046b27-55bd467469-hsk4w"
Jul 21 17:51:20.637183 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:51:20.637151    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-43413b/auth-test-model-43413b-kserve-d4c577dd7-f7zxt"]
Jul 21 17:51:20.640683 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:51:20.640667    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-43413b/auth-test-model-43413b-kserve-d4c577dd7-f7zxt"
Jul 21 17:51:20.647788 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:51:20.647766    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-43413b\"/\"kube-root-ca.crt\""
Jul 21 17:51:20.648659 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:51:20.648639    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-43413b\"/\"auth-test-model-43413b-kserve-self-signed-certs\""
Jul 21 17:51:20.648765 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:51:20.648646    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-43413b\"/\"openshift-service-ca.crt\""
Jul 21 17:51:20.648765 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:51:20.648646    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-43413b\"/\"default-dockercfg-qxhgm\""
Jul 21 17:51:20.656798 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:51:20.656775    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-43413b/auth-test-model-43413b-kserve-d4c577dd7-f7zxt"]
Jul 21 17:51:20.695113 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:51:20.695077    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hs5gc\" (UniqueName: \"kubernetes.io/projected/4418e243-ed8a-498a-9fb8-71a80e42f19d-kube-api-access-hs5gc\") pod \"auth-test-model-43413b-kserve-d4c577dd7-f7zxt\" (UID: \"4418e243-ed8a-498a-9fb8-71a80e42f19d\") " pod="ai-tenant-e2e-shared-a-43413b/auth-test-model-43413b-kserve-d4c577dd7-f7zxt"
Jul 21 17:51:20.695272 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:51:20.695136    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4418e243-ed8a-498a-9fb8-71a80e42f19d-home\") pod \"auth-test-model-43413b-kserve-d4c577dd7-f7zxt\" (UID: \"4418e243-ed8a-498a-9fb8-71a80e42f19d\") " pod="ai-tenant-e2e-shared-a-43413b/auth-test-model-43413b-kserve-d4c577dd7-f7zxt"
Jul 21 17:51:20.695272 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:51:20.695162    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4418e243-ed8a-498a-9fb8-71a80e42f19d-tmp-dir\") pod \"auth-test-model-43413b-kserve-d4c577dd7-f7zxt\" (UID: \"4418e243-ed8a-498a-9fb8-71a80e42f19d\") " pod="ai-tenant-e2e-shared-a-43413b/auth-test-model-43413b-kserve-d4c577dd7-f7zxt"
Jul 21 17:51:20.695272 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:51:20.695193    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4418e243-ed8a-498a-9fb8-71a80e42f19d-tls-certs\") pod \"auth-test-model-43413b-kserve-d4c577dd7-f7zxt\" (UID: \"4418e243-ed8a-498a-9fb8-71a80e42f19d\") " pod="ai-tenant-e2e-shared-a-43413b/auth-test-model-43413b-kserve-d4c577dd7-f7zxt"
Jul 21 17:51:20.695440 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:51:20.695279    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4418e243-ed8a-498a-9fb8-71a80e42f19d-dshm\") pod \"auth-test-model-43413b-kserve-d4c577dd7-f7zxt\" (UID: \"4418e243-ed8a-498a-9fb8-71a80e42f19d\") " pod="ai-tenant-e2e-shared-a-43413b/auth-test-model-43413b-kserve-d4c577dd7-f7zxt"
Jul 21 17:51:20.695440 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:51:20.695334    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4418e243-ed8a-498a-9fb8-71a80e42f19d-model-cache\") pod \"auth-test-model-43413b-kserve-d4c577dd7-f7zxt\" (UID: \"4418e243-ed8a-498a-9fb8-71a80e42f19d\") " pod="ai-tenant-e2e-shared-a-43413b/auth-test-model-43413b-kserve-d4c577dd7-f7zxt"
Jul 21 17:51:20.796556 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:51:20.796515    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hs5gc\" (UniqueName: \"kubernetes.io/projected/4418e243-ed8a-498a-9fb8-71a80e42f19d-kube-api-access-hs5gc\") pod \"auth-test-model-43413b-kserve-d4c577dd7-f7zxt\" (UID: \"4418e243-ed8a-498a-9fb8-71a80e42f19d\") " pod="ai-tenant-e2e-shared-a-43413b/auth-test-model-43413b-kserve-d4c577dd7-f7zxt"
Jul 21 17:51:20.796767 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:51:20.796576    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4418e243-ed8a-498a-9fb8-71a80e42f19d-home\") pod \"auth-test-model-43413b-kserve-d4c577dd7-f7zxt\" (UID: \"4418e243-ed8a-498a-9fb8-71a80e42f19d\") " pod="ai-tenant-e2e-shared-a-43413b/auth-test-model-43413b-kserve-d4c577dd7-f7zxt"
Jul 21 17:51:20.796767 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:51:20.796596    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4418e243-ed8a-498a-9fb8-71a80e42f19d-tmp-dir\") pod \"auth-test-model-43413b-kserve-d4c577dd7-f7zxt\" (UID: \"4418e243-ed8a-498a-9fb8-71a80e42f19d\") " pod="ai-tenant-e2e-shared-a-43413b/auth-test-model-43413b-kserve-d4c577dd7-f7zxt"
Jul 21 17:51:20.796767 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:51:20.796615    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4418e243-ed8a-498a-9fb8-71a80e42f19d-tls-certs\") pod \"auth-test-model-43413b-kserve-d4c577dd7-f7zxt\" (UID: \"4418e243-ed8a-498a-9fb8-71a80e42f19d\") " pod="ai-tenant-e2e-shared-a-43413b/auth-test-model-43413b-kserve-d4c577dd7-f7zxt"
Jul 21 17:51:20.796767 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:51:20.796638    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4418e243-ed8a-498a-9fb8-71a80e42f19d-dshm\") pod \"auth-test-model-43413b-kserve-d4c577dd7-f7zxt\" (UID: \"4418e243-ed8a-498a-9fb8-71a80e42f19d\") " pod="ai-tenant-e2e-shared-a-43413b/auth-test-model-43413b-kserve-d4c577dd7-f7zxt"
Jul 21 17:51:20.796767 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:51:20.796677    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4418e243-ed8a-498a-9fb8-71a80e42f19d-model-cache\") pod \"auth-test-model-43413b-kserve-d4c577dd7-f7zxt\" (UID: \"4418e243-ed8a-498a-9fb8-71a80e42f19d\") " pod="ai-tenant-e2e-shared-a-43413b/auth-test-model-43413b-kserve-d4c577dd7-f7zxt"
Jul 21 17:51:20.797050 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:51:20.797024    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4418e243-ed8a-498a-9fb8-71a80e42f19d-tmp-dir\") pod \"auth-test-model-43413b-kserve-d4c577dd7-f7zxt\" (UID: \"4418e243-ed8a-498a-9fb8-71a80e42f19d\") " pod="ai-tenant-e2e-shared-a-43413b/auth-test-model-43413b-kserve-d4c577dd7-f7zxt"
Jul 21 17:51:20.797173 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:51:20.797075    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4418e243-ed8a-498a-9fb8-71a80e42f19d-home\") pod \"auth-test-model-43413b-kserve-d4c577dd7-f7zxt\" (UID: \"4418e243-ed8a-498a-9fb8-71a80e42f19d\") " pod="ai-tenant-e2e-shared-a-43413b/auth-test-model-43413b-kserve-d4c577dd7-f7zxt"
Jul 21 17:51:20.797173 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:51:20.797112    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4418e243-ed8a-498a-9fb8-71a80e42f19d-model-cache\") pod \"auth-test-model-43413b-kserve-d4c577dd7-f7zxt\" (UID: \"4418e243-ed8a-498a-9fb8-71a80e42f19d\") " pod="ai-tenant-e2e-shared-a-43413b/auth-test-model-43413b-kserve-d4c577dd7-f7zxt"
Jul 21 17:51:20.799129 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:51:20.799113    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4418e243-ed8a-498a-9fb8-71a80e42f19d-dshm\") pod \"auth-test-model-43413b-kserve-d4c577dd7-f7zxt\" (UID: \"4418e243-ed8a-498a-9fb8-71a80e42f19d\") " pod="ai-tenant-e2e-shared-a-43413b/auth-test-model-43413b-kserve-d4c577dd7-f7zxt"
Jul 21 17:51:20.799386 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:51:20.799370    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4418e243-ed8a-498a-9fb8-71a80e42f19d-tls-certs\") pod \"auth-test-model-43413b-kserve-d4c577dd7-f7zxt\" (UID: \"4418e243-ed8a-498a-9fb8-71a80e42f19d\") " pod="ai-tenant-e2e-shared-a-43413b/auth-test-model-43413b-kserve-d4c577dd7-f7zxt"
Jul 21 17:51:20.825088 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:51:20.825063    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hs5gc\" (UniqueName: \"kubernetes.io/projected/4418e243-ed8a-498a-9fb8-71a80e42f19d-kube-api-access-hs5gc\") pod \"auth-test-model-43413b-kserve-d4c577dd7-f7zxt\" (UID: \"4418e243-ed8a-498a-9fb8-71a80e42f19d\") " pod="ai-tenant-e2e-shared-a-43413b/auth-test-model-43413b-kserve-d4c577dd7-f7zxt"
Jul 21 17:51:20.950297 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:51:20.950198    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-43413b/auth-test-model-43413b-kserve-d4c577dd7-f7zxt"
Jul 21 17:51:21.093056 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:51:21.093026    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-43413b/auth-test-model-43413b-kserve-d4c577dd7-f7zxt"]
Jul 21 17:51:21.096201 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:51:21.096171    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod4418e243_ed8a_498a_9fb8_71a80e42f19d.slice/crio-3de44326d94787d58e94f8b49b2bf9ae396e74175e2bebf36d70fc6a36beb56f WatchSource:0}: Error finding container 3de44326d94787d58e94f8b49b2bf9ae396e74175e2bebf36d70fc6a36beb56f: Status 404 returned error can't find the container with id 3de44326d94787d58e94f8b49b2bf9ae396e74175e2bebf36d70fc6a36beb56f
Jul 21 17:51:21.566343 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:51:21.566307    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-43413b/auth-test-model-43413b-kserve-d4c577dd7-f7zxt" event={"ID":"4418e243-ed8a-498a-9fb8-71a80e42f19d","Type":"ContainerStarted","Data":"a1fec165e228b7015dbcb21907e00b3ffbcda1ff017df88c3f84fa003d2afdf1"}
Jul 21 17:51:21.566343 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:51:21.566349    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-43413b/auth-test-model-43413b-kserve-d4c577dd7-f7zxt" event={"ID":"4418e243-ed8a-498a-9fb8-71a80e42f19d","Type":"ContainerStarted","Data":"3de44326d94787d58e94f8b49b2bf9ae396e74175e2bebf36d70fc6a36beb56f"}
Jul 21 17:51:21.603116 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:51:21.603059    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-43413b/auth-test-model-43413b-kserve-d4c577dd7-f7zxt" podStartSLOduration=1.603042072 podStartE2EDuration="1.603042072s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 17:51:20 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 17:51:21.601719423 +0000 UTC m=+2574.055872065" watchObservedRunningTime="2026-07-21 17:51:21.603042072 +0000 UTC m=+2574.057194711"
Jul 21 17:51:30.950501 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:51:30.950461    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-43413b/auth-test-model-43413b-kserve-d4c577dd7-f7zxt"
Jul 21 17:51:30.951002 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:51:30.950526    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-43413b/auth-test-model-43413b-kserve-d4c577dd7-f7zxt"
Jul 21 17:51:30.963538 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:51:30.963515    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-43413b/auth-test-model-43413b-kserve-d4c577dd7-f7zxt"
Jul 21 17:51:31.621662 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:51:31.621632    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-43413b/auth-test-model-43413b-kserve-d4c577dd7-f7zxt"
Jul 21 17:53:28.581915 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:53:28.581842    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-b64gx_9425e519-d00c-4af6-a68a-3efde7aae5ba/ovn-acl-logging/0.log"
Jul 21 17:53:28.594351 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:53:28.594331    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-b64gx_9425e519-d00c-4af6-a68a-3efde7aae5ba/ovn-acl-logging/0.log"
Jul 21 17:53:55.087603 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:53:55.087568    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-43413b/auth-test-model-43413b-kserve-d4c577dd7-f7zxt"]
Jul 21 17:54:03.510300 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:54:03.510258    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-43413b/sub-test-model-43413b-kserve-57dc65f757-zntsx"]
Jul 21 17:54:03.513477 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:54:03.513460    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-43413b/sub-test-model-43413b-kserve-57dc65f757-zntsx"
Jul 21 17:54:03.516540 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:54:03.516516    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-43413b\"/\"sub-test-model-43413b-kserve-self-signed-certs\""
Jul 21 17:54:03.535918 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:54:03.535882    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-43413b/sub-test-model-43413b-kserve-57dc65f757-zntsx"]
Jul 21 17:54:03.646750 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:54:03.646709    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qqz8t\" (UniqueName: \"kubernetes.io/projected/c1e26876-0533-45c3-b6d2-8de365b99e54-kube-api-access-qqz8t\") pod \"sub-test-model-43413b-kserve-57dc65f757-zntsx\" (UID: \"c1e26876-0533-45c3-b6d2-8de365b99e54\") " pod="ai-tenant-e2e-shared-a-43413b/sub-test-model-43413b-kserve-57dc65f757-zntsx"
Jul 21 17:54:03.646946 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:54:03.646785    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c1e26876-0533-45c3-b6d2-8de365b99e54-tmp-dir\") pod \"sub-test-model-43413b-kserve-57dc65f757-zntsx\" (UID: \"c1e26876-0533-45c3-b6d2-8de365b99e54\") " pod="ai-tenant-e2e-shared-a-43413b/sub-test-model-43413b-kserve-57dc65f757-zntsx"
Jul 21 17:54:03.646946 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:54:03.646815    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c1e26876-0533-45c3-b6d2-8de365b99e54-home\") pod \"sub-test-model-43413b-kserve-57dc65f757-zntsx\" (UID: \"c1e26876-0533-45c3-b6d2-8de365b99e54\") " pod="ai-tenant-e2e-shared-a-43413b/sub-test-model-43413b-kserve-57dc65f757-zntsx"
Jul 21 17:54:03.646946 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:54:03.646832    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c1e26876-0533-45c3-b6d2-8de365b99e54-tls-certs\") pod \"sub-test-model-43413b-kserve-57dc65f757-zntsx\" (UID: \"c1e26876-0533-45c3-b6d2-8de365b99e54\") " pod="ai-tenant-e2e-shared-a-43413b/sub-test-model-43413b-kserve-57dc65f757-zntsx"
Jul 21 17:54:03.646946 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:54:03.646880    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c1e26876-0533-45c3-b6d2-8de365b99e54-model-cache\") pod \"sub-test-model-43413b-kserve-57dc65f757-zntsx\" (UID: \"c1e26876-0533-45c3-b6d2-8de365b99e54\") " pod="ai-tenant-e2e-shared-a-43413b/sub-test-model-43413b-kserve-57dc65f757-zntsx"
Jul 21 17:54:03.647104 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:54:03.646990    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c1e26876-0533-45c3-b6d2-8de365b99e54-dshm\") pod \"sub-test-model-43413b-kserve-57dc65f757-zntsx\" (UID: \"c1e26876-0533-45c3-b6d2-8de365b99e54\") " pod="ai-tenant-e2e-shared-a-43413b/sub-test-model-43413b-kserve-57dc65f757-zntsx"
Jul 21 17:54:03.747651 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:54:03.747615    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c1e26876-0533-45c3-b6d2-8de365b99e54-dshm\") pod \"sub-test-model-43413b-kserve-57dc65f757-zntsx\" (UID: \"c1e26876-0533-45c3-b6d2-8de365b99e54\") " pod="ai-tenant-e2e-shared-a-43413b/sub-test-model-43413b-kserve-57dc65f757-zntsx"
Jul 21 17:54:03.747865 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:54:03.747668    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qqz8t\" (UniqueName: \"kubernetes.io/projected/c1e26876-0533-45c3-b6d2-8de365b99e54-kube-api-access-qqz8t\") pod \"sub-test-model-43413b-kserve-57dc65f757-zntsx\" (UID: \"c1e26876-0533-45c3-b6d2-8de365b99e54\") " pod="ai-tenant-e2e-shared-a-43413b/sub-test-model-43413b-kserve-57dc65f757-zntsx"
Jul 21 17:54:03.747865 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:54:03.747719    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c1e26876-0533-45c3-b6d2-8de365b99e54-tmp-dir\") pod \"sub-test-model-43413b-kserve-57dc65f757-zntsx\" (UID: \"c1e26876-0533-45c3-b6d2-8de365b99e54\") " pod="ai-tenant-e2e-shared-a-43413b/sub-test-model-43413b-kserve-57dc65f757-zntsx"
Jul 21 17:54:03.747865 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:54:03.747746    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c1e26876-0533-45c3-b6d2-8de365b99e54-home\") pod \"sub-test-model-43413b-kserve-57dc65f757-zntsx\" (UID: \"c1e26876-0533-45c3-b6d2-8de365b99e54\") " pod="ai-tenant-e2e-shared-a-43413b/sub-test-model-43413b-kserve-57dc65f757-zntsx"
Jul 21 17:54:03.747865 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:54:03.747766    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c1e26876-0533-45c3-b6d2-8de365b99e54-tls-certs\") pod \"sub-test-model-43413b-kserve-57dc65f757-zntsx\" (UID: \"c1e26876-0533-45c3-b6d2-8de365b99e54\") " pod="ai-tenant-e2e-shared-a-43413b/sub-test-model-43413b-kserve-57dc65f757-zntsx"
Jul 21 17:54:03.747865 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:54:03.747843    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c1e26876-0533-45c3-b6d2-8de365b99e54-model-cache\") pod \"sub-test-model-43413b-kserve-57dc65f757-zntsx\" (UID: \"c1e26876-0533-45c3-b6d2-8de365b99e54\") " pod="ai-tenant-e2e-shared-a-43413b/sub-test-model-43413b-kserve-57dc65f757-zntsx"
Jul 21 17:54:03.748230 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:54:03.748204    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c1e26876-0533-45c3-b6d2-8de365b99e54-tmp-dir\") pod \"sub-test-model-43413b-kserve-57dc65f757-zntsx\" (UID: \"c1e26876-0533-45c3-b6d2-8de365b99e54\") " pod="ai-tenant-e2e-shared-a-43413b/sub-test-model-43413b-kserve-57dc65f757-zntsx"
Jul 21 17:54:03.748488 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:54:03.748459    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c1e26876-0533-45c3-b6d2-8de365b99e54-model-cache\") pod \"sub-test-model-43413b-kserve-57dc65f757-zntsx\" (UID: \"c1e26876-0533-45c3-b6d2-8de365b99e54\") " pod="ai-tenant-e2e-shared-a-43413b/sub-test-model-43413b-kserve-57dc65f757-zntsx"
Jul 21 17:54:03.748759 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:54:03.748491    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c1e26876-0533-45c3-b6d2-8de365b99e54-home\") pod \"sub-test-model-43413b-kserve-57dc65f757-zntsx\" (UID: \"c1e26876-0533-45c3-b6d2-8de365b99e54\") " pod="ai-tenant-e2e-shared-a-43413b/sub-test-model-43413b-kserve-57dc65f757-zntsx"
Jul 21 17:54:03.750166 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:54:03.750147    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c1e26876-0533-45c3-b6d2-8de365b99e54-dshm\") pod \"sub-test-model-43413b-kserve-57dc65f757-zntsx\" (UID: \"c1e26876-0533-45c3-b6d2-8de365b99e54\") " pod="ai-tenant-e2e-shared-a-43413b/sub-test-model-43413b-kserve-57dc65f757-zntsx"
Jul 21 17:54:03.750701 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:54:03.750678    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c1e26876-0533-45c3-b6d2-8de365b99e54-tls-certs\") pod \"sub-test-model-43413b-kserve-57dc65f757-zntsx\" (UID: \"c1e26876-0533-45c3-b6d2-8de365b99e54\") " pod="ai-tenant-e2e-shared-a-43413b/sub-test-model-43413b-kserve-57dc65f757-zntsx"
Jul 21 17:54:03.756592 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:54:03.756566    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qqz8t\" (UniqueName: \"kubernetes.io/projected/c1e26876-0533-45c3-b6d2-8de365b99e54-kube-api-access-qqz8t\") pod \"sub-test-model-43413b-kserve-57dc65f757-zntsx\" (UID: \"c1e26876-0533-45c3-b6d2-8de365b99e54\") " pod="ai-tenant-e2e-shared-a-43413b/sub-test-model-43413b-kserve-57dc65f757-zntsx"
Jul 21 17:54:03.822271 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:54:03.822179    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-43413b/sub-test-model-43413b-kserve-57dc65f757-zntsx"
Jul 21 17:54:03.956558 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:54:03.956530    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-43413b/sub-test-model-43413b-kserve-57dc65f757-zntsx"]
Jul 21 17:54:03.958587 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:54:03.958547    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc1e26876_0533_45c3_b6d2_8de365b99e54.slice/crio-dbad9ccb6476199ad7eb1a6ec6c5e41a798d364a110360d15d83cfc15e703574 WatchSource:0}: Error finding container dbad9ccb6476199ad7eb1a6ec6c5e41a798d364a110360d15d83cfc15e703574: Status 404 returned error can't find the container with id dbad9ccb6476199ad7eb1a6ec6c5e41a798d364a110360d15d83cfc15e703574
Jul 21 17:54:04.309644 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:54:04.309614    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-43413b/sub-test-model-43413b-kserve-57dc65f757-zntsx" event={"ID":"c1e26876-0533-45c3-b6d2-8de365b99e54","Type":"ContainerStarted","Data":"c6a3740177237e4a3646799ac167fb0858ed10b26de239aab9b7b707d7abc18d"}
Jul 21 17:54:04.309831 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:54:04.309658    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-43413b/sub-test-model-43413b-kserve-57dc65f757-zntsx" event={"ID":"c1e26876-0533-45c3-b6d2-8de365b99e54","Type":"ContainerStarted","Data":"dbad9ccb6476199ad7eb1a6ec6c5e41a798d364a110360d15d83cfc15e703574"}
Jul 21 17:54:04.327860 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:54:04.327816    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-43413b/sub-test-model-43413b-kserve-57dc65f757-zntsx" podStartSLOduration=1.32780013 podStartE2EDuration="1.32780013s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 17:54:03 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 17:54:04.326879813 +0000 UTC m=+2736.781032454" watchObservedRunningTime="2026-07-21 17:54:04.32780013 +0000 UTC m=+2736.781952770"
Jul 21 17:54:10.108363 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:54:10.108312    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-43413b/auth-test-model-43413b-kserve-d4c577dd7-f7zxt" podUID="4418e243-ed8a-498a-9fb8-71a80e42f19d" containerName="main" containerID="cri-o://a1fec165e228b7015dbcb21907e00b3ffbcda1ff017df88c3f84fa003d2afdf1" gracePeriod=45
Jul 21 17:54:10.337562 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:54:10.337527    2575 generic.go:356] "Generic (PLEG): container finished" podID="4418e243-ed8a-498a-9fb8-71a80e42f19d" containerID="a1fec165e228b7015dbcb21907e00b3ffbcda1ff017df88c3f84fa003d2afdf1" exitCode=0
Jul 21 17:54:10.337723 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:54:10.337600    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-43413b/auth-test-model-43413b-kserve-d4c577dd7-f7zxt" event={"ID":"4418e243-ed8a-498a-9fb8-71a80e42f19d","Type":"ContainerDied","Data":"a1fec165e228b7015dbcb21907e00b3ffbcda1ff017df88c3f84fa003d2afdf1"}
Jul 21 17:54:10.362259 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:54:10.362198    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-43413b/auth-test-model-43413b-kserve-d4c577dd7-f7zxt"
Jul 21 17:54:10.516717 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:54:10.516684    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4418e243-ed8a-498a-9fb8-71a80e42f19d-home\") pod \"4418e243-ed8a-498a-9fb8-71a80e42f19d\" (UID: \"4418e243-ed8a-498a-9fb8-71a80e42f19d\") "
Jul 21 17:54:10.516916 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:54:10.516754    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hs5gc\" (UniqueName: \"kubernetes.io/projected/4418e243-ed8a-498a-9fb8-71a80e42f19d-kube-api-access-hs5gc\") pod \"4418e243-ed8a-498a-9fb8-71a80e42f19d\" (UID: \"4418e243-ed8a-498a-9fb8-71a80e42f19d\") "
Jul 21 17:54:10.516916 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:54:10.516778    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4418e243-ed8a-498a-9fb8-71a80e42f19d-dshm\") pod \"4418e243-ed8a-498a-9fb8-71a80e42f19d\" (UID: \"4418e243-ed8a-498a-9fb8-71a80e42f19d\") "
Jul 21 17:54:10.516916 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:54:10.516806    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4418e243-ed8a-498a-9fb8-71a80e42f19d-model-cache\") pod \"4418e243-ed8a-498a-9fb8-71a80e42f19d\" (UID: \"4418e243-ed8a-498a-9fb8-71a80e42f19d\") "
Jul 21 17:54:10.516916 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:54:10.516889    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4418e243-ed8a-498a-9fb8-71a80e42f19d-tmp-dir\") pod \"4418e243-ed8a-498a-9fb8-71a80e42f19d\" (UID: \"4418e243-ed8a-498a-9fb8-71a80e42f19d\") "
Jul 21 17:54:10.517131 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:54:10.516922    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4418e243-ed8a-498a-9fb8-71a80e42f19d-tls-certs\") pod \"4418e243-ed8a-498a-9fb8-71a80e42f19d\" (UID: \"4418e243-ed8a-498a-9fb8-71a80e42f19d\") "
Jul 21 17:54:10.517131 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:54:10.516991    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4418e243-ed8a-498a-9fb8-71a80e42f19d-home" (OuterVolumeSpecName: "home") pod "4418e243-ed8a-498a-9fb8-71a80e42f19d" (UID: "4418e243-ed8a-498a-9fb8-71a80e42f19d"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 17:54:10.517234 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:54:10.517154    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4418e243-ed8a-498a-9fb8-71a80e42f19d-model-cache" (OuterVolumeSpecName: "model-cache") pod "4418e243-ed8a-498a-9fb8-71a80e42f19d" (UID: "4418e243-ed8a-498a-9fb8-71a80e42f19d"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 17:54:10.517234 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:54:10.517193    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4418e243-ed8a-498a-9fb8-71a80e42f19d-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "4418e243-ed8a-498a-9fb8-71a80e42f19d" (UID: "4418e243-ed8a-498a-9fb8-71a80e42f19d"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 17:54:10.517317 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:54:10.517245    2575 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4418e243-ed8a-498a-9fb8-71a80e42f19d-home\") on node \"ip-10-0-141-39.ec2.internal\" DevicePath \"\""
Jul 21 17:54:10.517317 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:54:10.517258    2575 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4418e243-ed8a-498a-9fb8-71a80e42f19d-model-cache\") on node \"ip-10-0-141-39.ec2.internal\" DevicePath \"\""
Jul 21 17:54:10.519299 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:54:10.519276    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4418e243-ed8a-498a-9fb8-71a80e42f19d-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "4418e243-ed8a-498a-9fb8-71a80e42f19d" (UID: "4418e243-ed8a-498a-9fb8-71a80e42f19d"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 21 17:54:10.519434 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:54:10.519310    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4418e243-ed8a-498a-9fb8-71a80e42f19d-dshm" (OuterVolumeSpecName: "dshm") pod "4418e243-ed8a-498a-9fb8-71a80e42f19d" (UID: "4418e243-ed8a-498a-9fb8-71a80e42f19d"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 17:54:10.519434 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:54:10.519360    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4418e243-ed8a-498a-9fb8-71a80e42f19d-kube-api-access-hs5gc" (OuterVolumeSpecName: "kube-api-access-hs5gc") pod "4418e243-ed8a-498a-9fb8-71a80e42f19d" (UID: "4418e243-ed8a-498a-9fb8-71a80e42f19d"). InnerVolumeSpecName "kube-api-access-hs5gc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 17:54:10.618472 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:54:10.618371    2575 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4418e243-ed8a-498a-9fb8-71a80e42f19d-tmp-dir\") on node \"ip-10-0-141-39.ec2.internal\" DevicePath \"\""
Jul 21 17:54:10.618472 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:54:10.618396    2575 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4418e243-ed8a-498a-9fb8-71a80e42f19d-tls-certs\") on node \"ip-10-0-141-39.ec2.internal\" DevicePath \"\""
Jul 21 17:54:10.618472 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:54:10.618406    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hs5gc\" (UniqueName: \"kubernetes.io/projected/4418e243-ed8a-498a-9fb8-71a80e42f19d-kube-api-access-hs5gc\") on node \"ip-10-0-141-39.ec2.internal\" DevicePath \"\""
Jul 21 17:54:10.618472 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:54:10.618436    2575 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4418e243-ed8a-498a-9fb8-71a80e42f19d-dshm\") on node \"ip-10-0-141-39.ec2.internal\" DevicePath \"\""
Jul 21 17:54:11.343901 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:54:11.343876    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-43413b/auth-test-model-43413b-kserve-d4c577dd7-f7zxt"
Jul 21 17:54:11.344373 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:54:11.343921    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-43413b/auth-test-model-43413b-kserve-d4c577dd7-f7zxt" event={"ID":"4418e243-ed8a-498a-9fb8-71a80e42f19d","Type":"ContainerDied","Data":"3de44326d94787d58e94f8b49b2bf9ae396e74175e2bebf36d70fc6a36beb56f"}
Jul 21 17:54:11.344373 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:54:11.343968    2575 scope.go:117] "RemoveContainer" containerID="a1fec165e228b7015dbcb21907e00b3ffbcda1ff017df88c3f84fa003d2afdf1"
Jul 21 17:54:11.366999 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:54:11.366967    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-43413b/auth-test-model-43413b-kserve-d4c577dd7-f7zxt"]
Jul 21 17:54:11.370776 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:54:11.370747    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-43413b/auth-test-model-43413b-kserve-d4c577dd7-f7zxt"]
Jul 21 17:54:12.117135 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:54:12.117098    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4418e243-ed8a-498a-9fb8-71a80e42f19d" path="/var/lib/kubelet/pods/4418e243-ed8a-498a-9fb8-71a80e42f19d/volumes"
Jul 21 17:54:13.822691 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:54:13.822657    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-43413b/sub-test-model-43413b-kserve-57dc65f757-zntsx"
Jul 21 17:54:13.823095 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:54:13.822713    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-43413b/sub-test-model-43413b-kserve-57dc65f757-zntsx"
Jul 21 17:54:13.835518 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:54:13.835487    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-43413b/sub-test-model-43413b-kserve-57dc65f757-zntsx"
Jul 21 17:54:14.370217 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:54:14.370188    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-43413b/sub-test-model-43413b-kserve-57dc65f757-zntsx"
Jul 21 17:55:12.931622 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:55:12.931588    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-43413b/sub-test-model-43413b-kserve-57dc65f757-zntsx"]
Jul 21 17:55:16.211911 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:55:16.211875    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-43413b/rate-test-model-43413b-kserve-69659d8987-lxxmr"]
Jul 21 17:55:16.212490 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:55:16.212471    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4418e243-ed8a-498a-9fb8-71a80e42f19d" containerName="main"
Jul 21 17:55:16.212545 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:55:16.212495    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="4418e243-ed8a-498a-9fb8-71a80e42f19d" containerName="main"
Jul 21 17:55:16.212639 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:55:16.212626    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="4418e243-ed8a-498a-9fb8-71a80e42f19d" containerName="main"
Jul 21 17:55:16.215826 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:55:16.215809    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-43413b/rate-test-model-43413b-kserve-69659d8987-lxxmr"
Jul 21 17:55:16.218802 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:55:16.218783    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-43413b\"/\"rate-test-model-43413b-kserve-self-signed-certs\""
Jul 21 17:55:16.226142 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:55:16.226121    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-43413b/rate-test-model-43413b-kserve-69659d8987-lxxmr"]
Jul 21 17:55:16.317619 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:55:16.317593    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a0a5bd3d-4151-462a-953a-6fd65be641ca-model-cache\") pod \"rate-test-model-43413b-kserve-69659d8987-lxxmr\" (UID: \"a0a5bd3d-4151-462a-953a-6fd65be641ca\") " pod="ai-tenant-e2e-shared-a-43413b/rate-test-model-43413b-kserve-69659d8987-lxxmr"
Jul 21 17:55:16.317785 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:55:16.317624    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kzk8c\" (UniqueName: \"kubernetes.io/projected/a0a5bd3d-4151-462a-953a-6fd65be641ca-kube-api-access-kzk8c\") pod \"rate-test-model-43413b-kserve-69659d8987-lxxmr\" (UID: \"a0a5bd3d-4151-462a-953a-6fd65be641ca\") " pod="ai-tenant-e2e-shared-a-43413b/rate-test-model-43413b-kserve-69659d8987-lxxmr"
Jul 21 17:55:16.317785 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:55:16.317646    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a0a5bd3d-4151-462a-953a-6fd65be641ca-dshm\") pod \"rate-test-model-43413b-kserve-69659d8987-lxxmr\" (UID: \"a0a5bd3d-4151-462a-953a-6fd65be641ca\") " pod="ai-tenant-e2e-shared-a-43413b/rate-test-model-43413b-kserve-69659d8987-lxxmr"
Jul 21 17:55:16.317785 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:55:16.317730    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a0a5bd3d-4151-462a-953a-6fd65be641ca-tmp-dir\") pod \"rate-test-model-43413b-kserve-69659d8987-lxxmr\" (UID: \"a0a5bd3d-4151-462a-953a-6fd65be641ca\") " pod="ai-tenant-e2e-shared-a-43413b/rate-test-model-43413b-kserve-69659d8987-lxxmr"
Jul 21 17:55:16.317785 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:55:16.317761    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a0a5bd3d-4151-462a-953a-6fd65be641ca-tls-certs\") pod \"rate-test-model-43413b-kserve-69659d8987-lxxmr\" (UID: \"a0a5bd3d-4151-462a-953a-6fd65be641ca\") " pod="ai-tenant-e2e-shared-a-43413b/rate-test-model-43413b-kserve-69659d8987-lxxmr"
Jul 21 17:55:16.317941 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:55:16.317790    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a0a5bd3d-4151-462a-953a-6fd65be641ca-home\") pod \"rate-test-model-43413b-kserve-69659d8987-lxxmr\" (UID: \"a0a5bd3d-4151-462a-953a-6fd65be641ca\") " pod="ai-tenant-e2e-shared-a-43413b/rate-test-model-43413b-kserve-69659d8987-lxxmr"
Jul 21 17:55:16.418568 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:55:16.418527    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a0a5bd3d-4151-462a-953a-6fd65be641ca-tmp-dir\") pod \"rate-test-model-43413b-kserve-69659d8987-lxxmr\" (UID: \"a0a5bd3d-4151-462a-953a-6fd65be641ca\") " pod="ai-tenant-e2e-shared-a-43413b/rate-test-model-43413b-kserve-69659d8987-lxxmr"
Jul 21 17:55:16.418568 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:55:16.418566    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a0a5bd3d-4151-462a-953a-6fd65be641ca-tls-certs\") pod \"rate-test-model-43413b-kserve-69659d8987-lxxmr\" (UID: \"a0a5bd3d-4151-462a-953a-6fd65be641ca\") " pod="ai-tenant-e2e-shared-a-43413b/rate-test-model-43413b-kserve-69659d8987-lxxmr"
Jul 21 17:55:16.418835 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:55:16.418590    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a0a5bd3d-4151-462a-953a-6fd65be641ca-home\") pod \"rate-test-model-43413b-kserve-69659d8987-lxxmr\" (UID: \"a0a5bd3d-4151-462a-953a-6fd65be641ca\") " pod="ai-tenant-e2e-shared-a-43413b/rate-test-model-43413b-kserve-69659d8987-lxxmr"
Jul 21 17:55:16.418835 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:55:16.418644    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a0a5bd3d-4151-462a-953a-6fd65be641ca-model-cache\") pod \"rate-test-model-43413b-kserve-69659d8987-lxxmr\" (UID: \"a0a5bd3d-4151-462a-953a-6fd65be641ca\") " pod="ai-tenant-e2e-shared-a-43413b/rate-test-model-43413b-kserve-69659d8987-lxxmr"
Jul 21 17:55:16.418835 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:55:16.418662    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kzk8c\" (UniqueName: \"kubernetes.io/projected/a0a5bd3d-4151-462a-953a-6fd65be641ca-kube-api-access-kzk8c\") pod \"rate-test-model-43413b-kserve-69659d8987-lxxmr\" (UID: \"a0a5bd3d-4151-462a-953a-6fd65be641ca\") " pod="ai-tenant-e2e-shared-a-43413b/rate-test-model-43413b-kserve-69659d8987-lxxmr"
Jul 21 17:55:16.418835 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:55:16.418678    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a0a5bd3d-4151-462a-953a-6fd65be641ca-dshm\") pod \"rate-test-model-43413b-kserve-69659d8987-lxxmr\" (UID: \"a0a5bd3d-4151-462a-953a-6fd65be641ca\") " pod="ai-tenant-e2e-shared-a-43413b/rate-test-model-43413b-kserve-69659d8987-lxxmr"
Jul 21 17:55:16.419030 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:55:16.418988    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a0a5bd3d-4151-462a-953a-6fd65be641ca-tmp-dir\") pod \"rate-test-model-43413b-kserve-69659d8987-lxxmr\" (UID: \"a0a5bd3d-4151-462a-953a-6fd65be641ca\") " pod="ai-tenant-e2e-shared-a-43413b/rate-test-model-43413b-kserve-69659d8987-lxxmr"
Jul 21 17:55:16.419089 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:55:16.419049    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a0a5bd3d-4151-462a-953a-6fd65be641ca-home\") pod \"rate-test-model-43413b-kserve-69659d8987-lxxmr\" (UID: \"a0a5bd3d-4151-462a-953a-6fd65be641ca\") " pod="ai-tenant-e2e-shared-a-43413b/rate-test-model-43413b-kserve-69659d8987-lxxmr"
Jul 21 17:55:16.419145 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:55:16.419107    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a0a5bd3d-4151-462a-953a-6fd65be641ca-model-cache\") pod \"rate-test-model-43413b-kserve-69659d8987-lxxmr\" (UID: \"a0a5bd3d-4151-462a-953a-6fd65be641ca\") " pod="ai-tenant-e2e-shared-a-43413b/rate-test-model-43413b-kserve-69659d8987-lxxmr"
Jul 21 17:55:16.421109 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:55:16.421086    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a0a5bd3d-4151-462a-953a-6fd65be641ca-dshm\") pod \"rate-test-model-43413b-kserve-69659d8987-lxxmr\" (UID: \"a0a5bd3d-4151-462a-953a-6fd65be641ca\") " pod="ai-tenant-e2e-shared-a-43413b/rate-test-model-43413b-kserve-69659d8987-lxxmr"
Jul 21 17:55:16.421357 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:55:16.421339    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a0a5bd3d-4151-462a-953a-6fd65be641ca-tls-certs\") pod \"rate-test-model-43413b-kserve-69659d8987-lxxmr\" (UID: \"a0a5bd3d-4151-462a-953a-6fd65be641ca\") " pod="ai-tenant-e2e-shared-a-43413b/rate-test-model-43413b-kserve-69659d8987-lxxmr"
Jul 21 17:55:16.433821 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:55:16.429946    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kzk8c\" (UniqueName: \"kubernetes.io/projected/a0a5bd3d-4151-462a-953a-6fd65be641ca-kube-api-access-kzk8c\") pod \"rate-test-model-43413b-kserve-69659d8987-lxxmr\" (UID: \"a0a5bd3d-4151-462a-953a-6fd65be641ca\") " pod="ai-tenant-e2e-shared-a-43413b/rate-test-model-43413b-kserve-69659d8987-lxxmr"
Jul 21 17:55:16.524930 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:55:16.524878    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-43413b/rate-test-model-43413b-kserve-69659d8987-lxxmr"
Jul 21 17:55:16.663810 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:55:16.663749    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-43413b/rate-test-model-43413b-kserve-69659d8987-lxxmr"]
Jul 21 17:55:17.656668 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:55:17.656630    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-43413b/rate-test-model-43413b-kserve-69659d8987-lxxmr" event={"ID":"a0a5bd3d-4151-462a-953a-6fd65be641ca","Type":"ContainerStarted","Data":"4642758b262b552fc07d8ce77318d4a69de737d8854ec5b6dedbc7b059eca7e6"}
Jul 21 17:55:17.656668 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:55:17.656670    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-43413b/rate-test-model-43413b-kserve-69659d8987-lxxmr" event={"ID":"a0a5bd3d-4151-462a-953a-6fd65be641ca","Type":"ContainerStarted","Data":"363f4aa5764535f4cb27c421d48a85353cf3c66f2e11e650b4a67eed31514c19"}
Jul 21 17:55:17.673767 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:55:17.673720    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-43413b/rate-test-model-43413b-kserve-69659d8987-lxxmr" podStartSLOduration=1.6737058569999999 podStartE2EDuration="1.673705857s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 17:55:16 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 17:55:17.672448913 +0000 UTC m=+2810.126601553" watchObservedRunningTime="2026-07-21 17:55:17.673705857 +0000 UTC m=+2810.127858531"
Jul 21 17:55:26.525186 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:55:26.525148    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-43413b/rate-test-model-43413b-kserve-69659d8987-lxxmr"
Jul 21 17:55:26.525186 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:55:26.525194    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-43413b/rate-test-model-43413b-kserve-69659d8987-lxxmr"
Jul 21 17:55:26.537960 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:55:26.537940    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-43413b/rate-test-model-43413b-kserve-69659d8987-lxxmr"
Jul 21 17:55:26.709879 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:55:26.709851    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-43413b/rate-test-model-43413b-kserve-69659d8987-lxxmr"
Jul 21 17:55:27.957474 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:55:27.957399    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-43413b/sub-test-model-43413b-kserve-57dc65f757-zntsx" podUID="c1e26876-0533-45c3-b6d2-8de365b99e54" containerName="main" containerID="cri-o://c6a3740177237e4a3646799ac167fb0858ed10b26de239aab9b7b707d7abc18d" gracePeriod=45
Jul 21 17:55:28.206602 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:55:28.206577    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-43413b/sub-test-model-43413b-kserve-57dc65f757-zntsx"
Jul 21 17:55:28.330926 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:55:28.330814    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qqz8t\" (UniqueName: \"kubernetes.io/projected/c1e26876-0533-45c3-b6d2-8de365b99e54-kube-api-access-qqz8t\") pod \"c1e26876-0533-45c3-b6d2-8de365b99e54\" (UID: \"c1e26876-0533-45c3-b6d2-8de365b99e54\") "
Jul 21 17:55:28.330926 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:55:28.330844    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c1e26876-0533-45c3-b6d2-8de365b99e54-home\") pod \"c1e26876-0533-45c3-b6d2-8de365b99e54\" (UID: \"c1e26876-0533-45c3-b6d2-8de365b99e54\") "
Jul 21 17:55:28.330926 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:55:28.330864    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c1e26876-0533-45c3-b6d2-8de365b99e54-tmp-dir\") pod \"c1e26876-0533-45c3-b6d2-8de365b99e54\" (UID: \"c1e26876-0533-45c3-b6d2-8de365b99e54\") "
Jul 21 17:55:28.330926 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:55:28.330880    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c1e26876-0533-45c3-b6d2-8de365b99e54-tls-certs\") pod \"c1e26876-0533-45c3-b6d2-8de365b99e54\" (UID: \"c1e26876-0533-45c3-b6d2-8de365b99e54\") "
Jul 21 17:55:28.330926 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:55:28.330921    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c1e26876-0533-45c3-b6d2-8de365b99e54-model-cache\") pod \"c1e26876-0533-45c3-b6d2-8de365b99e54\" (UID: \"c1e26876-0533-45c3-b6d2-8de365b99e54\") "
Jul 21 17:55:28.344629 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:55:28.330970    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c1e26876-0533-45c3-b6d2-8de365b99e54-dshm\") pod \"c1e26876-0533-45c3-b6d2-8de365b99e54\" (UID: \"c1e26876-0533-45c3-b6d2-8de365b99e54\") "
Jul 21 17:55:28.344629 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:55:28.331082    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c1e26876-0533-45c3-b6d2-8de365b99e54-home" (OuterVolumeSpecName: "home") pod "c1e26876-0533-45c3-b6d2-8de365b99e54" (UID: "c1e26876-0533-45c3-b6d2-8de365b99e54"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 17:55:28.344629 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:55:28.331159    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c1e26876-0533-45c3-b6d2-8de365b99e54-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "c1e26876-0533-45c3-b6d2-8de365b99e54" (UID: "c1e26876-0533-45c3-b6d2-8de365b99e54"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 17:55:28.344629 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:55:28.331196    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c1e26876-0533-45c3-b6d2-8de365b99e54-model-cache" (OuterVolumeSpecName: "model-cache") pod "c1e26876-0533-45c3-b6d2-8de365b99e54" (UID: "c1e26876-0533-45c3-b6d2-8de365b99e54"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 17:55:28.344629 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:55:28.331302    2575 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c1e26876-0533-45c3-b6d2-8de365b99e54-model-cache\") on node \"ip-10-0-141-39.ec2.internal\" DevicePath \"\""
Jul 21 17:55:28.344629 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:55:28.331314    2575 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c1e26876-0533-45c3-b6d2-8de365b99e54-home\") on node \"ip-10-0-141-39.ec2.internal\" DevicePath \"\""
Jul 21 17:55:28.344629 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:55:28.331338    2575 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c1e26876-0533-45c3-b6d2-8de365b99e54-tmp-dir\") on node \"ip-10-0-141-39.ec2.internal\" DevicePath \"\""
Jul 21 17:55:28.344629 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:55:28.333046    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c1e26876-0533-45c3-b6d2-8de365b99e54-dshm" (OuterVolumeSpecName: "dshm") pod "c1e26876-0533-45c3-b6d2-8de365b99e54" (UID: "c1e26876-0533-45c3-b6d2-8de365b99e54"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 17:55:28.344629 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:55:28.333052    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c1e26876-0533-45c3-b6d2-8de365b99e54-kube-api-access-qqz8t" (OuterVolumeSpecName: "kube-api-access-qqz8t") pod "c1e26876-0533-45c3-b6d2-8de365b99e54" (UID: "c1e26876-0533-45c3-b6d2-8de365b99e54"). InnerVolumeSpecName "kube-api-access-qqz8t". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 17:55:28.344629 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:55:28.333186    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c1e26876-0533-45c3-b6d2-8de365b99e54-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "c1e26876-0533-45c3-b6d2-8de365b99e54" (UID: "c1e26876-0533-45c3-b6d2-8de365b99e54"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 21 17:55:28.432360 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:55:28.432327    2575 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c1e26876-0533-45c3-b6d2-8de365b99e54-dshm\") on node \"ip-10-0-141-39.ec2.internal\" DevicePath \"\""
Jul 21 17:55:28.432360 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:55:28.432360    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qqz8t\" (UniqueName: \"kubernetes.io/projected/c1e26876-0533-45c3-b6d2-8de365b99e54-kube-api-access-qqz8t\") on node \"ip-10-0-141-39.ec2.internal\" DevicePath \"\""
Jul 21 17:55:28.432582 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:55:28.432376    2575 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c1e26876-0533-45c3-b6d2-8de365b99e54-tls-certs\") on node \"ip-10-0-141-39.ec2.internal\" DevicePath \"\""
Jul 21 17:55:28.707889 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:55:28.707795    2575 generic.go:356] "Generic (PLEG): container finished" podID="c1e26876-0533-45c3-b6d2-8de365b99e54" containerID="c6a3740177237e4a3646799ac167fb0858ed10b26de239aab9b7b707d7abc18d" exitCode=0
Jul 21 17:55:28.707889 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:55:28.707854    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-43413b/sub-test-model-43413b-kserve-57dc65f757-zntsx"
Jul 21 17:55:28.707889 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:55:28.707863    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-43413b/sub-test-model-43413b-kserve-57dc65f757-zntsx" event={"ID":"c1e26876-0533-45c3-b6d2-8de365b99e54","Type":"ContainerDied","Data":"c6a3740177237e4a3646799ac167fb0858ed10b26de239aab9b7b707d7abc18d"}
Jul 21 17:55:28.708113 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:55:28.707903    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-43413b/sub-test-model-43413b-kserve-57dc65f757-zntsx" event={"ID":"c1e26876-0533-45c3-b6d2-8de365b99e54","Type":"ContainerDied","Data":"dbad9ccb6476199ad7eb1a6ec6c5e41a798d364a110360d15d83cfc15e703574"}
Jul 21 17:55:28.708113 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:55:28.707924    2575 scope.go:117] "RemoveContainer" containerID="c6a3740177237e4a3646799ac167fb0858ed10b26de239aab9b7b707d7abc18d"
Jul 21 17:55:28.716996 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:55:28.716977    2575 scope.go:117] "RemoveContainer" containerID="c6a3740177237e4a3646799ac167fb0858ed10b26de239aab9b7b707d7abc18d"
Jul 21 17:55:28.717559 ip-10-0-141-39 kubenswrapper[2575]: E0721 17:55:28.717532    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c6a3740177237e4a3646799ac167fb0858ed10b26de239aab9b7b707d7abc18d\": container with ID starting with c6a3740177237e4a3646799ac167fb0858ed10b26de239aab9b7b707d7abc18d not found: ID does not exist" containerID="c6a3740177237e4a3646799ac167fb0858ed10b26de239aab9b7b707d7abc18d"
Jul 21 17:55:28.717666 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:55:28.717569    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c6a3740177237e4a3646799ac167fb0858ed10b26de239aab9b7b707d7abc18d"} err="failed to get container status \"c6a3740177237e4a3646799ac167fb0858ed10b26de239aab9b7b707d7abc18d\": rpc error: code = NotFound desc = could not find container \"c6a3740177237e4a3646799ac167fb0858ed10b26de239aab9b7b707d7abc18d\": container with ID starting with c6a3740177237e4a3646799ac167fb0858ed10b26de239aab9b7b707d7abc18d not found: ID does not exist"
Jul 21 17:55:28.731243 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:55:28.731219    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-43413b/sub-test-model-43413b-kserve-57dc65f757-zntsx"]
Jul 21 17:55:28.735320 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:55:28.735291    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-43413b/sub-test-model-43413b-kserve-57dc65f757-zntsx"]
Jul 21 17:55:30.116891 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:55:30.116856    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c1e26876-0533-45c3-b6d2-8de365b99e54" path="/var/lib/kubelet/pods/c1e26876-0533-45c3-b6d2-8de365b99e54/volumes"
Jul 21 17:56:17.955506 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:56:17.955464    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-43413b/rate-test-model-43413b-kserve-69659d8987-lxxmr"]
Jul 21 17:56:32.976278 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:56:32.976241    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-43413b/rate-test-model-43413b-kserve-69659d8987-lxxmr" podUID="a0a5bd3d-4151-462a-953a-6fd65be641ca" containerName="main" containerID="cri-o://4642758b262b552fc07d8ce77318d4a69de737d8854ec5b6dedbc7b059eca7e6" gracePeriod=45
Jul 21 17:56:33.222560 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:56:33.222539    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-43413b/rate-test-model-43413b-kserve-69659d8987-lxxmr"
Jul 21 17:56:33.316705 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:56:33.316678    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a0a5bd3d-4151-462a-953a-6fd65be641ca-model-cache\") pod \"a0a5bd3d-4151-462a-953a-6fd65be641ca\" (UID: \"a0a5bd3d-4151-462a-953a-6fd65be641ca\") "
Jul 21 17:56:33.316870 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:56:33.316715    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kzk8c\" (UniqueName: \"kubernetes.io/projected/a0a5bd3d-4151-462a-953a-6fd65be641ca-kube-api-access-kzk8c\") pod \"a0a5bd3d-4151-462a-953a-6fd65be641ca\" (UID: \"a0a5bd3d-4151-462a-953a-6fd65be641ca\") "
Jul 21 17:56:33.316870 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:56:33.316741    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a0a5bd3d-4151-462a-953a-6fd65be641ca-tmp-dir\") pod \"a0a5bd3d-4151-462a-953a-6fd65be641ca\" (UID: \"a0a5bd3d-4151-462a-953a-6fd65be641ca\") "
Jul 21 17:56:33.316870 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:56:33.316777    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a0a5bd3d-4151-462a-953a-6fd65be641ca-dshm\") pod \"a0a5bd3d-4151-462a-953a-6fd65be641ca\" (UID: \"a0a5bd3d-4151-462a-953a-6fd65be641ca\") "
Jul 21 17:56:33.316870 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:56:33.316796    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a0a5bd3d-4151-462a-953a-6fd65be641ca-home\") pod \"a0a5bd3d-4151-462a-953a-6fd65be641ca\" (UID: \"a0a5bd3d-4151-462a-953a-6fd65be641ca\") "
Jul 21 17:56:33.317076 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:56:33.316870    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a0a5bd3d-4151-462a-953a-6fd65be641ca-tls-certs\") pod \"a0a5bd3d-4151-462a-953a-6fd65be641ca\" (UID: \"a0a5bd3d-4151-462a-953a-6fd65be641ca\") "
Jul 21 17:56:33.317076 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:56:33.316936    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a0a5bd3d-4151-462a-953a-6fd65be641ca-model-cache" (OuterVolumeSpecName: "model-cache") pod "a0a5bd3d-4151-462a-953a-6fd65be641ca" (UID: "a0a5bd3d-4151-462a-953a-6fd65be641ca"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 17:56:33.317184 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:56:33.317074    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a0a5bd3d-4151-462a-953a-6fd65be641ca-home" (OuterVolumeSpecName: "home") pod "a0a5bd3d-4151-462a-953a-6fd65be641ca" (UID: "a0a5bd3d-4151-462a-953a-6fd65be641ca"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 17:56:33.317184 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:56:33.317089    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a0a5bd3d-4151-462a-953a-6fd65be641ca-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "a0a5bd3d-4151-462a-953a-6fd65be641ca" (UID: "a0a5bd3d-4151-462a-953a-6fd65be641ca"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 17:56:33.317261 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:56:33.317188    2575 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a0a5bd3d-4151-462a-953a-6fd65be641ca-model-cache\") on node \"ip-10-0-141-39.ec2.internal\" DevicePath \"\""
Jul 21 17:56:33.317261 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:56:33.317201    2575 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a0a5bd3d-4151-462a-953a-6fd65be641ca-tmp-dir\") on node \"ip-10-0-141-39.ec2.internal\" DevicePath \"\""
Jul 21 17:56:33.317261 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:56:33.317215    2575 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a0a5bd3d-4151-462a-953a-6fd65be641ca-home\") on node \"ip-10-0-141-39.ec2.internal\" DevicePath \"\""
Jul 21 17:56:33.318930 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:56:33.318902    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a0a5bd3d-4151-462a-953a-6fd65be641ca-kube-api-access-kzk8c" (OuterVolumeSpecName: "kube-api-access-kzk8c") pod "a0a5bd3d-4151-462a-953a-6fd65be641ca" (UID: "a0a5bd3d-4151-462a-953a-6fd65be641ca"). InnerVolumeSpecName "kube-api-access-kzk8c". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 17:56:33.319098 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:56:33.319080    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a0a5bd3d-4151-462a-953a-6fd65be641ca-dshm" (OuterVolumeSpecName: "dshm") pod "a0a5bd3d-4151-462a-953a-6fd65be641ca" (UID: "a0a5bd3d-4151-462a-953a-6fd65be641ca"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 17:56:33.319158 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:56:33.319113    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a0a5bd3d-4151-462a-953a-6fd65be641ca-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "a0a5bd3d-4151-462a-953a-6fd65be641ca" (UID: "a0a5bd3d-4151-462a-953a-6fd65be641ca"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 21 17:56:33.418086 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:56:33.418054    2575 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a0a5bd3d-4151-462a-953a-6fd65be641ca-tls-certs\") on node \"ip-10-0-141-39.ec2.internal\" DevicePath \"\""
Jul 21 17:56:33.418086 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:56:33.418080    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kzk8c\" (UniqueName: \"kubernetes.io/projected/a0a5bd3d-4151-462a-953a-6fd65be641ca-kube-api-access-kzk8c\") on node \"ip-10-0-141-39.ec2.internal\" DevicePath \"\""
Jul 21 17:56:33.418086 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:56:33.418090    2575 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a0a5bd3d-4151-462a-953a-6fd65be641ca-dshm\") on node \"ip-10-0-141-39.ec2.internal\" DevicePath \"\""
Jul 21 17:56:34.020243 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:56:34.020211    2575 generic.go:356] "Generic (PLEG): container finished" podID="a0a5bd3d-4151-462a-953a-6fd65be641ca" containerID="4642758b262b552fc07d8ce77318d4a69de737d8854ec5b6dedbc7b059eca7e6" exitCode=0
Jul 21 17:56:34.020243 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:56:34.020249    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-43413b/rate-test-model-43413b-kserve-69659d8987-lxxmr" event={"ID":"a0a5bd3d-4151-462a-953a-6fd65be641ca","Type":"ContainerDied","Data":"4642758b262b552fc07d8ce77318d4a69de737d8854ec5b6dedbc7b059eca7e6"}
Jul 21 17:56:34.020889 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:56:34.020259    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-43413b/rate-test-model-43413b-kserve-69659d8987-lxxmr"
Jul 21 17:56:34.020889 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:56:34.020277    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-43413b/rate-test-model-43413b-kserve-69659d8987-lxxmr" event={"ID":"a0a5bd3d-4151-462a-953a-6fd65be641ca","Type":"ContainerDied","Data":"363f4aa5764535f4cb27c421d48a85353cf3c66f2e11e650b4a67eed31514c19"}
Jul 21 17:56:34.020889 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:56:34.020295    2575 scope.go:117] "RemoveContainer" containerID="4642758b262b552fc07d8ce77318d4a69de737d8854ec5b6dedbc7b059eca7e6"
Jul 21 17:56:34.029872 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:56:34.029835    2575 scope.go:117] "RemoveContainer" containerID="4642758b262b552fc07d8ce77318d4a69de737d8854ec5b6dedbc7b059eca7e6"
Jul 21 17:56:34.030087 ip-10-0-141-39 kubenswrapper[2575]: E0721 17:56:34.030069    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4642758b262b552fc07d8ce77318d4a69de737d8854ec5b6dedbc7b059eca7e6\": container with ID starting with 4642758b262b552fc07d8ce77318d4a69de737d8854ec5b6dedbc7b059eca7e6 not found: ID does not exist" containerID="4642758b262b552fc07d8ce77318d4a69de737d8854ec5b6dedbc7b059eca7e6"
Jul 21 17:56:34.030147 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:56:34.030101    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4642758b262b552fc07d8ce77318d4a69de737d8854ec5b6dedbc7b059eca7e6"} err="failed to get container status \"4642758b262b552fc07d8ce77318d4a69de737d8854ec5b6dedbc7b059eca7e6\": rpc error: code = NotFound desc = could not find container \"4642758b262b552fc07d8ce77318d4a69de737d8854ec5b6dedbc7b059eca7e6\": container with ID starting with 4642758b262b552fc07d8ce77318d4a69de737d8854ec5b6dedbc7b059eca7e6 not found: ID does not exist"
Jul 21 17:56:34.042540 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:56:34.042517    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-43413b/rate-test-model-43413b-kserve-69659d8987-lxxmr"]
Jul 21 17:56:34.049179 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:56:34.049154    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-43413b/rate-test-model-43413b-kserve-69659d8987-lxxmr"]
Jul 21 17:56:34.116565 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:56:34.116533    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a0a5bd3d-4151-462a-953a-6fd65be641ca" path="/var/lib/kubelet/pods/a0a5bd3d-4151-462a-953a-6fd65be641ca/volumes"
Jul 21 17:56:48.177358 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:56:48.177313    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-43413b-68dbcd55db-5pjn8"]
Jul 21 17:56:48.177990 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:56:48.177545    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-43413b-68dbcd55db-5pjn8" podUID="8e998c14-cd72-412e-820e-ae75977208bd" containerName="maas-api" containerID="cri-o://7581e778cf3b834a905d4e5ed8ad2cd695a598abf4ce8e05c76bc2fa862c25ea" gracePeriod=30
Jul 21 17:56:48.435803 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:56:48.435710    2575 prober.go:120] "Probe failed" probeType="Readiness" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-43413b-68dbcd55db-5pjn8" podUID="8e998c14-cd72-412e-820e-ae75977208bd" containerName="maas-api" probeResult="failure" output="Get \"https://10.134.0.48:8443/health\": dial tcp 10.134.0.48:8443: connect: connection refused"
Jul 21 17:56:48.627069 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:56:48.627039    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-43413b-68dbcd55db-5pjn8"
Jul 21 17:56:48.655063 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:56:48.655037    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9s2s5\" (UniqueName: \"kubernetes.io/projected/8e998c14-cd72-412e-820e-ae75977208bd-kube-api-access-9s2s5\") pod \"8e998c14-cd72-412e-820e-ae75977208bd\" (UID: \"8e998c14-cd72-412e-820e-ae75977208bd\") "
Jul 21 17:56:48.655233 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:56:48.655083    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8e998c14-cd72-412e-820e-ae75977208bd-openshift-service-ca\") pod \"8e998c14-cd72-412e-820e-ae75977208bd\" (UID: \"8e998c14-cd72-412e-820e-ae75977208bd\") "
Jul 21 17:56:48.655233 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:56:48.655108    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8e998c14-cd72-412e-820e-ae75977208bd-maas-api-tls\") pod \"8e998c14-cd72-412e-820e-ae75977208bd\" (UID: \"8e998c14-cd72-412e-820e-ae75977208bd\") "
Jul 21 17:56:48.655479 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:56:48.655454    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8e998c14-cd72-412e-820e-ae75977208bd-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "8e998c14-cd72-412e-820e-ae75977208bd" (UID: "8e998c14-cd72-412e-820e-ae75977208bd"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 17:56:48.657327 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:56:48.657298    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8e998c14-cd72-412e-820e-ae75977208bd-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "8e998c14-cd72-412e-820e-ae75977208bd" (UID: "8e998c14-cd72-412e-820e-ae75977208bd"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 21 17:56:48.657456 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:56:48.657355    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8e998c14-cd72-412e-820e-ae75977208bd-kube-api-access-9s2s5" (OuterVolumeSpecName: "kube-api-access-9s2s5") pod "8e998c14-cd72-412e-820e-ae75977208bd" (UID: "8e998c14-cd72-412e-820e-ae75977208bd"). InnerVolumeSpecName "kube-api-access-9s2s5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 17:56:48.756697 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:56:48.756670    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9s2s5\" (UniqueName: \"kubernetes.io/projected/8e998c14-cd72-412e-820e-ae75977208bd-kube-api-access-9s2s5\") on node \"ip-10-0-141-39.ec2.internal\" DevicePath \"\""
Jul 21 17:56:48.756697 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:56:48.756692    2575 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8e998c14-cd72-412e-820e-ae75977208bd-openshift-service-ca\") on node \"ip-10-0-141-39.ec2.internal\" DevicePath \"\""
Jul 21 17:56:48.756697 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:56:48.756701    2575 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8e998c14-cd72-412e-820e-ae75977208bd-maas-api-tls\") on node \"ip-10-0-141-39.ec2.internal\" DevicePath \"\""
Jul 21 17:56:49.089816 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:56:49.089731    2575 generic.go:356] "Generic (PLEG): container finished" podID="8e998c14-cd72-412e-820e-ae75977208bd" containerID="7581e778cf3b834a905d4e5ed8ad2cd695a598abf4ce8e05c76bc2fa862c25ea" exitCode=0
Jul 21 17:56:49.089816 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:56:49.089778    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-43413b-68dbcd55db-5pjn8"
Jul 21 17:56:49.089816 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:56:49.089801    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-43413b-68dbcd55db-5pjn8" event={"ID":"8e998c14-cd72-412e-820e-ae75977208bd","Type":"ContainerDied","Data":"7581e778cf3b834a905d4e5ed8ad2cd695a598abf4ce8e05c76bc2fa862c25ea"}
Jul 21 17:56:49.090058 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:56:49.089843    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-43413b-68dbcd55db-5pjn8" event={"ID":"8e998c14-cd72-412e-820e-ae75977208bd","Type":"ContainerDied","Data":"88c4c129da1b016d9b0de812b73c32b06c3e28ff6dba8e27459bbb568d8a8910"}
Jul 21 17:56:49.090058 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:56:49.089863    2575 scope.go:117] "RemoveContainer" containerID="7581e778cf3b834a905d4e5ed8ad2cd695a598abf4ce8e05c76bc2fa862c25ea"
Jul 21 17:56:49.099551 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:56:49.099530    2575 scope.go:117] "RemoveContainer" containerID="7581e778cf3b834a905d4e5ed8ad2cd695a598abf4ce8e05c76bc2fa862c25ea"
Jul 21 17:56:49.099796 ip-10-0-141-39 kubenswrapper[2575]: E0721 17:56:49.099777    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7581e778cf3b834a905d4e5ed8ad2cd695a598abf4ce8e05c76bc2fa862c25ea\": container with ID starting with 7581e778cf3b834a905d4e5ed8ad2cd695a598abf4ce8e05c76bc2fa862c25ea not found: ID does not exist" containerID="7581e778cf3b834a905d4e5ed8ad2cd695a598abf4ce8e05c76bc2fa862c25ea"
Jul 21 17:56:49.099846 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:56:49.099805    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7581e778cf3b834a905d4e5ed8ad2cd695a598abf4ce8e05c76bc2fa862c25ea"} err="failed to get container status \"7581e778cf3b834a905d4e5ed8ad2cd695a598abf4ce8e05c76bc2fa862c25ea\": rpc error: code = NotFound desc = could not find container \"7581e778cf3b834a905d4e5ed8ad2cd695a598abf4ce8e05c76bc2fa862c25ea\": container with ID starting with 7581e778cf3b834a905d4e5ed8ad2cd695a598abf4ce8e05c76bc2fa862c25ea not found: ID does not exist"
Jul 21 17:56:49.112115 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:56:49.112088    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-43413b-68dbcd55db-5pjn8"]
Jul 21 17:56:49.117095 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:56:49.117069    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-43413b-68dbcd55db-5pjn8"]
Jul 21 17:56:50.116836 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:56:50.116803    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8e998c14-cd72-412e-820e-ae75977208bd" path="/var/lib/kubelet/pods/8e998c14-cd72-412e-820e-ae75977208bd/volumes"
Jul 21 17:57:10.441470 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:57:10.441437    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-046b27-55bd467469-hsk4w"]
Jul 21 17:57:10.442372 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:57:10.442331    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-046b27-55bd467469-hsk4w" podUID="7288009f-192e-4009-b097-dc0f8d4df8ea" containerName="maas-api" containerID="cri-o://f7f55d7693c29bafb4b9d86f90cbfae938f585e7e6a442cd129be7d9c38bdd45" gracePeriod=30
Jul 21 17:57:10.890076 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:57:10.890054    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-046b27-55bd467469-hsk4w"
Jul 21 17:57:10.949463 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:57:10.949433    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-znbpq\" (UniqueName: \"kubernetes.io/projected/7288009f-192e-4009-b097-dc0f8d4df8ea-kube-api-access-znbpq\") pod \"7288009f-192e-4009-b097-dc0f8d4df8ea\" (UID: \"7288009f-192e-4009-b097-dc0f8d4df8ea\") "
Jul 21 17:57:10.949599 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:57:10.949514    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7288009f-192e-4009-b097-dc0f8d4df8ea-openshift-service-ca\") pod \"7288009f-192e-4009-b097-dc0f8d4df8ea\" (UID: \"7288009f-192e-4009-b097-dc0f8d4df8ea\") "
Jul 21 17:57:10.949599 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:57:10.949579    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7288009f-192e-4009-b097-dc0f8d4df8ea-maas-api-tls\") pod \"7288009f-192e-4009-b097-dc0f8d4df8ea\" (UID: \"7288009f-192e-4009-b097-dc0f8d4df8ea\") "
Jul 21 17:57:10.949850 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:57:10.949826    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7288009f-192e-4009-b097-dc0f8d4df8ea-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "7288009f-192e-4009-b097-dc0f8d4df8ea" (UID: "7288009f-192e-4009-b097-dc0f8d4df8ea"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 17:57:10.951734 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:57:10.951713    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7288009f-192e-4009-b097-dc0f8d4df8ea-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "7288009f-192e-4009-b097-dc0f8d4df8ea" (UID: "7288009f-192e-4009-b097-dc0f8d4df8ea"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 21 17:57:10.951866 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:57:10.951843    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7288009f-192e-4009-b097-dc0f8d4df8ea-kube-api-access-znbpq" (OuterVolumeSpecName: "kube-api-access-znbpq") pod "7288009f-192e-4009-b097-dc0f8d4df8ea" (UID: "7288009f-192e-4009-b097-dc0f8d4df8ea"). InnerVolumeSpecName "kube-api-access-znbpq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 17:57:11.050224 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:57:11.050198    2575 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7288009f-192e-4009-b097-dc0f8d4df8ea-maas-api-tls\") on node \"ip-10-0-141-39.ec2.internal\" DevicePath \"\""
Jul 21 17:57:11.050317 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:57:11.050226    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-znbpq\" (UniqueName: \"kubernetes.io/projected/7288009f-192e-4009-b097-dc0f8d4df8ea-kube-api-access-znbpq\") on node \"ip-10-0-141-39.ec2.internal\" DevicePath \"\""
Jul 21 17:57:11.050317 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:57:11.050240    2575 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7288009f-192e-4009-b097-dc0f8d4df8ea-openshift-service-ca\") on node \"ip-10-0-141-39.ec2.internal\" DevicePath \"\""
Jul 21 17:57:11.195092 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:57:11.195047    2575 generic.go:356] "Generic (PLEG): container finished" podID="7288009f-192e-4009-b097-dc0f8d4df8ea" containerID="f7f55d7693c29bafb4b9d86f90cbfae938f585e7e6a442cd129be7d9c38bdd45" exitCode=0
Jul 21 17:57:11.195409 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:57:11.195352    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-046b27-55bd467469-hsk4w"
Jul 21 17:57:11.195684 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:57:11.195373    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-046b27-55bd467469-hsk4w" event={"ID":"7288009f-192e-4009-b097-dc0f8d4df8ea","Type":"ContainerDied","Data":"f7f55d7693c29bafb4b9d86f90cbfae938f585e7e6a442cd129be7d9c38bdd45"}
Jul 21 17:57:11.195796 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:57:11.195713    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-046b27-55bd467469-hsk4w" event={"ID":"7288009f-192e-4009-b097-dc0f8d4df8ea","Type":"ContainerDied","Data":"1f947ad60bbd32931efad6a8ec2cf4492cca808ef7a119bf6391dbd6b1889764"}
Jul 21 17:57:11.195796 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:57:11.195742    2575 scope.go:117] "RemoveContainer" containerID="f7f55d7693c29bafb4b9d86f90cbfae938f585e7e6a442cd129be7d9c38bdd45"
Jul 21 17:57:11.205401 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:57:11.205383    2575 scope.go:117] "RemoveContainer" containerID="f7f55d7693c29bafb4b9d86f90cbfae938f585e7e6a442cd129be7d9c38bdd45"
Jul 21 17:57:11.205682 ip-10-0-141-39 kubenswrapper[2575]: E0721 17:57:11.205663    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f7f55d7693c29bafb4b9d86f90cbfae938f585e7e6a442cd129be7d9c38bdd45\": container with ID starting with f7f55d7693c29bafb4b9d86f90cbfae938f585e7e6a442cd129be7d9c38bdd45 not found: ID does not exist" containerID="f7f55d7693c29bafb4b9d86f90cbfae938f585e7e6a442cd129be7d9c38bdd45"
Jul 21 17:57:11.205733 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:57:11.205691    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f7f55d7693c29bafb4b9d86f90cbfae938f585e7e6a442cd129be7d9c38bdd45"} err="failed to get container status \"f7f55d7693c29bafb4b9d86f90cbfae938f585e7e6a442cd129be7d9c38bdd45\": rpc error: code = NotFound desc = could not find container \"f7f55d7693c29bafb4b9d86f90cbfae938f585e7e6a442cd129be7d9c38bdd45\": container with ID starting with f7f55d7693c29bafb4b9d86f90cbfae938f585e7e6a442cd129be7d9c38bdd45 not found: ID does not exist"
Jul 21 17:57:11.228989 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:57:11.228960    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-046b27-55bd467469-hsk4w"]
Jul 21 17:57:11.238832 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:57:11.238804    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-046b27-55bd467469-hsk4w"]
Jul 21 17:57:12.116497 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:57:12.116468    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7288009f-192e-4009-b097-dc0f8d4df8ea" path="/var/lib/kubelet/pods/7288009f-192e-4009-b097-dc0f8d4df8ea/volumes"
Jul 21 17:57:28.238492 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:57:28.238465    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-64ff86b949-jdvqb_deb4e91d-dbfd-4c48-986d-16526d41a946/manager/0.log"
Jul 21 17:57:28.611954 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:57:28.611923    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-65b498688-hkdhk_06e8fe36-9cbc-467f-9e2f-38a20111351c/copy-manifests/0.log"
Jul 21 17:57:28.619323 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:57:28.619300    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-65b498688-hkdhk_06e8fe36-9cbc-467f-9e2f-38a20111351c/manager/0.log"
Jul 21 17:57:29.235526 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:57:29.235495    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-86767987f9-52rc8_9c75a363-e217-4a69-bd09-aaa6e68d9080/maas-api/0.log"
Jul 21 17:57:29.354975 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:57:29.354947    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-29744250-kpgfg_38bf5016-b955-4c0f-8cbe-edcb50833f65/cleanup/0.log"
Jul 21 17:57:31.310698 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:57:31.310670    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-w4f7k_b150820a-6d2d-4426-82f1-6d8def164e1b/kuadrant-console-plugin/0.log"
Jul 21 17:57:31.563530 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:57:31.563453    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-hctdj_37daaf9f-e396-4287-a4e7-457b221672fb/manager/0.log"
Jul 21 17:57:32.425220 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:57:32.425176    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-589694fdcc-62dzq_94fa3ceb-0fc6-47f7-8847-af61b41903e4/kube-auth-proxy/0.log"
Jul 21 17:57:32.796313 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:57:32.796284    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7677b774bb-shdmw_4ba7de0b-5e3f-4462-babf-3b40fce63243/payload-pre-processing/0.log"
Jul 21 17:57:33.390025 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:57:33.389995    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-67d8d5d6d-44zt9_bc5082c4-f9c6-4f27-9d40-1992ae9aeb00/main/0.log"
Jul 21 17:57:33.624454 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:57:33.624429    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-598466548d-6vj7t_fb1096e4-f860-44e6-be7e-d90cbd760e04/main/0.log"
Jul 21 17:57:33.965703 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:57:33.965662    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-57fc66f697-86fxw_12e90958-152f-4416-bba2-e8f752fa09e9/main/0.log"
Jul 21 17:57:42.677592 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:57:42.677565    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-44fbg_7900e00a-7d30-4941-a177-1ce9da22deb3/global-pull-secret-syncer/0.log"
Jul 21 17:57:43.052471 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:57:43.052440    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-hbwdq_dacfd9ac-9516-4da2-ab9c-2629e4e6174e/konnectivity-agent/0.log"
Jul 21 17:57:43.148011 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:57:43.147983    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-141-39.ec2.internal_35d9bf4db485a74e935a67bfd9e0bd65/haproxy/0.log"
Jul 21 17:57:48.490389 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:57:48.490363    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-w4f7k_b150820a-6d2d-4426-82f1-6d8def164e1b/kuadrant-console-plugin/0.log"
Jul 21 17:57:48.755717 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:57:48.755629    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-hctdj_37daaf9f-e396-4287-a4e7-457b221672fb/manager/0.log"
Jul 21 17:57:50.854193 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:57:50.854160    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-56c5594674-m7w8f_eac8bdfe-0e8f-44d6-9a65-c65c9ad9a767/kube-state-metrics/0.log"
Jul 21 17:57:50.875135 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:57:50.875107    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-56c5594674-m7w8f_eac8bdfe-0e8f-44d6-9a65-c65c9ad9a767/kube-rbac-proxy-main/0.log"
Jul 21 17:57:50.896474 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:57:50.896446    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-56c5594674-m7w8f_eac8bdfe-0e8f-44d6-9a65-c65c9ad9a767/kube-rbac-proxy-self/0.log"
Jul 21 17:57:50.938851 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:57:50.938823    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-7c7644cb77-wflck_e93b6b24-7471-4420-a3ca-33e74b7797b7/metrics-server/0.log"
Jul 21 17:57:51.082770 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:57:51.082744    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-9k2gn_175fcf39-c159-4e24-885e-60190609aa71/node-exporter/0.log"
Jul 21 17:57:51.103705 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:57:51.103676    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-9k2gn_175fcf39-c159-4e24-885e-60190609aa71/kube-rbac-proxy/0.log"
Jul 21 17:57:51.125963 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:57:51.125892    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-9k2gn_175fcf39-c159-4e24-885e-60190609aa71/init-textfile/0.log"
Jul 21 17:57:51.302532 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:57:51.302502    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_9c1b74e2-0ca1-4a71-b530-6bc1536771b4/prometheus/0.log"
Jul 21 17:57:51.324192 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:57:51.324171    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_9c1b74e2-0ca1-4a71-b530-6bc1536771b4/config-reloader/0.log"
Jul 21 17:57:51.348674 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:57:51.348648    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_9c1b74e2-0ca1-4a71-b530-6bc1536771b4/thanos-sidecar/0.log"
Jul 21 17:57:51.368364 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:57:51.368338    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_9c1b74e2-0ca1-4a71-b530-6bc1536771b4/kube-rbac-proxy-web/0.log"
Jul 21 17:57:51.388678 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:57:51.388603    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_9c1b74e2-0ca1-4a71-b530-6bc1536771b4/kube-rbac-proxy/0.log"
Jul 21 17:57:51.408691 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:57:51.408663    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_9c1b74e2-0ca1-4a71-b530-6bc1536771b4/kube-rbac-proxy-thanos/0.log"
Jul 21 17:57:51.431530 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:57:51.431505    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_9c1b74e2-0ca1-4a71-b530-6bc1536771b4/init-config-reloader/0.log"
Jul 21 17:57:51.507922 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:57:51.507878    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-85574b5f49-zch68_229dd683-aaf1-4bde-8091-45e5d43360bc/prometheus-operator-admission-webhook/0.log"
Jul 21 17:57:52.670517 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:57:52.670485    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-rjthx/perf-node-gather-daemonset-tzxjv"]
Jul 21 17:57:52.671002 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:57:52.670978    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7288009f-192e-4009-b097-dc0f8d4df8ea" containerName="maas-api"
Jul 21 17:57:52.671002 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:57:52.670997    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="7288009f-192e-4009-b097-dc0f8d4df8ea" containerName="maas-api"
Jul 21 17:57:52.671119 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:57:52.671010    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a0a5bd3d-4151-462a-953a-6fd65be641ca" containerName="main"
Jul 21 17:57:52.671119 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:57:52.671018    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="a0a5bd3d-4151-462a-953a-6fd65be641ca" containerName="main"
Jul 21 17:57:52.671119 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:57:52.671051    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8e998c14-cd72-412e-820e-ae75977208bd" containerName="maas-api"
Jul 21 17:57:52.671119 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:57:52.671061    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="8e998c14-cd72-412e-820e-ae75977208bd" containerName="maas-api"
Jul 21 17:57:52.671119 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:57:52.671076    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c1e26876-0533-45c3-b6d2-8de365b99e54" containerName="main"
Jul 21 17:57:52.671119 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:57:52.671084    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="c1e26876-0533-45c3-b6d2-8de365b99e54" containerName="main"
Jul 21 17:57:52.671404 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:57:52.671172    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="c1e26876-0533-45c3-b6d2-8de365b99e54" containerName="main"
Jul 21 17:57:52.671404 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:57:52.671185    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="8e998c14-cd72-412e-820e-ae75977208bd" containerName="maas-api"
Jul 21 17:57:52.671404 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:57:52.671197    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="7288009f-192e-4009-b097-dc0f8d4df8ea" containerName="maas-api"
Jul 21 17:57:52.671404 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:57:52.671207    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="a0a5bd3d-4151-462a-953a-6fd65be641ca" containerName="main"
Jul 21 17:57:52.674510 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:57:52.674490    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-rjthx/perf-node-gather-daemonset-tzxjv"
Jul 21 17:57:52.677362 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:57:52.677345    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-rjthx\"/\"openshift-service-ca.crt\""
Jul 21 17:57:52.677362 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:57:52.677352    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-rjthx\"/\"kube-root-ca.crt\""
Jul 21 17:57:52.678159 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:57:52.678145    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-rjthx\"/\"default-dockercfg-d9sl7\""
Jul 21 17:57:52.682038 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:57:52.682019    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-rjthx/perf-node-gather-daemonset-tzxjv"]
Jul 21 17:57:52.722303 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:57:52.722266    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/b8454228-a745-4a0c-8636-a29bb3e1aeac-podres\") pod \"perf-node-gather-daemonset-tzxjv\" (UID: \"b8454228-a745-4a0c-8636-a29bb3e1aeac\") " pod="openshift-must-gather-rjthx/perf-node-gather-daemonset-tzxjv"
Jul 21 17:57:52.722537 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:57:52.722338    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g9hbs\" (UniqueName: \"kubernetes.io/projected/b8454228-a745-4a0c-8636-a29bb3e1aeac-kube-api-access-g9hbs\") pod \"perf-node-gather-daemonset-tzxjv\" (UID: \"b8454228-a745-4a0c-8636-a29bb3e1aeac\") " pod="openshift-must-gather-rjthx/perf-node-gather-daemonset-tzxjv"
Jul 21 17:57:52.722537 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:57:52.722392    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b8454228-a745-4a0c-8636-a29bb3e1aeac-sys\") pod \"perf-node-gather-daemonset-tzxjv\" (UID: \"b8454228-a745-4a0c-8636-a29bb3e1aeac\") " pod="openshift-must-gather-rjthx/perf-node-gather-daemonset-tzxjv"
Jul 21 17:57:52.722537 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:57:52.722406    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/b8454228-a745-4a0c-8636-a29bb3e1aeac-proc\") pod \"perf-node-gather-daemonset-tzxjv\" (UID: \"b8454228-a745-4a0c-8636-a29bb3e1aeac\") " pod="openshift-must-gather-rjthx/perf-node-gather-daemonset-tzxjv"
Jul 21 17:57:52.722537 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:57:52.722469    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b8454228-a745-4a0c-8636-a29bb3e1aeac-lib-modules\") pod \"perf-node-gather-daemonset-tzxjv\" (UID: \"b8454228-a745-4a0c-8636-a29bb3e1aeac\") " pod="openshift-must-gather-rjthx/perf-node-gather-daemonset-tzxjv"
Jul 21 17:57:52.823144 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:57:52.823100    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b8454228-a745-4a0c-8636-a29bb3e1aeac-sys\") pod \"perf-node-gather-daemonset-tzxjv\" (UID: \"b8454228-a745-4a0c-8636-a29bb3e1aeac\") " pod="openshift-must-gather-rjthx/perf-node-gather-daemonset-tzxjv"
Jul 21 17:57:52.823144 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:57:52.823141    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/b8454228-a745-4a0c-8636-a29bb3e1aeac-proc\") pod \"perf-node-gather-daemonset-tzxjv\" (UID: \"b8454228-a745-4a0c-8636-a29bb3e1aeac\") " pod="openshift-must-gather-rjthx/perf-node-gather-daemonset-tzxjv"
Jul 21 17:57:52.823389 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:57:52.823163    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b8454228-a745-4a0c-8636-a29bb3e1aeac-lib-modules\") pod \"perf-node-gather-daemonset-tzxjv\" (UID: \"b8454228-a745-4a0c-8636-a29bb3e1aeac\") " pod="openshift-must-gather-rjthx/perf-node-gather-daemonset-tzxjv"
Jul 21 17:57:52.823389 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:57:52.823228    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/b8454228-a745-4a0c-8636-a29bb3e1aeac-podres\") pod \"perf-node-gather-daemonset-tzxjv\" (UID: \"b8454228-a745-4a0c-8636-a29bb3e1aeac\") " pod="openshift-must-gather-rjthx/perf-node-gather-daemonset-tzxjv"
Jul 21 17:57:52.823389 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:57:52.823244    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/b8454228-a745-4a0c-8636-a29bb3e1aeac-proc\") pod \"perf-node-gather-daemonset-tzxjv\" (UID: \"b8454228-a745-4a0c-8636-a29bb3e1aeac\") " pod="openshift-must-gather-rjthx/perf-node-gather-daemonset-tzxjv"
Jul 21 17:57:52.823389 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:57:52.823243    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b8454228-a745-4a0c-8636-a29bb3e1aeac-sys\") pod \"perf-node-gather-daemonset-tzxjv\" (UID: \"b8454228-a745-4a0c-8636-a29bb3e1aeac\") " pod="openshift-must-gather-rjthx/perf-node-gather-daemonset-tzxjv"
Jul 21 17:57:52.823389 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:57:52.823298    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b8454228-a745-4a0c-8636-a29bb3e1aeac-lib-modules\") pod \"perf-node-gather-daemonset-tzxjv\" (UID: \"b8454228-a745-4a0c-8636-a29bb3e1aeac\") " pod="openshift-must-gather-rjthx/perf-node-gather-daemonset-tzxjv"
Jul 21 17:57:52.823389 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:57:52.823310    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/b8454228-a745-4a0c-8636-a29bb3e1aeac-podres\") pod \"perf-node-gather-daemonset-tzxjv\" (UID: \"b8454228-a745-4a0c-8636-a29bb3e1aeac\") " pod="openshift-must-gather-rjthx/perf-node-gather-daemonset-tzxjv"
Jul 21 17:57:52.823389 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:57:52.823355    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g9hbs\" (UniqueName: \"kubernetes.io/projected/b8454228-a745-4a0c-8636-a29bb3e1aeac-kube-api-access-g9hbs\") pod \"perf-node-gather-daemonset-tzxjv\" (UID: \"b8454228-a745-4a0c-8636-a29bb3e1aeac\") " pod="openshift-must-gather-rjthx/perf-node-gather-daemonset-tzxjv"
Jul 21 17:57:52.833073 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:57:52.833051    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g9hbs\" (UniqueName: \"kubernetes.io/projected/b8454228-a745-4a0c-8636-a29bb3e1aeac-kube-api-access-g9hbs\") pod \"perf-node-gather-daemonset-tzxjv\" (UID: \"b8454228-a745-4a0c-8636-a29bb3e1aeac\") " pod="openshift-must-gather-rjthx/perf-node-gather-daemonset-tzxjv"
Jul 21 17:57:52.985277 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:57:52.985188    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-rjthx/perf-node-gather-daemonset-tzxjv"
Jul 21 17:57:53.126534 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:57:53.126499    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-rjthx/perf-node-gather-daemonset-tzxjv"]
Jul 21 17:57:53.129322 ip-10-0-141-39 kubenswrapper[2575]: W0721 17:57:53.129297    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podb8454228_a745_4a0c_8636_a29bb3e1aeac.slice/crio-d6421e89edd0618d093bae11e343f2690b55b2f0955e5af0a48e1329e5b8d06e WatchSource:0}: Error finding container d6421e89edd0618d093bae11e343f2690b55b2f0955e5af0a48e1329e5b8d06e: Status 404 returned error can't find the container with id d6421e89edd0618d093bae11e343f2690b55b2f0955e5af0a48e1329e5b8d06e
Jul 21 17:57:53.388497 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:57:53.388463    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-rjthx/perf-node-gather-daemonset-tzxjv" event={"ID":"b8454228-a745-4a0c-8636-a29bb3e1aeac","Type":"ContainerStarted","Data":"86cca72a1704e18f0246293e0e3c784b6e70ee273661aeb8d8ab037f9033ac5f"}
Jul 21 17:57:53.388706 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:57:53.388526    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-rjthx/perf-node-gather-daemonset-tzxjv" event={"ID":"b8454228-a745-4a0c-8636-a29bb3e1aeac","Type":"ContainerStarted","Data":"d6421e89edd0618d093bae11e343f2690b55b2f0955e5af0a48e1329e5b8d06e"}
Jul 21 17:57:53.388706 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:57:53.388571    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-rjthx/perf-node-gather-daemonset-tzxjv"
Jul 21 17:57:53.408114 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:57:53.408055    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-rjthx/perf-node-gather-daemonset-tzxjv" podStartSLOduration=1.40803828 podStartE2EDuration="1.40803828s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-21 17:57:52 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 17:57:53.40705595 +0000 UTC m=+2965.861208612" watchObservedRunningTime="2026-07-21 17:57:53.40803828 +0000 UTC m=+2965.862190898"
Jul 21 17:57:55.793183 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:57:55.793151    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-bqg65_bb79e03c-062a-4642-8d8c-7803a581a97a/dns/0.log"
Jul 21 17:57:55.814366 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:57:55.814341    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-bqg65_bb79e03c-062a-4642-8d8c-7803a581a97a/kube-rbac-proxy/0.log"
Jul 21 17:57:55.880898 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:57:55.880873    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-qmbvr_7533c67e-e7ed-4836-8a8b-a670200cccba/dns-node-resolver/0.log"
Jul 21 17:57:56.421912 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:57:56.421885    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-57dbbfd699-mb69j_ccc7bf0b-87e4-4eae-8e6a-4b61193af05d/registry/0.log"
Jul 21 17:57:56.443190 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:57:56.443166    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-d7gn6_72cdbb9c-0664-46c0-ab7c-4f38ebd7644f/node-ca/0.log"
Jul 21 17:57:57.659444 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:57:57.659403    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-589694fdcc-62dzq_94fa3ceb-0fc6-47f7-8847-af61b41903e4/kube-auth-proxy/0.log"
Jul 21 17:57:57.779799 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:57:57.779769    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7677b774bb-shdmw_4ba7de0b-5e3f-4462-babf-3b40fce63243/payload-pre-processing/0.log"
Jul 21 17:57:58.550740 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:57:58.550711    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-bc6dr_93f2422b-be81-4dc7-8d57-5a51f0cd2c55/serve-healthcheck-canary/0.log"
Jul 21 17:57:59.076763 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:57:59.076732    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-84m9r_3928ed50-aedd-4f2b-bc1f-cea69ea7b4b2/kube-rbac-proxy/0.log"
Jul 21 17:57:59.099410 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:57:59.099385    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-84m9r_3928ed50-aedd-4f2b-bc1f-cea69ea7b4b2/exporter/0.log"
Jul 21 17:57:59.122282 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:57:59.122254    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-84m9r_3928ed50-aedd-4f2b-bc1f-cea69ea7b4b2/extractor/0.log"
Jul 21 17:57:59.403583 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:57:59.403518    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-rjthx/perf-node-gather-daemonset-tzxjv"
Jul 21 17:58:01.758763 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:58:01.758686    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-64ff86b949-jdvqb_deb4e91d-dbfd-4c48-986d-16526d41a946/manager/0.log"
Jul 21 17:58:01.887030 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:58:01.887000    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-65b498688-hkdhk_06e8fe36-9cbc-467f-9e2f-38a20111351c/manager/0.log"
Jul 21 17:58:01.911342 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:58:01.911316    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-65b498688-hkdhk_06e8fe36-9cbc-467f-9e2f-38a20111351c/copy-manifests/0.log"
Jul 21 17:58:03.349333 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:58:03.349307    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-589694fdcc-62dzq_94fa3ceb-0fc6-47f7-8847-af61b41903e4/kube-auth-proxy/0.log"
Jul 21 17:58:03.450975 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:58:03.450950    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7677b774bb-shdmw_4ba7de0b-5e3f-4462-babf-3b40fce63243/payload-pre-processing/0.log"
Jul 21 17:58:03.472017 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:58:03.471988    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-646df98c5d-wzk9k_bea11817-7413-42c3-b7b5-530fce83f672/manager/0.log"
Jul 21 17:58:05.024583 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:58:05.024538    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-589694fdcc-62dzq_94fa3ceb-0fc6-47f7-8847-af61b41903e4/kube-auth-proxy/0.log"
Jul 21 17:58:05.129203 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:58:05.129177    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7677b774bb-shdmw_4ba7de0b-5e3f-4462-babf-3b40fce63243/payload-pre-processing/0.log"
Jul 21 17:58:08.616974 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:58:08.616950    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-7cc9c7ffd7-tg868_123fc2cb-18cb-4992-a1f3-b764922b6e3d/migrator/0.log"
Jul 21 17:58:08.638274 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:58:08.638244    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-7cc9c7ffd7-tg868_123fc2cb-18cb-4992-a1f3-b764922b6e3d/graceful-termination/0.log"
Jul 21 17:58:10.223259 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:58:10.223181    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-jmsnn_0af1b5ce-5a4d-4cc2-a9ef-ac31ed1f07ca/kube-multus-additional-cni-plugins/0.log"
Jul 21 17:58:10.264038 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:58:10.264007    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-jmsnn_0af1b5ce-5a4d-4cc2-a9ef-ac31ed1f07ca/egress-router-binary-copy/0.log"
Jul 21 17:58:10.291241 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:58:10.291217    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-jmsnn_0af1b5ce-5a4d-4cc2-a9ef-ac31ed1f07ca/cni-plugins/0.log"
Jul 21 17:58:10.324078 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:58:10.324052    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-jmsnn_0af1b5ce-5a4d-4cc2-a9ef-ac31ed1f07ca/bond-cni-plugin/0.log"
Jul 21 17:58:10.353168 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:58:10.353139    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-jmsnn_0af1b5ce-5a4d-4cc2-a9ef-ac31ed1f07ca/routeoverride-cni/0.log"
Jul 21 17:58:10.379047 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:58:10.379023    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-jmsnn_0af1b5ce-5a4d-4cc2-a9ef-ac31ed1f07ca/whereabouts-cni-bincopy/0.log"
Jul 21 17:58:10.410270 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:58:10.410241    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-jmsnn_0af1b5ce-5a4d-4cc2-a9ef-ac31ed1f07ca/whereabouts-cni/0.log"
Jul 21 17:58:10.989499 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:58:10.989465    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-wzxwp_0db4134e-c6f4-4665-9268-90a3569ccb73/kube-multus/0.log"
Jul 21 17:58:11.015249 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:58:11.015222    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-n98c6_75e3f13b-b4dd-479c-b305-420ec10c39d7/network-metrics-daemon/0.log"
Jul 21 17:58:11.043880 ip-10-0-141-39 kubenswrapper[2575]: I0721 17:58:11.043858    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-n98c6_75e3f13b-b4dd-479c-b305-420ec10c39d7/kube-rbac-proxy/0.log"